Skip to main content

Systems of Inhomogeneous Linear Equations

  • Chapter
Computational Physics

Part of the book series: Graduate Texts in Physics ((GTP))

  • 84k Accesses

Abstract

Many problems in physics and especially computational physics involve systems of linear equations which arise e.g. from linearization of a general nonlinear problem or from discretization of differential equations. If the dimension of the system is not too large standard methods like Gaussian elimination or QR decomposition are sufficient. Systems with a tridiagonal matrix are important for cubic spline interpolation and numerical second derivatives. They can be solved very efficiently with a specialized Gaussian elimination method. Practical applications often involve very large dimensions and require iterative methods. Convergence of Jacobi and Gauss-Seidel methods is slow and can be improved by relaxation or over-relaxation. An alternative for large systems is the method of conjugate gradients.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 79.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Alternatively Givens rotations [108] can be employed which need slightly more floating point operations.

  2. 2.

    This algorithm is only well behaved if the matrix is diagonal dominant |b i |>|a i |+|c i |.

  3. 3.

    Here uv T is the outer or matrix product of the two vectors.

  4. 4.

    This is also known as the method of successive over-relaxation (SOR).

  5. 5.

    The vector norm used here is not necessarily the Euclidian norm.

  6. 6.

    Using the Frobenius norm \(\|A\|=\sqrt{\sum_{ij}A_{ij}^{2}}\).

References

  1. B. Beckermann, Numer. Math. 85, 553 (2000)

    Article  MathSciNet  MATH  Google Scholar 

  2. A. Bermann, S. Gueron, Math. Gaz. 86, 274 (2002)

    Article  Google Scholar 

  3. I.N. Bronshtein, K.A. Semendyayev, Handbook of Mathematics, 3rd edn. (Springer, New York, 1997), p. 892

    MATH  Google Scholar 

  4. J.W. Daniel, W.B. Gragg, L. Kaufmann, G.W. Stewart, Math. Comput. 30, 772 (1976)

    MATH  Google Scholar 

  5. G.H. Golub, C.F. Van Loan, Matrix Computations, 3rd edn. (Johns Hopkins University Press, Baltimore, 1976). ISBN 978-0-8018-5414-9

    Google Scholar 

  6. M.R. Hestenes, E. Stiefel, J. Res. Natl. Bur. Stand. 49, 435 (1952)

    Article  MathSciNet  Google Scholar 

  7. D. Hilbert, L. Nordheim, J. von Neumann, Math. Ann. 98, 1 (1927)

    Article  MATH  Google Scholar 

  8. H. Jeffreys, B.S. Jeffreys, Methods of Mathematical Physics, 3rd edn. (Cambridge University Press, Cambridge, 1988), pp. 305–306

    Google Scholar 

  9. W.H. Press, S.A. Teukolsky, W.T. Vetterling, B.P. Flannery, LU decomposition and its applications, in Numerical Recipes: The Art of Scientific Computing, 3rd edn. (Cambridge University Press, Cambridge, 2007), pp. 48–55

    Google Scholar 

  10. W.H. Press, S.A. Teukolsky, W.T. Vetterling, B.P. Flannery, Cholesky decomposition, in Numerical Recipes: The Art of Scientific Computing, 3rd edn. (Cambridge University Press, Cambridge, 2007), pp. 100–101

    Google Scholar 

  11. W.H. Press, S.A. Teukolsky, W.T. Vetterling, B.P. Flannery, Cyclic tridiagonal systems, in Numerical Recipes: The Art of Scientific Computing, 3rd edn. (Cambridge University Press, Cambridge, 2007), p. 79

    Google Scholar 

  12. W.H. Press, S.A. Teukolsky, W.T. Vetterling, B.P. Flannery, Relaxation mehods for boundary value problems, in Numerical Recipes: The Art of Scientific Computing, 3rd edn. (Cambridge University Press, Cambridge, 2007), pp. 1059–1065

    Google Scholar 

  13. I.R. Savage, E. Lukacs, in Contributions to the Solution of Systems of Linear Equations and the Determination of Eigenvalues, ed. by O. Taussky. National Bureau of Standards, Applied Mathematics Series, vol. 39 (1954)

    Google Scholar 

  14. J. Sherman, W.J. Morrison, Ann. Math. Stat. 20, 621 (1949)

    Google Scholar 

  15. J. Stör, R. Bulirsch, Introduction to Numerical Analysis, 3rd revised edn. (Springer, New York, 2010). ISBN 978-1441930064

    Google Scholar 

  16. L.N. Trefethen, D. Bau III, Numerical Linear Algebra (Society for Industrial and Applied Mathematics, Philadelphia, 1997), p. 1

    Book  MATH  Google Scholar 

  17. J.H. Wilkinson, J. ACM 8, 281 (1961)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Scherer, P.O.J. (2013). Systems of Inhomogeneous Linear Equations. In: Computational Physics. Graduate Texts in Physics. Springer, Heidelberg. https://doi.org/10.1007/978-3-319-00401-3_5

Download citation

Publish with us

Policies and ethics