The underlying theory for linear systems is covered in numerous linear algebra textbooks. Some popular choices include those by Strang Strang (2016), Lay Lay (2012), and Leon Leon (2006), but there are many other good choices.
More advanced texts specifically on numerical linear algebra include the classic texts by Trefethen and Bau Trefethen & III (1997) and Golub and Van Loan Golub & Van Loan (1996).
Numerical analysis of the fundamental algorithms is emphasized in Higham Higham (2002); there are many interesting quotations there as well. Here is a sample:
Many years ago we made out of half a dozen transformers a simple and rather inaccurate machine for solving simultaneous equations—the solutions being represented as flux in the cores of the transformers. During the course of our experiments we set the machine to solve the equations—
The machine reacted sharply—it blew the main fuse and put all the lights out. (B. V. Bowden, The Organization of a Typical Machine, 1953)
The reader may find historical information on numerical linear algebra of interest at the SIAM website, http://
- Strang, G. (2016). Introduction to Linear Algebra. Wellesley-Cambridge Press.
- Lay, D. C. (2012). Linear Algebra and Its Applications (4th ed). Addison-Wesley.
- Leon, S. J. (2006). Linear Algebra with Applications. Pearson Prentice Hall.
- Trefethen, L. N., & III, D. B. (1997). Numerical Linear Algebra. SIAM.
- Golub, G. H., & Van Loan, C. F. (1996). Matrix Computations (3rd ed.). JHU Press.