Preface |
|
xi | |
About the Companion Website |
|
xv | |
|
1 A Review of Elementary Matrix Algebra |
|
|
1 | (34) |
|
|
1 | (1) |
|
1.2 Definitions and Notation |
|
|
1 | (1) |
|
1.3 Matrix Addition and Multiplication |
|
|
2 | (1) |
|
|
3 | (1) |
|
|
4 | (1) |
|
|
5 | (4) |
|
|
9 | (3) |
|
|
12 | (2) |
|
|
14 | (1) |
|
|
15 | (1) |
|
|
16 | (2) |
|
|
18 | (1) |
|
1.13 Random Vectors and Some Related Statistical Concepts |
|
|
19 | (16) |
|
|
29 | (6) |
|
|
35 | (60) |
|
|
35 | (1) |
|
|
35 | (7) |
|
2.3 Linear Independence and Dependence |
|
|
42 | (3) |
|
2.4 Matrix Rank and Linear Independence |
|
|
45 | (4) |
|
|
49 | (4) |
|
2.6 Orthonormal Bases and Projections |
|
|
53 | (5) |
|
|
58 | (7) |
|
2.8 Linear Transformations and Systems of Linear Equations |
|
|
65 | (8) |
|
2.9 The Intersection and Sum of Vector Spaces |
|
|
73 | (3) |
|
|
76 | (4) |
|
|
80 | (15) |
|
|
85 | (10) |
|
3 Eigenvalues and Eigenvectors |
|
|
95 | (60) |
|
|
95 | (1) |
|
3.2 Eigenvalues, Eigenvectors, and Eigenspaces |
|
|
95 | (4) |
|
3.3 Some Basic Properties of Eigenvalues and Eigenvectors |
|
|
99 | (7) |
|
|
106 | (8) |
|
3.5 Continuity of Eigenvalues and Eigenprojections |
|
|
114 | (2) |
|
3.6 Extremal Properties of Eigenvalues |
|
|
116 | (7) |
|
3.7 Additional Results Concerning Eigenvalues Of Symmetric Matrices |
|
|
123 | (6) |
|
3.8 Nonnegative Definite Matrices |
|
|
129 | (12) |
|
3.9 Antieigenvalues and Antieigenvectors |
|
|
141 | (14) |
|
|
144 | (11) |
|
4 Matrix Factorizations and Matrix Norms |
|
|
155 | (46) |
|
|
155 | (1) |
|
4.2 The Singular Value Decomposition |
|
|
155 | (7) |
|
4.3 The Spectral Decomposition of a Symmetric Matrix |
|
|
162 | (7) |
|
4.4 The Diagonalization of a Square Matrix |
|
|
169 | (4) |
|
4.5 The Jordan Decomposition |
|
|
173 | (2) |
|
4.6 The Schur Decomposition |
|
|
175 | (3) |
|
4.7 The Simultaneous Diagonalization of Two Symmetric Matrices |
|
|
178 | (6) |
|
|
184 | (17) |
|
|
191 | (10) |
|
|
201 | (46) |
|
|
201 | (1) |
|
5.2 The Moore-Penrose Generalized Inverse |
|
|
202 | (3) |
|
5.3 Some Basic Properties of the Moore-Penrose Inverse |
|
|
205 | (6) |
|
5.4 The Moore--Penrose Inverse of a Matrix Product |
|
|
211 | (4) |
|
5.5 The Moore--Penrose Inverse of Partitioned Matrices |
|
|
215 | (4) |
|
5.6 The Moore--Penrose Inverse of a Sum |
|
|
219 | (3) |
|
5.7 The Continuity of the Moore--Penrose Inverse |
|
|
222 | (2) |
|
5.8 Some Other Generalized Inverses |
|
|
224 | (8) |
|
5.9 Computing Generalized Inverses |
|
|
232 | (15) |
|
|
238 | (9) |
|
6 Systems of Linear Equations |
|
|
247 | (38) |
|
|
247 | (1) |
|
6.2 Consistency of a System of Equations |
|
|
247 | (4) |
|
6.3 Solutions to a Consistent System of Equations |
|
|
251 | (7) |
|
6.4 Homogeneous Systems of Equations |
|
|
258 | (2) |
|
6.5 Least Squares Solutions to a System of Linear Equations |
|
|
260 | (6) |
|
6.6 Least Squares Estimation For Less Than Full Rank Models |
|
|
266 | (5) |
|
6.7 Systems of Linear Equations and The Singular Value Decomposition |
|
|
271 | (2) |
|
6.8 Sparse Linear Systems of Equations |
|
|
273 | (12) |
|
|
278 | (7) |
|
|
285 | (30) |
|
|
285 | (1) |
|
|
285 | (3) |
|
|
288 | (8) |
|
|
296 | (2) |
|
|
298 | (4) |
|
|
302 | (13) |
|
|
307 | (8) |
|
8 Special Matrices and Matrix Operations |
|
|
315 | (72) |
|
|
315 | (1) |
|
8.2 The Kronecker Product |
|
|
315 | (8) |
|
|
323 | (1) |
|
|
323 | (6) |
|
|
329 | (10) |
|
8.6 The Commutation Matrix |
|
|
339 | (7) |
|
8.7 Some Other Matrices Associated With the Vec Operator |
|
|
346 | (5) |
|
|
351 | (12) |
|
8.9 Circulant and Toeplitz Matrices |
|
|
363 | (6) |
|
8.10 Hadamard and Vandermonde Matrices |
|
|
369 | (18) |
|
|
373 | (14) |
|
9 Matrix Derivatives and Related Topics |
|
|
387 | (46) |
|
|
387 | (1) |
|
9.2 Multivariable Differential Calculus |
|
|
387 | (3) |
|
9.3 Vector and Matrix Functions |
|
|
390 | (6) |
|
9.4 Some Useful Matrix Derivatives |
|
|
396 | (4) |
|
9.5 Derivatives of Functions of Patterned Matrices |
|
|
400 | (2) |
|
9.6 The Perturbation Method |
|
|
402 | (7) |
|
|
409 | (4) |
|
9.8 Convex and Concave Functions |
|
|
413 | (4) |
|
9.9 The Method of Lagrange Multipliers |
|
|
417 | (16) |
|
|
423 | (10) |
|
|
433 | (24) |
|
|
433 | (1) |
|
|
433 | (11) |
|
10.3 Cauchy-Schwarz Inequalities |
|
|
444 | (2) |
|
|
446 | (4) |
|
10.5 Minkowski's Inequality |
|
|
450 | (2) |
|
10.6 The Arithmetic-Geometric Mean Inequality |
|
|
452 | (5) |
|
|
453 | (4) |
|
11 Some Special Topics Related to Quadratic Forms |
|
|
457 | (50) |
|
|
457 | (1) |
|
11.2 Some Results on Idempotent Matrices |
|
|
457 | (5) |
|
|
462 | (3) |
|
11.4 Distribution of Quadratic Forms in Normal Variates |
|
|
465 | (6) |
|
11.5 Independence of Quadratic Forms |
|
|
471 | (6) |
|
11.6 Expected Values of Quadratic Forms |
|
|
477 | (8) |
|
11.7 The Wishart Distribution |
|
|
485 | (22) |
|
|
496 | (11) |
References |
|
507 | (6) |
Index |
|
513 | |