Preface |
|
ix | |
|
I. Linear Algebra Concepts and Matrix Decompositions |
|
|
|
Vectors and Matrices in Data Mining and Pattern Recognition |
|
|
3 | (10) |
|
Data Mining and Pattern Recognition |
|
|
3 | (1) |
|
|
4 | (3) |
|
|
7 | (1) |
|
|
8 | (1) |
|
Floating Point Computations |
|
|
8 | (3) |
|
|
11 | (2) |
|
|
13 | (10) |
|
Matrix-Vector Multiplication |
|
|
13 | (2) |
|
Matrix-Matrix Multiplication |
|
|
15 | (2) |
|
Inner Product and Vector Norms |
|
|
17 | (1) |
|
|
18 | (2) |
|
Linear Independence: Bases |
|
|
20 | (1) |
|
|
21 | (2) |
|
Linear Systems and Least Squares |
|
|
23 | (14) |
|
|
23 | (2) |
|
Symmetric, Positive Definite Matrices |
|
|
25 | (1) |
|
Perturbation Theory and Condition Number |
|
|
26 | (1) |
|
Rounding Errors in Gaussian Elimination |
|
|
27 | (2) |
|
|
29 | (2) |
|
The Least Squares Problem |
|
|
31 | (6) |
|
|
37 | (10) |
|
Orthogonal Vectors and Matrices |
|
|
38 | (2) |
|
Elementary Orthogonal Matrices |
|
|
40 | (5) |
|
Number of Floating Point Operations |
|
|
45 | (1) |
|
Orthogonal Transformations in Floating Point Arithmetic |
|
|
46 | (1) |
|
|
47 | (10) |
|
Orthogonal Transformation to Triangular Form |
|
|
47 | (4) |
|
Solving the Least Squares Problem |
|
|
51 | (1) |
|
Computing or Not Computing Q |
|
|
52 | (1) |
|
Flop Count for QR Factorization |
|
|
53 | (1) |
|
Error in the Solution of the Least Squares Problem |
|
|
53 | (1) |
|
Updating the Solution of a Least Squares Problem |
|
|
54 | (3) |
|
Singular Value Decomposition |
|
|
57 | (18) |
|
|
57 | (4) |
|
|
61 | (2) |
|
|
63 | (3) |
|
Principal Component Analysis |
|
|
66 | (1) |
|
Solving Least Squares Problems |
|
|
66 | (3) |
|
Condition Number and Perturbation Theory for the Least Squares Problem |
|
|
69 | (1) |
|
Rank-Deficient and Underdetermined Systems |
|
|
70 | (2) |
|
|
72 | (1) |
|
Complete Orthogonal Decomposition |
|
|
72 | (3) |
|
Reduced-Rank Least Squares Models |
|
|
75 | (16) |
|
Truncated SVD: Principal Component Regression |
|
|
77 | (3) |
|
|
80 | (11) |
|
|
91 | (10) |
|
|
91 | (1) |
|
|
92 | (2) |
|
|
94 | (2) |
|
Approximating a Tensor by HOSVD |
|
|
96 | (5) |
|
Clustering and Nonnegative Matrix Factorization |
|
|
101 | (12) |
|
|
102 | (4) |
|
Nonnegative Matrix Factorization |
|
|
106 | (7) |
|
II. Data Mining Applications |
|
|
|
Classification of Handwritten Digits |
|
|
113 | (16) |
|
Handwritten Digits and a Simple Algorithm |
|
|
113 | (2) |
|
Classification Using SVD Bases |
|
|
115 | (7) |
|
|
122 | (7) |
|
|
129 | (18) |
|
Preprocessing the Documents and Queries |
|
|
130 | (1) |
|
|
131 | (4) |
|
|
135 | (4) |
|
|
139 | (2) |
|
Nonnegative Matrix Factorization |
|
|
141 | (1) |
|
|
142 | (3) |
|
|
145 | (2) |
|
Page Ranking for a Web Search Engine |
|
|
147 | (14) |
|
|
147 | (3) |
|
Random Walk and Markov Chains |
|
|
150 | (4) |
|
The Power Method for Pagerank Computation |
|
|
154 | (5) |
|
|
159 | (2) |
|
Automatic Key Word and Key Sentence Extraction |
|
|
161 | (8) |
|
|
161 | (4) |
|
Key Sentence Extraction from a Rank-k Approximation |
|
|
165 | (4) |
|
Face Recognition Using Tensor SVD |
|
|
169 | (10) |
|
|
169 | (3) |
|
|
172 | (3) |
|
Face Recognition with HOSVD Compression |
|
|
175 | (4) |
|
III. Computing the Matrix Decompositions |
|
|
|
Computing Eigenvalues and Singular Values |
|
|
179 | (30) |
|
|
180 | (5) |
|
The Power Method and Inverse Iteration |
|
|
185 | (2) |
|
Similarity Reduction to Tridiagonal Form |
|
|
187 | (2) |
|
The QR Algorithm for a Symmetric Tridiagonal Matrix |
|
|
189 | (7) |
|
|
196 | (1) |
|
The Nonsymmetric Eigenvalue Problem |
|
|
197 | (1) |
|
|
198 | (2) |
|
The Arnoldi and Lanczos Methods |
|
|
200 | (7) |
|
|
207 | (2) |
Bibliography |
|
209 | (8) |
Index |
|
217 | |