|
1 Introduction to 3D Computer Vision |
|
|
1 | (28) |
|
|
1 | (1) |
|
1.2 Imaging Geometry and Camera Models |
|
|
2 | (5) |
|
|
2 | (3) |
|
1.2.2 Single View Imaging Geometry |
|
|
5 | (2) |
|
1.3 Single View Metrology and Reconstruction |
|
|
7 | (10) |
|
1.3.1 Measurement on Space Planes |
|
|
8 | (1) |
|
1.3.2 Camera Calibration from a Single View |
|
|
9 | (2) |
|
1.3.3 Measurement in 3D Space |
|
|
11 | (3) |
|
1.3.4 Examples of Single View Reconstruction |
|
|
14 | (3) |
|
1.4 Two-View Geometry and 3D Reconstruction |
|
|
17 | (3) |
|
1.4.1 Epipolar Geometry and Fundamental Matrix |
|
|
17 | (1) |
|
1.4.2 Three Dimensional Reconstruction |
|
|
18 | (2) |
|
1.5 Reconstruction of Structured Seenes from Two Images |
|
|
20 | (6) |
|
1.5.1 Plane Detection Strategy |
|
|
20 | (4) |
|
1.5.2 Camera Calibration and Reconstruction |
|
|
24 | (2) |
|
|
26 | (3) |
|
|
26 | (1) |
|
|
26 | (1) |
|
|
27 | (2) |
|
2 Simplified Camera Projection Models |
|
|
29 | (14) |
|
|
29 | (1) |
|
2.2 Affine Projection Model |
|
|
30 | (3) |
|
2.3 Quasi-Perspective Projection Model |
|
|
33 | (5) |
|
2.3.1 Quasi-Perspective Projection |
|
|
33 | (3) |
|
2.3.2 Error Analysis of Different Models |
|
|
36 | (2) |
|
2.4 Experimental Evaluations |
|
|
38 | (2) |
|
|
39 | (1) |
|
2.4.2 Influence of Imaging Conditions |
|
|
39 | (1) |
|
|
40 | (3) |
|
|
40 | (1) |
|
|
41 | (1) |
|
|
41 | (2) |
|
3 Geometrical Properties of Quasi-Perspective Projection |
|
|
43 | (20) |
|
|
43 | (1) |
|
3.2 One-View Geometrical Property |
|
|
44 | (2) |
|
3.3 Two-View Geometrical Property |
|
|
46 | (6) |
|
|
47 | (3) |
|
3.3.2 Plane Induced Homography |
|
|
50 | (1) |
|
3.3.3 Computation with Outliers |
|
|
51 | (1) |
|
3.4 3D Structure Reconstruction |
|
|
52 | (1) |
|
3.5 Evaluations on Synthetic Data |
|
|
53 | (4) |
|
3.5.1 Fundamental Matrix and Homography |
|
|
54 | (1) |
|
|
55 | (1) |
|
3.5.3 Reconstruction Result |
|
|
55 | (2) |
|
3.6 Evaluations on Real Images |
|
|
57 | (3) |
|
3.6.1 Test on Stone Dragon Images |
|
|
57 | (2) |
|
3.6.2 Test on Medusa Head Images |
|
|
59 | (1) |
|
|
60 | (3) |
|
|
60 | (1) |
|
|
60 | (1) |
|
|
61 | (2) |
|
4 Introduction to Structure and Motion Factorization |
|
|
63 | (24) |
|
|
63 | (2) |
|
|
65 | (3) |
|
4.3 Structure and Motion Factorization of Rigid Objects |
|
|
68 | (4) |
|
4.3.1 Rigid Factorization Under Orthographic Projection |
|
|
68 | (3) |
|
4.3.2 Rigid Factorization Under Perspective Projection |
|
|
71 | (1) |
|
4.4 Structure and Motion Factorization of Nonrigid Objects |
|
|
72 | (7) |
|
4.4.1 Bregler's Deformation Model |
|
|
73 | (1) |
|
4.4.2 Nonrigid Factorization Under Affine Models |
|
|
74 | (3) |
|
4.4.3 Nonrigid Factorization Under Perspective Projection |
|
|
77 | (2) |
|
4.5 Factorization of Multi-Body and Articulated Objects |
|
|
79 | (4) |
|
4.5.1 Multi-Body Factorization |
|
|
79 | (3) |
|
4.5.2 Articulated Factorization |
|
|
82 | (1) |
|
|
83 | (4) |
|
|
83 | (1) |
|
|
83 | (1) |
|
|
84 | (3) |
|
5 Perspective 3D Reconstruction of Rigid Objects |
|
|
87 | (22) |
|
|
87 | (2) |
|
5.2 Previous Works on Projective Depths Recovery |
|
|
89 | (2) |
|
5.2.1 Epipolar Geometry Based Algorithm |
|
|
89 | (1) |
|
5.2.2 Iteration Based Algorithm |
|
|
90 | (1) |
|
5.3 Hybrid Projective Depths Recovery |
|
|
91 | (3) |
|
5.3.1 Initialization and Optimization |
|
|
91 | (2) |
|
5.3.2 Selection of Reference Frames |
|
|
93 | (1) |
|
5.4 Camera Calibration and Euclidean Reconstruction |
|
|
94 | (4) |
|
5.4.1 Camera Self-Calibration |
|
|
94 | (2) |
|
5.4.2 Euclidean Reconstruction |
|
|
96 | (1) |
|
5.4.3 Outline of the Algorithm |
|
|
97 | (1) |
|
5.5 Evaluations on Synthetic Data |
|
|
98 | (3) |
|
5.5.1 Projective Depths Recovery |
|
|
98 | (1) |
|
5.5.2 Calibration and Reconstruction |
|
|
99 | (2) |
|
5.6 Evaluations on Real Sequences |
|
|
101 | (4) |
|
5.6.1 Test on Model House Sequence |
|
|
102 | (1) |
|
5.6.2 Test on Stone Post Sequence |
|
|
103 | (1) |
|
5.6.3 Test on Medusa Head Sequence |
|
|
104 | (1) |
|
|
105 | (4) |
|
|
105 | (1) |
|
|
106 | (1) |
|
|
106 | (3) |
|
6 Perspective 3D Reconstruction of Nonrigid Objects |
|
|
109 | (16) |
|
|
109 | (1) |
|
6.2 Perspective Depth Scales and Nonrigid Factorization |
|
|
110 | (2) |
|
6.2.1 Perspective Depth Scales |
|
|
110 | (1) |
|
6.2.2 Nonrigid Affine Factorization |
|
|
111 | (1) |
|
6.3 Perspective Stratification |
|
|
112 | (3) |
|
6.3.1 Linear Recursive Estimation |
|
|
112 | (2) |
|
6.3.2 Nonlinear Optimization Algorithm |
|
|
114 | (1) |
|
6.4 Evaluations on Synthetic Data |
|
|
115 | (3) |
|
6.4.1 Reconstruction Results |
|
|
116 | (1) |
|
6.4.2 Convergence and Performance Comparisons |
|
|
116 | (2) |
|
6.5 Experiments with Real Sequence |
|
|
118 | (3) |
|
6.5.1 Test on Franck Sequence |
|
|
118 | (2) |
|
6.5.2 Test on Scarf Sequence |
|
|
120 | (1) |
|
|
121 | (4) |
|
|
121 | (1) |
|
|
122 | (1) |
|
|
122 | (3) |
|
7 Rotation Constrained Power Factorization |
|
|
125 | (16) |
|
|
125 | (1) |
|
7.2 Power Factorization for Rigid Objects |
|
|
126 | (1) |
|
7.3 Power Factorization for Nonrigid Objects |
|
|
127 | (5) |
|
7.3.1 Rotation Constrained Power Factorization |
|
|
128 | (2) |
|
7.3.2 Initialization and Convergence Determination |
|
|
130 | (1) |
|
7.3.3 Sequential Factorization |
|
|
131 | (1) |
|
7.4 Evaluations on Synthetic Data |
|
|
132 | (3) |
|
7.4.1 Reconstruction Results and Evaluations |
|
|
132 | (1) |
|
7.4.2 Convergence Property |
|
|
133 | (2) |
|
7.4.3 Influence of Imaging Conditions |
|
|
135 | (1) |
|
7.5 Evaluations on Real Sequences |
|
|
135 | (2) |
|
7.5.1 Test on Grid Sequence |
|
|
135 | (1) |
|
7.5.2 Test on Franck Sequence |
|
|
136 | (1) |
|
7.5.3 Test on Quilt Sequence |
|
|
137 | (1) |
|
|
137 | (4) |
|
|
137 | (1) |
|
|
138 | (1) |
|
|
139 | (2) |
|
8 Stratified Euclidean Reconstruction |
|
|
141 | (20) |
|
|
141 | (1) |
|
8.2 Deformation Weight Constraint |
|
|
142 | (5) |
|
8.2.1 Nonrigid Factorization |
|
|
142 | (1) |
|
8.2.2 Deformation Weight Constraint |
|
|
143 | (2) |
|
8.2.3 Geometrical Explanation |
|
|
145 | (2) |
|
8.3 Affine Structure and Motion Recovery |
|
|
147 | (2) |
|
8.3.1 Constrained Power Factorization |
|
|
147 | (1) |
|
8.3.2 Initialization and Convergence Determination |
|
|
148 | (1) |
|
8.4 Segmentation and Stratification |
|
|
149 | (3) |
|
8.4.1 Deformation Detection Strategy |
|
|
149 | (2) |
|
8.4.2 Stratification to Euclidean Space |
|
|
151 | (1) |
|
8.4.3 Implementation Outline |
|
|
151 | (1) |
|
8.5 Evaluations on Synthetic Data |
|
|
152 | (4) |
|
8.5.1 Reconstruction Results and Evaluations |
|
|
152 | (1) |
|
8.5.2 Convergence Property and Segmentation |
|
|
153 | (3) |
|
8.6 Evaluations on Real Sequences |
|
|
156 | (2) |
|
8.6.1 Test on Grid Sequence |
|
|
156 | (1) |
|
8.6.2 Test on Toy Sequence |
|
|
157 | (1) |
|
|
158 | (3) |
|
|
158 | (1) |
|
|
159 | (1) |
|
|
159 | (2) |
|
9 Quasi-Perspective Factorization |
|
|
161 | (22) |
|
|
161 | (1) |
|
9.2 Background on Factorization |
|
|
162 | (2) |
|
9.3 Quasi-Perspective Rigid Factorization |
|
|
164 | (6) |
|
9.3.1 Euclidean Upgrading Matrix |
|
|
164 | (5) |
|
|
169 | (1) |
|
9.4 Quasi-Perspective Nonrigid Factorization |
|
|
170 | (3) |
|
9.4.1 Problem Formulation |
|
|
170 | (1) |
|
9.4.2 Euclidean Upgrading Matrix |
|
|
171 | (2) |
|
9.5 Evaluations on Synthetic Data |
|
|
173 | (3) |
|
9.5.1 Evaluation on Rigid Factorization |
|
|
173 | (2) |
|
9.5.2 Evaluation on Nonrigid Factorization |
|
|
175 | (1) |
|
9.6 Evaluations on Real Image Sequences |
|
|
176 | (3) |
|
9.6.1 Test on Fountain Base Sequence |
|
|
177 | (1) |
|
9.6.2 Test on Franck Sequence |
|
|
178 | (1) |
|
|
179 | (4) |
|
|
179 | (1) |
|
|
180 | (1) |
|
|
180 | (3) |
|
Appendix A Projective Geometry for Computer Vision |
|
|
183 | (8) |
|
A.1 2D Projective Geometry |
|
|
183 | (4) |
|
|
183 | (1) |
|
A.1.2 Conics and Duel Conics |
|
|
184 | (2) |
|
A.1.3 2D Projective Transformation |
|
|
186 | (1) |
|
A.2 3D Projective Geometry |
|
|
187 | (4) |
|
A.2.1 Points, Lines, and Planes |
|
|
187 | (2) |
|
A.2.2 Projective Transformation and Quadrics |
|
|
189 | (2) |
|
Appendix B Matrix Decomposition |
|
|
191 | (8) |
|
B.1 Singlular Value Decomposition |
|
|
191 | (3) |
|
B.1.1 Properties of SVD Decomposition |
|
|
192 | (1) |
|
B.1.2 Low-Rank Matrix Approximation |
|
|
193 | (1) |
|
B.2 QR and RQ Decompositions |
|
|
194 | (1) |
|
B.3 Symmetric and Skew-Symmetric Matrix |
|
|
195 | (4) |
|
|
195 | (1) |
|
B.3.2 Cholesky Decomposition |
|
|
196 | (1) |
|
B.3.3 Extended Cholesky Decomposition |
|
|
197 | (2) |
|
Appendix C Numerical Computation Method |
|
|
199 | (8) |
|
|
199 | (3) |
|
|
200 | (1) |
|
C.1.2 Deficient Rank System |
|
|
201 | (1) |
|
C.2 Nonlinear Estimation Methods |
|
|
202 | (5) |
|
|
202 | (1) |
|
|
203 | (1) |
|
C.2.3 Levenberg-Marquardt Algorithm |
|
|
204 | (3) |
References |
|
207 | (2) |
Glossary |
|
209 | (2) |
Index |
|
211 | |