Foreword |
|
xi | |
Preface |
|
xiii | |
|
|
1 | (14) |
|
1 Research Issues on Learning in Computer Vision |
|
|
2 | (4) |
|
|
6 | (6) |
|
|
12 | (3) |
|
2. THEORY: PROBABILISTIC CLASSIFIERS |
|
|
15 | (30) |
|
|
15 | (3) |
|
2 Preliminaries and Notations |
|
|
18 | (2) |
|
2.1 Maximum Likelihood Classification |
|
|
18 | (1) |
|
|
19 | (1) |
|
|
20 | (1) |
|
3 Bayes Optimal Error and Entropy |
|
|
20 | (7) |
|
4 Analysis of Classification Error of Estimated (Mismatched) Distribution |
|
|
27 | (4) |
|
4.1 Hypothesis Testing Framework |
|
|
28 | (2) |
|
4.2 Classification Framework |
|
|
30 | (1) |
|
5 Density of Distributions |
|
|
31 | (9) |
|
5.1 Distributional Density |
|
|
33 | (4) |
|
5.2 Relating to Classification Error |
|
|
37 | (3) |
|
6 Complex Probabilistic Models and Small Sample Effects |
|
|
40 | (1) |
|
|
41 | (4) |
|
3. THEORY: GENERALIZATION BOUNDS |
|
|
45 | (20) |
|
|
45 | (2) |
|
|
47 | (2) |
|
3 A Margin Distribution Based Bound |
|
|
49 | (8) |
|
3.1 Proving the Margin Distribution Bound |
|
|
49 | (8) |
|
|
57 | (7) |
|
4.1 Comparison with Existing Bounds |
|
|
59 | (5) |
|
|
64 | (1) |
|
4. THEORY: SEMI-SUPERVISED LEARNING |
|
|
65 | (38) |
|
|
65 | (2) |
|
2 Properties of Classification |
|
|
67 | (1) |
|
|
68 | (2) |
|
4 Semi-supervised Learning Using Maximum Likelihood Estimation |
|
|
70 | (3) |
|
5 Asymptotic Properties of Maximum Likelihood Estimation with Labeled and Unlabeled Data |
|
|
73 | (17) |
|
|
76 | (1) |
|
|
77 | (3) |
|
5.3 Examples: Unlabeled Data Degrading Performance with Discrete and Continuous Variables |
|
|
80 | (3) |
|
5.4 Generating Examples: Performance Degradation with Univariate Distributions |
|
|
83 | (3) |
|
5.5 Distribution of Asymptotic Classification Error Bias |
|
|
86 | (2) |
|
|
88 | (2) |
|
6 Learning with Finite Data |
|
|
90 | (10) |
|
6.1 Experiments with Artificial Data |
|
|
91 | (1) |
|
6.2 Can Unlabeled Data Help with Incorrect Models? Bias vs. Variance Effects and the Labeled-unlabeled Graphs |
|
|
92 | (5) |
|
6.3 Detecting When Unlabeled Data Do Not Change the Estimates |
|
|
97 | (2) |
|
6.4 Using Unlabeled Data to Detect Incorrect Modeling Assumptions |
|
|
99 | (1) |
|
|
100 | (3) |
|
5. ALGORITHM: MAXIMUM LIKELIHOOD MINIMUM ENTROPY HMM |
|
|
103 | (16) |
|
|
103 | (2) |
|
2 Mutual Information, Bayes Optimal Error, Entropy, and Conditional Probability |
|
|
105 | (2) |
|
3 Maximum Mutual Information HMMs |
|
|
107 | (4) |
|
3.1 Discrete Maximum Mutual Information HMMs |
|
|
108 | (2) |
|
3.2 Continuous Maximum Mutual Information HMMs |
|
|
110 | (1) |
|
|
111 | (1) |
|
|
111 | (4) |
|
|
111 | (1) |
|
|
112 | (1) |
|
4.3 Maximum A-posteriori View of Maximum Mutual Information HMMs |
|
|
112 | (3) |
|
|
115 | (2) |
|
5.1 Synthetic Discrete Supervised Data |
|
|
115 | (1) |
|
|
115 | (2) |
|
|
117 | (1) |
|
5.4 Real-time Emotion Data |
|
|
117 | (1) |
|
|
117 | (2) |
|
6. ALGORITHM: MARGIN DISTRIBUTION OPTIMIZATION |
|
|
119 | (10) |
|
|
119 | (1) |
|
2 A Margin Distribution Based Bound |
|
|
120 | (1) |
|
3 Existing Learning Algorithms |
|
|
121 | (4) |
|
4 The Margin Distribution Optimization (MDO) Algorithm |
|
|
125 | (2) |
|
4.1 Comparison with SVM and Boosting |
|
|
126 | (1) |
|
|
126 | (1) |
|
5 Experimental Evaluation |
|
|
127 | (1) |
|
|
128 | (1) |
|
7. ALGORITHM: LEARNING THE STRUCTURE OF BAYESIAN NETWORK CLASSIFIERS |
|
|
129 | (28) |
|
|
129 | (1) |
|
2 Bayesian Network Classifiers |
|
|
130 | (8) |
|
2.1 Naive Bayes Classifiers |
|
|
132 | (1) |
|
2.2 Tree-Augmented Naive Bayes Classifiers |
|
|
133 | (5) |
|
3 Switching between Models: Naive Bayes and TAN Classifiers |
|
|
138 | (2) |
|
4 Learning the Structure of Bayesian Network Classifiers: Existing Approaches |
|
|
140 | (3) |
|
4.1 Independence-based Methods |
|
|
140 | (2) |
|
4.2 Likelihood and Bayesian Score-based Methods |
|
|
142 | (1) |
|
5 Classification Driven Stochastic Structure Search |
|
|
143 | (3) |
|
5.1 Stochastic Structure Search Algorithm |
|
|
143 | (2) |
|
5.2 Adding VC Bound Factor to the Empirical Error Measure |
|
|
145 | (1) |
|
|
146 | (4) |
|
6.1 Results with Labeled Data |
|
|
146 | (1) |
|
6.2 Results with Labeled and Unlabeled Data |
|
|
147 | (3) |
|
7 Should Unlabeled Data Be Weighed Differently? |
|
|
150 | (1) |
|
|
151 | (2) |
|
|
153 | (4) |
|
8. APPLICATION: OFFICE ACTIVITY RECOGNITION |
|
|
157 | (18) |
|
1 Context-Sensitive Systems |
|
|
157 | (2) |
|
2 Towards Tractable and Robust Context Sensing |
|
|
159 | (1) |
|
3 Layered Hidden Markov Models (LHMMs) |
|
|
160 | (4) |
|
|
161 | (1) |
|
3.2 Decomposition per Temporal Granularity |
|
|
162 | (2) |
|
|
164 | (2) |
|
4.1 Feature Extraction and Selection in SEER |
|
|
164 | (1) |
|
|
165 | (1) |
|
|
166 | (1) |
|
4.4 Classification in SEER |
|
|
166 | (1) |
|
|
166 | (4) |
|
|
169 | (1) |
|
6 Related Representations |
|
|
170 | (2) |
|
|
172 | (3) |
|
9. APPLICATION: MULTIMODAL EVENT DETECTION |
|
|
175 | (12) |
|
1 Fusion Models: A Review |
|
|
176 | (1) |
|
2 A Hierarchical Fusion Model |
|
|
177 | (5) |
|
|
178 | (1) |
|
2.2 The Duration Dependent Input Output Markov Model |
|
|
179 | (3) |
|
3 Experimental Setup, Features, and Results |
|
|
182 | (1) |
|
|
183 | (4) |
10. APPLICATION: FACIAL EXPRESSION RECOGNITION |
|
187 | (24) |
|
|
187 | (2) |
|
|
189 | (8) |
|
2.1 Affective Human-computer Interaction |
|
|
189 | (1) |
|
|
190 | (2) |
|
2.3 Facial Expression Recognition Studies |
|
|
192 | (5) |
|
3 Facial Expression Recognition System |
|
|
197 | (4) |
|
3.1 Face Tracking and Feature Extraction |
|
|
197 | (3) |
|
3.2 Bayesian Network Classifiers: Learning the "Structure" of the Facial Features |
|
|
200 | (1) |
|
|
201 | (7) |
|
4.1 Experimental Results with Labeled Data |
|
|
204 | (3) |
|
4.1.1 Person-dependent Tests |
|
|
205 | (1) |
|
4.1.2 Person-independent Tests |
|
|
206 | (1) |
|
4.2 Experiments with Labeled and Unlabeled Data |
|
|
207 | (1) |
|
|
208 | (3) |
11. APPLICATION: BAYESIAN NETWORK CLASSIFIERS FOR FACE DETECTION |
|
211 | (14) |
|
|
211 | (2) |
|
|
213 | (4) |
|
3 Applying Bayesian Network Classifiers to Face Detection |
|
|
217 | (1) |
|
|
218 | (4) |
|
|
222 | (3) |
References |
|
225 | (12) |
Index |
|
237 | |