|
Part I Laplace Principle, Relative Entropy, and Elementary Examples |
|
|
|
|
3 | (28) |
|
1.1 Large Deviation Principle |
|
|
3 | (4) |
|
1.2 An Equivalent Formulation of the Large Deviation Principle |
|
|
7 | (13) |
|
1.3 Basic Results in the Theory |
|
|
20 | (9) |
|
|
29 | (2) |
|
2 Relative Entropy and Tightness of Measures |
|
|
31 | (18) |
|
2.1 Properties of Relative Entropy |
|
|
31 | (13) |
|
2.2 Tightness of Probability Measures |
|
|
44 | (3) |
|
|
47 | (2) |
|
3 Examples of Representations and Their Application |
|
|
49 | (30) |
|
3.1 Representation for an IID Sequence |
|
|
49 | (11) |
|
3.1.1 Sanov's and Cramer's Theorems |
|
|
51 | (1) |
|
3.1.2 Tightness and Weak Convergence |
|
|
52 | (1) |
|
3.1.3 Laplace Upper Bound |
|
|
53 | (1) |
|
3.1.4 Laplace Lower Bound |
|
|
54 | (1) |
|
3.1.5 Proof of Lemma 3.5 and Remarks on the Proof of Sanov's Theorem |
|
|
54 | (2) |
|
|
56 | (4) |
|
3.2 Representation for Functionals of Brownian Motion |
|
|
60 | (9) |
|
3.2.1 Large Deviation Theory of Small Noise Diffusions |
|
|
63 | (2) |
|
3.2.2 Tightness and Weak Convergence |
|
|
65 | (1) |
|
3.2.3 Laplace Upper Bound |
|
|
66 | (1) |
|
3.2.4 Compactness of Level Sets |
|
|
67 | (1) |
|
3.2.5 Laplace Lower Bound |
|
|
68 | (1) |
|
3.3 Representation for Functionals of a Poisson Process |
|
|
69 | (6) |
|
|
75 | (4) |
|
Part II Discrete Time Processes |
|
|
|
4 Recursive Markov Systems with Small Noise |
|
|
79 | (40) |
|
|
79 | (2) |
|
|
81 | (2) |
|
4.3 Form of the Rate Function |
|
|
83 | (1) |
|
|
84 | (2) |
|
|
86 | (6) |
|
4.5.1 Tightness and Uniform Integrability |
|
|
86 | (2) |
|
|
88 | (2) |
|
4.5.3 Completion of the Laplace Upper Bound |
|
|
90 | (1) |
|
4.5.4 I is a Rate Function |
|
|
91 | (1) |
|
4.6 Properties of L(x, β) |
|
|
92 | (6) |
|
4.7 Laplace Lower Bound Under Condition 4.7 |
|
|
98 | (4) |
|
4.7.1 Construction of a Nearly Optimal Control |
|
|
99 | (1) |
|
4.7.2 Completion of the Proof of the Laplace Lower Bound |
|
|
99 | (1) |
|
4.7.3 Approximation by Bounded Velocity Paths |
|
|
100 | (2) |
|
4.8 Laplace Lower Bound Under Condition 4.8 |
|
|
102 | (15) |
|
|
102 | (2) |
|
4.8.2 Variational Bound for the Mollified Process |
|
|
104 | (2) |
|
4.8.3 Perturbation of L and Its Properties |
|
|
106 | (2) |
|
4.8.4 A Nearly Optimal Trajectory and Associated Control Sequence |
|
|
108 | (4) |
|
4.8.5 Tightness and Convergence of Controlled Processes |
|
|
112 | (2) |
|
4.8.6 Completion of the Proof of the Laplace Lower Bound |
|
|
114 | (3) |
|
|
117 | (2) |
|
5 Moderate Deviations for Recursive Markov Systems |
|
|
119 | (32) |
|
5.1 Assumptions, Notation, and Theorem Statement |
|
|
121 | (3) |
|
|
124 | (1) |
|
5.3 Tightness and Limits for Controlled Processes |
|
|
125 | (16) |
|
5.3.1 Tightness and Uniform Integrability |
|
|
125 | (4) |
|
5.3.2 Identification of Limits |
|
|
129 | (12) |
|
|
141 | (1) |
|
|
142 | (7) |
|
|
149 | (2) |
|
6 Empirical Measure of a Markov Chain |
|
|
151 | (30) |
|
|
151 | (2) |
|
6.1.1 Markov Chain Monte Carlo |
|
|
152 | (1) |
|
6.1.2 Markov Modulated Dynamics |
|
|
152 | (1) |
|
|
153 | (1) |
|
6.3 Form of the Rate Function |
|
|
154 | (2) |
|
6.4 Assumptions and Statement of the LDP |
|
|
156 | (2) |
|
6.5 Properties of the Rate Function |
|
|
158 | (2) |
|
6.6 Tightness and Weak Convergence |
|
|
160 | (2) |
|
|
162 | (1) |
|
|
163 | (10) |
|
6.9 Uniform Laplace Principle |
|
|
173 | (1) |
|
6.10 Noncompact State Space |
|
|
174 | (4) |
|
|
178 | (3) |
|
7 Models with Special Features |
|
|
181 | (30) |
|
|
181 | (1) |
|
|
182 | (21) |
|
7.2.1 Preliminaries and Main Result |
|
|
183 | (5) |
|
7.2.2 Laplace Upper Bound |
|
|
188 | (2) |
|
7.2.3 Properties of the Rate Function |
|
|
190 | (6) |
|
7.2.4 Laplace Lower Bound |
|
|
196 | (2) |
|
7.2.5 Solution to Calculus of Variations Problems |
|
|
198 | (5) |
|
7.3 Two Scale Recursive Markov Systems with Small Noise |
|
|
203 | (3) |
|
7.3.1 Model and Assumptions |
|
|
204 | (1) |
|
7.3.2 Rate Function and the LDP |
|
|
205 | (1) |
|
|
206 | (1) |
|
|
206 | (5) |
|
Part III Continuous Time Processes |
|
|
|
8 Representations for Continuous Time Processes |
|
|
211 | (34) |
|
8.1 Representation for Infinite Dimensional Brownian Motion |
|
|
212 | (13) |
|
|
212 | (2) |
|
8.1.2 Preparatory Results |
|
|
214 | (3) |
|
8.1.3 Proof of the Upper Bound in the Representation |
|
|
217 | (1) |
|
8.1.4 Proof of the Lower Bound in the Representation |
|
|
218 | (4) |
|
8.1.5 Representation with Respect to a General Filtration |
|
|
222 | (3) |
|
8.2 Representation for Poisson Random Measure |
|
|
225 | (17) |
|
|
225 | (4) |
|
8.2.2 Preparatory Results |
|
|
229 | (3) |
|
8.2.3 Proof of the Upper Bound in the Representation |
|
|
232 | (3) |
|
8.2.4 Proof of the Lower Bound in the Representation |
|
|
235 | (3) |
|
8.2.5 Construction of Equivalent Controls |
|
|
238 | (4) |
|
8.3 Representation for Functionals of PRM and Brownian Motion |
|
|
242 | (1) |
|
|
243 | (2) |
|
9 Abstract Sufficient Conditions for Large and Moderate Deviations in the Small Noise Limit |
|
|
245 | (16) |
|
9.1 Definitions and Notation |
|
|
246 | (1) |
|
9.2 Abstract Sufficient Conditions for LDP and MDP |
|
|
247 | (6) |
|
9.2.1 An Abstract Large Deviation Result |
|
|
248 | (2) |
|
9.2.2 An Abstract Moderate Deviation Result |
|
|
250 | (3) |
|
9.3 Proof of the Large Deviation Principle |
|
|
253 | (2) |
|
9.4 Proof of the Moderate Deviation Principle |
|
|
255 | (4) |
|
|
259 | (2) |
|
10 Large and Moderate Deviations for Finite Dimensional Systems |
|
|
261 | (34) |
|
10.1 Small Noise Jump-Diffusion |
|
|
262 | (1) |
|
10.2 An LDP for Small Noise Jump-Diffusions |
|
|
263 | (15) |
|
10.2.1 Proof of the Large Deviation Principle |
|
|
270 | (8) |
|
10.3 An MDP for Small Noise Jump-Diffusions |
|
|
278 | (15) |
|
10.3.1 Some Preparatory Results |
|
|
280 | (8) |
|
10.3.2 Proof of the Moderate Deviation Principle |
|
|
288 | (3) |
|
10.3.3 Equivalence of Two Rate Functions |
|
|
291 | (2) |
|
|
293 | (2) |
|
11 Systems Driven by an Infinite Dimensional Brownian Noise |
|
|
295 | (24) |
|
11.1 Formulations of Infinite Dimensional Brownian Motion |
|
|
296 | (6) |
|
11.1.1 The Representations |
|
|
300 | (2) |
|
11.2 General Sufficient Condition for an LDP |
|
|
302 | (4) |
|
11.3 Reaction--Diffusion SPDE |
|
|
306 | (11) |
|
11.3.1 The Large Deviation Theorem |
|
|
306 | (5) |
|
11.3.2 Qualitative Properties of Controlled Stochastic Reaction--Diffusion Equations |
|
|
311 | (6) |
|
|
317 | (2) |
|
12 Stochastic Flows of Diffeomorphisms and Image Matching |
|
|
319 | (24) |
|
12.1 Notation and Definitions |
|
|
321 | (3) |
|
12.2 Statement of the LDP |
|
|
324 | (4) |
|
12.3 Weak Convergence for Controlled Flows |
|
|
328 | (8) |
|
12.4 Application to Image Analysis |
|
|
336 | (6) |
|
|
342 | (1) |
|
13 Models with Special Features |
|
|
343 | (40) |
|
|
343 | (1) |
|
13.2 A Model with Discontinuous Statistics-Weighted Serve-the-Longest Queue |
|
|
344 | (21) |
|
13.2.1 Problem Formulation |
|
|
345 | (2) |
|
13.2.2 Form of the Rate Function and Statement of the Laplace Principle |
|
|
347 | (4) |
|
13.2.3 Laplace Upper Bound |
|
|
351 | (2) |
|
13.2.4 Properties of the Rate Function |
|
|
353 | (2) |
|
13.2.5 Laplace Lower Bound |
|
|
355 | (10) |
|
13.3 A Class of Pure Jump Markov Processes |
|
|
365 | (15) |
|
13.3.1 Large Deviation Principle |
|
|
366 | (6) |
|
13.3.2 Moderate Deviation Principle |
|
|
372 | (8) |
|
|
380 | (3) |
|
Part IV Accelerated Monte Carlo for Rare Events |
|
|
|
14 Rare Event Monte Carlo and Importance Sampling |
|
|
383 | (30) |
|
14.1 Example of a Quantity to be Estimated |
|
|
383 | (4) |
|
|
385 | (2) |
|
|
387 | (9) |
|
14.2.1 Importance Sampling for Rare Events |
|
|
388 | (2) |
|
14.2.2 Controls Without Feedback, and Dangers in the Rare Event Setting |
|
|
390 | (3) |
|
14.2.3 A Dynamic Game Interpretation of Importance Sampling |
|
|
393 | (3) |
|
|
396 | (5) |
|
14.4 The IS Scheme Associated to a Subsolution |
|
|
401 | (4) |
|
|
405 | (7) |
|
14.5.1 Functionals Besides Probabilities |
|
|
405 | (1) |
|
|
406 | (2) |
|
|
408 | (1) |
|
14.5.4 Path Dependent Events |
|
|
409 | (2) |
|
14.5.5 Markov Modulated Models |
|
|
411 | (1) |
|
|
412 | (1) |
|
15 Performance of an IS Scheme Based on a Subsolution |
|
|
413 | (26) |
|
15.1 Statement of Resulting Performance |
|
|
413 | (5) |
|
15.2 Performance Bounds for the Finite-Time Problem |
|
|
418 | (11) |
|
15.3 Performance Bounds for the Exit Probability Problem |
|
|
429 | (8) |
|
|
437 | (2) |
|
|
439 | (32) |
|
16.1 Notation and Terminology |
|
|
441 | (4) |
|
16.2 Formulation of the Algorithm |
|
|
445 | (6) |
|
16.3 Performance Measures |
|
|
451 | (6) |
|
16.4 Design and Asymptotic Analysis of Splitting Schemes |
|
|
457 | (9) |
|
16.5 Splitting for Finite-Time Problems |
|
|
466 | (3) |
|
16.5.1 Subsolutions for Analysis of Metastability |
|
|
467 | (2) |
|
|
469 | (2) |
|
17 Examples of Subsolutions and Their Application |
|
|
471 | (38) |
|
17.1 Estimating an Expected Value |
|
|
472 | (5) |
|
|
472 | (1) |
|
|
472 | (1) |
|
17.1.3 Component Functions |
|
|
473 | (1) |
|
|
473 | (2) |
|
|
475 | (2) |
|
17.2 Hitting Probabilities and Level Crossing |
|
|
477 | (6) |
|
|
477 | (1) |
|
|
477 | (1) |
|
17.2.3 Component Functions |
|
|
477 | (2) |
|
|
479 | (1) |
|
|
479 | (4) |
|
17.3 Path-Dependent Functional |
|
|
483 | (4) |
|
17.3.1 Problem Formulation |
|
|
484 | (1) |
|
|
484 | (1) |
|
|
485 | (2) |
|
17.4 Serve-the-Longest Queue |
|
|
487 | (9) |
|
17.4.1 Problem Formulation |
|
|
487 | (2) |
|
17.4.2 Associated Rate Function |
|
|
489 | (1) |
|
17.4.3 Adaptations Needed for the WSLQ Model |
|
|
489 | (2) |
|
17.4.4 Characterization of Subsolutions |
|
|
491 | (1) |
|
17.4.5 Component Functions |
|
|
491 | (1) |
|
|
492 | (2) |
|
|
494 | (2) |
|
17.5 Jump Markov Processes with Moderate Deviation Scaling |
|
|
496 | (6) |
|
17.5.1 Problem Formulation |
|
|
497 | (1) |
|
|
498 | (1) |
|
17.5.3 Component Functions |
|
|
499 | (1) |
|
|
499 | (1) |
|
|
500 | (2) |
|
17.6 Escape from the Neighborhood of a Rest Point |
|
|
502 | (6) |
|
17.6.1 Problem Formulation |
|
|
503 | (1) |
|
|
503 | (1) |
|
|
504 | (1) |
|
|
504 | (4) |
|
|
508 | (1) |
Appendix A Spaces of Measures |
|
509 | (8) |
Appendix B Stochastic Kernels |
|
517 | (6) |
Appendix C Further Properties of Relative Entropy |
|
523 | (10) |
Appendix D Martingales and Stochastic Integration |
|
533 | (8) |
Appendix E Analysis and Measure Theory |
|
541 | (4) |
Conventions and Standard Notation |
|
545 | (8) |
Abbreviations |
|
553 | (2) |
Specialized Symbols |
|
555 | (4) |
References |
|
559 | (12) |
Index |
|
571 | |