| Introduction: Brief Overview Of Monte-Carlo Methods |
|
1 | (28) |
|
A Little History: From The Buffon Needle To Neutron Transport |
|
|
3 | (7) |
|
Three Typical Problems In Random Simulation |
|
|
10 | (1) |
|
Problem 1 Numerical Integration: Quadrature, Monte-Carlo And Quasi Monte-Carlo Methods |
|
|
10 | (8) |
|
Problem 2 Simulation Of Complex Distributions: Metropolis-Hastings Algorithm, Gibbs Sampler |
|
|
18 | (5) |
|
Problem 3 Stochastic Optimization: Simulated Annealing And The Robbinsmonro Algorithm |
|
|
23 | (6) |
|
PART A TOOLBOX FOR STOCHASTIC SIMULATION |
|
|
29 | (86) |
|
Chapter 1 Generating random variables |
|
|
31 | (18) |
|
1.1 Pseudorandom Number Generator |
|
|
31 | (1) |
|
1.2 Generation Of One-Dimensional Random Variables |
|
|
32 | (5) |
|
|
|
32 | (4) |
|
|
|
36 | (1) |
|
1.3 Acceptance-Rejection Methods |
|
|
37 | (5) |
|
1.3.1 Generation of conditional distribution |
|
|
37 | (1) |
|
1.3.2 Generation of (non-conditional) distributions by the acceptance-rejection method |
|
|
38 | (2) |
|
1.3.3 Ratio-of-uniforms method |
|
|
40 | (2) |
|
1.4 Other Techniques For Generating A Random Vecto |
|
|
42 | (5) |
|
1.4.1 The Gaussian vector |
|
|
43 | (1) |
|
1.4.2 Modeling of dependence using copulas |
|
|
44 | (3) |
|
|
|
47 | (2) |
|
Chapter 2 Convergences and error estimates |
|
|
49 | (40) |
|
|
|
49 | (3) |
|
2.2 Central Limit Theorem And Consequences |
|
|
52 | (13) |
|
2.2.1 Central limit theorem in dimension 1 and beyond |
|
|
52 | (2) |
|
2.2.2 Asymptotic confidence regions and intervals |
|
|
54 | (2) |
|
2.2.3 Application to the evaluation of a function of E(X) |
|
|
56 | (5) |
|
2.2.4 Applications in the evaluation of sensitivity of expectations |
|
|
61 | (4) |
|
2.3 Other Asymptotic Controls |
|
|
65 | (2) |
|
2.3.1 Berry-Essen bounds and Edgeworth expansions |
|
|
65 | (1) |
|
2.3.2 Law of iterated logarithm |
|
|
66 | (1) |
|
2.3.3 "Almost sure" central limit theorem |
|
|
66 | (1) |
|
2.4 Non-Asymptotic Estimates |
|
|
67 | (18) |
|
2.4.1 About exponential inequalities |
|
|
67 | (2) |
|
2.4.2 Concentration inequalities in the case of bounded random variables |
|
|
69 | (1) |
|
2.4.3 Uniform concentration inequalities |
|
|
70 | (7) |
|
2.4.4 Concentration inequalities in the case of Gaussian noise |
|
|
77 | (8) |
|
|
|
85 | (4) |
|
Chapter 3 Variance reduction |
|
|
89 | (26) |
|
|
|
89 | (3) |
|
3.2 Conditioning And Stratification |
|
|
92 | (2) |
|
3.2.1 Conditioning technique |
|
|
92 | (1) |
|
3.2.2 Stratification technique |
|
|
92 | (2) |
|
|
|
94 | (3) |
|
|
|
94 | (1) |
|
|
|
95 | (2) |
|
|
|
97 | (15) |
|
3.4.1 Changes of probability measure: basic notions and applications to Monte-Carlo methods |
|
|
97 | (6) |
|
3.4.2 Changes of probability measure by affine transformations |
|
|
103 | (4) |
|
3.4.3 Change of probability measure by Esscher transform |
|
|
107 | (3) |
|
|
|
110 | (2) |
|
|
|
112 | (3) |
|
PART B SIMULATION OF LINEAR PROCESSES |
|
|
115 | (96) |
|
Chapter 4 Stochastic differential equations and Feynman-Kac formulas |
|
|
117 | (46) |
|
|
|
119 | (13) |
|
|
|
119 | (1) |
|
|
|
119 | (5) |
|
|
|
124 | (4) |
|
|
|
128 | (3) |
|
4.1.5 Quadratic variation |
|
|
131 | (1) |
|
4.2 Stochastic Integral And Ito Formula |
|
|
132 | (6) |
|
4.2.1 Filtration and stopping times |
|
|
133 | (1) |
|
4.2.2 Stochastic integral and its properties |
|
|
134 | (3) |
|
4.2.3 Ito process and Ito formula |
|
|
137 | (1) |
|
4.3 Stochastic Differential Equations |
|
|
138 | (4) |
|
4.3.1 Definition, existence, uniqueness |
|
|
138 | (1) |
|
4.3.2 Flow property and Markov property |
|
|
139 | (1) |
|
|
|
139 | (3) |
|
4.4 Probabilistic Representations Of Partial Differential Equations: Feynman-Kac Formulas |
|
|
142 | (11) |
|
4.4.1 Infinitesimal generator |
|
|
142 | (2) |
|
4.4.2 Linear parabolic partial differential equation with Cauchy condition |
|
|
144 | (4) |
|
4.4.3 Linear elliptic partial differential equation |
|
|
148 | (1) |
|
4.4.4 Linear parabolic partial differential equation with Cauchy-Dirichlet condition |
|
|
149 | (4) |
|
4.4.5 Linear elliptic partial differential equation with Dirichlet condition |
|
|
153 | (1) |
|
4.5 Probabilistic Formulas For The Gradients |
|
|
153 | (3) |
|
4.5.1 Pathwise differentiation method |
|
|
154 | (1) |
|
|
|
155 | (1) |
|
|
|
156 | (7) |
|
Chapter 5 Euler scheme for stochastic differential equations |
|
|
163 | (28) |
|
5.1 Definition And Simulation |
|
|
164 | (6) |
|
5.1.1 Definition as an Ito process, quadratic moments |
|
|
164 | (2) |
|
|
|
166 | (2) |
|
5.1.3 Application to computation of diffusion expectation: discretization error and statistical error |
|
|
168 | (2) |
|
|
|
170 | (3) |
|
|
|
173 | (5) |
|
5.3.1 Convergence at order 1 |
|
|
173 | (3) |
|
|
|
176 | (2) |
|
5.4 Simulation Of Stopped Processes |
|
|
178 | (8) |
|
5.4.1 Discrete approximation of exit time |
|
|
179 | (2) |
|
5.4.2 Brownian bridge method |
|
|
181 | (3) |
|
5.4.3 Boundary shifting method |
|
|
184 | (2) |
|
|
|
186 | (5) |
|
Chapter 6 Statistical error in the simulation of stochastic differential equations |
|
|
191 | (20) |
|
6.1 Asymptotic Analysis: Number Of Simulations And Time Step |
|
|
191 | (3) |
|
6.2 Non-Asymptotic Analysis Of The Statistical Error In The Euler Scheme |
|
|
194 | (3) |
|
|
|
197 | (5) |
|
6.4 Unbiased Simulation Using A Randomized Multi-Level Method |
|
|
202 | (4) |
|
6.5 Variance Reduction Methods |
|
|
206 | (2) |
|
|
|
206 | (1) |
|
6.5.2 Importance sampling |
|
|
207 | (1) |
|
|
|
208 | (3) |
|
PART C SIMULATION OF NON-LINEAR PROCESSES |
|
|
211 | (74) |
|
Chapter 7 Backward stochastic differential equations |
|
|
213 | (28) |
|
|
|
214 | (7) |
|
7.1.1 Examples coming from reaction-diffusion equations |
|
|
214 | (3) |
|
7.1.2 Examples coming from stochastic modeling |
|
|
217 | (4) |
|
|
|
221 | (6) |
|
|
|
221 | (3) |
|
|
|
224 | (3) |
|
7.3 Time Discretization And Dynamic Programming Equation |
|
|
227 | (4) |
|
7.3.1 Discretization of the problem |
|
|
227 | (1) |
|
|
|
228 | (3) |
|
7.4 Other Dynamic Programming Equations |
|
|
231 | (2) |
|
7.5 Another Probabilistic Representation Via Branching Processes |
|
|
233 | (3) |
|
|
|
236 | (5) |
|
Chapter 8 Simulation by empirical regression |
|
|
241 | (32) |
|
8.1 The Difficulties Of A Naive Approach |
|
|
241 | (3) |
|
8.2 Approximation Of Conditional Expectations By Least Squares Methods |
|
|
244 | (13) |
|
8.2.1 Empirical regression |
|
|
245 | (1) |
|
|
|
246 | (3) |
|
8.2.3 Example of approximation space: the local polynomials |
|
|
249 | (1) |
|
8.2.4 Error estimations, robust with respect to the model |
|
|
250 | (2) |
|
8.2.5 Adjustment of the parameters in the case of local polynomials |
|
|
252 | (2) |
|
8.2.6 Proof of the error estimations |
|
|
254 | (3) |
|
8.3 Application To The Resolution Of The Dynamic Programming Equation By Empirical Regression |
|
|
257 | (10) |
|
8.3.1 Learning sample and approximation space |
|
|
257 | (1) |
|
8.3.2 Calculation of the empirical regression functions |
|
|
258 | (2) |
|
8.3.3 Equation of the error propagation |
|
|
260 | (6) |
|
8.3.4 Optimal adjustment of the convergence parameters in the case of local polynomials |
|
|
266 | (1) |
|
|
|
267 | (6) |
|
Chapter 9 Interacting particles and non-linear equations in the McKean sense |
|
|
273 | (12) |
|
|
|
273 | (5) |
|
9.1.1 Macroscopic scale versus microscopic scale |
|
|
273 | (2) |
|
9.1.2 Examples and applications |
|
|
275 | (3) |
|
9.2 Existence And Uniqueness Of Non-Linear Diffusions |
|
|
278 | (1) |
|
9.3 Convergence Of The System Of Interacting Diffusions, Propagation Of Chaos And Simulation |
|
|
279 | (6) |
|
APPENDIX A Reminders and complementary results |
|
|
285 | (8) |
|
|
|
285 | (1) |
|
A.1.1 Convergence a.s., in probability and in L1 |
|
|
285 | (1) |
|
A.1.2 Convergence in distribution |
|
|
286 | (1) |
|
A.2 Several Useful Inequalities |
|
|
287 | (1) |
|
A.2.1 Inequalities for moments |
|
|
287 | (3) |
|
A.2.2 Inequalities in the deviation probabilities |
|
|
290 | (3) |
| Bibliography |
|
293 | (14) |
| Index |
|
307 | |