|
1 Introduction to Averaging |
|
|
1 | (10) |
|
1.1 Averaging for Ordinary Differential Equations |
|
|
1 | (6) |
|
1.1.1 Averaging for Globally Lipschitz Systems |
|
|
1 | (3) |
|
1.1.2 Averaging for Locally Lipschitz Systems |
|
|
4 | (3) |
|
|
7 | (4) |
|
1.2.1 Averaging for Stochastic Perturbation Process |
|
|
7 | (1) |
|
1.2.2 Averaging for Stochastic Differential Equations |
|
|
8 | (3) |
|
2 Introduction to Extremum Seeking |
|
|
11 | (10) |
|
2.1 Motivation and Recent Revival |
|
|
11 | (1) |
|
2.2 Why Stochastic Extremum Seeking? |
|
|
12 | (1) |
|
2.3 A Brief Introduction to Stochastic Extremum Seeking |
|
|
13 | (8) |
|
2.3.1 A Basic Deterministic ES Scheme |
|
|
14 | (1) |
|
2.3.2 A Basic Stochastic ES Scheme |
|
|
15 | (1) |
|
2.3.3 A Heuristic Analysis of a Simple Stochastic ES Algorithm |
|
|
16 | (5) |
|
3 Stochastic Averaging for Asymptotic Stability |
|
|
21 | (36) |
|
|
21 | (1) |
|
|
22 | (7) |
|
3.2.1 Uniform Strong Ergodic Perturbation Process |
|
|
22 | (4) |
|
3.2.2 Ø-Mixing Perturbation Process |
|
|
26 | (3) |
|
3.3 Proofs of the Theorems |
|
|
29 | (22) |
|
3.3.1 Proofs for the Case of Uniform Strong Ergodic Perturbation Process |
|
|
29 | (7) |
|
3.3.2 Proofs for the Case of ø-Mixing Perturbation Process |
|
|
36 | (15) |
|
|
51 | (4) |
|
3.4.1 Perturbation Process Is Asymptotically Periodic |
|
|
51 | (1) |
|
3.4.2 Perturbation Process Is Almost Surely Exponentially Stable |
|
|
52 | (2) |
|
3.4.3 Perturbation Process Is Brownian Motion on the Unit Circle |
|
|
54 | (1) |
|
|
55 | (2) |
|
4 Stochastic Averaging for Practical Stability |
|
|
57 | (22) |
|
4.1 General Stochastic Averaging |
|
|
57 | (7) |
|
4.1.1 Problem Formulation |
|
|
57 | (4) |
|
4.1.2 Statements of General Results on Stochastic Averaging |
|
|
61 | (3) |
|
4.2 Proofs of the General Theorems on Stochastic Averaging |
|
|
64 | (10) |
|
|
64 | (1) |
|
4.2.2 Proof of Approximation Result (4.22) of Theorem 4.1 |
|
|
65 | (1) |
|
4.2.3 Preliminary Lemmas for the Proof of Approximation Result (4.23) of Theorem 4.1 |
|
|
66 | (3) |
|
4.2.4 Proof of Approximation Result (4.23) of Theorem 4.1 |
|
|
69 | (1) |
|
4.2.5 Proof of Theorem 4.2 |
|
|
70 | (2) |
|
|
72 | (2) |
|
4.3 Discussions of the Existence of Solution |
|
|
74 | (4) |
|
|
78 | (1) |
|
5 Single-parameter Stochastic Extremum Seeking |
|
|
79 | (16) |
|
5.1 Extremum Seeking for a Static Map |
|
|
81 | (5) |
|
5.2 Stochastic Extremum Seeking Feedback for General Nonlinear Dynamic Systems |
|
|
86 | (7) |
|
|
93 | (2) |
|
6 Stochastic Source Seeking for Nonholonomic Vehicles |
|
|
95 | (26) |
|
6.1 Vehicle Model and Problem Statement |
|
|
96 | (1) |
|
6.2 Stochastic Source Seeking Controller |
|
|
96 | (2) |
|
|
98 | (5) |
|
|
103 | (4) |
|
6.5 Simulations and Dependence on Design Parameters |
|
|
107 | (1) |
|
|
107 | (1) |
|
6.5.2 Dependence of Annulus Radius ρ on Parameters |
|
|
108 | (1) |
|
6.6 Dependence on Damping Term d0 |
|
|
108 | (4) |
|
6.6.1 No Damping (d0 = 0) |
|
|
108 | (2) |
|
6.6.2 Effect of Damping (d0 > 0) |
|
|
110 | (2) |
|
6.7 Effect of Constraints of the Angular Velocity and Design Alternatives |
|
|
112 | (4) |
|
6.7.1 Effect of Constraints of the Angular Velocity |
|
|
112 | (1) |
|
6.7.2 Alternative Designs |
|
|
112 | (4) |
|
6.8 System Behavior for Elliptical Level Sets |
|
|
116 | (1) |
|
|
117 | (4) |
|
7 Stochastic Source Seeking with Tuning of Forward Velocity |
|
|
121 | (8) |
|
7.1 The Model of Autonomous Vehicle |
|
|
121 | (1) |
|
7.2 Search Algorithm and Convergence Analysis |
|
|
122 | (4) |
|
|
126 | (1) |
|
|
127 | (2) |
|
8 Multi-parameter Stochastic Extremum Seeking and Slope Seeking |
|
|
129 | (18) |
|
8.1 Multi-input Stochastic Averaging |
|
|
129 | (3) |
|
8.2 Multi-parameter Stochastic ES for Static Maps |
|
|
132 | (6) |
|
8.2.1 Algorithm for Multi-parameter Stochastic ES |
|
|
132 | (2) |
|
8.2.2 Convergence Analysis |
|
|
134 | (4) |
|
8.3 Stochastic Gradient Seeking |
|
|
138 | (8) |
|
8.3.1 Single-parameter Stochastic Slope Seeking |
|
|
138 | (4) |
|
8.3.2 Multi-parameter Stochastic Gradient Seeking |
|
|
142 | (4) |
|
|
146 | (1) |
|
9 Stochastic Nash Equilibrium Seeking for Games with General Nonlinear Payoffs |
|
|
147 | (14) |
|
|
148 | (1) |
|
9.2 Stochastic Nash Equilibrium Seeking Algorithm |
|
|
149 | (3) |
|
9.3 Proof of the Algorithm Convergence |
|
|
152 | (3) |
|
|
155 | (4) |
|
|
159 | (2) |
|
10 Nash Equilibrium Seeking for Quadratic Games and Applications to Oligopoly Markets and Vehicle Deployment |
|
|
161 | (20) |
|
10.1 N-Player Games with Quadratic Payoff Functions |
|
|
161 | (6) |
|
10.1.1 General Quadratic Games |
|
|
161 | (5) |
|
10.1.2 Symmetric Quadratic Games |
|
|
166 | (1) |
|
10.2 Oligopoly Price Games |
|
|
167 | (2) |
|
10.3 Multi-agent Deployment in the Plane |
|
|
169 | (9) |
|
10.3.1 Vehicle Model and Local Agent Cost |
|
|
169 | (1) |
|
|
170 | (2) |
|
10.3.3 Stability Analysis |
|
|
172 | (6) |
|
|
178 | (1) |
|
10.4 Notes and References |
|
|
178 | (3) |
|
11 Newton-Based Stochastic Extremum Seeking |
|
|
181 | (20) |
|
11.1 Single-parameter Newton Algorithm for Static Maps |
|
|
181 | (4) |
|
11.2 Multi-parameter Newton Algorithm for Static Maps |
|
|
185 | (3) |
|
11.2.1 Problem Formulation |
|
|
185 | (1) |
|
11.2.2 Algorithm Design and Stability Analysis |
|
|
186 | (2) |
|
11.3 Newton Algorithm for Dynamic Systems |
|
|
188 | (9) |
|
|
197 | (2) |
|
11.5 Notes and References |
|
|
199 | (2) |
Appendix A Some Properties of p-Limit and p-Infinitesimal Operator |
|
201 | (2) |
Appendix B Auxiliary Proofs for Section 3.2.2 |
|
203 | (12) |
References |
|
215 | (8) |
Index |
|
223 | |