Preface |
|
xv | |
Authors |
|
xix | |
Chapter 1 Introduction to Networked Control Systems |
|
1 | (18) |
|
1.1 Overview of Networked Control Techniques |
|
|
2 | (1) |
|
1.2 Challenges in Networked Control Systems |
|
|
3 | (10) |
|
1.2.1 Network Imperfections |
|
|
4 | (1) |
|
1.2.1.1 Network-Induced Delay |
|
|
4 | (1) |
|
|
4 | (1) |
|
|
5 | (1) |
|
1.2.3 Network Protocol Effects |
|
|
6 | (7) |
|
|
13 | (2) |
|
|
13 | (1) |
|
1.3.2 Spectrum Management |
|
|
13 | (1) |
|
|
13 | (1) |
|
|
14 | (1) |
|
1.3.5 Event-Sampled Control |
|
|
14 | (1) |
|
|
15 | (4) |
Chapter 2 Background on Lyapunov Stability and Stochastic Optimal Control |
|
19 | (46) |
|
2.1 Deterministic Dynamical Systems |
|
|
19 | (4) |
|
2.1.1 Discrete-Time Systems |
|
|
19 | (1) |
|
2.1.2 Brunovsky Canonical Form |
|
|
20 | (1) |
|
|
21 | (2) |
|
|
22 | (1) |
|
|
22 | (1) |
|
2.2 Mathematical Background |
|
|
23 | (3) |
|
2.2.1 Vector and Matrix Norms |
|
|
23 | (2) |
|
2.2.1.1 Singular Value Decomposition |
|
|
24 | (1) |
|
2.2.1.2 Quadratic Forms and Definiteness |
|
|
25 | (1) |
|
2.2.2 Continuity and Function Norms |
|
|
25 | (1) |
|
2.3 Properties of Dynamical Systems |
|
|
26 | (3) |
|
2.3.1 Asymptotic Stability |
|
|
27 | (1) |
|
|
27 | (1) |
|
|
28 | (1) |
|
2.3.4 A Note on Autonomous Systems and Linear Systems |
|
|
28 | (1) |
|
2.4 Nonlinear Stability Analysis and Controls Design |
|
|
29 | (13) |
|
2.4.1 Lyapunov Analysis for Autonomous Systems |
|
|
29 | (4) |
|
2.4.2 Controller Design Using Lyapunov Techniques |
|
|
33 | (4) |
|
2.4.2.1 Lyapunov Analysis and Controls Design for Linear Systems |
|
|
35 | (1) |
|
2.4.2.2 Stability Analysis |
|
|
35 | (1) |
|
2.4.2.3 Lyapunov Design of LTI Feedback Controllers |
|
|
36 | (1) |
|
2.4.3 Lyapunov Analysis for Nonautonomous Systems |
|
|
37 | (2) |
|
2.4.4 Extensions of Lyapunov Techniques and Bounded Stability |
|
|
39 | (3) |
|
2.4.4.1 UUB Analysis and Controls Design |
|
|
39 | (3) |
|
2.5 Stochastic Discrete-Time Control |
|
|
42 | (19) |
|
2.5.1 Stochastic Lyapunov Stability |
|
|
42 | (1) |
|
2.5.1.1 Asymptotic Stable in the Mean Square |
|
|
43 | (1) |
|
2.5.1.2 Lyapunov Stable in the Mean Square |
|
|
43 | (1) |
|
2.5.1.3 Bounded in the Mean Square |
|
|
43 | (1) |
|
2.5.1.4 Bounded in the Mean |
|
|
43 | (1) |
|
2.5.2 Stochastic Linear Discrete-Time Optimal Control |
|
|
43 | (5) |
|
2.5.3 Stochastic Q-Learning |
|
|
48 | (3) |
|
|
48 | (2) |
|
2.5.3.2 Model-Free Online Tuning Based on Adaptive Estimator and Q-Learning |
|
|
50 | (1) |
|
2.5.4 Stochastic Nonlinear Discrete-Time Optimal Control |
|
|
51 | (3) |
|
2.5.5 Background on Neural Networks |
|
|
54 | (1) |
|
2.5.6 Two-Layer Neural Networks |
|
|
55 | (4) |
|
2.5.7 NN Function Approximation |
|
|
59 | (10) |
|
2.5.7.1 Functional Link Neural Networks |
|
|
60 | (1) |
|
|
61 | (1) |
|
|
62 | (3) |
Chapter 3 Optimal Adaptive Control of Uncertain Linear Network Control Systems |
|
65 | (40) |
|
3.1 Traditional Control Design and Stochastic Riccati Equation-Based Solution |
|
|
67 | (2) |
|
3.2 Finite-Horizon Optimal Adaptive Control |
|
|
69 | (19) |
|
|
69 | (3) |
|
3.2.2 Stochastic Value Function |
|
|
72 | (1) |
|
3.2.3 Model-Free Online Tuning of Adaptive Estimator |
|
|
73 | (5) |
|
3.2.4 Closed-Loop System Stability |
|
|
78 | (4) |
|
|
82 | (6) |
|
3.2.5.1 LNCS State Regulation Error and Performance |
|
|
83 | (1) |
|
3.2.5.2 Bellman Equation and Terminal Constraint Errors |
|
|
83 | (2) |
|
3.2.5.3 Optimality Analysis of the Proposed Scheme |
|
|
85 | (3) |
|
3.3 Extensions to Infinite Horizon |
|
|
88 | (8) |
|
3.3.1 Adaptive Estimation for Optimal Regulator Design |
|
|
88 | (4) |
|
|
92 | (4) |
|
|
96 | (1) |
|
|
97 | (1) |
|
|
98 | (1) |
|
|
98 | (1) |
|
|
99 | (2) |
|
|
101 | (1) |
|
|
102 | (3) |
Chapter 4 Optimal Control of Unknown Quantized Network Control Systems |
|
105 | (50) |
|
|
108 | (6) |
|
4.1.1 Quantized Linear Networked Control Systems |
|
|
108 | (2) |
|
4.1.2 Quantizer Representation |
|
|
110 | (2) |
|
4.1.3 Quantized Nonlinear Networked Control System |
|
|
112 | (2) |
|
4.2 Finite-Horizon Optimal Control of Linear QNCS |
|
|
114 | (13) |
|
4.2.1 Action-Dependent Value-Function Setup |
|
|
115 | (2) |
|
4.2.2 Model-Free Online Tuning of Action-Dependent Value Function with Quantized Signals |
|
|
117 | (5) |
|
4.2.3 Estimation of the Optimal Feedback Control |
|
|
122 | (1) |
|
4.2.4 Convergence Analysis |
|
|
122 | (2) |
|
|
124 | (3) |
|
4.3 Finite-Horizon Optimal Control of Nonlinear QNCS |
|
|
127 | (14) |
|
|
129 | (3) |
|
4.3.2 Near-Optimal Regulator Design |
|
|
132 | (26) |
|
4.3.2.1 Value Function Approximation |
|
|
133 | (2) |
|
4.3.2.2 Control Input Approximation |
|
|
135 | (2) |
|
4.3.2.3 Dynamic Quantizer Design |
|
|
137 | (1) |
|
4.3.2.4 Stability Analysis |
|
|
138 | (2) |
|
4.3.2.5 Simulation Results |
|
|
140 | (1) |
|
|
141 | (2) |
|
|
143 | (1) |
|
|
144 | (1) |
|
|
145 | (3) |
|
|
148 | (1) |
|
|
149 | (2) |
|
|
151 | (4) |
Chapter 5 Optimal Control of Uncertain Linear Networked Control Systems in Input-Output Form with Disturbance Inputs |
|
155 | (32) |
|
5.1 Traditional Two-Player Zero-Sum Game Design and Game Theoretic Riccati Equation-Based Solution |
|
|
156 | (2) |
|
5.2 Infinite-Horizon Optimal Adaptive Design |
|
|
158 | (19) |
|
|
159 | (5) |
|
5.2.1.1 LNCS Quadratic Zero-Sum Games |
|
|
159 | (2) |
|
5.2.1.2 LNCS Quadratic Zero-Sum Games in Input-Output Form |
|
|
161 | (3) |
|
5.2.2 Stochastic Value Function |
|
|
164 | (3) |
|
5.2.3 Model-Free Online Tuning |
|
|
167 | (4) |
|
5.2.4 Closed-Loop System Stability |
|
|
171 | (2) |
|
|
173 | (4) |
|
|
177 | (1) |
|
|
178 | (1) |
|
|
178 | (2) |
|
|
180 | (3) |
|
|
183 | (1) |
|
|
184 | (3) |
Chapter 6 Optimal Control of Uncertain Nonlinear Networked Control Systems via Neurodynamic Programming |
|
187 | (34) |
|
6.1 Traditional Nonlinear Optimal Control Design and HJB Equation-Based Solution |
|
|
188 | (2) |
|
6.2 Finite-Horizon Optimal Control for NNCS |
|
|
190 | (19) |
|
|
191 | (1) |
|
6.2.2 Online NN Identifier Design |
|
|
192 | (3) |
|
6.2.3 Stochastic Value Function Setup and Critic NN Design |
|
|
195 | (3) |
|
6.2.4 Actor NN Estimation of Optimal Control Policy |
|
|
198 | (2) |
|
6.2.5 Closed-Loop Stability |
|
|
200 | (2) |
|
|
202 | (7) |
|
6.2.6.1 State Regulation Error and Controller Performance |
|
|
204 | (3) |
|
6.2.6.2 HJB Equation and Terminal Constraint Estimation Errors |
|
|
207 | (1) |
|
6.2.6.3 Cost Function Comparison |
|
|
207 | (2) |
|
6.3 Extensions to Infinite Horizon |
|
|
209 | (9) |
|
6.3.1 Optimal Stochastic Value Function Approximation and Control Policy Design |
|
|
210 | (4) |
|
|
214 | (4) |
|
|
218 | (1) |
|
|
219 | (1) |
|
|
219 | (2) |
Chapter 7 Optimal Design for Nonlinear Two-Player Zero-Sum Games under Communication Constraints |
|
221 | (36) |
|
7.1 Traditional Stochastic Optimal Control Design for Two-Player Zero-Sum Game |
|
|
223 | (2) |
|
7.2 NNCS Two-Player Zero-Sum Game |
|
|
225 | (2) |
|
7.3 Finite-Horizon Optimal Adaptive Design |
|
|
227 | (15) |
|
7.3.1 Online NN Identifier Design |
|
|
227 | (3) |
|
7.3.2 Stochastic Value Function |
|
|
230 | (5) |
|
7.3.3 Approximation of Optimal Control and Disturbance |
|
|
235 | (4) |
|
7.3.4 Closed-Loop System Stability |
|
|
239 | (3) |
|
|
242 | (5) |
|
7.4.1 State Regulation and Control and Disturbance Input Performance |
|
|
242 | (2) |
|
7.4.2 Hamilton-Jacobi-Isaacs and Terminal Constraint Errors |
|
|
244 | (3) |
|
7.4.3 Optimal Performance of the Proposed Design |
|
|
247 | (1) |
|
|
247 | (1) |
|
|
247 | (1) |
|
|
248 | (1) |
|
|
249 | (6) |
|
|
255 | (2) |
Chapter 8 Distributed Joint Optimal Network Scheduling and Controller Design for Wireless Networked Control Systems |
|
257 | (18) |
|
8.1 Background of Wireless Networked Control Systems |
|
|
258 | (1) |
|
8.2 Wireless Networked Control Systems Codesign |
|
|
259 | (13) |
|
|
259 | (1) |
|
|
260 | (1) |
|
8.2.3 Stochastic Optimal Control Design |
|
|
261 | (3) |
|
8.2.4 Optimal Cross-Layer Distributed Scheduling Scheme |
|
|
264 | (5) |
|
8.2.5 Numerical Simulations |
|
|
269 | (3) |
|
|
272 | (1) |
|
|
272 | (1) |
|
|
272 | (3) |
Chapter 9 Event-Sampled Distributed Networked Control Systems |
|
275 | (22) |
|
9.1 Distributed Networked Control Systems |
|
|
277 | (2) |
|
9.2 Optimal Adaptive Event-Sampled Control |
|
|
279 | (12) |
|
9.2.1 ZOH-Based Event-Triggered Control System |
|
|
279 | (1) |
|
9.2.2 Optimal Adaptive ZOH-Based Event-Triggered Control |
|
|
280 | (4) |
|
9.2.2.1 Value Function Setup |
|
|
280 | (1) |
|
9.2.2.2 Model-Free Online Tuning of Value Function |
|
|
281 | (3) |
|
9.2.3 Cross-Layer Distributed Scheduling Design |
|
|
284 | (14) |
|
9.2.3.1 Cross-Layer Design |
|
|
284 | (1) |
|
9.2.3.2 Distributed Scheduling |
|
|
284 | (7) |
|
|
291 | (3) |
|
|
294 | (1) |
|
|
295 | (1) |
|
|
295 | (2) |
Chapter 10 Optimal Control of Uncertain Linear Control Systems under a Unified Communication Protocol |
|
297 | (32) |
|
10.1 Optimal Control Design under Unified Communication Protocol Framework |
|
|
298 | (9) |
|
|
299 | (3) |
|
10.1.2 Stochastic Value Function |
|
|
302 | (2) |
|
10.1.3 Model-Free Online Tuning of Adaptive Estimator |
|
|
304 | (3) |
|
10.2 Closed-Loop System Stability |
|
|
307 | (2) |
|
|
309 | (6) |
|
10.3.1 Traditional Pole Placement Controller Performance with Network Imperfections |
|
|
310 | (1) |
|
10.3.2 NCS under TCP with Intermittent Acknowledgment |
|
|
310 | (2) |
|
10.3.3 NCS under TCP with Full Acknowledgment |
|
|
312 | (1) |
|
10.3.4 NCS under UDP with No Acknowledgment |
|
|
313 | (2) |
|
|
315 | (1) |
|
|
316 | (1) |
|
|
317 | (4) |
|
|
321 | (3) |
|
|
324 | (3) |
|
|
327 | (2) |
Index |
|
329 | |