Part I Evolutionary Mobile Robots |
|
|
1 Differential Evolution Approach Using Chaotic Sequences Applied to Planning of Mobile Robot in a Static Environment with Obstacles |
|
|
|
Leandro dos Santos Coelho, Nadia Nedjah, Luiza de Macedo Mourelle |
|
|
3 | |
|
|
4 | |
|
1.2 Differential Evolution |
|
|
5 | |
|
1.3 New Approach of Differential Evolution Combined with Chaos Theory |
|
|
7 | |
|
1.4 Planning of Mobile Robots |
|
|
11 | |
|
|
13 | |
|
1.5.1 Case study 1: Environment with 7 obstacles |
|
|
13 | |
|
1.5.2 Case study 2: Environment with 14 obstacles |
|
|
15 | |
|
|
16 | |
|
|
19 | |
|
2 Evolving Modular Robots for Rough Terrain Exploration |
|
|
|
|
23 | |
|
|
23 | |
|
|
25 | |
|
2.2.1 Modular Robotic Systems |
|
|
25 | |
|
2.2.2 Evolutionary Optimization |
|
|
26 | |
|
|
27 | |
|
2.3 Evolutionary Task-Based Design |
|
|
29 | |
|
2.3.1 Genotype Encoding: Incidence Matrix |
|
|
29 | |
|
|
31 | |
|
|
34 | |
|
2.3.4 Phenotype Evaluation |
|
|
35 | |
|
|
36 | |
|
|
36 | |
|
|
38 | |
|
2.4.3 Task 2: Reaching a goal |
|
|
39 | |
|
2.4.4 Task 3: Getting altitude |
|
|
39 | |
|
2.4.5 Task 4: Increasing angular velocity |
|
|
41 | |
|
2.5 Summary and Conclusions |
|
|
43 | |
|
|
44 | |
|
3 Evolutionary Navigation of Autonomous Robots Under Varying Terrain Conditions |
|
|
|
|
47 | |
|
|
47 | |
|
|
50 | |
|
|
50 | |
|
|
51 | |
|
3.3 Motion Planning Algorithm |
|
|
53 | |
|
3.3.1 Encoding the Chromosome |
|
|
53 | |
|
|
54 | |
|
3.3.3 Genetic operators and parameters |
|
|
54 | |
|
|
54 | |
|
3.3.5 Dynamic Environment |
|
|
56 | |
|
|
56 | |
|
|
60 | |
|
|
61 | |
|
4 Aggregate Selection in Evolutionary Robotics |
|
|
|
Andrew L. Nelson, Edward Grant |
|
|
63 | |
|
|
64 | |
|
4.1.1 Evolutionary Robotics Process Overview |
|
|
65 | |
|
|
66 | |
|
|
66 | |
|
4.2 Evolutionary Robotics So Far |
|
|
70 | |
|
4.3 Evolutionary Robotics and Aggregate Fitness |
|
|
73 | |
|
4.4 Making Aggregate Selection Work |
|
|
74 | |
|
4.5 Aggregate Selection and Competition |
|
|
75 | |
|
|
83 | |
|
|
85 | |
|
5 Evolving Fuzzy Classifier for Novelty Detection and Landmark Recognition by Mobile Robots |
|
|
|
Plamen Angelov, Xiaowei Zhou |
|
|
89 | |
|
|
89 | |
|
5.2 Landmark Recognition in Mobile Robotics |
|
|
91 | |
|
5.3 Evolving Fuzzy Rule-Based Classifier (eClass) |
|
|
92 | |
|
5.3.1 The Informative Data Density and Proximity Measure |
|
|
93 | |
|
5.3.2 Landmark Classifier Generation and Evolution |
|
|
94 | |
|
5.3.3 Landmark Recognition (real-time classification) |
|
|
96 | |
|
|
98 | |
|
5.4 Case Study: Corner Recognition |
|
|
99 | |
|
5.4.1 The Mobile Robotic Platform |
|
|
100 | |
|
5.4.2 Experiment Settings |
|
|
103 | |
|
|
104 | |
|
5.4.4 Results and Analysis |
|
|
105 | |
|
5.5 Further Investigations and Conclusion |
|
|
109 | |
|
5.5.1 Using Different Devices and Selecting Features |
|
|
109 | |
|
|
110 | |
|
5.5.3 Applying Variable Radius |
|
|
111 | |
|
|
112 | |
|
|
112 | |
|
|
112 | |
|
Appendix: C++ Class EvolvingClassifier |
|
|
115 | |
Part II Learning Mobile Robots |
|
|
6 Reinforcement Learning for Autonomous Robotic Fish |
|
|
|
Jindong Liu, Lynne E. Parker, Raj Madhavan |
|
|
121 | |
|
|
121 | |
|
6.2 Introduction of Robotic Fish-Aifi |
|
|
123 | |
|
6.3 Policy Gradient Learning in Swim Pattern Layer |
|
|
124 | |
|
6.4 State-based Reinforcement Learning in Cognitive Layer |
|
|
127 | |
|
6.4.1 Action Space and State Space |
|
|
128 | |
|
6.4.2 Markov Decision Process Model |
|
|
128 | |
|
|
129 | |
|
6.5.1 Policy Gradient Learning for Sharp- Turning Swim Pattern |
|
|
129 | |
|
6.5.2 Q-learning for Tank Border Exploration Task |
|
|
130 | |
|
|
133 | |
|
|
133 | |
|
7 Module-based Autonomous Learning for Mobile Robots |
|
|
|
Esther L. Colombini, Carlos H.C. Ribeiro |
|
|
137 | |
|
|
138 | |
|
7.1.1 Bibliography Review |
|
|
138 | |
|
7.2 Reinforcement Learning |
|
|
140 | |
|
7.2.1 Markovian Decision Processes |
|
|
140 | |
|
|
141 | |
|
|
142 | |
|
|
142 | |
|
|
144 | |
|
7.3.1 Cerebellar Model Articulation Controller (CMAC) |
|
|
144 | |
|
|
147 | |
|
|
147 | |
|
|
148 | |
|
|
148 | |
|
7.4.4 Space Discretisation |
|
|
148 | |
|
7.4.5 Hand-crafted Policy |
|
|
149 | |
|
|
149 | |
|
|
150 | |
|
|
154 | |
|
|
156 | |
|
|
157 | |
|
8 A Hybrid Adaptive Architecture for Mobile Robots Based on Reactive Behaviours |
|
|
|
Antonio Henrique Pinto Selvatici, Anna Helena Reali Costa |
|
|
161 | |
|
|
161 | |
|
|
163 | |
|
8.2.1 Simple Reflex Agents |
|
|
163 | |
|
8.2.2 Model-Based Reflex Agents |
|
|
163 | |
|
|
164 | |
|
8.2.4 Utility-Based Agents |
|
|
165 | |
|
|
165 | |
|
|
166 | |
|
|
168 | |
|
|
170 | |
|
|
170 | |
|
8.5.2 Definition of the Situation Space |
|
|
172 | |
|
8.5.3 Definition of the Weights Sets |
|
|
173 | |
|
8.5.4 The Reinforcement Function |
|
|
174 | |
|
8.6 Experiments with AAREACT |
|
|
175 | |
|
|
175 | |
|
8.6.2 Initial Learning Phase |
|
|
176 | |
|
8.6.3 Scenario Changing Experiments |
|
|
177 | |
|
|
178 | |
|
|
182 | |
|
|
183 | |
|
9 Collaborative Robots for Infrastructure Security Applications |
|
|
|
Yi Guo, Lynne E. Parker, Raj Aladhavan |
|
|
185 | |
|
|
185 | |
|
9.2 Infrastructure Security Scenario and Research Problems |
|
|
187 | |
|
9.3 Multi-Robot Positioning and Mapping using Distributed Sensing |
|
|
188 | |
|
9.3.1 Heterogeneous Distributed Multi-Robot Localization |
|
|
188 | |
|
|
191 | |
|
9.4 Dynamic Multi-Robot Motion Planning |
|
|
192 | |
|
|
193 | |
|
9.4.2 Initial Distribution |
|
|
193 | |
|
9.4.3 Complete Coverage Patrolling |
|
|
194 | |
|
|
196 | |
|
9.5 System Integration Towards Proof of Principle Demonstration |
|
|
197 | |
|
|
198 | |
|
|
199 | |
|
10 Imitation Learning: An Application in a Micro Robot Soccer Game |
|
|
|
Dennis Barrios-Aranibar and Pablo Javier Alsina |
|
|
201 | |
|
|
201 | |
|
10.2 Case Study and Control Architecture |
|
|
204 | |
|
10.3 Situations Recognition |
|
|
206 | |
|
10.4 Behaviors Patterns Recognition |
|
|
212 | |
|
10.5 Experimental Results |
|
|
213 | |
|
10.6 Conclusions and Future Works |
|
|
217 | |
|
|
218 | |
Index |
|
221 | |
Author Index |
|
223 | |