Contributors |
|
xiii | |
Preface |
|
xvii | |
|
Part I Tactile sensing and perception |
|
|
|
1 GelTip tactile sensor for dexterous manipulation in clutter |
|
|
|
|
|
|
3 | (1) |
|
1.2 An overview of the tactile sensors |
|
|
4 | (4) |
|
1.2.1 Marker-based optical tactile sensors |
|
|
5 | (1) |
|
1.2.2 Image-based optical tactile sensors |
|
|
6 | (2) |
|
|
8 | (6) |
|
|
8 | (2) |
|
1.3.2 The sensor projective model |
|
|
10 | (2) |
|
1.3.3 Fabrication process |
|
|
12 | (2) |
|
|
14 | (4) |
|
1.4.1 Contact localization |
|
|
14 | (2) |
|
1.4.2 Touch-guided grasping in a Blocks World environment |
|
|
16 | (2) |
|
1.5 Conclusions and discussion |
|
|
18 | (5) |
|
|
19 | (1) |
|
|
19 | (4) |
|
2 Robotic perception of object properties using tactile sensing |
|
|
|
|
|
|
23 | (1) |
|
2.2 Material properties recognition using tactile sensing |
|
|
24 | (2) |
|
2.3 Object shape estimation using tactile sensing |
|
|
26 | (3) |
|
2.4 Object pose estimation using tactile sensing |
|
|
29 | (1) |
|
2.5 Grasping stability prediction using tactile sensing |
|
|
30 | (1) |
|
2.6 Vision-guided tactile perception for crack reconstruction |
|
|
31 | (7) |
|
2.6.1 Visual guidance for touch sensing |
|
|
33 | (1) |
|
2.6.2 Guided tactile crack perception |
|
|
34 | (2) |
|
|
36 | (1) |
|
2.6.4 Experimental results |
|
|
37 | (1) |
|
2.7 Conclusion and discussion |
|
|
38 | (7) |
|
|
40 | (5) |
|
3 Multimodal perception for dexterous manipulation |
|
|
|
|
|
|
45 | (1) |
|
3.2 Visual-tactile cross-modal generation |
|
|
46 | (4) |
|
3.2.1 "Touching to see" and "seeing to feel" |
|
|
46 | (2) |
|
3.2.2 Experimental results |
|
|
48 | (2) |
|
3.3 Spatiotemporal attention model for tactile texture perception |
|
|
50 | (6) |
|
3.3.1 Spatiotemporal attention model |
|
|
51 | (1) |
|
|
52 | (1) |
|
|
52 | (2) |
|
3.3.4 Experimental results |
|
|
54 | (1) |
|
3.3.5 Attention distribution visualization |
|
|
55 | (1) |
|
3.4 Conclusion and discussion |
|
|
56 | (3) |
|
|
57 | (1) |
|
|
57 | (2) |
|
4 Capacitive material detection with machine learning for robotic grasping applications |
|
|
|
|
|
|
|
59 | (3) |
|
|
59 | (1) |
|
|
60 | (1) |
|
|
61 | (1) |
|
|
62 | (6) |
|
4.2.1 Capacitance perception |
|
|
62 | (4) |
|
4.2.2 Classification for material detection |
|
|
66 | (2) |
|
|
68 | (5) |
|
|
68 | (2) |
|
4.3.2 Classifier configurations |
|
|
70 | (3) |
|
|
73 | (4) |
|
|
77 | (6) |
|
|
78 | (5) |
|
Part II Skill representation and learning |
|
|
|
5 Admittance Control: Learning from humans through collaborating with humans |
|
|
|
|
|
|
83 | (2) |
|
5.2 Learning from human based on admittance control |
|
|
85 | (5) |
|
5.2.1 Learning a task using dynamic movement primitives |
|
|
85 | (2) |
|
5.2.2 Admittance control model |
|
|
87 | (1) |
|
5.2.3 Learning of compliant movement profiles based on biomimetic control |
|
|
87 | (3) |
|
5.3 Experimental validation |
|
|
90 | (3) |
|
|
90 | (2) |
|
|
92 | (1) |
|
|
92 | (1) |
|
5.4 Human robot collaboration based on admittance control |
|
|
93 | (5) |
|
5.4.1 Principle of human arm impedance model |
|
|
94 | (1) |
|
5.4.2 Estimation of stiffness matrix |
|
|
95 | (3) |
|
5.4.3 Stiffness mapping between human and robot arm |
|
|
98 | (1) |
|
5.5 Variable admittance control model |
|
|
98 | (2) |
|
|
100 | (6) |
|
5.6.1 Test of variable admittance control |
|
|
100 | (2) |
|
5.6.2 Human-robot collaborative sawing task |
|
|
102 | (4) |
|
|
106 | (3) |
|
|
106 | (3) |
|
6 Sensorimotor control for dexterous grasping-inspiration from human hand |
|
|
|
|
6.1 Introduction of sensorimotor control for dexterous grasping |
|
|
109 | (2) |
|
6.2 Sensorimotor control for grasping kinematics |
|
|
111 | (9) |
|
6.3 Sensorimotor control for grasping kinetics |
|
|
120 | (7) |
|
|
127 | (6) |
|
|
127 | (1) |
|
|
128 | (5) |
|
7 From human to Robot Grasping: Force and kinematic synergies |
|
|
|
|
|
|
|
|
|
|
|
|
133 | (4) |
|
7.1.1 Human hand synergies |
|
|
134 | (2) |
|
7.1.2 The impact of the synergies approach on robotic hands |
|
|
136 | (1) |
|
|
137 | (7) |
|
7.2.1 Study 1: force synergies comparison between human and robot hands |
|
|
137 | (2) |
|
7.2.2 Results of force synergies study |
|
|
139 | (1) |
|
7.2.3 Study 2: kinematic synergies in both human and robot hands |
|
|
139 | (3) |
|
7.2.4 Results of kinematic synergies study |
|
|
142 | (2) |
|
|
144 | (2) |
|
7.3.1 Force synergies: human vs. robot |
|
|
144 | (1) |
|
7.3.2 Kinematic synergies: human vs. robot |
|
|
145 | (1) |
|
|
146 | (3) |
|
|
147 | (1) |
|
|
147 | (2) |
|
8 Learning form-closure grasping with attractive region in environment |
|
|
|
|
|
|
|
149 | (1) |
|
|
150 | (2) |
|
|
150 | (1) |
|
8.2.2 Environmental constraints |
|
|
151 | (1) |
|
|
151 | (1) |
|
8.3 Learning a form-closure grasp with attractive region in environment |
|
|
152 | (14) |
|
8.3.1 Attractive region in environment for four-pin grasping |
|
|
152 | (4) |
|
8.3.2 Learning to evaluate grasp quality with ARIE |
|
|
156 | (5) |
|
8.3.3 Learning to grasp with ARIE |
|
|
161 | (5) |
|
|
166 | (5) |
|
|
167 | (4) |
|
9 Learning hierarchical control for robust in-hand manipulation |
|
|
|
|
|
171 | (2) |
|
|
173 | (1) |
|
|
174 | (4) |
|
9.3.1 Hierarchical structure for in-hand manipulation |
|
|
175 | (1) |
|
9.3.2 Low-level controller |
|
|
176 | (1) |
|
9.3.3 Mid-level controller |
|
|
177 | (1) |
|
|
178 | (5) |
|
9.4.1 Training mid-level policies and baseline |
|
|
179 | (1) |
|
|
180 | (1) |
|
9.4.3 Reaching desired object poses |
|
|
180 | (1) |
|
9.4.4 Robustness analysis |
|
|
181 | (1) |
|
9.4.5 Manipulating a cube |
|
|
182 | (1) |
|
|
183 | (4) |
|
|
183 | (4) |
|
10 Learning industrial assembly by guided-DDPG |
|
|
|
|
|
187 | (2) |
|
10.2 From model-free RL to model-based RL |
|
|
189 | (3) |
|
10.2.1 Guided policy search |
|
|
189 | (1) |
|
10.2.2 Deep deterministic policy gradient |
|
|
190 | (1) |
|
10.2.3 Comparison of DDPG and GPS |
|
|
191 | (1) |
|
10.3 Guided deep deterministic policy gradient |
|
|
192 | (2) |
|
10.4 Simulations and experiments |
|
|
194 | (5) |
|
|
195 | (1) |
|
10.4.2 Simulation results |
|
|
195 | (3) |
|
10.4.3 Experimental results |
|
|
198 | (1) |
|
|
199 | (6) |
|
|
200 | (5) |
|
Part III Robotic hand adaptive control |
|
|
|
11 Clinical evaluation of Hannes: measuring the usability of a novel polyarticulated prosthetic hand |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
205 | (1) |
|
|
206 | (3) |
|
|
207 | (1) |
|
|
207 | (2) |
|
|
209 | (3) |
|
11.3.1 Analysis of survey study and definition of requirements |
|
|
209 | (1) |
|
11.3.2 System architecture |
|
|
209 | (3) |
|
11.4 Pilot study for evaluating the Hannes hand |
|
|
212 | (6) |
|
11.4.1 Materials and methods |
|
|
213 | (2) |
|
|
215 | (3) |
|
11.5 Validation of custom EMG sensors |
|
|
218 | (4) |
|
11.5.1 Materials and methods |
|
|
218 | (2) |
|
|
220 | (2) |
|
11.6 Discussion and conclusions |
|
|
222 | (5) |
|
|
224 | (3) |
|
12 A hand-arm teleoperation system for robotic dexterous manipulation |
|
|
|
|
|
|
|
227 | (2) |
|
|
229 | (1) |
|
12.3 Vision-based teleoperation for dexterous hand |
|
|
230 | (5) |
|
|
230 | (3) |
|
12.3.2 Pair-wise robot-human hand dataset generation |
|
|
233 | (2) |
|
12.4 Hand-arm teleoperation system |
|
|
235 | (2) |
|
12.5 Transteleop evaluation |
|
|
237 | (3) |
|
12.5.1 Network implementation details |
|
|
237 | (1) |
|
12.5.2 Transteleop evaluation |
|
|
238 | (2) |
|
12.5.3 Hand pose analysis |
|
|
240 | (1) |
|
12.6 Manipulation experiments |
|
|
240 | (3) |
|
12.7 Conclusion and discussion |
|
|
243 | (4) |
|
|
244 | (3) |
|
13 Neural network-enhanced optimal motion planning for robot manipulation under remote center of motion |
|
|
|
|
|
|
247 | (3) |
|
|
250 | (5) |
|
13.2.1 Kinematics modeling |
|
|
250 | (1) |
|
|
251 | (4) |
|
13.3 Control system design |
|
|
255 | (2) |
|
13.3.1 Controller design method |
|
|
255 | (1) |
|
13.3.2 RBFNN-based approximation |
|
|
256 | (1) |
|
|
257 | (1) |
|
|
257 | (4) |
|
|
261 | (4) |
|
|
262 | (3) |
|
14 Towards dexterous in-hand manipulation of unknown objects |
|
|
|
|
|
|
|
265 | (1) |
|
|
266 | (2) |
|
14.3 Reactive object manipulation framework |
|
|
268 | (5) |
|
14.3.1 Local manipulation controller - position part |
|
|
269 | (1) |
|
14.3.2 Local manipulation controller - force part |
|
|
270 | (1) |
|
14.3.3 Local manipulation controller - composite part |
|
|
271 | (1) |
|
|
272 | (1) |
|
14.4 Finding optimal regrasp points |
|
|
273 | (3) |
|
14.4.1 Grasp stability and manipulability |
|
|
273 | (1) |
|
14.4.2 Object surface exploration controller |
|
|
274 | (2) |
|
14.5 Evaluation in physics-based simulation |
|
|
276 | (8) |
|
14.5.1 Local object manipulation |
|
|
277 | (2) |
|
14.5.2 Large-scale object manipulation |
|
|
279 | (5) |
|
14.6 Evaluation in a real robot experiment |
|
|
284 | (6) |
|
14.6.1 Unknown object surface exploration by one finger |
|
|
284 | (4) |
|
14.6.2 Unknown object local manipulation by two fingers |
|
|
288 | (2) |
|
|
290 | (7) |
|
|
292 | (1) |
|
|
293 | (4) |
|
15 Robust dexterous manipulation and finger gaiting under various uncertainties |
|
|
|
|
|
297 | (4) |
|
15.2 Dual-stage manipulation and gaiting framework |
|
|
301 | (1) |
|
15.3 Modeling of uncertain manipulation dynamics |
|
|
301 | (4) |
|
15.3.1 State-space dynamics |
|
|
301 | (3) |
|
15.3.2 Combining feedback linearization with modeling |
|
|
304 | (1) |
|
15.4 Robust manipulation controller design |
|
|
305 | (4) |
|
|
305 | (2) |
|
15.4.2 Design of weighting functions |
|
|
307 | (1) |
|
15.4.3 Manipulation controller design |
|
|
308 | (1) |
|
15.5 Real-time finger gaits planning |
|
|
309 | (6) |
|
15.5.1 Grasp quality analysis |
|
|
309 | (1) |
|
15.5.2 Position-level finger gaits planning |
|
|
310 | (1) |
|
15.5.3 Velocity-level finger gaits planning |
|
|
311 | (2) |
|
15.5.4 Similarities between position-level and velocity-level planners |
|
|
313 | (1) |
|
15.5.5 Finger gaiting with jump control |
|
|
314 | (1) |
|
15.6 Simulation and experiment studies |
|
|
315 | (14) |
|
|
315 | (1) |
|
15.6.2 Experimental setup |
|
|
316 | (1) |
|
|
317 | (1) |
|
15.6.4 RMC simulation results |
|
|
318 | (5) |
|
15.6.5 RMC experiment results |
|
|
323 | (2) |
|
15.6.6 Finger gaiting simulation results |
|
|
325 | (4) |
|
|
329 | (4) |
|
|
330 | (3) |
|
A Key components of dexterous manipulation: tactile sensing, skill learning, and adaptive control |
|
|
|
|
|
|
|
|
|
333 | (1) |
|
A.2 Why sensing, why tactile sensing |
|
|
333 | (2) |
|
|
335 | (1) |
|
|
336 | (1) |
|
|
337 | (2) |
Index |
|
339 | |