About the Authors |
|
xvii | |
Preface |
|
xix | |
|
1 Introduction to Network Robot Approach for Human-Robot Interaction |
|
|
1 | (8) |
|
1.1 From Navigation and Manipulation to Human-Robot Introduction |
|
|
1 | (4) |
|
|
5 | (3) |
|
|
8 | (1) |
|
2 Field Tests--- Observing People's Reaction |
|
|
9 | (66) |
|
|
9 | (1) |
|
2.2 Interactive Humanoid Robots for a Science Museum |
|
|
10 | (21) |
|
|
|
|
|
|
10 | (1) |
|
|
11 | (1) |
|
|
12 | (1) |
|
2.2.3 The Osaka Science Museum |
|
|
13 | (1) |
|
|
13 | (1) |
|
2.2.3.2 Our Experimental Settings |
|
|
13 | (1) |
|
2.2.4 System Configuration |
|
|
14 | (1) |
|
|
15 | (1) |
|
2.2.4.2 Embedded Ubiquitous Sensors in an Environment |
|
|
15 | (1) |
|
|
16 | (2) |
|
|
18 | (1) |
|
|
18 | (1) |
|
2.2.5.2 Robots That Talk with Each Other |
|
|
18 | (5) |
|
2.2.5.3 A Robot Saying Goodbye |
|
|
23 | (1) |
|
|
23 | (1) |
|
2.2.6.1 A 2-Month Exhibition |
|
|
23 | (1) |
|
2.2.6.2 Results of the 2-Month Experiment |
|
|
23 | (3) |
|
2.2.6.3 Experiments on the Behavior of Robots |
|
|
26 | (1) |
|
2.2.6.4 Results of Robots Behavior |
|
|
27 | (1) |
|
2.2.7 Discussion and Conclusion |
|
|
28 | (1) |
|
|
28 | (1) |
|
2.2.7.2 A Perspective on Autonomy for a Communication Robot in Daily Life |
|
|
28 | (2) |
|
|
30 | (1) |
|
|
30 | (1) |
|
2.3 Humanoid Robots as a Passive-Social Medium--- A Field Experiment at a Train Station |
|
|
31 | (21) |
|
|
|
|
|
|
|
|
|
|
31 | (1) |
|
|
32 | (2) |
|
2.3.2 Multi-robot Communication System |
|
|
34 | (1) |
|
|
35 | (1) |
|
|
35 | (1) |
|
|
36 | (1) |
|
2.3.2.4 Scenario-Controlling System |
|
|
36 | (1) |
|
2.3.2.5 Example of a Script |
|
|
37 | (1) |
|
|
38 | (1) |
|
|
38 | (1) |
|
|
38 | (1) |
|
|
39 | (2) |
|
2.3.3.4 Content of Scenarios |
|
|
41 | (1) |
|
|
41 | (4) |
|
|
45 | (1) |
|
|
45 | (3) |
|
|
48 | (1) |
|
2.3.4.1 Contribution to HRI Research |
|
|
48 | (1) |
|
2.3.4.2 Contribution to Robot Design as a Medium |
|
|
48 | (1) |
|
2.3.4.3 Effects of Robots as Passive-Social Medium |
|
|
49 | (1) |
|
|
49 | (1) |
|
|
50 | (1) |
|
|
50 | (1) |
|
|
51 | (1) |
|
|
51 | (1) |
|
2.4 An Affective Guide Robot in a Shopping Mall |
|
|
52 | (23) |
|
|
|
|
|
|
|
52 | (1) |
|
|
53 | (1) |
|
|
54 | (1) |
|
2.4.3 Contemplating Robot Roles |
|
|
54 | (1) |
|
|
55 | (1) |
|
2.4.3.2 Role 2: Building Rapport |
|
|
56 | (1) |
|
2.4.3.3 Role 3: Advertisements |
|
|
56 | (1) |
|
|
56 | (2) |
|
|
58 | (1) |
|
|
58 | (1) |
|
|
58 | (1) |
|
2.4.5.3 Building Rapport Behavior |
|
|
59 | (1) |
|
2.4.5.4 Behavior for Advertisements |
|
|
59 | (1) |
|
2.4.6 System Configuration |
|
|
60 | (1) |
|
|
60 | (1) |
|
|
60 | (1) |
|
2.4.7.2 Person Identification |
|
|
61 | (1) |
|
2.4.7.3 Position Estimation |
|
|
62 | (1) |
|
2.4.7.4 Behavior and Episode Rules |
|
|
62 | (1) |
|
2.4.7.5 Nonverbal Behaviors |
|
|
63 | (1) |
|
|
63 | (1) |
|
2.4.8.1 Substitute of Speech Recognition |
|
|
64 | (1) |
|
2.4.8.2 Supervisor of Behavior Selector |
|
|
64 | (1) |
|
2.4.8.3 Knowledge Provider |
|
|
64 | (1) |
|
2.4.9 Conversational Fillers |
|
|
65 | (1) |
|
|
65 | (1) |
|
|
65 | (1) |
|
|
65 | (1) |
|
2.4.11.1 Overall Transition of Interactions |
|
|
65 | (1) |
|
2.4.11.2 Perception of Participants |
|
|
66 | (3) |
|
2.4.11.3 Comparison with an Information Display |
|
|
69 | (1) |
|
2.4.11.4 Integrated Analysis |
|
|
70 | (1) |
|
|
71 | (1) |
|
2.4.12.1 Degree of Operator Involvement |
|
|
71 | (1) |
|
|
72 | (1) |
|
|
73 | (1) |
|
|
73 | (2) |
|
3 Users' Attitude and Expectations |
|
|
75 | (26) |
|
|
75 | (1) |
|
|
76 | (1) |
|
3.2 Is Interaction with Teleoperated Robots Less Enjoyable? |
|
|
76 | (12) |
|
|
|
|
|
|
76 | (1) |
|
|
77 | (1) |
|
3.2.2 Experimental System |
|
|
77 | (1) |
|
|
78 | (2) |
|
3.2.3.1 Participants and Environment |
|
|
80 | (1) |
|
|
80 | (2) |
|
|
82 | (1) |
|
|
83 | (1) |
|
|
83 | (1) |
|
3.2.4.1 Does Prior Knowledge of Operator's Presence Vary Impressions? |
|
|
83 | (1) |
|
3.2.4.2 Participants Affected by Prior Knowledge of Operator's Presence |
|
|
84 | (3) |
|
|
87 | (1) |
|
|
87 | (1) |
|
|
87 | (1) |
|
3.3 Hesitancy in Interacting with Robots--- Anxiety and Negative Attitudes |
|
|
88 | (13) |
|
|
|
|
|
|
88 | (1) |
|
|
89 | (1) |
|
3.3.2 Psychological Scales for Human-Robot Interaction |
|
|
89 | (1) |
|
3.3.2.1 Background: Attitudes and Anxiety |
|
|
90 | (1) |
|
3.3.2.2 Negative Attitudes toward Robots Scale (NARS) |
|
|
90 | (1) |
|
3.3.2.3 Robot Anxiety Scale (RAS) |
|
|
90 | (1) |
|
|
91 | (1) |
|
3.3.3.1 Participants and Settings |
|
|
91 | (1) |
|
|
91 | (1) |
|
|
92 | (1) |
|
|
93 | (1) |
|
3.3.4.1 Measurement Result |
|
|
93 | (3) |
|
3.3.4.2 Prediction of Communication Avoidance Behavior from Anxiety and Negative Attitudes |
|
|
96 | (1) |
|
|
97 | (1) |
|
|
98 | (1) |
|
|
98 | (2) |
|
Appendix---Items in the NARS [ 15] and RAS [ 16] |
|
|
100 | (1) |
|
4 Modeling Natural Behaviors for Human-Like Interaction with Robots |
|
|
101 | (56) |
|
|
101 | (3) |
|
|
103 | (1) |
|
4.2 A Model of Natural Deictic Interaction |
|
|
104 | (16) |
|
|
|
|
|
|
|
104 | (1) |
|
|
105 | (1) |
|
4.2.3 Model of Deictic interaction |
|
|
105 | (3) |
|
4.2.4 Development of a Communication Robot Capable of Natural Deictic Interaction |
|
|
108 | (5) |
|
4.2.5 Evaluation Experiment |
|
|
113 | (1) |
|
|
113 | (1) |
|
|
114 | (1) |
|
|
115 | (1) |
|
|
116 | (2) |
|
|
118 | (1) |
|
|
119 | (1) |
|
|
119 | (1) |
|
|
119 | (1) |
|
|
120 | (1) |
|
4.3 A Model of Proximic Behavior for Being Together While Sharing Attention |
|
|
120 | (20) |
|
|
|
|
|
|
121 | (1) |
|
|
121 | (1) |
|
4.3.3 Modeling of Implicit Cue for Attention-Shifting |
|
|
122 | (1) |
|
4.3.3.1 Definition of "Implicit" Attention-Shifting |
|
|
122 | (1) |
|
4.3.3.2 Overview of Modeling |
|
|
123 | (1) |
|
4.3.3.3 Estimating Attention from Implicit Cues |
|
|
124 | (1) |
|
4.3.3.4 Detecting Partner's Attention-Shift from Implicit Cues |
|
|
124 | (1) |
|
4.3.3.5 Predicting Partner's Next Attention from Implicit Cues |
|
|
124 | (3) |
|
4.3.4 Modeling of Spatial Position |
|
|
127 | (1) |
|
4.3.4.1 Constraint of Proximity |
|
|
127 | (1) |
|
|
127 | (1) |
|
4.3.4.3 Constraint of Partner's Field of View |
|
|
128 | (1) |
|
4.3.4.4 Constraint of Robot's Field of View |
|
|
129 | (2) |
|
4.3.5 Position Model for a Presenter Robot |
|
|
131 | (1) |
|
|
132 | (1) |
|
4.3.6.1 System Configuration |
|
|
132 | (1) |
|
|
133 | (1) |
|
4.3.7 Evaluation Experiment |
|
|
134 | (1) |
|
|
134 | (1) |
|
|
134 | (2) |
|
|
136 | (1) |
|
4.3.7.4 Hypothesis and Predictions |
|
|
136 | (1) |
|
|
137 | (1) |
|
4.3.8.1 Verification of Prediction 1 |
|
|
137 | (1) |
|
4.3.8.2 Verification of Prediction 2 |
|
|
138 | (1) |
|
4.3.8.3 Verification of Prediction 3 |
|
|
138 | (1) |
|
|
139 | (1) |
|
|
139 | (1) |
|
|
139 | (1) |
|
4.4 A Model for Natural and Comprehensive Direction Giving |
|
|
140 | (17) |
|
|
|
|
|
|
|
141 | (1) |
|
|
141 | (1) |
|
|
141 | (1) |
|
|
141 | (1) |
|
|
142 | (1) |
|
4.4.3 Modeling Robot's Direction Giving |
|
|
142 | (1) |
|
|
143 | (2) |
|
|
145 | (1) |
|
|
146 | (3) |
|
4.4.4 Evaluation Experiment |
|
|
149 | (1) |
|
4.4.4.1 Hypothesis and Predictions |
|
|
149 | (1) |
|
|
149 | (2) |
|
|
151 | (1) |
|
4.4.5.1 Verification of Predictions |
|
|
151 | (1) |
|
4.4.5.2 Comparison of Naturalness Ratings |
|
|
152 | (1) |
|
|
153 | (1) |
|
|
154 | (1) |
|
|
154 | (1) |
|
|
154 | (3) |
|
5 Sensing Systems: Networked Robot Approach |
|
|
157 | (98) |
|
|
157 | (1) |
|
5.2 Laser-Based Tracking of Human Position and Orientation Using Parametric Shape Modeling |
|
|
158 | (25) |
|
|
|
|
|
|
159 | (1) |
|
|
159 | (1) |
|
|
160 | (1) |
|
|
161 | (1) |
|
5.2.3.1 Detection and Association |
|
|
162 | (1) |
|
5.2.3.2 Particle Filtering |
|
|
162 | (1) |
|
|
163 | (1) |
|
|
163 | (1) |
|
|
163 | (3) |
|
5.2.4 Orientation Estimation |
|
|
166 | (1) |
|
5.2.4.1 Theoretical Shape Model |
|
|
166 | (2) |
|
5.2.4.2 Radial Data Representation |
|
|
168 | (1) |
|
5.2.4.3 Empirical Distance Distribution Model |
|
|
168 | (2) |
|
5.2.4.4 First-Pass θ Determination |
|
|
170 | (1) |
|
5.2.4.5 Second-Pass θ Determination |
|
|
171 | (2) |
|
5.2.4.6 Correction of Reversals |
|
|
173 | (1) |
|
5.2.5 Laboratory Performance Analysis |
|
|
173 | (1) |
|
5.2.5.1 Setup and Procedure |
|
|
173 | (2) |
|
|
175 | (1) |
|
5.2.6 Natural Walking Experiment |
|
|
175 | (1) |
|
5.2.6.1 Setup and Procedure |
|
|
176 | (1) |
|
|
176 | (4) |
|
|
180 | (1) |
|
5.2.7.1 Performance Tuning |
|
|
180 | (1) |
|
5.2.7.2 Real-Time Operation |
|
|
180 | (1) |
|
|
181 | (1) |
|
|
182 | (1) |
|
|
182 | (1) |
|
5.3 Super-Flexible Skin Sensors Embedded on the Whole Body, Self-Organizing Based on Haptic Interactions |
|
|
183 | (20) |
|
|
|
|
|
|
183 | (1) |
|
|
184 | (2) |
|
5.3.2 Background and Comparisons |
|
|
186 | (1) |
|
5.3.3 Self-Organizing Tactile Sensor Method to Decide Sensor Boundaries |
|
|
187 | (1) |
|
|
187 | (1) |
|
|
188 | (1) |
|
|
188 | (1) |
|
|
189 | (1) |
|
5.3.3.5 Learning Sensor Banks |
|
|
190 | (1) |
|
5.3.3.6 Somatosensory Map |
|
|
191 | (1) |
|
|
191 | (1) |
|
|
191 | (2) |
|
|
193 | (2) |
|
5.3.4.3 Construction of the Haptic Interaction Database |
|
|
195 | (1) |
|
|
196 | (5) |
|
|
201 | (1) |
|
|
201 | (1) |
|
|
202 | (1) |
|
|
202 | (1) |
|
5.4 Integrating Passive RFID tag and Person Tracking for Social Interaction in Daily Life |
|
|
203 | (20) |
|
|
|
|
|
|
|
|
204 | (1) |
|
|
204 | (2) |
|
5.4.2 Person Tracking and Identification |
|
|
206 | (1) |
|
|
206 | (1) |
|
|
207 | (2) |
|
5.4.4 System Configuration |
|
|
209 | (1) |
|
|
209 | (1) |
|
|
209 | (2) |
|
|
211 | (1) |
|
5.4.5 Hypotheses-Based Mechanism |
|
|
211 | (1) |
|
5.4.5.1 Making a Hypotheses Mechanism |
|
|
212 | (5) |
|
5.4.5.2 Verifying Hypotheses Mechanism |
|
|
217 | (1) |
|
5.4.6 Performance Evaluation |
|
|
217 | (1) |
|
|
217 | (1) |
|
|
218 | (1) |
|
|
219 | (1) |
|
5.4.7.1 HRI Contributions |
|
|
219 | (2) |
|
5.4.7.2 Performance Improvement Approach |
|
|
221 | (1) |
|
|
221 | (1) |
|
|
222 | (1) |
|
|
222 | (1) |
|
5.5 Friendship Estimation Model for Social Robots to Understand Human Relationships |
|
|
223 | (14) |
|
|
|
|
223 | (1) |
|
|
224 | (2) |
|
5.5.2 Friendship Estimation Model from Observation |
|
|
226 | (1) |
|
5.5.2.1 Related Research on Friendship |
|
|
226 | (1) |
|
5.5.2.2 Related Research on Sensor-Based Observation of Humans' Interactions |
|
|
226 | (1) |
|
5.5.2.3 Friendship Estimation Model |
|
|
227 | (1) |
|
|
228 | (1) |
|
5.5.3 Robovie: An Interactive Humanoid Robot |
|
|
229 | (1) |
|
5.5.3.1 Hardware of Interactive Humanoid Robot |
|
|
229 | (2) |
|
5.5.3.2 Person Identification with Wireless ID Tags |
|
|
231 | (1) |
|
5.5.3.3 Interactive Behaviors |
|
|
231 | (1) |
|
5.5.4 Experiment and Result |
|
|
232 | (1) |
|
|
232 | (1) |
|
5.5.4.2 Results for Frequency of Friend-Accompanying Behavior |
|
|
232 | (1) |
|
5.5.4.3 Results for Friendship Estimation |
|
|
233 | (2) |
|
5.5.4.4 Results for Comparison between Frequency of Interaction with the Robot and Estimation Result |
|
|
235 | (1) |
|
|
235 | (1) |
|
|
236 | (1) |
|
|
236 | (1) |
|
5.6 Estimating Group States for Interactive Humanoid Robots |
|
|
237 | (18) |
|
|
|
|
|
|
|
237 | (1) |
|
|
238 | (2) |
|
5.6.2 Estimating a Group State |
|
|
240 | (3) |
|
|
243 | (1) |
|
|
243 | (4) |
|
|
247 | (1) |
|
|
247 | (1) |
|
5.6.3.1 Gathering Data for Evaluation |
|
|
247 | (1) |
|
5.6.3.2 Making an SVM Model Using Gathered Data |
|
|
248 | (1) |
|
5.6.3.3 Evaluation of Proposed Method |
|
|
249 | (1) |
|
|
250 | (1) |
|
5.6.4.1 Contributions for Human-Robot Interaction |
|
|
250 | (1) |
|
5.6.4.2 Performance Improvement Approach |
|
|
250 | (2) |
|
|
252 | (1) |
|
|
252 | (1) |
|
|
252 | (3) |
|
6 Shared Autonomy and Teleoperation |
|
|
255 | (42) |
|
|
255 | (2) |
|
|
256 | (1) |
|
6.2 A Semi-Autonomous Social Robot That Asks Help from a Human Operator |
|
|
257 | (12) |
|
|
|
|
|
|
|
|
257 | (1) |
|
|
258 | (1) |
|
6.2.2 Semi-Autonomous Robot System |
|
|
258 | (1) |
|
|
258 | (1) |
|
|
259 | (1) |
|
|
260 | (2) |
|
|
262 | (1) |
|
6.2.3 Field Trial at a Train Station |
|
|
263 | (1) |
|
6.2.3.1 Environment and Settings |
|
|
263 | (2) |
|
|
265 | (3) |
|
|
268 | (1) |
|
|
268 | (1) |
|
|
269 | (1) |
|
6.3 Teleoperation of Multiple Social Robots |
|
|
269 | (28) |
|
|
|
|
|
|
269 | (1) |
|
|
270 | (1) |
|
|
270 | (1) |
|
6.3.1.2 Design Considerations |
|
|
271 | (2) |
|
6.3.1.3 Social Human-Robot Interaction |
|
|
273 | (1) |
|
|
273 | (3) |
|
6.3.1.5 Teleoperation Interface Design |
|
|
276 | (1) |
|
6.3.1.6 Task Difficulty Metrics |
|
|
277 | (1) |
|
|
278 | (1) |
|
6.3.2.1 Social Human-Robot Interaction |
|
|
278 | (1) |
|
|
279 | (1) |
|
6.3.2.3 Multi-Robot Coordination |
|
|
280 | (1) |
|
6.3.2.4 Teleoperation Interface Design |
|
|
280 | (1) |
|
6.3.3 Experimental Validation |
|
|
281 | (1) |
|
6.3.3.1 Laboratory Experiment |
|
|
281 | (3) |
|
6.3.3.2 Experimental Results |
|
|
284 | (2) |
|
6.3.3.3 Operator Experience |
|
|
286 | (1) |
|
|
287 | (1) |
|
6.3.4.1 Interaction Model |
|
|
287 | (1) |
|
|
287 | (1) |
|
6.3.4.3 Operator Allocation |
|
|
288 | (1) |
|
6.3.4.4 Number of PTC Behaviors |
|
|
288 | (1) |
|
6.3.4.5 Relying on Autonomy |
|
|
289 | (1) |
|
|
290 | (1) |
|
6.3.5.1 Effectiveness of Shared Autonomy |
|
|
291 | (1) |
|
6.3.5.2 Defining Criticality |
|
|
291 | (1) |
|
6.3.5.3 Operator Workload |
|
|
292 | (1) |
|
|
292 | (1) |
|
|
292 | (1) |
|
|
293 | (1) |
|
|
293 | (4) |
|
7 Learning and Adaptation |
|
|
297 | (48) |
|
|
297 | (2) |
|
|
298 | (1) |
|
7.2 Moderating Users' Tension to Enable Them to Exhibit Other Emotions |
|
|
299 | (13) |
|
|
|
|
|
|
300 | (1) |
|
|
300 | (1) |
|
7.2.2 Does Tension Disturb Occurrence of Other Emotions? |
|
|
301 | (1) |
|
|
301 | (1) |
|
7.2.2.2 Hypothesis: Disturbance Caused by Tension |
|
|
301 | (1) |
|
7.2.2.3 Hypothesis Verification |
|
|
302 | (1) |
|
7.2.3 System Configuration |
|
|
303 | (1) |
|
|
303 | (1) |
|
|
303 | (1) |
|
7.2.3.3 Face Tracking Unit |
|
|
304 | (1) |
|
7.2.3.4 Emotion Recognition Unit |
|
|
304 | (1) |
|
7.2.3.5 Speech Recognition Unit |
|
|
305 | (1) |
|
7.2.3.6 Behavior Selector: Tension Moderation |
|
|
306 | (1) |
|
|
306 | (1) |
|
|
306 | (1) |
|
|
307 | (3) |
|
|
310 | (1) |
|
|
311 | (1) |
|
|
311 | (1) |
|
|
311 | (1) |
|
7.3 Adapting Nonverbal Behavior Parameters to Be Preferred by Individuals |
|
|
312 | (13) |
|
|
|
|
|
|
|
313 | (1) |
|
|
313 | (1) |
|
7.3.2 The Behavior Adaptation System |
|
|
314 | (1) |
|
7.3.2.1 The Robot and Its Interaction Behaviors |
|
|
314 | (1) |
|
7.3.2.2 Adapted Parameters |
|
|
315 | (1) |
|
|
316 | (1) |
|
7.3.2.4 The PGRL Algorithm |
|
|
317 | (1) |
|
|
317 | (1) |
|
|
318 | (1) |
|
|
318 | (1) |
|
|
319 | (1) |
|
|
320 | (3) |
|
|
323 | (1) |
|
|
323 | (1) |
|
|
323 | (1) |
|
|
324 | (1) |
|
|
324 | (1) |
|
7.4 Learning Pedestrians' Behavior in a Shopping Mall |
|
|
325 | (20) |
|
|
|
|
|
|
|
325 | (1) |
|
|
325 | (1) |
|
|
326 | (1) |
|
|
326 | (1) |
|
|
326 | (1) |
|
7.4.1.4 System Configuration |
|
|
327 | (2) |
|
7.4.1.5 Analysis of Accumulated Trajectories |
|
|
329 | (5) |
|
7.4.1.6 Anticipation System |
|
|
334 | (6) |
|
7.4.1.7 Field Test with a Social Robot |
|
|
340 | (2) |
|
|
342 | (1) |
|
|
343 | (1) |
|
|
343 | (2) |
Index |
|
345 | |