|
|
1 | (6) |
|
|
5 | (2) |
|
2 The Neuroscience of Action and Perception |
|
|
7 | (32) |
|
2.1 The Two Cortical Streams of Visual Elaboration, Fundamental Roles and Proofs of Dissociation |
|
|
7 | (5) |
|
2.1.1 A Dual Mechanism for Vision |
|
|
9 | (2) |
|
2.1.2 Brain Pathways for Vision-Based Grasping |
|
|
11 | (1) |
|
2.2 Visual Areas and Stream Separation |
|
|
12 | (2) |
|
2.3 The Action-Oriented Dorsal Stream |
|
|
14 | (10) |
|
2.3.1 Posterior Intraparietal Sulcus |
|
|
15 | (3) |
|
2.3.2 Anterior Intraparietal Sulcus |
|
|
18 | (3) |
|
2.3.3 Ventral Premotor Cortex (PMv) and Other Motor Areas |
|
|
21 | (1) |
|
2.3.4 Other Dorsal Stream Areas |
|
|
22 | (2) |
|
2.4 Object Recognition and Stream Integration |
|
|
24 | (3) |
|
2.4.1 The Lateral Occipital Complex |
|
|
24 | (1) |
|
2.4.2 Other Brain Areas Involved in Grasping |
|
|
25 | (1) |
|
2.4.3 The Visual Streams in Action |
|
|
26 | (1) |
|
2.5 The Third Stream of Visual Processing |
|
|
27 | (12) |
|
|
28 | (11) |
|
3 Intelligent Robotic Grasping? |
|
|
39 | (18) |
|
3.1 Vision-Based Robotic Grasping, A Brief Outline |
|
|
39 | (3) |
|
3.2 Biological Inspiration for Robot Grasping and Manipulation |
|
|
42 | (2) |
|
3.3 Symbol Grounding Through Robotic Manipulation |
|
|
44 | (7) |
|
3.3.1 Symbol Grounding and Neuroscience |
|
|
44 | (1) |
|
3.3.2 An Emerging Categorization of Synthesized Robot Grips |
|
|
45 | (2) |
|
3.3.3 Extracting Symbolic Meanings from Physical Interactions |
|
|
47 | (3) |
|
3.3.4 Symbolic Value of Hand-Object Interactions |
|
|
50 | (1) |
|
3.4 Toward Intelligent Robotic Grasping |
|
|
51 | (6) |
|
|
52 | (5) |
|
4 Vision-Based Grasping, Where Robotics Meets Neuroscience |
|
|
57 | (26) |
|
4.1 Previous Models and Related Approaches |
|
|
57 | (5) |
|
4.2 Basic Modeling Concepts |
|
|
62 | (6) |
|
4.2.1 Methodological Issues |
|
|
62 | (1) |
|
|
63 | (4) |
|
4.2.3 Role of the Dorsal and Ventral Streams and Possible Interactions |
|
|
67 | (1) |
|
|
68 | (8) |
|
4.3.1 Processing of Basic Visual Information |
|
|
70 | (1) |
|
4.3.2 Extraction of Visual Features Suitable for Grasping |
|
|
70 | (2) |
|
4.3.3 Transformation of Visual Features into Hand Shapes |
|
|
72 | (3) |
|
|
75 | (1) |
|
|
76 | (7) |
|
|
77 | (6) |
|
5 Extraction of Grasp-Related Visual Features |
|
|
83 | (36) |
|
5.1 Extraction and Integration of Object-Related Visual Cues in the Primate Cortex and in Robotics |
|
|
84 | (5) |
|
|
85 | (1) |
|
|
86 | (1) |
|
5.1.3 Object Recognition in the Ventral Stream |
|
|
87 | (1) |
|
5.1.4 Orientation Estimation in Artificial Vision and Robotics |
|
|
88 | (1) |
|
5.2 A Model of Distance and Orientation Estimation of Graspable Objects |
|
|
89 | (7) |
|
5.2.1 Distance Estimation Through Proprioceptive Data |
|
|
89 | (1) |
|
5.2.2 Object Orientation Estimation Through Retinal Data |
|
|
90 | (5) |
|
5.2.3 Hierarchical Object Classification |
|
|
95 | (1) |
|
5.3 Neural Network Implementation of a Multiple Cue Slant Estimator |
|
|
96 | (3) |
|
5.3.1 Neural Network Estimators |
|
|
96 | (1) |
|
5.3.2 Merging the Estimators |
|
|
96 | (1) |
|
5.3.3 Results of the ANN Simulation |
|
|
97 | (2) |
|
|
99 | (15) |
|
|
101 | (2) |
|
5.4.2 Object Classification Experiments |
|
|
103 | (2) |
|
5.4.3 Object Pose and Distance Estimation |
|
|
105 | (5) |
|
5.4.4 Experimental Results |
|
|
110 | (4) |
|
|
114 | (5) |
|
|
115 | (4) |
|
6 Visuomotor Transformations for Grasp Planning and Execution |
|
|
119 | (26) |
|
6.1 Neural Coding in the Caudal Intraparietal Sulcus |
|
|
119 | (10) |
|
6.1.1 Understanding and Interpreting the Available Data |
|
|
121 | (2) |
|
6.1.2 SOS Neurons Transfer Function |
|
|
123 | (2) |
|
6.1.3 AOS Neurons Transfer Function |
|
|
125 | (2) |
|
6.1.4 Robotic SOS and AOS |
|
|
127 | (2) |
|
6.1.5 Discussion and Future Developments |
|
|
129 | (1) |
|
6.2 Planning and Executing the Grasping Action |
|
|
129 | (13) |
|
6.2.1 Characteristics of the Visual Input to AIP |
|
|
130 | (1) |
|
6.2.2 The Search for Grasp Quality |
|
|
131 | (3) |
|
|
134 | (2) |
|
|
136 | (6) |
|
|
142 | (3) |
|
|
142 | (3) |
|
7 An Ever-Developing Research Framework |
|
|
145 | |
|
7.1 Purely Visual and Visuomotor Transformations in AIP |
|
|
145 | (5) |
|
7.1.1 Visual-Visual Transformations |
|
|
145 | (1) |
|
7.1.2 Visuomotor Transformations |
|
|
146 | (2) |
|
7.1.3 The Reaching and Grasping Action |
|
|
148 | (1) |
|
|
149 | (1) |
|
7.2 A Tighter Interaction Between the Streams |
|
|
150 | (2) |
|
7.2.1 Links Between CIP and the Ventral Stream |
|
|
150 | (1) |
|
7.2.2 Links Between AIP and the Ventral Stream |
|
|
151 | (1) |
|
7.3 fRI, Functional Robotic Imaging: Visualizing a Robot Brain |
|
|
152 | (6) |
|
7.3.1 Modeling Requirements |
|
|
153 | (1) |
|
|
154 | (1) |
|
7.3.3 Reproducing and Predicting Experiments |
|
|
155 | (1) |
|
7.3.4 fRI of the Posterior Parietal Cortex |
|
|
156 | (1) |
|
7.3.5 The Brain-Damaged Robot |
|
|
157 | (1) |
|
|
158 | (2) |
|
7.4.1 Temporal Coordination |
|
|
158 | (1) |
|
|
159 | (1) |
|
|
159 | (1) |
|
|
160 | (1) |
|
|
160 | |
|
|
161 | |