| Preface |
|
xvii | |
| Foreword |
|
xix | |
| Section 1: Human Information Processing |
|
|
Chapter 1 Multimodal Interfaces in Human Computer Interaction |
|
|
|
Implications of Compatibility and Cuing Effects for Multimodal Interfaces |
|
|
3 | (10) |
|
|
|
|
|
Multimodal Interfaces Improve Memory |
|
|
13 | (8) |
|
|
|
|
|
Multi-Modal Interfaces for Future Applications of Augmented Cognition |
|
|
21 | (7) |
|
|
|
|
|
|
|
Monitoring of Dual Coded Information: The Impact of Task Switching |
|
|
28 | (5) |
|
|
|
|
|
Assessing Influences of Verbal and Spatial Ability on Multimodal C2 Task Performance |
|
|
33 | (10) |
|
|
|
|
|
|
|
Chapter 2 Cognitive Foundations of Human Information Processing |
|
|
|
The Cognitive Pyramid - Fundamental Components That Influence Human Information Processing |
|
|
43 | (2) |
|
|
|
|
|
Computation of the Correlation Between Consciousness and Physiology in Stress Environments |
|
|
45 | (10) |
|
|
|
|
|
|
|
Training Effects on the Neural Circuits That Support Visual Attention and Multi-Task Performance |
|
|
55 | (5) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Nonlinear Dynamics Model and Simulation of Spontaneous Perception Switching with Ambiguous Visual Stimuli |
|
|
60 | (10) |
|
|
|
Augmented Cognition and Time Perception |
|
|
70 | (3) |
|
|
|
|
|
Melissa M. Walwanis Nelson |
|
|
|
|
Change Blindness: What You Don't See Is What You Don't Get |
|
|
73 | (9) |
|
|
|
Stress, Cognition and Human Performance: A Conceptual Framework |
|
|
82 | (11) |
|
|
|
Chapter 3 Modulators of Human Information Processing in Realistic Environments |
|
|
|
Biocybernetic Systems: Information Processing Challenges That Lie Ahead |
|
|
93 | (8) |
|
|
|
Using Modes of Cardiac Autonomic Control to Assess Demands Upon Processing Resources During Driving |
|
|
101 | (9) |
|
|
|
|
|
|
|
Sensor-Based Cognitive State Assessment in a Mobile Environment |
|
|
110 | (10) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Augmentation of Cognition and Perception Through Advanced Synthetic Vision Technology |
|
|
120 | (10) |
|
|
|
|
|
|
|
|
|
|
|
|
|
Cellulars, Cars and Cortex - A Neurophysiological Study of Multi-Task Performance Degradation |
|
|
130 | (2) |
|
|
|
The Communications Scheduler: A Task Scheduling Mitigation for a Closed Loop Adaptive System |
|
|
132 | (10) |
|
|
|
|
|
|
|
|
|
|
|
Some Implications and Challenges for "Augmented Cognition" from the Perspective of the Theory of Complex and Cognitive Systems |
|
|
142 | (9) |
|
|
|
Chapter 4 Task Specific Information Processing in Operational and Virtual Environments |
|
|
|
Task Specific Information Processing in Operational and Virtual Environments |
|
|
151 | (3) |
|
|
|
Mobile lnfospaces: Personal and Egocentric Space as Psychological Frames for Information Organization in Augmented Reality Environments |
|
|
154 | (10) |
|
|
|
|
|
|
|
|
|
|
|
Cognitive Influences on Self-Rotation Perception |
|
|
164 | (10) |
|
|
|
|
|
|
|
Relationships Among Visual Perception, Psychomotor Performance and Complex Motor Performance in Military Pilots During an Overnight Air-Refueling Simulated Flight: Implications for Automated Cognitive Workload Reduction Systems |
|
|
174 | (10) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Maintaining Optimal Challenge in Computer Games Through Real-Time Physiological Feedback |
|
|
184 | (9) |
|
|
|
|
|
|
|
fMRI of Virtual Social Behavior: Brain Signals in Virtual Reality and Operational Environments |
|
|
193 | (10) |
|
|
|
|
| Section 2: Cognitive State Sensors |
|
|
Chapter 5 Functional Near Infrared Technologies for Assessing Cognitive Function |
|
|
|
Near-Infrared Brain Imaging and Augmented Cognition: A Brief Overview of Advancements, Challenges and Future Developments |
|
|
203 | (1) |
|
|
|
|
|
Non-Invasive Measurement of Functional Optical Brain Changes |
|
|
204 | (1) |
|
|
|
|
|
A New Approach to FNIR: The Optical Tomographic Imaging Spectrometer |
|
|
205 | (2) |
|
|
|
|
|
|
|
|
|
J. Patrick Stautzenberger |
|
|
Hemodynamic Response Estimation During Cognitive Activity Using FNIR Spectroscopy |
|
|
207 | (3) |
|
|
|
|
|
|
|
|
|
|
|
|
|
When the Rules Keep Changing: Using the Fast Optical Signal to Elucidate Different Brain Preparatory States |
|
|
210 | (1) |
|
|
|
|
|
|
|
|
|
|
|
Telescopic Imaging of PFC Hemodynamic and Metabolic Activities by Remote Sensing NIR Imaging |
|
|
211 | (10) |
|
|
|
|
|
|
|
Chapter 6 EEG for Functional Operator State Assessment |
|
|
|
The Invisible Electrode - Zero Prep Time, Ultra Low Capacitive Sensing |
|
|
221 | (10) |
|
|
|
|
|
|
|
|
|
|
|
Artifact Detection and Correction for Operator Functional State Estimation |
|
|
231 | (10) |
|
|
|
|
|
|
|
On-Line Correction of Artifacts in Cognitive State Gauges |
|
|
241 | (4) |
|
|
|
|
|
|
|
eXecutive Load Index (XLI): Spatial-Frequency EEG Tracks Moment-Tomoment Changes in High-Order Attentional Resources |
|
|
245 | (7) |
|
|
|
|
|
Cortical Activity of Soldiers During Shooting as a Function of Varied Task Demand |
|
|
252 | (11) |
|
|
|
Chapter 7 Psycho-Physiological Sensor Technologies |
|
|
|
Psycho-Physiological Sensor Techniques: An Overview |
|
|
263 | (10) |
|
|
|
|
|
|
|
A Suite of Physiological Sensors for Assessing Cognitive States |
|
|
273 | (10) |
|
|
|
|
|
|
|
Use of Near-Infrared Methods to Augment Cognition |
|
|
283 | (1) |
|
|
|
|
|
|
|
Detection of Human Physiological State Change Using Fisher's Linear Discriminant |
|
|
284 | (9) |
|
|
|
|
|
|
|
Facial Temperature as a Measure of Operator State |
|
|
293 | (9) |
|
|
|
|
|
Robust Feature Extraction and Classification of EEG Spectra for Real-Time Classification of Cognitive State |
|
|
302 | (10) |
|
|
|
|
|
|
|
Assessing Cognitive Engagement and Cognitive State from Eye Metrics |
|
|
312 | (9) |
|
|
|
Postural Measurements Seated Subjects as Gauges of Cognitive Engagement |
|
|
321 | (10) |
|
|
|
|
|
|
|
|
|
Chapter 8 Wireless, Wearable & Rugged Sensors for Operational Environments |
|
|
|
Wearable Cognitive Monitors for Dismounted Warriors |
|
|
331 | (4) |
|
|
|
Enhancing Warfighter Readiness Through Physiologic Situational Awareness - The Warfighter Physiological Status Monitoring - Initial Capability |
|
|
335 | (10) |
|
|
|
|
|
|
|
|
|
|
|
Artifact Differences in Seated vs. Mobile EEG Recordings Made During Simulated Military Operations in Urban Terrain (MOUT) |
|
|
345 | (9) |
|
|
|
Developing an Augmented Cognition Sensor for the Operational Environment: The Wearable Arousal Meter |
|
|
354 | (8) |
|
|
|
|
|
|
|
Challenges for Honeywell's Mobile Augmented Cognition Ensemble |
|
|
362 | (5) |
|
|
|
|
|
|
|
|
|
|
|
Scheduling Communications with an Adaptive System Driven by Real-Time Assessment of Cognitive State |
|
|
367 | (10) |
|
|
|
|
|
|
|
|
|
A Low-Cost, "Wireless", Portable, Physiological Monitoring System to Collect Physiological Measures During Operational Team Tasks |
|
|
377 | (10) |
|
|
|
|
|
|
|
Chapter 9 Transforming Sensors into Cognitive State Gauges |
|
|
|
Transforming Sensors Into Cognitive State Gauges |
|
|
387 | (4) |
|
|
|
Feature Saliency Analysis for Operator State Estimation |
|
|
391 | (5) |
|
|
|
|
|
Comparing Classifiers for Real Time Estimation of Cognitive Workload |
|
|
396 | (9) |
|
|
|
|
|
|
|
|
|
EEG Indices Distinguish Spatial and Verbal Working Memory Processing: Implications for Real-Time Monitoring in a Closed-Loop Tactical Tomahawk Weapons Simulation |
|
|
405 | (9) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Statistical Process Control as a Triggering Mechanism for Augmented Cognition Mitigations |
|
|
414 | (7) |
|
|
|
From Disparate Sensors to a Unified Guage: Bringing Them All Together |
|
|
421 | (9) |
|
|
|
|
|
Construction of Appropriate Gauges for the Control of Augmented Cognition Systems |
|
|
430 | (11) |
|
|
| Section 3: Augmented Cognition Technology |
|
|
Chapter 10 Fundamentals of Augmented Cognition |
|
|
|
Session Overview: Foundations of Augmented Cognition |
|
|
441 | (5) |
|
|
|
|
|
Overview of the DARPA Augmented Cognition Technical Integration Experiment |
|
|
446 | (7) |
|
|
|
|
|
|
|
Performance Augmentation Through Cognitive Enhancement (PACE) |
|
|
453 | (7) |
|
|
|
|
|
|
|
Building Honeywell's Adaptive System for the Augmented Cognition Program |
|
|
460 | (9) |
|
|
|
|
|
|
|
|
|
The Boeing Team Fundamentals of Augmented Cognition |
|
|
469 | (8) |
|
|
|
|
|
DaimlerChrysler's Closed Loop Integrated Prototype: Current Status and Outlook |
|
|
477 | (2) |
|
|
|
The Cognitive Cockpit - A Test-Bed for Augmented Cognition |
|
|
479 | (10) |
|
|
|
Chapter 11 Context Modeling for Augmented Cognition |
|
|
|
"Look Who's Talking": Audio Monitoring and Awareness of Social Context |
|
|
489 | (11) |
|
|
|
|
|
|
|
|
|
|
|
|
|
Exploring Human Cognition by Spectral Decomposition of a Markov Random Field |
|
|
500 | (10) |
|
|
|
|
|
Models and Model Biases for Automatically Learning Task Switching Behavior |
|
|
510 | (10) |
|
|
|
|
|
|
|
Context Modeling as an Aid to the Management of Operator State |
|
|
520 | (8) |
|
|
|
Automatic Event Structure Parsing for Context Modeling: A Role for Postural Orienting Responses |
|
|
528 | (9) |
|
|
|
|
|
|
|
|
|
Modeling Human Recognition of Vehicle-Driving Situations as a Supervised Machine Learning Task |
|
|
537 | (7) |
|
|
|
|
|
|
|
Automated Context Modeling Through Text Analysis |
|
|
544 | (2) |
|
|
|
Context Modeling for Augmented Cognition |
|
|
546 | (5) |
|
|
|
Chapter 12 Issues of Trust in Adaptive Systems |
|
|
|
Trust in Adaptive Automation: The Role of Etiquette in Tuning Trust via Analogic and Affective Methods |
|
|
551 | (9) |
|
|
|
Automation Etiquette in the Augmented Cognition Context |
|
|
560 | (10) |
|
|
|
|
|
|
|
Assisted Focus: Heuristic Automation for Guiding Users' Attention Toward Critical Information |
|
|
570 | (7) |
|
|
|
|
|
|
|
Developing Trust of Highly Automated Systems |
|
|
577 | (10) |
|
|
|
|
|
PACT: Enabling Trust in Adaptive Systems Through Contracted Delegation of Authority |
|
|
587 | (10) |
|
|
|
The Impact of Operator Trust on Monitoring a Highly Reliable Automated System |
|
|
597 | (8) |
|
|
|
|
|
Human Interaction with Adaptive Automation: Strategies for Trading of Control Under Possibility of Over-Trust and Complacency |
|
|
605 | (12) |
|
|
|
|
|
|
|
Chapter 13 Closed Loop Systems - Stability and Predictability |
|
|
|
Closed Loop Systems Stability and Predictability |
|
|
617 | (4) |
|
|
|
Enabling Improved Performance Though a Closed-Loop Adaptive System Driven by Real-Time Assessment of Cognitive State |
|
|
621 | (10) |
|
|
|
|
|
|
|
|
|
|
|
The Future of Augmentation Managers |
|
|
631 | (10) |
|
|
|
Cybernetics of Augmented Cognition as an Alternative to Information Processing |
|
|
641 | (10) |
|
|
|
|
|
Implementation of a Closed-Loop Real-Time EEG-Based Drowsiness Detection System: Effects of Feedback Alarms on Performance in a Driving Simulator |
|
|
651 | (10) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
The Challenges of Designing an Intelligent Companion |
|
|
661 | (12) |
|
|
|
|
|
|
|
|
| Section 4: Augmented Cognition and Advanced Computing |
|
|
Chapter 14 Stress in the Computing Environment |
|
|
|
Operator Performance Under Stress |
|
|
673 | (7) |
|
|
|
|
|
|
|
Human Temporal Judgment in the Humans-In-Automation Environment |
|
|
680 | (10) |
|
|
|
|
|
|
|
Concentration - An Instrument to Augment Cognition |
|
|
690 | (10) |
|
|
|
Human Robot Teams as Soldier Augmentation in Future Battlefields: An Overview |
|
|
700 | (7) |
|
|
|
|
|
Cerebral Hemodynamics and Brain Systems in Vigilance |
|
|
707 | (2) |
|
|
|
|
|
Augmented Reality as a Human Computer Interaction Device for Augmented Cognition |
|
|
709 | (9) |
|
|
|
|
|
|
|
|
|
|
|
Spatial Orienting of Attention Using Augmented Reality |
|
|
718 | (11) |
|
|
|
|
|
|
|
Chapter 15 Human-Machine Symbiosis - Biological Interfaces |
|
|
|
Human-Machine Symbiosis Overview |
|
|
729 | (8) |
|
|
|
|
|
Assessment of Invasive Neural Implant Technology |
|
|
737 | (8) |
|
|
|
|
|
|
|
Recording Options for Brain-Computer Interfaces |
|
|
745 | (4) |
|
|
|
|
|
First Investigations of an FNIR-Based Brain-Computer Interface |
|
|
749 | (9) |
|
|
|
|
|
|
|
|
|
Using Hypermedia to Support Communication in Alzheimer's Disease: The CIRCA Project |
|
|
758 | (10) |
|
|
|
|
|
|
|
|
|
|
|
|
|
Information Frames in Augmented Reality Mobile User Interfaces |
|
|
768 | (10) |
|
|
|
|
|
|
|
|
|
|
|
|
|
Toward Collective Intelligence |
|
|
778 | (13) |
|
|
|
Chapter 16 Adaptive User Interfaces |
|
|
|
UCAV Operator Workload Issues Using Adaptive Aiding Systems |
|
|
791 | (6) |
|
|
|
Adaptive User Interfaces: Examination of Adaptation Costs in User Performance |
|
|
797 | (9) |
|
|
|
|
|
Augmented Cognition: An Approach to Increasing Universal Benefit from Information Technology |
|
|
806 | (8) |
|
|
|
|
|
|
|
|
|
Improving Recovery from Multi-Task Interruptions Using an Intelligent Change Awareness Tool |
|
|
814 | (5) |
|
|
|
|
|
Augmenting Knowledge Flow and Comprehension in Command and Control (C2) Environments |
|
|
819 | (10) |
|
|
|
Windows as a Second Language: An Overview of the Jargon Project |
|
|
829 | (10) |
|
|
|
|
|
Chapter 17 Neuroergonomics - Cognitive Human Factors |
|
|
|
Neuroergonomics: An Overview of Research and Applications |
|
|
839 | (2) |
|
|
|
Neurophysiologic Measures for Neuroergonomics |
|
|
841 | (10) |
|
|
|
|
|
The Engineering of Motor Learning and Adaptive Control |
|
|
851 | (1) |
|
Ferdinando A. Mussa-Ivaldi |
|
|
Using Electrical Brain Potentials and Cerebral Oximetry to Detect G-Induced Loss of Consciousness |
|
|
852 | (2) |
|
|
|
|
|
Virtual Environments for Localizing Cognitive Impairments in Real Word Tasks |
|
|
854 | (1) |
|
|
|
|
|
Molecular Genetics of Augmented Cognition |
|
|
855 | (5) |
|
|
|
|
|
Neuro-Ergonomics Support from Bio- And Nano-Technologies |
|
|
860 | (3) |
|
|
|
Chapter 18 Affective Computing |
|
|
|
Affect Sensing and Recognition: State-of-the-Art Overview |
|
|
863 | (10) |
|
|
|
|
|
873 | (6) |
|
|
|
|
|
|
|
Developing Computer Agents with Personalities |
|
|
879 | (10) |
|
|
|
|
|
Results from a Field Study: The Need for an Emotional Relationship Between the Elderly and Their Assistive Technologies |
|
|
889 | (10) |
|
|
|
|
|
Evaluation of Affective Computing Systems from a Dimensional Metaethical Position |
|
|
899 | (9) |
|
|
|
|
|
Use of a Dynamic Personality Filter in Discrete Event Simulation of Human Behavior Under Stress and Fatigue |
|
|
908 | (10) |
|
|
|
|
|
|
|
|
|
|
|
User Experience Based Adaptation of Information in Mobile Contexts for Mobile Messaging |
|
|
918 | (13) |
|
|
|
|
| Section 5: AugCog New Directions |
|
|
Chapter 19 Augmented Cognition for Training Superiority |
|
|
|
Augmented Cognition Technologies Applied to Training: A Roadmap for the Future |
|
|
931 | (10) |
|
|
|
|
|
|
|
|
|
"Oops, I Did It Again": Using Neurophysiological Indicators to Distinguish Slips from Mistakes in Simulation-Based Training Systems |
|
|
941 | (5) |
|
|
|
|
|
Investigating the Transition from Novice to Expert in a Virtual Training Environment Using Neuro-Cognitive Measures |
|
|
946 | (10) |
|
|
|
|
|
|
|
Will Augmented Cognition Improve Training Results? |
|
|
956 | (8) |
|
|
|
|
|
|
|
Augmented Tutoring: Enhancing Simulation Based Training Through Model Tracing and Real-Time Neurophysiological Sensing |
|
|
964 | (10) |
|
|
|
|
|
Recreation Embedded State Tuning for Optimal Readiness and Effectiveness (RESTORE) |
|
|
974 | (10) |
|
|
|
|
|
Potential Predictors of Errors in Shooting Judgment and Cognitive Performance |
|
|
984 | (9) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Chapter 20 Engineering Modular Augmented Cognition Systems |
|
|
|
Toward Platform Architectures for Modular Cognitive Cockpits |
|
|
993 | (10) |
|
|
|
Modular Design for Augmented Cognition Systems |
|
|
1003 | (6) |
|
|
|
|
|
Modular Software for an Augmented Cognition System |
|
|
1009 | (7) |
|
|
|
AMI: An Adaptive Multi-Agent Framework for Augmented Cognition |
|
|
1016 | (9) |
|
|
|
|
|
|
|
|
|
|
|
Developing a Human Error Modeling Architecture (HEMA) |
|
|
1025 | (10) |
|
|
|
|
|
|
|
A Modular Architecture for Integrating Cognitive, Communicative, and Situated Behavior |
|
|
1035 | (12) |
|
|
|
|
|
Chapter 21 Neural Correlates of Cognitive States |
|
|
|
Spatial-Frequency Networks of Cognition |
|
|
1047 | (8) |
|
|
|
|
|
|
|
Preattentive Crossmodal Information Processing Under Distraction and Fatigue |
|
|
1055 | (10) |
|
|
|
|
|
|
|
|
|
|
|
|
|
EEG- and Context-Based Cognitive-State Classifications Lead to Improved Cognitive Performance While Driving |
|
|
1065 | (2) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Neural Correlates of Simulated Driving: Auditory Oddball Responses Dependent on Workload |
|
|
1067 | (10) |
|
|
|
|
|
|
|
|
|
An Experiment to Probe Brain Responses to Driver Information Systems |
|
|
1077 | (12) |
|
|
|
|
|
|
|
|
|
|
|
Chapter 22 Future Applications of Augmented Cognition |
|
|
|
Augmented Cognition for Warfighters: A Beta Test for Future Applications |
|
|
1089 | (8) |
|
|
|
AugCogifying the Army's Future Warfighter |
|
|
1097 | (8) |
|
|
|
|
|
|
|
|
|
|
|
Augmented Cognition for Fire Emergency Response: An Iterative User Study |
|
|
1105 | (10) |
|
|
|
|
|
|
|
|
|
|
|
|
|
An Intelligent Deception Verification System |
|
|
1115 | (7) |
|
|
|
Augmented higher Cognition: Enhancing Speech Recognition Through Neural Activity Measures |
|
|
1122 | (10) |
|
|
|
|
|
Augmented Cognition for Bioinformatics Problem Solving |
|
|
1132 | (13) |
|
|
|
|
|
|
|
Chapter 23 Augmented Cognition and its Influence on Decision Making |
|
|
|
Augmenting Decision Making - What GOES? |
|
|
1145 | (11) |
|
|
|
Survey of Decision Support Control/Display Concepts: Classification, Lessons Learned, Application to Unmanned Aerial Vehicle Supervisory Control |
|
|
1156 | (9) |
|
|
|
|
|
|
|
|
|
Enabling Autonomous UAV Co-Operation by Onboard Artificial Cognition |
|
|
1165 | (10) |
|
|
|
|
|
Integration of Human Domains to Enhance Decision Making Through Design, Process, Procedures and Organizational Structure |
|
|
1175 | (5) |
|
Jennifer McGovern Narkevicius |
|
|
|
|
|
|
Implications of Adaptive vs. Adaptable UIs on Decision Making: Why "Automated Adaptiveness" Is Not Always the Right Answer |
|
|
1180 | (10) |
|
|
|
|
|
|
|
|
|
|
|
Supervising UAVs: Improving Operator Performance by Optimizing the Human Factor |
|
|
1190 | (9) |
|
|
|
|
|
|
|
Operator in the Loop? Adaptive Decision Support for Military Air Missions |
|
|
1199 | (12) |
|
|
|
|
|
|
|
|
|
Chapter 24 Team Cognition |
|
|
|
|
|
1211 | (8) |
|
|
|
Modeling, Measuring, and Improving Cognition at the Team Level |
|
|
1219 | (9) |
|
|
|
|
|
|
|
|
|
|
|
Social Psychophysiological Compliance as a Gauge of Teamwork |
|
|
1228 | (11) |
|
|
|
|
|
|
|
Tools for Enhancing Team Performance Through Automated Modeling of the Content of Team Discourse |
|
|
1239 | (10) |
|
|
|
FAUCET: Using Communication Flow Analysis to Diagnose Team Cognition |
|
|
1249 | (8) |
|
|
|
The Effect of Command and Control Team Structure on Ability to Quickly and Accurately Retarget Unmanned Vehicles |
|
|
1257 | (10) |
|
|
|
|
|
|
|
Cognition, Teams, and Augmenting Team Cognition: Understanding Memory Failures in Distributed Human-Agent Teams |
|
|
1267 | (10) |
|
|
|
|
|
|
|
|
| Author Index |
|
1277 | (4) |
| Subject Index |
|
1281 | |
