Macrocognition Metrics and Scenarios: Design and Evaluation for Real-World Teams translates advances by scientific leaders in the relatively new area of macrocognition into a format that will support immediate use by members of the software testing and evaluation community for large-scale systems as well as trainers of real-world teams. Macrocognition is defined as how activity in real-world teams is adapted to the complex demands of a setting with high consequences for failure. The primary distinction between macrocognition and prior research is that the primary unit for measurement is a real-world team coordinating their activity, rather than individuals processing information, the predominant model for cognition for decades. This book provides an overview of the theoretical foundations of macrocognition, describes a set of exciting new macrocognitive metrics, and provides guidance on using the metrics in the context of different approaches to evaluation and measurement of real-world teams.
|
|
|
vii | |
|
|
|
ix | |
| Acknowledgments |
|
xi | |
|
|
|
xiii | |
| Preface |
|
xxiii | |
|
|
|
|
|
|
|
|
|
PART I THEORETICAL FOUNDATIONS |
|
|
|
1 Theory → Concepts → Measures but Policies → Metrics |
|
|
3 | (8) |
|
|
|
2 Some Challenges for Macrocognitive Measurement |
|
|
11 | (18) |
|
|
|
3 Measuring Macrocognition in Teams: Some Insights for Navigating the Complexities |
|
|
29 | (18) |
|
|
|
|
|
|
|
|
|
PART II MACROCOGNITION MEASURES FOR REAL-WORLD TEAMS |
|
|
|
4 Macrocognitive Measures for Evaluating Cognitive Work |
|
|
47 | (18) |
|
|
|
5 Measuring Attributes of Rigor in Information Analysis |
|
|
65 | (20) |
|
|
|
|
|
|
|
6 Assessing Expertise When Performance Exceeds Perfection |
|
|
85 | (10) |
|
|
|
|
|
|
|
|
|
|
|
7 Demand Calibration in Multitask Environments: Interactions of Micro and Macrocognition |
|
|
95 | (14) |
|
|
|
8 Assessment of Intent in Macrocognitive Systems |
|
|
109 | (14) |
|
|
|
9 Survey of Healthcare Teamwork Rating Tools: Reliability, Validity, Ease of Use, and Diagnostic Efficacy |
|
|
123 | (14) |
|
|
|
|
|
|
|
|
|
10 Measurement Approaches for Transfers of Work During Handoffs |
|
|
137 | (24) |
|
|
|
|
|
11 The Pragmatics of Communication-based Methods for Measuring Macrocognition |
|
|
161 | (18) |
|
|
|
|
|
12 From Data, to Information, to Knowledge: Measuring Knowledge Building in the Context of Collaborative Cognition |
|
|
179 | (24) |
|
|
|
|
|
|
|
|
|
|
|
PART III SCENARIO-BASED EVALUATION APPROACHES |
|
|
|
13 Forging New Evaluation Paradigms: Beyond Statistical Generalization |
|
|
203 | (18) |
|
|
|
|
|
14 Facets of Complexity in Situated Work |
|
|
221 | (32) |
|
|
|
|
|
|
|
15 Evaluating the Resilience of a Human-Computer Decision-making Team: A Methodology for Decision-Centered Testing |
|
|
253 | (18) |
|
|
|
|
|
16 Synthetic Task Environments: Measuring Macrocognition |
|
|
271 | (14) |
|
|
|
|
|
|
|
|
|
|
|
17 System Evaluation Using the Cognitive Performance Indicators |
|
|
285 | (18) |
|
|
|
|
| Index |
|
303 | |
Dr. Emily S. Patterson conducts research to improve the performance of real-world teams in complex, socio-technical settings, including healthcare, military, intelligence analysis, space shuttle mission control, emergency response, and emergency call centers. She is an assistant professor in the Health Information Management and Systems Division at The Ohio State University Medical Center, School of Allied Medical Professions.. In 2004, Dr. Patterson received the Alexander C. Williams, Jr., Design Award from the Human Factors and Ergonomics Society for identifying nursing "workarounds" that reduced the effectiveness of a barcode point of care system in reducing medication errors in 128 medical centers. Dr. Patterson serves as Associate Editor for IEEE Transactions on Systems, Man, and Cybernetics: Part A, serves on the Editorial Advisory Board for the Joint Commission Journal on Quality and Patient Safety and the Advisory Committee for the Center for Innovation of the National Board of Medical Examiners, and previously served as Centers Communication Advisory Group Member for the Joint Commission International Center for Patient Safety. Dr. Janet E. Miller is a Program Manager in the Air Force Research Laboratory's Sensors Directorate at Wright-Patterson AFB, Ohio. Dr. Miller received a Ph.D. in Industrial and Systems Engineering from The Ohio State University in 2002. Dr. Miller is advancing the state-of-the-art in macrocognition research and application in military situations.
Rohkem infot Taylor & Francis e-raamatute kohta