Summary |
|
1 | (4) |
|
|
5 | (6) |
|
Study Background and Charge to the Committee |
|
|
6 | (1) |
|
|
7 | (1) |
|
|
7 | (1) |
|
|
8 | (1) |
|
Effect of AI on Human Performance |
|
|
9 | (1) |
|
Report Structure and Summary |
|
|
10 | (1) |
|
2 Human-Ai Teaming Methods And Models |
|
|
11 | (8) |
|
|
11 | (1) |
|
Human-AI Teaming Models and Perspectives |
|
|
12 | (2) |
|
Should Humans Team with AI? |
|
|
14 | (2) |
|
Improved Models for Human-AI Teams |
|
|
16 | (1) |
|
Key Challenges and Research Gaps |
|
|
17 | (1) |
|
|
17 | (1) |
|
|
18 | (1) |
|
3 Human-Ai Teaming Processes And Effectiveness |
|
|
19 | (6) |
|
What Does It Mean for AI to Be a Teammate? |
|
|
19 | (1) |
|
Processes and Characteristics of Effective Human-AI Teams |
|
|
20 | (3) |
|
|
20 | (1) |
|
|
21 | (1) |
|
Communication and Coordination |
|
|
22 | (1) |
|
|
22 | (1) |
|
Other Features of Effective Teams |
|
|
23 | (1) |
|
Key Challenges and Research Gaps |
|
|
23 | (1) |
|
|
23 | (1) |
|
|
24 | (1) |
|
4 Situation Awareness In Human-Ai Teams |
|
|
25 | (6) |
|
Situation Awareness in Multi-Domain Operations |
|
|
25 | (2) |
|
Key Challenges and Research Gaps |
|
|
27 | (1) |
|
|
27 | (1) |
|
Shared SA in Human-AI Teams |
|
|
27 | (3) |
|
Key Challenges and Research Gaps |
|
|
29 | (1) |
|
|
29 | (1) |
|
|
30 | (1) |
|
5 Ai Transparency And Explainability |
|
|
31 | (10) |
|
|
34 | (2) |
|
Key Challenges and Research Gaps |
|
|
35 | (1) |
|
|
35 | (1) |
|
|
36 | (4) |
|
Key Challenges and Research Gaps |
|
|
37 | (1) |
|
|
38 | (2) |
|
|
40 | (1) |
|
6 Human-Ai Team Interaction |
|
|
41 | (8) |
|
|
41 | (3) |
|
Key Challenges and Research Gaps |
|
|
44 | (1) |
|
|
44 | (1) |
|
AI Dynamics and Temporality |
|
|
44 | (2) |
|
Key Challenges and Research Gaps |
|
|
45 | (1) |
|
|
45 | (1) |
|
|
46 | (1) |
|
Key Challenges and Research Gaps |
|
|
46 | (1) |
|
|
46 | (1) |
|
Other Human-AI Team Interaction Issues |
|
|
47 | (1) |
|
Key Challenges and Research Gaps |
|
|
47 | (1) |
|
|
47 | (1) |
|
|
48 | (1) |
|
|
49 | (8) |
|
Trust Frameworks Past and Present |
|
|
49 | (2) |
|
Trusting AI in Complex Work Environments |
|
|
51 | (1) |
|
Key Challenges and Research Gaps |
|
|
51 | (1) |
|
|
52 | (3) |
|
|
55 | (2) |
|
8 Identification And Mitigation Of Bias In Human-Ai Teams |
|
|
57 | (6) |
|
|
57 | (1) |
|
|
57 | (2) |
|
|
59 | (1) |
|
Key Challenges and Research Gaps |
|
|
60 | (1) |
|
|
60 | (1) |
|
|
61 | (2) |
|
9 Training Human-Ai Teams |
|
|
63 | (6) |
|
Human-Human Team Training to Inform Human-AI Team Training |
|
|
63 | (2) |
|
Strategies for Team Training |
|
|
64 | (1) |
|
|
64 | (1) |
|
Training Content: Taskwork and Teamwork |
|
|
65 | (1) |
|
Key Challenges and Research Gaps |
|
|
65 | (1) |
|
|
66 | (1) |
|
|
67 | (2) |
|
10 Hsi Processes And Measures Of Human-Ai Team Collaboration And Performance |
|
|
69 | (16) |
|
Taking an HSI Perspective in Human-AI Team Design and Implementation |
|
|
69 | (2) |
|
Key Challenges and Research Gaps |
|
|
70 | (1) |
|
|
70 | (1) |
|
Requirements for Research in Human-AI Team Development |
|
|
71 | (1) |
|
Key Challenges and Research Gaps |
|
|
71 | (1) |
|
|
71 | (1) |
|
Research Team Competencies |
|
|
72 | (1) |
|
Key Challenges and Research Gaps |
|
|
73 | (1) |
|
|
73 | (1) |
|
HSI Considerations for Human-AI Teams |
|
|
73 | (2) |
|
Key Challenges and Research Gaps |
|
|
75 | (1) |
|
|
75 | (1) |
|
Testing, Evaluation, Verification, and Validation of Human-AI Teams |
|
|
75 | (2) |
|
Key Challenges and Research Gaps |
|
|
77 | (1) |
|
|
77 | (1) |
|
Human-AI Team Research Testbeds |
|
|
77 | (1) |
|
Key Challenges and Research Gaps |
|
|
78 | (1) |
|
|
78 | (1) |
|
Human-AI Team Measures and Metrics |
|
|
78 | (3) |
|
Key Challenges and Research Gaps |
|
|
80 | (1) |
|
|
80 | (1) |
|
Agile Software Development and HSI |
|
|
81 | (2) |
|
Key Challenges and Research Gaps |
|
|
82 | (1) |
|
|
82 | (1) |
|
|
83 | (2) |
|
|
85 | (6) |
References |
|
91 | (24) |
Appendixes |
|
A Committee Biographies |
|
115 | (4) |
B Human-AI Teaming Workshop Agenda |
|
119 | (2) |
C Definitions |
|
121 | |