About the Authors |
|
xix | |
Foreword |
|
xxi | |
Preface |
|
xxiii | |
Acknowledgments |
|
xxv | |
|
Chapter 1 Introduction to HCI Research |
|
|
1 | (24) |
|
|
1 | (1) |
|
|
1 | (1) |
|
1.2 Types of HCI Research Contributions |
|
|
2 | (1) |
|
1.3 Changes in Topics of HCI Research Over Time |
|
|
3 | (1) |
|
1.4 Changes in HCI Research Methods Over Time |
|
|
4 | (3) |
|
1.5 Understanding HCI Research Methods and Measurement |
|
|
7 | (2) |
|
1.6 The Nature of Interdisciplinary Research in HCI |
|
|
9 | (2) |
|
1.7 Who is the Audience for Your Research? |
|
|
11 | (2) |
|
1.8 Understanding One Research Project in the Context of Related Research |
|
|
13 | (5) |
|
1.9 Inherent Trade-offs in HCI |
|
|
18 | (1) |
|
|
19 | (6) |
|
|
22 | (3) |
|
Chapter 2 Experimental Research |
|
|
25 | (20) |
|
2.1 Types of Behavioral Research |
|
|
26 | (1) |
|
|
27 | (5) |
|
2.2.1 Null Hypothesis and Alternative Hypothesis |
|
|
28 | (2) |
|
2.2.2 Dependent and Independent Variables |
|
|
30 | (1) |
|
2.2.3 Typical Independent Variables in HCI Research |
|
|
30 | (1) |
|
2.2.4 Typical Dependent Variables in HCI Research |
|
|
31 | (1) |
|
2.3 Basics of Experimental Research |
|
|
32 | (3) |
|
2.3.1 Components of an Experiment |
|
|
32 | (1) |
|
|
33 | (2) |
|
|
35 | (4) |
|
2.4.1 Why Do We Need Them? |
|
|
35 | (1) |
|
2.4.2 Type I and Type II Errors |
|
|
36 | (2) |
|
2.4.3 Controlling the Risks of Type I and Type II Errors |
|
|
38 | (1) |
|
2.5 Limitations of Experimental Research |
|
|
39 | (2) |
|
|
41 | (4) |
|
|
43 | (2) |
|
Chapter 3 Experimental Design |
|
|
45 | (26) |
|
3.1 What Needs to be Considered When Designing Experiments? |
|
|
46 | (1) |
|
3.2 Determining the Basic Design Structure |
|
|
47 | (1) |
|
3.3 Investigating a Single Independent Variable |
|
|
48 | (8) |
|
3.3.1 Between-Group Design and Within-Group Design |
|
|
49 | (3) |
|
3.3.2 Choosing the Appropriate Design Approach |
|
|
52 | (4) |
|
3.4 Investigating More Than One Independent Variable |
|
|
56 | (3) |
|
|
56 | (1) |
|
|
57 | (1) |
|
3.4.3 Interaction Effects |
|
|
58 | (1) |
|
3.5 Reliability of Experimental Results |
|
|
59 | (6) |
|
|
59 | (1) |
|
|
60 | (5) |
|
3.6 Experimental Procedures |
|
|
65 | (1) |
|
|
66 | (5) |
|
|
68 | (3) |
|
Chapter 4 Statistical Analysis |
|
|
71 | (34) |
|
4.1 Preparing Data for Statistical Analysis |
|
|
71 | (3) |
|
|
72 | (1) |
|
|
73 | (1) |
|
|
74 | (1) |
|
4.2 Descriptive Statistics |
|
|
74 | (2) |
|
4.2.1 Measures of Central Tendency |
|
|
74 | (1) |
|
|
75 | (1) |
|
|
76 | (1) |
|
|
77 | (3) |
|
4.4.1 Independent-Samples t Test |
|
|
78 | (1) |
|
4.4.2 Paired-Samples / Test |
|
|
78 | (1) |
|
4.4.3 Interpretation of t Test Results |
|
|
79 | (1) |
|
4.4.4 Two-Tailed t Tests and One-Tailed t Tests |
|
|
80 | (1) |
|
|
80 | (7) |
|
|
80 | (2) |
|
|
82 | (1) |
|
4.5.3 Repeated Measures ANOVA |
|
|
83 | (2) |
|
4.5.4 ANOVA for Split-Plot Design |
|
|
85 | (2) |
|
4.6 Assumptions of t Tests and F Tests |
|
|
87 | (1) |
|
4.7 Identifying Relationships |
|
|
88 | (5) |
|
|
88 | (3) |
|
|
91 | (2) |
|
4.8 Nonparametric Statistical Tests |
|
|
93 | (7) |
|
|
94 | (2) |
|
4.8.2 Other Nonparametric Tests |
|
|
96 | (4) |
|
|
100 | (5) |
|
|
103 | (2) |
|
|
105 | (30) |
|
|
105 | (1) |
|
5.2 Benefits and Drawbacks of Surveys |
|
|
106 | (2) |
|
5.3 Goals and Targeted Users for Survey Research |
|
|
108 | (1) |
|
5.4 Probabilistic Sampling |
|
|
109 | (4) |
|
|
111 | (1) |
|
|
112 | (1) |
|
|
113 | (1) |
|
5.5 Nonprobabilistic Sampling |
|
|
113 | (6) |
|
|
114 | (1) |
|
|
115 | (1) |
|
5.5.3 Random Sampling of Usage, Not Users |
|
|
116 | (1) |
|
5.5.4 Self-Selected Surveys |
|
|
116 | (1) |
|
5.5.5 Uninvestigated Populations |
|
|
117 | (2) |
|
5.6 Developing Survey Questions |
|
|
119 | (3) |
|
5.6.1 Open-Ended Questions |
|
|
119 | (1) |
|
5.6.2 Closed-Ended Questions |
|
|
120 | (1) |
|
5.6.3 Common Problems With Survey Questions |
|
|
121 | (1) |
|
5.7 Overall Survey Structure |
|
|
122 | (2) |
|
|
124 | (1) |
|
5.9 Paper or Online Surveys? |
|
|
124 | (2) |
|
5.10 Pilot Testing the Survey Tool |
|
|
126 | (2) |
|
|
128 | (1) |
|
|
129 | (1) |
|
|
130 | (5) |
|
|
131 | (4) |
|
|
135 | (18) |
|
|
135 | (3) |
|
6.2 Why do we Use Diaries in HCI Research? |
|
|
138 | (3) |
|
6.3 Participants for a Diary Study |
|
|
141 | (2) |
|
|
143 | (2) |
|
|
143 | (1) |
|
|
144 | (1) |
|
6.4.3 Hybrid Feedback and Elicitation Diary |
|
|
145 | (1) |
|
6.5 Data Collection for the Diary Study |
|
|
145 | (3) |
|
6.6 Letting Participants Know When to Record a Diary Entry |
|
|
148 | (1) |
|
|
149 | (1) |
|
|
150 | (3) |
|
|
151 | (2) |
|
|
153 | (34) |
|
|
153 | (1) |
|
7.2 Observing Sara: A Case Study of a Case Study |
|
|
154 | (2) |
|
7.3 What is a Case Study? |
|
|
156 | (3) |
|
7.3.1 In-Depth Investigation of a Small Number of Cases |
|
|
156 | (1) |
|
7.3.2 Examination in Context |
|
|
157 | (1) |
|
7.3.3 Multiple Data Sources |
|
|
157 | (2) |
|
7.3.4 Emphasis on Qualitative Data and Analysis |
|
|
159 | (1) |
|
7.4 Goals of HCI Case Studies |
|
|
159 | (6) |
|
|
160 | (1) |
|
|
160 | (2) |
|
|
162 | (2) |
|
|
164 | (1) |
|
|
165 | (5) |
|
7.5.1 Intrinsic or Instrumental |
|
|
165 | (1) |
|
7.5.2 Single Case or Multiple Cases |
|
|
165 | (4) |
|
7.5.3 Embedded or Holistic |
|
|
169 | (1) |
|
7.6 Research Questions and Hypotheses |
|
|
170 | (2) |
|
|
172 | (2) |
|
|
174 | (2) |
|
7.8.1 Data Sources and Questions |
|
|
174 | (1) |
|
|
175 | (1) |
|
7.9 Analysis and Interpretation |
|
|
176 | (2) |
|
7.10 Writing Up the Study |
|
|
178 | (2) |
|
7.11 Informal Case Studies |
|
|
180 | (2) |
|
|
182 | (5) |
|
|
184 | (3) |
|
Chapter 8 Interviews and Focus Groups |
|
|
187 | (42) |
|
|
187 | (1) |
|
8.2 Pros and Cons of Interviews |
|
|
188 | (1) |
|
8.3 Applications of Interviews in HCI Research |
|
|
189 | (7) |
|
8.3.1 Initial Exploration |
|
|
189 | (4) |
|
8.3.2 Requirements Gathering |
|
|
193 | (2) |
|
8.3.3 Evaluation and Subjective Reactions |
|
|
195 | (1) |
|
|
196 | (2) |
|
|
198 | (6) |
|
8.5.1 How Much Structure? |
|
|
198 | (2) |
|
8.5.2 Focused and Contextual Interviews |
|
|
200 | (4) |
|
8.6 Interviews vs Focus Groups |
|
|
204 | (2) |
|
|
206 | (4) |
|
8.8 Conducting an Interview |
|
|
210 | (6) |
|
|
210 | (1) |
|
8.8.2 Recording the Responses |
|
|
211 | (1) |
|
8.8.3 During the Interview |
|
|
212 | (4) |
|
8.9 Electronically Mediated Interviews and Focus Groups |
|
|
216 | (3) |
|
|
217 | (1) |
|
|
217 | (2) |
|
8.10 Analyzing Interview Data |
|
|
219 | (5) |
|
|
220 | (1) |
|
|
221 | (2) |
|
|
223 | (1) |
|
|
223 | (1) |
|
|
224 | (5) |
|
|
226 | (3) |
|
|
229 | (34) |
|
|
229 | (2) |
|
|
231 | (2) |
|
|
233 | (2) |
|
9.4 Conducting Ethnographic Research |
|
|
235 | (13) |
|
9.4.1 Selecting a Site or Group of Interest |
|
|
236 | (1) |
|
9.4.2 Participating: Choosing a Role |
|
|
237 | (4) |
|
9.4.3 Building Relationships |
|
|
241 | (1) |
|
|
242 | (1) |
|
9.4.5 Interviewing, Observing, Analyzing, Repeating, and Theorizing |
|
|
243 | (4) |
|
|
247 | (1) |
|
|
248 | (8) |
|
|
248 | (1) |
|
|
249 | (1) |
|
9.5.3 Educational Settings |
|
|
250 | (1) |
|
9.5.4 Ethnographies of Mobile and Ubiquitous Systems |
|
|
251 | (1) |
|
9.5.5 Virtual Ethnography |
|
|
252 | (4) |
|
|
256 | (7) |
|
|
258 | (5) |
|
Chapter 10 Usability Testing |
|
|
263 | (36) |
|
|
263 | (1) |
|
10.2 What is Usability Testing? |
|
|
263 | (2) |
|
10.3 How Does Usability Testing Relate to "Traditional" Research? |
|
|
265 | (2) |
|
10.4 Types of Usability Testing or Usability Inspections |
|
|
267 | (4) |
|
10.4.1 Expert-Based Testing |
|
|
268 | (2) |
|
10.4.2 Automated Usability Testing |
|
|
270 | (1) |
|
10.5 The Process of User-Based Testing |
|
|
271 | (22) |
|
10.5.1 Formative and Summative Usability Testing |
|
|
271 | (3) |
|
10.5.2 Stages of Usability Testing |
|
|
274 | (1) |
|
10.5.3 How Many Users are Sufficient? |
|
|
275 | (1) |
|
10.5.4 Locations for Usability Testing |
|
|
276 | (10) |
|
|
286 | (2) |
|
|
288 | (2) |
|
10.5.7 The Usability Testing Session |
|
|
290 | (2) |
|
10.5.8 Making Sense of the Data |
|
|
292 | (1) |
|
10.6 Other Variations on Usability Testing |
|
|
293 | (1) |
|
|
294 | (5) |
|
|
296 | (3) |
|
Chapter 11 Analyzing Qualitative Data |
|
|
299 | (30) |
|
|
299 | (1) |
|
11.2 Goals and Stages of Qualitative Analysis |
|
|
300 | (1) |
|
|
301 | (2) |
|
|
301 | (1) |
|
11.3.2 Questions to Consider Before Content Analysis |
|
|
301 | (2) |
|
11.4 Analyzing Text Content |
|
|
303 | (17) |
|
|
303 | (8) |
|
|
311 | (3) |
|
11.4.3 Ensuring High-Quality Analysis |
|
|
314 | (6) |
|
11.5 Analyzing Multimedia Content |
|
|
320 | (2) |
|
|
322 | (7) |
|
|
325 | (4) |
|
Chapter 12 Automated Data Collection Methods |
|
|
329 | (40) |
|
|
329 | (1) |
|
|
330 | (9) |
|
|
330 | (8) |
|
12.2.2 Stored Application Data |
|
|
338 | (1) |
|
12.3 Activity-Logging Software |
|
|
339 | (7) |
|
12.3.1 Web Proxies and Interaction Loggers |
|
|
340 | (4) |
|
12.3.2 Keystroke and Activity Loggers |
|
|
344 | (1) |
|
12.3.3 Interaction Recording Tools |
|
|
345 | (1) |
|
|
346 | (7) |
|
12.4.1 Instrumented Software |
|
|
346 | (3) |
|
|
349 | (4) |
|
12.5 Hybrid Data Collection Methods |
|
|
353 | (1) |
|
12.6 Data Management and Analysis |
|
|
354 | (4) |
|
12.6.1 Handling Stored Data |
|
|
354 | (1) |
|
12.6.2 Analyzing Log Files |
|
|
355 | (3) |
|
12.7 Automated Interface Evaluation |
|
|
358 | (1) |
|
12.8 Challenges of Computerized Data Collection |
|
|
358 | (3) |
|
|
361 | (8) |
|
|
365 | (4) |
|
Chapter 13 Measuring the Human |
|
|
369 | (42) |
|
|
369 | (1) |
|
|
370 | (6) |
|
|
370 | (1) |
|
|
371 | (5) |
|
13.3 Motion and Position Tracking |
|
|
376 | (5) |
|
13.3.1 Muscular and Skeletal Position Sensing |
|
|
377 | (2) |
|
13.3.2 Motion Tracking for Large Displays and Virtual Environments |
|
|
379 | (2) |
|
|
381 | (5) |
|
13.4.1 Physiological Data |
|
|
381 | (5) |
|
13.5 Data Collection, Analysis, and Interpretation |
|
|
386 | (8) |
|
|
387 | (2) |
|
|
389 | (1) |
|
13.5.3 Data Interpretation |
|
|
390 | (4) |
|
|
394 | (2) |
|
|
396 | (15) |
|
|
399 | (12) |
|
Chapter 14 Online and Ubiquitous HCI Research |
|
|
411 | (44) |
|
|
411 | (1) |
|
|
412 | (13) |
|
14.2.1 Observational Online Studies |
|
|
412 | (2) |
|
14.2.2 Online Data Collection |
|
|
414 | (2) |
|
|
416 | (6) |
|
14.2.4 Online Research Design Challenges |
|
|
422 | (3) |
|
|
425 | (11) |
|
14.3.1 Introduction to Human Computation |
|
|
425 | (4) |
|
14.3.2 Conducting Human Computation Studies |
|
|
429 | (6) |
|
14.3.3 Future of Human Computation |
|
|
435 | (1) |
|
14.4 Sensors and Ubiquitous Computing |
|
|
436 | (5) |
|
14.4.1 History and Examples |
|
|
437 | (2) |
|
14.4.2 Ubiquitous Computing Research Methods |
|
|
439 | (2) |
|
|
441 | (14) |
|
|
443 | (12) |
|
Chapter 15 Working With Human Subjects |
|
|
455 | (38) |
|
|
455 | (1) |
|
15.2 Identifying Potential Participants |
|
|
455 | (8) |
|
|
456 | (2) |
|
15.2.2 How Many Subjects? |
|
|
458 | (2) |
|
15.2.3 Recruiting Participants |
|
|
460 | (3) |
|
15.3 Care and Handling of Research Participants |
|
|
463 | (21) |
|
15.3.1 Risks and Concerns of Research Participants |
|
|
464 | (4) |
|
15.3.2 Protecting Privacy |
|
|
468 | (1) |
|
15.3.3 Institutional Review Boards |
|
|
469 | (3) |
|
|
472 | (4) |
|
15.3.5 Respecting Participants |
|
|
476 | (2) |
|
15.3.6 Additional Concerns |
|
|
478 | (5) |
|
15.3.7 International Concerns |
|
|
483 | (1) |
|
15.4 Human Subjects Research and the Public Trust |
|
|
484 | (1) |
|
|
485 | (8) |
|
|
487 | (6) |
|
Chapter 16 Working With Research Participants With Disabilities |
|
|
493 | (30) |
|
|
493 | (2) |
|
|
495 | (9) |
|
16.2.1 Inclusion Criteria |
|
|
495 | (2) |
|
16.2.2 Differing Levels of Ability |
|
|
497 | (2) |
|
16.2.3 Recruitment of Participants With Disabilities |
|
|
499 | (2) |
|
16.2.4 Communicating With People Who are Deaf or Hard of Hearing |
|
|
501 | (1) |
|
16.2.5 Communicating With People With Moderate to Severe Speech Impairments |
|
|
502 | (1) |
|
|
503 | (1) |
|
16.3 Methodological Considerations |
|
|
504 | (4) |
|
16.3.1 Small Sample Sizes |
|
|
504 | (1) |
|
16.3.2 Distributed Research |
|
|
505 | (1) |
|
16.3.3 In-Depth Case Studies |
|
|
506 | (1) |
|
16.3.4 Consistent Technical Environment or Best Case Scenario? |
|
|
507 | (1) |
|
|
508 | (1) |
|
|
508 | (10) |
|
16.4.1 Communicating With Potential Participants |
|
|
508 | (1) |
|
|
509 | (1) |
|
16.4.3 Scheduling Data Collection Involving Users With Disabilities |
|
|
510 | (1) |
|
16.4.4 Involving Participants With Cognitive Disabilities/Intellectual Impairments |
|
|
511 | (2) |
|
16.4.5 Documentation for Users With Disabilities |
|
|
513 | (3) |
|
16.4.6 Bringing Extra Computer Parts |
|
|
516 | (1) |
|
|
517 | (1) |
|
|
518 | (5) |
|
|
520 | (3) |
Index |
|
523 | |