| List of Figures |
|
xvi | |
| List of Tables |
|
xix | |
| Acknowledgments |
|
xxi | |
| About the Companion Website |
|
xxiii | |
| Chapter 1 Introduction |
|
1 | (24) |
|
1.0 Introduction to the Book |
|
|
3 | (16) |
|
|
|
3 | (1) |
|
Systematically Working with Video Data: Phases I-V |
|
|
4 | (13) |
|
Chapter 1 Systematically Working with Multimodal Data: Introduction |
|
|
4 | (1) |
|
Chapter 2 Philosophical and Theoretical Background |
|
|
5 | (1) |
|
Chapter 3 Systematically Working with Multimodal Data Phase I |
|
|
6 | (3) |
|
Chapter 3.0 Phase I: Data Collection |
|
|
7 | (1) |
|
Chapter 3.1 Systematically Working with Small Data Sets/Data Pieces: Phase I |
|
|
7 | (1) |
|
Chapter 3.2 Systematically Working with Medium-Sized Data Sets: Phase I |
|
|
8 | (1) |
|
Chapter 3.3 Systematically Working with Large Data Sets: Phase I |
|
|
9 | (1) |
|
Chapter 4 Systematically Working with Video Data Phase II |
|
|
9 | (3) |
|
Chapter 4.0 Phase II: Delineating the Data |
|
|
10 | (1) |
|
Chapter 4.1 Systematically Working with Small Data Sets/Data Pieces: Phase II |
|
|
10 | (1) |
|
Chapter 4.2 Systematically Working with Medium-Sized Data Sets: Phase II |
|
|
11 | (1) |
|
Chapter 4.3 Systematically Working with Large Data Sets: Phase II |
|
|
11 | (1) |
|
Chapter 5 Systematically Working with Video Data Phase III |
|
|
12 | (3) |
|
Chapter 5.0 Phase III: Selecting Data Pieces for Micro analysis |
|
|
12 | (1) |
|
Chapter 5.1 Systematically Working with Small Data Sets/Data Pieces: Phase III |
|
|
13 | (1) |
|
Chapter 5.2 Systematically Working with Medium-Sized Data Sets: Phase III |
|
|
13 | (1) |
|
Chapter 5.3 Systematically Working with Large Data Sets: Phase III |
|
|
14 | (1) |
|
Chapter 6 Systematically Working with Video Data Phase IV |
|
|
15 | (1) |
|
Phase IV: Transcribing Data Using Multimodal Transcription Conventions |
|
|
15 | (1) |
|
Chapter 7 Systematically Working with Multimodal Data Phase V |
|
|
16 | (1) |
|
Phase V: Using Analytical Tools |
|
|
16 | (1) |
|
Chapter 8 Systematically Working with Multimodal Data |
|
|
17 | (11) |
|
A Quick Guide for Instructors |
|
|
17 | (1) |
|
|
|
17 | (2) |
|
1.1 Brief Introduction to Multimodal Discourse Analysis |
|
|
19 | (6) |
|
Multimodal Discourse Analysis: Some Other Research |
|
|
19 | (1) |
|
Multimodal Discourse Analysis: Research Underpinning This Book |
|
|
20 | (1) |
|
Mediated Discourse Theory |
|
|
21 | (1) |
|
|
|
22 | (1) |
|
|
|
23 | (2) |
| Chapter 2 Background |
|
25 | (36) |
|
2.0 Philosophical and Theoretical Background |
|
|
27 | (23) |
|
Philosophical Underpinnings |
|
|
28 | (4) |
|
|
|
29 | (2) |
|
|
|
31 | (1) |
|
Theoretical Underpinnings: One Principle, Two Sub-Principles |
|
|
32 | (3) |
|
The Principle of Social Action |
|
|
32 | (1) |
|
The Sub-Principle of Communication |
|
|
33 | (1) |
|
The Sub-Principle of History |
|
|
34 | (1) |
|
Principle and Sub-Principles: A Perfect Fit |
|
|
35 | (1) |
|
Multimodal Mediated Theory: Basic Theoretical Concepts |
|
|
35 | (15) |
|
Embodiment and Perception: Multimodal Mediated Theory |
|
|
36 | (1) |
|
Unit of Analysis: The Mediated Action |
|
|
36 | (4) |
|
|
|
37 | (1) |
|
Mediational Means/Cultural Tools |
|
|
37 | (1) |
|
|
|
37 | (1) |
|
|
|
37 | (1) |
|
Humans and Animals as Mediational Means |
|
|
38 | (1) |
|
Multiple Mediational Means/Cultural Tools in a Mediated Action |
|
|
39 | (1) |
|
Lower-Level Mediated Action |
|
|
40 | (3) |
|
Lower-Level Mediated Actions: Perception |
|
|
41 | (1) |
|
Lower-Level Mediated Actions: Embodiment |
|
|
42 | (1) |
|
Higher-Level Mediated Action |
|
|
43 | (2) |
|
Higher-Level Mediated Actions: Perception |
|
|
44 | (1) |
|
Higher-Level Mediated Actions: Embodiment |
|
|
45 | (1) |
|
|
|
45 | (2) |
|
Frozen Mediated Actions: Perception |
|
|
46 | (1) |
|
Frozen Mediated Actions: Embodiment |
|
|
46 | (1) |
|
|
|
47 | (1) |
|
|
|
48 | (1) |
|
|
|
48 | (1) |
|
|
|
48 | (3) |
|
Site of Engagement: Perception |
|
|
49 | (1) |
|
Site of Engagement: Embodiment |
|
|
49 | (1) |
|
2.1 Development of Scollon's Philosophical Thought |
|
|
50 | (11) |
|
Scollon Referenced Vygotsky and Nishida |
|
|
51 | (6) |
|
Scollon and Vygotsky: Some Musings |
|
|
51 | (2) |
|
Scollon and Nishida: Some Musings |
|
|
53 | (4) |
|
Scollon's Theory: Some Musings |
|
|
57 | (2) |
|
Scollon's Practice: Some Musings |
|
|
57 | (2) |
|
Philosophical and Theoretical Background: Summary |
|
|
59 | (4) |
|
Philosophical and Theoretical Background - Things to Remember |
|
|
60 | (1) |
| Chapter 3 Systematically Working with Multimodal Data Phase I |
|
61 | (56) |
|
3.0 Phase I: Data Collection |
|
|
63 | (23) |
|
|
|
64 | (1) |
|
|
|
64 | (18) |
|
Step 1: Identifying a Theme or Topic |
|
|
64 | (1) |
|
Step 2: Developing Research Questions |
|
|
65 | (1) |
|
Step 3: Considerations Before Setting Out on Data Collection: What Is Data? |
|
|
66 | (2) |
|
Step 4: Considerations Before Setting Out on Data Collection: What Are Naturally Occurring Data? |
|
|
68 | (1) |
|
Step 5: Considerations Before Setting Out on Data Collection: Ethics |
|
|
69 | (3) |
|
Working with Participants: Consent |
|
|
69 | (2) |
|
Working with Participants: Informing Them About Your Findings |
|
|
71 | (1) |
|
Fair Use or Permissions: YouTube, TV, Movies |
|
|
72 | (1) |
|
Step 6: Video Recording and Camera Placement |
|
|
72 | (7) |
|
Limitations of Video Recording |
|
|
73 | (1) |
|
|
|
73 | (2) |
|
Recording and Camera Placement |
|
|
75 | (1) |
|
|
|
76 | (1) |
|
A Common Reaction to Being Recorded |
|
|
77 | (1) |
|
Using Readily Available Video as Data: YouTube, TV, and Movies |
|
|
77 | (2) |
|
Step 7: Collecting Video Data, Taking Field Notes and Interviewing Participants |
|
|
79 | (1) |
|
Step 8: Producing a Data Collection Table |
|
|
79 | (1) |
|
Step 9: Identifying the Recording Equipment, the Researcher(s), Video Recorded (Inter)Action and Animals Recorded or Not Recorded |
|
|
79 | (2) |
|
Step 10: Collating and Time Stamping |
|
|
81 | (1) |
|
Collating and Synchronizing Videos |
|
|
81 | (1) |
|
Time Stamping Your Video Files |
|
|
82 | (1) |
|
|
|
82 | (3) |
|
Phase I: Data Collection - Things to Remember |
|
|
83 | (2) |
|
|
|
85 | (1) |
|
3.1 Systematically Working with Small Data Sets/Data Pieces: Phase I Data Collection |
|
|
86 | (7) |
|
A Step-by-Step Guide to Analyze a YouTube Video |
|
|
86 | (1) |
|
|
|
86 | (5) |
|
Step 1: Identifying a Theme or Topic |
|
|
87 | (1) |
|
Step 2: Developing Research Questions |
|
|
87 | (1) |
|
Step 3: Considerations Before Setting Out on Data Collection: What Is Data? |
|
|
87 | (1) |
|
Step 4: Considerations Before Setting Out on Data Collection: What Are Naturally Occurring Data? |
|
|
88 | (1) |
|
Step 5: Considerations Before Setting Out on Data Collection: Ethics |
|
|
88 | (1) |
|
Step 6: Video Recording and Camera Placement |
|
|
88 | (1) |
|
Step 7: Collecting Video Data, Taking Field Notes and Interviewing Participants |
|
|
89 | (1) |
|
Step 8: Producing a Data Collection Table |
|
|
90 | (1) |
|
Step 9: Identifying the Researcher in Relation to the YouTube Video |
|
|
91 | (1) |
|
|
|
91 | (2) |
|
3.2 Systematically Working with Medium-Sized Data Sets: Phase I Data Collection |
|
|
93 | (13) |
|
A Step-by-Step Guide to Analyze Experimental Data |
|
|
93 | (1) |
|
|
|
93 | (11) |
|
Step 1: Identifying a Theme or Topic |
|
|
94 | (1) |
|
Step 2: Developing Research Questions |
|
|
95 | (1) |
|
Step 3: Considerations Before Setting Out on Data Collection: What Is Data? |
|
|
95 | (1) |
|
Step 4: Considerations Before Setting Out on Data Collection: What Are Naturally Occurring Data? |
|
|
96 | (1) |
|
Step 5: Considerations Before Setting Out on Data Collection: Ethics |
|
|
96 | (1) |
|
Step 6: Video Recording and Camera Placement |
|
|
97 | (4) |
|
Limitations of Video Recording |
|
|
97 | (1) |
|
|
|
98 | (1) |
|
Camera Angle(s), Number of Cameras, and Camera Placement |
|
|
99 | (2) |
|
The Place of the Researcher |
|
|
101 | (1) |
|
Step 7: Collecting Video Data, Taking Field Notes and Interviewing Participants |
|
|
101 | (1) |
|
Step 8: Producing a Data Collection Table |
|
|
102 | (1) |
|
Step 9: Identifying the Recording Equipment, the Researcher(s), and the Video Recorded (Inter)Action |
|
|
102 | (1) |
|
Step 10: Collating and Time Stamping |
|
|
103 | (1) |
|
|
|
104 | (2) |
|
3.3 Systematically Working with Large Data Sets: Phase I Data Collection |
|
|
106 | (11) |
|
A Step-by-Step Guide to Analyze Video Ethnographic Data |
|
|
106 | (1) |
|
|
|
106 | (9) |
|
Step 1: Identifying a Theme or Topic |
|
|
107 | (1) |
|
Step 2: Developing Research Questions |
|
|
108 | (1) |
|
Step 3: Considerations Before Setting Out on Data Collection: What Is Data? |
|
|
108 | (1) |
|
Step 4: Considerations Before Setting Out on Data Collection: What Are Naturally Occurring Data? |
|
|
109 | (1) |
|
Step 5: Considerations Before Setting Out on Data Collection: Ethics |
|
|
109 | (1) |
|
Step 6: Video Recording and Camera Placement |
|
|
110 | (2) |
|
|
|
110 | (1) |
|
Camera Angle(s), Number of Cameras, and Camera Placement |
|
|
111 | (1) |
|
The Place of the Researcher |
|
|
111 | (1) |
|
Step 7: Collecting Video Data, Taking Field Notes, and Interviewing Participants |
|
|
112 | (1) |
|
Step 8: Producing a Data Collection Table |
|
|
113 | (1) |
|
Step 9: Identifying the Recording Equipment, the Researcher(s), and the Video Recorded (Inter)action |
|
|
113 | (1) |
|
Step 10: Collating and Time Stamping |
|
|
114 | (1) |
|
|
|
115 | (2) |
| Chapter 4 Systematically Working with Multimodal Data Phase II |
|
117 | (42) |
|
4.0 Phase II: Delineating the Data |
|
|
119 | (10) |
|
|
|
119 | (1) |
|
Phase II: Delineating the Data |
|
|
120 | (7) |
|
Step 1: Identifying Your Data Set |
|
|
121 | (2) |
|
Step 2: Understanding the Site of Engagement That Includes the Researcher and the Data Set |
|
|
123 | (1) |
|
Step 3: Identifying a Data Piece |
|
|
124 | (1) |
|
Step 4: Understanding the Site of Engagement That Includes the Researcher and the Data Piece |
|
|
125 | (1) |
|
Step 5: Phrasing a Research Question That Encircles Your Data |
|
|
126 | (1) |
|
|
|
127 | (2) |
|
Phase II: Delineating Your Data - Things to Remember |
|
|
127 | (2) |
|
4.1 Systematically Working with Small Data Sets/Data Pieces: Phase II Delineating the Data |
|
|
129 | (8) |
|
A Step-by-Step Guide to Analyze a YouTube Video |
|
|
129 | (1) |
|
Phase II: Delineating the Data |
|
|
129 | (6) |
|
Step 1: Identifying Your Data Set |
|
|
129 | (2) |
|
Step 2: Understanding the Site of Engagement That Includes the Researcher and the Data Set |
|
|
131 | (1) |
|
Step 3: Identifying a Data Piece |
|
|
132 | (1) |
|
Step 4: Identifying the Site of Engagement That Embraces the Researcher/Viewer in Relation to the Data Piece |
|
|
133 | (1) |
|
Step 5: Phrasing a Research Question That Encircles Your Data |
|
|
134 | (1) |
|
|
|
135 | (2) |
|
4.2 Systematically Working with Medium-Sized Data Sets: Phase II Delineating the Data |
|
|
137 | (11) |
|
A Step-by-Step Guide to Analyze Experimental Data |
|
|
137 | (1) |
|
Phase II: Delineating the Data |
|
|
137 | (9) |
|
Step 1: Identifying Your Data Set |
|
|
138 | (4) |
|
Step 2: Understanding the Site of Engagement That Includes the Researcher and the Data Set |
|
|
142 | (1) |
|
Step 3: Identifying a Data Piece |
|
|
143 | (1) |
|
Step 4: Identifying the Site of Engagement That Embraces the Researcher in Relation to the Data Piece |
|
|
144 | (1) |
|
Step 5: Phrasing a Research Question That Encirlces Your Data |
|
|
145 | (1) |
|
|
|
146 | (2) |
|
4.3 Systematically Working with Large Data Sets: Phase II Delineating the Data |
|
|
148 | (11) |
|
A Step-by-Step Guide to Analyzing Video Ethnographic Data |
|
|
148 | (1) |
|
Phase II: Delineating the Data |
|
|
148 | (9) |
|
Step 1: Identifying Your Data Set |
|
|
149 | (3) |
|
Step 2: Understanding the Site of Engagement That Includes the Researcher and the Data Set |
|
|
152 | (2) |
|
Step 3: Identifying a Data Piece |
|
|
154 | (1) |
|
Step 4: Identifying the Site of Engagement That Embraces You, the Viewer/Researcher and the Data Piece |
|
|
155 | (1) |
|
Step 5: Phrasing a Research Question That Encircles Your Data |
|
|
155 | (2) |
|
|
|
157 | (2) |
| Chapter 5 Systematically Working with Multimodal Data: Phase III |
|
159 | (38) |
|
5.0 Phase III: Selecting Data Pieces for Micro Analysis |
|
|
161 | (9) |
|
|
|
162 | (1) |
|
Phase III: Selecting Data Pieces for Micro Analysis |
|
|
162 | (6) |
|
Step 1: The Mediated Action: Rephrasing Your General Research Question |
|
|
163 | (1) |
|
Step 2: Demarcating Higher-Level Mediated Actions |
|
|
164 | (1) |
|
Step 3: Developing an Overview of Higher-Level Mediated Actions in Your Data Set |
|
|
165 | (2) |
|
Step 4: Narrowing the Site of Engagement |
|
|
167 | (1) |
|
Site of Engagement as Window for Analysis |
|
|
167 | (1) |
|
|
|
168 | (2) |
|
Phase III: Selecting Data Pieces for Micro Analysis - Things to Remember |
|
|
168 | (2) |
|
5.1 Systematically Working with Small Data Sets/Data Pieces: Phase III Selecting Data Pieces for Micro Analysis |
|
|
170 | (8) |
|
A Step-by-Step Guide to Analyze a YouTube Video |
|
|
170 | (1) |
|
Phase III: Selecting Data Pieces for Micro Analysis |
|
|
170 | (7) |
|
Step 1: The Mediated Action: Rephrasing Your Data Driven Research Question |
|
|
171 | (1) |
|
Step 2: Demarcating Higher-Level Mediated Actions |
|
|
172 | (2) |
|
Step 3: Developing an Overview of Higher-Level Mediated Actions in Your Data Set |
|
|
174 | (2) |
|
Step 4: Selecting Data Pieces for Micro Analysis: Narrowing the Site of Engagement |
|
|
176 | (1) |
|
|
|
177 | (1) |
|
5.2 Systematically Working with Medium-Sized Data Sets: Phase III Selecting Data Pieces for Micro Analysis |
|
|
178 | (9) |
|
A Step-by-Step Guide to Analyze Experimental Data |
|
|
178 | (1) |
|
Phase III: Selecting Data Pieces for Micro Analysis |
|
|
178 | (8) |
|
Step 1: The Mediated Action: Rephrasing Your Data Driven Research Question |
|
|
179 | (1) |
|
Step 2: Demarcating Higher-Level Mediated Actions |
|
|
180 | (3) |
|
Step 3: Developing an Overview of Higher-Level Mediated Actions in Your Data Set |
|
|
183 | (2) |
|
Step 4: Selecting Data Pieces for Micro Analysis: Narrowing the Site of Engagement |
|
|
185 | (1) |
|
|
|
186 | (1) |
|
5.3 Systematically Working with Large Data Sets: Phase III Selecting Data Pieces for Micro Analysis |
|
|
187 | (10) |
|
A Step-by-Step Guide to Analyze Video Ethnographic Data |
|
|
187 | (1) |
|
Phase III: Selecting Data Pieces for Micro Analysis |
|
|
187 | (8) |
|
Step 1: The Mediated Action: Rephrasing Your Data Driven Research Question |
|
|
188 | (1) |
|
Step 2: Demarcating Higher-Level Mediated Actions |
|
|
189 | (3) |
|
Step 3: Developing an Overview of Higher-Level Mediated Actions in Your Data Set |
|
|
192 | (2) |
|
Step 4: Selecting Data Pieces for Micro Analysis - Narrowing the Site of Engagement |
|
|
194 | (1) |
|
|
|
195 | (2) |
| Chapter 6 Systematically Working with Multimodal Data Phase IV |
|
197 | (36) |
|
6 Phase IV: Transcribing Data Using Multimodal Transcription Conventions |
|
|
199 | (34) |
|
|
|
200 | (1) |
|
Phase IV: Transcribing Data Using Multimodal Transcription Conventions |
|
|
201 | (29) |
|
Step 1: Identifying a Mode |
|
|
201 | (4) |
|
Step 2: Transcribing Layout |
|
|
205 | (4) |
|
Step 3: Transcribing Proxemics |
|
|
209 | (2) |
|
Step 4: Transcribing Posture |
|
|
211 | (3) |
|
Step 5: Transcribing Gesture |
|
|
214 | (3) |
|
|
|
217 | (2) |
|
Step 7: Transcribing Head Movement |
|
|
219 | (3) |
|
Step 8: Transcribing Facial Expression |
|
|
222 | (2) |
|
Step 9: Transcribing Object Handling |
|
|
224 | (1) |
|
Step 10: Transcribing Language |
|
|
225 | (4) |
|
Step 11: Producing a Final Transcript |
|
|
229 | (1) |
|
|
|
230 | (1) |
|
Phase IV: Transcribing Data Using Multimodal Transcription Conventions - Things to Remember |
|
|
230 | (3) |
| Chapter 7 Systematically Working with Multimodal Data Phase V |
|
233 | (34) |
|
7 Phase V: Using Analytical Tools |
|
|
235 | (32) |
|
Step 1: Selecting Analytical Tools for Micro Analysis |
|
|
236 | (17) |
|
Analytical Tool for Micro Analysis 1: The Lower-Level Mediated Action |
|
|
236 | (2) |
|
Analytical Tool for Micro Analysis 2: The Higher-Level Mediated Action |
|
|
238 | (3) |
|
Analytical Tool for Micro Analysis 3: The Frozen Mediated Action |
|
|
241 | (1) |
|
Analytical Tool for Micro Analysis 4: Modal Density |
|
|
242 | (3) |
|
Analytical Tool for Micro Analysis 5: Modal Configuration |
|
|
245 | (2) |
|
Analytical Tool for Micro Analysis 6: Modal Density Foreground- Background Continuum of Attention/Awareness |
|
|
247 | (3) |
|
Analytical Tool for Micro Analysis 7: Semantic/Pragmatic Means |
|
|
250 | (3) |
|
Step 2: Conducting a Micro Analysis by Utilizing Analytical Tools |
|
|
253 | (4) |
|
Utilizing Analytical Tool for Micro Analysis 1: The Lower-Level Mediated Action |
|
|
253 | (1) |
|
Utilizing Analytical Tool for Micro Analysis 2: The Higher-Level Mediated Action |
|
|
254 | (1) |
|
Utilizing Analytical Tool for Micro Analysis 3: The Frozen Mediated Action |
|
|
254 | (1) |
|
Utilizing Analytical Tool for Micro Analysis 4: Modal Density |
|
|
255 | (1) |
|
Utilizing Analytical Tool for Micro Analysis 5: Modal Configuration |
|
|
255 | (1) |
|
Utilizing Analytical Tool for Micro Analysis 6: Modal Density Foreground-Background Continuum of Attention/Awareness |
|
|
256 | (1) |
|
Utilizing Analytical Tool for Micro Analysis 7: Semantic/Pragmatic Means |
|
|
256 | (1) |
|
Step 3: Selecting Analytical Tools to Put Micro Analyses into a Larger Perspective |
|
|
257 | (6) |
|
Analytical Tool for Intermediate/Macro Analyses 1: Scales of Action |
|
|
257 | (1) |
|
Analytical Tool Set for Intermediate/Macro Analyses 2: Site of Engagement, Practices, and Discourses |
|
|
258 | (2) |
|
Analytical Tool for Intermediate/Macro Analyses 3: Natural Experienced Time Cycles and Rhythms |
|
|
260 | (3) |
|
Step 4: Putting Micro Analyses into a Larger Perspective by Utilizing Analytical Tools or Tool Sets for Intermediate/Macro Analyses |
|
|
263 | (1) |
|
Utilizing Analytical Tool for Intermediate/Macro Analyses 1: Scales of Action |
|
|
263 | (1) |
|
Utilizing Analytical Tool Set for Intermediate/Macro Analyses 2: Site of Engagement, Practices, and Discourses |
|
|
263 | (1) |
|
Utilizing Analytical Tool or Intermediate/Macro Analyses 3: Natural Experienced Time Cycles and Rhythms |
|
|
264 | (1) |
|
|
|
264 | (5) |
|
Phase V: Using Analytical Tools - Things to Remember |
|
|
265 | (2) |
| Chapter 8 Systematically Working with Multimodal Data: Guides for Instructors |
|
267 | (10) |
|
8 A Quick Guide for Instructors |
|
|
269 | (8) |
|
A Quick Guide for Undergraduate-Class Instructors |
|
|
270 | (2) |
|
A Quick Guide for Graduate-Course Instructors |
|
|
272 | (2) |
|
A Quick Guide for PhD Seminar Instructors and Research Team Leaders |
|
|
274 | (3) |
| References |
|
277 | (19) |
| Index |
|
296 | |