Preface |
|
xi | |
Acknowledgements |
|
xiii | |
Authors |
|
xv | |
Part I Introduction |
|
|
1 Foreword to Mixed-Mode Official Surveys: Design and Analysis |
|
|
3 | (6) |
|
1.1 Why a Book on Mixed-Mode Survey Design and Analysis? |
|
|
3 | (1) |
|
|
4 | (2) |
|
|
6 | (3) |
|
2 Designing Mixed-Mode Surveys |
|
|
9 | (24) |
|
|
9 | (1) |
|
2.2 Why Mixed-Mode Survey Designs? |
|
|
9 | (4) |
|
2.3 How Can Modes Be Combined? |
|
|
13 | (3) |
|
2.4 How Do Modes Affect Quality? |
|
|
16 | (6) |
|
2.5 How to Reduce Mode Impact on Quality? |
|
|
22 | (4) |
|
|
26 | (4) |
|
2.6.1 Dutch Crime Victimization Survey |
|
|
27 | (1) |
|
2.6.2 Dutch Labour Force Survey |
|
|
28 | (1) |
|
2.6.3 European Health Interview Survey |
|
|
29 | (1) |
|
|
30 | (3) |
Part II Mode Effects |
|
|
3 Mode-Specific Measurement Effects |
|
|
33 | (24) |
|
|
33 | (2) |
|
3.2 Measurement Features of Modes |
|
|
35 | (7) |
|
3.3 Mode-Specific Answering Behaviors and Response Styles |
|
|
42 | (7) |
|
3.4 Detection of Mode-Specific Measurement Effects |
|
|
49 | (6) |
|
|
55 | (2) |
|
4 Mode-Specific Selection Effects |
|
|
57 | (26) |
|
|
57 | (1) |
|
4.2 Coverage Issues in CAPI, CATI, Mail, and Web Surveys |
|
|
58 | (10) |
|
|
58 | (1) |
|
|
59 | (4) |
|
|
63 | (1) |
|
|
63 | (5) |
|
4.3 Response and Subgroup Response Rates in Mixed-Mode Designs |
|
|
68 | (11) |
|
4.3.1 Mixed-Mode Designs at Statistics Netherlands |
|
|
70 | (9) |
|
|
79 | (1) |
|
|
79 | (4) |
Part III Design |
|
|
5 Mixed-Mode Data Collection Design |
|
|
83 | (40) |
|
|
83 | (2) |
|
5.2 Mode and Mode Combinations |
|
|
85 | (5) |
|
5.3 Concurrent and Sequential Designs |
|
|
90 | (4) |
|
5.3.1 Concurrent or Sequential Order? |
|
|
90 | (3) |
|
5.3.2 Sequential, but Which Sequence? |
|
|
93 | (1) |
|
|
94 | (1) |
|
5.5 Sample Composition and Data Quality |
|
|
95 | (2) |
|
5.6 Communication Strategies to Increase Web Response |
|
|
97 | (23) |
|
5.6.1 Contacting the Sample Person or Household |
|
|
99 | (1) |
|
|
100 | (1) |
|
5.6.3 Invitation Letters, Flyers, and Envelopes: Statistics Netherlands' Experiments |
|
|
101 | (9) |
|
5.6.3.1 Experimental Manipulations |
|
|
102 | (4) |
|
|
106 | (4) |
|
5.6.4 Incentives in Web and Mixed-Mode Surveys |
|
|
110 | (13) |
|
5.6.4.1 Effect on Sample Composition and Data Quality |
|
|
112 | (1) |
|
5.6.4.2 Incentives in European NSIs |
|
|
113 | (1) |
|
5.6.4.3 Incentive Experiments by Statistics Netherlands |
|
|
114 | (4) |
|
5.6.4.4 An Incentive Experiment in the Longitudinal Labor Force Survey |
|
|
118 | (2) |
|
|
120 | (1) |
|
|
121 | (2) |
|
6 Mixed-Mode Questionnaire Design |
|
|
123 | (26) |
|
|
123 | (1) |
|
6.2 General Goals and Challenges in Questionnaire Design |
|
|
123 | (4) |
|
6.2.1 Why Questionnaire Matters |
|
|
123 | (1) |
|
6.2.2 Striking a Balance between Conflicting Goals and Stakeholders |
|
|
124 | (2) |
|
Clients (Partly Overlap with Data Users) |
|
|
125 | (1) |
|
|
125 | (1) |
|
|
125 | (1) |
|
|
125 | (1) |
|
Data Users (Partly Overlap with Clients) |
|
|
125 | (1) |
|
|
126 | (1) |
|
|
126 | (1) |
|
6.2.3 Questionnaire Design as an Iterative Process |
|
|
126 | (1) |
|
6.3 Questionnaire Design and Mode-Specific Measurement Errors |
|
|
127 | (6) |
|
6.3.1 The Cognitive Response Process Model |
|
|
127 | (1) |
|
6.3.2 Main Sources of Mode-Specific Measurement Error |
|
|
128 | (1) |
|
6.3.3 Even Small Design Differences May Matter |
|
|
129 | (1) |
|
6.3.4 Device-Specific Measurement Errors |
|
|
130 | (3) |
|
6.4 Questionnaire Design for Mixed-Mode Surveys |
|
|
133 | (5) |
|
6.4.1 Minimizing Differences or Minimizing Error? |
|
|
133 | (1) |
|
6.4.2 Mixed-Mode Requirements in the Questionnaire Design Process |
|
|
134 | (2) |
|
6.4.3 Mixed-Device Questionnaire Design |
|
|
136 | (2) |
|
6.5 Testing and Evaluating Mixed-Mode Questionnaires |
|
|
138 | (5) |
|
6.5.1 Testing and Evaluation as Part of the Questionnaire Design Process |
|
|
138 | (3) |
|
6.5.2 Mixed-Mode Questionnaire Testing and Evaluation |
|
|
141 | (2) |
|
Step 1 Make an Explicit Mode Risk Assessment |
|
|
141 | (1) |
|
Step 2 Decide if the Test Should Compare Modes |
|
|
141 | (1) |
|
Step 3 Decide Which Modes to Test, and When in the Development Process |
|
|
142 | (1) |
|
Step 4 Test Relevant Modes as Realistically as Practically Possible |
|
|
142 | (1) |
|
Step 5 In Analyses and Reporting, Distinguish between Usability and Content Findings, and Reflect on Mode and Device Specificity Regarding Findings |
|
|
143 | (1) |
|
6.6 Guidelines for Mixed-Mode Questionnaire Design |
|
|
143 | (3) |
|
6.6.1 Keep the Stimulus and Response Task as Similar as Possible in All Modes |
|
|
143 | (1) |
|
6.6.2 Organize the Questionnaire Design Process to Prevent and Detect Mode-Specific Measurement Errors |
|
|
144 | (1) |
|
6.6.3 Prevent Social Desirability Bias |
|
|
145 | (1) |
|
6.6.4 Prevent Satisficing |
|
|
145 | (1) |
|
|
146 | (3) |
Part IV Analysis |
|
|
7 Field Tests and Implementation of Mixed-Mode Surveys |
|
|
149 | (26) |
|
|
149 | (3) |
|
7.2 Design of Field Experiments |
|
|
152 | (2) |
|
7.3 Design-Based Inference for Field Experiments |
|
|
154 | (7) |
|
7.3.1 Measurement Error Model and Hypotheses Testing |
|
|
154 | (2) |
|
7.3.2 Parameter and Variance Estimation |
|
|
156 | (2) |
|
7.3.3 Wald Test and Related Tests |
|
|
158 | (1) |
|
|
159 | (1) |
|
|
160 | (1) |
|
|
161 | (3) |
|
7.5 Small Area Estimation Methods |
|
|
164 | (2) |
|
7.6 The Introduction of a Hybrid Mixed-Mode Design in the Dutch Crime Victimization Survey |
|
|
166 | (6) |
|
|
166 | (2) |
|
|
168 | (4) |
|
|
172 | (2) |
|
|
174 | (1) |
|
8 Re-interview Designs to Disentangle and Adjust for Mode Effects |
|
|
175 | (26) |
|
|
175 | (2) |
|
8.2 Decomposition of Relative Mode Effects |
|
|
177 | (2) |
|
8.3 Estimating Components of the Relative Mode Effects |
|
|
179 | (5) |
|
8.3.1 Experimental Design |
|
|
179 | (2) |
|
8.3.2 Estimation Strategies |
|
|
181 | (2) |
|
|
183 | (1) |
|
|
184 | (6) |
|
8.5 Adjusting Measurement Bias Using Re-interview Designs |
|
|
190 | (5) |
|
|
195 | (2) |
|
8.7 Extension of Re-interview Design to Multiple Modes |
|
|
197 | (1) |
|
|
198 | (1) |
|
|
199 | (2) |
|
9 Mixed-Mode Data Analysis |
|
|
201 | (22) |
|
|
201 | (1) |
|
9.2 Analyzing Mixed-Mode Survey Response Data |
|
|
202 | (3) |
|
|
202 | (2) |
|
9.2.2 Problem Statement, Definitions, and Notation |
|
|
204 | (1) |
|
9.3 Correcting Differential Measurement Bias |
|
|
205 | (3) |
|
|
205 | (2) |
|
9.3.2 Mode-Specific Estimators |
|
|
207 | (1) |
|
9.4 Balancing Differential Measurement Bias |
|
|
208 | (4) |
|
|
208 | (3) |
|
9.4.2 Choosing Calibration Levels |
|
|
211 | (1) |
|
9.5 Handling Measurement Bias in Practice |
|
|
212 | (2) |
|
9.5.1 Testing Assumptions |
|
|
212 | (1) |
|
9.5.2 Calibration Levels and Mixing Coefficients |
|
|
212 | (2) |
|
9.5.3 Comparison with Single-Mode Designs |
|
|
214 | (1) |
|
|
214 | (5) |
|
|
214 | (1) |
|
9.6.2 Crime Victimization Survey |
|
|
215 | (3) |
|
|
218 | (1) |
|
|
219 | (4) |
Part V The Future of Mixed-Mode Surveys |
|
|
|
223 | (28) |
|
|
223 | (2) |
|
|
225 | (8) |
|
10.2.1 A Taxonomy of Smart Surveys |
|
|
225 | (3) |
|
|
228 | (3) |
|
10.2.3 Other Types of External Data |
|
|
231 | (2) |
|
|
233 | (4) |
|
10.3.1 Representation and Measurement of Smart Surveys |
|
|
233 | (2) |
|
10.3.2 Criteria to Include New Types of Data |
|
|
235 | (2) |
|
10.4 Methodology for Hybrid Data Collection |
|
|
237 | (6) |
|
10.4.1 Active Versus Passive Data Collection |
|
|
237 | (1) |
|
10.4.2 Data Collection Strategies |
|
|
238 | (2) |
|
10.4.3 Measurement Strategies |
|
|
240 | (1) |
|
10.4.4 Estimation Strategies |
|
|
241 | (1) |
|
10.4.5 Logistics and Operations |
|
|
241 | (2) |
|
|
243 | (5) |
|
10.5.1 Smart Survey Criteria |
|
|
243 | (3) |
|
10.5.2 A Case Study Elaborated: Physical Activity |
|
|
246 | (2) |
|
|
248 | (1) |
|
|
249 | (2) |
|
11 Adaptive Mixed-Mode Survey Designs |
|
|
251 | (22) |
|
|
251 | (2) |
|
11.2 Elements of Adaptive Multi-Mode Survey Designs |
|
|
253 | (13) |
|
11.2.1 Survey Mode as a Design Feature |
|
|
254 | (2) |
|
|
256 | (5) |
|
11.2.3 Quality and Cost Objectives in Multi-Mode Surveys |
|
|
261 | (4) |
|
11.2.4 Optimization Strategies |
|
|
265 | (1) |
|
|
266 | (6) |
|
|
267 | (2) |
|
|
269 | (3) |
|
|
272 | (1) |
|
12 The Future of Mixed-Mode Surveys |
|
|
273 | (8) |
|
|
273 | (1) |
|
12.2 What Are the Current Developments? |
|
|
273 | (2) |
|
12.3 What Are the Open Areas in the Methodology of Mixed-Mode Surveys |
|
|
275 | (2) |
|
12.4 Open Areas in Logistics and Implementation of Mixed-Mode Surveys |
|
|
277 | (1) |
|
12.5 Will There Be Mixed-Mode Surveys in the Future? |
|
|
278 | (3) |
References |
|
281 | (20) |
Index |
|
301 | |