Preface |
|
xv | |
About the Author |
|
xix | |
Chapter 1 Conducting Surveys: Everyone Is Doing It |
|
1 | (34) |
|
|
1 | (1) |
|
|
2 | (1) |
|
Example: Surveys to Meet Policy or Program Needs |
|
|
2 | (1) |
|
Example: Surveys in Evaluations of Programs |
|
|
2 | (1) |
|
Example: Surveys for Research |
|
|
3 | (1) |
|
|
3 | (2) |
|
Example: From an Overly Ambitious Self-Administered Questionnaire |
|
|
4 | (1) |
|
Example: Surveys Combined With Other Information Sources |
|
|
5 | (1) |
|
Self-Administered Questionnaires and Interviews: The Heart of the Matter |
|
|
5 | (6) |
|
|
6 | (1) |
|
Example: Forced-Choice Question |
|
|
6 | (1) |
|
Example: Open-Ended Question |
|
|
6 | (1) |
|
|
6 | (1) |
|
Planning for Data Analysis |
|
|
7 | (1) |
|
|
8 | (1) |
|
|
8 | (1) |
|
|
9 | (2) |
|
Example: The Look of Survey Results (1) |
|
|
9 | (1) |
|
Example: The Look of Survey Results (2) |
|
|
9 | (1) |
|
Example: The Look of Survey Results (3) |
|
|
10 | (1) |
|
|
11 | (7) |
|
|
11 | (1) |
|
Usefulness or Credibility of Results |
|
|
11 | (1) |
|
|
11 | (1) |
|
The Special Case of Online Surveys |
|
|
11 | (3) |
|
Checklist for Deciding the Best Uses for Online Surveys |
|
|
12 | (2) |
|
Guidelines for Surveyors Who Work With Commercial Survey Companies |
|
|
14 | (1) |
|
The Special Case of Cell or Mobile Phones |
|
|
14 | (1) |
|
|
15 | (3) |
|
A Survey Continuum: From Specific to General Use |
|
|
18 | (1) |
|
Example: Survey With a Specific Use |
|
|
18 | (1) |
|
Example: Survey With a General Use |
|
|
18 | (1) |
|
Ethics, Privacy, and Confidentiality |
|
|
19 | (7) |
|
|
20 | (1) |
|
Contents of an Informed-Consent Form |
|
|
20 | (1) |
|
The Internet and Ethical Surveys |
|
|
20 | (18) |
|
Example Questionnaire: Maintaining an Ethically Sound Online Survey |
|
|
24 | (1) |
|
Example: Informed-Consent Form for an Online Survey |
|
|
25 | (1) |
|
Children and Survey Ethics |
|
|
26 | (2) |
|
Example: Child Assent Form |
|
|
27 | (1) |
|
|
28 | (1) |
|
Formal Standards for Survey Ethics |
|
|
29 | (1) |
|
|
30 | (1) |
|
|
31 | (3) |
|
|
34 | (1) |
Chapter 2 The Survey Form: Questions, Scales, and Appearance |
|
35 | (32) |
|
|
35 | (1) |
|
The Content Is the Message |
|
|
35 | (1) |
|
|
36 | (1) |
|
Select Your Information Needs or Hypotheses |
|
|
36 | (1) |
|
Make Sure You Can Get the Information |
|
|
37 | (1) |
|
Do Not Ask for Information Unless You Can Act on It |
|
|
37 | (1) |
|
Example: Plan for Survey of Satisfaction With the Youth Center |
|
|
38 | (1) |
|
|
38 | (2) |
|
Open-Ended and Closed Questions |
|
|
38 | (2) |
|
Example: Open-Ended Question |
|
|
38 | (1) |
|
|
38 | (1) |
|
Example: Open-Ended Question for Elementary School Teaching Program |
|
|
39 | (1) |
|
Example: Closed Question for Elementary School Teaching Program |
|
|
40 | (1) |
|
Making the Decision: Open-Ended Versus Closed Questions |
|
|
40 | (1) |
|
Organizing Responses to Open-Ended Survey Items: Do You Get Any Satisfaction? |
|
|
40 | (4) |
|
Step 1: Asking Respondents' Opinions |
|
|
40 | (1) |
|
Step 2: Coding LB/LL Data |
|
|
41 | (1) |
|
Example LB/LL: Response Categories |
|
|
41 | (1) |
|
Example LB/LL: Participant Responses |
|
|
41 | (1) |
|
|
42 | (6) |
|
Example LB/LL: Number of Responses for Each Code |
|
|
42 | (1) |
|
Example LB/LL: Participants' Response Pattern |
|
|
42 | (1) |
|
Example LB/LL: Summary of Responses |
|
|
43 | (1) |
|
Rules for Writing Closed Survey Questions |
|
|
44 | (4) |
|
Example: Item-Writing Skills—Length, Clarity, Abbreviations, and Jargon |
|
|
45 | (1) |
|
Example: Item-Writing Skills—Concrete Questions |
|
|
46 | (1) |
|
Example: Item-Writing Skills—Specificity of Questions |
|
|
46 | (1) |
|
Example: Item-Writing Skills—Hidden Biases |
|
|
47 | (1) |
|
Example: Item-Writing Skills—Hidden Biases |
|
|
47 | (1) |
|
Example: Question-Writing Skills—Very Personal Questions |
|
|
48 | (1) |
|
Example: Question-Writing Skills—One Thought per Question |
|
|
48 | (1) |
|
Responses for Closed Questions |
|
|
48 | (1) |
|
|
48 | (1) |
|
Example: Yes-and-No Responses |
|
|
49 | (1) |
|
|
49 | (5) |
|
Categorical or Continuous? What About Ordinal? |
|
|
49 | (2) |
|
Example: Categorical Rating Scale |
|
|
49 | (1) |
|
Example: Ordinal Rating Scale |
|
|
49 | (2) |
|
|
51 | (2) |
|
|
51 | (1) |
|
Example: Selecting the Number of Categories |
|
|
51 | (2) |
|
Example: Rank Order Scale |
|
|
53 | (1) |
|
Example: Comparative Rating Scale |
|
|
53 | (1) |
|
|
53 | (7) |
|
Example: Checklist Responses in Which Respondent Must Choose One From a List of Several |
|
|
53 | (1) |
|
Example: Checklist Responses That Respondents Answer Yes, No, or Don't Know for Each Item in a List |
|
|
54 | (1) |
|
|
54 | (3) |
|
|
57 | (3) |
|
Example: Survey Progress Bar |
|
|
58 | (1) |
|
Example: Response to One Question Dictates the Response to the Next |
|
|
59 | (1) |
|
Example: Explanation for Changing Online Responses |
|
|
59 | (1) |
|
Plain and Simple Survey Questions and Responses |
|
|
60 | (1) |
|
|
60 | (4) |
|
|
60 | (2) |
|
Example: A Survey With an Additive Scale |
|
|
61 | (1) |
|
Example: A Survey of Foreign Language Skills |
|
|
62 | (1) |
|
|
62 | (1) |
|
Example: Scoring a Differential Scale |
|
|
62 | (1) |
|
|
63 | (8) |
|
Example: Creating a Summated Scale for a Self-Esteem Survey |
|
|
63 | (1) |
|
Example: Scoring a Summated Scale |
|
|
64 | (1) |
|
|
64 | (1) |
|
|
65 | (2) |
Chapter 3 Getting It Together: Some Practical Concerns |
|
67 | (26) |
|
|
67 | (1) |
|
|
68 | (1) |
|
Example: How a Survey's Circumstances Can Influence Its Length |
|
|
68 | (1) |
|
Getting the Survey in Order |
|
|
68 | (3) |
|
Example: An Introduction to a Telephone Survey and Its First Question |
|
|
69 | (1) |
|
Example: Ordering Survey Questions (1) |
|
|
70 | (1) |
|
Example: Ordering Survey Questions (2) |
|
|
70 | (1) |
|
Example: Providing Transitions |
|
|
70 | (1) |
|
Checklist to Guide Question Order |
|
|
71 | (1) |
|
Questionnaire Format: Aesthetics and Other Concerns |
|
|
71 | (1) |
|
|
71 | (1) |
|
Example: Response Formats |
|
|
71 | (1) |
|
Branching Questions, or the Infamous "Skip" Pattern |
|
|
71 | (1) |
|
Example: Skip Patterns or Branching Questions |
|
|
72 | (1) |
|
Administration: Who Gives What to Whom? |
|
|
72 | (4) |
|
Self-Administered Questionnaires |
|
|
72 | (2) |
|
Checklist for Using Self-Administered Questionnaires |
|
|
73 | (1) |
|
|
74 | (2) |
|
Reliability and Validity: The Quality of Your Survey |
|
|
76 | (3) |
|
|
76 | (2) |
|
Example: Internal Consistency Counts |
|
|
77 | (1) |
|
Example: Internal Consistency Does Not Count |
|
|
77 | (1) |
|
|
78 | (1) |
|
Selecting and Adapting Surveys |
|
|
79 | (5) |
|
Example: Excerpt From a Real Online Service Agreement for Free Survey Items (Names Changed) |
|
|
79 | (1) |
|
Guidelines for Finding Useable and Useful Surveys in the Research Literature |
|
|
79 | (16) |
|
Example: Search for School Dropout Surveys: Sample Findings From the Web of Science |
|
|
81 | (1) |
|
Example: Sample Reports of Reliability and Validity in the Research Literature |
|
|
82 | (2) |
|
Finding Surveys on the Web |
|
|
84 | (1) |
|
Example: Search for Education Surveys: A Sample Page From the National Center for Education Statistics |
|
|
85 | (1) |
|
The Survey Is Put on Trial: Guidelines for Pilot Testing |
|
|
85 | (2) |
|
A Far-Reaching World: Surveys, Language, and Culture |
|
|
87 | (2) |
|
Guidelines for Translating Surveys |
|
|
87 | (1) |
|
Example: Question About Ethnicity: U.S. Department of Health and Human Services Office of Minority Health |
|
|
88 | (1) |
|
|
89 | (1) |
|
|
90 | (1) |
|
|
90 | (3) |
Chapter 4 Sampling |
|
93 | (24) |
|
|
93 | (1) |
|
Sample Size and Response Rate: Who and How Many? |
|
|
93 | (2) |
|
Example: Random and Convenience Sampling |
|
|
94 | (1) |
|
|
95 | (1) |
|
Example: Simple Random Sampling (1) |
|
|
95 | (1) |
|
Example: Not Random Sampling |
|
|
96 | (1) |
|
Example: Simple Random Sampling (2) |
|
|
96 | (1) |
|
|
96 | (1) |
|
Stratified Random Sampling |
|
|
96 | (2) |
|
Example: Stratified Random Sampling |
|
|
97 | (1) |
|
|
97 | (1) |
|
Simple Random Cluster Sampling |
|
|
98 | (1) |
|
Example: Simple Random Cluster Sampling |
|
|
98 | (1) |
|
|
98 | (1) |
|
|
99 | (1) |
|
|
99 | (1) |
|
|
99 | (1) |
|
|
100 | (1) |
|
Other Convenience Sampling Methods |
|
|
100 | (2) |
|
Example: Other Convenience Samples |
|
|
100 | (2) |
|
Finding the Sample: Who Is In? Who Is Out? |
|
|
102 | (1) |
|
How Large Should Your Sample Be? |
|
|
102 | (1) |
|
|
103 | (1) |
|
Statistical Methods: Sampling for Two Groups and an Intervention |
|
|
103 | (7) |
|
Example: Sample Size Calculations for Sampling Two Groups and an Intervention |
|
|
104 | (1) |
|
Subgroups, Measures, Resources, and Schedule |
|
|
105 | (1) |
|
Five Questions to Ask When Determining Sample Size |
|
|
106 | (4) |
|
Example: Calculating Sample Size in a Survey of Employees in an Experimental and Control Group |
|
|
107 | (1) |
|
Example: Power to Detect Differences |
|
|
108 | (1) |
|
Example: 80% Power and Effect |
|
|
108 | (1) |
|
Example: Sample Size, Effect, and Power |
|
|
109 | (1) |
|
|
110 | (1) |
|
Tips for Improving Response Rate |
|
|
110 | (1) |
|
|
110 | (2) |
|
Example: Calculating Poststratification Weights |
|
|
111 | (1) |
|
Margin of Error and Confidence Level |
|
|
112 | (1) |
|
Sample Size and the Margin of Error |
|
|
113 | (1) |
|
|
113 | (1) |
|
|
114 | (1) |
|
|
115 | (2) |
Chapter 5 Survey Design: Environmental Control |
|
117 | (18) |
|
|
117 | (1) |
|
Which Designs Are Available? |
|
|
118 | (1) |
|
Example: Surveys With Differing Designs |
|
|
118 | (1) |
|
Cross-Sectional Survey Designs |
|
|
119 | (2) |
|
Example: Cross-Sectional Design |
|
|
119 | (2) |
|
|
121 | (1) |
|
|
121 | (1) |
|
Example: Longitudinal Surveys: Cohort Design |
|
|
121 | (1) |
|
|
121 | (1) |
|
Experimental Survey Designs |
|
|
121 | (4) |
|
Example: A Nonrandomized Controlled Trial or Quasi-Experimental Design |
|
|
122 | (1) |
|
Example: A Nonrandomized Controlled Trial With a Longitudinal Design |
|
|
122 | (1) |
|
Example: A Randomized Controlled Trial or True Experiment |
|
|
123 | (1) |
|
Example: A Randomized Controlled Trial With a Longitudinal Design |
|
|
123 | (1) |
|
Factorial Designs: Special Cases |
|
|
124 | (1) |
|
|
124 | (1) |
|
Other Survey Designs: Normative and Case Control |
|
|
125 | (1) |
|
|
125 | (1) |
|
Example: Normative Design |
|
|
125 | (1) |
|
Example: Normative Design—Comparison to a Model |
|
|
125 | (1) |
|
|
125 | (1) |
|
|
126 | (1) |
|
|
126 | (1) |
|
Example: Case Control Design |
|
|
126 | (1) |
|
|
126 | (3) |
|
|
127 | (1) |
|
|
128 | (1) |
|
Surveys, Research Design, and Internal and External Validity |
|
|
129 | (1) |
|
Example: Cross-Sectional Survey and Threats to Validity |
|
|
129 | (1) |
|
Example: Longitudinal Design and Threats to Validity |
|
|
129 | (1) |
|
Example: Randomized Controlled Trials and Validity |
|
|
130 | (1) |
|
Surveys With Qualitative Data: Threats to Internal and External Validity |
|
|
130 | (2) |
|
Example: Qualitative Studies and Validity |
|
|
131 | (1) |
|
|
132 | (1) |
|
|
133 | (1) |
|
|
134 | (1) |
Chapter 6 Analyzing and Organizing Data From Surveys |
|
135 | (32) |
|
|
135 | (1) |
|
What Is Typical Anyway? Some Commonly Used Methods for Analyzing Survey Data |
|
|
136 | (13) |
|
|
137 | (1) |
|
Example: Preschool Purposes Questionnaire |
|
|
137 | (1) |
|
Example: Frequency of Questionnaire Responses |
|
|
137 | (1) |
|
Example: Grouped Ratings of Preschool Purposes by 50 Directors |
|
|
138 | (1) |
|
Averages: Means, Medians, and Modes |
|
|
138 | (3) |
|
Example: Computing the Median for an Even Number of Scores |
|
|
139 | (1) |
|
Example: Computing the Median for an Odd Number of Scores |
|
|
139 | (2) |
|
Variation: Range, Variance, and Standard Deviation |
|
|
141 | (1) |
|
Correlation and Regression |
|
|
142 | (1) |
|
Example: Rank Order Correlation |
|
|
142 | (1) |
|
Differences Between Groups |
|
|
143 | (2) |
|
|
145 | (1) |
|
|
146 | (3) |
|
Surveying Differences: Usual Methods |
|
|
149 | (3) |
|
|
149 | (1) |
|
|
149 | (1) |
|
|
149 | (1) |
|
|
149 | (1) |
|
|
150 | (1) |
|
Example: Mann-Whitney U Test |
|
|
150 | (1) |
|
|
150 | (1) |
|
|
150 | (3) |
|
Example: Odds Ratio and Relative Risk |
|
|
150 | (2) |
|
To Be or Not to Be: Statistician or Qualitative Analyst? |
|
|
152 | (1) |
|
Content Analysis, Open-Ended Responses, and Comments |
|
|
152 | (1) |
|
Example: Hypothetical Content Analysis: Teasing Boys and Girls |
|
|
152 | (1) |
|
Putting the Cart in Front of the Horse: Selecting Analysis Methods |
|
|
153 | (4) |
|
Seven Questions to Answer Before Choosing an Analysis Method |
|
|
153 | (4) |
|
|
157 | (7) |
|
Creating a Code Book or Operations Manual |
|
|
157 | (2) |
|
Example: Excerpt From the CARPS, a Survey to Detect Binge Drinking in College Students |
|
|
157 | (1) |
|
Example: Excerpt From the Code Book for the CARPS, a Survey to Detect Binge Drinking |
|
|
158 | (1) |
|
Establishing Reliable Coding |
|
|
159 | (1) |
|
Measuring Agreement: The Kappa |
|
|
159 | (1) |
|
Measuring Agreement Between Two Coders: The Kappa (K) Statistic |
|
|
160 | (1) |
|
Reviewing Surveys for Missing Data |
|
|
161 | (1) |
|
|
162 | (1) |
|
Example: Survey Responses From Six People |
|
|
162 | (1) |
|
|
163 | (1) |
|
|
164 | (1) |
|
|
164 | (1) |
|
|
165 | (2) |
Chapter 7 Presenting the Survey Results |
|
167 | (26) |
|
|
167 | (1) |
|
Reproducing the Questionnaire |
|
|
167 | (2) |
|
Example: Reporting Results With the Questionnaire |
|
|
168 | (1) |
|
Example: Online Survey Statistics in Real Time |
|
|
169 | (1) |
|
|
169 | (3) |
|
Example: Shell Table Describing Children in Two Schools |
|
|
170 | (1) |
|
Example: Shell Table for Comparing Children in Two Schools |
|
|
170 | (1) |
|
Some Table Preparation Rules |
|
|
171 | (1) |
|
|
172 | (1) |
|
|
172 | (2) |
|
|
174 | (4) |
|
Example: Downloaded Results of a Customer Satisfaction Survey |
|
|
176 | (1) |
|
Example: Transferring the Results of One Question Into Bar and Line Graphs |
|
|
177 | (1) |
|
Drawing Diagrams or Pictures |
|
|
178 | (1) |
|
Example: Words and Diagrams in Survey Reports |
|
|
178 | (1) |
|
Writing the Results of a Survey |
|
|
179 | (3) |
|
|
180 | (2) |
|
Example: Structured Abstract of a Survey Report |
|
|
180 | (2) |
|
Survey Reporting Checklists and Guides |
|
|
182 | (2) |
|
|
183 | (1) |
|
|
184 | (1) |
|
|
184 | (3) |
|
Oral Versus Written Reports: A Difference in Conversation |
|
|
187 | (4) |
|
Example: Table Used in a Written and an Oral Report |
|
|
187 | (3) |
|
|
190 | (1) |
|
|
191 | (1) |
|
|
191 | (1) |
|
|
192 | (1) |
Index |
|
193 | |