List of Figures |
|
xi | |
List of Tables |
|
xiii | |
List of Exhibits |
|
xvii | |
Preface to the Fourth Edition |
|
xix | |
Acknowledgments |
|
xxv | |
List of Acronyms |
|
xxvii | |
Section I: The Context of Health Program Development |
|
1 | (56) |
|
Chapter 1 Context of Health Program Development and Evaluation |
|
|
3 | (26) |
|
|
4 | (4) |
|
|
4 | (1) |
|
Health Programs, Projects, and Services |
|
|
4 | (1) |
|
History of Health Program Planning and Evaluation |
|
|
5 | (3) |
|
Evaluation as a Profession |
|
|
8 | (3) |
|
Who Does Planning and Evaluations? |
|
|
10 | (1) |
|
|
10 | (1) |
|
Planning and Evaluation Cycle |
|
|
11 | (3) |
|
Interdependent and Cyclic Nature of Planning and Evaluation |
|
|
11 | (2) |
|
Using Evaluation Results as the Cyclical Link |
|
|
13 | (1) |
|
|
13 | (1) |
|
The Fuzzy Aspects of Planning |
|
|
14 | (5) |
|
|
14 | (2) |
|
|
16 | (1) |
|
Uncertainty, Ambiguity, Risk, and Control |
|
|
17 | (2) |
|
Introduction to the Types of Evaluation |
|
|
19 | (2) |
|
Mandated and Voluntary Evaluations |
|
|
20 | (1) |
|
|
21 | (1) |
|
The Public Health Pyramid |
|
|
21 | (4) |
|
Use of the Public Health Pyramid in Program Planning and Evaluation |
|
|
23 | (1) |
|
The Public Health Pyramid as an Ecological Model |
|
|
23 | (2) |
|
The Town of Layetteville in Bowe County |
|
|
25 | (1) |
|
|
25 | (2) |
|
|
27 | (1) |
|
|
27 | (1) |
|
|
27 | (2) |
|
Chapter 2 Relevance of Diversity and Disparities to Health Programs |
|
|
29 | (28) |
|
|
30 | (3) |
|
Diversity and Health Disparities |
|
|
32 | (1) |
|
Diversity and Health Programs |
|
|
33 | (1) |
|
|
33 | (5) |
|
|
38 | (5) |
|
Influences of Sociocultural Diversity on Interventions |
|
|
38 | (1) |
|
Influences of Biological Diversity on Interventions |
|
|
39 | (1) |
|
Approaches to Developing Programs |
|
|
39 | (1) |
|
Profession and Provider Diversity |
|
|
40 | (3) |
|
The Three Health Provider Sectors |
|
|
43 | (1) |
|
Diversity Within Healthcare Organizations and Programs |
|
|
43 | (7) |
|
|
44 | (1) |
|
Cultural Competency Continuum |
|
|
44 | (4) |
|
Enhancing Cultural Competency |
|
|
48 | (2) |
|
Stakeholders and Coalitions |
|
|
50 | (1) |
|
|
51 | (2) |
|
|
53 | (1) |
|
|
53 | (1) |
|
|
54 | (3) |
Section II: Defining the Health Problem |
|
57 | (64) |
|
Chapter 3 Community Health Assessment for Program Planning |
|
|
59 | (32) |
|
|
59 | (3) |
|
Community as Context and Intended Recipient |
|
|
60 | (1) |
|
Defining Terms: Based, Focused, and Driven |
|
|
61 | (1) |
|
|
62 | (1) |
|
|
63 | (1) |
|
|
64 | (5) |
|
|
64 | (2) |
|
|
66 | (1) |
|
|
66 | (1) |
|
Communication Action Approach |
|
|
67 | (1) |
|
Comprehensive Rational Approach |
|
|
67 | (1) |
|
Strategic Planning Approach |
|
|
68 | (1) |
|
|
69 | (1) |
|
Models for Planning Public Health Programs |
|
|
69 | (2) |
|
Mobilizing for Action through Planning and Partnership (MAPP) |
|
|
70 | (1) |
|
Community Health Improvement Process (CHIP) |
|
|
70 | (1) |
|
Protocol for Assessing Community Excellence in Environmental Health (PACE-EH) |
|
|
70 | (1) |
|
|
70 | (1) |
|
Perspectives on Assessment |
|
|
71 | (4) |
|
Epidemiological Perspective |
|
|
72 | (2) |
|
Public Health Perspective |
|
|
74 | (1) |
|
|
74 | (1) |
|
|
74 | (1) |
|
|
75 | (1) |
|
|
75 | (2) |
|
Organizational Assessment |
|
|
75 | (1) |
|
|
76 | (1) |
|
|
76 | (1) |
|
Community He8Ith Assessment |
|
|
77 | (1) |
|
|
77 | (1) |
|
Steps in Planning and Conducting the Assessment |
|
|
77 | (6) |
|
Form and Develop the Team |
|
|
78 | (1) |
|
|
79 | (1) |
|
Involve Community Members |
|
|
79 | (1) |
|
|
80 | (1) |
|
Define the Problem to Be Assessed |
|
|
81 | (1) |
|
|
81 | (1) |
|
|
82 | (1) |
|
|
82 | (1) |
|
|
83 | (1) |
|
Anticipate Data-Related and Methodological Issues |
|
|
83 | (2) |
|
|
85 | (1) |
|
|
85 | (1) |
|
|
86 | (1) |
|
|
87 | (4) |
|
Chapter 4 Characterizing and Defining the Health Problem |
|
|
91 | (30) |
|
Collecting Data From Multiple Sources |
|
|
91 | (3) |
|
|
91 | (1) |
|
|
92 | (1) |
|
|
92 | (1) |
|
|
93 | (1) |
|
|
93 | (1) |
|
|
93 | (1) |
|
|
93 | (1) |
|
Collecting Descriptive Data |
|
|
94 | (5) |
|
|
94 | (1) |
|
Dynamics Leading to the Problem |
|
|
94 | (2) |
|
Population Characteristics |
|
|
96 | (1) |
|
|
96 | (1) |
|
Years of Life and Quality of Life |
|
|
96 | (3) |
|
Statistics for Describing Health Problems |
|
|
99 | (3) |
|
|
100 | (1) |
|
Geographic Information Systems: Mapping |
|
|
101 | (1) |
|
Small Numbers and Small Areas |
|
|
101 | (1) |
|
|
102 | (1) |
|
Stating the Health Problem |
|
|
102 | (8) |
|
Diagramming the Health Problem |
|
|
102 | (6) |
|
Writing a Causal Theory of the Health Problem |
|
|
108 | (2) |
|
Prioritizing Health Problems |
|
|
110 | (5) |
|
|
111 | (1) |
|
Basic Priority Rating System |
|
|
111 | (2) |
|
Propriety, Economics, Acceptability, Resources, and Legality (PEARL) Component |
|
|
113 | (1) |
|
Prioritizing Based on Importance and Changeability |
|
|
114 | (1) |
|
|
115 | (2) |
|
Discussion Questions and Activities |
|
|
117 | (1) |
|
|
118 | (1) |
|
|
118 | (3) |
Section III: Health Program Development and Planning |
|
121 | (52) |
|
Chapter 5 Program Theory and Interventions Revealed |
|
|
123 | (24) |
|
|
124 | (2) |
|
|
125 | (1) |
|
|
125 | (1) |
|
|
126 | (8) |
|
Finding and Identifying Interventions |
|
|
126 | (1) |
|
|
127 | (1) |
|
Specifying Intervention Administration and Dosage |
|
|
128 | (2) |
|
Interventions and Program Components |
|
|
130 | (1) |
|
Characteristics of Good Interventions |
|
|
131 | (3) |
|
Path to Program Outcomes and Impacts |
|
|
134 | (4) |
|
Components of the Effect Theory |
|
|
135 | (2) |
|
Matching Levels: Audience, Cause, Intervention, and Effects |
|
|
137 | (1) |
|
Generating the Effect Theory |
|
|
138 | (3) |
|
|
138 | (1) |
|
Draw Upon the Scientific Literature |
|
|
138 | (2) |
|
Diagram the Causal Chain of Events |
|
|
140 | (1) |
|
Check Against Assumptions |
|
|
141 | (1) |
|
Functions of Program Theory |
|
|
141 | (2) |
|
|
141 | (1) |
|
|
142 | (1) |
|
Form a Basis for Communication |
|
|
142 | (1) |
|
Make a Scientific Contribution |
|
|
143 | (1) |
|
|
143 | (1) |
|
Discussion Questions and Activities |
|
|
144 | (1) |
|
|
144 | (1) |
|
|
145 | (2) |
|
Chapter 6 Program Objectives and Setting Targets |
|
|
147 | (26) |
|
Program Goals and Objectives |
|
|
147 | (9) |
|
|
147 | (1) |
|
|
148 | (3) |
|
Objectives and Indicators |
|
|
151 | (3) |
|
Good Goals and Objectives |
|
|
154 | (2) |
|
Using Data to Set Target Values |
|
|
156 | (14) |
|
Decisional Framework for Setting Target Values |
|
|
156 | (3) |
|
Stratification and Object Target Values |
|
|
159 | (1) |
|
Use of Logic Statements to Develop Targets |
|
|
160 | (1) |
|
Options for Calculating Target Values |
|
|
160 | (10) |
|
Caveats to the Goal-Oriented Approach |
|
|
170 | (1) |
|
|
171 | (1) |
|
Discussion Questions and Activities |
|
|
171 | (1) |
|
|
172 | (1) |
|
|
172 | (1) |
Section IV: Implementing and Monitoring the Health Program |
|
173 | (90) |
|
Chapter 7 Process Theory for Program Implementation |
|
|
175 | (26) |
|
Organizational Plan Inputs |
|
|
175 | (7) |
|
|
177 | (2) |
|
|
179 | (1) |
|
|
180 | (1) |
|
|
180 | (1) |
|
|
180 | (1) |
|
|
180 | (2) |
|
|
182 | (1) |
|
Organizational Plan Outputs |
|
|
182 | (3) |
|
|
182 | (1) |
|
|
182 | (2) |
|
|
184 | (1) |
|
|
185 | (1) |
|
Inputs to Service Utilization Plan |
|
|
185 | (6) |
|
|
185 | (1) |
|
|
185 | (4) |
|
|
189 | (1) |
|
|
189 | (2) |
|
Services Utilization Plan Outputs |
|
|
191 | (1) |
|
Summary: Elements of Organizational and Services Utilization Plans |
|
|
192 | (1) |
|
|
192 | (3) |
|
|
193 | (2) |
|
|
195 | (1) |
|
|
195 | (2) |
|
Discussion Questions and Activities |
|
|
197 | (1) |
|
|
197 | (1) |
|
|
198 | (3) |
|
Chapter 8 Monitoring Implementation Through Budgets and Information Systems |
|
|
201 | (18) |
|
|
201 | (3) |
|
|
202 | (2) |
|
Budgeting as Part of Planning |
|
|
204 | (5) |
|
Monetize and Compute Program Costs |
|
|
204 | (1) |
|
Budget for Start-Up and Evaluation Costs |
|
|
205 | (1) |
|
|
205 | (2) |
|
|
207 | (2) |
|
Budget as a Monitoring Tool |
|
|
209 | (4) |
|
|
209 | (1) |
|
|
209 | (4) |
|
|
213 | (3) |
|
Health Informatics Terminology |
|
|
214 | (1) |
|
Information Systems Considerations |
|
|
214 | (2) |
|
|
216 | (1) |
|
Discussion Questions and Activities |
|
|
217 | (1) |
|
|
217 | (1) |
|
|
218 | (1) |
|
Chapter 9 Implementation Evaluation: Measuring Inputs and Outputs |
|
|
219 | (26) |
|
Assessing the Implementation |
|
|
219 | (3) |
|
Implementation Documentation |
|
|
220 | (1) |
|
Implementation Assessment |
|
|
221 | (1) |
|
Implementation Evaluation |
|
|
221 | (1) |
|
Efficacy, Effectiveness, and Efficiency |
|
|
222 | (1) |
|
|
223 | (1) |
|
Quantifying Inputs to the Organizational Plan |
|
|
223 | (7) |
|
|
228 | (1) |
|
|
229 | (1) |
|
Quantifying Outputs of the Organizational Plan |
|
|
230 | (1) |
|
|
230 | (1) |
|
|
230 | (1) |
|
Quantifying Inputs to the Services Utilization Plan |
|
|
230 | (4) |
|
Participants and Recipients |
|
|
230 | (1) |
|
Intervention Delivery and Fidelity |
|
|
231 | (3) |
|
Quantifying Outputs of the Services Utilization Plan |
|
|
234 | (7) |
|
Coverage as Program Reach |
|
|
234 | (4) |
|
Participant-Related Issues |
|
|
238 | (2) |
|
|
240 | (1) |
|
|
241 | (1) |
|
Discussion Questions and Activities |
|
|
242 | (1) |
|
|
243 | (1) |
|
|
243 | (2) |
|
Chapter 10 Program Quality and Fidelity: Managerial and Contextual Considerations |
|
|
245 | (18) |
|
The Accountability Context |
|
|
246 | (1) |
|
|
246 | (1) |
|
Professional Accountability |
|
|
246 | (1) |
|
Performance and Quality: Navigating the Interface |
|
|
247 | (8) |
|
Quality Improvement Approaches |
|
|
248 | (1) |
|
Quality Improvement Tools |
|
|
248 | (3) |
|
Relevance to Health Programs |
|
|
251 | (1) |
|
|
252 | (1) |
|
Informatics and Information Technology |
|
|
253 | (2) |
|
Creating Change for Quality and Fidelity |
|
|
255 | (4) |
|
Interpreting Implementation Data |
|
|
255 | (2) |
|
Maintaining Program Process Quality and Fidelity |
|
|
257 | (1) |
|
Managing Group Processes for Quality and Fidelity |
|
|
258 | (1) |
|
When and What Not to Change |
|
|
259 | (1) |
|
|
259 | (1) |
|
|
259 | (1) |
|
|
260 | (1) |
|
|
260 | (1) |
|
|
261 | (2) |
Section V: Outcome and Impact Evaluation of Health Programs |
|
263 | (118) |
|
Chapter 11 Planning the Intervention Effect Evaluations |
|
|
265 | (22) |
|
Developing the Evaluation Questions |
|
|
266 | (5) |
|
Characteristics of the Right Question |
|
|
267 | (1) |
|
Outcome Documentation, Outcome Assessment, and Outcome Evaluation |
|
|
268 | (1) |
|
|
268 | (2) |
|
|
270 | (1) |
|
Variables from the Program Effect Theory |
|
|
271 | (4) |
|
Outcome and Impact Dependent Variables |
|
|
271 | (2) |
|
Causal Factors as Independent Variables |
|
|
273 | (1) |
|
Antecedent, Moderating, and Mediating Factors as Variables |
|
|
273 | (2) |
|
Measurement Considerations |
|
|
275 | (4) |
|
|
275 | (1) |
|
Types of Variables (Levels of Measurement) |
|
|
275 | (3) |
|
|
278 | (1) |
|
|
278 | (1) |
|
|
279 | (2) |
|
|
279 | (1) |
|
|
280 | (1) |
|
|
281 | (1) |
|
Contextual Considerations in Planning the Evaluation |
|
|
281 | (3) |
|
|
281 | (1) |
|
|
282 | (1) |
|
|
282 | (2) |
|
|
284 | (1) |
|
Discussion Questions and Activities |
|
|
284 | (1) |
|
|
285 | (1) |
|
|
285 | (2) |
|
Chapter 12 Choosing Designs for Effect Evaluations |
|
|
287 | (28) |
|
Evaluation Design Caveats |
|
|
288 | (6) |
|
Considerations in Choosing a Design |
|
|
289 | (5) |
|
Using Designs Derived from Multiple Paradigms: An Example |
|
|
294 | (1) |
|
Choosing the Evaluation Design |
|
|
294 | (15) |
|
Identifying Design Options |
|
|
294 | (1) |
|
Overview of the Decision Tree |
|
|
295 | (3) |
|
Designs for Outcome Documentation |
|
|
298 | (3) |
|
Designs for Outcome Assessment: Establishing Association |
|
|
301 | (6) |
|
Designs for Outcome Evaluation: Establishing Causation |
|
|
307 | (1) |
|
Practical Issues with Experimental Designs |
|
|
307 | (2) |
|
|
309 | (2) |
|
|
311 | (1) |
|
|
312 | (1) |
|
|
312 | (1) |
|
|
312 | (3) |
|
Chapter 13 Sampling Designs and Data Sources for Effect Evaluations |
|
|
315 | (20) |
|
|
315 | (2) |
|
|
317 | (5) |
|
Hard-to-Reach Populations |
|
|
318 | (1) |
|
|
318 | (1) |
|
Calculating Response Rates |
|
|
319 | (3) |
|
Sampling for Effect Evaluations |
|
|
322 | (2) |
|
Sampling for Outcome Assessment |
|
|
322 | (2) |
|
Sampling for Outcome Evaluation |
|
|
324 | (1) |
|
|
324 | (6) |
|
Surveys and Questionnaires |
|
|
325 | (3) |
|
|
328 | (1) |
|
|
329 | (1) |
|
|
330 | (1) |
|
|
330 | (1) |
|
Discussion Questions and Activities |
|
|
330 | (1) |
|
|
331 | (1) |
|
|
331 | (4) |
|
Chapter 14 Quantitative Data Analysis and Interpretation |
|
|
335 | (24) |
|
Data Entry and Management |
|
|
335 | (3) |
|
|
337 | (1) |
|
|
337 | (1) |
|
|
338 | (1) |
|
|
339 | (4) |
|
Change as a Difference Score |
|
|
339 | (1) |
|
Issues with Quantifying Change from the Program |
|
|
339 | (3) |
|
Relationship of Change to Intervention Effort |
|
|
342 | (1) |
|
Clinical and Statistical Significance |
|
|
343 | (1) |
|
Across Levels of Analysis |
|
|
343 | (2) |
|
Statistical Answers to the Questions |
|
|
345 | (8) |
|
|
346 | (2) |
|
|
348 | (1) |
|
|
349 | (1) |
|
|
350 | (3) |
|
|
353 | (3) |
|
Four Fallacies of Interpretation |
|
|
353 | (1) |
|
|
354 | (2) |
|
|
356 | (1) |
|
Discussion Questions and Activities |
|
|
356 | (1) |
|
|
357 | (1) |
|
|
357 | (2) |
|
Chapter 15 Qualitative Methods for Planning and Evaluation |
|
|
359 | (22) |
|
Qualitative Methods Throughout the Planning and Evaluation Cycle |
|
|
359 | (1) |
|
|
360 | (8) |
|
Individual In-Depth Interview |
|
|
361 | (1) |
|
Written Open-Ended Questions |
|
|
362 | (1) |
|
|
363 | (1) |
|
|
364 | (1) |
|
|
364 | (1) |
|
|
365 | (1) |
|
|
366 | (2) |
|
|
368 | (1) |
|
Sampling for Qualitative Methods |
|
|
369 | (3) |
|
Analysis of Qualitative Data |
|
|
372 | (3) |
|
Overview of Analytic Process |
|
|
372 | (2) |
|
|
374 | (1) |
|
|
374 | (1) |
|
|
375 | (1) |
|
|
376 | (1) |
|
Discussion Questions and Activities |
|
|
377 | (1) |
|
|
377 | (1) |
|
|
377 | (4) |
Section VI Additional Considerations for Evaluators |
|
381 | (28) |
|
Chapter 16 Program Evaluators' Responsibilities |
|
|
383 | (26) |
|
|
383 | (6) |
|
|
383 | (2) |
|
Institutional Review Board Approval and Informed Consent |
|
|
385 | (2) |
|
|
387 | (1) |
|
|
388 | (1) |
|
Responsible Spin of Data and Information |
|
|
389 | (3) |
|
Persuasion and Information |
|
|
389 | (2) |
|
Information and Sensemaking |
|
|
391 | (1) |
|
|
392 | (6) |
|
|
392 | (2) |
|
|
394 | (3) |
|
|
397 | (1) |
|
|
398 | (2) |
|
Organization-Evaluator Relationship |
|
|
398 | (1) |
|
|
399 | (1) |
|
Responsible for Evaluation Quality |
|
|
400 | (1) |
|
Responsible for Dissemination |
|
|
401 | (1) |
|
Responsible for Current Practice |
|
|
402 | (2) |
|
|
404 | (1) |
|
Discussion Questions and Activities |
|
|
405 | (1) |
|
|
405 | (1) |
|
|
405 | (4) |
Index |
|
409 | |