|
|
xix | |
|
|
xxi | |
|
|
xxv | |
Preface to the Third Edition |
|
xxvii | |
Acknowledgments |
|
xxxv | |
|
|
xxxvii | |
|
SECTION I The Context of Health Program Development and Evaluation |
|
|
1 | (76) |
|
1 Context of Health Program Development and Evaluation |
|
|
3 | (34) |
|
|
4 | (5) |
|
|
4 | (1) |
|
History of Health Program Planning |
|
|
5 | (4) |
|
Evaluation as a Profession |
|
|
9 | (4) |
|
Who Does Planning and Evaluations? |
|
|
11 | (2) |
|
|
13 | (1) |
|
Planning and Evaluation Cycle |
|
|
13 | (6) |
|
Interdependent and Cyclic Nature of Planning and Evaluation |
|
|
13 | (4) |
|
|
17 | (2) |
|
|
19 | (5) |
|
Mandated and Voluntary Evaluations |
|
|
22 | (1) |
|
|
23 | (1) |
|
The Public Health Pyramid |
|
|
24 | (6) |
|
Use of the Public Health Pyramid in Program Planning and Evaluation |
|
|
26 | (1) |
|
The Public Health Pyramid as an Ecological Model |
|
|
27 | (2) |
|
Health Programs, Projects, and Services |
|
|
29 | (1) |
|
Layetteville and Bowe County |
|
|
30 | (1) |
|
|
30 | (2) |
|
|
32 | (1) |
|
|
32 | (1) |
|
|
33 | (4) |
|
2 Relevance of Diversity and Disparities to Health Programs |
|
|
37 | (40) |
|
|
39 | (3) |
|
Diversity and Health Disparities |
|
|
40 | (2) |
|
Diversity and Health Programs |
|
|
42 | (1) |
|
|
42 | (6) |
|
|
48 | (7) |
|
Influences of Sociocultural Diversity on Interventions |
|
|
48 | (2) |
|
Influences of Biological Diversity on Interventions |
|
|
50 | (1) |
|
Approaches to Developing Programs |
|
|
51 | (1) |
|
Profession and Provider Diversity |
|
|
52 | (1) |
|
The Three Health Provider Sectors |
|
|
52 | (3) |
|
Diversity within Healthcare Organizations and Programs |
|
|
55 | (10) |
|
|
56 | (1) |
|
Cultural Competency Continuum |
|
|
57 | (5) |
|
Enhancing Cultural Competency |
|
|
62 | (3) |
|
Stakeholders and Coalitions |
|
|
65 | (2) |
|
|
67 | (3) |
|
|
70 | (1) |
|
|
70 | (1) |
|
|
71 | (6) |
|
SECTION II Defining the Health Problem |
|
|
77 | (102) |
|
3 Planning for Health Programs and Services |
|
|
79 | (34) |
|
|
80 | (1) |
|
Historical Background on Planning in Public Health |
|
|
80 | (5) |
|
|
82 | (1) |
|
|
82 | (1) |
|
|
83 | (1) |
|
|
83 | (1) |
|
|
84 | (1) |
|
|
84 | (1) |
|
Triggering the Planning Cycle |
|
|
85 | (2) |
|
The Fuzzy Aspects of Planning |
|
|
87 | (7) |
|
|
87 | (2) |
|
|
89 | (2) |
|
Uncertainty, Ambiguity, Risk, and Control |
|
|
91 | (1) |
|
|
92 | (2) |
|
|
94 | (8) |
|
|
96 | (1) |
|
|
96 | (1) |
|
|
97 | (1) |
|
Communication Action Approach |
|
|
98 | (1) |
|
Comprehensive Rational Approach |
|
|
99 | (1) |
|
Strategic Planning Approach |
|
|
100 | (1) |
|
|
101 | (1) |
|
Planning Steps and Stages |
|
|
102 | (5) |
|
Team Formation and Development |
|
|
102 | (2) |
|
|
104 | (1) |
|
|
104 | (2) |
|
|
106 | (1) |
|
|
106 | (1) |
|
Implementation and Continuation |
|
|
107 | (1) |
|
|
107 | (1) |
|
|
108 | (1) |
|
|
109 | (1) |
|
|
110 | (3) |
|
4 Community Health Assessment for Program Planning |
|
|
113 | (28) |
|
|
113 | (5) |
|
Community as Context and Target |
|
|
115 | (1) |
|
Defining Terms: Based, Focused, and Driven |
|
|
116 | (2) |
|
|
118 | (2) |
|
Perspectives on Assessment |
|
|
120 | (6) |
|
Epidemiological Perspective |
|
|
120 | (3) |
|
Public Health Perspective |
|
|
123 | (1) |
|
|
123 | (1) |
|
|
124 | (1) |
|
|
125 | (1) |
|
|
126 | (3) |
|
Organizational Assessment |
|
|
126 | (1) |
|
|
127 | (1) |
|
|
127 | (1) |
|
Community Health Assessment |
|
|
128 | (1) |
|
|
129 | (1) |
|
Steps in Conducting the Assessment |
|
|
129 | (4) |
|
Involve Community Members |
|
|
130 | (1) |
|
|
131 | (1) |
|
Define the Problem to Be Assessed |
|
|
132 | (1) |
|
Anticipate Data-Related and Methodological Issues |
|
|
133 | (2) |
|
|
135 | (1) |
|
|
136 | (1) |
|
|
137 | (1) |
|
|
138 | (3) |
|
5 Characterizing and Defining the Health Problem |
|
|
141 | (38) |
|
Collecting Data from Multiple Sources |
|
|
141 | (3) |
|
|
141 | (1) |
|
|
142 | (1) |
|
|
142 | (1) |
|
|
143 | (1) |
|
|
143 | (1) |
|
|
143 | (1) |
|
|
144 | (1) |
|
Collecting Descriptive Data |
|
|
144 | (7) |
|
|
144 | (1) |
|
Dynamics Leading to the Problem |
|
|
145 | (1) |
|
Population Characteristics |
|
|
146 | (1) |
|
|
146 | (2) |
|
Years of Life and Quality of Life |
|
|
148 | (3) |
|
Statistics for Describing Health Problems |
|
|
151 | (4) |
|
|
151 | (3) |
|
Geographic Information Systems: Mapping |
|
|
154 | (1) |
|
Small Numbers and Small Areas |
|
|
154 | (1) |
|
Stating the Health Problem |
|
|
155 | (9) |
|
Diagramming the Health Problem |
|
|
156 | (6) |
|
Writing a Causal Theory of the Health Problem |
|
|
162 | (2) |
|
Prioritizing Health Problems |
|
|
164 | (7) |
|
|
165 | (1) |
|
Basic Priority Rating System |
|
|
166 | (3) |
|
Propriety, Economics, Acceptability, Resources, and Legality (PEARL) Component |
|
|
169 | (1) |
|
Prioritizing Based on Importance and Changeability |
|
|
170 | (1) |
|
|
171 | (3) |
|
Discussion Questions and Activities |
|
|
174 | (1) |
|
|
174 | (1) |
|
|
175 | (4) |
|
SECTION III Health Program Development |
|
|
179 | (70) |
|
6 Program Theory and Interventions Revealed |
|
|
181 | (34) |
|
|
182 | (3) |
|
|
183 | (1) |
|
|
184 | (1) |
|
|
185 | (12) |
|
Finding and Identifying Interventions |
|
|
186 | (1) |
|
|
187 | (1) |
|
Specifying Intervention Administration and Dosage |
|
|
188 | (3) |
|
Interventions and Program Components |
|
|
191 | (1) |
|
Characteristics of Good Interventions |
|
|
192 | (5) |
|
Path to Program Outcomes and Impacts |
|
|
197 | (4) |
|
Elements of the Effect Theory |
|
|
198 | (3) |
|
Generating the Effect Theory |
|
|
201 | (5) |
|
|
201 | (2) |
|
Draw Upon the Scientific Literature |
|
|
203 | (2) |
|
Diagram the Causal Chain of Events |
|
|
205 | (1) |
|
Check Against Assumptions |
|
|
205 | (1) |
|
Functions of Program Theory |
|
|
206 | (3) |
|
|
206 | (1) |
|
|
207 | (1) |
|
Form a Basis for Communication |
|
|
208 | (1) |
|
Make a Scientific Contribution |
|
|
209 | (1) |
|
|
209 | (1) |
|
Discussion Questions and Activities |
|
|
210 | (1) |
|
|
211 | (1) |
|
|
212 | (3) |
|
7 Program Objectives and Setting Targets |
|
|
215 | (34) |
|
Program Goals and Objectives |
|
|
215 | (11) |
|
|
216 | (1) |
|
|
216 | (5) |
|
Objectives and Indicators |
|
|
221 | (2) |
|
Good Goals and Objectives |
|
|
223 | (3) |
|
Using Data to Set Target Values |
|
|
226 | (19) |
|
Decisional Framework for Setting Target Values |
|
|
227 | (4) |
|
Stratification and Object Target Values |
|
|
231 | (1) |
|
Use of Logic Statements to Develop Targets |
|
|
232 | (1) |
|
Options for Calculating Target Values |
|
|
233 | (12) |
|
Caveats to the Goal-Oriented Approach |
|
|
245 | (1) |
|
|
246 | (1) |
|
Discussion Questions and Activities |
|
|
247 | (1) |
|
|
247 | (1) |
|
|
248 | (1) |
|
SECTION IV Implementing and Monitoring the Health Program |
|
|
249 | (114) |
|
|
251 | (32) |
|
Organizational Plan Inputs |
|
|
253 | (8) |
|
|
253 | (4) |
|
|
257 | (1) |
|
|
258 | (1) |
|
|
258 | (1) |
|
|
258 | (1) |
|
|
259 | (1) |
|
|
260 | (1) |
|
Organizational Plan Outputs |
|
|
261 | (2) |
|
|
261 | (1) |
|
|
261 | (2) |
|
|
263 | (1) |
|
|
263 | (1) |
|
Inputs to Service Utilization Plan |
|
|
263 | (9) |
|
|
263 | (1) |
|
|
264 | (5) |
|
|
269 | (1) |
|
|
270 | (2) |
|
Services Utilization Plan Outputs |
|
|
272 | (2) |
|
Summary: Elements of Organizational and Services Utilization Plans |
|
|
273 | (1) |
|
|
274 | (4) |
|
|
275 | (1) |
|
|
276 | (2) |
|
|
278 | (1) |
|
Discussion Questions and Activities |
|
|
279 | (1) |
|
|
280 | (1) |
|
|
281 | (2) |
|
9 Monitoring Implementation Through Budgets and Information Systems |
|
|
283 | (22) |
|
|
283 | (3) |
|
|
284 | (2) |
|
Budgeting as Part of Planning |
|
|
286 | (6) |
|
Monetize and Compute Program Costs |
|
|
286 | (1) |
|
Budget for Start-Up and Evaluation Costs |
|
|
287 | (1) |
|
|
288 | (4) |
|
|
292 | (1) |
|
Budget as a Monitoring Tool |
|
|
292 | (6) |
|
|
293 | (1) |
|
|
293 | (5) |
|
|
298 | (3) |
|
Health Informatics Terminology |
|
|
298 | (1) |
|
Information Systems Considerations |
|
|
299 | (2) |
|
|
301 | (1) |
|
Discussion Questions and Activities |
|
|
302 | (1) |
|
|
303 | (1) |
|
|
303 | (2) |
|
10 Implementation Evaluation: Measuring Inputs and Outputs |
|
|
305 | (34) |
|
Assessing the Implementation |
|
|
305 | (5) |
|
Implementation Documentation |
|
|
307 | (1) |
|
Implementation Assessment |
|
|
307 | (1) |
|
Implementation Evaluation |
|
|
308 | (2) |
|
Efficacy, Effectiveness, and Efficiency |
|
|
310 | (1) |
|
|
311 | (3) |
|
Quantifying Inputs to the Organizational Plan |
|
|
314 | (5) |
|
|
316 | (2) |
|
|
318 | (1) |
|
Quantifying Outputs of the Organizational Plan |
|
|
319 | (1) |
|
|
319 | (1) |
|
|
320 | (1) |
|
Quantifying Inputs to the Services Utilization Plan |
|
|
320 | (5) |
|
Participants and Recipients |
|
|
320 | (2) |
|
Intervention Delivery and Fidelity |
|
|
322 | (3) |
|
Quantifying Outputs of the Services Utilization Plan |
|
|
325 | (9) |
|
Coverage as Program Reach |
|
|
325 | (4) |
|
Participant-Related Issues |
|
|
329 | (4) |
|
|
333 | (1) |
|
|
334 | (2) |
|
Discussion Questions and Activities |
|
|
336 | (1) |
|
|
336 | (1) |
|
|
337 | (2) |
|
11 Program Quality and Fidelity: Managerial and Contextual Considerations |
|
|
339 | (24) |
|
The Accountability Context |
|
|
340 | (2) |
|
|
340 | (1) |
|
Professional Accountability |
|
|
341 | (1) |
|
Performance and Quality: Navigating the Interface |
|
|
342 | (10) |
|
Quality Improvement Approaches |
|
|
343 | (1) |
|
Quality Improvement Tools |
|
|
344 | (3) |
|
Relevance to Health Programs |
|
|
347 | (1) |
|
|
347 | (4) |
|
Informatics and Information Technology |
|
|
351 | (1) |
|
Creating Change for Quality and Fidelity |
|
|
352 | (5) |
|
Interpreting Implementation Data |
|
|
352 | (2) |
|
Maintaining Program Process Quality and Fidelity |
|
|
354 | (2) |
|
Managing Group Processes for Quality and Fidelity |
|
|
356 | (1) |
|
When and What Not to Change |
|
|
356 | (1) |
|
|
357 | (1) |
|
|
357 | (1) |
|
|
358 | (1) |
|
|
359 | (1) |
|
|
360 | (3) |
|
SECTION V Outcome and Impact Evaluation of Health Programs |
|
|
363 | (150) |
|
12 Planning the Intervention Effect Evaluations |
|
|
365 | (28) |
|
Developing the Evaluation Questions |
|
|
366 | (7) |
|
Characteristics of the Right Question |
|
|
367 | (2) |
|
Outcome Documentation, Outcome Assessment, and Outcome Evaluation |
|
|
369 | (1) |
|
|
370 | (2) |
|
|
372 | (1) |
|
Variables from the Program Effect Theory |
|
|
373 | (5) |
|
Outcome and Impact Dependent Variables |
|
|
373 | (3) |
|
Causal Factors as Independent Variables |
|
|
376 | (1) |
|
Antecedent, Moderating, and Mediating Factors as Variables |
|
|
376 | (2) |
|
Measurement Considerations |
|
|
378 | (5) |
|
|
378 | (1) |
|
Types of Variables (Levels of Measurement) |
|
|
378 | (3) |
|
|
381 | (1) |
|
|
382 | (1) |
|
|
383 | (3) |
|
|
384 | (1) |
|
|
384 | (1) |
|
|
385 | (1) |
|
Contextual Considerations in Planning the Evaluation |
|
|
386 | (3) |
|
|
386 | (1) |
|
|
387 | (1) |
|
|
388 | (1) |
|
|
389 | (2) |
|
Discussion Questions and Activities |
|
|
391 | (1) |
|
|
391 | (1) |
|
|
391 | (2) |
|
13 Choosing Designs for Effect Evaluations |
|
|
393 | (36) |
|
Evaluation Design Caveats |
|
|
394 | (8) |
|
Considerations in Choosing a Design |
|
|
395 | (6) |
|
Integrated Use of Designs: An Example |
|
|
401 | (1) |
|
Choosing the Evaluation Design |
|
|
402 | (20) |
|
Identifying Design Options |
|
|
402 | (1) |
|
Overview of the Decision Tree |
|
|
403 | (3) |
|
Designs for Outcome Documentation |
|
|
406 | (4) |
|
Designs for Outcome Assessment |
|
|
410 | (8) |
|
Designs for Outcome Evaluation |
|
|
418 | (1) |
|
Practical Issues with Experimental Designs |
|
|
419 | (3) |
|
|
422 | (2) |
|
|
424 | (1) |
|
|
425 | (1) |
|
|
425 | (1) |
|
|
426 | (3) |
|
14 Sampling Designs and Data Sources for Effect Evaluations |
|
|
429 | (24) |
|
|
429 | (2) |
|
|
431 | (7) |
|
Hard-to-Reach Populations |
|
|
433 | (1) |
|
|
434 | (1) |
|
Calculating Response Rates |
|
|
435 | (3) |
|
Sampling for Effect Evaluations |
|
|
438 | (3) |
|
Sampling for Outcome Assessment |
|
|
438 | (2) |
|
Sampling for Outcome Evaluation |
|
|
440 | (1) |
|
|
441 | (7) |
|
Surveys and Questionnaires |
|
|
443 | (3) |
|
|
446 | (2) |
|
|
448 | (1) |
|
|
448 | (1) |
|
Discussion Questions and Activities |
|
|
449 | (1) |
|
|
449 | (1) |
|
|
450 | (3) |
|
15 Quantitative Data Analysis and Interpretation |
|
|
453 | (32) |
|
Data Entry and Management |
|
|
454 | (4) |
|
|
456 | (1) |
|
|
456 | (2) |
|
|
458 | (1) |
|
|
458 | (7) |
|
Change as a Difference Score |
|
|
458 | (2) |
|
Issues with Quantifying Change from the Program |
|
|
460 | (4) |
|
Clinical and Statistical Significance |
|
|
464 | (1) |
|
Across Levels of Analysis |
|
|
465 | (2) |
|
Statistical Answers to the Questions |
|
|
467 | (10) |
|
|
470 | (1) |
|
|
471 | (1) |
|
|
472 | (3) |
|
|
475 | (2) |
|
|
477 | (3) |
|
Four Fallacies of Interpretation |
|
|
478 | (2) |
|
|
480 | (1) |
|
|
480 | (1) |
|
Discussion Questions and Activities |
|
|
481 | (1) |
|
|
482 | (1) |
|
|
483 | (2) |
|
16 Qualitative Methods for Planning and Evaluation |
|
|
485 | (28) |
|
Qualitative Methods Throughout the Planning and Evaluation Cycle |
|
|
485 | (1) |
|
|
486 | (11) |
|
Individual In-Depth Interview |
|
|
487 | (2) |
|
Written Open-Ended Questions |
|
|
489 | (1) |
|
|
490 | (1) |
|
|
491 | (2) |
|
|
493 | (2) |
|
|
495 | (2) |
|
|
497 | (2) |
|
Sampling for Qualitative Methods |
|
|
499 | (3) |
|
Analysis of Qualitative Data |
|
|
502 | (5) |
|
Overview of Analytic Process |
|
|
502 | (3) |
|
|
505 | (1) |
|
|
506 | (1) |
|
|
507 | (1) |
|
|
507 | (2) |
|
Discussion Questions and Activities |
|
|
509 | (1) |
|
|
509 | (1) |
|
|
510 | (3) |
|
SECTION VI Additional Considerations for Evaluators |
|
|
513 | (32) |
|
17 Program Evaluators' Responsibilities |
|
|
515 | (30) |
|
|
515 | (6) |
|
Institutional Review Board Approval and Informed Consent |
|
|
516 | (1) |
|
|
517 | (3) |
|
|
520 | (1) |
|
Responsible Spin of Data and Information |
|
|
521 | (4) |
|
Persuasion and Information |
|
|
521 | (2) |
|
Information and Sense Making |
|
|
523 | (2) |
|
|
525 | (8) |
|
|
525 | (2) |
|
|
527 | (4) |
|
|
531 | (1) |
|
|
532 | (1) |
|
Expansions and Replications |
|
|
533 | (1) |
|
|
533 | (3) |
|
Organization-Evaluator Relationship |
|
|
533 | (2) |
|
|
535 | (1) |
|
Responsible for Evaluation Quality |
|
|
536 | (1) |
|
Responsible for Current Practice |
|
|
537 | (2) |
|
|
537 | (1) |
|
|
538 | (1) |
|
|
539 | (2) |
|
Discussion Questions and Activities |
|
|
541 | (1) |
|
|
541 | (1) |
|
|
542 | (3) |
Index |
|
545 | |