Preface |
|
xii | |
Acknowledgments |
|
xiv | |
About the Authors |
|
xvi | |
Chapter 1 Introduction to Developing Monitoring and Evaluation Frameworks |
|
1 | (27) |
|
What Is a Monitoring and Evaluation Framework? |
|
|
1 | (1) |
|
|
2 | (2) |
|
What Functions Does a Monitoring and Evaluation Framework Serve? |
|
|
4 | (2) |
|
What Gap Does This Text Intend to Fill? |
|
|
6 | (1) |
|
Key Features of the Approach |
|
|
7 | (2) |
|
|
9 | (2) |
|
What Are the Differences Between Monitoring and Evaluation? |
|
|
11 | (4) |
|
What Are the Complementarities Between Monitoring and Evaluation? |
|
|
15 | (4) |
|
What Is Included in a Monitoring and Evaluation Framework? |
|
|
19 | (1) |
|
Format and Layout of the Text |
|
|
20 | (8) |
Chapter 2 Foundation Concepts |
|
28 | (15) |
|
1 Multiple Purposes for Monitoring and Evaluation |
|
|
29 | (2) |
|
2 Results-Based Management Approach |
|
|
31 | (4) |
|
|
35 | (3) |
|
4 Evaluation-Led Monitoring and Evaluation |
|
|
38 | (2) |
|
5 Participatory Orientation |
|
|
40 | (3) |
Chapter 3 First Steps: Scoping the Monitoring and Evaluation Framework, Stakeholder Mapping, and Evaluation Capacity Building |
|
43 | (27) |
|
1 Introduction to Scoping the Framework With Key Stakeholders |
|
|
44 | (2) |
|
2 Key Steps in Scoping the Framework |
|
|
46 | (22) |
|
Step 1 Identify Requirements |
|
|
47 | (3) |
|
Step 2 Determine Participation Arrangements |
|
|
50 | (10) |
|
Step 3 Identify Possible and Preferred Approaches |
|
|
60 | (5) |
|
Step 4 Review Resource Parameters |
|
|
65 | (1) |
|
Step 5 Confirm Purpose and Parameters of the Framework |
|
|
66 | (2) |
|
3 From First Steps Onward |
|
|
68 | (1) |
|
|
68 | (1) |
|
|
69 | (1) |
Chapter 4 Program Theory and Program Logic as Foundations for the Monitoring and Evaluation Framework |
|
70 | (23) |
|
1 Introduction to Developing Program Theory and Program Logic |
|
|
71 | (9) |
|
|
72 | (2) |
|
Differences Between Program Theory and Program Logic |
|
|
74 | (1) |
|
|
74 | (2) |
|
Program Theory and Program Logic for a Community Education Program |
|
|
76 | (4) |
|
2 Steps Involved in Developing Program Theory and Program Logic |
|
|
80 | (11) |
|
Step 1 Plan Stakeholder Engagement Strategy |
|
|
81 | (2) |
|
Step 2 Develop Program Theory |
|
|
83 | (2) |
|
Step 3 Develop Program Logic |
|
|
85 | (4) |
|
Step 4 Confirm Program Theory and Program Logic With Key Stakeholders |
|
|
89 | (2) |
|
|
91 | (1) |
|
|
92 | (1) |
Chapter 5 Evaluation Questions-Determining What We Want to Know |
|
93 | (27) |
|
1 Introduction to Developing Evaluation Questions |
|
|
94 | (3) |
|
Answering Evaluation Questions: A Complementary Role for Monitoring and Evaluation |
|
|
94 | (1) |
|
Developing Agreed, Practical, and Useful Evaluation Questions |
|
|
95 | (2) |
|
2 Using Evaluation Domains to Guide Selection of Questions |
|
|
97 | (10) |
|
3 Using Program Theory and Logic to Determine Evaluation Questions |
|
|
107 | (3) |
|
4 Steps Involved in Developing Evaluation Questions |
|
|
110 | (8) |
|
Step 1 Develop Draft Evaluation Questions |
|
|
112 | (1) |
|
Step 2 Facilitate Stakeholder Participation |
|
|
113 | (2) |
|
Step 3 Scope Number and Range of Questions Against Data and Resources Available |
|
|
115 | (1) |
|
Step 4 Present Questions to Stakeholders for Final Endorsement |
|
|
116 | (1) |
|
Step 5 Finalize Evaluation Questions |
|
|
117 | (1) |
|
|
118 | (1) |
|
|
119 | (1) |
Chapter 6 The Monitoring Plan |
|
120 | (28) |
|
|
121 | (1) |
|
2 Introduction to Program Monitoring |
|
|
121 | (4) |
|
Performance Management and Program Monitoring |
|
|
123 | (2) |
|
|
125 | (3) |
|
4 Steps in Developing the Monitoring Plan |
|
|
128 | (17) |
|
|
129 | (2) |
|
Step 2 Develop Performance Indicators and Targets |
|
|
131 | (11) |
|
Step 3 Identify Data Collection Processes and Tools |
|
|
142 | (2) |
|
Step 4 Determine Responsibilities and Time Frames |
|
|
144 | (1) |
|
5 The Future of Program Monitoring |
|
|
145 | (1) |
|
|
146 | (1) |
|
|
147 | (1) |
Chapter 7 The Evaluation Plan |
|
148 | (33) |
|
|
149 | (1) |
|
|
150 | (5) |
|
|
151 | (1) |
|
|
152 | (1) |
|
|
152 | (1) |
|
Types of Evaluation: Formative and Summative |
|
|
153 | (2) |
|
|
155 | (5) |
|
4 Steps Involved in Developing the Evaluation Plan |
|
|
160 | (19) |
|
Step 1 Determine Overall Evaluation Approach |
|
|
161 | (8) |
|
Step 2 Identify Evaluation Questions Requiring Criteria and Standards |
|
|
169 | (4) |
|
Step 3 Identify Focus of Evaluation and Methods for Each Question |
|
|
173 | (3) |
|
Step 4 Determine Responsibilities and Time Frame |
|
|
176 | (1) |
|
Step 5 Review the Monitoring and Evaluation Plans |
|
|
177 | (2) |
|
|
179 | (1) |
|
|
180 | (1) |
Chapter 8 Collecting, Managing, Analyzing, and Synthesizing Data to Reach Evaluative Conclusions |
|
181 | (37) |
|
1 Introduction to Data Processes That Support Sound Conclusions |
|
|
182 | (2) |
|
2 Organizational Context for Data Collection, Management, and Analysis |
|
|
184 | (3) |
|
|
187 | (2) |
|
4 Steps Involved in Data Collection, Management, Analysis, and Synthesis |
|
|
189 | (27) |
|
Step 1 Develop Data Collection Plan |
|
|
190 | (7) |
|
Step 2 Develop Data Management Plan |
|
|
197 | (6) |
|
Step 3 Consider Approach to Data Synthesis |
|
|
203 | (7) |
|
Step 4 Consider Approach to Making Evaluative Judgments and Reaching Evaluative Conclusions |
|
|
210 | (6) |
|
|
216 | (1) |
|
|
217 | (1) |
Chapter 9 Learning, Reporting and Dissemination Strategies |
|
218 | (24) |
|
|
219 | (1) |
|
2 Steps Involved in Learning and Reporting and Dissemination |
|
|
220 | (20) |
|
Step 1 Consider Developing or Refining a Learning Strategy That Maximizes Use of Conclusions, Recommendations, and Lessons |
|
|
222 | (4) |
|
Step 2 Consider the Identification of Recommendations and Lessons |
|
|
226 | (4) |
|
Step 3 Provide Guidance on Developing a Reporting and Dissemination Strategy |
|
|
230 | (10) |
|
|
240 | (1) |
|
|
241 | (1) |
Chapter 10 Planning for Implementation of the Monitoring and Evaluation Framework |
|
242 | (12) |
|
1 Introduction to Planning for Implementation |
|
|
243 | (3) |
|
2 Key Steps in Implementation of Monitoring and Evaluation Frameworks |
|
|
246 | (7) |
|
Step 1 Confirm Program Management Arrangements |
|
|
247 | (1) |
|
Step 2 Work Planning for Implementation |
|
|
248 | (3) |
|
Step 3 Plan for Monitoring and Review of Framework |
|
|
251 | (2) |
|
|
253 | (1) |
|
|
253 | (1) |
Chapter 11 Conclusion |
|
254 | (3) |
Appendix |
|
257 | (18) |
References |
|
275 | (8) |
Index |
|
283 | |