Muutke küpsiste eelistusi

Developing Monitoring and Evaluation Frameworks [Pehme köide]

  • Formaat: Paperback / softback, 312 pages, kõrgus x laius: 231x187 mm, kaal: 560 g
  • Ilmumisaeg: 03-Sep-2015
  • Kirjastus: SAGE Publications Inc
  • ISBN-10: 148335833X
  • ISBN-13: 9781483358338
  • Formaat: Paperback / softback, 312 pages, kõrgus x laius: 231x187 mm, kaal: 560 g
  • Ilmumisaeg: 03-Sep-2015
  • Kirjastus: SAGE Publications Inc
  • ISBN-10: 148335833X
  • ISBN-13: 9781483358338
Markiewicz and Patrick provide guidance to the planning that is required to produce high quality evaluation that incorporates routine monitoring, and set out a structured, staged approach to this undertaking. Historically, monitoring and evaluation have been considered different functions, they say, but increasingly developing a framework that includes both is seen as an an important step in determining the performance of a program. Their topics include foundation concepts, program theory and program logic as foundations for the monitoring and evaluation framework, the monitoring plan, the evaluation plan, and planning for the implementation of the monitoring and evaluation framework. Annotation ©2015 Ringgold, Inc., Portland, OR (protoview.com)

Developing Monitoring and Evaluation Frameworks is a practical book that provides clear, step-by-step guidance on how to develop a monitoring and evaluation framework in a participatory, logical, systematic, and integrated way. Authors Anne Markiewicz and Ian Patrick outline the key stages and steps involved, including: scoping the framework; identifying planned results; using program theory and program logic; developing evaluation questions; identifying processes for ongoing data collection and analysis; determining means to promote learning; reporting; and dissemination of results. A final chapter focuses on planning for implementation of the framework, with reference to the broader program and organizational context. The authors draw on their extensive experience in developing monitoring and evaluation frameworks to provide examples of good practice that inform organizational learning and decision making, while offering tips and guidelines that can be used to address common pitfalls.

Arvustused

"The text provides an excellent resource for developing monitoring and evaluation frameworks for a wide range of organizations and programs. Students and practitioners are provided with a great resource that can help organizations better society, and maximize evaluation efficiency by integrating monitoring with evaluation." -- Daniela C. Schroeter This book does a brilliant job of integrating program monitoring concepts into the broader field of evaluation.  It fills a glaring gap in the evaluation literature, and I highly recommend it for practicing evaluators, evaluation scholars, and evaluation faculty and students. -- Stewart I. Donaldson At last--a step-by-step guide to realizing the potential of monitoring and evaluation by building them in from the beginning. This book provides a systematic and well-tested approach to planning and successfully implementing an integrated monitoring and evaluation framework. -- Patricia Rogers

Preface xii
Acknowledgments xiv
About the Authors xvi
Chapter 1 Introduction to Developing Monitoring and Evaluation Frameworks 1(27)
What Is a Monitoring and Evaluation Framework?
1(1)
Why Invest?
2(2)
What Functions Does a Monitoring and Evaluation Framework Serve?
4(2)
What Gap Does This Text Intend to Fill?
6(1)
Key Features of the Approach
7(2)
Program-Level Focus
9(2)
What Are the Differences Between Monitoring and Evaluation?
11(4)
What Are the Complementarities Between Monitoring and Evaluation?
15(4)
What Is Included in a Monitoring and Evaluation Framework?
19(1)
Format and Layout of the Text
20(8)
Chapter 2 Foundation Concepts 28(15)
1 Multiple Purposes for Monitoring and Evaluation
29(2)
2 Results-Based Management Approach
31(4)
3 Theory-Based Approach
35(3)
4 Evaluation-Led Monitoring and Evaluation
38(2)
5 Participatory Orientation
40(3)
Chapter 3 First Steps: Scoping the Monitoring and Evaluation Framework, Stakeholder Mapping, and Evaluation Capacity Building 43(27)
1 Introduction to Scoping the Framework With Key Stakeholders
44(2)
2 Key Steps in Scoping the Framework
46(22)
Step 1 Identify Requirements
47(3)
Step 2 Determine Participation Arrangements
50(10)
Step 3 Identify Possible and Preferred Approaches
60(5)
Step 4 Review Resource Parameters
65(1)
Step 5 Confirm Purpose and Parameters of the Framework
66(2)
3 From First Steps Onward
68(1)
Summary Checklist
68(1)
Chapter Review Questions
69(1)
Chapter 4 Program Theory and Program Logic as Foundations for the Monitoring and Evaluation Framework 70(23)
1 Introduction to Developing Program Theory and Program Logic
71(9)
Program Theory
72(2)
Differences Between Program Theory and Program Logic
74(1)
Program Logic
74(2)
Program Theory and Program Logic for a Community Education Program
76(4)
2 Steps Involved in Developing Program Theory and Program Logic
80(11)
Step 1 Plan Stakeholder Engagement Strategy
81(2)
Step 2 Develop Program Theory
83(2)
Step 3 Develop Program Logic
85(4)
Step 4 Confirm Program Theory and Program Logic With Key Stakeholders
89(2)
Summary Checklist
91(1)
Chapter Review Questions
92(1)
Chapter 5 Evaluation Questions-Determining What We Want to Know 93(27)
1 Introduction to Developing Evaluation Questions
94(3)
Answering Evaluation Questions: A Complementary Role for Monitoring and Evaluation
94(1)
Developing Agreed, Practical, and Useful Evaluation Questions
95(2)
2 Using Evaluation Domains to Guide Selection of Questions
97(10)
3 Using Program Theory and Logic to Determine Evaluation Questions
107(3)
4 Steps Involved in Developing Evaluation Questions
110(8)
Step 1 Develop Draft Evaluation Questions
112(1)
Step 2 Facilitate Stakeholder Participation
113(2)
Step 3 Scope Number and Range of Questions Against Data and Resources Available
115(1)
Step 4 Present Questions to Stakeholders for Final Endorsement
116(1)
Step 5 Finalize Evaluation Questions
117(1)
Summary Checklist
118(1)
Chapter Review Questions
119(1)
Chapter 6 The Monitoring Plan 120(28)
1 Introduction
121(1)
2 Introduction to Program Monitoring
121(4)
Performance Management and Program Monitoring
123(2)
3 The Monitoring Plan
125(3)
4 Steps in Developing the Monitoring Plan
128(17)
Step 1 Identify Focus
129(2)
Step 2 Develop Performance Indicators and Targets
131(11)
Step 3 Identify Data Collection Processes and Tools
142(2)
Step 4 Determine Responsibilities and Time Frames
144(1)
5 The Future of Program Monitoring
145(1)
Summary Checklist
146(1)
Chapter Review Questions
147(1)
Chapter 7 The Evaluation Plan 148(33)
1 Introduction
149(1)
2 Focusing on Evaluation
150(5)
Quality and Value
151(1)
Example of Quality
152(1)
Example of Value
152(1)
Types of Evaluation: Formative and Summative
153(2)
3 The Evaluation Plan
155(5)
4 Steps Involved in Developing the Evaluation Plan
160(19)
Step 1 Determine Overall Evaluation Approach
161(8)
Step 2 Identify Evaluation Questions Requiring Criteria and Standards
169(4)
Step 3 Identify Focus of Evaluation and Methods for Each Question
173(3)
Step 4 Determine Responsibilities and Time Frame
176(1)
Step 5 Review the Monitoring and Evaluation Plans
177(2)
Summary Checklist
179(1)
Chapter Review Questions
180(1)
Chapter 8 Collecting, Managing, Analyzing, and Synthesizing Data to Reach Evaluative Conclusions 181(37)
1 Introduction to Data Processes That Support Sound Conclusions
182(2)
2 Organizational Context for Data Collection, Management, and Analysis
184(3)
3 Data Quality
187(2)
4 Steps Involved in Data Collection, Management, Analysis, and Synthesis
189(27)
Step 1 Develop Data Collection Plan
190(7)
Step 2 Develop Data Management Plan
197(6)
Step 3 Consider Approach to Data Synthesis
203(7)
Step 4 Consider Approach to Making Evaluative Judgments and Reaching Evaluative Conclusions
210(6)
Summary Checklist
216(1)
Chapter Review Questions
217(1)
Chapter 9 Learning, Reporting and Dissemination Strategies 218(24)
1 Introduction
219(1)
2 Steps Involved in Learning and Reporting and Dissemination
220(20)
Step 1 Consider Developing or Refining a Learning Strategy That Maximizes Use of Conclusions, Recommendations, and Lessons
222(4)
Step 2 Consider the Identification of Recommendations and Lessons
226(4)
Step 3 Provide Guidance on Developing a Reporting and Dissemination Strategy
230(10)
Summary Checklist
240(1)
Chapter Review Questions
241(1)
Chapter 10 Planning for Implementation of the Monitoring and Evaluation Framework 242(12)
1 Introduction to Planning for Implementation
243(3)
2 Key Steps in Implementation of Monitoring and Evaluation Frameworks
246(7)
Step 1 Confirm Program Management Arrangements
247(1)
Step 2 Work Planning for Implementation
248(3)
Step 3 Plan for Monitoring and Review of Framework
251(2)
Summary Checklist
253(1)
Chapter Review Questions
253(1)
Chapter 11 Conclusion 254(3)
Appendix 257(18)
References 275(8)
Index 283
Anne Markiewicz is an independent evaluation consultant and the Director of Anne Markiewicz and Associates. Commencing her professional career a social worker, Anne held academic positions in Social Work at two Australian Universities. In 1997, Anne pursued her interest in evaluation and commenced working as an independent consultant. In 2000, she completed a Master of Education in Program Evaluation at the University of Melbourne. Since that time, Anne has completed a significant number of evaluation projects for a range of Australian government departments, non-government organizations and international agencies. She has specialized in evaluating programs with social justice objectives.

Annes practice as an evaluator has highlighted the need for early evaluation planning to provide a clear and agreed focus, ensure data availability and support the production of credible evaluations. She has increasingly focused on the development of Monitoring and Evaluation Frameworks for a range of clients. She has designed and delivered an array of related training programs, which also encompass areas such as stakeholder engagement, negotiation and evaluation reporting. This training has been delivered extensively in Australasia, particularly within Australia and Papua New Guinea.  Anne has a commitment to evaluation capacity building and has provided mentoring support to a range of government and non-government organizations.

Anne is a past board member of the Australasian Evaluation Society, holding positions of Secretary and Vice President. She has received two awards for excellence in evaluation from the Australasian Evaluation Society. These were the Indigenous Evaluation Award (2008) for an evaluation completed with the Australian Department of Finance and Deregulation, and the Outstanding Contribution to Evaluation Award (2013). Anne has published articles on the political context to evaluation, balancing stakeholder interests in evaluation and the evaluation of programs for Indigenous Australians.

Dr. Ian Patrick is an independent evaluation consultant and Director of Ian Patrick and Associates. Ian has a number of threads in his career which have supported his move into evaluation. Building on a background in teaching and radio and television production, Ian shifted his focus to international program management. He became aware of the challenges involved in evaluation of complex programs operating in the Asia-Pacific region while working for several Australian universities and managing contractors. Ian completed a PhD in Asian Studies in 1997, and commenced working in academic roles in international development for both the RMIT University and Deakin University, Australia. Ian is currently an Honorary Senior Fellow with the Development Studies Program at the University of Melbourne.

Ian commenced working as an independent consultant in 1998 with roles encompassing evaluation, program design, strategy development and organizational review. The focus of this work has progressively shifted to concentrate on the evaluation area and has also achieved a balance between Australian and international contexts. He has undertaken evaluation related assignments for a range of international agencies, Australian government departments and non-government organisations. He has interests in evaluation practice in both public sector and civil society contexts with sectoral experience crossing areas such as law and justice, health, education, rural and urban development, environment, human rights, disaster management, media and the arts, and migration and Indigenous issues.

Ian is a member of the Australasian Evaluation Society and the American Evaluation Association. In 2012, he received the Best Evaluation Policy and Systems Award from the Australasian Evaluation Society for a Monitoring and Evaluation Framework developed for the Mongolia Australia Scholarship Program.