North American education evaluation specialists Yarbrough (U. of Iowa), Shulha (Queen's U. at Kingston, Canada), Hopson (Duquesne U.), and Caruthers (Florida Legislature) present the latest edition guide for evaluating programs that foster learning and performance across the life span, applicable in various settings, from schools and universities to communities, governmental organizations, medical and health-care organizations, the military, private sector enterprises, and nonprofit and nongovernmental organizations. Thirty standards are organized into five groups corresponding to five key attributes of evaluation quality: utility, feasibility, propriety, accuracy, and--new to this edition--accountability. Designed for evaluation professionals, evaluation users and clients, the third edition features greater integration of the standards into recommendations for reflective practice, extensive attention to the roles of culture and context in evaluation, integrated discussion of high-quality communication and the need for communication planning, and the increased emphasis on improving and holding evaluations accountable through systematic metaevaluation. Annotation ©2010 Book News, Inc., Portland, OR (booknews.com)
Helping you use program evaluation standards most effectively
The Joint Committee on Standards for Educational Evaluation (JCSEE.org) is an American National Standards Institute (ANSI) accredited standards developer, sponsored by 17 North American professional organizations. With oversight from the JCSEE, Yarbrough, Schula, Hopson, and Caruthers have revised and illustrated this new edition of the Program Evaluation Standards. These thirty standards support the core attributes of evaluation quality: utility, feasibility, propriety, accuracy, and accountability, and provide guidance to anyone interested in planning, implementing, or using program evaluations.
Key Features
This new edition
- Provides extensive attention to cultures and contexts in evaluations
- Encourages reflective practice based on in-depth understanding of standards and their applications
- Suggests flexible approaches for learning how to use the standards
- Includes a new section, Evaluation Accountability, emphasizing metaevaluation for improvement and accountability guided by three new metaevaluation standards
- Includes case scenarios and applications across multiple standards to help users apply the standards individually and in concert
- Offers updated documentation reference lists
Intended Audience
This resource provides guidance for all stakeholders: anyone-from the practicing evaluator to evaluation users and clients-who will either experience or use standards-based program evaluations.
Members of the Joint Committee on Standards for Educational Evaluation, During the Development of this Edition 2005 through 2010 |
|
vii | |
Acknowledgments |
|
ix | |
Preface |
|
xii | |
About the Authors |
|
xvi | |
Introduction |
|
xviii | |
Applying the Standards |
|
xxx | |
The Functional Table of Standards |
|
xli | |
|
|
|
|
3 | (68) |
|
|
15 | (8) |
|
U2 Attention to Stakeholders |
|
|
23 | (6) |
|
|
29 | (8) |
|
|
37 | (8) |
|
|
45 | (6) |
|
U6 Meaningful Processes and Products |
|
|
51 | (6) |
|
U7 Timely and Appropriate Communicating and Reporting |
|
|
57 | (8) |
|
U8 Concern for Consequences and Influence |
|
|
65 | (6) |
|
|
71 | (34) |
|
|
79 | (8) |
|
|
87 | (6) |
|
|
93 | (6) |
|
|
99 | (6) |
|
|
105 | (52) |
|
P1 Responsive and Inclusive Orientation |
|
|
113 | (6) |
|
|
119 | (6) |
|
P3 Human Rights and Respect |
|
|
125 | (6) |
|
|
131 | (8) |
|
P5 Transparency and Disclosure |
|
|
139 | (6) |
|
P6 Conflicts of Interests |
|
|
145 | (6) |
|
|
151 | (6) |
|
|
157 | (68) |
|
A1 Justified Conclusions and Decisions |
|
|
165 | (6) |
|
|
171 | (8) |
|
|
179 | (6) |
|
A4 Explicit Program and Context Descriptions |
|
|
185 | (8) |
|
A5 Information Management |
|
|
193 | (8) |
|
A6 Sound Designs and Analyses |
|
|
201 | (8) |
|
A7 Explicit Evaluation Reasoning |
|
|
209 | (8) |
|
A8 Communication and Reporting |
|
|
217 | (8) |
|
PART V EVALUATION ACCOUNTABILITY |
|
|
225 | (28) |
|
E1 Evaluation Documentation |
|
|
231 | (6) |
|
E2 Internal Metaevaluation |
|
|
237 | (8) |
|
E3 External Metaevaluation |
|
|
245 | (8) |
Appendix A The 1981 Program Evaluation Standards |
|
253 | (8) |
Appendix B The 1994 Program Evaluation Standards |
|
261 | (8) |
Appendix C Resources and Support |
|
269 | (14) |
Glossary |
|
283 | (11) |
Documentation Reference Lists |
|
294 | (31) |
Index |
|
325 | |
Donald B. Yarbrough, Ph.D., is the Director of the Center for Evaluation and Assessment and Professor of Psychological and Quantitative Foundations at the University of Iowa. He is the current chair of the JCSEE and has been a member since 1996, sponsored until 2008 by the National Council on Measurement in Education. He served as a writer for the Personnel Evaluation Standards and the Student Evaluation Standards and has helped organize and conduct numerous evaluation standards development activities, including national hearings and field trials. In addition to authoring and co-authoring more than 100 evaluation reports, he has published widely on assessment and evaluation. He has received funding from NIH, NSF, FIPSE, DE, HHS, NEA and numerous private foundations. In addition, he currently serves as chair of the NIH Clinical and Translational Science Evaluators Definitions Working Group. He maintains active members in the American Psychological Society, American Evaluation Association, and the American Educational Research Association. Lyn M. Shulha is Professor and a Director of the Assessment and Evaluation Group, Queens University at Kingston, Canada. Lyn has served on the JCSEE since 2003, sponsored by the Canadian Society for the Study of Education. Lyn is also a long time active member of the American Evaluation Association. She currently serves on the editorial boards of the American Journal of Evaluation, The Canadian Journal of Program Evaluation, the Journal Evaluation and Program Planning, and is an Associate Editor of the new international journal, Assessment Matters. An active evaluator and researcher in assessment and evaluation, Lyns interests include the use of evaluative inquiry in school university professional learning partnerships, collaborative and participatory approaches to evaluation, classroom assessment practices and assessment as pedagogy. Rodney K.M. Hopson is Hillman Distinguished Professor, Department of Educational Foundations and Leadership in the School of Education, and faculty member in the Center for Interpretive and Qualitative Research, Duquesne University. With funding support from W.K. Kellogg Foundation, National Science Foundation, Robert Wood Johnson Foundation, Annie E. Casey Foundation, and other funding streams, Hopson has raised more than $3 million in the last five years in the support of graduate and post-graduate students of color in natural and social sciences to contribute to the development of interests that focus on democratically-oriented evaluation and research approaches and practices in traditionally underserved communities in the U.S. One book, The Role of Culture and Cultural Context in Evaluation: A Mandate for Inclusion, the Discovery of Truth and Understanding (with Stafford Hood & Henry Frierson, Information Age: Greenwich, CT, 2005), provides import to how the evaluation community attends to matters of culture and cultural context, especially in reconstituting knowledge production in the field. In addition, Hopson has served on several editorial boards related to evaluation, such as American Journal of Evaluation, Encyclopedia of Evaluation, Evaluation and Society book series, and the Journal of MultiDisciplinary Evaluation. Recent professional service includes former membership on the Board of Directors of the American Evaluation Association, and founding Project Director, American Evaluation Association/Duquesne University Graduate Education Diversity Internship Program. Flora A. Caruthers is the Staff Director for Technical Services and Staff Development for the Florida Legislatures Office of Program Policy Analysis and Government Accountability (OPPAGA). Since joining the staff in 1982, she has served in a variety of positions, including leader for a number of education-related program evaluations. Since 1996 she has been responsible for OPPAGAs personnel, budget, staff recruitment, and training functions. Her previous professional experiences include service as an elementary school teacher, university administrator and faculty member, and evaluation consultant for postsecondary education. She also served as President of the Southeast Evaluation Association. She has served as the National Legislative Program Evaluation Societys liaison to the JCSEE since 2000, and has is in her second three year term on the Executive Board.