|
Session Title: Tips From the Trenches: The Role of the Evaluator in Designing a Quality Evaluation
|
|
Panel Session 308 to be held in Texas A on Thursday, Nov 11, 1:40 PM to 3:10 PM
|
|
Sponsored by the Government Evaluation TIG
|
| Chair(s): |
| Stanley Capela, HeartShare Human Services of New York, stan.capela@heartshare.org
|
| Discussant(s):
|
| Amy Germuth, EvalWorks LLC, agermuth@mindspring.com
|
| Abstract:
The session will focus on how three program evaluators from the government and non-profit sector developed an approach to designing a quality evaluation. It will provide participants a variety of tips and techniques on how to facilitate the process in a way that engages stakeholders to ensure the evaluation provides meaningful information to assist in strengthening program services. As part of the discussion, presenters will also discuss barriers they confronted and how they approached these issues to further ensure the quality of the evaluation.
|
|
Quality Perspectives in the Evaluation of a K-12 English Language Proficiency Program
|
| Stephan Henry, REASolutions LLC, shenry@reasolutions.net
|
|
This presentation describes the application of the Joint Committee’s Program Evaluation Standards as tool in planning and metaevaluating an urban school district ELL program evaluation in terms of four quality elements: Propriety, Utility, Feasibility, and Accuracy. The design and implementation of the evaluation in examining the quality of the English Language Proficiency Program will also be undertaken. A challenge to utilization of the evaluation findings was created when the evaluator and key managers and administrators for the program resigned shortly after the evaluation was completed. Strategies implemented to maximize utilization of the findings, before and after the resignations, will be reviewed.
|
|
|
Real Time Peer Reviews: An Efficient Way to Ensure Evaluation Quality
|
| Rakesh Mohan, Idaho State Legislature, rmohan@ope.idaho.gov
|
|
Many performance audit and evaluation organizations working at any level of government undergo external quality control reviews, or peer reviews. These peer reviews are conducted once every 3-5 years by a team of several senior auditors/evaluators from peer organizations. If done correctly, peer reviews are helpful in improving internal processes and procedures of an audit or evaluation organization.
When I first learned about these peer reviews 22 years ago, I thought it would be nice if these reviews were done prior to completing the project. Recently, as the director of my evaluation office, I decided to do an experiment – modify the concept of these traditional peer reviews slightly by employing them in real time as we carry out each project from start to finish. These real time peer reviews have been extremely useful for us in ensuring the quality of our evaluation projects. Furthermore, I have found these real time peer reviews to be very cost effective. I will provide a how-to guide for using these real time peer reviews.
| |
|
Quality Evaluation Template: How to Develop a Utilization Focused Evaluation System Incorporating Quality Improvement and Quality Assurance Systems
|
| Stanley Capela, HeartShare Human Services of New York, stan.capela@heartshare.org
|
|
HeartShare Human Services provides a variety of developmental disabilities services. As a result the funder places a great deal of emphasis on quality assurance and compliance. At the same time senior management understands that organizations that strive to achieve a higher standard must incorporate a quality improvement system. This session will provide a template on how an evaluator incorporates the ideals of quality assurance and quality improvement to ensure the utilization focused evaluation approach meets the needs of senior management and at the same time strengthens program services to meet the needs of the individuals served by the programs.
| |