|
Improving the Quality of Program Evaluation Reporting: A Capacity Building Event in California's Tobacco Control Programs
|
| Presenter(s):
|
| Jeanette Treiber, University of California, Davis, jtreiber@ucdavis.edu
|
| Abstract:
The Tobacco Control Evaluation Center (TCEC) at UC Davis supports more than 100 grantees that are comprised of county health departments and local organizations throughout California involved in local tobacco policy work. TCEC uses training and on-demand technical assistance to build the evaluation capacity of these grantees that have varying levels of evaluation expertise. It also scores and provides feedback on grantees’ three year final evaluation reports. The evaluation reports of the funding cycle that ended in 2007 showed large gaps in proper analysis and reporting. For this reason, TCEC increased its analysis and report writing training effort in 2010, before the final evaluation reports of the next funding cycle were due. Capacity building occurred through a threefold effort: regional one-day trainings at various sites in California, a life webinar that was recorded and posted on the TCEC website, and on-demand one-on-one technical assistance via phone. This paper relates the capacity building activities and their results by tracking the extend of grantee participation in these capacity building events, by analyzing training satisfaction surveys, and by comparing final evaluation report scores of 2007 and 2010.
|
|
Am I My Brother's Keeper? Coaching Communities an Evaluation of Process and Outcome
|
| Presenter(s):
|
| Gina Weisblat, Cleveland State University, g.weisblat@csuohio.edu
|
| Abstract:
Coaching communities is a practice where a single coach (for organizations, peer group, or students) creates communal goals and achieves these goals through the sharing of ideas/practices. This paper will use the Success Case Method (SCM) to evaluate differences in training models from traditional professional development to coaching communities created within one organization and multiple sites. SCM is designed to facilitate organizations’ leverage learning and performance improvement via training. This study will investigate organizational change and culture over a three year period, using data from prior staff experiences to compare to the coaching community model. Specific outcomes will be addressed: perception change, use of existing assets, development of social capital between staff and program, dependence on outside coach versus internal coaching community, and development of a pedagogical approach.
|
|
Evaluation Capacity Building in the Corporate Sector: Using eLearning and Traditional Methods to Increase Organizational Capacity
|
| Presenter(s):
|
| Michele Graham, KPMG LLP, magraham@kpmg.com
|
| John Mattox, Knowledge Advisors, jmattox@knowledgeadvisors.com
|
| Peter Sanacore, KPMG LLP, psanacore@kpmg.com
|
| Abstract:
This paper demonstrates how eLearning programs can enhance evaluation capacity building (ECB) efforts. It describes how the learning measurement group within a large private corporation used an ECB model to facilitate organizational learning related to training evaluation. Cost-effectiveness was important given resource constraints of the measurement group, a flagging economy, and the diverse audience needs; thus, traditional ECB methods alone could not be used. Therefore, the ECB model focused on a blended learning curriculum designed to increase knowledge and skills for performing training evaluation with a focus on quality methods. The blended solution included eLearning, instructor-led-training, technical assistance, use of technology, and written materials. Measures of success included knowledge gain, performance of evaluation tasks, and development of an evaluation culture. Findings indicate gains in capacity were achieved largely because eLearning provided a foundation of knowledge transfer; results revealed important successes with regard to organizational learning by using the blended model.
|
| | |