|
Session Title: Consequences of Evaluation: The Power of Process Use
|
|
Multipaper Session 456 to be held in Panzacola Section G1 on Friday, Nov 13, 9:15 AM to 10:45 AM
|
|
Sponsored by the Evaluation Use TIG
, the Collaborative, Participatory & Empowerment Evaluation TIG, and the Government Evaluation TIG
|
| Chair(s): |
| Jacqueline Stillisano,
Texas A&M University, jstillisano@tamu.edu
|
| Discussant(s): |
| Helene Jennings,
ICF Macro, helene.p.jennings@macrointernational.com
|
|
Towards the Measurement of Process Use
|
| Presenter(s):
|
| Lennise Baptiste, Kent State University, lbaptist@kent.edu
|
| Abstract:
In his 2008 expanded definition of process use M.Q. Patton, suggested that evaluators could look at areas such as increased evaluation capacity, the infusion of evaluation activities, the revision, clarification, or conceptualization of goals, logic models, program priorities and outcomes measurement to understand the type of learning acquired by participants in an evaluation. The researcher presents the findings of a study in which Q-methodology was employed to capture the different types of process use which emerged in three evaluation contexts. The development of the tool will be described. Such a tool can be employed by evaluators who wish to describe what participation in the evaluation illuminated about the stakeholders and the programs beyond the evaluation findings.
|
|
Investigating the Relationship Between Process Use and Use of Evaluation Findings in a Government Context
|
| Presenter(s):
|
| Courtney Amo, National Research Council Canada, courtneyamo@hotmail.com
|
| J Bradley Cousins, University of Ottawa, cjpe@uottawa.ca
|
| Abstract:
Despite support for evaluation utilization being facilitated by stakeholder engagement, evaluation practice in government contexts may not be conducive to such engagement. This paper presents the results of a mixed-methods study that explores the extent to which process use is manifest within government; the conditions/factors that enhance process use; and the relationship between process use and use of evaluation findings. Through the use of data collected through a larger study on evaluation capacity building, this study supports the notion that process use - or the consequences of involvement in (or proximity to) evaluation processes - is an important predictor of findings use in government. However, not all consequences of involvement in evaluation processes exhibit the same explanatory strength. This study highlights the importance of timely, higher-level engagement as well as the importance of organizational learning capacity and conditions mediating evaluation use in setting the stage for process use to occur.
|
| |