|
Staff Members as Stakeholders in Participatory Evaluation: Three Case Studies
|
| Presenter(s):
|
| Nicole Ardoin, Stanford University, nmardoin@stanford.edu
|
| Kathayoon Khalil, Stanford University, kakhalil@stanford.edu
|
| Abstract:
Scholars have suggested an important role for engaging staff members in evaluation processes, from inception and implementation to data analysis and presentation (Powell et al. 2008). We will present research on three case studies with a range of staff engagement in evaluation, opportunities and challenges with staff engagement in evaluation, and potential directions for capacity building in this area. The first case is the Oregon Zoo's ZooCamp program, whose more than 50 staff members serve over 4,000 Pre-K to middle-school-aged children. Staff participate in evaluation by developing learning objectives establishing numeric and qualitative measurements of student learning. The second and third case studies are residential environmental education centers—Great Smoky Mountains Institute at Tremont and NorthBay Adventure Center—where staff have participated in developing, implementing, and sustaining evaluation over nearly a decade. We'll present findings from research into the effectiveness of these staff engagement processes in evaluation.
|
|
The Experience Sampling Method (ESM): A Tool for Assessing Stakeholder and Program Values
|
| Presenter(s):
|
| Cristina Tangonan, Claremont Graduate University, cristina.tangonan@gmail.com
|
| Nicole Porter, Claremont Graduate University, nicole.porter@cgu.edu
|
| Abstract:
This paper will consider the utility of employing the Experience Sampling Method (ESM) in program evaluations, especially those that are participatory or collaborative in nature. First developed by Mihaly Csikszentmihalyi, the ESM is a technique used to gather real-time data pertaining to the subjective experiences of individuals and the thoughts, feelings, and emotions linked to those experiences. Selected past research has utilized the ESM to further understand adolescents' experiences in educational settings, employee work satisfaction in organizations, and the phenomenon of flow. Few evaluations, however, utilize this cost-effective method. This paper will explore the ESM's benefits at multiple stages of an evaluation and discuss the advantages of using the ESM to promote stakeholder involvement in evaluation activities. Finally, this paper will explore how the ESM can provide insight into the underlying values and complexities of an evaluand that may not otherwise be addressed.
|
|
Valuing the Role of Adults as Allies: A Pilot Project to Understand the Roles of Adults in Youth Participatory Research and Evaluation Efforts
|
| Presenter(s):
|
| Mariah Kornbluh, Michigan State University, mkornblu@gmail.com
|
| Katie Richards-Schuster, University of Michigan, kers@umich.edu
|
| Jennifer Juras, Youth Leadership Institute, jenjuras@gmail.com
|
| Abstract:
This paper presentation focuses on the initial findings from a pilot study designed to explore the role of adult allies in youth participatory research and evaluation efforts. The study surveys self identified adult allies about their past experiences, their perspectives on the work, and their understanding of what facilitates and supports their roles as allies to young people. This study employs two different methods, an on-line survey and qualitative interviews. The survey and interview protocol was designed in collaboration with a community based partner. This presentation will discuss the conceptual framework for the project, the process of collaboratively developing the survey and interview protocol, and the pilot findings of the project to date.
|
| | |