Evaluation 2008 Banner

Return to search form  

Contact emails are provided for one-to-one contact only and may not be used for mass emailing or group solicitations.

Session Title: The Role of Organization/Institutional Context in Evaluation Use and Organizational Learning
Multipaper Session 244 to be held in Room 109 in the Convention Center on Thursday, Nov 6, 9:15 AM to 10:45 AM
Sponsored by the Organizational Learning and Evaluation Capacity Building TIG and the Systems in Evaluation TIG
Chair(s):
Martin Steinmeyer,  Independent Consultant,  m.steinmeyer@gmx.net
Discussant(s):
Nancy Zajano,  Learning Point Associates,  nancy.zajano@learningpt.org
Organizational Resistance to Evaluative Reflection and Learning
Presenter(s):
David Campbell,  University of California Davis,  dave.c.campbell@ucdavis.edu
Abstract: This paper presents a meta-analysis of six recent evaluations in which the goal of creating learning communities was frustrated to greater or lesser degrees. In retrospect, the failures are not attributable to faulty designs or other evaluation mechanics. Rather, attending focally to these matters created a kind of tunnel vision that blinded evaluators to aspects of the organizational context that proved decisive in facilitating or hindering organizational learning and adaptation that took advantage of evaluation findings. This paper draws on the organizational development literature to illuminate common sources of resistance to evaluative reflection, illustrating these with case examples from government and foundation sponsored evaluations. Theory and practice points to a conundrum for evaluation practice: how to be engaged critically with organizational stakeholders without unwittingly exacerbating a climate of anxiety and defensiveness that undermines the spirit of open inquiry we hope to foster.
Higher Ed Assessment: The Role of Institutional Context in Faculty Engagement
Presenter(s):
Susan Boser,  Indiana University of Pennsylvania,  sboser@iup.edu
Abstract: Accrediting and licensure bodies have been moving US higher education institutions into student learning outcomes assessment since the 1990s, and remain a keenly felt presence. However, higher education institutions often experience multiple challenges to developing systematic outcomes assessment and utilizing such evaluation for program improvement. Interestingly, faculty resistance to assessment often presents one particular challenge. This session will look at the role of the institutional context in influencing faculty attitudes toward assessment, examining particular institutional characteristics that might inhibit and those that might promote faculty participation in assessment. In particular, this paper will draw on case examples and a review of the literature to suggest some specific strategies that institutions might use to introduce quality assessment practices to faculty, support active use of assessment findings for curriculum revision and sustain on-going assessment use. Comments will draw selectively on research regarding evaluation use, systems theory, and the literature of participatory evaluation.
Building Capacity Through Empowerment Evaluation: Is Principled Practice Possible in a Resource-Constrained Setting?
Presenter(s):
Wendi Siebold,  Evaluation, Management and Training Associates Inc,  wendi.lyn1@gmail.com
Rhonda Johnson,  University of Alaska,  rhonda.johnson@uaa.alaska.edu
Abstract: A core tenet of empowerment evaluation (EE) is building the capacity of local practitioners to evaluate their efforts. While promising in theory, the practice of EE proves to be challenging when working with organizations and practitioners who have limited time and funding for evaluation activities and capacity-building. The ten “principles” of EE introduced by Fetterman and Wandersman (2005) frame EE practice, yet tensions between these principles become prevalent in resource-constrained settings. For example, the principle of “inclusion” is difficult to achieve when following the principle of “capacity building.” Key stakeholders whose evaluation capacity needs to be built to ensure the institutionalization of evaluation (i.e. program executive directors), are often the hardest to involve due to time constraints. The application of empowerment evaluation in the national CDC-funded DELTA domestic violence prevention initiative offers insights into whether it is truly possible for evaluators to shift from conducting evaluation to building evaluation capacity.

 Return to Evaluation 2008

Add to Custom Program