|
The Political Context of Program Evaluation
|
| Presenter(s):
|
| Anne Markiewicz, Anne Markiewicz and Associates Pty Ltd, anne@anneconsulting.com.au
|
| Abstract:
The presentation will contend that evaluation takes place within a political context influenced by the variety of positions presented by involved stakeholders. The political and stakeholder influenced context of evaluation is a reality that brings with it many benefits for the relevance and the use of evaluation findings. However, this context also presents a number of challenges for the evaluator in preserving their independence and objectivity with potential adverse consequences for the credibility of the evaluation. Many evaluators have experienced undue influence from commissioners of evaluations or key stakeholders involved in the process. This influence can affect each stage of the evaluation process but is particularly highlighted during the formulation of evaluation findings or recommendations.
It is proposed that evaluators need to negotiate such challenges effectively. A credible evaluation is necessary to enable both commissioners of evaluations to make informed decisions and evaluators to produce quality work. The knowledge, skills and experience of the evaluator in attaining a balance between the impact of political and stakeholder influences and interests and delivering credible evaluation findings is critical to the future of evaluation and its utility.
|
|
Organizational Structures and Attitudes Towards Evaluation: An Examination of Contextual Factors That Shape Evaluation
|
| Presenter(s):
|
| Janet Lee, University of California Los Angeles, janet.lee@ucla.edu
|
| Anne Vo, University of California Los Angeles, annevo@ucla.edu
|
| Noelle Rivera, University of California Los Angeles, novari320@hotmail.com
|
| Abstract:
The manner in which evaluations are conducted are often shaped by the context in which they were commissioned. Programs' organizational structures are perhaps the best sources for understanding such contextual impact. In this presentation, we will discuss how the processes and activities of an evaluation for a federally funded educational program have been influenced by differences in organizational contexts. Specifically, we will examine various successes and challenges encountered while conducting an evaluation of small learning community (SLC) implementation at five high schools in a large, urban school district. These successes and challenges of conducting the evaluation will also be discussed in light of general attitudes towards program implementation, evaluation, and decision-making. Data collected through surveys, interviews and focus groups will be used. Understanding how these contextual factors may have impacted the evaluation provides important insight that can be useful for the planning of future evaluations.
|
|
Data Based Discussions: Uncovering the Unexamined Assumptions
|
| Presenter(s):
|
| Micah Fierstein, University of Alaska Anchorage, micah@uaa.alaska.edu
|
| Ed McLain, University of Alaska Anchorage, ed@uaa.alaska.edu
|
| Abstract:
Teacher and evaluator conversations too often appear to be 'loaded' and influenced by participants' silent assumptions and frames. All too often these assumptions are unconsciously held, and unexamined. They are simply taken as granted as 'the ways things are' (Argyris, C.,1974). These silent assumptions can unwittingly constrain, frame, and ultimately debilitate the teachers' and evaluators' perspectives, and the their ability to understand and appreciate the data's underlying meaning. They can limit the teachers' ability to fully appreciate the situation and opportunities at hand - the teachers' role and potential for change and to influence the future. These blind spots undermine the teacher's and team's capacity to change practice - to make a difference. This paper identifies and examines these silent assumptions, and the influence they can have on a team's or individual's data-based meaning making in program review and evaluation.
|
| | |