|
European Union Rural Development Program 2007-13 in Italy: Meta Evaluative Narratives of Rural Development Programs Ex Ante Evaluations- Focus on Methodologies
|
| Presenter(s):
|
| Vincenzo Fucilli, University of Bari, v.fucilli@agr.uniba.it
|
| Abstract:
Planning and implementation of the European Union policy for rural areas are based on rural development programs. In current regulations, a primary role is also given to evaluation, the aim of which is to improve the quality, efficiency and effectiveness of programs. The paper stems from the observation that a multitude of evaluations of programs are undoubtedly available, whereas there doesn't seem to be the same number of studies and analyses of 'the evaluation' itself, and in particular analyses of evaluations as complex as those of rural development programs. It is a real meta-evaluative exercise that will try to reconstruct the methodological path adopted by evaluators. Through analyses of ex-ante evaluation reports of the 21 Rural Development Programs in Italy, narratives of these evaluations are reconstructed with specific reference to methodological aspects, models and procedures adopted by evaluators. Central interest is on how judgements have been constructed.
|
|
Measuring Empowerment: A Model for Use in Evaluation of Organizations Who Aim to Increase Their Clients' Power
|
| Presenter(s):
|
| Lauren Cattaneo, George Mason University, lcattane@gmu.edu
|
| Aliya Chapman, George Mason University, arazvi@gmu.edu
|
| Abstract:
The compelling concept of empowerment is employed across many fields, including program evaluation. While the meaning of this concept within empowerment evaluation is clear, its use among a wide array of organizations and programs is far less precise. This murkiness in definition means that when an organization includes the empowerment of clients in its mission, the evaluator of this organization is left without a clear roadmap for conceptualization and measurement. This paper describes a model of the process of empowerment, and explains how the evaluator might employ it. The model identifies core components of the empowerment process: personally meaningful and power-oriented goals, self-efficacy, knowledge, competence, action, and impact. Individuals move through the process with respect to particular goals, doubling back repeatedly as experience promotes reflection. When an organization aims to empower its clients, its work related to each component of this process should be the evaluator's focus.
|
|
The Nexus Between Measurement and Evaluation: A Process Evaluation of a Standard Setting Procedure Using Rasch Measurement Theory and Evaluation Theory
|
| Presenter(s):
|
| Jade Caines, Emory University, jcaines@emory.edu
|
| George Engelhard Jr, Emory University, gengelh@emory.edu
|
| Abstract:
Standard setting is an area within applied measurement that involves the specification of a minimal level of performance on a particular task (Cizek, 2001; Crocker and Algina, 1986; Glass, 1978). Within diverse professional fields, panelists consider various levels of examinee performance on an assessment and then determine a cut score that represents minimum proficiency. It is, however, a highly evaluative and policy-driven process that needs further examination within a measurement and evaluation context. Since, human judgment is at the heart of the standard setting process, it follows that evaluation theories should shed light on this oftentimes high-stakes, black box procedure. Therefore, the purpose of this study is to explore various evaluation theories as a context for conceptualizing and improving evaluative judgments obtained from a particular standard-setting method called Body of Work. Data are obtained from a large Midwestern state and cut score judgments are made for two elementary writing assessments.
|
| | |