|
Credible judgment in program evaluation: evaluators encounter stakeholders
|
| Presenter(s):
|
| Marthe Hurteau, University of Quebec, Monteral, hurteau.marthe@uqam.ca
|
| David Williams, Brigham Young University, david_williams@byu.edu
|
| Marie-Pier Marchand, University of Quebec, Montreal, mariepiermarchand@hotmail.com
|
| Abstract:
For an evaluation to successfully make credible judgments of the quality of a program, it should be valid and believable to stakeholders. This presentation summarizes research conducted to develop a coherent model of required elements and processes in evaluations to generate such credible judgments. The first presenter will briefly summarize this model and associated research results, focusing on the essential encounter between the evaluator and stakeholders. The specific contributions of the stakeholders will be highlighted. The second presenter will illustrate the model and results using a case story. Both presenters will emphasize the importance of understanding and responding to multiple stakeholders' values in facilitating valid and credible judgments by them rather than imposing a judgment based only on values of external evaluators. Planned steps for future research will be offered and discussion invited.
|
|
Emergent, Investigative Evaluation: Theory, Development, and Use in Evaluation Practice
|
| Presenter(s):
|
| Nick Smith, Syracuse University, nlsmith@syr.edu
|
| Abstract:
The prevalent view of evaluation as the use of pre-ordinate, confirmatory studies to assess program impact overshadows a powerful alternative, the use of emergent, investigative evaluations in natural settings to uncover unknown influences, hidden value, and overlooked alternatives. Further, emergent, investigative approaches are better suited to the evaluation of dynamic, developmental, or largely unknown programs. This paper reviews the current state of work on emergent, investigative evaluation approaches, addressing issues of (1) conditions of use, (2) types of designs, (3) the emergent design process and relevant decision-rules, (4) the nature of evidence produced, and (5) criteria for judging the quality of emergent, investigative evaluations. Prior work in evaluation is reviewed as well as related approaches employed outside evaluation and characterized variously as 'developmental research', 'design research', and 'design-based research'. Emergent, investigative evaluation approaches are also contrasted with somewhat related approaches such as formative assessment and developmental evaluation.
|
| |