|
Practice What you Preach: Towards a Theory of Using Program Theory in Evaluation
|
| Presenter(s):
|
| Jan Hense, University of Munich, jan.hense@psy.lmu.de
|
| Abstract:
The notion of using program theory (PT) in evaluation has become a mainstream idea in the evaluation discourse, and numerous supposed advantages are associated with it. Conceptually, it has been argued that evaluation approaches ignoring PT treat their evaluands as black boxes, as they pay no attention to the mediating mechanisms between programs and their outcomes. However, the use of PT in evaluation itself resembles a black box, too, as there exists no coherent theoretical framework which explains the mechanisms between the use of PT and better evaluations. This paper presents such a framework. It combines a process model of evaluation, to identify different functions of PT, with existing models of evaluation influence, to show how these functions can contribute to better evaluations. This work is expected to clarify the different functions of PT for evaluation and to make assumptions on the effects of PT empirically testable.
|
|
Practical Issues for Evaluation Theory and Application
|
| Presenter(s):
|
| Michael Laurendeau, Cathexis Consulting, mlauren@sympatico.ca
|
| Abstract:
Wherever the function exists, evaluation is constrained by a number of government policies related to public management and conditioned by competing practices stemming from the audit function. In order to position evaluation in this overall context, it is useful to remember that evaluation is essentially research activity that tries to measure the impacts of public interventions (policies, programs and initiatives) by establishing causality and dealing with attribution. This should be done by providing proper evidence of the causal relationships that exist, according to strategic plans, along chains of results ranging from inputs to end outcomes. Performance measurement also requires monitoring the implementation of program delivery against operational plans.
The presenter will discuss and clarify the approach to the modelling of chains of results (logic model) and of program implementation (delivery process models) to clarify program assumptions that must tested by program evaluation.
|
| |