|
The Mix of Methods: Towards a Framework to Anticipate Validity Threats When Evaluating Agricultural Value Chain Development Interventions
|
| Presenter(s):
|
| Giel Ton, LEI Wageningen UR, giel.ton@wur.nl
|
| Marieke De Ruijter De Wildt, LEI Wageningen UR, marieke.deruijterdewildt@wur.nl
|
| Abstract:
Impact evaluations of value chain interventions are challenging: outcome indicators are often multi-dimensional, impact is generated in dynamic and open systems, and the social embeddedness constraints external validity. Therefore, there is a strong case for theory-based evaluation where a logic model indicates how the intervention is expected to influence the incentives for people’s behaviour. The key assumptions inherent in these casual models can be tested through the observation and measurement of specific outcome indicators using mixed methods in triangulation. The paper presents a framework to evaluate the design of these mixed methods to assess change and impacts in value chain configurations, using the four types of validity threats to the evaluative conclusion. We apply the framework on three impact assessment experiences, we have been involved in, and reflect on the feasibility to improve its methodological design: micro-irrigation technology supply; farmer field schools; business service development.
|
|
Team Process Factors in the Evaluation of a Community-Team-based Entrepreneurial Development Initiative
|
| Presenter(s):
|
| Laurie Van Egeren, Michigan State University, vanegere@msu.edu
|
| Meenal Rana, Michigan State University, ranameen@msu.edu
|
| Diane Doberneck, Michigan State University, connordm@msu.edu
|
| Miles McNall, Michigan State University, mcnall@msu.edu
|
| Abstract:
Creating Entrepreneurial Communities (CEC) was a one-year program designed to provide community teams (N = 9) with assistance, tools, and resources to develop environments supportive of entrepreneurs. Teams, selected through an application process, were provided with an intensive four-day training on the development of entrepreneurial communities and one year of coaching support. The evaluation of CEC used a mixed-method approach that was based on a combination of Neo-Analytic Induction and Qualitative Comparative Analysis by Hicks (1994) and that permitted a summary of both qualitative and quantitative data. The core of this approach was to identify teams as “sustained” or “not sustained” and examine whether differences were evident between the two groups in a model that predicted that the development of positive team processes mediates between the intervention and success. Using this method, several community, team, and programming factors were identified that distinguished between “sustained” and “not sustained” teams.
|
| |