|
Systems Approach and Mixed Methods in Evaluation Within a Collaborative Context
|
| Presenter(s):
|
| Jianglan White, Georgia Department of Community Health, jzwhite@dhr.state.ga.us
|
| Dafna Kanny, Centers for Disease Control and Prevention, dkanny@cdc.gov
|
| Abstract:
This paper introduces a system strategy for transforming evaluation into a collaborative and participatory process, with a special emphasis on how to engage program stakeholders in evaluation planning, implementation and dissemination. Modeled on an application of the Model for Collaborative Evaluations (Collaborative Evaluations by Liliana Rodríguez-Campos, 2005) and on the CDC Framework for Program Evaluation (http://www.cdc.gov/eval/framework.htm), the paper provides practical, step-by-step suggestions on how to apply such conceptual approaches to a real world evaluation practice. It demonstrates a collaborative and mixed methods evaluation of a state-wide multi-level obesity prevention initiative, which addresses physical inactivity, poor nutrition, and obesity, through policy, environmental support strategies for behavior changes within a social-ecological context. In addition, the paper will introduce cross-setting mixed data analysis methodologies (both quantitative and qualitative) which were employed in the evaluation, in particular, how to measure health related objectives and outcomes, particularly intermediate outcomes.
|
|
Assessing Collaborative Functioning: Identification of Factors Associated With Longevity and Perceived Effectiveness
|
| Presenter(s):
|
| Ann Peisher, University of Georgia, apeisher@uga.edu
|
| Virginia Dick, University of Georgia, vdick@cviog.uga.edu
|
| Amy Laura Arnold, University of Georgia, alarnold@uga.edu
|
| Robetta McKenzie, Augusta Partnership for Children Inc, rmckenzie@arccp.org
|
| Katrina Aaron, Augusta Partnership for Children Inc, kaaron@arccp.org
|
| Don Bower, University of Georgia, dbower@uga.edu
|
| Abstract:
In an effort to reduce duplication and maximize resources, collaboration is often a requirement of grant funding; therefore, frequently collaboratives are formed for specific purposes and survive only for the duration of the funding period. Typically, real world community issues and problems outlive the specific streams of funding and the associated collaborative; however, there are some exceptions to the short lived collaborative. In the present study, the collaborative framework developed by Berstrom, Clark, Hogue, Iyechad, Miller, et al.(1995) is used as the theoretical basis of a mixed-method collaborative functioning assessment that studies the factors associated with a collaborative with over 20 years tenure. Data and analysis included document review, researcher-developed survey (N=94), and key informant interviews (N=8). There is significant congruence between the methods of assessment and a surprising history of resource sharing that is a probable key to the current level of commitment and continued cooperation.
|
|
Evaluating and Enhancing Inter-agency Collaboration and Project Outcomes Using Social Network Analysis Within a Mixed Methods Design
|
| Presenter(s):
|
| Debra Heath, Albuquerque Public Schools, heath_d@aps.edu
|
| Jennifer Cross, Colorado State University, jeni.cross@colostate.edu
|
| Abstract:
This paper describes how Social Network Analysis is used within a mixed methods design to evaluate changes in school-community partnerships as well as the impacts of those changes on student health, safety and performance. Social network data are collected not only to measure changes over time in the structure of inter-agency relationships, but also to engage stakeholders in concrete discussions about collaboration, including what level of collaboration each partner needs to have with each of the others in order to achieve desired project outcomes. Numeric ratings of inter-agency linkages and narrative descriptions are collected in group sessions and via individual surveys and interviews. Results are depicted in visually powerful network diagrams that validate stakeholder efforts and reveal structural ‘holes’ that must be filled with new or expanded relationships. These methods provide highly reliable information about collaboration development and also energize stakeholders around concrete improvement plans.
|
| | |