|
The Relationship Between Evaluation Quality and Use: A Foundation’s Perspective
|
| Presenter(s):
|
| Rosanna Tran, California HealthCare Foundation, rtran@chcf.org
|
| Abstract:
Funders can play a critical role in how program evaluations are designed and implemented, and consequently, evaluation quality. This paper will present two case studies that examine the experience of the California HealthCare Foundation (CHCF) in defining and promoting evaluation quality. The first, an evaluation of one of CHCF’s early projects, highlights the tensions that can surface when research methods and design, project timeline, and the needs of users are misaligned. The second is a more recent evaluation in which CHCF realized that grantee engagement and input were prerequisites to a high quality evaluation, and worked closely with the grantee and evaluator to ensure that the evaluation addressed questions that were a priority from the grantee’s perspective. From these experiences, CHCF has found that emphasizing utility for intended users often provides guidance on how to prioritize the various aspects of evaluation quality.
|
|
Theory Usage in Nonprofit and Foundation Evaluation: Theorists, Funders and Recipient Perspectives
|
| Presenter(s):
|
| Anne Hewitt, Seton Hall University, hewittan@shu.edu
|
| Charles Gasper, Missouri Foundation for Health, cgasper@mffh.org
|
| Abstract:
To improve the quality of nonprofit and foundation evaluations, a three-phase initiative was developed to identify, introduce and disseminate evaluation theories to aid grant recipients in project evaluation design. In phase one, a Delphi study of senior evaluation theorists will provide a scholarly foundation for the choice of appropriate theoretical approaches and models. For phase two, a randomized survey of current funders will help identify their familiarity and competency level with the suggested theories. Finally, for phase three, a survey of current nonprofit grant recipients from several diverse foundations provides a baseline comparison for theory usage and proficiency. This session presents commonalities and differences among surveyed groups and provides recommendations for improving evaluation quality via theory integration.
|
|
The Role of the Funder in Evaluation Capacity Building for Nonprofit Human Services Organizations
|
| Presenter(s):
|
| Salvatore Alaimo, Grand Valley State University, alaimos@gvsu.edu
|
| Abstract:
The increasing call for accountability and competition for resources challenges nonprofit organizations with responding to the external pull from funders, government agencies and accrediting bodies to build long-term capacity to evaluate their programs. These external stakeholders who typically hold the resources nonprofits require for satisfying their missions and ultimately for survival are in a position to impact the evaluation capacity of their funding recipients.
Salvatore Alaimo will draw on his qualitative study of one-on-one interviews with 20 funders of various types to begin to address the following questions:
• How a nonprofit organization’s capacity to evaluate its programs is impacted by external funders?
• Is there variance in funder and recipient’s perceptions and understanding of program evaluation?
• How do funder requirements and relationship dynamics impact a nonprofit organization’s evaluation capacity?
|
|
Fostering and Measuring Nonprofit Networks to Inform Grantmaking Decisions
|
| Presenter(s):
|
| Patricia Zerounian, Montgomery County Health Department, zerounianp@co.monterey.ca.us
|
| Janet Shing, Community Foundation for Monterey County, janet@cfmco.org
|
| Jeff Bryant, Community Foundation for Monterey County, jeff@cfmco.org
|
| Krista Hanni, Montgomery County Health Department, hannikd@co.monterey.ca.us
|
| Abstract:
When the David and Lucile Packard Foundation awarded a grant to implement and strengthen nonprofit networks, it was part of a larger philanthropic inquiry: Could knowing how networks connect, share, and mobilization teach foundations how to be more effective sponsors of community change? How might the impacts of social networks transform grantmaking and program development?
Evaluators investigated four newly-formed nonprofit networks using two comprehensive evaluation plans – one to test the effectiveness of introducing networking to diverse community groups, and another to test the transforming impact of these networks on grantmaking decisions. Network members answered survey questions in five categories of network function: affinity to network concepts; learning/contributing; network cohesion; increased effectiveness; and network technology. These categories directly corresponded to answers the foundation sought. An analysis of the networks’ Google Group activities measured group member engagement. Group interviews with emergent leaders of the four networks added qualitative content.
|
| | | |