|
Session Title: The Internal and External Context of Evaluation in the Non-profit Sector: Can Evaluation Capacity Building Help Non-profits Move From Accountability to Organizational Learning?
|
|
Panel Session 461 to be held in Panzacola Section H4 on Friday, Nov 13, 9:15 AM to 10:45 AM
|
|
Sponsored by the Non-profit and Foundations Evaluation TIG
|
| Chair(s): |
| Joanne Carman, University of North Carolina at Charlotte, jgcarman@uncc.edu
|
| Abstract:
The purpose of this panel is to highlight the unique context of evaluation in the nonprofit sector and explore the extent to which specific stakeholder groups have an effect on the evaluation expectations and requirements of nonprofit organizations. In this panel, we bring together the authors of the most recent empirical research about the evaluation practices of nonprofit organizations. Our first panelist, Deena Murphy, will discuss the specific organizational characteristics that are associated with using evaluation as an organizational learning tool, as opposed to an external accountability tool. Our second panelist, Sal Alaimo, will discuss the important role of the nonprofit's board of directors. Our third panelist, Laura Pejsa, will present case study research which highlights the extent to which the evaluation requirements of funders tend to drive evaluation capacity building efforts. Our final panelist, Joanne Carman, will explore the role of nonprofit accrediting bodies.
|
|
Context matters: Why it is Critical to Understand the Unique Context for Evaluation in the Nonprofit Sector
|
| Deena Murphy, National Development and Research Institutes Inc, murphy@ndri-nc.org
|
|
Research on the context of evaluation in the nonprofit sector suggests that nonprofits remain primarily focused on collecting evaluation data to be used for accountability purposes. Emerging research suggests that organizational characteristics significantly influence the extent to which evaluation findings are used to support organizational learning rather than simply being a tool for accountability. Deena Murphy will draw on data gathered from 283 nonprofits across North Carolina, as well as her ongoing work in evaluation capacity building with substance abuse and mental health treatment organizations, to examine the changing context for evaluation in the nonprofit sector and highlight the implications for evaluation capacity building interventions. Specifically, she will address: What is the context for evaluation in the nonprofit sector and how is this changing? Who is engaged in the evaluation process and why is this important? What would help nonprofits conduct and use evaluation more effectively?
|
|
|
The Role of the Board of Directors in Setting the Context for Program Evaluation Through Evaluation Capacity Building (ECB)
|
| Salvatore Alaimo, Indiana University, salaimo@comcast.net
|
|
The increasing call for accountability and competition for resources challenges nonprofit organizations with responding to the external pull from funders, government agencies and accrediting bodies while developing an intrinsically motivated internal push to build long-term capacity to evaluate their programs. The Board of Directors is ultimately accountable for the organization and for fulfilling their duty of obedience, duty of care and duty of loyalty.
Salvatore Alaimo will draw on his qualitative study of one-on-one interviews with 20 board chairs, and their executive directors, and two case studies of nonprofit human service organizations to begin to address the following questions:
- How the capacity to evaluate nonprofit programs is impacted by the role of the board?
- Within that role, what motivates the board to engage in and/or support program evaluation? How do their motivations impact capacity?
- What specific actions have boards taken to be successful in ECB?
| |
|
Performance and Quality Improvement Standards: Meaningful Change or Masquerade?
|
| Joanne Carman, University of North Carolina at Charlotte, jgcarman@uncc.edu
|
|
In recent years, researchers have observed that major accrediting bodies are requiring nonprofit organizations to demonstrate that they have plans to monitor and improve the quality of the services that they provide. Moreover, empirical research has indeed suggested that, for some nonprofits organizations, meeting these external expectations and standards is the primary reason for their evaluation activity. In this session, Joanne Carman will explore the following questions: 1) What types of nonprofit organization seeks accreditation, and why? 2) What are the accrediting standards that are related to evaluation and performance measurement? 3) In what ways do these standards affect evaluation practice? 4) What do nonprofit leaders think about these requirements? Are they useful? Or are they just going though the motions? The session will conclude with examples of best practices from organizations that have used these standards to promote evaluation capacity building and cultivate a culture of organizational learning.
| |