|
The Impact of Participant Feedback on Program Outcomes: A Program Evaluation Consideration
|
| Presenter(s):
|
| Candace Lacey, Nova Southeastern University, clacey@nova.edu
|
| Barbara Packer-Mutil, Nova Southeastern University, packerb@nova.edu
|
| Jennifer Reeves, Nova Southeastern University, jennreev@nova.edu
|
| Abstract:
Athletic coaches have long recognized the importance of feedback on performance. Translating this concept to the field of program evaluation, this presentation focuses on the role of feedback on survey participants’ level of engagement/job satisfaction. Findings from a 3-year study conducted at Nova Southeastern University in collaboration with the Gallup Organization indicated that sharing feedback on prior year’s data played a significant role in increasing employee engagement scores. This presentation focuses on the method of data collection, findings, dissemination, and outcomes of a 3-year initiative to measure employee engagement.
|
|
Using Appreciative Inquiry Focus Groups to Engage Members in Planning for the National Network of Libraries of Medicine Middle Atlantic Region
|
| Presenter(s):
|
| Sue Hunter, New York University, sue.hunter@med.nyu.edu
|
| Cynthia Olney, National Network of Libraries of Medicine, olneyc@coevaluation.com
|
| Abstract:
This paper will report on a focus group project conducted by a regional office of the National Network of Libraries of Medicine (NN/LM) that used an Appreciative Inquiry (AI) approach. Funded through the National Library of Medicine, NN/LM is a nationwide network of health sciences libraries and information centers (called “network members”) with the goal of advancing the progress of medicine and improving public health through equal access to health information. The focus groups were conducted to gather input from representatives of the network members supported through the NN/LM Middle Atlantic Region (MAR) to serve the health information needs of a four-state region (Delaware, New Jersey, New York, and Pennsylvania). This paper will highlight the process that was implemented and the advantages of the AI approach, including high levels of staff participation, efficient use of staff resources, and quality of the collected data.
|
|
Meta-evaluation Quality in Brazil: A Mamdani Hierarchical Fuzzy Inference System
|
| Presenter(s):
|
| Ana Carolina Letichevsky, Cesgranrio Foundation, anacarolina@cesgranrio.org.br
|
| Thereza Penna-Firme, Cesgranrio Foundation, therezapf@uol.com.br
|
| Abstract:
This paper presents a meta-evaluation system that makes use of fuzzy sets and fuzzy logic concepts. It comprehends a data collection instrument and a Mamdani (1974) hierarchical fuzzy inference system. The advantages of the proposed system are: the instrument, which allows intermediate answers; the inference process ability to adapt to specific needs; transparency, through the use of linguistic rules that helps both the understanding and the discussion of the whole process. The rules are based on guidelines established by the Joint Committee on Standards for Educational Evaluation (1994) and also represent the view of Brazilian experts. In Brazil there is a great concern about evaluation quality. However the meta-evaluation concept is new. The system here presented can provide support to evaluators that may lack experience in meta-evaluation, which is the situation in some developing countries as Brazil. A discussion of two case studies both in the educational area is included.
|
| | |