|
Session Title: Using Emerging Technologies to Improve Evaluation Practice Across Contexts
|
|
Panel Session 550 to be held in Sebastian Section I4 on Friday, Nov 13, 1:40 PM to 3:10 PM
|
|
Sponsored by the Research on Evaluation TIG
|
| Chair(s): |
| Stewart Donaldson, Claremont Graduate University, stewart.donaldson@cgu.edu
|
| Discussant(s):
|
| Susan Kistler, American Evaluation Association, susan@eval.org
|
| Abstract:
These panel presentations look beyond familiar off-the-shelf web-based applications to a variety of emerging technologies that are changing the way evaluators work. Findings from investigations and applications of specialized software tools will be described and demonstrated, including (1) software that supports the development of complex conceptual frameworks, theories of change, and program theories to guide evaluation practice; (2) software that enables evaluation communication, reporting, and teaching at a distance across dispersed contexts, (3) applications of user-friendly (and free) GIS tools for improving evaluation, (4) research on a web-based visual survey tool that collects program theories that are used to characterize and better understand diverse perspectives; and (5) findings from the application of technologically-oriented tools in alignment with the principles of empowerment evaluation, fostering improvement, capacity building, and accountability.
|
|
Using New Technologies to Better Address Context, Complexity, and To Build Evaluation Capacity
|
| Shabnam Ozlati, Claremont Graduate University, shabnam.ozlati@cgu.edu
|
| Stewart Donaldson, Claremont Graduate University, stewart.donaldson@cgu.edu
|
|
As evaluation as taken on more complex interventions and evaluands, parsimonus logic models, program theories, and conceptual frameworks have become more difficult to develop. In this presentation, we will illustrate some of the latest breakthroughs in capturing context and multiple levels of complexity in evaluation practice. Insights and findings from investigating the use of complex, interactive conceptual frameworks enhanced by software to improve complex evaluations will be discussed. In addition, new software to improve communicating and reporting evaluation findings, as well as teaching evaluation from a distance across diverse contexts will be explored. A special emphasis will be placed on demonstrating how these new technologies can be used to build evaluation capacity.
|
|
|
How to Utilize User-Friendly and Free Geographic Information System (GIS) Tools for Evaluation Practice
|
| Tarek Azzam, Claremont Graduate University, tarek.azzam@cgu.edu
|
|
This presentation will focus on the application of user-friendly (and free) GIS tools for evaluation practice. Many of the existing GIS software packages require large commitments of time and money to fully utilize, but there are accessible web-based programs such as MSN Live(tm) Maps and Google(tm) Maps that can provide evaluators with powerful mapping abilities to represent complex contexts. Although this type of software is constantly evolving with new features being added, many evaluators have yet to tap into its full potential. These tools can be used to geographically represent program impact, program evolution, and the stories that emerge from different locations. Examples will be offered to demonstrate the various applications of these tools, along with information on how access and utilize each of them.
| |
|
A Visual Program Theory Survey Tool
|
| John Gargani, Gargani + Company, john@gcoinc.com
|
|
Each of us has our own explanation for why a program or policy will work (or fail). In many respects, it is the degree of difference in those explanations that determine the degree of controversy that program staff and policymakers face. This presentation describes an investigation of a web-based visual survey tool that collects program theory diagrams from a large number of stakeholders. The resulting diagrams are then used as data in order to characterize the diverse perspectives of individuals, the degree of consensus within and across groups, and other cognitive characteristics of respondents. An example from its application in the field will be provided.
| |
|
Empowerment Evaluation: Technological Tools of the Trade
|
| David Fetterman, Fetterman & Associates, fettermanassociates@gmail.com
|
|
Empowerment evaluation is an approach to evaluation that is designed to facilitate participation, collaboration, and empowerment. There are many tools used to conduct an empowerment evaluation. A few technological tools of the trade are discussed in this presentation. They include: collaborative web sites, videoconferencing on the Internet, blogging, online surveys, Google Docs and Spreadsheets, and sharing digital photographs on the Internet. The overriding principle guiding the use of technologically-oriented tools is that they are in alignment with the principles of empowerment evaluation, fostering improvement, capacity building, and accountability.
| |