Return to search form  

Session Title: Educational Technology: Evaluation Opportunities
Multipaper Session 802 to be held in Chesapeake Room on Saturday, November 10, 12:10 PM to 1:40 PM
Sponsored by the Distance Ed. & Other Educational Technologies TIG
Chair(s):
Shani Reid,  Macro International Inc,  shani.a.reid@orcmacro.com
It's not Just Fun and Games: Evaluating Games in the Classroom
Presenter(s):
Shani Reid,  Macro International Inc,  shani.a.reid@orcmacro.com
Helene Jennings,  Macro International Inc,  jennings@macroint.com
Betsy Peisach,  Maryland Public Television,  bpeisach@mail.mpt.org
Abstract: There has been increased interest in educational computer games as educators, researchers, and scientists work together to take advantage of the opportunities games provide to enrich the learning experiences of the multimedia generation. One factor hindering the expansion of educational games to the classroom however is the lack of evaluative data that demonstrates the effectiveness of these games. Macro International has the opportunity to advance research in this area through evaluating Maryland Public Television's 5-year grant to develop a series of games focused on pre-algebra skills. In this presentation we will highlight the integral role evaluation plays in educational computer games designed for use in the classroom. We will discuss techniques and findings from various evaluation methodologies employed, including observations of teachers using games in the classroom and prototype testing. We will also discuss our plans for Randomized Controlled Trials in subsequent years.
Evaluative Learning and Technology Use in Educational Innovation Programs
Presenter(s):
Juna Snow,  InnovatEd Consulting,  jsnow@innovatedconsulting.com
Abstract: This paper discusses evaluation design issues for three process evaluations of technology programs in educational settings. These innovations, idealizations of betterment typically based on pre-existing processes, intended to change prior processes. New programs, as well as new technologies, necessitate formative, diagnostic evaluation because designers can not predict fully in what ways participants will make use of and benefit from the program innovations. In each of the three cases, the programs implemented technology innovations with goals to create teacher change and transform practice. Specific evaluation design and methods used are discussed to illustrate the framework introduced in this paper. Moreover, this paper demonstrates how the technological nature of the innovations provided the medium and tools for data collection. The evaluative learning about the evaluand was fostered and shared with clients and stakeholders in each case as part of the methodology framework presented in the paper.
Evaluation of the Computer's Efficacy in Education
Presenter(s):
Paul Lorton Jr,  University of San Francisco,  lorton@usfca.edu
Abstract: Does the computer as an educational tool help or hinder the educational effort? We know that the answer really depends on the substantive question being asked – and evaluation of efficacy in any domain depends on how we define efficacy. In this survey, the focus is on how the evaluation of this at once too costly and too necessary educational technology has been shaped over the almost fifty years of effort in the field, and what we have learned as evaluators and from the evaluations. Starting with the early efforts in the 1960's where the bar was set at a fairly low self fulfilling level to the most recent efforts to tease out the always subtle but real effects, the discussion will follow threads in the affective and effective domains while glancing often at the parallel state of other technologies used in education.
Search Form