| Session Title: Learning From the American Evaluation Association Topical Interest Groups Proposal Review Standards |
| Think Tank Session 307 to be held in Liberty Ballroom Section B on Thursday, November 8, 9:35 AM to 11:05 AM |
| Sponsored by the AEA Conference Committee |
| Presenter(s): |
| Daniela C Schroeter, Western Michigan University, daniela.schroeter@wmich.edu |
| Discussant(s): |
| Chris Coryn, Western Michigan University, christian.coryn@wmich.edu |
| Robert Hanson, Health Canada, robert_hanson@hc-sc.gc.ca |
| Ann Maxwell, United States Department of Health and Human Services, ann.maxwell@oig.hhs.gov |
| Martha Ann Carey, Azusa Pacific University, mcarey@apu.edu |
| Janice Noga, Pathfinder Evaluation and Consulting, jan.noga@stanfordalumni.org |
| Rita O'Sullivan, University of North Carolina, Chapel Hill, ritao@email.unc.edu |
| Elmima Johnson, National Science Foundation, ejohnson@nsf.gov |
| Emiel W Owens Jr, Texas Southern University, owensew@tsu.edu |
| Liesel Ritchie, Western Michigan University, liesel.ritchie@wmich.edu |
| Eunice Rodriguez, Stanford University, er23@stanford.edu |
| John Nash, Open Eye Group, john@openeyegroup.com |
| James Sass, LA's BEST After School Enrichment Program, jim.sass@lausd.net |
| Nino Saakashvili, Horizonti Foundation, nino.adm@horizonti.org |
| Ann Zukoski, Oregon State University, ann.zukoski@oregonstate.edu |
| Heather Boyd, Virginia Tech, hboyd@vt.edu |
| Susan Kistler, American Evaluation Association, susan@eval.org |
| Nicole Vicinanza, American Evaluation Association, nvicinanza@jbsinternational.com |
| Howard Mzumara, Indiana University Purdue University Indianapolis, hmzumara@iupui.edu |
| Otto Gustafson, Western Michigan University, ottonuke@yahoo.com |
| Marcie Bober, San Diego State University, bober@mail.sdsu.edu |
| Tom McKlin, Georgia Institute of Technology, tom.mcklin@gatech.edu |
| Emmalou Norland, Institute for Learning Innovation, norland@ilinet.org |
| Neva Nahan, Wayne State University, n.nahan@wayne.edu |
| Denice Cassaro, Cornell University, dac11@cornell.edu |
| Eric Barela, Los Angeles Unified School District, eric.barela@lausd.net |
| Abstract: Annually, the American Evaluation Association (AEA) calls for submissions to present at its conference. In 2006 alone, more than 1,000 submissions were received and evaluated by AEA's Topical Interest Groups (TIGs). More than two thirds of all proposals submitted to AEA 2006 were reviewed by the TIGs involved in this session. Their review processes reflect on TIG evaluation practices, while posing important questions about standards the professional evaluation community applies to its conference submissions. Reflecting on experiences with reviewing AEA submissions, related challenges and opportunities, expectation of TIGs, and the current AEA program, this Think Tank asks: Do we hold proposals to the same or similar standards across all TIGs? Should we? Are our standards too high or too low? Should reviews be blinded, or not? How do we deal with tensions between inclusion and quality? Do submitters receive constructive feedback? How can reviews be conducted most efficiently? |