THURSDAY, NOVEMBER 5, 1998
9:45 AM to 11:15 AM

back.gif (804 bytes)

Site Visit:  Please note that a special site visit to Cook County Hospital has been arranged for departure at 9:30.  For more information, please see Session 37.

SESSION 40:  PRESIDENTIAL STRAND - PANEL SESSION SALON A
Sponsored by the Topical Interest Group on Feminist Issues

Stakeholders' Perceptions: Whose Views Count and How Do We Take Them Into Account?

Chair: Katherine Ryan, University of Illinois at Urbana
Panelists: Voices in Conversation, Jennifer Greene, Cornell University
   The Deliberative Democratic View, Ernest House & Ken Howe, University of Colorado at Boulder
   Pragmatism and Privilege: Means to an End?"  Jean A. King, University of Minnesota
Discussants: Katherine Ryan, University of Illinois at Urbana
  Thomas Schwandt, Indiana University

 

SESSION 41:  PAPER SESSION SALON B
Sponsored by the Topical Interest Group on Theories of Evaluation

Theoretical Perspectives on Valuing, Evaluation Reasoning, Evaluation Impact, and Professionalism

Chair: Deborah Fournier, Boston University
Presenters: The Entity Called Program Evaluation: The Logic Based on Which Evaluators View Evaluation as a Profession, Shahpar Modarresi, Diana L. Newman & Mitch Y. Abolafia, State University of New York at Albany
  Program Evaluation and the Theory of Organizational Effectiveness, Lawrence B. Mohr, University of Michigan
   Apprehending Connections: Naturalistic Generalization Versus Investigative Insight?, Nick L. Smith, Syracuse University
Discussant: Abraham Wandersman, University of South Carolina

 

SESSION 42:  PANEL SESSION SALON C
Sponsored by the Topical Interest Group on Program Theory and Theory-driven Evaluation

The Promise of Program Theory Evaluation: What's Been Delivered

Chair: Patricia J. Rogers, Harvard University
Panelists: Using Program Theory Evaluation to Replicate Successful Programs, Timothy A. Hacsi, Harvard University
   Filling in the Black Box: A Shared Understanding Between Evaluators and Program Staff, Tracy A. Huebner, Harvard University
   How Theory-based Evaluation Can Help Research Synthesis: Exploiting Intermediate Links, Anthony J. Petrosino, Harvard University
   Answering Questions About Causal Attribution, Patricia J. Rogers, Harvard University
Discussant: Leonard Bickman, Vanderbilt University

 

SESSION 43 ROUNDTABLES SALON D

Full Session:  9:45 AM to 11:15 AM

Table A: Evaluating  Collaborative Capacity Building Initiatives for Prevention and Health Promotion: Part II:  Working in Reality (Continued from Part I, Session 39)

Sponsored by the Topical Interest Groups on Alcohol, Drug Abuse, and Mental Health, and Collaborative, Participatory, and Empowerment Evaluation
Facilitator: David M. Chavis, Association for the Study and Development of Community
Participants: Linda Bowen, National Funding Collaborative on Violence Prevention
  Julie Chambliss, EMSTAR Research, Inc.
  Paul Florin, University of Rhode Island and Brown University
  Cheryl N. Grills, Loyola Marymount University
  Kien Lee, Association for the Study and Development of Community

Tables B&C: Evaluating Educational Technology Applications in the Real World

Sponsored by the Topical Interest Group on Distance Education and Other Educational Technologies
Host: Daniel Matthews, University of Illinois at Springfield
Presenters: Exploring the Utility of Hall et al.'s Concerns-based Adoption Model for Evaluating Educational Technology Development, Mark Hawkes, North Central Regional Educational Laboratory
  The Role of Evaluation in Becoming Better Distance Educators, Maria Hruby Moore & Rosemary McMasters, The Ohio State University
  Technology, Teaching, and Learning in Iowa High Schools, Nancy J. Maushak, Lynn Manternach-Wigans & Caryl Bender, Iowa State University
  Evaluation of Satellite-based Training for Teachers, Parents and Caregivers, Aimin Wang, Christopher R. Wolfe & Doris M. Bergen, Miami University

HALF SESSIONS:  9:45 AM to 10:30 AM

Table D: Evaluation of Community Health Promotion Grants in Central Alberta

Presenter: Neale Smith, David Thompson Health Region

Table E: Evaluation of the Internet as a Means for Creating a Community of Learners in the Arts

Presenters: C. Eric Kirkland & Alicia R. Williams, COSMOS Corporation

Table F: HIV/AIDS Education for Recent Hispanic Immigrants: A Data Collection Method That Works

Presenters: Mirta T. Londero, National American Red Cross

Table G: The Virginia Effective Practices Project: Accountability Through Empowerment

Presenters: Anne J. Atkinson & Jeanne Martino-McAllister, James Madison University

Table H: Evaluation of Training and Workshops

Presenters: Responding to Mid-way Evaluations Creates a Win-win Experience for Everyone, Jacqueline E. LaMuth, Ohio State University
  Evaluation of Training of VBA Letter Writers, Robert E. Stake, University of Illinois; and William Platt, Veterans Benefits Administration

Table I:  Evaluation in the Policy Arena

Presenters: Transforming Society Through Welfare Reform: The Role of Evaluation Research, Ted Goertzel, Rutgers University at Camden
  Using ITMRA to Link Performance Measures to Strategic Planning, Laurence Wolfe, General Services Administration

Table J: Evaluation Design for a Vermont Community Based Initiative

Sponsored by the Topical Interest Group on State and Local Government
Presenter: Deborah Brown, Independent Consultant

Table K: Social Service Privatization: Emerging Challenges and Recent Results in Child Support Enforcement

Sponsored by the Topical Interest Group on State and Local Government
Presenters: Mark Ward & Chris Morehouse, U.S. General Accounting Office

Table L: The Role of Evaluation in Collaborative Integrated Services Initiatives

Sponsored by the Topical Interest Group on State and Local Government
Presenters: Marijo Wunderlich & Patricia Seppanen, University of Minnesota

Table M: Sentinel Community Surveillance: A Case for Decentralization in Pakistan

Sponsored by the Topical Interest Group on State and Local Government
Presenter: Abdul Alim, United Nations Children's Fund (UNICEF)

Table N: Did the National Study of Law Enforcement Interoperability Make Any Difference?

Sponsored by the Topical Interest Group on Crime and Justice
Presenter: Mary Jean Taylor, Independent Consultant

Table O: Evaluating the Aesthetic Face of Leadership

Presenters: Theresa Souchet & Linda Hamman Moore, University of Illinois at Urbana-Champaign

Table P: Student Assessment

Presenters: Context Enriched Report Cards, Margaret E. Ross & Cynthia Reed, Auburn University
  Statewide Outcomes Assessment of the Alabama Department of Education Requirement That Teachers Receive Training in Student Evaluation, Monika Schäffner & Judith A. Burry-Stock, University of Alabama

Table Q: Evaluation in Federal Human Resource Demonstration Projects: Empirical Evidence for Innovation and Policy Change

Presenter: Dee Ann Batten, U.S. Office of Personnel Management

Table R: Evaluation and School Reform

Presenters: Year Three Results From a Longitudinal Evaluation of Block Scheduling in a "High Performance" High School, Astrid Hendricks-Smith & William E. Bickel, University of Pittsburgh
  Evaluating School Reform Efforts Aimed at Improving Outcomes for Children With Emotional and Behavioral Disabilities, Krita Kutash, University of South Florida

Table S: Policy Analysis and Program Evaluation of the National Literacy Program in Namibia

Presenter: H.S. Bhola, Indiana University

HALF SESSION:  9:45 AM to 10:30 AM

Table D: Standard Bearers in Educational Evaluation

Presenters: State Level Program Evaluation Requirements for School Counselor Certification, Michael S. Trevisan, Washington State University
  Design Considerations for Evaluating the West Alabama Learning Coalition: Thinking Ahead to Proposed NCATE Standards, Cynthia Reed & Margaret E. Ross, Auburn University

Table E: Student Retention - A University's Perspective

Sponsored by the Topical Interest Group on Assessment in Higher Education
Presenters: Jeana Locke, Katye Perry & Janice Williams, Oklahoma State University

Table F: Use and Misuse of Data Envelopment Analysis

Presenter: William G. Ludwin, Indiana-Purdue University Fort Wayne

Table G: Going Virtual: One Company's Experience With Moving Business Online

Sponsored by the Topical Interest Group on Business and Industry
Presenter: Michal Galin, Cornell University

Table H: Using Program Theory to Understand International Education

Sponsored by the Topical Interest Group on International and Cross-cultural Evaluation
Presenter: Jeanette Colby, University of Minnesota

Table I: A Draft Version of the Minnesota Evaluator Competencies: A Guide for Professional and Program Development?

Presenters: Gail Ghere, Jane Minnema, Laurel Stevahn & Jean A. King, University of Minnesota

Table J: Evaluating Systemic Education Reform

Presenters: Systemic Reform, Comprehensive Evaluations: Designs and Findings of Empirical Research on District-wide Educational Change, William E. Bickel & Catherine Awsumb Nelson, University of Pittsburgh
  Evaluating the Implementation of Systemic Education Reform in Pittsburgh, Catherine Awsumb Nelson & William E. Bickel, University of Pittsburgh

Table K: Working with Teen Pregnancy Prevention Programs

Presenters: Raising Your Program Staff's Research IQ: Lessons Learned From a Multi-site Evaluation, Eleanor R. Hall, Ounce of Prevention Fund
  Qualitative Methods in the Evaluation of a Community-based Teen Pregnancy Prevention Program: Youth Narratives in Context, Yolanda G. Martinez, Orange County Health Department

Table L: Evaluating Health Programs in Context

Sponsored by the Topical Interest Group on Health Evaluation
Presenters: Community Health Care Needs Assessment: Whose Health? Whose Needs?, Pauline E. Ginsberg, Utica College of Syracuse University
  The Value of the Determinants of Health Model in Program Evaluations, Anita Kothari, McMaster University

Table M: Evaluating Child-focused Programs

Presenters: Systems of Support for Children at Risk: Evaluating a Child Welfare Reform Initiative, Constance M. Lehman, Portland State University
  A Cost-benefit Evaluation of Three Early Childhood Special Education Programs, David W. Quinn, North Central Regional Educational Laboratory

Table N: Working With Programs Attempting to Reduce Substance Abuse

Sponsored by the Topical Interest Group on Alcohol, Drug Abuse, and Mental Health
Presenters: Longitudinal Study: The Effectiveness of a Normative Media Compaign in Reducing Freshmen Substance Abuse, Stacie Hudgens & Peggy Glider, University of Arizona
  Research & Evaluation: Changing University Policy for Students, José L. Santos & Peggy Glider, University of Arizona

Table O: Setting Program-performance Standards: What Program Evaluators Can Learn From the Testing and Assessment Literature

Presenter: Paul R. Brandon, University of Hawai'i at Manoa

Table P: Evaluation of Computer-assisted Instructional Technology: Addressing the Need for and Development of a Process for Evaluating Content

Sponsored by the Topical Interest Group on Computer Use in Evaluation
Presenters: Leslie Ann Bliss & Dianna L. Newman, State University of New York at Albany

Table Q: Using Classroom Observations to Develop Case Studies of Teachers' Implementation of Integrated Curriculum

Sponsored by the Topical Interest Group on Qualitative Methods
Presenters: Joan Peterson & Mahna Schwager, WestEd; and Jody McCarthy, California State Department of Education

Table R: Dissemination of Evaluation Findings Throughout the American Cancer Society: Increased Potential for Use and Misuse

Presenter: Eden Avery, American Cancer Society

Table S: Evaluation Students Doing Evaluations: An Experiential Component of a Program Evaluation Class

Sponsored by the Topical Interest Group on Teaching Evaluation
Presenters: Heather Becker & Jeff Cookston, University of Texas at Austin

 

SESSION 44:  PANEL SESSION SALON E

The American Cancer Society's Collaborative Evaluation Fellows Project: A Practical Collaborative Training Model for Community-Based Non-profits

Chair: Don Compton, American Cancer Society
Panelists: Don Compton, American Cancer Society  (Framing the story)
  Michael Quinn Patton, Utilization-focused Information and Training (Framing the story)
  Michael Baizerman, University of Minnesota
  Debbie Bonnet, D. Bonnet Associates
  Robin Lackey, University of New Mexico
  Hallie Preskill, University of New Mexico

 

SESSION 45:  TECH TALKS SALON F
Sponsored by the Topical Interest Group on Computer Use in Evaluation

a. Replacing Traditional Paper-based Evaluation Tools with an Interactive CD-ROM (9:45 -10:25 AM)

Presenters: Abbie Brown, Timothy Green & David Zatz, Indiana University

b. Paperless Survey Administration Over Local Area Networks (10:35 - 11:15 AM)

Presenter: Edward C. Siegel, Center for Evaluation Research

 

SESSION 46:  PERFORMANCES SALON G
Sponsored by the Topical Interest Group on Collaborative/Participatory & Empowerment Evaluation

a. Nine Years of Outcomes-focused Evaluation for Local Collaborations Serving Youth in "High Risk" Neighborhoods-OR Why Do We Know So Little About What Happened to the Kids? (9:45 -10:25 AM)

Presenters: Cindy Roberts-Gray & Laura Acuna Zavalney, Resource Network

b. From Research to Reflection: Using Performance as a Re-presentation of a Participatory Evaluation (10:35 - 11:15 AM)

Presenter: Leslie Goodyear, Cornell University

 

SESSION 47:  DEMONSTRATION SALON H
Sponsored by the Topical Interest Group on Evaluation Use

Patterns & Spells: New Approaches to Conceptualizing Children's Out-of-Home Placement Experiences

Presenters: Melissa A. Barker & Gene Lyle, Ramsey County Department of Human Services
Discussant: Charles Lindsey Usher, University of North Carolina at Chapel Hil

 

SESSION 48:  PAPER SESSION DENVER
Sponsored by the Topical Interest Group on Teaching Evaluation

Theory Versus Practice: Implications for Teaching Evaluation

Chair: Leslie J. Cooksy, University of Delaware
Presenters: Evaluators' Perspectives on Research Assumptions: Implications for Professional Education and Practice, Kathleen A. Bolland, University of Alabama
  Working Effectively With Program Stakeholders in Participatory Evaluation, Anna F. Lobosco, NYS Developmental Disabilities Planning Council, Dianna L. Newman, State University of New York at Albany
  Fragmentation of Evaluation Practice and the Implications for Teaching Evaluation at the University Level: What to Teach and Why, Rhonda Riherd Trautman, University of Arizona
Discussant: John Owens, University of Melbourne

 

SESSION 49:  PANEL SESSION HOUSTON
Sponsored by the Topical Interest Group on Crime and Justice

Use of Risk & Protective Factors: Choosing, Delivering & Evaluating Social Services

Chair: Richard D. King, Jr., Vanderbilt University
Panelists: Using Risk & Protective Factors in Evaluating a Community's System of Social Services, Teresa Carlo, Western Michigan University
   Risk Factors & the Limits of Intervention for Marijuana Use, James H. Derzon, Vanderbilt University
   Risk & Protective Factor Assessment as a Tool for Case Management & Outcomes Evaluation in Juvenile Justice Systems, Richard D. King, Jr., Vanderbilt University
   Using Risk Factor Data to Guide Federal Youth Initiatives, Paul Kingery, George Washington University

 

SESSION 50:  PAPER SESSION KANSAS CITY

Mixed Method Approaches in Education

Chair: Jane Schleisman, University of Minnesota
Presenters: A Conceptual Framework for Evaluating Student-Related Outcomes of Tech-prep Programs: A Mixed Method Approach, Steven R. Aragon, K. Peter Kuchinke & Debra Bragg, University of Illinois at Urbana-Champaign
  A Mix Method Approach for Validating Nine Learning Style Instruments for Use with Native American Adult Learners, Steven R. Aragon, University of Illinois at Urbana-Champaign
  The Role of Evaluation in Student Achievement of the National Science Education Standard: Policy and Practice, Douglas Huffman, University of Minnesota

 

SESSION 51: PANEL SESSION LOS ANGELES

Scope & Status of GPRA

Chair: Christopher Wye, National Academy of Public Administration
Panelists: TBD

 

SESSION 52:  PAPER SESSION MIAMI
Sponsored by the Topical Interest Group on Program Theory and Theory-driven Evaluation

Extending the Horizons of Theory-driven Evaluation

Chair: Stewart I. Donaldson, Claremont Graduate University
Presenters: Collaborative Development of a Theory-based Student Assessment for a Violence Prevention Program, Norm Constantine & Kathleen Curry, WestEd
  So What's the Final Verdict? Synthesizing Results From Theory-based Evaluations of Multi-faceted Programs, E. Jane Davidson, Claremont Graduate University
  Managing Evaluation Anxiety, Stewart I. Donaldson & Laura E. Gooler, Claremont Graduate University
  Leveling the Research Playing Field Between Consumer/Survivors and Mental Health Researchers: The Coexistence of Weeds and Crops, Barbara Lee, Louis de la Parte Florida Mental Health Institute; Dianne Cote, P.E.E.R. Center, Inc.; Sally Clay, Consumer Advocate; and Frederick L. Newman, Florida International University
  Let Us Open the Box! Transforming Society by Illuminating Program Process: Integration of Local Program Theory and Interpretivism During Program Evaluation, Kathryn A. Sielbeck-Bowen, Cornell University

 

SESSION 53:  PANEL SESSION SCOTTSDALE
Sponsored by the Topical Interest Group on Evaluation Use

The Chicken and the Egg: Evaluation Demand and Use in Learning Organizations

Chair: Belle Brett, City Year, Inc.
Panelists: A Learning Organization's Relationship with Evaluation, Patti Bourexis, The Study Group; and Joyce Kaser, Kaser and Associates
   Building Skills, Creating Demand at the Grass Roots, Belle Brett, & Ivy Jones, City Year
   Evaluation Use at the National and Site Levels: Challenges and Successes, Stephanie Wu & Lynnae Hill-Meade, City Year
   Creating a Hunger for Data, Kristin Powell & Marc Hahn, Teachers' Academy for Mathematics and Science
   Developing the Core Competency of Reflective Practice, Joseph Frattaroli, Hosanna Mahaley & Jeanne Brady, Teachers' Academy for Mathematics and Science
Discussant: Rosalie Torres, Developmental Studies Center

 

SESSION 54: PAPER SESSION ILLINOIS
Sponsored by the Topical Interest Group on Qualitative Methods

Mixed Models:  Qualitative Methods and the Logic of Evaluation Design

Chair: Richard Thurlow, Widener University
Presenters: Small Budget Evaluation Design: Lessons Learned From an Evaluation of Juvenile Addiction Receiving Facilities, Kristen M. Snyder & Paul G. Stiles, University of South Florida
  Ideological and Structural Logic Models, Linda Mabry & Soo Baik, Indiana University
  Using Qualitative Methods To Evaluate Better, Tamara M. Walser, Utah State University

 

SESSION 55:  PAPER SESSION INDIANA
Sponsored by the Topical Interest Group on State and Local Government

When Worlds Collide: Cross-sector and Cross-agency Evaluations

Chair: Elizabeth Holtzapple, Arizona Auditor General's Office
Presenters: Meeting the Challenges of Evaluating Private Versus Public Social Service Delivery, Elham-Eid Alldredge, Margaret Marcus Hale, Zheng Wang, Suzanne Bowler & Samia Noursi, REDA International, Inc.
  Improving Private and Public Performance Measurement, Sharon Stout, Community Well Research and Evaluation, Inc.
  Cross-Agency Collaboration: Rhetoric or Reality?, Charles McClintock & Elizabeth LaPolt, Cornell University
Discussant: Elizabeth Holtzapple, Arizona Auditor General's Office

 

SESSION 56:  PANEL SESSION IOWA
Sponsored by the Topical Interest Group on Quantitative Methods: Theory and Design

Evaluating Item Response Theory: Empirical Tests and Practical Applications

Chair: John Hetherington, Southern Illinois University
Panelists: An Empirical Comparison of Item Response Theory and Classical Test Theory Statistics: Show Me the Variance, John Hetherington & Denise M. Truskosky, Southern Illinois University
   Item Response Theory and Small Samples: Putting Parameter Invariance to the Test, Denise M. Truskosky & John Hetherington, Southern Illinois University
   The Environmental Test of Scientific Processes: An Application of Item Response Theory in the Evaluation of Student Learning,  Denise M. Truskosky & John Hetherington, Southern Illinois University
   Item Analysis of the Test of School Readiness: Benefits of the Classical and Item Response Theory, Zarko Vukmirovic, Southern Illinois University
Discussant: Patrick McKnight, University of Arizona

 

SESSION 57:  PAPER SESSION MICHIGAN
Sponsored by the Topical Interest Group on Evaluation of Services for Special Needs Populations

Tools of the Trade: Strategic Planning, Evaluation Instruments and Stakeholder Input

Chair: Thomas E. Grayson, University of Illinois at Urbana-Champaign
Presenters: Using a Bottom-up Approach To Identify Barriers and Issues Facing Individuals With Disabilities in Educational Reform Initiatives, Thomas E. Grayson, University of Illinois at Urbana-Champaign
  Developing a Comprehensive Instrument for Facilitating Project Evaluation Meta-Analysis and For Identifying Needs of Professional Development, Thomas Grayson & Edith J. Cisneros-Cohernour, University of Illinois at Urbana-Champaign
  Issues in Strategic Planning for Special Needs Populations, Gary W. Mauk, Eric J. Gee, Spectrum Consulting
  Understanding Evaluation Consent Disclosures: Improving the Informed Consent Process When Evaluating Services for Persons With Severe Mental Illness, Paul G. Stiles & Norman Poythress, University of South Florida

 

SESSION 58:  PAPER SESSION MICHIGAN STATE
Sponsored by the Topical Interest Group on Collaborative/Participatory & Empowerment Evaluation

Empowerment Evaluation and Youth Development

Chair: Elizabeth Whitmore, Carleton University
Presenters: Practitioners Driving Change Through Evaluation, Genevieve Lau, Skyline College
  4-H Teen Mentor Camp Evaluation, Jan Anderson Talley, Resource Development Institute
  A Participatory Evaluation of a Drop in Center for Street Youth, Elizabeth Whitmore, Carleton University

 

SESSION 60:  PAPER SESSION NORTHWESTERN
Sponsored by the Topical Interest Group on International and Cross-cultural Evaluation

Evaluation Issues in International Non-Governmental Organizations

Chair: Michael Bamberger, World Bank
Presenters: Lessons Learned From a CECIP/UNICEF Evaluation of Educational Materials in Brazil, Thomaz K. Chianca, Claudia P. Ceccon, Claudius Ceccon, Mário M. Chaves, Eduardo Marino & Jovelina Protasio, Centro de Criação de Imagem Popular
  A Life-of-Project (and Beyond) Perspective for Impact Evaluation: Some Learnings from CARE's Experiences With International Development Projects, Jim Rugh, CARE
  Building on Evaluation Results to Promote Effective Community Based Resources Management Strategies in the Amazon, Laura E. Roper, Oxfam America

 

SESSION 61:  PANEL SESSION OHIO STATE
Sponsored by the Topical Interest Group on Health Evaluation

Assessing Impacts in Health Evaluation

Chair: Eunice Rodriguez, Cornell University
Panelists: Cost Effectiveness of School-based Health Care, Robbya R. Green-Weir, Henry Ford Health System
  HIV Prevention Indicators: Monitoring HIV Prevention Vital Signs, Deborah L. Rugg, Janet L. Heitgerd, David Cotton & Larry Wilkinson, Centers for Disease Control and Prevention
  Evaluation and Epidemiology: Common Challenges and Converging Paths?, Eunice Rodriguez, Cornell University

 

SESSION 62:  PAPER SESSION PURDUE
Sponsored by the Topical Interest Group on Non-profit and Foundations Evaluation

Program Evaluations in the Non-profit Sector

Chair: Stanley Capela, HeartShare Human Services
Presenters: Youth At-risk Mentor Program: Rethinking Evaluation and Outcomes, Sharon Baggett, Independent Consultant
  Listening to the Children's Voices, Huilan Yang, Starr Commonwealth
  Evaluation of Housing Initiatives in Community Development, Robert K. Yin & James Greer, COSMOS Corporation

back.gif (804 bytes)