THURSDAY, NOVEMBER 5, 1998
8:00 AM to 9:30 AM

back.gif (804 bytes)

SESSION 16:  PRESIDENTIAL STRAND - INTERACTIVE PANEL SALON A
Sponsored by the Topical Interest Group on Evaluation Use

Transformative Issues of Evaluation Use

Chair: Valerie Caracelli, U.S. General Accounting Office
Panelists: A Federal Perspective, Valerie Caracelli, U.S. General Accounting Office
   Democratic Theory and Deliberative Theories of Democracy, Gary Henry, Georgia State University
   Validity Perspectives and Consequential Justifications of Validity, Karen Kirkhart, Syracuse University
   Perspectives on Evaluation Use as Transformative Learning, Hallie Preskill, University of New Mexico; and Rosalie Torres, Developmental Studies Center
   Perspectives on Knowledge and the Role of Dialogic Inquiry, Sharon Rallis, Harvard University; and Gretchen Rossman, University of Massachusetts
   Perspectives on Professional Development, Lyn Shulha, Queen's University

 

SESSION 17:  INTERACTIVE SYMPOSIUM SALON B

The Gender Equity Expert Panel - Creative Ways to Learn What Works for Whom

Co-chairs: Lynn Fox, American University
  Susan Klein, U.S. Department of Education
Presenters: Gypsy Abbott, University of Alabama at Birmington
  Lynn Fox, American University
  Susan Klein, U.S. Department of Education
  Dawn Pickard, University of Oakland
  Pamela Sandoval, Indiana University Northwest
  Ann Weinheimer, U.S. Department of Education
  Mary Wiberg, Iowa Department of Education

 

SESSION 18:  PAPER SESSION SALON C
Sponsored by the Topical Interest Group on Collaborative/Participatory & Empowerment Evaluation

Empowerment and Participatory Evaluation:  The Role of Collaboration

Chair: David Fetterman, Stanford University and the Empowerment Evaluation Institute
Presenters:   Evaluator Versus Program Practitioner Perspectives in Collaborative Evaluation, J. Bradley Cousins & Stephanie Sutherland, University of Ottawa
   How Collaborative Approaches Promote Evaluation with Community-Based Programs for Young Children and Their Families, Rita O'Sullivan & Anne D'Agostino, University of North Carolina at Greensboro
   Collaboration: Interviews on its Conceptualization, Operationalization, and Influence on Evaluation Findings, Mary Piontek & Susan Frankel, RMC Research Corporation
Discussant: Andy Rowe, Empowerment Evaluation Institute

 

SESSION 19:  PANEL SESSION SALON D
Sponsored by the Topical Interest Group on Quantitative Methods: Theory and Design

New Chapters and Challenges in Methodology

Chair: Mark W. Lipsey, Vanderbilt University
Panelists: From Data to Conclusion: The Limited Significance of Statistical Significance, Mark W. Lipsey, Vanderbilt University
  Differential Program Effects: Distinguishing Theory and Implementation Successes and Failures, David S. Cordray, Vanderbilt University
  A Proposed Reorientation of Design and Method for Social Science Research, Lawrence B. Mohr, University of Michigan
  Realist Mechanisms in Contexts: Pre-Positivist Emancipation of Internal and External Validity, George Julnes, University of Illinois at Springfield

 

SESSION 20:  PRESENTATION, DEBATE and DISCUSSION SALON E

A Soft Debate About the Proposition: "Be it resolved that the field of evaluation should undertake the development of a system to certify (or credential) evaluators."

Moderator: Blaine R. Worthen, Utah State University
Presenters: James W. Altschuld, The Ohio State University
  Steven Jones, Utah State University
  Blaine R. Worthen, Utah State University
Debaters: (Pro) James W. Altschuld, The Ohio State University
  (Pro) Leonard Bickman, Vanderbilt University
  (Con) Michael Scriven, Claremont Graduate University
  (Con) Midge Smith, University of Maryland

 

SESSION 21:  SKILL BUILDING WORKSHOPS SALON F
Sponsored by the Topical Interest Group on Quantitative Methods: Theory and Design

a.    Doubly Significant Results: Statistical Power and Adequate Sample Size (8:00 AM - 8:40 AM)

Presenter: James A. Wells, CHPS Consulting

b.    Breakeven Analysis in Activity Based Costing (8:50 AM - 9:30 AM)

Presenter: Mark Trease, University of Arizona

 

SESSION 22:  DEMONSTRATIONS SALON G
Sponsored by the Topical Interest Group on Computer Use in Evaluation

a. The Community Collaborative Database:  A Tool for Tracking and Linking Clients, Services, and Outcomes Across Multiple Agencies (8:00 - 8:40 AM)

Presenter: Jordan Horowitz, WestEd

b. Program Information Management System:  Preparing for Program Evaluation (8:50 - 9:30 AM)

Presenters: Ching-Tung Wang & Carolyn Winje, National Committee to Prevent Child Abuse

 

SESSION 23:  SKILL BUILDING WORKSHOP SALON H
Sponsored by the Topical Interest Group on Collaborative/Participatory and Empowerment Evaluation

Picturing and Narrating Meaning: Effective Tools for Facilitating a Learning Community Approach to Planning and Evaluation

Presenter: Daniel Folkman & Kalyani Rai, University of Wisconsin - Milwaukee

 

SESSION 24:  PAPER SESSION DENVER
Sponsored by the Topical Interest Group on Extension Education Evaluation

Approaches to Program Evaluation in Extension Organizations

Chair:   Claude Bennett, U.S. Department of Agriculture
Presenters:   Strategies for Evaluating 4-H Clubs, June P. Mead, Eunice Rodriguez, Thomas Hirschl & Steve Goggin, Cornell University
   Evaluating Water Quality Education Programs: Striking a Balance With Administrative Accountability, Sound Investigative Techniques and Local Practicality, Robin Shepard, University of Wisconsin - Madison
   An Evaluation of Florida Cooperative Extension's County Program Review Process, Steve G. Jacob & Glenn D. Israel, University of Florida

 

SESSION 25:  PAPER SESSION HOUSTON
Sponsored by the Topical Interest Group on Human Services Evaluation

Evaluating Innovations in Social Service Programs for Children and Families

Chair: Frank A. Sansone, University of West Florida
Presenters:   Training Issues in Contracting Child Protective Services: Evaluation of a Pilot Project, Jeanne Brooks, University of Tennessee
   A Process Evaluation of a Multi-agency Service Delivery System for Children and Families, Brenda Klostermann, Maria Britto & Andrea Bonny, University of Cincinnati and Children's Hospital Medical Center
   Children of Change: Results from a Pilot Program for Children in Divorcing Families, Robert L. Fischer, Families First
   Asset Development for Social Service Clients: A Program Design and Evaluation, Frank A. Sansone, University of West Florida
Discussant: 

Frank A. Sansone, University of West Florida

 

SESSION 26:  PAPER SESSION KANSAS CITY

Community Level Collaborations

Chair:   Barry B. Cohen, Rainbow Research, Inc.
Presenters:    PRISM: A Lens for Organizational Evaluation and Development, Lynn K. Bradshaw, East Carolina University; and David Langmeyer, Independent Consultant
   Community Indicators and Assessing Community Impact: A Case Study, Barry B. Cohen, Rainbow Research, Inc.
   Building Collaboratives and Empowering Community Members: Community-Level Outcomes of the Colorado Healthy Communities Programs, Ross Conner, Sora Park Tanjasiri , Catherine Dempsey, Gabriela Robles & Marc Davidson, University of California - Irvine; and Doug Easterling, The Colorado Trust
   Evaluation of the Strengthening Ohio's Leadership Capacity Building Team, Ana Kazan, The Ohio State University; and Ruben Nieto & Annie Berry, Ohio State University Extension

 

SESSION 27:  PANEL SESSION   LOS ANGELES

How Can Faculty Evaluation Approaches Contribute to Emerging Debates on Improving Post Secondary Teaching?

Chair: William H. Rickards, Alverno College
Panelists: Katherine Ryan, University of Illinois at Urbana-Champaign
  Tim Riordan, Alverno College
  Mark Troy, Texas A&M University

 

SESSION 28:  PANEL SESSION   MIAMI
Sponsored by the Topical Interest Group on Evaluation Managers and Supervisors

Evaluation's Role in Protecting Vulnerable Populations in Evolving Health Care Settings

Chair: Chester B. Slaughter, U.S. Department of Health and Human Services (DHHS)
Panelists: Medicare HMO Appeal and Grievance Processes, Jennifer Collins & Linda Paddock, DHHS
   Perspectives of Seriously Ill, Functionally Limited, and Disabled Beneficiaries in Medicare Risk HMOs, Chester B. Slaughter & Judith V. Tyler, DHHS
Discussant: George Grob, DHHS

 

SESSION 29:  PANEL SESSION   SCOTTSDALE
Sponsored by the Topical Interest Group on Alcohol, Drug Abuse, and Mental Health

A Collaborative Approach to Designing a Cross-site Evaluation Study: The Center for Mental Health Services Housing Initiative for Persons with Serious Mental Illness

Chair: Debra J. Rog, Vanderbilt Institute of Public Policy Studies
Panelists: Robert Paulson, Regional Research Institute for Human Services, Portland State University
  Fran Randolph, Center for Mental Health Services
  Debra J. Rog, Vanderbilt Institute of Public Policy Studies

 

SESSION 30:  PAPER SESSION   ILLINOIS
Sponsored by the Topical Interest Group on Research, Technology and Development Evaluation

From Basic Science to Technology Transfer: Evaluation Challenges and Methods

Chair:   Julia Melkers, Georgia State University
Presenters:   Can We Evaluate the Economic Impact of Basic Research? Erik Arnold & Katalin Balázs, Technopolis, Ltd.
   Using Evaluative Data in an Energy Efficiency and Renewable Energy R&D Portfolio Process, John Mortensen & Bill Babiuch, National Renewable Energy Laboratory
   Evaluation of Technology Transfer,  Frans van den Beemt, Technology Foundation STW

 

SESSION 31:  PAPER SESSION   INDIANA
Sponsored by the Topical Interest Groups on International and Cross-cultural Evaluation, and Health Evaluation

Health Evaluation: International and Cross-cultural Perspectives

Chair:   Gary Miron, Western Michigan University
Presenters:   Tracking and Interviewing Clients at Risk for HIV and Substance Abuse in a Predominantly Latino Community, Amy Juntunen & Melanie Hwalek, SPEC Associates
   Building Capabilities for Evaluating Violations of Children's Rights in Nepal and Pakistan, Experiences With Sentinel Community Surveillance, 1995-98, Roger Pearson, United Nations Children's Fund (UNICEF)
   Introducing Markets Into Public Health Care Systems: Evaluating the Catalan Experience, Eunice Rodriguez, Cornell University

 

SESSION 32:  PANEL SESSION   IOWA
Sponsored by the Topical Interest Group on Business and Industry

Evaluator Approaches in a Corporate Setting: Three Case Studies

Chair:   Jennifer D. Dewey, Andersen Worldwide
Panelists: Evolution of Service Evaluation Utilizing an Electronic Format: A Longitudinal Case, Nancy L. deLay, Andersen Worldwide
   The Evaluator as Member of a Multi-Disciplinary Team, Laura J. Graf, Andersen Worldwide
   Rollout of Large-scale Initiatives: Green Lights and Speed Bumps, Rose J. Setze, Andersen Worldwide
Discussants: Steven C. Bond, Andersen Worldwide
  Sandra Lamartine, Andersen Worldwide

 

SESSION 33: PANEL followed by ROUNDTABLE DISCUSSIONS    MICHIGAN

Connections to the Federal Evaluation Arena: Research and Education Opportunities at NSF

Chair: Conrad Katzenmeyer, National Science Foundation (NSF)
Panelists: Connection to Evaluation Efforts in K-12 Systemic Reform, Bernice Anderson, NSF
  Connections With the Other NSF/EHR Evaluation Efforts, Elmima Johnson, NSF
  Research Funding Possibilities in REC, Conrad Katzenmeyer, NSF

 

SESSION 34:  PAPER SESSION   MICHIGAN STATE
Sponsored by the Topical Interest Group on Minority Issues in Evaluation

Are Methods Multicultural?: The Use of Culturally Appropriate Evaluation Methods and Measures

Chair:   Hazel Simonnette, University of Wisconsin System
Presenters:   Organization-to-Organization Evaluation: Forging a New Tool to Assess Effectiveness and Performance of Cooperative Agreements, Carolyne W. Arnold, University of Massachusetts - Boston
   An Equity Analysis of Existing Evaluation Data, Zoe A. Barley & Cynthia Phillips, Western Michigan University
   Designing Culturally Appropriate Outcome Measurement, Barbara Gurley, The Evaluation Forum
   The Use of Concept Mapping Methodology for Outcome Measurement for an HIV Prevention Program (Keepin' It R.E.A.L.), Joseph Watkins, Emory University
Discussant:   Ivy Jones, University of Massachusetts - Boston

 

SESSION 35: PANEL   MINNESOTA

A Conundrum: State Efforts to Evaluate the Charter School Experiment

Chair: Mary Ann Millsap, Abt Associates
Panelists: Nancy Brigham, Rosenblum Brigham Associates
  Sheila Rosenblum, Rosenblum Brigham Associates
  Patricia S. Seppanen, University of Minnesota
Discussant: Mary Ann Millsap, Abt Associates, Inc.

 

SESSION 36:  PAPER SESSION   NORTHWESTERN
Sponsored by the Topical Interest Group on Collaborative/Participatory and Empowerment Evaluation

Empowerment and Participatory Evaluation and Violence Prevention

Chair: Lynn Short, Centers for Disease Control and Prevention
Presenters:   Design Issues in Evaluating a Grassroots Health Outreach and Education Program for Migrant Farmworker Women, Lynn M. Short, Centers for Disease Control and Prevention; Rachel Rodriguez, University of Texas; and Karen Mountain, Migrant Clinician's Network
   Participatory Evaluation of a Multi-site Youth Violence Prevention Initiative, Kris Putnam, Stanford University
Discussant: Abraham Wandersman, University of South Carolina

 

SESSION 37:  PANEL SESSION (Provides context for the site visit at session)   OHIO STATE
Sponsored by the Topical Interest Group on Health Evaluation

Evaluating Public Health Programs in Community-based Settings

Chair: Anabel Burgh Crane, U.S. Department of Health and Human Services (DHHS)
Panelists: Evaluating Community-Based HIV/AIDS Outreach Projects, Katharine Marconi, Moses Pounds, Philomena Green, Richard Moore & Barney Singer, DHHS
   Issues in Evaluating Consortia in Community-Based Public Health Programs, Karen Thiel Raykovich, DHHS
   Evaluating Health Professions Training Activities in Community-based Sites, Jennifer Burks, DHHS

Site Visit to Cook County Hospital!

A site visit to Cook County Hospital will immediately follow this session with departure at 9:30 AM and return by 11:15 AM.  Free van transportation will be provided on a first-come, first-served basis; the group will meet at the concierge desk.   The focus for the site visit is on learning about the application of evaluation strategies at a successful community-based organization working with vulnerable populations.  For information, or to RSVP (if possible), please contact Terrie Alvarez at (301) 443 - 6500.

 

SESSION 38:  SKILL BUILDING WORKSHOP   PURDUE
Sponsored by the Topical Interest Group on Non-profit and Foundations Evaluation

Outcome-based Grants Management: What has to Change for Grantmakers?

Presenter:   Dawn Hanson Smart, The Evaluation Forum and Clegg & Associates

 

SESSION 39: PANEL SESSION   WISCONSIN
Sponsored by the Topical Interest Group on Alcohol, Drug Abuse, and Mental Health

Evaluating State-level Capacity Building Initiatives for Prevention and Health Promotion: Part I:  Measuring "Virtual Reality" (Discussion for this session will continue at Session 43, Roundtable A)

Chair: John F. Stevenson, University of Rhode Island and Brown University
Panelists: Technical Assistance as Independent Variable in Capacity Building Initiatives: Conceptual and Methodological Issues, Peter Mulhall, University of Illinois
   Evaluating Collaboration Around Prevention Services: Conceptual and Methodological Issues, Roger Mitchell, Brown University
   Evaluating the Strength of Policy Change Efforts: Conceptual and Methodological Issues, David M. Chavis, Association for the Study and Development of Community
Discussant: Roy Gabriel, RMC Research Corporation

back.gif (804 bytes)