|
Session Title: Teaching of Evaluation TIG Business Meeting and Panel: Meet Our Authors
|
|
Business Meeting with Panel Session 509 to be held in Pacific C on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Teaching of Evaluation TIG
|
| TIG Leader(s):
|
|
Linda Schrader, Florida State University, lschrader@fsu.edu
|
|
Bonnie Stabile, George Mason University, bstabile@gmu.edu
|
|
Randall Davies, Brigham Young University, randy.davies@byu.edu
|
| Chair(s): |
| Katye Perry, Oklahoma State University, katye.perry@okstate.edu
|
| Abstract:
This session will provide an opportunity for those who teach one or more courses in program evaluation or have an interest in teaching such a course to engage in conversation with the authors of the text they use or would like to use with their classes. A unique feature of this session is that the authors who are invited to participate have a text that is most frequently identified as one that is used by actual instructors of program evaluation courses. Among the questions for the authors to address are: "What was your purpose for writing the text we use?" "Who do you see as users of your text?" "What value(s) do you see reflected in your writing that will in turn support how you see evaluation should or could be practiced?" This session will provide ample time for interactive Q&A between authors and session attendees.
|
|
Program Evaluation: Alternative Approaches and Practical Guidelines: Its Purpose, Its Use, Its Value
|
| Jody Fitzpatrick, University of Colorado at Denver, jody.fitzpatrick@ucdenver.edu
|
|
Having been identified as an author of a most frequently used textbook in program evaluation classes, this session will allow the opportunity for this author to engage in a dialogue with its users by sharing what motivated the purpose for writing the text as well as providing ideas regarding its use and value in the practice of evaluation. Having been a member of the TIG: TOE for a number of years, an appreciation is known as to what influences AEA members to identify it as a resource to aid in their instruction. To this end a mutual exchange between author and instructor is looked towards with excitement.
|
|
|
Qualitization-Focused Evaluation: Its Purpose, Its Use, Its Value
|
| Michael Patton, Utilization-Focused Evaluation, mqpatton@prodigy.net
|
|
Having been identified as an author of a most frequently used textbook in program evaluation classes, this session will allow the opportunity for this author to engage in a dialogue with its users by sharing what motivated the purpose for writing the text as well as providing ideas regarding its use and value in the practice of evaluation. Having a primary focus on the involvement of primary intended users of its results, the approach taken within a utilization-focused evaluation has application across multiple settings. The mutual exchange between author and instructor can provide additional examples for its application.
| |
|
Session Title: Costs, Effectiveness, Benefits, and Economics TIG Business Meeting
|
|
Business Meeting Session 515 to be held in Avila A on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Costs, Effectiveness, Benefits, and Economics TIG
|
| TIG Leader(s): |
|
Ron Visscher, Western Michigan University, ron.visscher@aquinas.edu
|
|
Nadini Persaud, University of the West Indies, npersaud07@yahoo.com
|
|
Session Title: Evaluation Managers and Supervisors TIG Business Meeting and Presentation: Informing the Intrinsic Value of Evaluation Work - Using Social Learning Theory to Promote Self-efficacy
|
|
Business Meeting and Multipaper Session 516 to be held in Avila B on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Evaluation Managers and Supervisors TIG
|
| TIG Leader(s): |
|
Ann Maxwell, Office of Inspector General, ann.maxwell@oig.hhs.gov
|
|
Sue Hewitt, Health District of Northern Larimer County, shewitt@healthdistrict.org
|
|
Laura Feldman, University of Wyoming, lfeldman@uwyo.edu
|
| Presenter(s):
|
| Christa Smith, Kansas State University, christas@ksu.edu
|
| Sheryl Hodge, Kansas State University, shodge@ksu.edu
|
| Abstract:
This presentation describes a team-building activity that was conducted in an office of professional evaluators in an effort to build understanding of each others' strengths, as well as to identify their own strengths and contributions to the field of evaluation. The purpose of the activity was created out of a desire to reflect on current assets, provide continuous feedback on evaluation-related tasks, and ultimately increase the self-efficacies of evaluation professionals.
By incorporating Bandura's self-efficacy model (Bandura, 1977) in our professional development endeavors, we examined the influences of prior knowledge and experiences, persuasion, vicarious learning, and interpretation of physiological responses on our own evaluator self-efficacy. Additionally, the activity enabled recognition of how evaluator self-efficacy in turn impacts task choice, effort, and persistence.
Through dissemination of the procedures utilized, evaluation managers and supervisors can provide an innovative, insightful, and constructive mechanism for promoting a productive work environment that fosters professional growth.
|
|
|
Session Title: Non-profit and Foundations Evaluation TIG Business Meeting
|
|
Business Meeting Session 518 to be held in Balboa C on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Non-profit and Foundations Evaluation TIG
|
| TIG Leader(s): |
|
Charles Gasper, Missouri Foundation for Health, cgasper@mffh.org
|
|
Beth Stevens, Mathematica Policy Research, bstevens@mathematica-mpr.com
|
|
Helen Davis Picher, William Penn Foundation, hdpicher@williampennfoundation.org
|
|
Joanne G Carman, University of North Carolina, Charlotte, jgcarman@uncc.edu
|
|
Session Title: Organizational Learning and Evaluation Capacity Building TIG Business Meeting and Roundtable Discussion: Good Evaluation Questions: Can I Get a Checklist?
|
|
Business Meeting Session 519 to be held in Capistrano A on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Organizational Learning and Evaluation Capacity Building
|
| TIG Leader(s): |
|
Joseph Bauer, American Cancer Society, joseph.bauer@cancer.org
|
|
Angela Moore, Centers for Disease Control and Prevention, cyq6@cdc.gov
|
|
Jesse Burns, University of Washington, jesseburns1@gmail.com
|
| Presenter(s): |
| Sarah Gill, Centers for Disease Control and Prevention, sgill@cdc.gov
|
| Maureen Wilce, Centers for Disease Control and Prevention, muw9@cdc.gov
|
| Sheri Disler, Centers for Disease Control and Prevention, sjd9@cdc.gov
|
| Abstract:
Meaningful evaluation findings are the answers to good evaluation questions. For many of us, asking good evaluation questions is an art, learned by practice. We use our experience to judge how 'good' a question will be in producing useful, actionable findings that reflect stakeholder values. Is there a way to teach this art to others, including new evaluators? Is there a way to distill lessons learned about the quality of evaluation questions? Can we identify factors that make an evaluation question good? As evaluators charged with providing technical assistance for the National Asthma Control Program, our team asks whether it is possible to articulate a set criteria for defining and assessing good evaluation questions. What makes a proposed question explicitly evaluative? In this roundtable we will share our observations in supporting 36 state partners and facilitate a discussion intended to answer the question: 'Can I get a checklist?'
|
|
Session Title: Disaster and Emergency Management Evaluation TIG Business Meeting
|
|
Business Meeting Session 520 to be held in Capistrano B on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Disaster and Emergency Management Evaluation
|
| TIG Leader(s): |
|
Liesel Ritchie, University of Colorado, Boulder, liesel.ritchie@colorado.edu
|
|
S Scott Aminov, Food for the Hungry, saminov@fh.org
|
|
Brandi Gilbert, University of Colorado at Boulder, brandi.gilbert@colorado.edu
|
|
Session Title: Health Evaluation TIG Business Meeting and Demonstration: Uniting TEAMS: North Carolina's Web-based Tobacco Evaluation and Management System (TEAMS)
|
|
Business Meeting Session 523 to be held in El Capitan A on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Health Evaluation TIG
|
| TIG Leader(s): |
|
Robert LaChausse, California State University, San Bernardino, rlachaus@csusb.edu
|
|
Jenica Huddleston, Deloitte Consulting, jenicahuddleston@gmail.com
|
| Presenter(s): |
| Kearston Ingraham, University of North Carolina, Chapel Hill, kearston_ingraham@med.unc.edu
|
| Abstract:
Strong data infrastructure and consistent collection practices are essential to program evaluation. An internal assessment of the North Carolina Health and Wellness Trust Fund Teen Tobacco Use Prevention and Cessation Initiative's evaluation data collection system- Web-based Indicator Progress Tracking System (WiPTS)- led to the development of the Tobacco Evaluation and Management System (TEAMS). This database incorporates the needs of program funders, evaluators, technical assistance providers, and grantees. TEAMS, an innovative multi-faceted program management and evaluation tool designed to track statewide programmatic activities, provides a centralized location for monthly data entry, program management, technical assistance services, and data analysis which can be used by program managers and evaluators.
New strategies are needed to provide cost-effective ways to collect program data utilizing a paperless conduit that can be employed by program funders and evaluators. This demonstration will show attendees how the TEAMS database functions and improves programmatic activities and evaluation results.
|
|
Session Title: Feminist Issues in Evaluation TIG Business Meeting
|
|
Business Meeting Session 526 to be held in Huntington A on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Feminist Issues in Evaluation TIG
|
| TIG Leader(s): |
|
Kathryn Bowen, Centerstone Research Institute, kathryn.bowen@centerstone.org
|
|
Denise Seigart, Stevenson University, dseigart@stevenson.edu
|
|
Linda Thurston, National Science Foundation, lthursto@nsf.gov
|
|
Denice Cassaro, Cornell University, dac11@cornell.edu
|
|
Session Title: College Access Programs TIG Business Meeting
|
|
Business Meeting Session 529 to be held in La Jolla on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the College Access Programs TIG
|
| TIG Leader(s): |
|
Wendy Erisman, Strix Research LLC, werisman@strixresearch.com
|
|
Felicia Bohanon, Northern Illinois University, fbohanon@niu.edu
|
|
Rita O'Sullivan, University of North Carolina, rjosull@mindspring.com
|
|
Session Title: Theories of Evaluation TIG Business Meeting
|
|
Business Meeting Session 530 to be held in Laguna A on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Theories of Evaluation TIG
|
| TIG Leader(s): |
|
James Griffith, Claremont Graduate University, james.griffith@cgu.edu
|
|
Bianca Montrosse, Western Carolina University, bemontrosse@wcu.edu
|
|
Karen Zannini Bull, Syracuse University, kbull@syr.edu
|
|
Session Title: Research, Technology, and Development Evaluation TIG Business Meeting
|
|
Business Meeting Session 534 to be held in Malibu on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Research, Technology, and Development Evaluation TIG
|
| TIG Leader(s): |
|
Cheryl Oros, Oros Consulting LLC, cheryl.oros@gmail.com
|
|
Brian Zuckerman, Science and Technology Policy Institute, bzuckerm@ida.org
|
|
George Teather, Performance Management Network, george.teather@pmn.net
|
|
Juan Rogers, Georgia Institute of Technology, jdrogers@gatech.edu
|
|
Session Title: Qualitative Methods TIG Business Meeting
|
|
Business Meeting Session 537 to be held in Oceanside on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Qualitative Methods TIG
|
| TIG Leader(s): |
|
Jennifer Jewiss, University of Vermont, jennifer.jewiss@uvm.edu
|
|
Leslie Goodyear, National Science Foundation, lgoodyea@nsf.gov
|
|
Janet Usinger, University of Nevada Reno, usingerj@unr.edu
|
|
Eric Barela, Partners in School Innovation, ebarela@partnersinschools.org
|
|
Session Title: Human Services Evaluation TIG Business Meeting
|
|
Business Meeting Session 538 to be held in Palisades on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Human Services Evaluation TIG
|
| TIG Leader(s): |
|
Tania Rempert, University of Illinois at Urbana-Champaign, trempert@illinois.edu
|
|
Todd Franke, University of California, Los Angeles, tfranke@ucla.edu
|
|
Vajeera Dorabawila, New York State Office of Children and Family Services, vajeera.dorabawila@ocfs.state.ny.us
|
|
Session Title: Environmental Program Evaluation TIG Business Meeting
|
|
Business Meeting Session 539 to be held in Palos Verdes A on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Environmental Program Evaluation TIG
|
| TIG Leader(s): |
|
Annelise Carleton-Hug, Trillium Associates, annelise@trilliumassociates.com
|
|
Mary McEathron, University of Minnesota, mceat001@umn.edu
|
|
Nancy Carrillo, Apex Education, nancy@apexeducation.org
|
|
Session Title: Multiethnic Issues in Evaluation TIG Business Meeting and Guest Speaker
|
|
Business Meeting Session 540 to be held in Palos Verdes B on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Multiethnic Issues in Evaluation TIG
|
| TIG Leader(s): |
|
Maurice Samuels, University of Chicago, mcsamuels@uchicago.edu
|
|
Erika Taylor, Prince George's County Public Schools, etaylorcre@aol.com
|
|
Pamela Frazier-Anderson, Frazier-Anderson Research & Evaluation, pfa@frazier-anderson.com
|
| Presenter(s): |
| Henry Frierson, University of Florida, hfrierson@ufl.edu
|
|
Session Title: Assessment in Higher Education TIG Business Meeting
|
|
Business Meeting Session 542 to be held in Salinas on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Assessment in Higher Education TIG
|
| TIG Leader(s): |
|
Rhoda Risner, United States Army, rhoda.risner@us.army.mil
|
|
Audrey Rorrer, University of North Carolina, Charlotte, arorrer@uncc.edu
|
|
George Reinhart, University of Maryland, greinhart@casl.umd.edu
|
|
Session Title: Advocacy and Policy Change TIG Business Meeting
|
|
Business Meeting Session 543 to be held in San Clemente on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Advocacy and Policy Change TIG
|
| TIG Leader(s): |
|
Annette Gardner, University of California, San Francisco, annette.gardner@ucsf.edu
|
|
David Devlin-Foltz, Aspen Institute, david.devlin-foltz@aspen.org
|
|
James Riedel, Girl Scouts of the USA, jriedel@girlscouts.org
|
|
Jennifer Cartland, Children’s Memorial Research Center, jcartland@childrensmemorial.org
|
|
Session Title: Collaborative, Participatory & Empowerment Evaluation TIG Business Meeting and Panel: How are Evaluation and Continuous Quality Improvement Capacities Built Using Getting to Outcomes (GTO)
|
|
Business Meeting with Panel Session 544 to be held in San Simeon A on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Collaborative, Participatory & Empowerment Evaluation TIG
|
| TIG Leader(s):
|
|
David Fetterman, Fetterman Associates, fettermanassociates@gmail.com
|
|
Liliana Rodriguez-Campos, University of South Florida, liliana@usf.edu
|
| Chair(s): |
| Abraham Wandersman, University of South Carolina, wandersman@sc.edu
|
| Abstract:
How are the capacities built by GTO®(1) related to performance? The goal of this panel is underscore the importance of evaluation capacity building among human service organizations. It is timely given the current economic climate, where more emphasis being placed on evaluation and more human service organizations are being asked to do evaluation and continuous quality improvement (CQI).
There will be a brief overview to GTO presented by Abe Wandersman and 3 brief presentations on using GTO in prevention and treatment programs (8 minutes each) and 8 minutes for the discussant Laura Leviton.
In each presentation, there will be 3-4 powerpoint slides. One slide on background of project, one on findings, and one on next steps/unanswered questions. This provides some evidence re: the premise of GTO in building capacity.
(1) Getting To Outcomes® and GTO® have been registered by the University of South Carolina and RAND.
|
|
The Getting to Outcomes ® - Continuous Quality Improvement: Intervention Development Project
|
| Sarah Hunter, RAND Corporation, shunter@rand.org
|
| Matthew Chinman, RAND Corporation, chinman@rand.org
|
| Patricia Ebener, RAND Corporation, patricia_ebener@rand.org
|
|
This presentation will describe an iterative participatory process used to develop the Getting To Outcomes (GTO) Continuous Quality Improvement manual for use in community service organizations. Using the GTO participatory evaluation framework, researchers worked closely with a community service organization to adapt existing CQI approaches for use in a substance abuse prevention and treatment setting. The CQI process was based on an empowerment evaluation approach where providers systematically assessed their own programs and developed CQI actions with guidance from CQI Experts/RAND researchers and support from organizational leadership. Program staff participated in the training and testing of the CQI tools and provided feedback on feasibility over a two-year period. The CQI tools that were modified over time based on program staff feedback will be illustrated. The presentation will also incorporate program staff's experiences including the resources needed to conduct CQI in these settings.
|
|
|
Supporting the Implementation of Positive Youth Development Programs Through Getting to Outcomes®
|
| Joie Acosta, RAND Corporation, shunter@rand.org
|
| Matthew Chinman, RAND Corporation, chinman@rand.org
|
|
Despite the spread of evidence-based prevention to support healthy youth development, communities still face difficulty in achieving outcomes because of limited capacity to implement "off the shelf" programs. This presentation will describe the structure and findings of a project that combines two complementary models to address this implementation challenge: Getting To Outcomes® (GTO) and Developmental Assets (Assets). GTO enhances local capacity for discrete prevention tasks; Assets supports community mobilization to promote positive youth development. The project is a randomized community trial comparing six prevention coalitions receiving a two-year intervention based on Assets-GTO (manuals, training, and ongoing technical assistance) with 6 similar coalitions who are not. Coalition surveys (about 54 members/coalition) and interviews with program staff (5 per coalition) were used to assess the adoption of Assets-GTO, and the impact on prevention capacity and performance. Findings from these instruments and their implications for conducting implementation research will be presented.
| |
|
Utilizing Getting to Outcomes® Within a Recovery-oriented System of Care
|
| Jonathan Scaccia, University of South Carolina, jonathan.p.scaccia@gmail.com
|
| Jennifer Castellow, University of South Carolina, castellj@email.sc.edu
|
| Isha Metzger, University of South Carolina, isha.metzger@gmail.com
|
| Andrea Lamont, University of South Carolina, alamont082@gmail.com
|
| Jason Katz, University of South Carolina, jaskatz@gmail.com
|
| Abraham Wandersman, University of South Carolina, wandersman@sc.edu
|
|
When developing and enhancing recovery-oriented programming, the Getting To Outcomes (GTO) ® framework (Chinman, Imm, and Wandersman, 2004) may be beneficial in improving the quality of services. GTO is well suited to help organizations develop organic recovery programming that is tailored to the strengths and needs of the individual, while still fitting within the capacities of the organization and the community. This overview will outline the methods by which GTO can be utilized to develop programming within a Recovery-Oriented System of Care (ROSC). The ROSC model is research-based, outcome-driven, and requires ongoing monitoring and feedback for systems improvement (Laudet and White, 2010). GTO meets these standards through systematically including the evidence base, matching these practices with current needs of the individual receiving services, and providing feedback and data to insure continuous quality improvement. The use of GTO to develop and administer treatment for pregnant, substance-abusing women will be described.
| |
|
Session Title: Pre-K - 12 Educational Evaluation TIG Business Meeting
|
|
Business Meeting Session 545 to be held in San Simeon B on Thursday, Nov 3, 6:10 PM to 7:00 PM
|
|
Sponsored by the Pre-K - 12 Educational Evaluation TIG
|
| TIG Leader(s): |
|
Tom McKlin, The Findings Group, tom@thefindingsgroup.com
|
|
Manolya Tanyu, American Institutes for Research, mtanyu@air.org
|
|
Chad Green, Loudoun County Public Schools, chad.green@loudoun.k12.va.us
|
|
Sheila Robinson Kohn, University of Rochester, sbkohn@rochester.rr.com
|
