| Session Title: Engaging Stakeholders in the Scientific Enterprise: Using Concept Mapping for Research Priority Setting and Participatory Evaluation |
| Multipaper Session 809 to be held in Centennial Section H on Saturday, Nov 8, 8:00 AM to 9:30 AM |
| Sponsored by the Research, Technology, and Development Evaluation TIG |
| Chair(s): |
| Scott Rosas, Concept Systems Inc, srosas@conceptsystems.com |
| Discussant(s): |
| Scott Rosas, Concept Systems Inc, srosas@conceptsystems.com |
| Abstract: Recent transformation of the scientific research enterprise has led to a corresponding need for participatory methods that involve stakeholders in shaping directions for future research. This session examines multi-level stakeholder involvement and contributions across three projects focused on the planning and evaluation of scientific priorities. The first project engaged researchers and agency staff to co-construct a framework of success factors for evaluating an emerging infectious disease research program. The second project engaged internal and external stakeholders, including funding agency staff, researchers and collaborators of a multi-site research network, to identify cancer research priorities. The third project engaged residents, organizational associates, managers, and executives, family members, and experts to develop a community-articulated research agenda for future geriatric and aging research. This panel will summarize the common methodology, highlight its use across the three projects, and conclude with a discussion of the involvement of stakeholders at multiple levels. |
| Defining Success for the National Institute of Allergy and Infectious Diseases' Regional Centers of Excellence in Biodefense and Emerging Infectious Diseases Research Program: A Co-Authored Evaluation Framework and Plan |
| Mary Kane, Concept Systems Inc, mkane@conceptsystems.com |
| Kathleen M Quinlan, Concept Systems Inc, kquinlan@conceptsystems.com |
| The National Institute of Allergy and Infectious Diseases (NIAID) Regional Centers of Excellence in Biodefense and Emerging Infectious Diseases Research Program was first funded in 2003, as part of a large funding allocation for biodefense. Given the newness, the broad mandate and the innovative approaches of the program, an evaluation of its first five years was planned. The concept mapping methodology provided a rigorous, structured approach for scientists to articulate the conceptual model underlying their endeavor, a major challenge in this type of evaluation. Center researchers and agency staff co-constructed a framework of success factors that served as the foundation upon which a task force of leaders within NIAID and the RCEs collaboratively identified evaluation questions and measures. This thorough, participatory planning process set the stage for participant commitment to, involvement in and acceptance of the interim evaluation. |
| Identifying Research Priorities for the National Cancer Institute's Cancer Research Network: Developing a Collaboratively Authored Conceptual Framework |
| Kathleen M Quinlan, Concept Systems Inc, kquinlan@conceptsystems.com |
| Katy Hall, Concept Systems Inc, khall@conceptsystems.com |
| Leah Tuzzio, Group Health Care Cooperative, tuzzio.l@ghc.org |
| Wendy McLaughlin, National Institutes of Health, wendy.mclaughlin@nih.hhs.gov |
| Ed Wagner, National Institutes of Health, wagner.e@ghc.org |
| Martin Brown, National Institutes of Health, mbrown@mail.nih.gov |
| Robin Yabroff, National Institutes of Health, robin.yabroff@nih.hhs.gov |
| Entering its third 5-year funding cycle, the National Cancer Institute's (NCI) Cancer Research Network (CRN), consisting of 14 integrated health systems nationwide, is a cooperative research grant that encourages the generation of new research ideas and increased involvement by other cancer researchers. To support research agenda planning and decision-making, the CRN sought stakeholder input on scientific research priorities. Key leaders brainstormed 98 research topics and then used the concept mapping approach to organize the ideas conceptually. Both internal and external CRN stakeholders those directly involved with the network and those with an interest in cancer research were invited to rate the ideas to determine CRN research priorities. The framework includes elements related to the biological, behavioral, and economic aspects of cancer; informatics and diffusion research; and aspects of the healthcare system, setting a research agenda that will improve the quality and effectiveness of preventive, curative, and supportive interventions for cancer. |
| Setting the Research Agenda with Communities |
| Mary Kane, Concept Systems Inc, mkane@conceptsystems.com |
| This initiative yielded a collaboratively authored comprehensive framework to guide the selection of future research programs in the field of aging and wellness. The Institute for Optimal Aging (IOA) stakeholders were residents of three senior living communities in the Chicago area; professional and para-professional associates who provide care giving and programming to the residents; executives and field employees operational corporation, and academics and researchers in geriatrics. Participants used a mix of web-based and on-site methods for collecting and organizing data; this input created the conceptual framework of priority research areas on aging. Through document review and key informant interviews, the conceptual research framework was enriched and rendered more relevant to future research needs in geriatrics. The benefits of engaging residents, associates and academics in one endeavor included greater depth in the research framework, and a strong sense of contributing to future geriatric research. |