Return to search form  

Session Title: Closing the Loop: Mapping Value to Inform Research Management
Multipaper Session 124 to be held in Royale Board Room on Wednesday, November 7, 4:30 PM to 6:00 PM
Sponsored by the Research, Technology, and Development Evaluation TIG
Chair(s):
Neville Reeve,  European Commission,  neville.reeve@ec.europa.eu
A Framework for Evaluating Large Scale AIDS Clinical Research Networks
Presenter(s):
Jonathan Kagan,  National Institutes of Health,  jkagan@niaid.nih.gov
Mary Kane,  Concept Systems Inc,  mkane@conceptsystems.com
Kathleen M Quinlan,  Concept Systems Inc,  kquinlan@conceptsystems.com
William Trochim,  Cornell University,  wmt1@cornell.edu
Daniel Montoya,  Hill and Knowlton,  daniel.montoya@hillandknowlton.com
Melissa Burns,  Concept Systems Inc,  mburns@conceptsystems.com
Brendan Cole,  National Institutes of Health,  bcole@niaid.nih.gov
Abstract: The National Institute for Allergy and Infectious Diseases' Division of AIDS has completed a restructure of its multimillion dollar clinical trials networks. An evaluation system is being designed to support the goals of the restructure. To begin the system design, the primary research question focused on defining success of the newly coordinated clinical research networks. With the broadest participation of network communities, a structured conceptualization methodology was adapted to this context to create a collaboratively authored framework. The framework contains 100 detailed ideas organized into higher level themes. Major concepts include collaboration and communication, community input, setting research priorities, coordinated strategic planning of the research agenda, and progress on biomedical objectives. The map framework was transformed into a program logic model, from which specific measures are being developed, and evaluation data collection systems are being identified.
Analysis of Follow-up Evaluation Results of Research and Development (R&D) Projects Applying Logic Model to Elucidate the Process of Innovation
Presenter(s):
Kazuki Ogasahara,  Ministry of Economy, Trade and Industry,  ogasahara-kazuki@meti.go.jp
Osamu Nakamura,  National Institute of Advanced Industrial Science and Technology,  osamu.nakamura@aist.go.jp
Kazuyuki Inahashi,  Ministry of Economy, Trade and Industry,  inahashi-kazuyuki@meti.go.jp
Chikahiro Miyokawa,  Ministry of Economy, Trade and Industry,  miyokawa-chikahiro@meti.go.jp
Yoshitaka Kimura,  Ministry of Economy, Trade and Industry,  kimura-yoshitaka@meti.go.jp
Abstract: In the Ministry of Economy, Trade and Industry (METI), the follow-up evaluations of eleven big R&D projects have ever been implemented since 2000 to investigate and analyze the effectiveness of R&D projects to produce the socio-economic outcomes toward innovation. This time, we have applied the logic model for each project based on actual follow-up evaluation results of R&D projects to learn about the logical chains from project outputs to socio-economic outcomes through many steps of intermediate outcomes. With this study, useful lessons to implement R&D projects will be acquired to produce outcomes toward innovation. Our points of issue are to apply the logic model to analyze the results of follow-up evaluation of R&D projects to review the innovation processes, and thus to implement the strategic planning and evaluation of the promising R&D projects.
Contribution of Evaluation to Management of Research and Development (R&D) in the Process of Technology Transfer: A Knowledge Value Mapping Approach
Presenter(s):
Juan Rogers,  Georgia Institute of Technology,  juan.rogers@pubpolicy.gatech.edu
Abstract: This paper will review the current theoretical frameworks that are used in R&D evaluation and propose a knowledge value mapping approach to the realization of value from knowledge creation activities. Oftentimes, the desired impact of research is conceived of in terms of its application as a result of a process of technology transfer from its source in research to a new context of application either commercial or mission oriented. We will use several cases of scientific and technological research to propose more general categories of the realization of values from the creation and utilization of knowledge and apply them in a set of procedures that comprise a knowledge value mapping approach to R&D evaluation. The management benefits will be presented based on experiences of application in the context of rehabilitation research in the US and the design of an evaluation framework for the national policy of a South American country.
Search Form