|
Results Based Evaluation on the Appraisal Process of a Technology Transfer Program
|
| Presenter(s):
|
| Yukio Kemmochi, Japan Science and Technology Agency, kemmochi@jst.go.jp
|
| Abstract:
Results based evaluation is a powerful management tool with greater accountability (Kusek & Rist). We adopted this method to assess the appraisal process of the Contract Development Program, a technology transfer program that has been overseen by the Japan Science and Technology Agency (JST) for more than fifty years. The appraisal process of the program tends to focus on the technology to be transferred. Meanwhile, as far as the private enterprise is concerned, the technology transfer project is only a part of the company's activities. It is natural to consider that company's general activities and economic environment also impact the development process of a technology transfer projects. In this paper, we evaluate the appraisal process with the commercialization results of the program.
|
|
Assessing the Effects of a Collaborative Research Funding Scheme: An Approach Combining Meta-Evaluation and Evaluation Synthesis
|
| Presenter(s):
|
| Barbara Good, Technopolis Group, barbara.good@technopolis-group.com
|
| Abstract:
The Swiss Innovation Agency CTI has administrated its collaborative research funding scheme since the early 1980s. Between 1989 and 2002 the scheme was evaluated 14 times. In a study combining meta-evaluation and evaluation synthesis, these evaluations were evaluated against the evaluation standards of the Swiss Evaluation Society (http://www.seval.ch/en/standards/index.cfm). The meta-evaluation showed that the evaluations conducted were mostly qualitative, internal and ex post and that evaluation culture at CTI was selective. Only research institutes and firms that carried out a large number of CTI projects were evaluated regularly. Evaluations under study differed in quality, with most evaluation standards being fulfilled fairly to very well. The results of the meta-evaluation were central to the ensuing evaluation synthesis by giving information on the quality of the evaluations. The synthesis compiled the - mostly qualitative - results of the evaluations. There were strong indications that CTI funding does have a variety of effects.
|
|
Best Practices in the Transformation of Research Knowledge to Application: A Case Study
|
| Presenter(s):
|
| George Teather, Performance Management Network, george.teather@pmn.net
|
| Suzanne Lafortune, Performance Management Network, suzanne.lafortune@pmn.net
|
| Abstract:
One of the major issues for science policy and programs relates to the need to improve the linkage between knowledge created through research and its application for public good and private benefit. This difficulty is often described as the 'Valley of Death'.
This presentation presents the results of a recent evaluation of the Natural Resources Canada Clean Electrical Power Generation (CEPG) program that supports R&D to reduce the environmental impact of Canada's electrical power generation system and increase the efficiency of fossil-fuelled power systems. The study examined the mechanisms by which knowledge was generated and applied. The study found that CPEG had engaged many of the major public and private sector stakeholders who need to take up and apply the new and improved technologies developed through the program. In many cases, the stakeholders identify priorities, contribute funding, and help select projects. The study found that the major pathways for the application of R&D knowledge for the private sector was through the development of prototypes, demonstrations and field trials. For the public sector, R&D led to the development of new and revised policies and regulations related to fossil-fuelled power generation and related emissions.
The presentation will use several case studies to show various approaches used by CEPG to engage stakeholders.
|
|
Translating New Knowledge from Technology Based Research Projects: A Randomized Control Study of an End-of-Grant Intervention
|
| Presenter(s):
|
| Vathsala Stone, University at Buffalo, vstone@buffalo.edu
|
| Machiko Tomita, University at Buffalo, machikot@buffalo.edu
|
| Abstract:
The concept of Knowledge Translation (KT) responds to a current concern about obtaining beneficial social impact from research, particularly research sponsored through public funding. This paper will present the methodology and results from a KT intervention study close to completion at the University at Buffalo. The study evaluates a KT strategy for new knowledge generated by technology-based research and development projects. A randomized control design is used to compare effects on Knowledge Use (KU) between the intervention, the traditional dissemination method and a control group. A Level of Knowledge Use Survey (LOKUS) was developed to measure effects. Contextualized Knowledge Packages (CKPs) were developed as KT components. An independent investigation established psychometric soundness of LOKUS. Participants represent six categories of potential K users related to Augmentative and Alternative Communication technology including consumers, manufacturers, brokers, clinicians, policymakers and other researchers. Presentation will cover intervention effects and development of LOKUS and the CKPs.
|
| | | |