| Session Title: Impact Evaluation for Public Research and Development Program in Japan |
| Multipaper Session 855 to be held in Centennial Section H on Saturday, Nov 8, 10:45 AM to 12:15 PM |
| Sponsored by the Research, Technology, and Development Evaluation TIG |
| Chair(s): |
| Yasukuni Okubo, Ministry of Economy Trade and Industry, okubo-yasukuni@meti.go.jp |
| Abstract: Japan has been promoting science and technology development program under the Basic Plan for Science and Technology Law. Since then the evaluation has took a key role for producing impacts from the development. The scope of public R&D program covers a wide range from high risk basic research to technology development for industrialization and the impacts produced are diversified. Today, the impact evaluation draws upon diffusion of innovations in the world, which describes how social change occurs. In this changing context, we discuss impact evaluation methods proper to measure public R&D program. |
| Effective Methods to Evaluate Impacts of Meti Projects: New Approaches for Logic Model Development to Find Paths Between Research and Development Outputs and Objectives |
| Kazuki Ogasahara, Ministry of Economy Trade and Industry, ogasahara-kazuki@meti.go.jp |
| Yasukuni Okubo, Ministry of Economy Trade and Industry, okubo-yasukuni@meti.go.jp |
| Chikahiro Miyokawa, Ministry of Economy Trade and Industry, ogasahara-kazuki@meti.go.jp |
| We challenge to develop an effective method to make clear the path between outputs and objectives of R&D projects implemented in Ministry of Economy, Trade and Industry (METI). Logic model is a tool available to capture the path and to delineate missing elements. 'Missing Middle', which represents the missing element, often emerges between the seed side and the objective side and is crucial to evaluate the project impacts. To fill the 'Missing Middle', we develop logic models of several METI projects from the objective side. The data based on are scenario, technical overview and roadmap in 'Strategic Technology Roadmap' published by METI. The results indicate paths and their outcome indicators to evaluation the project impacts. |
| Case Study and Analysis for Economic and Social Impact on National Research and Development Project Based on the Results of Follow-Up Monitoring and Evaluation at NEDO |
| Takahisa Yano, New Energy and Industrial Technology Development Organization, yanotkh@nedo.go.jp |
| Mitsuru Takeshita, New Energy and Industrial Technology Development Organization, takeshitamtr@nedo.go.jp |
| Hideaki Takamatsu, New Energy and Industrial Technology Development Organization, |
| Tsutomu Kitagawa, New Energy and Industrial Technology Development Organization, |
| Tsunekazu Asano, New Energy and Industrial Technology Development Organization, |
| Kazuaki Komoto, New Energy and Industrial Technology Development Organization, kohmotokza@nedo.go.jp |
| Momoko Okada, New Energy and Industrial Technology Development Organization, yanotkh@nedo.go.jp |
| Momoko Okada, New Energy and Industrial Technology Development Organization, okadammk@nedo.go.jp |
| Hiroyuki Usada, New Energy and Industrial Technology Development Organization, |
| Hiroyuki Usada, New Energy and Industrial Technology Development Organization, |
| NEDO is a funding agency for promoting the development of advanced industrial, environmental, new energy and energy conservation technology. NEDO needs to improve its performance through evaluation activities. Follow-up monitoring and evaluation were started with the purpose of understanding R&D short-term outcomes and utilizing the results of monitoring to improve NEDO's R&D management. In order to understand the current statuses of the completed projects, their ex-post activities including further R&D and commercialization are monitored for a period of 5 years. In this session, we discuss the economic and social impact of the project completed in 5 years ago based on the results of the follow-up monitoring. Using case study analysis, we also introduce some remarkable results in detail and identify the relationship between ex-post evaluations and follow-up monitoring. |
| Measurement of Economic Impact on National Research and Development Program and Cost Benefit Analysis at NEDO |
| Kazuaki Komoto, New Energy and Industrial Technology Development Organization, kohmotokza@nedo.go.jp |
| Mitsuru Takeshita, New Energy and Industrial Technology Development Organization, takeshitamtr@nedo.go.jp |
| Hideaki Takamatsu, New Energy and Industrial Technology Development Organization, |
| Tsutomu Kitagawa, New Energy and Industrial Technology Development Organization, |
| Tsunekazu Asano, New Energy and Industrial Technology Development Organization, |
| Takahisa Yano, New Energy and Industrial Technology Development Organization, yanotkh@nedo.go.jp |
| Outcome survey covered 6 technology areas has been conducted in the past three years for the purpose of understanding mid- and long-term economic and social impact of R&D programs. In this research, we deal with national photovoltaic (PV) R&D programs. Solar energy is one of several promising clean energy sources that contribute to a stable energy supply and mitigation of global environmental issues. The Japanese government has been promoting PV R&D through initiatives such as the 'Sunshine Program' and 'New Sunshine Program' since 1974. Recently, Japan has achieved the highest PV production and installation levels in the world. We studied the relationship between national PV R&D programs and PV industry through interviews with project participants. Based on these results, we have discussed how to grasp the outcome additionality of PV R&D programs using econometric approach. We also tried to measure economic impact of the programs and studied cost benefit analysis. |