| Session Title: The New Era of Performance Evaluation in Korean Evaluation System |
| Multipaper Session 424 to be held in Room 112 in the Convention Center on Thursday, Nov 6, 4:30 PM to 6:00 PM |
| Sponsored by the Research, Technology, and Development Evaluation TIG |
| Chair(s): |
| Young-Wha Cho, Korea Institute of Science & Technology Evaluation and Planning, yhcho@kistep.re.kr |
| Abstract: There has been increased requirement on the accountability and efficiency of national R&D programs in according to the increased R&D investment within the limited national resources. To cope with these issues, each government is trying to promote its R&D capability by implementing S&T basic plans and Korea is also trying to upgrade national S&T capability under the guidance of NSTC (National S&T Committee). With the limited government resource and increasing demand for the accountability, performance assessment of government R&D for public accountability is increasingly gaining attention. To increase the efficiency and effectiveness of national R&D programs, Korean government has actively been evaluating over two hundreds national R&D programs funded by the government every year, through performance evaluation system. In this session, Korea's expertise and experience in R&D performance evaluation, the relation between performance evaluation and national budget and new approach of evaluation system in Korea are being presented and discussed. |
| Reformation of Research and Development Program Performance Evaluation System |
| Jong Sung Im, Ministry of Strategy and Finance, jsim114@mosf.go.kr |
| Apart from general finance program, the unique performance evaluation at R&D program has been conducted since 1999. In Feb. 2008, the function of performance evaluation at R&D program transferred from National Science and Technology Council (NSTIC) to Ministry of Strategy and Finance (MOSF) due to amendment of reformation of the government organization law and related laws. Upon this opportunity, MOSF lays and promotes a scheme of reorganizing R&D program performance evaluation system of ‘Practical R&D program performance evaluation’ through ‘Choice and Concentration’. In the meantime, the investment of R&D program has been increased, on the other hand, it has been being pointed out continuously that the performance evaluation system is inefficient and ineffective. From this situation, responding to the R&D investment expansion, MOSF is planning to reform the R&D performance evaluation system in order to support the R&D investment efficiency through simplification of evaluation, reinforcement of department self-evaluation, in-depth analysis and the strong connection between evaluation result and setting budgetary. |
| Use of Performance Evaluation Information of Research and Development Program in Budgeting Process in Korea |
| Boo-jong Kil, Korea Institute of Science and Technology Evaluation and Planning, kbjok@kistep.re.kr |
| Su-dong Park, Korea Institute of Science and Technology Evaluation and Planning, triznik@kistep.re.kr |
| In-ja Kim, Korea Institute of Science and Technology Evaluation and Planning, kij@kistep.re.kr |
| The introduction of performance information into the budget processes is an important initiative that is widespread across OECD countries (OECD, 2007). Some people believe that the use of performance information in budgetary decision making can contribute to improving program management and efficiency. Recently, Korean government (especially, Ministry of Science and Technology, Ministry of Planning and Budget) is trying to use performance evaluation information of government R&D program in budgeting process. In this paper, we will divide Korean government's efforts to link performance evaluation and budget of R&D program into 3 phases and analyze this evolutionary process, and give some recommendations to improve this linking system. |
| Performance Evaluation of National Research and Development in the Field of Environmental Technology With Respect to Science and Technology Classification |
| Noeon Park, Korea Institute of Science and Technology Evaluation and Planning, ecoenv@kistep.re.kr |
| HyunJung Cho, Korea Institute of Science and Technology Evaluation and Planning, chohj@kistep.re.kr |
| Seung Jun Yoo, Korea Institute of Science and Technology Evaluation and Planning, biojun@kistep.re.kr |
| Yule Shin, Korea Institute of Science and Technology Evaluation and Planning, shinyule@kistep.re.kr |
| Moon Jung Choi, Korea Institute of Science and Technology Evaluation and Planning, mjchoi@kistep.re.kr |
| Sang-youb Lee, Korea Institute of Science and Technology Evaluation and Planning, sylee@kistep.re.kr |
| Various research and development (R&D) classification systems in Korea have been used to plan and evaluate programs efficiently. Two kinds of classification systems (national and institutional) are mostly used to investigate national R&D in the field of environmental technology. Although both systems have been applicable for performance evaluation in environmental technology, they consist of different categories and scope. It is known that it is difficult to classify environmental technology in terms of division, discipline, and subject because a half of classified research area is overlapped. Until now, environmental technology R&D programs in Korea have simply been evaluated by numbers of each output, for example, 'how many papers were published?' In this study, firstly, performances in the R&D are further qualitatively analyzed in terms of two kinds of classification systems. Secondly, new classification system will be provided to be helpful to evaluate environmental technology R&D programs with customized classification system. |
| Evaluation of Technology Level Using a Dynamic Method on the Critical Technologies in the 2nd Science and Technology Basic Plan of Korea |
| Soon Cheon Byeon, Korea Institute of Science and Technology Evaluation and Planning, sbyeon@kistep.re.kr |
| Jiyeon Ryu, Korea Institute of Science and Technology Evaluation and Planning, jiyeon@kistep.re.kr |
| Moon Jung Choi, Korea Institute of Science and Technology Evaluation and Planning, mjchoi@kistep.re.kr |
| Pyengmu Bark, Pukyong National University, barkpm@pknu.ac.kr |
| Hyuck Jai Lee, Korea Institute of Science and Technology Information, hlee@kisti.re.kr |
| It is important to evaluate the exact technology level for the establishment of strategic national R&D policy. In the 2nd S&T basic plan of Korea, there are 90 critical technologies which is urgent for Korea to expand its S&T capability. But an implementation plan such as technology roadmap is yet to be prepared. As a first step for this process, Korean government evaluated its critical technologies and set up development strategy for these critical technologies. In this research, a dynamic method was applied to evaluate the exact technology level. In addition to the common evaluation of the relative position of Korea’s technology level compared to the world best level, the possible maximum level of the technology and the rate of technology changes were measured to propose possibilities of catching-up, if any. In this paper the dynamic evaluation process and the result with the optimal R&D strategy are described. |