| Session Title: New Direction of Research and Development Performance Evaluation System in Korea |
| Multipaper Session 234 to be held in Manhattan on Thursday, Nov 3, 8:00 AM to 9:30 AM |
| Sponsored by the Research, Technology, and Development Evaluation TIG |
| Chair(s): |
| Donghoon Oh, Korea Institute of Science & Technology Evaluation and Planning, smile@kistep.re.kr |
| Abstract: Back in the last couple of decades, the performance of Research & Development (R&D) has been dramatically increased in terms of quantitative efficiency, such as the number of publication and patent. During the past era, quantitative efficiency was the main perspective in performance evaluation of national R&D in Korea, which could lead to improvement of national S&T competitiveness, even though qualitative excellence has been stalled so far. Therefore, for five years from now, at least, the performance evaluation system of national R&D in Korea will drive into qualitative excellence from the past quantitative values, which will be in forced under '2nd R&D Performance Evaluation Basic Plan.' This session consists of 4 presentations which are the major issues of R&D performance evaluation system in Korea, evaluation system of Government-funded Research Institutes, and two evaluation practices. |
| New Direction of National Research and Development Evaluation System in Korea: From Quantity/Efficiency into Quality/Effectiveness |
| Seung Jun Yoo, Korea Institute of Science & Technology Evaluation and Planning, biojun@kistep.re.kr |
| ChangWhan Ma, National Science and Technology Commission, changma@nstc.go.kr |
| National R&D competitiveness can be achieved through advancing technology after optimized investment and excellent performance. In terms of performance evaluation, it can be either promoter or inhibitor for better performance. And quantity and quality usually cannot be compatible with each other, even though it could not be better if they are compatible. Since we have achieved quantitative efficiency of national R&D performance which could lead to enhancement of science & technology competitiveness somehow, we are at the transition point to upgrade our position from quantitative efficiency into qualitative excellence and effectiveness, which will lead to stronger competitiveness of science & technology more in substance. This presentation will introduce the action plan to achieve the main goal, shift from quantity/efficiency to quality/effectiveness. |
| Evaluation System of Government-funded Research Institutes (GRIs) in Korea |
| Woo Chul Chai, Korea Institute of Science & Technology Evaluation and Planning, wcchai@kistep.re.kr |
| With the increase of national investment in R&D, the demand for accountability and effectiveness of national R&D investment has been increased. Especially in the investment of government-funded research institutes (GRIs), which accounts for about 25% of national R&D fund, the demand for excellent R&D performances of GRIs is increasing through effective allocation of their R&D investment. The purpose of the study is to review the history and current evaluation systems of GRIs in S&T areas, which conducts the evaluation of both research results and management performances. It also shows how qualitative evaluation methods are applied for promoting the R&D performances of GRIs and the accomplishment of appropriate roles suitable for national S&T development strategy. |
| Conjoint analysis for Contract Strategy for Culture Technology Enhancement Program |
| Yun Jong Kim, Korea Institute of Science & Technology Evaluation and Planning, yjkim@kistep.re.kr |
| Uk Jung, Dongguk University, ukjung@dongguk.edu |
| This paper aims to calculate relative importance of each attribute of a R&D program organization which is related to promote the Culture Technology enhancement. Conjoint analysis can be used for choice simulation and can determine the best design. A series of interviews were conducted to identify and derive critical attributes for R&D program related to Culture Technology. Conjoint instrument was constructed using attributes identified and administered among actual researchers. Research period, research expenses, types of industry-academia research collaboration, and types of multidisciplinary collaborative research were found to be the most highly valued attributes of the Culture Technology R&D programs. We examine the preferences of various groups of researchers, including industry researchers, academic researchers, and researchers in research institute, using conjoint analysis. The results of this paper are expected to provide valuable information for the evaluator and planner of the Culture Technology R&D programs. |
| Performance Factors in Industry-University Collaboration |
| Youngsoo Ryu, Korea Institute of Science & Technology Evaluation and Planning, soory@kistep.re.kr |
| Hongbum Kim, Korea Institute of Science & Technology Evaluation and Planning, hbkim@kistep.re.kr |
| Industry-university collaboration in government-sponsored program includes various activities between two groups. This study is to empirically explore the factors influential to industry-university collaboration in government-sponsored program. Multiple regression analysis and t-test are conducted based on a survey. It is predicted that some activities (resource sharing, communication etc.) are verified to be the major factors. In addition, the findings will also reveal that there are the perceptional differences on the factors between two groups. |