2010 Banner

Return to search form  

Contact emails are provided for one-to-one contact only and may not be used for mass emailing or group solicitations.

Session Title: Improving Proposals and Programs by Improving Peer and Stakeholder Review
Multipaper Session 886 to be held in BONHAM E on Saturday, Nov 13, 2:50 PM to 4:20 PM
Sponsored by the Research, Technology, and Development Evaluation TIG
Chair(s):
George Teather,  George Teather and Associates, gteather@sympatico.ca
Using Fishbone Analysis to Improve the Quality of Science and Technology Program Proposals
Presenter(s):
Shan-Shan Li, National Applied Research Laboratories, ssli@mail.stpi.org.tw
Ling-Chu Lee, National Applied Research Laboratories, lclee@mail.stpi.org.tw
Abstract: The paper mainly discusses that using the tool of “fishbone diagram” will assist S&T program managers and staffs improve the evaluation quality of S&T program proposals. By using the tool, they can make “good” connection between problems, goals, objectives, and measurable indicators. The paper will have several parts: (1) to realize the importance of fishbone diagram in program planning and quality improvement of the proposals; (2) to know the essence of using fishbone diagram, by combining “AusAID’s logical framework approach (LFA)” with “MECE principle in MintoPyramidPrinciple” ;(3) to develop seven steps from fishbone diagram to reverse fishbone diagram, and involve stakeholders in the process ;(4) to take one of Taiwan S&T programs proposals as an example to demonstrate the usage of fishbone diagram. In the manner, the paper hopes to emphasize fishbone analysis is an necessary program planning tool so as to produce the significant outputs, outcomes, even impacts in the future.
Improving the Professionalism of Peer Review Panel in Research and Development (R&D) Evaluation : The Korean Case
Presenter(s):
Chan Goo Yi, Pukyong National University, changoo@pknu.ac.kr
Boojong Gill, Korea Institute of Science & Technology Evaluation and Planning (KISTEP), kgjok@kistep.re.kr
Abstract: It has been discussed that R&D evaluation system in Korea has been well established, so that it provided consultations to the South-Eastern countries including Vietnam. However, in contrast to the institutionalization of the evaluation system, stake-holders have not satisfied with the R&D evaluation itself. While scientist evaluated cannot trust R&D evaluation results because of its low professionalism, the governments to commission the evaluation have no willings to actively utilize evaluation findings due to its low professionalism and lacks of details of recommendations. Thus, the negative perception of the professionalism in R&D evaluation may cause the low credibility of evaluation and its under utilization, which, in turn, can make to deepen the distrust of the R&D evaluation itself. For this reason, this work aims to investigate which are critical factors to low professionalism in Korean R&D evaluation and discuss how to solve these problems.
Interactive Heuristic Reviewing Mechanism: A New Method of Assessing Exploratory Pioneering Research Projects for National Nature Science Foundation of China (NSFC)
Presenter(s):
Yue Wang, Chinese Academy of Sciences, wy71800@yahoo.com.cn
Xiaoxuan Li, Chinese Academy of Sciences, xiaoxuan@casipm.ac.cn
Jianzhong Zhou, Chinese Academy of Sciences, jzzhou@casipm.ac.cn
Yonghe Zheng, National Nature Science Foundation of China, zhengyonghe@gmail.com
Guoxiang Xiong, Chinese Academy of Sciences, gxxiong@cashq.ac.cn
Abstract: In this proposal, an interactive heuristic reviewing mechanism is proposed that could be used for National Nature Science Foundation of China (NSFC) to assess exploratory pioneering research projects. First, exploratory pioneering research projects are defined and the characteristics of such projects are summed up. Moreover, the problems of existing related reviewing mechanisms at NSFC are analyzed. Second, several typical mechanisms which are applied for science funding agencies in other countries to assess related research projects are analyzed and compared. Finally, based on preliminary research, taking mechanism design theory as macro theoretical guidance, an interactive heuristic reviewing mechanism is presented, which include the main principle of this assessing method, the model of this reviewing mechanism and its specific process. This new mechanism which could provide instant interactive environment for both reviewers and applicants is in a proactive mode to identify worthy of funding projects efficiently for NSFC.

 Return to Evaluation 2010

Add to Custom Program