| Session Title: Evaluating Large Transdisciplinary Initiatives: The Use of Bibliometric Techniques to Assess the Quality and Quantity of Research Productivity |
| Multipaper Session 843 to be held in the Granite Room Section B on Saturday, Nov 8, 9:50 AM to 10:35 AM |
| Sponsored by the Health Evaluation TIG |
| Chair(s): |
| Richard Moser, National Institutes of Health, moserr@mail.nih.gov |
| Abstract: Over the past few decades there has been a growing interest in the development and evaluation of large initiatives intended to promote transdisciplinary collaborations in research. As investments in these team science initiatives have grown and debates about their scientific and societal value have ensued, a calls for the evaluation of the effectiveness of these programs has become more pronounced in recent years. A variety of methods and measures evaluating these large initiatives have been explored. This session will show how bibliometric studies are being utilized to evaluate one such large research initiative, the Transdiciplinary Tobacco Use Research Centers (TTURCs). Two bibliometric methods that are being used to assess the scientific outcomes of the TTURC initiative will be presented: one that uses an interrupted time series design with a comparison group; the other focused on the utilization of science mapping techniques in assessing the evolution of TTURC publications in the tobacco research field as a whole. |
| A Bibliometric Study of the Productivity of the Transdisciplinary Tobacco Use Research Centers (TTURCs) with a Comparison Group |
| Annie Xuemei Feng, National Institutes of Health, fengx3@mail.nih.gov |
| David Berrigan, National Institutes of Health, berrigad@mail.nih.gov |
| James Corrigan, National Institutes of Health, corrigan@mail.nih.gov |
| Stephen Marcus, National Institutes of Health, marcusst@mail.nih.gov |
| Glen Morgan, National Institutes of Health, gmorgan@mail.nih.gov |
| Richard Moser, National Institutes of Health, moserr@mail.nih.gov |
| Mark Parascandola, National Institutes of Health, paramark@mail.nih.gov |
| Lawrence S Solomon, National Institutes of Health, solomonl@mail.nih.gov |
| Daniel Stokols, University of California Irvine, dstokols@uci.edu |
| Brandie Taylor, National Institutes of Health, taylorbr@mail.nih.gov |
| The Transdisciplinary Tobacco Use Research Centers (TTURCs) are one of the large research initiatives funded by the National Cancer Institute and were initiated in 1999. As one part of the evaluation of this initiative, this bibliometric study aims to examine the pattern of productivity of TTURC researchers before and after they were funded. Utilizing an interrupted control-series design (Campbell, 1969), this bibliometric study will examine how TTURC investigators' productivity was similar or different from that of tobacco research investigators who were funded under the traditional R01 grant mechanism during the same period of time. Bibliometric indexes such as publication counts, citations, number of expected citations, journal impact factors, statistics on cited and citing journals, and a journal disciplinary index reflecting the multidisciplinarity of cited or citing journals will be utilized and presented. |
| Mapping Transdisciplinary Tobacco Use Research Centers (TTURC) Publications onto the Landscape of the Tobacco Research Field |
| Katy Borner, Indiana University, katy@indiana.edu |
| David Berrigan, National Institutes of Health, berrigad@mail.nih.gov |
| James Corrigan, National Institutes of Health, corrigan@mail.nih.gov |
| Annie Xuemei Feng, National Institutes of Health, fengx3@mail.nih.gov |
| Stephen Marcus, National Institutes of Health, marcusst@mail.nih.gov |
| Glen Morgan, National Institutes of Health, gmorgan@mail.nih.gov |
| Richard Moser, National Institutes of Health, moserr@mail.nih.gov |
| Mark Parascandola, National Institutes of Health, paramark@mail.nih.gov |
| Lawrence S Solomon, National Institutes of Health, solomonl@mail.nih.gov |
| Daniel Stokols, University of California Irvine, dstokols@uci.edu |
| Brandie Taylor, National Institutes of Health, taylorbr@mail.nih.gov |
| To examine the unique contribution of TTURC research on the overall landscape of the tobacco research field, science mapping techniques will be used to produce a global map of the tobacco research field displaying the comprehensive structure and evolution process of tobacco research. TTURC publications and non-TTURC publications of comparable R01 tobacco researchers will be mapped onto the overall publication matrix for the tobacco research field as a whole over the course of the TTURC initiative. The TTURC research productivity will thus be captured and compared through its convergent and/or divergent development against comparable R01 researchers in the broader context of tobacco research field over the decade. Viable networks such as co-author, author-project and bibliometric indexes such as journal citations, and journal impact factors will be mapped and interpreted. |