| Session Title: Performance Measurement and Evaluation at the Bureau of Health Professions, Health Resources and Services Administration |
| Multipaper Session 724 to be held in Huntington B on Friday, Nov 4, 2:50 PM to 4:20 PM |
| Sponsored by the Government Evaluation TIG |
| Chair(s): |
| Cassandra Barnes, Health Resources and Services Administration, cbarnes1@hrsa.gov |
| Abstract: The Bureau of Health Professions administers a number of health profession training grant programs authorized by Title VII and Title VIII of the Public Health Service Act. The grants go to health professions schools and training programs across the United States to develop, expand and enhance training and to improve the distribution of the health care workforce. The passage of the Affordable Care Act and the GPRA Modernization Act have brought renewed interest and increased scrutiny to the performance of the Bureau's programs. This session will provide an overview of the response of the Bureau of Health Professions to this increased concentration on program performance as well as several examples of the current activities initiated in response. |
| Overview of the Performance Measurement and Evaluation Strategy |
| Sandra Abbott, Food and Drug Administration, sandra.abbott@fda.hhs.gov |
| Roger Straw, Health Resources and Services Administration, rstraw@hrsa.gov |
| This presentation will provide the necessary context about the Bureau's programs in order to understand the performance measurement and evaluation strategy. The strategy relies on several building blocks that are mutually reinforcing. Our Funding Opportunity Announcements (FOA) include guidance on performance measurement and evaluation to potential applicants so that they are aware of our evaluation expectations even before receiving grant funding. FOA's also include application review criteria associated with individual grantee level evaluation activities. We have made significant investments in training our program staff and in providing technical assistance to grantees about evaluation. We regularly conduct program reviews that rely on available performance data and evaluation results. We have completed a systematic process using logic modeling and other techniques that completely changed our approach to performance data collection. Finally, we have implemented a strategy for longitudinal data collection that will support impact evaluations of our programs in the future. |
| Using Logic Models to Rediscover the Value of Diversity Programs: Logic Model to Longitudinal Outcomes |
| Cassandra Barnes, Health Resources and Services Administration, cbarnes1@hrsa.gov |
| Evidence indicates that diversity is associated with improved access to care for racial and ethnic minority patients, greater patient choice and satisfaction, and better educational experiences for health professions students. Recognizing the need for diversity in the healthcare workforce, the Bureau of Health Professions aims to increase the diversity in the Nations' health workforce by providing funding to health professions schools to increase educational opportunities for disadvantaged students. What data is appropriate to collect on an individual participant level and in aggregate from grantees that will inform us most about health workforce diversity over time? A longitudinal study will provide information on retention of participants in primary care. Logic models set the foundation for describing legislative intent and program performance. The Division of Workforce and Performance Management will present the results of a collaborative process among stakeholders on creating improved performance measures and longitudinal outcomes. |
| Building Internal Capacity: Results of the Bureau of Health Professions Program Review Template |
| Courtney Pippen, Health Resources and Services Administration, cpippen@hrsa.gov |
| The Bureau of Health Professions has developed a program review template and user guide. The intent of the template is to allow program staff, or an independent evaluator, to systematically review the available qualitative and quantitative information about a program and to document their analyses and findings. The results are used to respond to routine requests for information as well as to guide and facilitate BHPr internal program evaluation efforts. Additionally, the participation of program staff in the review activities gives them a better appreciation of the value of evaluation. The template is broad enough to accommodate the range of purposes inherent in the Bureau's programs while allowing for flexibility for customization. The template has been used to review two BHPr programs; the Geriatric Education Center program and the Advanced Nursing Education Program. Additional programs will be reviewed. Lessons learned about both the programs and the template will be shared. |
| Impact of Medical School Funding on Physician Outcomes |
| Aisha Faria, Health Resources and Services Administration, afaria@hrsa.gov |
| The Bureau of Health Professions administers a number of health profession training grant programs authorized by Title VII and Title VIII of the Public Health Service Act. The grants go to health professions schools across the United States to develop, expand and enhance training and to improve the distribution of the health care workforce. This evaluation focuses on the impact of funding provided to U.S. medical schools between 1996-2009 on the diversity, supply, and distribution of the primary care physician workforce. The Association of American Medical Colleges will compile and link data from various internal and external sources and BHPr will use the data to analyze practice-level outcomes, graduate characteristics and the quality of education and their relationship with medical schools receipt of Title VII funding. This paper will provide an explanation of the methodology used in the study, present some of the results, and describe plans for additional analyses. |