Early outcomes of a large four-year MDMPH program: Results of a cross sectional survey of graduates (from three cohorts) ======================================================================================================================== * Julia Belkowitz * Sabrina Payoute * Gauri Agarwal * Daniel Lichtstein * Roderick King * Shirin Shafazand * Latha Chandran ## Abstract To address the public health needs of the 21st century, the University of Miami Miller School of Medicine implemented a four-year MD/ MPH program in 2011 with a mission to graduate public health physician leaders. The first cohort of students graduated in 2015. In the summer of 2020, a survey was sent to graduates to gather information on their early career involvement in the areas of leadership, research, and public health. In addition to several multiple-choice questions, the survey included an open-ended question on the impact of public health training in their careers. Content analysis was used to analyze the responses to the open-ended question. Eighty-two graduates completed the survey; 80 of whom had participated in residency training. Forty-nine (61%) joined a residency in a primary care field. Many graduates had leadership roles in their early careers, including 35 (44%) who were selected as chief residents. Fifty-seven (71%) participated in research, most commonly in quality improvement (40, 50%), clinical (34, 43%) and community based (19, 24%). Over one third (30, 38%) chose to do work in public health during residency. Themes that emerged regarding the impact of public health training on their careers were: 1) Shift in perspective, 2) Value of specific skills related to public health, 3) Steppingstone for professional opportunities 4) Focus on health disparities, social determinants, and inadequacies of the healthcare system, 5) Status as leaders and mentors for peers, and 6) Self-efficacy during the pandemic. Graduates self-reported significant commitment and involvement in leadership, research, and public health as well as towards addressing some of our most pressing public health needs. Although long-term career outcomes need to be determined over time, currently graduates report significant benefits of their public health training for their professional outcomes. ## Introduction It is imperative that the US create a workforce that includes physicians trained in public health who have skills and competencies to address health issues beyond the individual patient to those involving the community and population. In 2007, the Institute of Medicine made a call to enhance public health training among physicians through multiple avenues, including formal degree programs[1]. The COVID-19 pandemic with its associated morbidity, mortality, and strain on our health system has highlighted the importance of social determinants of health and public health infrastructure in ensuring the health of our nation. Physicians who are trained in population and public health sciences play a valuable role in leading a responsive and transformative health system. Over 80 medical schools currently offer opportunities for MPH training for their students, with most requiring a fifth year of training[2]. The number of programs has been increasing over the past decades, with a total of 822 graduates of combined MD/ MPH programs between 2007-2012 and 1,978 students who graduated between 2014-2019 [3,4]. MD/ MPH students self-reported greater levels of leadership, service and research as medical students as compared with MD only or other dual degree peers in a 2020 study reporting outcomes from a self-reported database of over 18,000 senior medical students [5]. Those evaluating career intentions and residency match outcomes comparing MD/ MPH program graduates with MD or other combined degree programs have found that MD/ MPH students are more likely to match in primary care specialties than peers [3,5,6] Krousel-Wood et al surveyed graduates who received public health training from one institution 10-20 years post-graduation and found that those with an MPH were more likely to be employed in academia, primary care, and/ or public health and were more likely to conduct research [7]. However, more detailed understanding of how graduates from other institutions focus their careers in public health, community service, research and leadership are needed, and no studies provide insight into the perceived impact on such training from the graduates themselves. In 2011, with a goal of graduating public health physician leaders, the MD/MPH program at the University of Miami Miller School of Medicine (UMMSM) began enrolling yearly cohorts of about 50 students, thereby making it the largest such program in the country [4]. This cohort completes both degrees within the traditional four years of training in medical school through integration of both the medical school and Master of Public Health curricula. The program is designed to provide students with the academic knowledge and skills, as well as the clinical and public health experience, to improve the health of populations, especially those most vulnerable and underserved. The first cohort graduated in 2015, and there have been 328 MD/ MPH graduates of our program between 2015-2021. The purpose of this study is to describe the early career outcomes of the graduates of the UMMSM four-year MD/ MPH program in the graduating classes of 2015-2017 specifically related to their continued engagement in leadership roles, research, and public health after graduation. ## Methods ### Study design and participants All graduates from the first three cohorts of the UMMSM MD/ MPH (UMM) program were eligible to participate in this cross-sectional survey. All eligible graduates for whom email addresses were available (130/142) were invited to participate in the online survey. The UMMSM Institutional Review Board approved this study (Protocol #20191104). ### Measures Survey items were selected or adapted from surveys available through the American Association of Medical Colleges (AAMC) and other national organizations and finalized by this team of investigators[8,9,10,11,12].Demographic data was collected and included gender identity, marital status, number of dependents, and specialty of residency training as per the AAMC Graduation Questionnaire [8]. Race and ethnicity were defined according to the federal government definitions[9]. Types of residency training program was defined based on the AAMC Program Survey[10]. Graduates were also asked to identify age, graduation year and status of training in residency and fellowship (as applicable). Questions about current workplace setting, were adapted from AAMC and American Academy of Pediatrics surveys [8,11,12]. Items regarding involvement in leadership, advocacy and public health were novel and included yes/ no or multiple responses with the opportunity for free text when graduates affirmed participation in a specific area (Table 1). The single open-ended question was “Please describe the impact of your public health education on your career.” View this table: [Table 1.](http://medrxiv.org/content/early/2022/09/09/2022.09.04.22279585/T1) Table 1. Survey items for leadership, research, and public health ### Data analysis Survey data was collected using Redcap v11.2.2, de-identified for analysis, and reported using tabular counts and descriptive statistics. Free text responses were independently summarized into categories by three investigators (JB, SP, GA) and the group discussed to achieve consensus when there was initial disagreement about the classification. Qualitative analysis was done manually for the one open-ended question using conventional content analysis. Two investigators (JB and SP) independently reviewed the responses and together created a codebook summarizing the definition of the codes and explanation for how to apply the codes during the analysis. Three investigators (JB, SP and GA) then independently reviewed the free responses and applied the codes to the collected data. This team then consolidated the responses into broader categories and used those categories to identify themes that illustrated the perspectives of the participants about their experiences. ## Results ### Demographics characteristics Of the 142 eligible participants, we had contact information on 130 alumni who were then invited to participate. This included 47/48 from the class of 2015 (98%), 45/48 from the class of 2016 (94%), and 38/46 (83%) from the class of 2017. A total of 82 alumni from the three cohorts responded to the questionnaire resulting in a 63% response rate. Demographic characteristics at enrollment in the survey are summarized in Table 2. Females represented 54% of survey respondents (44). Among survey respondents, 62% (51) self-identified as white, 4% (3) Black or African American, 13% (11) Asian, 11% (9) Hispanic, or Latino, or of Spanish origin, 6% multiracial (5), and 4% other race (3). The three cohorts were represented fairly evenly among the respondents. Seventy three percent (60) of respondents claimed zero dependents. Regarding marital status, 55% (45) of survey respondents were married. The average respondent age was 31.6 +/- 1.8 years (range 28 - 36 years). View this table: [Table 2.](http://medrxiv.org/content/early/2022/09/09/2022.09.04.22279585/T2) Table 2. Demographic characteristics of participants ### Residency and fellowship training Of the total of 82 respondents, only 80 (98%) who participated in residency or fellowship training are included in the analysis. Of these, 35 participants had completed their graduate medical education. Details regarding status of training and specialty choice are depicted in Fig 1. Eighteen (23%) participated in a specialized track for residency training. Graduates in a specialized residency track reported to have participated in pathways such as Advocacy/ Community Health (5), Primary Care (4), Global Health (3), and others. ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2022/09/09/2022.09.04.22279585/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2022/09/09/2022.09.04.22279585/F1) Figure 1: UMMSM MD/ MPH Alumni training status ### Leadership, research, and public health Many MD-MPH program graduates reported that they were appointed to a leadership position. Leadership characteristics are summarized in Table 3. Thirty-five (44%) were selected as chief residents. Thirty-eight (48%) listed other leadership activities held as a resident, 12 (15%) held leadership positions in their specialty specific organizations, and ten (12%) have held other state/national leadership positions. Categories of participation included leadership roles within their residency program or representing their residency program such as curriculum committee, Graduate Medical Education Committee representative (n=26); leadership within their specialty specific organization (ex. national delegate or committee chair), (n=18); leadership in research, patient safety, and/ or quality improvement (n=11); leadership regarding specific professional domains in the areas of diversity, wellness, and interprofessional collaboration (e.g. Diversity in Equity and Inclusion Committee), (n=10); leadership in community-based activities (e.g.. Community Health Committee) (n=5); and leadership related to clinical algorithms or skills development (eg. skills lab instructor) (n=4). View this table: [Table 3:](http://medrxiv.org/content/early/2022/09/09/2022.09.04.22279585/T3) Table 3: Leadership, research, and public health post medical school graduation Over half of those who had undergone residency training (n= 42, 53%) reported receiving an award professionally. Categories included awards highlighting their excellence as a resident/clinical skills from either the residency program or the specialty society (n=33); awards for research/ scholarship or patient safety/ quality improvement (n=21); awards for teaching/ humanism/ AOA (n=16); and other awards (n=12). Fifty-seven (71%) MD-MPH program alumni reported participation in research. Research characteristics are summarized in Table 3. Forty (50%) participated in quality improvement projects, 34 (43%), participated in investigator initiated clinical research, 19 (24%) in community-based research, 14 (18%) in translational research, 6 (8%) in basic science research, 3 (4%) in industry sponsored trials. Among the 57 that participated in research, 11 (14%) successfully received research grant support from sources including federal agencies (2, 3%), foundation (7, 9%), academic society (6, 8%), and industry sponsored grant funding (1, 1%). Results regarding the graduates’ involvement in public health are summarized in Table 3. Over a third of the respondents, 30 (38%) voluntarily chose to participate in public health work during residency, outside of what was required of them. Overall, categories of the public health related work were included Advocacy/ leadership (n=14), Research/ patient safety/ quality improvement (n=12), community based (n=10), global health (n=8), clinically related (n=6), teaching (n=5). Analysis of the responses to the question to “describe the impact of your public health education on your career” revealed six broad themes: 1) Shift in perspective, 2) Value of specific skills related to public health, 3) Stepping stone for professional opportunities 4) Focus on health disparities, social determinants and inadequacies of the healthcare system, 5) Status as leaders and mentors for peers, and 6) Self-efficacy during the pandemic. Further details are described in Table 4. View this table: [Table 4:](http://medrxiv.org/content/early/2022/09/09/2022.09.04.22279585/T4) Table 4: Qualitative analysis results for impact of public health training ## Discussion This study is the first to examine early career outcomes and qualitative impact from a large cohort of MD/ MPH students. Our study results indicate that the graduates of the UMMSM dual degree MD/MPH program are utilizing their public health education and continue to remain committed to leadership, research, and public health several years after graduation. The graduates’ choices of post-graduate programs (residencies) indicated that over 50% of them chose primary care specialties or combined primary programs that included primary care. Though the definition of primary care varies in the literature, this team of investigators elected to define primary care to include family medicine, internal medicine, pediatrics and obstetrics and gynecology, consistent with the United States Health Resources & Service Administration definitions [7,13,14,15]. The tendency towards MD/ MPH graduates to more heavily choose primary care residencies is consistent with graduate intentions and match outcomes at other institutions [3,5,6]. In a long-term study which followed graduates from one institution’s MD/ MPH program for 10-20 years post-graduation, members of their MD/ MPH cohort were more likely to practice general primary care [7]. It remains to be seen if our graduates will indeed follow a similar path as, 21 (43%), of our graduates who initially entered primary care related residencies ultimately participated in fellowship training. Future studies investigating the long-term career pathways will be required to better understand their ultimate career trajectories. Nonetheless, the mission of the dual degree program at our institution is not rooted in training primary care physicians. Rather, the stated mission is to develop public health physician leaders, regardless of specialty choice [16]. The results of our study indicate that they are indeed beginning to build a foundation to become public health leaders based upon their described involvement in leadership and research experiences. Forty four percent of the program’s alumni were selected as chief residents, and 48% held some other leadership role as a resident outside of serving as chief. Seventy one percent of the graduates participated in research since graduation, with 50% involved in quality improvement related work and 24% in community-based research. Narrative comments also supported their trajectory towards becoming public health leaders through their self-identified positions in their residency program as role models and teachers. Graduates of other MD/ MPH programs are more likely to describe intentions of working in academic medicine, healthcare administration and/or state and federal administration [3]. Christensten et al described residency characteristics comparing MD/ MPH students with other dual degree or MD only graduates and found that MD/ MPH students had significantly more participation in Gold Humanism Honor Society membership, research related experiences, leadership experiences, volunteer experiences during medical school [5]. We intend to follow this and future cohorts over time to better describe the ultimate career outcomes of our graduates. An important question is whether public health training in medical schools will lead to an expansion of the workforce of public health professionals. Emerging findings from this study and others seem to support that it will. More than one third (38%) of the graduates voluntarily elected to participate in public health endeavors during residency above and beyond what was required in their respective curricula, despite the rigorous demands of their schedules and residency responsibilities. Perhaps most meaningful in evaluating the impact of public health education (MPH) on the careers of the respondents were the themes that emerged from the rich narrative comments about the impact of the program’s public health training on their careers. Not surprisingly, students appreciated the specific public health skills such as appraisal of the literature and research. Others have surveyed medical student participants of their MPH training programs and similarly reported improved skills in critical appraisal of the literature and research skills, as well as a commitment towards underserved populations, policy and global health [13,17]. A national study of a cohort of 822 MD MPH graduates found that MD MPH program graduates were more likely to report altruism as a factor in their career choice than MD only graduates [3]. These findings are also highlighted in the comments from our study participants in themes that emerged regarding dedication towards addressing social determinants and service towards vulnerable populations, among others. Limitations include that this data was self-reported using a survey that had not been formally validated. There is always a potential for self-selection bias given the methodology. It is also difficult to make predictions regarding the long-term involvement of study participants in leadership, research, and public health, and to determine this we plan to follow this and future cohort of our graduates to determine the level of their continued engagement these areas. This study demonstrates that integrating a Master of Public Health curriculum into a four-year combined medical school program can lead to the successful development of a cohort of dedicated public health physician leaders. Though the full impact of this training cannot be measured for many years to come, it is encouraging to see the early career outcomes of MD/MPH trained physicians. Especially given the burgeoning public health crises resulting from the current pandemic, climate change, and other health needs around the world, it is the responsibility of the medical education community to continue to expand similar training programs that integrate the public health work force needs with the idealism and altruism that many students bring to their training. ## Data Availability The survey data was collected using RedCap and downloads are stored in our institution's Box folders. ## Acknowledgments The authors wish to thank Michael Maguire, MD, MPH for his support in providing contact information for alumni, Marta Bergez for providing data regarding the MD/ MPH cohort, and Anna Yabloch for her support in initial technical management of the survey. * Received September 4, 2022. * Revision received September 4, 2022. * Accepted September 9, 2022. * © 2022, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/) ## References 1. 1.Institute of Medicine 2007. Training Physicians for Public Health Careers. Washington, DC: The National Academies Press. [https://doi.org/10.17226/11915](https://doi.org/10.17226/11915). 2. 2.American Association of Medical Colleges. Directory of MD-MPH Educational Opportunities website. [https://students-residents.aamc.org/applying-dual-degree-programs/directory-md-mph-educational-opportunities](https://students-residents.aamc.org/applying-dual-degree-programs/directory-md-mph-educational-opportunities). Accessed May 5, 2021. 3. 3.Andriole DA, Jeffe DB, Tai RH. Characteristics and Career Intentions of MD-MPH Program Graduates: A National Cohort Study. Public Health Rep. 2016 Jul-Aug;131(4):637–49. doi: 10.1177/0033354916662224. PMID: 27453612; PMCID: PMC4937129. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/0033354916662224&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=27453612&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F09%2F2022.09.04.22279585.atom) 4. 4.AAMC: Data Warehouse, APP\_BIO and STUDENT\_IND tables as of July 15, 2020. STUDENT_IND last updated July 13, 2020, and APP_BIO last updated October 22, 2019. 5. 5.Christensen BR, Becnel CM, Chan LP, Minetos PD, Clarke JF, Kahn MJ. A comparison of match outcomes between traditional medical degree and dual-degree applicants. PLOS One. 2020 Dec 18;15(12):e0244147. doi: 10.1371/journal.pone.0244147. PMID: 33338062; PMCID: PMC7748145. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0244147&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33338062&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F09%2F2022.09.04.22279585.atom) 6. 6.Taylor, Barbara S. MD, MS1; Mazurek, Paulina H. EdD2; Gutierrez, Stephanie3; Tyson, Joshua4; Futrell, Selina5; Jackson, Jeff EdD6; Hanson, Joshua MD, MPH7; Valerio, Melissa A. PhD, MPH8 Educational Outcomes of a 4-Year MD–MPH Dual-Degree Program, Academic Medicine: January 18, 2022 - Volume - Issue - doi: 10.1097/ACM.0000000000004603 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/ACM.0000000000004603&link_type=DOI) 7. 7.Krousel-Wood M, He J, Booth M, Chen CS, Rice J, Kahn MJ, Maeshiro R, Whelton PK. Formal public health education and career outcomes of medical school graduates. PLOS One. 2012;7(6):e39020. doi: 10.1371/journal.pone.0039020. Epub 2012 Jun 20. PMID: 22745699; PMCID: PMC3380037. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1371/journal.pone.0039020&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22745699&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F09%2F2022.09.04.22279585.atom) 8. 8.2018 AAMC Medical School Graduation Questionnaire ([https://www.aamc.org/data-reports/students-residents/report/graduation-questionnaire-gq](https://www.aamc.org/data-reports/students-residents/report/graduation-questionnaire-gq)) 9. 9.Office of Management and Budget. Standards for the Classification of Federal Data on Race and Ethnicity. Available at: [https://obamawhitehouse.archives.gov/omb/fedreg\_race-ethnicity](https://obamawhitehouse.archives.gov/omb/fedreg_race-ethnicity) 10. 10.2016 AAMC Program Director Survey ([https://www.aamc.org/data-reports/students-residents/report/program-director-survey](https://www.aamc.org/data-reports/students-residents/report/program-director-survey)) 11. 11.Adapted from the National GME Census ([https://www.aamc.org/data-reports/students-residents/report/gme-track](https://www.aamc.org/data-reports/students-residents/report/gme-track)) 12. 12.AAP survey [https://www.aap.org/en-us/professional-resources/Research/Pages/PS43\_Additional\_Characteristics\_of\_Pediatricians.aspx](https://www.aap.org/en-us/professional-resources/Research/Pages/PS43\_Additional_Characteristics_of_Pediatricians.aspx) 13. 13.Stellman JM, Cohen S, Rosenfield A. Evaluation of a one-year Masters of Public Health program for medical students between their third and fourth years. Acad Med. 2008 Apr;83(4):365–70. doi: 10.1097/01.ACM.0b013e318166af00. PMID: 18367897. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/01.ACM.0b013e318166af00&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18367897&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F09%2F2022.09.04.22279585.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000267654000009&link_type=ISI) 14. 14.Health Center Program Terms and Definitions. [https://www.hrsa.gov/sites/default/files/grants/apply/assistance/Buckets/definitions.pdf](https://www.hrsa.gov/sites/default/files/grants/apply/assistance/Buckets/definitions.pdf). Accessed October 10, 2021. 15. 15.National Residency Matching Program. Results and Data 2021 Match. [https://mk0nrmp3oyqui6wqfm.kinstacdn.com/wp-content/uploads/2021/05/MRM-Results\_and-Data\_2021.pdf](https://mk0nrmp3oyqui6wqfm.kinstacdn.com/wp-content/uploads/2021/05/MRM-Results_and-Data_2021.pdf). Accessed October 10, 2021. 16. 16.University of Miami Miller School of Medicine. MD MPH Program. [http://admissions.med.miami.edu/md-programs/md-mph-program](http://admissions.med.miami.edu/md-programs/md-mph-program). Accessed October 5, 2021. 17. 17.Harris R, Kinsinger LS, Tolleson-Rinehart S, Viera AJ, Dent G. The MD-MPH program at the University of North Carolina at Chapel Hill. Acad Med. 2008 Apr;83(4):371–7. doi: 10.1097/ACM.0b013e318166a848. PMID: 18367898. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/ACM.0b013e318166a848&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=18367898&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2022%2F09%2F09%2F2022.09.04.22279585.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000267654000010&link_type=ISI)