Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Development of a federated learning approach to predict acute kidney injury in adult hospitalized patients with COVID-19 in New York City

View ORCID ProfileSuraj K Jaladanki, View ORCID ProfileAkhil Vaid, View ORCID ProfileAshwin S Sawant, View ORCID ProfileJie Xu, Kush Shah, View ORCID ProfileSergio Dellepiane, View ORCID ProfileIshan Paranjpe, View ORCID ProfileLili Chan, View ORCID ProfilePatricia Kovatch, View ORCID ProfileAlexander W Charney, View ORCID ProfileFei Wang, View ORCID ProfileBenjamin S Glicksberg, View ORCID ProfileKarandeep Singh, View ORCID ProfileGirish N Nadkarni
doi: https://doi.org/10.1101/2021.07.25.21261105
Suraj K Jaladanki
1The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, New York, New York, USA
2The Mount Sinai Clinical Intelligence Center (MSCIC), New York, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Suraj K Jaladanki
Akhil Vaid
1The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, New York, New York, USA
2The Mount Sinai Clinical Intelligence Center (MSCIC), New York, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Akhil Vaid
Ashwin S Sawant
2The Mount Sinai Clinical Intelligence Center (MSCIC), New York, New York, USA
3The Division of Data-Driven and Digital Medicine (D3M), Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ashwin S Sawant
Jie Xu
4Department of Population Health Sciences, Weill Cornell Medicine, New York, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jie Xu
Kush Shah
2The Mount Sinai Clinical Intelligence Center (MSCIC), New York, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sergio Dellepiane
2The Mount Sinai Clinical Intelligence Center (MSCIC), New York, New York, USA
3The Division of Data-Driven and Digital Medicine (D3M), Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Sergio Dellepiane
Ishan Paranjpe
1The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, New York, New York, USA
2The Mount Sinai Clinical Intelligence Center (MSCIC), New York, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ishan Paranjpe
Lili Chan
3The Division of Data-Driven and Digital Medicine (D3M), Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
5The Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
6BioMe Phenomics Center, Icahn School of Medicine at Mount Sinai, New York, New York, USA
7Division of Nephrology, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Lili Chan
Patricia Kovatch
8Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Patricia Kovatch
Alexander W Charney
2The Mount Sinai Clinical Intelligence Center (MSCIC), New York, New York, USA
8Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, New York, USA
9The Pamela Sklar Division of Psychiatric Genomics, Icahn School of Medicine at Mount Sinai, New York, New York, USA
10Department of Psychiatry, Icahn School of Medicine at Mount Sinai, New York, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Alexander W Charney
Fei Wang
4Department of Population Health Sciences, Weill Cornell Medicine, New York, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Fei Wang
Benjamin S Glicksberg
1The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, New York, New York, USA
2The Mount Sinai Clinical Intelligence Center (MSCIC), New York, New York, USA
8Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai, New York, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Benjamin S Glicksberg
Karandeep Singh
11Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, Michigan, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Karandeep Singh
Girish N Nadkarni
1The Hasso Plattner Institute for Digital Health at Mount Sinai, Icahn School of Medicine at Mount Sinai, New York, New York, USA
2The Mount Sinai Clinical Intelligence Center (MSCIC), New York, New York, USA
3The Division of Data-Driven and Digital Medicine (D3M), Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
5The Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
7Division of Nephrology, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Girish N Nadkarni
  • For correspondence: girish.nadkarni@mountsinai.org
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Federated learning is a technique for training predictive models without sharing patient-level data, thus maintaining data security while allowing inter-institutional collaboration. We used federated learning to predict acute kidney injury within three and seven days of admission, using demographics, comorbidities, vital signs, and laboratory values, in 4029 adults hospitalized with COVID-19 at five sociodemographically diverse New York City hospitals, between March-October 2020. Prediction performance of federated models was generally higher than single-hospital models and was comparable to pooled-data models. In the first use-case in kidney disease, federated learning improved prediction of a common complication of COVID-19, while preserving data privacy.

Introduction

Machine Learning (ML) models have been developed to aid in risk-stratification in patients with Coronavirus Disease-19 (COVID-19).1-3 Due to concerns about data privacy and ownership, most of these models were trained on data from single institutions, which limits their generalizability.4, 5 However, it is critical that these models be trained on large, diverse datasets, reflecting the variability seen in clinical practice.

Federated learning (FL), a technique that allows model training to occur without sharing confidential patient data, has gained significant interest during the pandemic. FL avoids the need to collect and store private data at a centralized location by allowing institutions to download a preliminary ML model, refine it locally, and then upload updated model parameters to an aggregator.5-7 FL models have been utilized to identify COVID-19 through computed tomography scans and to predict clinical outcomes in COVID-19 patients — published reports indicate that FL models not only outperform those trained on single-institution data but also approach the performance of traditional ML models trained on data pooled from multiple institutions.6, 8-10

COVID-19 has diverse clinical manifestations, and a common complication in hospitalized COVID-19 patients is acute kidney injury (AKI).11-14 Studies have reported AKI prevalence up to 46%, and mortality rates in AKI cohorts vary from 35%–71%.15, 16 Clinical models to pre-emptively identify patients with COVID-19 at increased risk for developing AKI can be valuable during a pandemic when resources may be constrained.17

Using COVID-19 associated AKI as a use case, we aimed to evaluate how FL trained models compare to models trained at individual institutions and pooled multi-institutional data. We developed federated models to predict AKI within three and seven days of admission using electronic health records (EHR) in patients hospitalized with COVID-19 and compared their performance to local and pooled models.

Short Methods

The study population consisted of adult patients admitted to one of five Mount Sinai Health System hospitals in New York City with laboratory confirmed SARS-CoV-2 infection within 48 hours of admission between March 1st and October 18th, 2020. We excluded patients with a history of transplants, a diagnosis of kidney failure or admissions less than 48 hours. We defined AKI according to 2012 Kidney Disease Improving Global Outcomes (KDIGO) guidelines.18 The primary outcomes of interest were incident AKI within three (AKI3) and seven (AKI7) days of admission. We included demographics, comorbidities, vital signs, laboratory values, and clinical outcomes extracted from an EHR database. For each parameter, we used the first available values obtained within 48 hours after admission. We used two classifiers: multilayer perceptron (MLP) to represent deep learning and Least Absolute Shrinkage and Selection Operator (LASSO) as a regression method. We used three training strategies for each classifier: local, federated, and pooled (Figure 1A, 1B). Local models for each hospital were trained and tested using only data from that hospital. Federated models used a FL framework to share model parameters with a central aggregator. Finally, pooled models combined data from all hospitals for model development and represented an optimal scenario. Model performance was assessed by average areas under the receiver operating characteristic curve (AUROCs) across 100 independent experiments with 70%/30% training/testing splits. SHapley Additive exPlanations (SHAP) scores were used to evaluate the importance of features contributing to model predictions.19 Detailed inclusion and exclusion criteria, data processing, classifier parameters, and software are described in Detailed Methods (Supplementary Material). We used the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) guidelines and shared our code under the GNU General Public License v3 to enhance replicability (Supplementary Material).

Figure 1.
  • Download figure
  • Open in new tab
Figure 1. Study Design and Model Performance.

(A) Overview of local and pooled models. Local models only utilize data from the site itself while pooled models incorporate data from all sites. Both local and pooled MLP, LR, and LASSO models were utilized. Based on https://medinform.jmir.org/2021/1/e24207/ (B) Overview of federated model. Parameters from a central aggregator are shared with each site, and sites do not have direct access to clinical data from others. After models are trained locally at a site, parameters are sent back to the central aggregator to update federated model parameters. Federated LASSO and MLP models were utilized. Based on https://medinform.jmir.org/2021/1/e24207/ (C) Performance of all models averaged across all sites as measured by area under the receiver-operating characteristic (AUROC) after 70-30 train-test split over 100 experiments with 95% confidence intervals for predicting AKI within three (top) and seven (bottom) days of admission.

Results

Cohort Characteristics

Among 4029 patients, the prevalence of AKI3 ranged from 23% to 37% across five hospitals, and 27% to 44% for AKI7. There were significant differences in demographics, comorbidities, laboratory measurements, outcome prevalence, and sample sizes between hospitals (Supplementary Table S3). For example, Mount Sinai West (MSW) had the largest class imbalance and smallest sample size of all hospitals.

Learning Framework Comparisons

We evaluated performance of three model strategies (local, pooled, and federated) at each hospital for predicting AKI3 and AKI7. Performance averaged across the five sites is shown in Figure 1C. All models had AUROCs in the range of 0.70–0.90 for predicting AKI3 and AKI7. Pooled models consistently outperformed both local and federated models for AKI3 and AKI7 prediction. LASSOfederated also outperformed LASSOlocal at all hospitals except one for both AKI3 and AKI7 prediction (Supplementary Table S5). MLPfederated outperformed MLPlocal only at MSW for both AKI3 and AKI7 prediction (Supplementary Table S5). Additional performance metrics for all models are available in the supplementary material (Supplementary Table S4).

MSW Performance and Feature Importance

The largest improvements in performance between local and federated models were seen for MSW (Figure 2A), with an increase of at least 3% (0.03) in AUROC for all three classifiers for AKI3 and AKI7 prediction. SHAP plots for LASSOlocal and LASSOfederated models for AKI3 prediction at MSW demonstrate differences in feature importance (Figure 2B). For LASSOlocal, history of stroke, black race, and Hispanic/latino ethnicity were the three most important features for predicting AKI3. However, for the corresponding LASSOfederated model, the three features with highest importance were blood urea nitrogen, age, and albumin.

Figure 2.
  • Download figure
  • Open in new tab
Figure 2. Model Performance and Feature Importance at MSW

(A) Performance of all models at Mount Sinai West (MSW) (n=474) as measured by area under the receiver-operating characteristic (AUROC) after 70-30 train-test split over 100 experiments with 95% confidence intervals for predicting AKI within three (left) and seven (right) days of admission. (B) SHAP values were calculated for LASSOlocal (left) and LASSOfederated (right) for predicting AKI within three days of admission at MSW and illustrated in summary plots where features are listed in decreasing order of importance.

Discussion

We trained models using federated learning to predict AKI at three and seven days in hospitalized patients with COVID-19. To our knowledge, this is the first use case of federated learning in kidney disease and to predict AKI over multiple time horizons. We found that models trained with FL outperformed those trained on locally available data, which was most apparent at the hospital with the smallest dataset.

All models had AUROCs of at least 0.70, suggesting that early vital signs and laboratory measurements can predict kidney complications during the first week in patients hospitalized with COVID-19. A similar approach has been used to predict mortality in hospitalized patients with COVID-19, highlighting the utility of peri-admission measurements in the prediction of clinical outcomes in this cohort.10 Model performance was consistently lower for AKI7 than AKI3, likely due to the longer prediction interval in the former case.

We found that LASSOfederated models outperformed their respective LASSOlocal models at most hospitals. At MSW, the hospital with the smallest sample size and largest class imbalance, SHAP plots indicate that the LASSOfederated model attached greater importance to features that have more biologically plausible links to renal outcomes than the corresponding LASSOlocal model, which was strongly influenced by race and a history of stroke. MSW was also the only site where MLPfederated outperformed MLPlocal, indicating that the greatest benefits from using FL to train deep learning models may accrue to sites with small amounts of local data available for training.

Models developed during this study may be implemented in clinical practice to predict onset of AKI in COVID-19 patients several days before it occurs, allowing clinicians to triage patients for better monitoring and use of intravenous fluids. Early prediction of AKI also allows for proactive allocation of resources, because published data indicate that these patients are hospitalized longer, are more likely to need intensive care, and more likely to require inpatient dialysis.14

Our study has several limitations. First, our data was limited to a single hospital system within New York City, which may limit generalizability to other geographical regions. Similarly, as the standard of care for hospitalized patients with COVID-19 has evolved after our data was collected, model performance should be validated with newer cohorts. Our models did not use inputs such as imaging and echocardiograms, and their exclusion may have hindered performance. We deliberately limited hyperparameter tuning of models to simulate a scenario where a federated model has to be urgently deployed at resource-constrained hospitals, such as during the COVID-19 pandemic. Allowing further optimization of the MLP structure, and techniques such as transfer learning may improve MLPfederated model performance.20 We examined only two classifiers; other approaches such as random forests or support vector machines may have yielded better results. Lastly, performance with the FL approach was generally statistically inferior to pooled dataset performance, and it remains to be explored if other approaches exist which can help bridge this gap while retaining the privacy advantages of FL.

In summary, we demonstrate the utility of FL to improve prediction of key outcomes while maintaining privacy and confidentiality. We hope this will encourage the development of generalizable clinical models which would otherwise be hindered by inability to share patient-level data across institutional boundaries.

Data Availability

This article is written following the TRIPOD (Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis) guidelines, which are further elaborated in Supplementary Table 3. Furthermore, we release all code used for building the classifier under the GPLv3 license in a public GitHub repository.

https://github.com/HPIMS/COVID_Federated_AKI

Footnotes

  • Sources of support. This study was supported by the National Center for Advancing Translational Sciences, National Institutes of Health (U54 TR001433-05). GNN is also supported by R01DK127139, R01HL155915, and R56DK126930. FW would like to acknowledge the support from NSF 1750326 and NIH RF1AG072449.

References

  1. 1.↵
    Mei X, Lee H-C, Diao K-y, et al. Artificial intelligence–enabled rapid diagnosis of patients with COVID-19. Nature Medicine 2020; 26: 1224–1228.
    OpenUrl
  2. 2.
    Vaid A, Somani S, Russak AJ, et al. Machine Learning to Predict Mortality and Critical Events in a Cohort of Patients With COVID-19 in New York City: Model Development and Validation. J Med Internet Res 2020; 22: e24018.
    OpenUrlCrossRef
  3. 3.↵
    Wynants L, Van Calster B, Collins GS, et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ 2020; 369: m1328.
    OpenUrlAbstract/FREE Full Text
  4. 4.↵
    Cahan EM, Hernandez-Boussard T, Thadaney-Israni S, et al. Putting the data before the algorithm in big data addressing personalized healthcare. npj Digital Medicine 2019; 2: 78.
    OpenUrl
  5. 5.↵
    Song X, Yu ASL, Kellum JA, et al. Cross-site transportability of an explainable artificial intelligence model for acute kidney injury prediction. Nature Communications 2020; 11: 5668.
    OpenUrl
  6. 6.↵
    Flores M, Dayan I, Roth H, et al. Federated Learning used for predicting outcomes in SARS-COV-2 patients. Res Sq 2021.
  7. 7.↵
    Xu J, Glicksberg BS, Su C, et al. Federated learning for healthcare informatics. arXiv preprint 2020.
  8. 8.↵
    Kumar R, Khan AA, Zhang S, et al. Blockchain-Federated-Learning and Deep Learning Models for COVID-19 detection using CT Imaging. arXiv preprint 2020.
  9. 9.
    Xu Y, Ma L, Yang F, et al. A collaborative online AI engine for CT-based COVID-19 diagnosis. medRxiv 2020: 2020.2005.2010.20096073.
  10. 10.↵
    Vaid A, Jaladanki SK, Xu J, et al. Federated Learning of Electronic Health Records to Improve Mortality Prediction in Hospitalized Patients With COVID-19: Machine Learning Approach. JMIR Med Inform 2021; 9: e24207.
    OpenUrl
  11. 11.↵
    Wu Z, McGoogan JM. Characteristics of and Important Lessons From the Coronavirus Disease 2019 (COVID-19) Outbreak in China: Summary of a Report of 72□314 Cases From the Chinese Center for Disease Control and Prevention. JAMA 2020; 323: 1239–1242.
    OpenUrlCrossRefPubMed
  12. 12.
    Chung M, Bernheim A, Mei X, et al. CT Imaging Features of 2019 Novel Coronavirus (2019-nCoV). Radiology 2020; 295: 202–207.
    OpenUrlCrossRefPubMed
  13. 13.
    Lala A, Johnson KW, Januzzi JL, et al. Prevalence and Impact of Myocardial Injury in Patients Hospitalized With COVID-19 Infection. J Am Coll Cardiol 2020; 76: 533–546.
    OpenUrlFREE Full Text
  14. 14.↵
    Chan L, Chaudhary K, Saha A, et al. AKI in Hospitalized Patients with COVID-19. Journal of the American Society of Nephrology 2021; 32: 151–160.
    OpenUrlAbstract/FREE Full Text
  15. 15.↵
    Zahid U, Ramachandran P, Spitalewitz S, et al. Acute Kidney Injury in COVID-19 Patients: An Inner City Hospital Experience and Policy Implications. American Journal of Nephrology 2020; 51: 786–796.
    OpenUrl
  16. 16.↵
    Hirsch JS, Ng JH, Ross DW, et al. Acute kidney injury in patients hospitalized with COVID-19. Kidney International 2020; 98: 209–218.
    OpenUrlCrossRefPubMed
  17. 17.↵
    Goldfarb DS, Benstein JA, Zhdanova O, et al. Impending Shortages of Kidney Replacement Therapy for COVID-19 Patients. Clinical Journal of the American Society of Nephrology 2020; 15: 880–882.
    OpenUrlFREE Full Text
  18. 18.↵
    Kidney Disease: Improving Global Outcomes (KDIGO) Acute Kidney Injury Work Group. KDIGO Clinical Practice Guidelines for Acute Kidney Injury. Kidney inter., Suppl. 2012; 2: 1–138.
    OpenUrlCrossRef
  19. 19.↵
    Lundberg SM, Erion G, Chen H, et al. From Local Explanations to Global Understanding with Explainable AI for Trees. Nature machine intelligence 2020; 2: 56–67.
    OpenUrl
  20. 20.↵
    Ching T, Himmelstein DS, Beaulieu-Jones BK, et al. Opportunities and obstacles for deep learning in biology and medicine. J R Soc Interface 2018; 15: 20170387.
    OpenUrlCrossRefPubMed
Back to top
PreviousNext
Posted July 28, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Development of a federated learning approach to predict acute kidney injury in adult hospitalized patients with COVID-19 in New York City
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Development of a federated learning approach to predict acute kidney injury in adult hospitalized patients with COVID-19 in New York City
Suraj K Jaladanki, Akhil Vaid, Ashwin S Sawant, Jie Xu, Kush Shah, Sergio Dellepiane, Ishan Paranjpe, Lili Chan, Patricia Kovatch, Alexander W Charney, Fei Wang, Benjamin S Glicksberg, Karandeep Singh, Girish N Nadkarni
medRxiv 2021.07.25.21261105; doi: https://doi.org/10.1101/2021.07.25.21261105
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
Development of a federated learning approach to predict acute kidney injury in adult hospitalized patients with COVID-19 in New York City
Suraj K Jaladanki, Akhil Vaid, Ashwin S Sawant, Jie Xu, Kush Shah, Sergio Dellepiane, Ishan Paranjpe, Lili Chan, Patricia Kovatch, Alexander W Charney, Fei Wang, Benjamin S Glicksberg, Karandeep Singh, Girish N Nadkarni
medRxiv 2021.07.25.21261105; doi: https://doi.org/10.1101/2021.07.25.21261105

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Nephrology
Subject Areas
All Articles
  • Addiction Medicine (157)
  • Allergy and Immunology (412)
  • Anesthesia (90)
  • Cardiovascular Medicine (852)
  • Dentistry and Oral Medicine (156)
  • Dermatology (97)
  • Emergency Medicine (247)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (392)
  • Epidemiology (8527)
  • Forensic Medicine (4)
  • Gastroenterology (381)
  • Genetic and Genomic Medicine (1731)
  • Geriatric Medicine (166)
  • Health Economics (370)
  • Health Informatics (1232)
  • Health Policy (615)
  • Health Systems and Quality Improvement (465)
  • Hematology (196)
  • HIV/AIDS (367)
  • Infectious Diseases (except HIV/AIDS) (10258)
  • Intensive Care and Critical Care Medicine (550)
  • Medical Education (192)
  • Medical Ethics (51)
  • Nephrology (209)
  • Neurology (1662)
  • Nursing (97)
  • Nutrition (247)
  • Obstetrics and Gynecology (321)
  • Occupational and Environmental Health (450)
  • Oncology (918)
  • Ophthalmology (261)
  • Orthopedics (99)
  • Otolaryngology (172)
  • Pain Medicine (110)
  • Palliative Medicine (40)
  • Pathology (249)
  • Pediatrics (532)
  • Pharmacology and Therapeutics (245)
  • Primary Care Research (205)
  • Psychiatry and Clinical Psychology (1751)
  • Public and Global Health (3814)
  • Radiology and Imaging (620)
  • Rehabilitation Medicine and Physical Therapy (316)
  • Respiratory Medicine (518)
  • Rheumatology (204)
  • Sexual and Reproductive Health (164)
  • Sports Medicine (156)
  • Surgery (188)
  • Toxicology (36)
  • Transplantation (99)
  • Urology (74)