Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative Study
View ORCID ProfileHui Feng, View ORCID ProfileFrancesco Ronzano, Jude LaFleur, Matthew Garber, Rodrigo de Oliveira, View ORCID ProfileKathryn Rough, Katharine Roth, Jay Nanavati, Khaldoun Zine El Abidine, View ORCID ProfileChristina Mack
doi: https://doi.org/10.1101/2024.05.17.24307411
Hui Feng
1Real world solutions, IQVIA
Francesco Ronzano
1Real world solutions, IQVIA
Jude LaFleur
1Real world solutions, IQVIA
Matthew Garber
1Real world solutions, IQVIA
Rodrigo de Oliveira
1Real world solutions, IQVIA
Kathryn Rough
1Real world solutions, IQVIA
Katharine Roth
1Real world solutions, IQVIA
Jay Nanavati
1Real world solutions, IQVIA
Khaldoun Zine El Abidine
1Real world solutions, IQVIA
Christina Mack
1Real world solutions, IQVIA

Data Availability
All underlying data used in this study are available online at https://microsoft.github.io/BLURB/tasks.html
Posted August 20, 2024.
Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative Study
Hui Feng, Francesco Ronzano, Jude LaFleur, Matthew Garber, Rodrigo de Oliveira, Kathryn Rough, Katharine Roth, Jay Nanavati, Khaldoun Zine El Abidine, Christina Mack
medRxiv 2024.05.17.24307411; doi: https://doi.org/10.1101/2024.05.17.24307411
Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative Study
Hui Feng, Francesco Ronzano, Jude LaFleur, Matthew Garber, Rodrigo de Oliveira, Kathryn Rough, Katharine Roth, Jay Nanavati, Khaldoun Zine El Abidine, Christina Mack
medRxiv 2024.05.17.24307411; doi: https://doi.org/10.1101/2024.05.17.24307411
Subject Area
Subject Areas
- Addiction Medicine (423)
- Allergy and Immunology (746)
- Anesthesia (219)
- Cardiovascular Medicine (3234)
- Dermatology (270)
- Emergency Medicine (476)
- Epidemiology (13250)
- Forensic Medicine (19)
- Gastroenterology (891)
- Genetic and Genomic Medicine (5066)
- Geriatric Medicine (471)
- Health Economics (773)
- Health Informatics (3189)
- Health Policy (1129)
- Hematology (423)
- HIV/AIDS (1005)
- Medical Education (468)
- Medical Ethics (125)
- Nephrology (513)
- Neurology (4811)
- Nursing (254)
- Nutrition (716)
- Oncology (2483)
- Ophthalmology (703)
- Orthopedics (279)
- Otolaryngology (337)
- Pain Medicine (320)
- Palliative Medicine (89)
- Pathology (531)
- Pediatrics (1281)
- Primary Care Research (550)
- Public and Global Health (7372)
- Radiology and Imaging (1669)
- Respiratory Medicine (970)
- Rheumatology (473)
- Sports Medicine (416)
- Surgery (534)
- Toxicology (69)
- Transplantation (233)
- Urology (199)