Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative Study

View ORCID ProfileHui Feng, View ORCID ProfileFrancesco Ronzano, Jude LaFleur, Matthew Garber, Rodrigo de Oliveira, View ORCID ProfileKathryn Rough, Katharine Roth, Jay Nanavati, Khaldoun Zine El Abidine, View ORCID ProfileChristina Mack
doi: https://doi.org/10.1101/2024.05.17.24307411
Hui Feng
1Real world solutions, IQVIA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Hui Feng
  • For correspondence: hui.feng{at}iqvia.com
Francesco Ronzano
1Real world solutions, IQVIA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Francesco Ronzano
Jude LaFleur
1Real world solutions, IQVIA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthew Garber
1Real world solutions, IQVIA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rodrigo de Oliveira
1Real world solutions, IQVIA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kathryn Rough
1Real world solutions, IQVIA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Kathryn Rough
Katharine Roth
1Real world solutions, IQVIA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jay Nanavati
1Real world solutions, IQVIA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Khaldoun Zine El Abidine
1Real world solutions, IQVIA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christina Mack
1Real world solutions, IQVIA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Christina Mack
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Data Availability

All underlying data used in this study are available online at https://microsoft.github.io/BLURB/tasks.html

Back to top
PreviousNext
Posted August 20, 2024.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative Study
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative Study
Hui Feng, Francesco Ronzano, Jude LaFleur, Matthew Garber, Rodrigo de Oliveira, Kathryn Rough, Katharine Roth, Jay Nanavati, Khaldoun Zine El Abidine, Christina Mack
medRxiv 2024.05.17.24307411; doi: https://doi.org/10.1101/2024.05.17.24307411
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Evaluation of Large Language Model Performance on the Biomedical Language Understanding and Reasoning Benchmark: Comparative Study
Hui Feng, Francesco Ronzano, Jude LaFleur, Matthew Garber, Rodrigo de Oliveira, Kathryn Rough, Katharine Roth, Jay Nanavati, Khaldoun Zine El Abidine, Christina Mack
medRxiv 2024.05.17.24307411; doi: https://doi.org/10.1101/2024.05.17.24307411

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Health Informatics
Subject Areas
All Articles
  • Addiction Medicine (427)
  • Allergy and Immunology (753)
  • Anesthesia (220)
  • Cardiovascular Medicine (3281)
  • Dentistry and Oral Medicine (362)
  • Dermatology (274)
  • Emergency Medicine (478)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (1164)
  • Epidemiology (13340)
  • Forensic Medicine (19)
  • Gastroenterology (896)
  • Genetic and Genomic Medicine (5130)
  • Geriatric Medicine (479)
  • Health Economics (781)
  • Health Informatics (3252)
  • Health Policy (1138)
  • Health Systems and Quality Improvement (1189)
  • Hematology (427)
  • HIV/AIDS (1013)
  • Infectious Diseases (except HIV/AIDS) (14611)
  • Intensive Care and Critical Care Medicine (910)
  • Medical Education (475)
  • Medical Ethics (126)
  • Nephrology (522)
  • Neurology (4899)
  • Nursing (261)
  • Nutrition (725)
  • Obstetrics and Gynecology (879)
  • Occupational and Environmental Health (795)
  • Oncology (2516)
  • Ophthalmology (722)
  • Orthopedics (280)
  • Otolaryngology (346)
  • Pain Medicine (323)
  • Palliative Medicine (90)
  • Pathology (538)
  • Pediatrics (1297)
  • Pharmacology and Therapeutics (548)
  • Primary Care Research (554)
  • Psychiatry and Clinical Psychology (4192)
  • Public and Global Health (7482)
  • Radiology and Imaging (1702)
  • Rehabilitation Medicine and Physical Therapy (1010)
  • Respiratory Medicine (979)
  • Rheumatology (478)
  • Sexual and Reproductive Health (495)
  • Sports Medicine (424)
  • Surgery (545)
  • Toxicology (71)
  • Transplantation (235)
  • Urology (203)