Multi-modal data abounds in biomedicine, such as radiology images and reports. Interpreting
this data at scale is essential for improving clinical care and accelerating clinical research. …

Self-supervised learning in vision--language processing (VLP) exploits semantic alignment
between imaging and text modalities. Prior work in biomedical VLP has mostly relied on the …

Imperfections in data annotation, known as label noise, are detrimental to the training of
machine learning models and have a confounding effect on the assessment of model …

Importance Personalized radiotherapy planning depends on high-quality delineation of target
tumors and surrounding organs at risk (OARs). This process puts additional time burdens …

Recent advances in AI combine large language models (LLMs) with vision encoders that
bring forward unprecedented technical capabilities to leverage for a wide range of healthcare …

The recent success of general-domain large language models (LLMs) has significantly
changed the natural language processing paradigm towards a unified foundation model across …

Label scarcity is a bottleneck for improving task performance in specialized domains. We
propose a novel compositional transfer learning framework (DoT5 1 ) for zero-shot domain …

Language-supervised pre-training has proven to be a valuable method for extracting
semantically meaningful features from images, serving as a foundational element in multimodal …

Timely detection of Barrett’s esophagus, the pre-malignant condition of esophageal
adenocarcinoma, can improve patient survival rates. The Cytosponge-TFF3 test, a non-endoscopic …

We present a radiology-specific multimodal model for the task for generating radiological
reports from chest X-rays (CXRs). Our work builds on the idea that large language model(s) …