Abstract
In large data sets discovery is often limited to pre-conceived hypotheses and data fishing. Here we tested whether systematic exploration of AI generated hypotheses could uncover clinically meaningful signals in extensively studied data. We deployed AutoDiscovery, a newly launched large language model (LLM) framework designed to search for hypotheses based on surprisal and systematically interrogate complex datasets, on The Cancer Genome Atlas breast cancer cohort. The system did not identify clinically meaningful novel findings without human input. However, a seeded warm-start run with minimal text input from an oncologist revealed multiple interesting and surprising hypotheses. Among these was that a robust immune signature was present across all subtypes of invasive lobular carcinoma (ILC) that exceeded invasive ductal carcinoma (IDC). This observation was independently validated in independent cohorts and confirmed by high-sensitivity multi-immunofluorescence tumor tissue analyses. These results suggest immunotherapy approaches should be tested in ILC including early-stage ER+HER2-ILC; these patients are currently excluded from large neoadjuvant immunotherapy trials. They further demonstrate that surprisal-based hypothesis generation frameworks can extract previously unappreciated patterns from deeply interrogated cancer datasets and imply that disease domain experts working with LLMs can derive more meaningful insights from complex data than either could achieve alone.
Competing Interest Statement
SD: funding to institution from AstraZeneca, Avistone, BMS, Boehringer Ingelheim, Ideaya, Lilly, Genmab, Pfizer, and Summit, Advisory board income from AstraZeneca, Amgen, Natera, BMS, Johnson and Johnson, Boehringer Ingelheim, Daiichi Sankyo, Lilly, Ideaya, Apollomics, Nuvation Bio, Acrotech, Speaker fees from AstraZeneca, Nuvation Bio, Johnson and Johnson, Boehringer Ingelheim. KP: funding to institution from Amgen, Immunocore, Regeneron, Iovance, Bristol-Myers Squibb and advisory board fees from Bristol-Myers Squibb. SS : funding to institution from Canwell, Ataraxis, and IMV Inc. All other authors: none .
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
All studies were institutional review board reviewed and approved by Providence (IRB# Study2025000994- computational studies and Study2024000051-tissue analysis)
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
All data produced in the present work are publicly available, included in the manuscript, or available online at https://autodiscovery.allen.ai/runs/shared/swedish
Funder Information Declared
