RT Journal Article SR Electronic T1 Acronym Disambiguation in Clinical Notes from Electronic Health Records JF medRxiv FD Cold Spring Harbor Laboratory Press SP 2020.11.25.20221648 DO 10.1101/2020.11.25.20221648 A1 Nicholas B. Link A1 Selena Huang A1 Tianrun Cai A1 Zeling He A1 Jiehuan Sun A1 Kumar Dahal A1 Lauren Costa A1 Kelly Cho A1 Katherine Liao A1 Tianxi Cai A1 Chuan Hong A1 in collaboration with the Million Veteran Program YR 2020 UL http://medrxiv.org/content/early/2020/11/27/2020.11.25.20221648.abstract AB Objective The use of electronic health records (EHR) systems has grown over the past decade, and with it, the need to extract information from unstructured clinical narratives. Clinical notes, however, frequently contain acronyms with several potential senses (meanings) and traditional natural language processing (NLP) techniques cannot differentiate between these senses. In this study we introduce an unsupervised method for acronym disambiguation, the task of classifying the correct sense of acronyms in the clinical EHR notes.Methods We developed an unsupervised ensemble machine learning (CASEml) algorithm to automatically classify acronyms by leveraging semantic embeddings, visit-level text and billing information. The algorithm was validated using note data from the Veterans Affairs hospital system to classify the meaning of three acronyms: RA, MS, and MI. We compared the performance of CASEml against another standard unsupervised method and a baseline metric selecting the most frequent acronym sense. We additionally evaluated the effects of RA disambiguation on NLP-driven phenotyping of rheumatoid arthritis.Results CASEml achieved accuracies of 0.947, 0.911, and 0.706 for RA, MS, and MI, respectively, higher than a standard baseline metric and (on average) higher than a state-of-the-art unsupervised method. As well, we demonstrated that applying CASEml to medical notes improves the AUC of a phenotype algorithm for rheumatoid arthritis.Conclusion CASEml is a novel method that accurately disambiguates acronyms in clinical notes and has advantages over commonly used supervised and unsupervised machine learning approaches. In addition, CASEml improves the performance of NLP tasks that rely on ambiguous acronyms, such as phenotyping.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis study was funded by the Department of Veterans Affairs Office of Research and Development, Million Veteran Program - MVP000.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This analysis was approved by the VA Central IRB through the Million Veteran Program.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesDue to the sensitive nature of the data, it is not possible to share.