TY - JOUR T1 - Development and validation of an electronic health records-based opioid use disorder algorithm by expert clinical adjudication JF - medRxiv DO - 10.1101/2021.09.23.21264021 SP - 2021.09.23.21264021 AU - Shabbar I. Ranapurwala AU - Ishrat Z. Alam AU - Brian W. Pence AU - Timothy S. Carey AU - Sean Christensen AU - Marshall Clark AU - Paul R. Chelminski AU - Li-Tzy Wu AU - Lawrence H. Greenblatt AU - Jeffrey E. Korte AU - Mark Wolfson AU - Heather E. Douglas AU - Lynn A. Bowlby AU - Michael Capata AU - Stephen W. Marshall Y1 - 2021/01/01 UR - http://medrxiv.org/content/early/2021/09/26/2021.09.23.21264021.abstract N2 - Background In the US, over 200 lives are lost from opioid overdoses each day. Accurate and prompt diagnosis of opioid use disorders (OUD) may contribute substantially to prevention of overdose deaths. However, OUD research is limited, the specificity and sensitivity of OUD ICD codes are unknown, and the ICD codes are known to underestimate OUD prevalence. We developed and validated algorithms to identify OUD from EHR data and examine validity of ICD-based definitions for OUD.Methods Through multiple iterations, we developed EHR-based algorithms to identify OUD. These algorithms and ICD-based OUD definition were validated against a total of 169 independent gold standard EHR chart reviews conducted by an expert adjudication panel of eight pain and addiction medicine clinical experts across four large healthcare systems. The experts relied on clinical judgement and current Diagnostic and Statistical Manual of Mental Disorders-5 criteria for making OUD diagnoses.Results Of the 169 EHR charts, 81 (48%) were reviewed by more than one expert and exhibited 85% agreement between the reviewing experts. The OUD ICD codes alone had 10% sensitivity and 99% specificity, underscoring the strong potential for OUD underestimation in studies depending on ICD codes alone. In comparison, after four iterations, the algorithms identified OUD with a 23% sensitivity and 98% specificity.Conclusions and Relevance This is the first study to evaluate the validity of OUD ICD codes and develop validated EHR-based algorithms to address OUD underestimation. This work has the potential to inform future research on early intervention and prevention of OUD.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis project was supported by the National Center for Advancing Translational Sciences (NCATS), National Institutes of Health, through Grant Award Number UL1TR002489 and the Duke Endowment through a pilot grant. SIR, SWM, TSC, PRC, and LTW were supported by a grant from the Centers for Disease Control and Prevention (R01CE003009). BWP and SIR were also supported through a grant funded by the National Institute for Drug Abuse (R21DA046048).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This study was approved by the Institutional Review Boards at the University of North Carolina at Chapel Hill, Duke University, Medical University of South Carolina, and Wake Forest University.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe data from the study are not directly available as these contain private health information obtained from electronic medical records. Aggregate level deidentified data can be made available by emailing the corresponding author. All code and methods used are available online at: https://github.com/ShabbarIR/OUD-algorithms-development-and-validation https://github.com/ShabbarIR/OUD-algorithms-development-and-validation ER -