Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Analysis of diagnosis instability in electronic health records reveals diverse disease trajectories of severe mental illness

View ORCID ProfileJuan F. De la Hoz, Alejandro Arias, Susan K. Service, Mauricio Castaño, View ORCID ProfileAna M. Diaz-Zuluaga, Janet Song, Cristian Gallego, Sergio Ruiz-Sánchez, Javier Escobar, View ORCID ProfileAlex A. T. Bui, View ORCID ProfileCarrie E. Bearden, View ORCID ProfileVictor Reus, Carlos Lopez-Jaramillo, Nelson B. Freimer, View ORCID ProfileLoes M. Olde Loohuis
doi: https://doi.org/10.1101/2022.08.20.22279007
Juan F. De la Hoz
1Center for Neurobehavioral Genetics, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Juan F. De la Hoz
  • For correspondence: juanfdelahoz@gmail.com
Alejandro Arias
2Department of Mental Health and Human Behavior, University of Caldas, Manizales, Colombia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Susan K. Service
1Center for Neurobehavioral Genetics, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mauricio Castaño
2Department of Mental Health and Human Behavior, University of Caldas, Manizales, Colombia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ana M. Diaz-Zuluaga
1Center for Neurobehavioral Genetics, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ana M. Diaz-Zuluaga
Janet Song
1Center for Neurobehavioral Genetics, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Cristian Gallego
2Department of Mental Health and Human Behavior, University of Caldas, Manizales, Colombia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sergio Ruiz-Sánchez
3Department of Psychiatry, University of Antioquia, Medellín, Colombia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Javier Escobar
4Department of Psychiatry, Herbert Wertheim College of Medicine, Florida International University, Miami, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alex A. T. Bui
5Department of Radiological Sciences, University of California Los Angeles, California, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Alex A. T. Bui
Carrie E. Bearden
1Center for Neurobehavioral Genetics, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Carrie E. Bearden
Victor Reus
6Department of Psychiatry, University of California San Francisco, San Francisco, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Victor Reus
Carlos Lopez-Jaramillo
3Department of Psychiatry, University of Antioquia, Medellín, Colombia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nelson B. Freimer
1Center for Neurobehavioral Genetics, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Loes M. Olde Loohuis
1Center for Neurobehavioral Genetics, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Loes M. Olde Loohuis
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Investigations using Electronic Health Records (EHR) databases could enable accurate delineation of psychiatric disease trajectories at an unprecedented scale. Using EHR from a single institution (Clínica San Juan de Dios in Manizales, Colombia), we characterize diagnostic trajectories of >22,000 (ages 4-90, 60% female) individuals treated for severe mental illness (SMI), including schizophrenia (SCZ), bipolar disorder (BD), and severe or recurrent major depressive disorder (MDD).

We extracted diagnostic codes, clinical notes, and healthcare use data collected since 2005. Using a subsample of 105 SMI patients, we assessed diagnostic reliability, comparing EHR to clinical chart review. EHR diagnostic codes showed very good agreement with chart review diagnoses (Cohen’s kappa 0.78). Using 3,600 annotated sentences from 2,788 patients, we developed a pipeline for extracting clinical features from the electronic text, which showed high agreement with gold-standard annotations (average F1 0.88). Factors associated with diagnostic instability, defined as changes in diagnosis between successive visits, were identified using mixed-effect logistic regression models.

Of SMI patients with >3 visits (n=12,962), 64% had multiple EHR diagnoses; diagnostic switches (19%), comorbidities (30%), and both (15%). While some diagnostic switches are common, such as the switch from MDD to BD (observed in 22% of BD patients), trajectories are highly heterogeneous, with rare trajectories (occurring in <1% of patients) making up the majority (58% of all patients). Predictors of diagnostic instability include time since initial visit (OR 0.56 by visit number, p-value 2e-66), previous diagnostic change (OR= 4.02, p-value 3e-250) and NLP-derived descriptions of delusions (OR 1.50, p-values 2e-18).

Our results underline the importance of considering longitudinal rather than cross-sectional diagnoses in psychiatric research and show how high-quality EHR data can contribute to global efforts to understand disease trajectories.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

Research reported here was supported by R01MH123157 (to LMOL, CLJ, and NBF), R01MH113078 (to CEB, CLJ, and NBF), R00MH116115 (to LMOL), T32MH073526 (to JFDLH) and the Fulbright Commission in Colombia through a Fulbright-Colciencias grant (to JFDLH). The content is solely the responsibility of the authors and does not necessarily represent the official views of Fulbright or the National Institutes of Health.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

All procedures involving human subjects/patients were approved by the Institutional Review Boards at Clinica San Juan de Dios Manizales and University of California, Los Angeles

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

NA

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted August 22, 2022.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Analysis of diagnosis instability in electronic health records reveals diverse disease trajectories of severe mental illness
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Analysis of diagnosis instability in electronic health records reveals diverse disease trajectories of severe mental illness
Juan F. De la Hoz, Alejandro Arias, Susan K. Service, Mauricio Castaño, Ana M. Diaz-Zuluaga, Janet Song, Cristian Gallego, Sergio Ruiz-Sánchez, Javier Escobar, Alex A. T. Bui, Carrie E. Bearden, Victor Reus, Carlos Lopez-Jaramillo, Nelson B. Freimer, Loes M. Olde Loohuis
medRxiv 2022.08.20.22279007; doi: https://doi.org/10.1101/2022.08.20.22279007
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Analysis of diagnosis instability in electronic health records reveals diverse disease trajectories of severe mental illness
Juan F. De la Hoz, Alejandro Arias, Susan K. Service, Mauricio Castaño, Ana M. Diaz-Zuluaga, Janet Song, Cristian Gallego, Sergio Ruiz-Sánchez, Javier Escobar, Alex A. T. Bui, Carrie E. Bearden, Victor Reus, Carlos Lopez-Jaramillo, Nelson B. Freimer, Loes M. Olde Loohuis
medRxiv 2022.08.20.22279007; doi: https://doi.org/10.1101/2022.08.20.22279007

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Psychiatry and Clinical Psychology
Subject Areas
All Articles
  • Addiction Medicine (280)
  • Allergy and Immunology (577)
  • Anesthesia (139)
  • Cardiovascular Medicine (1942)
  • Dentistry and Oral Medicine (252)
  • Dermatology (183)
  • Emergency Medicine (331)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (697)
  • Epidemiology (11086)
  • Forensic Medicine (8)
  • Gastroenterology (619)
  • Genetic and Genomic Medicine (3156)
  • Geriatric Medicine (307)
  • Health Economics (560)
  • Health Informatics (2037)
  • Health Policy (861)
  • Health Systems and Quality Improvement (781)
  • Hematology (309)
  • HIV/AIDS (682)
  • Infectious Diseases (except HIV/AIDS) (12702)
  • Intensive Care and Critical Care Medicine (707)
  • Medical Education (317)
  • Medical Ethics (92)
  • Nephrology (334)
  • Neurology (2977)
  • Nursing (162)
  • Nutrition (461)
  • Obstetrics and Gynecology (589)
  • Occupational and Environmental Health (614)
  • Oncology (1548)
  • Ophthalmology (474)
  • Orthopedics (185)
  • Otolaryngology (265)
  • Pain Medicine (201)
  • Palliative Medicine (57)
  • Pathology (402)
  • Pediatrics (909)
  • Pharmacology and Therapeutics (381)
  • Primary Care Research (354)
  • Psychiatry and Clinical Psychology (2774)
  • Public and Global Health (5583)
  • Radiology and Imaging (1090)
  • Rehabilitation Medicine and Physical Therapy (630)
  • Respiratory Medicine (755)
  • Rheumatology (338)
  • Sexual and Reproductive Health (311)
  • Sports Medicine (287)
  • Surgery (342)
  • Toxicology (48)
  • Transplantation (159)
  • Urology (131)