Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Imputation strategies for missing baseline neurological assessment covariates after traumatic brain injury: A CENTER-TBI study

View ORCID ProfileAri Ercole, Abhishek Dixit, David W Nelson, Frederick A Zeiler, View ORCID ProfileDaan Nieboer, Omar Bouamra, David K Menon, Andrew IR Maas, Simone A Dijkland, Hester F Lingsma, Lindsay Wilson, Fiona Lecky, View ORCID ProfileEwout Steyerberg, CENTER-TBI Investigators and Participants
doi: https://doi.org/10.1101/2021.04.07.21254969
Ari Ercole
1Division of Anaesthesia, University of Cambridge, Cambridge, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ari Ercole
  • For correspondence: ae105{at}cam.ac.uk
Abhishek Dixit
1Division of Anaesthesia, University of Cambridge, Cambridge, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David W Nelson
2Section for Anesthesiology and Intensive Care, Department of Physiology and Pharmacology, Karolinska Institutet, Stockholm, Sweden
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Frederick A Zeiler
3Section of Neurosurgery, Department of Surgery, Rady Faculty of Health Sciences, University of Manitoba, Winnipeg, Canada
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Daan Nieboer
4Department of Public Health, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Daan Nieboer
Omar Bouamra
8Centre for Urgent and Emergency Care Research (CURE), Health Services Research Section, School of Health and Related Research (ScHARR), University of Sheffield, Sheffield, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
David K Menon
1Division of Anaesthesia, University of Cambridge, Cambridge, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrew IR Maas
5Department of Neurosurgery, Antwerp University Hospital and University of Antwerp, Edegem, Belgium
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Simone A Dijkland
6Department of Public Health, Center for Medical Decision Making, Erasmus MCUniversity Medical Center Rotterdam, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hester F Lingsma
6Department of Public Health, Center for Medical Decision Making, Erasmus MCUniversity Medical Center Rotterdam, Rotterdam, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lindsay Wilson
7Division of Psychology, University of Stirling, Stirling, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fiona Lecky
8Centre for Urgent and Emergency Care Research (CURE), Health Services Research Section, School of Health and Related Research (ScHARR), University of Sheffield, Sheffield, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ewout Steyerberg
9Department of Medical Statistics and Bioinformatics, Leiden University Medical Center, Leiden, The Netherlands
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Ewout Steyerberg
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Statistical models for outcome prediction are central to traumatic brain injury research and critical to baseline risk adjustment. Glasgow coma score (GCS) and pupil reactivity are crucial co-variates in all such models but may be measured at multiple time points between the time of injury and hospital and are subject to a variable degree of unreliability and/or missingness. Imputation of missing data may be undertaken using full multiple imputation or by simple substitution of measurements from other time points. However it is unknown which strategy is best or which time points are more predictive. We evaluated the pseudo-R2 of logistic regression models (dichotomous survival) and proportional odds models (Glasgow Outcome Score-extended) using different imputation strategies from data from the The Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) study. Substitution strategies were easy to implement, achieved low levels of missingness (<< 10%) and could outperform multiple imputation without the need for computationally costly calculations and pooling multiple final models. Model performance was sensitive to imputation strategy although this was small in absolute terms and clinical relevance. A strategy of using the emergency department discharge assessments and working back in time when these were missing generally performed well. Full multiple imputation had the advantage of preserving time-dependence in the models: The pre-hospital assessments were found to be relatively unreliable predictors of survival or outcome. The predictive performance of later assessments was model-dependent. In conclusion, simple substitution strategies for imputing baseline GCS and pupil response can perform well and may be a simple alternative to full multiple imputation in many cases.

Competing Interest Statement

The authors have declared no competing interest.

Clinical Trial

This work involves analysis of previously collected data and is not a trial and does not require registration. However the underlying CENTER-TBI dataset was collected as part of Clinicaltrials.gov NCT02210221

Clinical Protocols

https://www.center-tbi.eu/data

Funding Statement

European Union 7th Framework Programme, the Hannelore Kohl Stiftung, OneMind, and Integra LifeSciences Corporation.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

This sub-study was undertaken as part of the data curation process for the CENTER-TBI study. Specific ethics was not required but use of the data for this purpose was explicitly approved by the CENTER-TBI management committee. The original study, registration and ethical framework has been previously described in: 1. Maas et al 2014 Neurosurgery, Volume 76, Issue 1, January 2015, Pages 67-80, Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI): A Prospective Longitudinal Observational Study DOI 10.1227/NEU.0000000000000575 2. Steyerberg et al. 2019 Case-mix, care pathways, and outcomes in patients with traumatic brain injury in CENTER-TBI: a European prospective, multicentre, longitudinal, cohort study DOI 10.1016/S1474-4422(19)30232-7 The international ethical approvals for each participating nation in the original data collection / CENTER-TBI study can be found at the study website https://www.center-tbi.eu/project/ethical-approval

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Footnotes

  • ↵† CENTER-TBI Participants and Investigators listed in the supplementary materials.

Data Availability

Data is available on application from the CENTER-TBI management committee at https://www.center-tbi.eu/data

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted April 09, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Imputation strategies for missing baseline neurological assessment covariates after traumatic brain injury: A CENTER-TBI study
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Imputation strategies for missing baseline neurological assessment covariates after traumatic brain injury: A CENTER-TBI study
Ari Ercole, Abhishek Dixit, David W Nelson, Frederick A Zeiler, Daan Nieboer, Omar Bouamra, David K Menon, Andrew IR Maas, Simone A Dijkland, Hester F Lingsma, Lindsay Wilson, Fiona Lecky, Ewout Steyerberg, CENTER-TBI Investigators and Participants
medRxiv 2021.04.07.21254969; doi: https://doi.org/10.1101/2021.04.07.21254969
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Imputation strategies for missing baseline neurological assessment covariates after traumatic brain injury: A CENTER-TBI study
Ari Ercole, Abhishek Dixit, David W Nelson, Frederick A Zeiler, Daan Nieboer, Omar Bouamra, David K Menon, Andrew IR Maas, Simone A Dijkland, Hester F Lingsma, Lindsay Wilson, Fiona Lecky, Ewout Steyerberg, CENTER-TBI Investigators and Participants
medRxiv 2021.04.07.21254969; doi: https://doi.org/10.1101/2021.04.07.21254969

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Epidemiology
Subject Areas
All Articles
  • Addiction Medicine (431)
  • Allergy and Immunology (757)
  • Anesthesia (221)
  • Cardiovascular Medicine (3298)
  • Dentistry and Oral Medicine (365)
  • Dermatology (280)
  • Emergency Medicine (479)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (1173)
  • Epidemiology (13385)
  • Forensic Medicine (19)
  • Gastroenterology (899)
  • Genetic and Genomic Medicine (5158)
  • Geriatric Medicine (482)
  • Health Economics (783)
  • Health Informatics (3276)
  • Health Policy (1143)
  • Health Systems and Quality Improvement (1193)
  • Hematology (432)
  • HIV/AIDS (1019)
  • Infectious Diseases (except HIV/AIDS) (14637)
  • Intensive Care and Critical Care Medicine (913)
  • Medical Education (478)
  • Medical Ethics (127)
  • Nephrology (525)
  • Neurology (4930)
  • Nursing (262)
  • Nutrition (730)
  • Obstetrics and Gynecology (886)
  • Occupational and Environmental Health (795)
  • Oncology (2524)
  • Ophthalmology (728)
  • Orthopedics (282)
  • Otolaryngology (347)
  • Pain Medicine (323)
  • Palliative Medicine (90)
  • Pathology (544)
  • Pediatrics (1302)
  • Pharmacology and Therapeutics (551)
  • Primary Care Research (557)
  • Psychiatry and Clinical Psychology (4218)
  • Public and Global Health (7512)
  • Radiology and Imaging (1708)
  • Rehabilitation Medicine and Physical Therapy (1016)
  • Respiratory Medicine (980)
  • Rheumatology (480)
  • Sexual and Reproductive Health (498)
  • Sports Medicine (424)
  • Surgery (549)
  • Toxicology (72)
  • Transplantation (236)
  • Urology (205)