ABSTRACT
Importance Patients with disorders of consciousness (DoC) after traumatic brain injury (TBI) recover to varying degrees of functional dependency. Dependency is difficult to measure but critical for outcome interpretation and prognostic counseling. Traditional outcome measures, like the Glasgow Outcome Scale-Extended (GOSE), are mandated by the US Food and Drug Administration for evaluating TBI clinical trial efficacy but have an unknown accuracy for measuring dependency.
Objective We used the Functional Independence Measure (FIM®) as the reference standard to evaluate how accurately the GOSE and Disability Rating Scale (DRS) assess functional dependency in the world’s largest cohort of patients with DoC after TBI. We propose an alternate, data-driven, approach to measuring dependency.
Design, Setting, and Participants In this cohort study, we included patients with DoC prospectively enrolled in the longitudinal Traumatic Brain Injury Model Systems National Database (TBIMS NDB). Participants were survivors of moderate/severe TBI with DoC on admission to a US inpatient rehabilitation center between 1988 and 2020, followed 1 year after injury.
Exposure We examined the classification performance of common TBI outcome measure cutpoints (GOSE ≤3 and ≤4 [Lower and Upper Severe Disability, respectively], and DRS ≥12 [Severe Disability]) in identifying subjects with functional dependency at 1 year. We compared dataderived optimal cut-points on these scales to a novel DRS-based marker of dependency, the DRSDepend.
Main Outcome and Measure Total FIM score < 80 (FIM-dependency) at 1 year.
Results Of 18,486 TBIMS participants, 1,483 with DoC on arrival to inpatient rehabilitation met inclusion criteria (mean [SD] age=38 [18] years; 76% male). The sensitivity of GOSE cut-points of ≤3 and ≤4 for identifying FIM-dependency were 97% and 98%, but specificities were 73% and 51%, respectively. The sensitivity of the DRS cut-point of ≥12 was 60%, but specificity was 100%. The DRSDepend had a sensitivity of 83% and a specificity of 94% for classifying FIM-dependency, with a greater AUROC than the data-derived optimal GOSE (≤3, p=0.01) and DRS (≥10, p=0.008) cut-points.
Conclusions and Relevance Commonly-used GOSE and DRS cut-points have limited sensitivity or specificity for identifying functional dependency. The DRSDepend identifies FIM-dependency more accurately than GOSE and DRS cut-points, but requires further validation.
Competing Interest Statement
Dr. Zafonte reported receiving royalties from Springer/Demos for the text Brain Injury Medicine as well as serving on the scientific advisory boards of Myomo, and One Care.ai. Dr. Giacino reported receiving a grant from the National Football League outside the submitted work. All other authors report no relevant disclosures.
Funding Statement
SBS receives funding from the American Academy of Neurology (Clinical Research Training Scholarship). RGK receives funding from: NIH National Institute of Neurological Disorders and Stroke (LRP). FH receives funding from National Institute on Disability, Independent Living, and Rehabilitation Research (grants 90DPTB0002, 90DPHF0006, 90DPTB0017, and 90RTEM0008); National Institutes of Health (UG3NS117844 and 1R01NS118009), PCORI UWSC9923/PCS-1604-35115; Department of Defense (W81XWH-18-1-0796); University of California- San Francisco; University of Michigan (SUBK10416CSPR-002). SI receives funding from the Neurocritical Care Society (Research Fellowship Award). BLE receives funding from the NIH National Institute of Neurological Disorders and Stroke (R21NS109627, RF1NS115268), NIH Directors Office (DP2HD101400), James S. McDonnell Foundation and Tiny Blue Dot Foundation. YGB receives funding from: NIH National Institute of Neurological Disorders and Stroke (U01 NS1365885, U01-NS086090), National Institute on Disability, Independent Living and Rehabilitation Research (NIDILRR), Administration for Community Living (90DPCP0008-01-00, 90DP0039), James S. McDonnell Foundation, and Tiny Blue Dot Foundation.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Institutional Review Board of Mass General Brigham gave ethical approval for this work.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Disclosures: Dr. Zafonte reported receiving royalties from Springer/Demos for the text Brain Injury Medicine as well as serving on the scientific advisory boards of Myomo, and One Care.ai.
Dr. Giacino reported receiving a grant from the National Football League outside the submitted work. All other authors report no relevant disclosures.
Funding: SBS receives funding from the American Academy of Neurology (Clinical Research Training Scholarship).
RGK receives funding from: NIH National Institute of Neurological Disorders and Stroke (LRP). FH receives funding from National Institute on Disability, Independent Living, and Rehabilitation Research (grants 90DPTB0002, 90DPHF0006, 90DPTB0017, and 90RTEM0008); National Institutes of Health (UG3NS117844 and 1R01NS118009), PCORI UWSC9923/PCS-1604-35115; Department of Defense (W81XWH-18-1-0796); University of California-San Francisco; University of Michigan (SUBK10416CSPR-002).
SI receives funding from the Neurocritical Care Society (Research Fellowship Award).
BLE receives funding from the NIH National Institute of Neurological Disorders and Stroke (R21NS109627, RF1NS115268), NIH Director’s Office (DP2HD101400), James S. McDonnell Foundation and Tiny Blue Dot Foundation.
YGB receives funding from: NIH National Institute of Neurological Disorders and Stroke (U01 NS1365885, U01-NS086090), National Institute on Disability, Independent Living and Rehabilitation Research (NIDILRR), Administration for Community Living (90DPCP0008-01-00, 90DP0039), James S. McDonnell Foundation, and Tiny Blue Dot Foundation.
Data Availability
All data produced in the present study are available upon reasonable request to the TBIMS study leadership.
