Abstract
Background The Veterans Health Administration COVID-19 (VACO) Index incorporates age, sex, and pre-existing comorbidity diagnoses readily available in the electronic health record (EHR) to predict 30-day all-cause mortality in both inpatients and outpatients infected with SARS-CoV-2. We examined the performance of the Index using data from Yale New Haven Hospital (YNHH) and national Medicare data overall, over time, and within important patient subgroups.
Methods and findings With measures and weights previously derived and validated in a national Veterans Healthcare Administration (VA) sample, we evaluated the accuracy of the VACO Index for estimating inpatient (YNHH) and both inpatient and outpatient mortality (Medicare) using area under the receiver operating characteristic curve (AUC) and comparisons of predicted versus observed mortality by decile (calibration plots). The VACO Index demonstrated similar discrimination and calibration in both settings, over time, and among important patient subgroups including women, Blacks, Hispanics, Asians, and Native Americans. In sensitivity analyses, we allowed component variables to be re-weighted in the validation datasets and found that weights were largely consistent with those determined in VA data. Supplementing the VACO Index with body mass index and race/ethnicity had no effect on discrimination.
Conclusion Among COVID-19 positive individuals, the VACO Index accurately estimates risk of short-term mortality among a wide variety of patients. While it modestly over-estimates risk in recent intervals, the Index consistently identifies those at greatest relative risk. The VACO Index could identify individuals who should continue practicing social distancing, help determine who should be prioritized for vaccination, and among outpatients who test positive for SARS-CoV-2, indicate who should receive greater clinical attention or monoclonal antibodies.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
ACJ: Department of Veterans Affairs, Office of Research and Development, Million Veteran Program Core (#MVP000; https://www.research.va.gov/). ACJ: National Institute on Alcohol Abuse and Alcoholism (U01-AA026224, U24-AA020794, U01-AA020790, U10-AA013566; https://www.niaaa.nih.gov/).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This study was conducted in compliance with the Health Insurance Portability and Accountability Act and was approved by the Institutional Review Boards of VA Connecticut Healthcare System and Yale University, both of whom granted waivers of consent.
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
The United States Department of Veterans Affairs (VA) places legal restrictions on access to veterans health care data, which includes both identifying data and sensitive patient information. The analytic data sets used for this study are not permitted to leave the VA firewall without a Data Use Agreement. This limitation is consistent with other studies based on VA data. VA data are made freely available to researchers behind the VA firewall with an approved VA study protocol. For more information please visit https://www.virec.research.va.gov or contact the VA Information Resource Center (VIReC) at VIReC{at}va.gov.
