ABSTRACT
Background The diagnostic performance of the high-sensitivity troponin T (hs-cTnT) European Society of Cardiology (ESC) 0/1-hour algorithm in sex and race subgroups is unclear, particularly in U.S. Emergency Department (ED) patients.
Methods A pre-planned subgroup analysis of the STOP-CP cohort study was conducted. Participants with 0- and 1-hour hs-cTnT measures (Roche Diagnostics; Basel, Switzerland), prospectively enrolled at eight U.S. EDs from 1/2017-9/2018, were stratified into rule-out, observation, and rule-in zones using the hs-cTnT ESC 0/1 algorithm. The primary outcome was adjudicated 30-day cardiac death or MI. Rates of patient stratification to each ESC 0/1 zone and the proportion with 30-day cardiac death or MI in each zone were compared between subgroups with Fisher’s-exact tests. The negative predictive value (NPV) of the ESC 0/1 rule-out zone for 30-day cardiac death or MI was calculated and compared between subgroups using Fisher’s exact tests.
Results Of the 1422 patients enrolled, 54.2% (770/1422) were male and 58.1% (826/1422) white with a mean age of 57.6 ± 12.8 years. At 30 days, cardiac death or MI occurred in 12.9% (183/1422) of participants. The ESC 0/1-h algorithm ruled-out more women than men [66.9% (436/652) vs 50.0% (385/770); p<0.001] and a similar proportion of white vs non-white patients [59.3% (490/826) vs 55.5% (331/596); p=0.16]. Among patients stratified to the rule-out zone, 30-day cardiac death or MI occurred in 1.1% (5/436) of women vs 2.1% (8/436) of men (p=0.40) and 1.2% (4/331) of non-white patients vs 1.8% (9/490) of white patients (p=0.58). The NPV for 30-day cardiac death or MI was similar among women vs men [98.9% (95%CI 97.3-99.6) vs 97.9% (95%CI 95.9-99.1); p = 0.40] and among white vs non-white patients [98.8% (95%CI 96.9-99.7) vs 98.2% (95%CI 96.5-99.2); p=0.39].
Conclusions The ESC 0/1-h hs-cTnT algorithm ruled-out more women than men, but achieved similar NPV for 30-day cardiac death or MI in all subgroups. NPVs <99% in each subgroup suggests the hs-cTnT ESC 0/1-h algorithm may not be safe for U.S. ED use.
Trial Registration High-Sensitivity Cardiac Troponin T to Optimize Chest Pain Risk Stratification (STOP-CP; ClinicalTrials.gov: NCT02984436; https://clinicaltrials.gov/ct2/show/NCT02984436)
What is Known
The European Society of Cardiology high-sensitivity troponin T (hs-cTnT) 0/1-hour algorithm has been validated as a tool to rule-out myocardial infarction (MI).
Evaluations of its performance differences based on sex and race are limited.
What the Study Adds
In this multisite U.S. cohort study of 1422 adults, the high-sensitivity troponin T (hs-cTnT) ESC 0/1-hour algorithm had a similar NPV in men vs women and white vs non-white patients but did not achieve ≥99% NPV for 30-day cardiac death or MI in any subgroup.
Emergency providers should be aware of the potential limitations of using the ESC 0/1-hour hs-cTnT algorithm for risk stratification because it may not satisfactorily exclude 30-day cardiac death or MI in any subgroup of ED patients (men, women, white patients, or non-white patients) with acute chest pain.
INTRODUCTION
Chest pain leads to over 6.5 million Emergency Department (ED) visits in the U.S. per year.1–3 To optimize care for these patients, accelerated diagnostic protocols (ADP) have been developed to objectively guide patient risk stratification. The high sensitivity cardiac troponin T European Society of Cardiology 0/1-hour algorithm (hs-cTnT ESC 0/1-hour algorithm) is a commonly used ADP and is recommended by European and U.S. guidelines.4–11
In several studies, mostly conducted in Europe and Australasia, the hs-cTnT ESC 0/1-hour algorithm has demonstrated a ≥99% negative predictive value (NPV) for 30-day myocardial infarction (MI) or cardiac death.6, 7, 12, 13 Its performance in U.S. patients with acute chest pain is not as well established.14 In the primary analysis of the STOP-CP multisite U.S. cohort, the hs-cTnT ESC 0/1-hour algorithm did not achieve a 99% NPV, which is the threshold commonly used for ADP safety.15 However, it is unclear whether diagnostic performance was consistent across key patient subgroups, such as men, women, white patients, and non-white patients and there is a paucity of prior data evaluating sex or race differences in algorithm performance. Prior studies have demonstrated significant differences in 99th percentile hs-cTnT values among men versus women and white patients versus non-white patients.16–19 In addition, it has been hypothesized that greater racial diversity of U.S. ED patients may explain differences in the diagnostic performance of the ESC 0/1-hour algorithm in the U.S. vs Europe and Australasia. Thus, it is plausible that performance of the ESC 0/1-hour algorithm may differ based on demographics.
The primary objective of this study was to evaluate and compare the diagnostic performance of the hs-cTnT ESC 0/1-hour algorithm for 30-day cardiac death or MI in men vs women and white vs non-white patients within the STOP-CP cohort. A secondary objective was to evaluate and compare diagnostic performance for 30-day major adverse cardiovascular events (MACE; defined as cardiac death, MI, or coronary revascularization) in these subgroups.
METHODS
Study Design and Setting
This is a preplanned subgroup analysis of the High-Sensitivity Cardiac Troponin T (Gen 5 STAT assay) to Optimize Chest Pain Risk Stratification (STOP-CP; ClinicalTrials.gov: NCT02984436) prospective, multicenter cohort study. STOP-CP enrolled patients with symptoms concerning for ACS at eight U.S. EDs from 01/25/2017 to 09/06/2018. Study sites included the University of Florida, Gainesville, Florida; Wake Forest University, Winston Salem, North Carolina; Henry Ford Health System, Detroit, Michigan; University of Maryland St. Joseph Medical Center, Towson, Maryland; University of Maryland Medical Center, Baltimore, Maryland; University of Maryland Baltimore Washington Medical Center, Glen Burnie, Maryland; University of California-Davis, Davis, California; and University of Utah, Salt Lake City, Utah. Institutional review board approval was obtained at all sites. Written informed consent was obtained for enrollment. STOP-CP methods are previously described.20 The Standards for Reporting of Diagnostic Accuracy Studies (STARD) guidelines helped direct the research and manuscript development processes.21
Study Population
We prospectively enrolled ED patients ≥21 years of age with serial troponins ordered for the evaluation of possible acute coronary syndrome (ACS). Exclusion criteria included ST-elevation myocardial infarction, systolic blood pressure <90 mmHg, life expectancy <90 days, a non-cardiac illness requiring admission, inability to provide consent or be contacted for follow-up, non-English speaking, pregnancy, being a prisoner, or previous enrollment in the study.
Data Collection
Serial blood samples were collected for hs-cTnT measurement at baseline (<1 hour from first clinical blood draw) and 1-hour later in lithium heparin tubes. hs-cTnT was quantified with the Gen 5 STAT assay on the Cobas e 601 analyzer (Roche Diagnostics; Basel, Switzerland). The assay has a range of 3 to 10,000 ng/L, limit of quantification at 6 ng/L, and a 99th percentile upper reference limit (URL) of 19 ng/L in the U.S. with a coefficient of variation of <10%.22 Treating providers were blinded to hs-cTnT results therefore, patient care was dictated by local standards of care and guided by contemporary cTn results.
Demographic data were collected by research staff from the patient by self-report and were supplemented by the patient’s electronic medical record. These included age on the day of emergency department visit, sex, race and ethnicity, and risk factors (current or prior tobacco use, hypertension, hyperlipidemia, diabetes, family history of coronary artery disease (CAD), obesity, prior cerebrovascular accident, peripheral vascular disease, and end-stage renal disease). Initial electrocardiogram (ECG) findings of acute ischemia were indicated by the treating physician.
ESC 0/1-Hour Algorithm
In each patient, hs-cTnT measures were used to stratify patients into rule-out, observation, and rule-in zones using established assay-specific cut-points.4, 5, 20 However, the hs-cTnT ESC 0/1-hour algorithm’s 0-hour rule-out cut-point of 5 ng/L (the limit of detection) was modified to 6 ng/L (the limit of quantification), because the U.S. Food and Drug Administration does not allow reporting below the limit of quantification. Based on prior derivation and validation studies, patients stratified to the rule-out zone were expected to have ≥99% NPV for cardiac death or MI.6, 7, 13, 23
Outcomes
The primary outcome was 30-day cardiac death or MI, inclusive of index visit events. Secondary outcomes included: 1) 30-day MACE, 2) the individual MACE components (cardiac death, MI, and coronary revascularization) at index and from index through 30-days, and 3) efficacy, defined as the proportion of patients classified into the rule-out zone.24, 25 Medical record review and telephone follow-up through 30-days were completed to determine outcomes. Expert reviewers adjudicated any patient who experienced death, a clinical diagnosis of MI, or had an elevated contemporary cTn. Adjudicators classified deaths as cardiac or non-cardiac based on the Action to Control Cardiovascular Risk in Diabetes (ACCORD) trial definition, except for death due to stroke which was classified as a non-cardiac death.26 If the cause of death could not be determined, it was considered cardiac. MI was determined by the Fourth Universal Definition of MI: rise and fall of troponin (with at least one value ˃99th percentile URL) with symptoms of ischemia, ECG evidence of ischemia, imaging evidence of new non-viable myocardium, a new regional wall motion abnormality, or evidence of thrombus on angiography.27
Statistical Analysis
Counts, percentages, means and standard deviations, or medians and interquartile (IQR) ranges were used to describe the study population. To evaluate the performance of the ESC 0/1-hour algorithm, sensitivity, specificity, negative and positive predictive values (NPV and PPV), and negative and positive likelihood ratios (-LR and +LR) for 30-day cardiac death or MI and 30-day MACE were calculated. For efficacy, sensitivity, specificity, NPV and PPV, exact 95% confidence intervals (95%CI) were computed, and Fisher’s exact tests were used to compare by sex (men vs. women) and race (white vs. non-white patients). Likelihood ratios were calculated and reported with 95%CIs using the method of Simel et al.28 The asymptotic hypothesis test developed by Luts et al. was used to compare LRs by sex and race.29 Consistent with prior studies, sensitivity, NPV, and -LR were calculated for the rule-out zone (i.e., rule-out vs rule-in or observation) and specificity, PPV, and +LR were calculated for the rule-in zone (i.e., rule-in vs. observation or rule-out).6, 7, 20, 30, 31 Fisher’s exact tests were used to compare cardiac death or MI and MACE at index and from index though 30-days among sexes and races.
To assess the association of sex or race with index and 30-day cardiac death or MI and 30-day MACE, multivariable logistic regression was performed. Models were adjusted for age, sex, race (white vs. non-white patients), hypertension, diabetes, hyperlipidemia, obesity (BMI ≥ 30kg/m2), current smoking, prior stroke, peripheral vascular disease, and end stage renal disease. These variables were selected due to their relevance and inclusion in previous cardiovascular risk stratification work.31 Ethnicity was not included in this analysis. For each outcome we computed two separate adjusted models, one containing an interaction term between ESC 0/1-hour zone and sex, and another containing an interaction term between ESC 0/1-hour zone and race. Separate, unadjusted logistic regression models were fit to evaluate the association between sex and race with the primary and secondary outcomes within each ESC 0/1-hour zone. Unadjusted or adjusted odds ratios (aOR) with corresponding 95%CIs were calculated as appropriate for each logistic model.
Results
This preplanned subgroup analysis included 1,422 patients. The patient flow diagram is shown in Figure 1. The cohort was 54.1% (770/1422) male and 58.1% (826/1422) white, with a mean age of 57.6±12.8 years. Patient demographics are presented in Table 1. The rate of 30-day cardiac death or MI in the cohort was 12.9% (183/1422), occurring in 8.7% (57/652) of women compared to 16.4% (126/770) of men (p < 0.001) and 11.2% (67/596) of non-white patients compared to 14.0% (116/826) of white patients (p = 0.12). MACE at 30-days was also more common in men than women [18.2% (140/770) vs. 9.7% (63/652); p < 0.001] and among white patients than non-white patients [16.0% (132/826) vs. 11.9% (71/596); p = 0.03].
ESC 0/1-Hour Algorithm by Sex
The efficacy of the hs-cTnT ESC 0/1-hour algorithm was higher in women than men, with 66.9% (436/652) of women stratified to the rule-out zone compared to 50.0% (385/770) of men (p<0.001). Among patients stratified into the rule-out zone, 30-day cardiac death or MI occurred in 1.1% (5/436) of women vs 2.1% (8/385) of men [OR 0.55, 95%CI 0.16-1.65]. MACE at 30 days did not significantly differ by sex among those in the rule-out zone, with a MACE rate of 1.8% (8/436) for women and 3.9% (15/385) for men [OR 0.46, 95%CI 0.18-1.07]. The NPV for 30-day cardiac death or MI was 98.9% (95%CI 97.3-99.6) in women and 97.9% (95%CI 95.9-99.1) in men (p=0.40). Events for men and women stratified by ESC 0/1-hour rule-out, observation, and rule-in zones are summarized in Table 2.
The ESC 0/1-hour algorithm classified 8.7% (57/652) of women into the rule-in zone vs. 17.3% of men (133/770) (p<0.001). Among rule-in patients, the rate of index cardiac death or MI was similar between women and men [61.4% (35/57) vs. 52.6% (70/133); OR 1.43, 95%CI 0.76-2.72]. The PPV for 30-day cardiac death or MI was 63.2% (95%CI 49.3-75.6) for women and 56.4% (95%CI 47.5-65.0) for men (p=0.42). However, the +LR for 30-day cardiac death or MI was higher for women than men (17.9, 95%CI 11.3-28.5 vs. 6.6, 95%CI 5.0-8.8; p< 0.001). The diagnostic performance of the algorithm by sex and race is summarized in Table 3 and Figure 2.
The interaction between the ESC 0/1-h algorithm and sex was significant for 30-day cardiac death or MI (p=0.04) and 30-day MACE (p=0.021). The adjusted odds of 30-day cardiac death or MI and 30-day MACE were higher for men in the rule-out and observation zones based on point estimates, but higher for women in the rule-in zone. Figure 3 and Supplemental Table 1 show the aORs for index and 30-day cardiac death or MI and MACE.
ESC 0/1-Hour Algorithm by Race
The efficacy of the ESC 0/1-hour algorithm was similar between non-white and white patients [55.5% (331/596) vs. 59.3% (490/826); p = 0.16]. Among patients who were ruled out by ESC 0/1-hour algorithm, cardiac death or MI at 30-days occurred in 1.2% (4/331) of non-white patients compared to 1.8% (9/490) of white patients [OR 0.65, 95%CI 0.18-2.03]. MACE at 30-days was also similar by race among patients classified into the rule-out zone, with a MACE rate of 2.1% (7/331) for non-white patients compared to 3.3% (16/490) for white patients [OR 0.64, 95%CI 0.24-1.52]. The NPV for 30-day cardiac death or MI was 98.8% (95%CI 96.9-99.7) for non-white patients and 98.2% (96.5-99.2) for white patients (p=0.58). Event rates for non-white and white patients stratified by ESC 0/1-hour algorithm rule-out, observation, and rule-in zones are summarized in Table 4 and Figure 4.
The ESC 0/1-hour algorithm classified 15.6% (93/596) of non-white patients into the rule-in zone vs. 11.7% (97/826) of white patients (p=0.04). Among rule-in patients, the rate of index cardiac death or MI was lower in non-white patients than white patients [47.3% (44/93) vs. 62.9% (61/97); OR 0.53, 95%CI 0.30-0.94]. At 30 days, 49.5% (46/93) of non-white patients experienced cardiac death or MI compared to 67.0% (65/97) of white patients (OR 0.48, 95%CI 0.27-0.86). The PPV for 30-day cardiac death or MI was 49.5% (95%CI 38.9-60.0) for non-white patients and 67.0% (95%CI 56.7-76.2) for white patients (p=0.21). The test characteristics for the rule-in zone are presented in Table 3.
The overall interaction of the ESC 0/1-hour algorithm with race was not significant for outcomes of 30-day cardiac death or MI (p=0.951) or 30-day MACE (p=0.861). Adjusted odds ratio point estimates remained greater than one for white patients compared to non-white patients in each ESC 0/1-hour algorithm zone. Figure 3 and Supplemental Table 1 show the aORs for index and 30-day cardiac death or MI and MACE.
Discussion
In this multicenter, prospective study, the hs-cTnT ESC 0/1-hour algorithm failed to achieve an acceptable15 NPV ≥99% for 30-day cardiac death or MI among any sex or race subgroup. Although efficacy was higher in women, there was no difference in safety among men vs. women. While fewer women were placed in the rule-in zone, they were more likely to experience 30-day cardiac death or MI or MACE than men. Efficacy and safety were similar among white and non-white patients. More non-white patients were classified to the rule-in zone, but they had lower odds of 30-day cardiac death or MI than white patients in the rule-in zone.
Use of the hs-cTnT ESC 0/1-hour algorithm for evaluation of ED patients with chest pain is a class I recommendation by the European Society of Cardiology guidelines.4 This recommendation is based on international studies of the algorithm, which have demonstrated a NPV ≥99% for index-MI,32, 33 30-day cardiac death or MI,34 or 30-day MACE.6, 7 However, in some cohorts the hs-cTnT ESC 0/1-hour algorithm has failed to achieve the ≥ 99% NPV for adverse cardiac events, which is the threshold most physicians consider acceptable.30, 35–39 This includes the primary analysis of the U.S.-based STOP-CP trial.20 Data from this subgroup analysis demonstrates adds to that primary analysis by demonstrating that the algorithm failed to achieve a NPV ≥99% for 30-day cardiac death or MI or 30-day MACE among any sex or race subgroup. This suggests the hs-cTnT ESC 0/1-hour algorithm alone may not be able to adequately identify US ED patients with chest pain who are safe for discharge.
Our results demonstrated that the hs-cTnT ESC 0/1-hour algorithm placed more women into the rule-out zone compared to men. This is consistent with a prior subgroup analysis of the hs-cTnT 0/1-hour algorithm in European and U.S. cohorts.6, 7, 14, 39 Sex-based differences in efficacy may be explained by sex-specific differences in normal troponin ranges and thresholds for MI diagnosis. Previous evidence suggests that normal troponin concentrations are lower among women compared to men, possibly due to differences in left ventricular mass.16, 40, 41 The Fourth Universal Definition of Myocardial Infarction (UDMI) recommends using sex-specific troponin cutoffs. When used, sex-specific hs-cTnT 99th percentile URL cutoffs increase the diagnosis of MI among women.16, 27 Kimenai et. al, found that at given levels of elevated hs-cTnT, women had higher risk of cardiovascular events than men, which may explain why we found a higher point estimate odds of 30-day cardiac death or MI for women in the rule-in group compared to men.42 We did not observe increased rates of 30-day cardiac death or MI or MACE for women relative to men in the rule-out zone, but the study may have been underpowered to detect this difference. The higher proportion of 30-day cardiac death or MI among women in the rule-in zone compared to men suggests sex-specific rule-in hs-cTnT thresholds may be needed for chest pain diagnostic pathways and should be a point of future study.
We found no significant interaction between race and ESC 0/1-hour algorithm for 30-day cardiac death or MI, with white patients in each ESC 0/1-hour algorithm zone having higher odds of 30-day cardiac death or MI compared to non-white patients. However, despite a significantly higher proportion of non-white patients placed in the rule-in zone compared to white patients, non-white patients had significantly lower odds of 30-day cardiac death or MI compared to white patients in the rule-in zone. This suggests that use of hs-cTnT ESC 0/1-hour algorithm may lead to disproportionate over-testing among non-white patients. The underlying mechanisms for this are unclear and warrant further study but may be related to unmeasured social determinants of health,. In addition, future studies are needed to determine if integrating individualized hs-cTn cutoffs based on race, social determinants, or other variables into a 0/1-hour algorithm reduces over-classification of patients into the rule-in zone.
Limitations
Although this study was conducted at eight U.S. EDs, these were mostly academic sites, which limits generalizability to other care settings. Informed consent was required to participate in STOP-CP, resulting in possible selection bias. Sex and race were determined by patient self-reporting and medical record review which may have led to misclassification bias. Ethnicity was not included in this analysis. The 30-day cardiac death or MI and MACE rates in STOP-CP are higher than in previous U.S. cohorts, and this increased prevalence may impact NPV and PPV.14, 30 As required by the Food and Drug Administration, the lowest reportable value for the hs-cTnT assay was 6 ng/L, which is different than the ESC 0/1-hour algorithm rule-out threshold hs-cTnT value of 5 ng/L used outside of the U.S. Our prior analyses suggest that this change has a minimal impact on the performance of the hs-cTnT ESC 0/1-hour algorithm.43, 44 However, it may affect the generalizability of these results outside of the U.S. This study used only the Roche hs-cTnT assay. Therefore, these conclusions cannot be applied to ESC 0/1-hour hs-cTnI algorithm derivations. Finally, this study was observational and as such, the ESC 0/1-hour hs-cTnT algorithm was not used to guide patient care.
Conclusions
In this multisite, prospective U.S. cohort study, the hs-cTnT ESC 0/1-hour algorithm did not achieve a NPV ≥ 99% in any sex or race subgroup. Efficacy was significantly higher for women compared to men. More non-white patients were classified into the rule-in zone, though they had significantly lower adjusted odds of 30-day cardiac death or MI compared to white patients in the rule-in zone. Future studies should assess the integration of individualized hs-cTnT thresholds to optimize risk stratification of ED patients with chest pain.
Data Availability
Data
Sources of Funding
This investigator-initiated study was funded by Roche Diagnostics.
Disclosures
Dr. O’Neill receives funding/support from Cytovale, Wake Forest CTSI, and National Center for the Advancement of Translational Sciences.
Dr. Ashburn receives funding from NHLBI (T32HL076132).
Dr. Snavely receives funding from Abbott and HRSA (1H2ARH399760100).
Dr. Stopyra receives research funding from NCATS/NIH (KL2TR001421), HRSA (H2ARH39976-01-00), Roche Diagnostics, Abbott Laboratories, Pathfast, Genetesis, Cytovale, Forest Devices, Vifor Pharma, and Chiesi Farmaceutici.
Dr. Mahler receives funding/support from Roche Diagnostics, Abbott Laboratories, Ortho Clinical Diagnostics, Siemens, Grifols, Pathfast, Quidel, Genetesis, Cytovale, and HRSA (1H2ARH399760100). He is a consultant for Roche, Quidel, Abbott, Genetesis, Inflammatix, Radiometer, and Amgen and the Chief Medical Officer for Impathiq Inc.
Dr. Allen receives research funding/support from Roche Diagnostics, Siemens Healthineers and Beckman Coulter. He is a consultant for Roche Diagnostics.
Dr. Nowak receives research funding/support from Roche Diagnostics, Beckmann Coulter, Siemens, Abbott Diagnostics, and Ortho Clinical Diagnostics. He is a consultant for Roche Diagnostics, Beckman Coulter, Siemens, Abbott Diagnostics, and Ortho Clinical Diagnostics.
Dr Mumma has research support from the NIH (5K08HL130546) and Roche Diagnostics. Dr Christenson is a consultant for and receives funding/support from Roche Diagnostics, Siemens Healthineers, Beckman Coulter Diagnostics, Becton Dickinson and Co, Quidel Corp, and Sphingotec GMBH.
Dr. Wilkerson receives research support from Regeneron, Eli Lilly, Cepheid, CoapTech, Global Blood Therapeutics, Novartis, EndPoint Health, Roche, Vapotherm, and Eldon. He has received research support from the National Heart, Lung, and Blood Institute (No. U24HL137907) and the National Institute for Diabetes and Digestive and Kidney Diseases (No. R44DK115325). He has been a contracted author for Elsevier Publishing and Relias Learning LLC. The other authors report no conflicts.
SUPPLEMENTAL MATERIALS
Acknowledgements
We appreciate Mate Huis in’t Veld MD; Michael Massoomi MD; and James McCord MD for adjudicating outcomes in the STOP-CP study. We appreciate Brennan E. Paradee MS for her contribution to the analysis.