International Journal of Radiation Oncology*Biology*Physics
Clinical InvestigationMuddy Water? Variation in Reporting Receipt of Breast Cancer Radiation Therapy by Population-Based Tumor Registries
Introduction
The Institute of Medicine has long advocated the development of systems to measure and monitor the quality of cancer care received by the US population (1). Such systems could identify populations who receive poor-quality care, thereby enabling targeted interventions to improve care and outcomes. Population-based tumor registries represent one important avenue for measuring quality of cancer care. For example, in breast cancer, data from the Surveillance, Epidemiology, and End Results (SEER) population-based registry program have been used to determine whether radiation therapy (RT) is used appropriately after lumpectomy and mastectomy 2, 3, 4, 5, 6. Such studies have largely concluded that RT is underutilized in breast cancer patients and, alarmingly, that underutilization has actually worsened in recent years (3).
Inherent to the use of registry data is the assumption that receipt of RT is correctly ascertained by the reporting registry. Several prior studies have generally suggested good accuracy of RT ascertainment by SEER registries when compared against the gold standard of Medicare billing claims 7, 8. However, such studies focused on the 9 to 13 SEER registries available at that time and did not evaluate the accuracy of RT coding in the expanded SEER program, which now includes 16 registries with linked Medicare billing claims, or in other population-based registries that do not participate in SEER. As registry data continue to be used by investigators to evaluate RT utilization and outcomes, a contemporary evaluation of the accuracy of RT coding is warranted.
Accordingly, we sought to evaluate the accuracy of registry RT ascertainment against the gold standard of Medicare billing claims in a contemporary cohort of breast cancer patients. To accomplish this, we used linked SEER–Medicare data, representing approximately 26% of the US population, to (1) determine underascertainment, sensitivity, specificity, and κ for registry RT receipt, and (2) identify factors associated with underascertainment of RT. In addition, we partnered with the three largest non-SEER registries—Florida, New York, and Texas, representing an additional 20% of the United States—to compare RT ascertainment among these registries to the SEER registries.
Section snippets
Data sources
The SEER Program of the National Cancer Institute assembles information on cancer incidence and survival from 16 population-based tumor registries, with a case ascertainment ratio of 97% (9). Data collected include patient demographics, tumor characteristics, and treatment, including RT receipt, during the initial treatment course. The National Cancer Institute has linked SEER records to the medical billing claims of Medicare beneficiaries. Medicare covers inpatient and outpatient medical care
Descriptive characteristics of SEER–Medicare cohort
Of 73,077 patients identified in the SEER–Medicare cohort, median age at diagnosis was 75 years, 56.9% (n=41,581) underwent BCS, 37.8% (n=27,657) underwent mastectomy, and 18.0% (n=13,123) received chemotherapy (Table 1).
A total of 41.6% (n=30,386) of patients were coded as receiving RT according to SEER registries, versus 49.3% (n=36,047) according to Medicare claims (P<.001) (Table 1). For the entire cohort, underascertainment of RT was 18.7% (n=6,738/29,309, 95% confidence interval [CI]
Discussion
In this unique cohort of breast cancer patients representing nearly half the US population, we found significant variation in the ascertainment of RT by cancer registries. Whereas some registries demonstrated extremely high sensitivity, exceeding 90%, sensitivity for other registries was below 60%. Further, we found that the original SEER-9 registries had the most accurate data, while two non-SEER registries had the least accurate data. In addition, we found that rural residence and increased
Acknowledgment
The authors thank the Applied Research Program, National Cancer Institute; the Office of Research, Development and Information, Centers for Medicare and Medicaid Services; Information Management Services, Inc.; and the SEER Program tumor registries for the creation of the SEER–Medicare database. They also thank the staffs of the Texas, Florida, and New York registries for their assistance in acquisition of data, for which they received no compensation.
References (20)
- et al.
Relation between appropriateness of primary therapy for early-stage breast carcinoma and increased use of breast-conserving surgery
Lancet
(2000) - et al.
Information on radiation treatment in patients with breast cancer: The advantages of the linked Medicare and SEER data. Surveillance, Epidemiology and End Results
J Clin Epidemiol
(1999) - et al.
Rationalization and regionalization of treatment for ductal carcinoma in situ of the breast
Int J Radiat Oncol Biol Phys
(2006) - et al.
Developing a national radiation oncology registry: From acorns to oaks
Practical Radiat Oncol
(2012) - et al.
National Cancer Policy Board, Institute of Medicine: Ensuring quality cancer care
(1999) - et al.
Trends in racial and age disparities in definitive local therapy of early-stage breast cancer
J Clin Oncol
(2009) - et al.
Trends in the treatment of ductal carcinoma in situ of the breast
J Natl Cancer Inst
(2004) - et al.
Geographic variation in the treatment of localized breast cancer
N Engl J Med
(1992) - et al.
Disparities in the application of adjuvant radiotherapy after breast-conserving surgery for early stage breast cancer: Impact on overall survival
Cancer
(2011) - et al.
Studying radiation therapy using SEER-Medicare-linked data
Med Care
(2002)
Cited by (60)
Aging a Decade in a Day: Age Cutoff Bias in Adjuvant Therapy Allocation for Early-Stage Breast Cancer
2023, International Journal of Radiation Oncology Biology PhysicsValidity of state cancer registry treatment information for adolescent and young adult women
2020, Cancer EpidemiologyDisparities in the Treatment and Outcome of Stage I Non–Small-Cell Lung Cancer in the 21st Century
2019, Clinical Lung Cancer
B.D.S. and S.H.G. are supported by Grant RP101207 from the Cancer Prevention and Research Institute of Texas. This study was also supported in part by the US Department of Health and Human Services National Cancer Institute (Grants CA16672 and T32CA77050). A portion of this work was also supported by a philanthropic contribution from Ann and Clarence Cazalot. M.J.S. is supported by Cooperative Agreement S3888 from the Association of Schools of Public Health/Centers for Disease Control supporting the New York–Medicare linkage.
This study used the linked Surveillance, Epidemiology, and End Results (SEER)–Medicare database. The interpretation and reporting of these data are the sole responsibility of the authors.
Conflict of interest: B.D.S. receives research support from Varian Medical Systems, but this support was not used for any portion of the present study.