Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

“Similar performances but markedly different triaging thresholds in three CAD4TB versions risk systematic errors in TB screening programs”

View ORCID ProfileJana Fehr, View ORCID ProfileEmily B. Wong
doi: https://doi.org/10.1101/2022.04.29.22274472
Jana Fehr
1Digital Health & Machine Learning, Hasso Plattner Institute for Digital Engineering and University of Potsdam, Germany
2Africa Health Research Institute, KwaZulu-Natal, South Africa
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Jana Fehr
Emily B. Wong
2Africa Health Research Institute, KwaZulu-Natal, South Africa
3Harvard Medical School, Boston, MA, USA
4Division of Infectious Diseases, Massachusetts General Hospital, Boston, MA, USA
5Division of Infectious Diseases, University of Alabama at Birmingham, AL, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Emily B. Wong
  • For correspondence: emily.wong@ahri.org
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Tuberculosis (TB) screening programs may apply computer-aided diagnostic (CAD) tools on chest radiographs to select people for microbiological sputum examination using a pre-selected triaging threshold. CAD software-updates are frequently introduced and it is unknown whether their use requires adjustment of triaging thresholds. In a community-based screening program in South Africa, we compared the scores between the three recent CAD4TB versions (v5, v6, and v7) and assessed their performance to identify microbiologically-confirmed TB. The performance of all versions was similar (v5: AUC 0.78, v6: AUC 0.79, v7: AUC 0.80; p-values>0.05), but along a 0-100 point scale, each had markedly different score distributions and optimal triaging thresholds (v5: 40, v6: 47, v7: 20). This has the potential to cause confusion within TB screening programs as these tools are increasingly adopted and new versions released. Independent guidance for adapting CAD triaging thresholds for frequently released software updates is needed.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

The community-screening program 'Vukuzazi' is funded by the Africa Health Research Institute, the Wellcome Trust (201433/Z/16/Z), and the Bill and Melinda Gates Foundation (OPP1175182). Additional funders include NIAID (K08AI118538) and FIC (TW011687), National Institutes of Health, and Cascade IMPAc-TB Center (Contract # 75N93019C00070). The funders had no role in study design, data analysis and interpretation, or writing of the report.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Ethics committees of the University of KwaZulu-Natal Biomedical Research Ethics Committee (BE560/17), the London School of Hygiene & Tropical Medicine Ethics Committee (14722), and the Partners Institutional Review Board (2018P001802) gave ethical approval for this work.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

The Vukuzazi screening protocol as well as the dataset analyzed during the current study may be accessed via the AHRI Data Repository at https://data.ahri.org/index.php/catalog/990 upon approval of proposed analyses by the Vukuzazi Scientific Steering Committee and completion of a data access agreement.

https://data.ahri.org/index.php/catalog/990

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-ND 4.0 International license.
Back to top
PreviousNext
Posted April 29, 2022.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
“Similar performances but markedly different triaging thresholds in three CAD4TB versions risk systematic errors in TB screening programs”
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
“Similar performances but markedly different triaging thresholds in three CAD4TB versions risk systematic errors in TB screening programs”
Jana Fehr, Emily B. Wong
medRxiv 2022.04.29.22274472; doi: https://doi.org/10.1101/2022.04.29.22274472
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
“Similar performances but markedly different triaging thresholds in three CAD4TB versions risk systematic errors in TB screening programs”
Jana Fehr, Emily B. Wong
medRxiv 2022.04.29.22274472; doi: https://doi.org/10.1101/2022.04.29.22274472

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (271)
  • Allergy and Immunology (557)
  • Anesthesia (135)
  • Cardiovascular Medicine (1769)
  • Dentistry and Oral Medicine (239)
  • Dermatology (173)
  • Emergency Medicine (316)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (662)
  • Epidemiology (10812)
  • Forensic Medicine (8)
  • Gastroenterology (594)
  • Genetic and Genomic Medicine (2960)
  • Geriatric Medicine (288)
  • Health Economics (534)
  • Health Informatics (1933)
  • Health Policy (836)
  • Health Systems and Quality Improvement (745)
  • Hematology (293)
  • HIV/AIDS (633)
  • Infectious Diseases (except HIV/AIDS) (12525)
  • Intensive Care and Critical Care Medicine (696)
  • Medical Education (300)
  • Medical Ethics (87)
  • Nephrology (324)
  • Neurology (2809)
  • Nursing (152)
  • Nutrition (433)
  • Obstetrics and Gynecology (560)
  • Occupational and Environmental Health (597)
  • Oncology (1473)
  • Ophthalmology (444)
  • Orthopedics (172)
  • Otolaryngology (257)
  • Pain Medicine (190)
  • Palliative Medicine (56)
  • Pathology (381)
  • Pediatrics (868)
  • Pharmacology and Therapeutics (367)
  • Primary Care Research (338)
  • Psychiatry and Clinical Psychology (2647)
  • Public and Global Health (5383)
  • Radiology and Imaging (1016)
  • Rehabilitation Medicine and Physical Therapy (597)
  • Respiratory Medicine (727)
  • Rheumatology (330)
  • Sexual and Reproductive Health (290)
  • Sports Medicine (279)
  • Surgery (327)
  • Toxicology (48)
  • Transplantation (150)
  • Urology (126)