Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Chest CT Images for COVID-19: Radiologists and Computer-based detection

Qingli Dou, Jiangping Liu, Wenwu Zhang, Yanan Gu, Wan-Ting Hsu, Kuan-Ching Ho, Hoi Sin Tong, Wing Yan Yu, Chien-Chang Lee
doi: https://doi.org/10.1101/2020.06.27.20141531
Qingli Dou
aDepartment of Emergency Medicine, The Second Affiliated Hospital of Shenzhen University, Shenzhen, Guangdong, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jiangping Liu
aDepartment of Emergency Medicine, The Second Affiliated Hospital of Shenzhen University, Shenzhen, Guangdong, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wenwu Zhang
aDepartment of Emergency Medicine, The Second Affiliated Hospital of Shenzhen University, Shenzhen, Guangdong, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yanan Gu
aDepartment of Emergency Medicine, The Second Affiliated Hospital of Shenzhen University, Shenzhen, Guangdong, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wan-Ting Hsu
bDepartment of Epidemiology, Harvard TH Chan School of Public Health, Boston, MA, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kuan-Ching Ho
cRadiology Department, St George Hospital Sydney, Kogarah, NSW, Australia
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hoi Sin Tong
dLi Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wing Yan Yu
dLi Ka Shing Faculty of Medicine, The University of Hong Kong, Hong Kong
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Chien-Chang Lee
eDepartment of Emergency Medicine, National Taiwan University Hospital, Taipei, Taiwan
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: cclee100@gmail.com hit3transparency@gmail.com
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Background Characteristic chest computed tomography (CT) manifestation of 2019 novel coronavirus (COVID-19) was added as a diagnostic criterion in the Chinese National COVID-19 management guideline. Whether the characteristic findings of Chest CT could differentiate confirmed COVID-19 cases from other positive nucleic acid test (NAT)-negative patients has not been rigorously evaluated.

Purpose We aim to test whether chest computed tomography (CT) manifestation of 2019 novel coronavirus (COVID-19) can be differentiated by a radiologist or a computer-based CT image analysis system.

Methods We conducted a retrospective case-control study that included 52 laboratory-confirmed COVID-19 patients and 80 non-COVID-19 viral pneumonia patients between 20 December, 2019 and 10 February, 2020. The chest CT images were evaluated by radiologists in a double blind fashion. A computer-based image analysis system (uAI system, Lianying Inc., Shanghai, China) detected the lesions in 18 lung segments defined by Boyden classification system and calculated the infected volume in each segment. The number and volume of lesions detected by radiologist and computer system was compared with Chi-square test or Mann-Whitney U test as appropriate.

Results The main CT manifestations of COVID-19 were multi-lobar/segmental peripheral ground-glass opacities and patchy air space infiltrates. The case and control groups were similar in demographics, comorbidity, and clinical manifestations. There was no significant difference in eight radiologist identified CT image features between the two groups of patients. There was also no difference in the absolute and relative volume of infected regions in each lung segment.

Conclusions We documented the non-differentiating nature of initial chest CT image between COVID-19 and other viral pneumonia with suspected symptoms. Our results do not support CT findings replacing microbiological diagnosis as a critical criterion for COVID-19 diagnosis. Our findings may prompt re-evaluation of isolated patients without laboratory confirmation.

INTRODUCTION

Due to high transmissibility and so far lack of proven treatment, the 2019 novel coronavirus disease, 2019-nCoV, has quickly disseminated worldwide.4,5 As symptoms of COVID-19 are similar to other acute respiratory infections, diagnosis relies on positive nucleic acid test (NAT). Given the long turnaround time and suboptimal sensitivity of NAT, chest computed tomography (CT) was proposed as a first line diagnostic tool by the Chinese national guideline (trial version 5).7 After the new definition implementation, 14,840 new cases with 242 deaths were reported on February 13th, which was the record by far reported in a single day since the outbreak.

Several case series have reported characteristic CT findings of COVID-19, including ground glass opacities in bilateral peripheral lung, crazy-paving changes, reticular thickening, or consolidations.8,9We aim to evaluate whether radiologists or a computer-based image analysis system can reliably differentiate COVID-19 cases from non-COVID-19 but suspected patients.

METHODS

Study population

From 20 December, 2019 to 10 February, 2020, 52 laboratory-confirmed COVID-19 patients in Shenzhen were identified that fulfilled the diagnostic criteria of Chinese national guideline.10 The criteria for a confirmed case include documented laboratory evidence, compatible clinical symptoms, and exposure history. Documented laboratory evidence is defined by positive NAT result either from respiratory tract, bronchoalveolar lavage fluid, or blood sample. Compatible clinical symptoms refer to fever, cough, imaging characteristics of pneumonia, and/or normal or decreased white blood cells count or decreased lymphocyte count. Exposure history includes travel/residence history in Wuhan city, contact history with laboratory-confirmed patients, or contact history with patients with fever or respiratory symptoms from Wuhan and its surrounding areas or endemic communities, within 14 days before the onset of illness. We randomly selected 80 laboratory-confirmed non-COVID-19 viral pneumonia patients as controls. These presented with suspected symptoms and exposure history and underwent NAT and chest CT exams in the same period. These patients must have at least two negative NAT results and a laboratory evidence of other respiratory virus infection.

Chest CT evaluation by radiologists

All CT images were independently retrospectively analyzed using a structured form by two experienced radiologists in a double blinded fashion without knowing the clinical diagnosis. A third senior radiologist was consulted to solve any discrepancy by consensus. Evaluation was focused on the presence of ground glass opacities, patchy infiltration, patchy consolidation, pleural effusion, mediastinal lymphadenopathy, air bronchogram, pleural thickening, and Interstitial change.

Machine-learning based CT lesion detection and quantification system

We used the uAI image analysis system (Lianying Intelligent Medical Technology Co Ltd, Shanghai, China) for detection and quantification of chest CT lesions (Computer-based detection in Appendix). The system classifies the lung fields into five lung lobes and 18 lung segments based on Boyden classification, detected infected regions in each anatomical region, and quantified the cumulative and relative infected volume. The infected volumes between the two groups were also compared in four different CT windows. This study was approved by the Institutional Review Board of the Second Affiliated Hospital of Shenzhen University.

Statistical analysis

Categorical variables were expressed as number and proportion and compared with a Chi-square test. Continuous variables were presented with mean ± standard deviation for data with a normal distribution and tested by Student t test. Data with non-normal distribution were presented with median with interquartile range and compared with independent sample Mann-Whitney U test. All tests in this study were two-sided, and P <0.05 was deemed statistically significant. Data were analyzed using SPSS 23.0 software.

RESULTS

Study patients

There was no significant difference between case and control cases in all categories (Table 1).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1. Patients characteristics between case and control patients [n(%)]

Comparison of CT interpretation by radiologists

In both COVID-19 and non-COVID-19 viral pneumonia patients, ground-glass opacity (Supplemental Figures 1A and 1B) and patchy airspace infiltrates (Supplemental Figures 2A and 2B) were the major findings. The lesions could be found in multiple lobes or segments, more often bilateral. There was no statistical significance between the distribution of lesions identified by radiologists in the two groups (Table 2).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 2. Radiologist interpretation of chest CT before NAT results [n(%)]

Comparison of computer system detected infected lung volume

Compared between COVID-19 and non-COVID-19 viral pneumonia patients, there was no significant difference in the computer system detected infected lung volume /percentage in 5 lung lobes and in different lung segments (Table 3). Similarly, there was no significant difference in the absolute or relative infected lung volume between the two groups of patients (Table S1).

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 3. Difference in lesions distribution between COVID-19 and non-COVID-19 viral pneumonia patients

Sensitivity analysis under different radiodensity windows for machine detection

The lesions’ infection volume/percentage for COVID-19 and non-COVID-19 patients were stratified by four different CT number ranges (Table S2). Lesions in the [-750, -300) Hounsfield units (HU) range were arbitrarily chosen to reflect ground-glass opacity, while those with CT numbers in the [-300, 50) range were considered as denser airspace infiltrates and consolidation. Anything less than -750 becomes harder to differentiate from normal lung tissue. An extreme number 50 was chosen, beyond which infection becomes unlikely, though not impossible, as the number starts to get into the soft tissue mass range. No statistically significant difference in the infected volumes between the two groups was found in any of the four ranges.

DISCUSSION

Chen et al. studied 29 patients with COVID-19 showed that the chest image lesions were mostly bilateral and multiple with patchy shadows and ground glass opacities.11.12 Pan et al reported CT images of COVID-19 are diverse in the early stages, which may present ground-glass opacities, pulmonary consolidation and nodules.13These studies were case series without suitable control groups.8,9,13-15 We found Radiologists’ interpretation alone or computer-based lesion detection cannot differentiate COVID-19 form other viral pneumonia. Such findings were robust under different anatomic sites or CT density ranges.

There are pros and cons using clinical diagnosis as a case definition. Clinical diagnosis allows early isolation with initial false negative NAT, slows transmission, and implements treatment early. However, the use of chest CT as a first line diagnostic method may miss early/mild disease, promote cross-infection in the CT room, increase radiation exposure, and consume enormous resources of disinfection.

Our findings have multiple implications. First, clinicians should not rely on initial chest CT findings to diagnose COVID-19 in the absence of laboratory confirmation. Second, patients who had been diagnosed with COVID-19 based on the clinical grounds should be re-evaluated with serum antibody tests. Third, patients who were isolated and cohorted with laboratory-confirmed cases in the temporary COVID-19 hospitals of Hubei province may need to be reevaluated aiming for further laboratory evidence including repeated NAT or serum antibody test.

Results of study should be interpreted in light of its shortfalls. Due to the constraints in time and patient number, we could not perform independent validation with an external sample. We did not compare serial imaging changes. We used a commercial image analysis system based on deep learning. The system does not provide flexibility in adjustment of machine-learning model or hyperparameters selection. We do not exclude future tailor trained machine learning systems that can differentiate chest CT of COVID-19 from other suspected patients.

CONCLUSION

We documented the non-differentiating nature of initial chest CT between COVID-19 and other viral pneumonia with suspected symptoms. Our results do not support CT findings replacing microbiological diagnosis as a critical criterion for COVID-19 diagnosis. Our findings may prompt re-evaluation of isolated patients without laboratory confirmation.

Data Availability

The data sets generated and/or analyzed during the current study are not publicly available due to the data confidentiality requirements of the ethics committee, but are available from the corresponding author on reasonable request and approval from the ethics committees in all institutions.

Conflict(s) of Interest/Disclosure(s)

The authors have no conflict of interests to declare.

Author Contributions

Conceptualization: Qingli Dou, Jiangping Liu. Data curation: Qingli Dou, Jiangping Liu. Formal analysis: Qingli Dou, Jiangping Liu.

Methodology: Qingli Dou, Jiangping Liu, Wenwu Zhang, Yanan Gu Project administration: Wan-Ting Hsu, Hoi Sin Tong, Wing Yan Yu. Resources: Qingli Dou, Jiangping Liu, Chien-Chang Lee. Supervision: Qingli Dou, Chien-Chang Lee.

Writing – original draft: Qingli Dou, Jiangping Liu, Wenwu Zhang, Yanan Gu, Chien-Chang Lee.

Writing – review & editing: Qingli Dou, Jiangping Liu, Kuan-Ching Ho, Hoi Sin Tong, Wing Yan Yu, Chien-Chang Lee.

Acknowledgement

We are indebted to Dr. Anuj Pareek at Department of Radiology, Stanford University for his constructive comments on the manuscript.

Footnotes

  • Founding: None.

References

  1. 1.
    Li Q, Guan X, Wu P, et al. Early transmission dynamics in Wuhan, China, of novel coronavirus–infected pneumonia. New England Journal of Medicine 2020.
  2. 2.
    Lu R, Zhao X, Li J, et al. Genomic characterisation and epidemiology of 2019 novel coronavirus: implications for virus origins and receptor binding. The Lancet 2020.
  3. 3.
    Huang C, Wang Y, Li X, et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. The Lancet 2020.
  4. 4.↵
    Bogoch II, Watts A, Thomas-Bachli A, Huber C, Kraemer MU, Khan K. Potential for global spread of a novel coronavirus from China. Journal of travel medicine 2020.
  5. 5.↵
    Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID- 19 in real time. The Lancet Infectious Diseases 2020.
  6. 6.
    Coronavirus COVID-19 Global Cases by John Hopkins. The Center for Systems Science and Engineering at Johns Hopkins University, 2020. (Accessed February 16, 2020, 2020, at https://gisanddata.maps.arcgis.com/apps/opsdashboard/index.html#/bda7594740fd40299423467b48e9ecf6.)
  7. 7.↵
    Ai J-W, Zhang H-C, Xu T, et al. Optimizing diagnostic strategy for novel coronavirus pneumonia, a multi-center study in Eastern China. medRxiv 2020.
  8. 8.↵
    Fang Y, Zhang H, Xu Y, Xie J, Pang P, Ji W. CT Manifestations of Two Cases of 2019 Novel Coronavirus (2019-nCoV) Pneumonia. Radiology 2020:200280.
  9. 9.↵
    Lei J, Li J, Li X, Qi X. CT Imaging of the 2019 Novel Coronavirus (2019-nCoV) Pneumonia. Radiology 2020:200236.
  10. 10.↵
    Lin L, Li T. Interpretation of “Guidelines for the Diagnosis and Treatment of Novel Coronavirus (2019-nCoV) Infection by the National Health Commission (Trial Version 5)”. Zhonghua yi xue za zhi 2020;100:E001.
    OpenUrlCrossRef
  11. 11.↵
    Fang Y, Zhang H, Xie J, et al. Sensitivity of Chest CT for COVID-19: Comparison to RT-PCR. Radiology 2020.
  12. 12.↵
    Chan JF-W, Yuan S, Kok K-H, et al. A familial cluster of pneumonia associated with the 2019 novel coronavirus indicating person-to-person transmission: a study of a family cluster. The Lancet 2020.
  13. 13.↵
    Pan Y, Guan H. Imaging changes in patients with 2019-nCov. Springer; 2020.
  14. 14.
    Kanne JP. Chest CT Findings in 2019 Novel Coronavirus (2019-nCoV) Infections from Wuhan, China: Key Points for the Radiologist. Radiology 2020:200241.
  15. 15.
    Chen N, Zhou M, Dong X, et al. Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study. The Lancet 2020.
Back to top
PreviousNext
Posted June 29, 2020.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Chest CT Images for COVID-19: Radiologists and Computer-based detection
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Chest CT Images for COVID-19: Radiologists and Computer-based detection
Qingli Dou, Jiangping Liu, Wenwu Zhang, Yanan Gu, Wan-Ting Hsu, Kuan-Ching Ho, Hoi Sin Tong, Wing Yan Yu, Chien-Chang Lee
medRxiv 2020.06.27.20141531; doi: https://doi.org/10.1101/2020.06.27.20141531
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
Chest CT Images for COVID-19: Radiologists and Computer-based detection
Qingli Dou, Jiangping Liu, Wenwu Zhang, Yanan Gu, Wan-Ting Hsu, Kuan-Ching Ho, Hoi Sin Tong, Wing Yan Yu, Chien-Chang Lee
medRxiv 2020.06.27.20141531; doi: https://doi.org/10.1101/2020.06.27.20141531

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Infectious Diseases (except HIV/AIDS)
Subject Areas
All Articles
  • Addiction Medicine (179)
  • Allergy and Immunology (434)
  • Anesthesia (99)
  • Cardiovascular Medicine (948)
  • Dentistry and Oral Medicine (178)
  • Dermatology (110)
  • Emergency Medicine (260)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (422)
  • Epidemiology (8985)
  • Forensic Medicine (4)
  • Gastroenterology (420)
  • Genetic and Genomic Medicine (1957)
  • Geriatric Medicine (190)
  • Health Economics (402)
  • Health Informatics (1329)
  • Health Policy (660)
  • Health Systems and Quality Improvement (519)
  • Hematology (212)
  • HIV/AIDS (420)
  • Infectious Diseases (except HIV/AIDS) (10808)
  • Intensive Care and Critical Care Medicine (575)
  • Medical Education (200)
  • Medical Ethics (54)
  • Nephrology (222)
  • Neurology (1830)
  • Nursing (110)
  • Nutrition (274)
  • Obstetrics and Gynecology (353)
  • Occupational and Environmental Health (470)
  • Oncology (998)
  • Ophthalmology (298)
  • Orthopedics (111)
  • Otolaryngology (182)
  • Pain Medicine (126)
  • Palliative Medicine (44)
  • Pathology (265)
  • Pediatrics (580)
  • Pharmacology and Therapeutics (276)
  • Primary Care Research (234)
  • Psychiatry and Clinical Psychology (1902)
  • Public and Global Health (4123)
  • Radiology and Imaging (676)
  • Rehabilitation Medicine and Physical Therapy (368)
  • Respiratory Medicine (548)
  • Rheumatology (225)
  • Sexual and Reproductive Health (191)
  • Sports Medicine (177)
  • Surgery (207)
  • Toxicology (39)
  • Transplantation (109)
  • Urology (81)