PT  - JOURNAL ARTICLE
AU  - Peng Zhang
AU  - Fan Lin
AU  - Fei Ma
AU  - Yuting Chen
AU  - Daowen Wang
AU  - Xiaoyun Yang
AU  - Qiang Li
TI  - Automated diagnosis of atrial fibrillation in 24-hour Holter recording based on deep learning:a study with randomized and real-world data validation
AID  - 10.1101/2021.08.25.21262591
DP  - 2021 Jan 01
TA  - medRxiv
PG  - 2021.08.25.21262591
4099  - http://medrxiv.org/content/early/2021/08/29/2021.08.25.21262591.short
4100  - http://medrxiv.org/content/early/2021/08/29/2021.08.25.21262591.full
AB  - Background With the increasing demand for atrial fibrillation (AF) screening, clinicians spend a significant amount of time in identifying the AF signals from massive electrocardiogram (ECG) data in long-term dynamic ECG monitoring. In this study, we aim to reduce clinicians’ workload and promote AF screening by using artificial intelligence (AI) to automatically detect AF episodes and identify AF patients in 24 h Holter recording.Methods We used a total of 22 979 Holter recordings (24 h) from 22 757 adult patients and established accurate annotations for AF by cardiologists. First, a randomized clinical cohort of 3 000 recordings (1 500 AF and 1 500 non-AF) from 3000 patients recorded between April 2012 and May 2020 was collected and randomly divided into training, validation and test sets (10:1:4). Then, a deep-learning-based AI model was developed to automatically detect AF episode using RR intervals and was tested with the test set. Based on AF episode detection results, AF patients were automatically identified by using a criterion of at least one AF episode of 6 min or longer. Finally, the clinical effectiveness of the model was verified with an independent real-world test set including 19 979 recordings (1 006 AF and 18 973 non-AF) from 19 757 consecutive patients recorded between June 2020 and January 2021.Findings Our model achieved high performance for AF episode detection in both test sets (sensitivity: 0.992 and 0.972; specificity: 0.997 and 0.997, respectively). It also achieved high performance for AF patient identification in both test sets (sensitivity:0.993 and 0.994; specificity: 0.990 and 0.973, respectively). Moreover, it obtained superior and consistent performance in an external public database.Interpretation Our AI model can automatically identify AF in long-term ECG recording with high accuracy. This cost-effective strategy may promote AF screening by improving diagnostic effectiveness and reducing clinical workload.Evidence before this study We searched Google Scholar and PubMed for research articles on artificial intelligence-based diagnosis of atrial fibrillation (AF) published in English between Jan 1, 2016 and Aug 1, 2021, using the search terms “deep learning” OR “deep neural network” OR “machine learning” OR “artificial intelligence” AND “atrial fibrillation”. We found that most of the previous deep learning models in AF detection were trained and validated on benchmark datasets (such as the PhysioNet database, the Massachusetts Institute of Technology Beth Israel Hospital AF database or Long-Term AF database), in which there were less than 100 patients or the recordings contained only short ECG segments (30-60s). Our search did not identify any articles that explored deep neural networks for AF detection in large real-world dataset of 24 h Holter recording, nor did we find articles that can automatically identify patients with AF in 24 h Holter recording.Added value of this study First, long-term Holter monitoring is the main method of AF screening, however, most previous studies of automatic AF detection mainly tested on short ECG recordings. This work focused on 24 h Holter recording data and achieved high accuracy in detecting AF episodes. Second, AF episodes detection did not automatically transform to AF patient identification in 24 h Holter recording, since at present, there is no well-recognized criterion for automatically identifying AF patient. Therefore, we established a criterion to identify AF patients by use of at least one AF episode of 6 min or longer, as this condition led to significantly increased risk of thromboembolism. Using this criterion, our method identified AF patients with high accuracy. Finally, and more importantly, our model was trained on a randomized clinical dataset and tested on an independent real-world clinical dataset to show great potential in clinical application. We did not exclude rare or special cases in the real-world dataset so as not to inflate our AF detection performance. To the best of our knowledge, this is the first study to automatically identifies both AF episodes and AF patients in 24 h Holter recording of large real-world clinical dataset.Implications of all the available evidence Our deep learning model automatically identified AF patient with high accuracy in 24 h Holter recording and was verified in real-world data, therefore, it can be embedded into the Holter analysis system and deployed at the clinical level to assist the decision making of Holter analysis system and clinicians. This approach can help improve the efficiency of AF screening and reduce the cost for AF diagnosis. In addition, our RR-interval-based model achieved comparable or better performance than the raw-ECG-based method, and can be widely applied to medical devices that can collect heartbeat information, including not only the multi-lead and single-lead Holter devices, but also other wearable devices that can reliably measure the heartbeat signals.Competing Interest StatementQL, PZ, YC and FL have applied for a patent for the deep learning algorithm in this study, pending to Huazhong University of Science and Technology. For the relationship with Industry, PZ, YC and QL are partially supported by United Imaging Healthcare, Inc. All other authors declare no competing interests.Funding StatementThis research was funded by the National Natural Science Foundation of China (Grant No. 62006087, 81500328), Science Fund for Creative Research Group of China (Grant No. 61721092), Director Fund of Wuhan National Laboratory for Optoelectronics (WNLO).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The data collection team was responsible for sample collection and anonymization. The algorithm development team received anonymized patient data with new case numbers, age, and gender information for subsequent algorithm development. Written informed consent was not required for this study as the Holter data were collected retrospectively and appropriately anonymized and deidentified according to the Health Insurance Portability and Accountability Act Safe Harbor provision. The study design was evaluated and exempted from full review by the Huazhong University of Science and Technology Institutional Review Board.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesPython scripts for data preprocessing and modelling can be requested by contacting corresponding author QL (liqiang8@hust.edu.cn). The test dataset of the randomized clinical cohort in this study is publicly available at Mendeley Data, V1, DOI:10.17632/6jd4rn2z9x.1. The MIT-BIH atrial fibrillation database is a public dataset available at: https://archive.physionet.org/physiobank/database/afdb/. The training and validation sets in the randomized clinical cohort and all the data in the real-world clinical cohort will be available after approval by the corresponding author XY (yangxiaoyun321@126.com). Any data and code use will be restricted to non-commercial research purposes. https://data.mendeley.com/datasets/44htzjcgsz/1