PT  - JOURNAL ARTICLE
AU  - Erick Andres Perez Alday
AU  - Annie Gu
AU  - Amit Shah
AU  - Chad Robichaux
AU  - An-Kwok Ian Wong
AU  - Chengyu Liu
AU  - Feifei Liu
AU  - Ali Bahrami Rad
AU  - Andoni Elola
AU  - Salman Seyedi
AU  - Qiao Li
AU  - Ashish Sharma
AU  - Gari D. Clifford
AU  - Matthew A. Reyna
TI  - Classification of 12-lead ECGs: the PhysioNet/Computing in Cardiology Challenge 2020
AID  - 10.1101/2020.08.11.20172601
DP  - 2020 Jan 01
TA  - medRxiv
PG  - 2020.08.11.20172601
4099  - http://medrxiv.org/content/early/2020/08/14/2020.08.11.20172601.short
4100  - http://medrxiv.org/content/early/2020/08/14/2020.08.11.20172601.full
AB  - The subject of the PhysioNet/Computing in Cardiology Challenge 2020 was the identification of cardiac abnormalities in 12-lead electrocardiogram (ECG) recordings. A total of 66,405 recordings were sourced from hospital systems from four distinct countries and annotated with clinical diagnoses, including 43,101 annotated recordings that were posted publicly.For this Challenge, we asked participants to design working, open-source algorithms for identifying cardiac abnormalities in 12-lead ECG recordings. This Challenge provided several innovations. First, we sourced data from multiple institutions from around the world with different demographics, allowing us to assess the generalizability of the algorithms. Second, we required participants to submit both their trained models and the code for reproducing their trained models from the training data, which aids the generalizability and reproducibility of the algorithms. Third, we proposed a novel evaluation metric that considers different misclassification errors for different cardiac abnormalities, reflecting the clinical reality that some diagnoses have similar outcomes and varying risks.Over 200 teams submitted 850 algorithms (432 of which successfully ran) during the unofficial and official phases of the Challenge, representing a diversity of approaches from both academia and industry for identifying cardiac abnormalities. The official phase of the Challenge is ongoing.Competing Interest StatementThis research is supported by the Gordon and Betty Moore Foundation and AliveCor, Inc. under unrestricted gifts. Google also donated cloud compute credits for Challenge teams. GC has financial interest in Alivecor and Mindchild Medical. GC also holds a board position in Mindchild Medical. Neither of these entities influenced the design of the Challenge or provided data for the Challenge. AIW holds equity and management roles in Ataia Medical.Funding StatementThis research is supported by the National Institute of General Medical Sciences (NIGMS) and the National Institute of Biomedical Imaging and Bioengineering (NIBIB) under NIH grant numbers 2R01GM104987-09 and R01EB030362 respectively, the National Center for Advancing Translational Sciences of the National Institutes of Health under Award Number UL1TR002378, as well as the Gordon and Betty Moore Foundation and AliveCor, Inc. under unrestricted gifts. Google also donated cloud compute credits for Challenge teams. GC has financial interest in Alivecor and Mindchild Medical. GC also holds a board position in Mindchild Medical. Neither of these entities influenced the design of the Challenge or provided data for the Challenge. AIW holds equity and management roles in Ataia Medical and is supported by the NIGMS 2T32GM095442. The content of this manuscript is solely the responsibility of the authors and does not necessarily represent the official views of the above entities.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The Emory IRB Office provided approval for this research.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll posted training datasets are available through the Challenge website at https://physionetchallenges.github.io/2020/.