RT Journal Article SR Electronic T1 Practical Strategies for Large Missing Data in Dementia Diagnosis JF medRxiv FD Cold Spring Harbor Laboratory Press SP 2020.07.13.20146118 DO 10.1101/2020.07.13.20146118 A1 Niamh McCombe A1 Shuo Liu A1 Xuemei Ding A1 Girijesh Prasad A1 Magda Bucholc A1 David P. Finn A1 Stephen Todd A1 Paula L. McClean A1 KongFatt Wong-Lin A1 Alzheimer’s Disease Neuroimaging Initiative YR 2020 UL http://medrxiv.org/content/early/2020/07/20/2020.07.13.20146118.abstract AB Accurate computational models for clinical decision support systems require clean and reliable data, but in clinical practice, data are often incomplete. Hence, missing data could arise not only from training datasets but also test datasets which could consist of a single undiagnosed case, an individual. Many popular methods of handling missing data are unsuitable for handling such missing test data. This work addresses the problem by evaluating multiple imputation and classification workflows based not only on diagnostic classification accuracy but also computational cost. In particular, we focus on dementia diagnosis due to long time delays, high variability, high attrition rates and lack of practical data imputation strategies in its diagnostic pathway. We identified and replicated the extreme missingness structure of data from a memory clinic on a larger open dataset, with the original complete data acting as ground truth. Overall, we found that computational cost, but not accuracy, varies widely for various imputation and classification approaches. Particularly, we found that iterative imputation on the training dataset combined with a reduced-feature classification model provides the best approach, compromising speed and accuracy. Taken together, this work has elucidated important factors to be considered when developing or maintaining a dementia diagnostic support system, which can be generalized to other clinical or medical domains, particularly with extreme data missingness.Competing Interest StatementThe authors have declared no competing interest.Clinical Protocols https://www.hra.nhs.uk/planning-and-improving-research/application-summaries/research-summaries/clinical-decision-support-app-for-dementia/ Funding StatementThis work was supported by the European Union's INTERREG VA Programme, managed by the Special EU Programmes Body (SEUPB), and additional support by Alzheimer's Research UK (XD, MB, ST, PLM, KW-L), Ulster University Research Challenge Fund (XD, MB, ST, PLM, KW-L), and the Dr George Moore Endowment for Data Science at Ulster University (MB). The views and opinions expressed in this paper do not necessarily reflect those of the European Commission or the Special EU Programmes Body (SEUPB).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Ethics approval for anonymous data from Altnagelvin Area Hospital's Memory Assessment Service (WHSCT) was obtained from the Office for Research Ethics Committee Northern Ireland (ORECNI, HSC REC B reference: 17/NI/0142; IRAS project ID: 230077).All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesData from the Alzheimer's Disease Neuroimaging Initiative (ADNI) is openly available.