ABSTRACT
This systematic review examines the evolution and current landscape of eXplainable Artificial Intelligence (XAI) in Clinical Decision Support Systems (CDSS), highlighting significant advancements and identifying persistent challenges. Utilising the PRISMA protocol, we searched major indexed databases such as Scopus, Web of Science, PubMed, and the Cochrane Library, to analyse publications from January 2000 to April 2024. This timeframe captures the progressive integration of XAI in CDSS, offering a historical and technological overview. The review covers the datasets, application areas, machine learning models, explainable AI methods, and evaluation strategies for multiple XAI methods.
Analysing 68 articles, we uncover valuable insights into the strengths and limitations of current XAI approaches, revealing significant research gaps and providing actionable recommendations. We emphasise the need for more public datasets, advanced data treatment methods, comprehensive evaluations of XAI methods, and interdisciplinary collaboration. Our findings stress the importance of balancing model performance with explainability and enhancing the usability of XAI tools for medical practitioners. This research provides a valuable resource for healthcare professionals, researchers, and policymakers seeking to develop and evaluate effective, ethical decision-support systems in clinical settings.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This publication has emanated from research conducted with the support of the Irish Research Council under award nos. GOIPG/2022/660 \& GOIPG/2021/1354 and grant number 18/CRT/6183 from SFI Centre for Research Training in Machine Learning (ML-Labs) at Technological University Dublin with the financial support of Science Foundation Ireland under grant no. 13/RC/2106\_P2 at the ADAPT SFI Research Centre at Technological University Dublin.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The study summarises various datasets from other research and details information such as variables (features), missing values, availability status, size of the dataset, sampling strategy, and strategy to overcome missing values. It is a desk study and does not identify or engage with any human subject. Details of datasets are described in Tables 8 and 9, along with references to the original research. We did not release any new datasets.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
This study did not generate any new data. All data discussed and analyzed are sourced from previously published research studies. The datasets referenced in the study have been fully described in Tables 8 and 9, including information on their variables, missing values, and the methods used in their original collection. The research remains a secondary analysis, utilizing existing datasets without the involvement of new data collection efforts
