ABSTRACT
Objectives To evaluate a novel Artificial Intelligence (AI) method for the detection of malignant skin lesions from dermoscopic images.
Methods 58,457 dermoscopic images available online from the International Skin Imaging Collaboration (ISIC) Archive were downloaded. These images were acquired from different centers worldwide by recognized dermatologists and show varied clinical outcomes belonging to different types of benign and malign skin lesions. A state-of-the-art AI skin lesion classifier based on Deep Learning was designed. The method, fully automated, first locates and segments the nevus in the image and then classifies it into either benign or malign type.
Results 1,631 images (2.8%) were discarded due to bad quality. A total of 56,826 images were finally used. Two thirds of the images (37,688) were used to train the classifier, leaving the remaining 19,138 images for validation. In this set, malignant lesions had a prevalence of 15.4% (2,956/19,138). The AI skin lesion classifier reached an area under the curve (AUC) of 87.4%. Optimal cut-off point in terms of accuracy resulted in an 85.9% accuracy (16,439/19,138) and sensibility of 89.6% (2,648/ 2,956) at 85.2% (13,791/16,182) specificity. Negative predictive value (NPV) was 97.8% (13,791/14,099). Other training/validation splits were also evaluated, showing similar results.
Conclusions A novel AI method showed promising results as skin lesion classifier from dermoscopic images. Its high NPV value could make it suited for high-risk patient screening. A large clinical study to confirm these results is needed and will be pursued.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This work in its entirety was supported by Transmural Biotech SL.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
It was not necessary to obtain IRB or ethics committee approval as the used database is public and available online.
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
All te data used in this study were downloaded online from the International Skin Imaging Collaboration (ISIC) Archive. The database used are composed of images provided from HAM10000 dataset, MSK dataset, BCN_20000 dataset and ISIC 2020 Challenge dataset. These datasets are licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC-BY-NC).
