Abstract
Background Current classification systems for thyroid nodules are very subjective. Artificial intelligence (AI) algorithms have been used to decrease subjectivity in medical image interpretation. 1 out of 2 women over the age of 50 may have a thyroid nodule and at present the only way to exclude malignancy is through invasive procedures. Hence, there exists a need for noninvasive objective classification of thyroid nodules. Some cancers have benign appearance on ultrasonogram. Hence, we decided to create an image similarity algorithm rather than image classification algorithm.
Methods Ultrasound images of thyroid nodules from patients who underwent either biopsy or thyroid surgery from February of 2012 through February of 2017 in our institution were used to create AI models. Nodules were excluded if there was no definitive diagnosis of benignity or malignancy. 482 nodules met the inclusion criteria and all available images from these nodules were used to create the AI models. Later, these AI models were used to test 103 thyroid nodules which underwent biopsy or surgery from March of 2017 through July of 2018.
Results Negative predictive value of the image similarity model was 93.2%. Sensitivity, specificity, positive predictive value and accuracy of the model was 87.8%, 78.5%, 65.9% and 81.5% respectively.
Conclusion When compared to published results of ACR TIRADS and ATA classification system, our image similarity model had comparable negative predictive value with better sensitivity specificity and positive predictive value. By using image similarity AI models, we can eliminate subjectivity and decrease the number of unnecessary biopsies. Using image similarity AI model, we were able to create an explainable AI model which increases physician’s confidence in the predictions.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
No funding.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Mercy IRB approved the research.
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Johnson Thomas MD, FACE, 3231 S National Ave, Suite 440, Springfield, Missouri, USA 65807 johnson.thomas{at}mercy.net
Tracy Haertling, DO, MS, Manager, Investigator-Initiated Trials - Mercy Research Mercy, 3231 S. National Ave., Suite 210 | Springfield, Missouri 65807 Tracy.Haertling{at}Mercy.net
** Note: A portion of the data in this manuscript was reported as an oral abstract at the 89th annual meeting of the American Thyroid Association, Chicago, USA, October 30 – Nov 3, 2019.
Data Availability
Data used for statistical analysis is available upon request.