Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Significant Reduction in Manual Annotation Costs in Ultrasound Medical Image Database Construction Through Step by Step Artificial Intelligence Pre-annotation

View ORCID ProfileFu Zheng, Liu XingMing, Xu JuYing, Tao MengYing, Yang BaoJian, Shan Yan, Ye KeWei, Lu ZhiKai, Huang Cheng, Qi KeLan, Chen XiHao, Du WenFei, He Ping, Wang RunYu, Ying Ying, Bu XiaoHui
doi: https://doi.org/10.1101/2025.01.09.25320077
Fu Zheng
1The Ultrasound Diagnosis Department, The 906th Hospital of PLA, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Fu Zheng
  • For correspondence: sss999001{at}126.com
Liu XingMing
1The Ultrasound Diagnosis Department, The 906th Hospital of PLA, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Xu JuYing
1The Ultrasound Diagnosis Department, The 906th Hospital of PLA, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tao MengYing
1The Ultrasound Diagnosis Department, The 906th Hospital of PLA, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yang BaoJian
1The Ultrasound Diagnosis Department, The 906th Hospital of PLA, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Shan Yan
1The Ultrasound Diagnosis Department, The 906th Hospital of PLA, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ye KeWei
1The Ultrasound Diagnosis Department, The 906th Hospital of PLA, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lu ZhiKai
1The Ultrasound Diagnosis Department, The 906th Hospital of PLA, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Huang Cheng
1The Ultrasound Diagnosis Department, The 906th Hospital of PLA, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Qi KeLan
1The Ultrasound Diagnosis Department, The 906th Hospital of PLA, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Chen XiHao
1The Ultrasound Diagnosis Department, The 906th Hospital of PLA, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Du WenFei
1The Ultrasound Diagnosis Department, The 906th Hospital of PLA, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
He Ping
1The Ultrasound Diagnosis Department, The 906th Hospital of PLA, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wang RunYu
2State Power Investment Corporation, Ningbo City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ying Ying
3Third Rehabilitation Zone, Hangzhou Rehabilitation Center for Special Duty Service Men of the PLA Air Force, Hangzhou City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Bu XiaoHui
4The Ultrasound Diagnosis Department, Hangzhou Special Service Sanatorium of the PLA Air Force, Hangzhou City, Zhejiang Province, China
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

This study investigates the feasibility of reducing manual image annotation costs in medical image database construction by utilizing a step by step approach where the Artificial Intelligence model(AI model) trained on a previous batch of data automatically pre-annotates the next batch of image data, taking ultrasound image of thyroid nodule annotation as an example. The study used yolov8 as the AI model. During the AI model training, in addition to conventional image augmentation techniques, augmentation methods specifically tailored for ultrasound images were employed to balance the quantity differences between thyroid nodule classes and enhance model training effectiveness. The study found that training the model with augmented data significantly outperformed training with raw images data. When the number of original images number was only 1,360, with 7 thyroid nodule classifications, pre-annotation using the AI model trained on augmented data could save at least 30% of the manual annotation workload for junior physicians. When the scale of original images number reached 6,800, the classification accuracy of the AI model trained on augmented data was consistent with that of junior physicians, eliminating the need for manual preliminary annotation.

Competing Interest Statement

The authors have declared no competing interest.

Funding Statement

Yes

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

N/A

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.

Yes

Data Availability

The data is available at the URL: pan.baidu.com/s/1RpdpMUfnEobu6aSoPx6ckA?pwd=y00v

https://pan.baidu.com/s/15hYqvKUs-j5bhMAKsMfwvw?pwd=x94s

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted January 10, 2025.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Significant Reduction in Manual Annotation Costs in Ultrasound Medical Image Database Construction Through Step by Step Artificial Intelligence Pre-annotation
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Significant Reduction in Manual Annotation Costs in Ultrasound Medical Image Database Construction Through Step by Step Artificial Intelligence Pre-annotation
Fu Zheng, Liu XingMing, Xu JuYing, Tao MengYing, Yang BaoJian, Shan Yan, Ye KeWei, Lu ZhiKai, Huang Cheng, Qi KeLan, Chen XiHao, Du WenFei, He Ping, Wang RunYu, Ying Ying, Bu XiaoHui
medRxiv 2025.01.09.25320077; doi: https://doi.org/10.1101/2025.01.09.25320077
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Significant Reduction in Manual Annotation Costs in Ultrasound Medical Image Database Construction Through Step by Step Artificial Intelligence Pre-annotation
Fu Zheng, Liu XingMing, Xu JuYing, Tao MengYing, Yang BaoJian, Shan Yan, Ye KeWei, Lu ZhiKai, Huang Cheng, Qi KeLan, Chen XiHao, Du WenFei, He Ping, Wang RunYu, Ying Ying, Bu XiaoHui
medRxiv 2025.01.09.25320077; doi: https://doi.org/10.1101/2025.01.09.25320077

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Radiology and Imaging
Subject Areas
All Articles
  • Addiction Medicine (576)
  • Allergy and Immunology (868)
  • Anesthesia (306)
  • Cardiovascular Medicine (4483)
  • Dentistry and Oral Medicine (449)
  • Dermatology (385)
  • Emergency Medicine (615)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (1528)
  • Epidemiology (15282)
  • Forensic Medicine (31)
  • Gastroenterology (1134)
  • Genetic and Genomic Medicine (6650)
  • Geriatric Medicine (671)
  • Health Economics (1006)
  • Health Informatics (4606)
  • Health Policy (1378)
  • Health Systems and Quality Improvement (1624)
  • Hematology (544)
  • HIV/AIDS (1276)
  • Infectious Diseases (except HIV/AIDS) (15965)
  • Intensive Care and Critical Care Medicine (1111)
  • Medical Education (626)
  • Medical Ethics (147)
  • Nephrology (674)
  • Neurology (6698)
  • Nursing (346)
  • Nutrition (1006)
  • Obstetrics and Gynecology (1153)
  • Occupational and Environmental Health (961)
  • Oncology (3370)
  • Ophthalmology (988)
  • Orthopedics (370)
  • Otolaryngology (421)
  • Pain Medicine (437)
  • Palliative Medicine (131)
  • Pathology (670)
  • Pediatrics (1704)
  • Pharmacology and Therapeutics (700)
  • Primary Care Research (717)
  • Psychiatry and Clinical Psychology (5497)
  • Public and Global Health (9287)
  • Radiology and Imaging (2225)
  • Rehabilitation Medicine and Physical Therapy (1375)
  • Respiratory Medicine (1202)
  • Rheumatology (598)
  • Sexual and Reproductive Health (721)
  • Sports Medicine (536)
  • Surgery (722)
  • Toxicology (100)
  • Transplantation (290)
  • Urology (267)