TY - JOUR T1 - Fully automatic segmentation of craniomaxillofacial CT scans for computer-assisted orthognathic surgery planning using the nnU-Net framework JF - medRxiv DO - 10.1101/2021.07.22.21260825 SP - 2021.07.22.21260825 AU - Gauthier Dot AU - Thomas Schouman AU - Guillaume Dubois AU - Philippe Rouch AU - Laurent Gajny Y1 - 2021/01/01 UR - http://medrxiv.org/content/early/2021/07/23/2021.07.22.21260825.abstract N2 - Objectives To evaluate the performance of the nnU-Net open-source deep learning framework for automatic multi-task segmentation of craniomaxillofacial (CMF) structures in CT scans obtained for computer-assisted orthognathic surgery.Methods Four hundred and fifty-three consecutive patients having undergone high-definition CT scans before orthognathic surgery were randomly distributed among a training/validation cohort (n = 300) and a testing cohort (n = 153). The ground truth segmentations were generated by 2 operators following an industry-certified procedure for use in computer-assisted surgical planning and personalized implant manufacturing. Model performance was assessed by comparing model predictions with ground truth segmentations. Examination of 45 CT scans by an industry expert provided additional evaluation. The model’s generalizability was tested on a publicly available dataset of 10 CT scans with ground truth segmentations of the mandible.Results In the test cohort, mean volumetric Dice Similarity Coefficient (vDSC) & surface Dice Similarity Coefficient at 1mm (sDSC) were 0.96 & 0.97 for the upper skull, 0.94 & 0.98 for the mandible, 0.95 & 0.99 for the upper teeth, 0.94 & 0.99 for the lower teeth and 0.82 & 0.98 for the mandibular canal. Industry expert segmentation approval rates were 93% for the mandible, 89% for the mandibular canal, 82% for the upper skull, 69% for the upper teeth and 58% for the lower teeth.Conclusion While additional efforts are required for the segmentation of dental apices, our results demonstrated the model’s reliability in terms of fully automatic segmentation of preoperative orthognathic CT scans.Key points– The nnU-Net deep learning framework can be used out-of-the-box to provide robust fully automatic multi-task segmentation of CT scans performed for computer-assisted orthognathic surgery planning.– Commonly used biomedical segmentation evaluation metrics (volumetric and surface Dice Similarity Coefficient) do not always match industry expert evaluation in the case of more demanding clinical applications.Competing Interest StatementAll authors have completed the ICMJE uniform disclosure form and declare: no support from any organisation for the submitted work; T. Schouman is a consultant for Materialise (Malakoff, France), G. Dubois is the CEO of Materialise (Malakoff, France); no other relationships or activities that could appear to have influenced the submitted work.Funding StatementThis study has received funding by the "Fondation des Gueules Cassees" (grant number 28-2020).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The IRB Comite d'Ethique pour la Recherche en Imagerie Medicale (CERIM) gave ethical approval for this research (number CRM-2001-051).All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesSome study subjects (10 mandibular CT scans) were shared in a previous publication: Wallner J, Mischak I, Jan Egger (2019) Computed tomography data collection of the complete human mandible and valid clinical ground truth models. Sci Data 6:190003. https://doi.org/10.1038/sdata.2019.3CMFCraniomaxillofacialvDSCVolumetric Dice Similarity CoefficientsDSCSurface Dice Similarity Coefficient at 1mmCBCTCone Beam CT ER -