Abstract
Markerless motion tracking is a promising technique to capture human movements and postures. It could be a clinically feasible tool to objectively assess movement disorders within severe dyskinetic cerebral palsy (CP). Here, we aim to evaluate tracking accuracy on clinically recorded video data.
Method 94 video recordings of 33 participants (dyskinetic CP, 8-23 years; GMFCS IV-V, i.e. non-ambulatory) from a previous clinical trial were used. Twenty-second clips were cut during lying down as this is a postion for this group of children and young adults allows to freely move. Video image resolution was 0.4 cm per pixel. Tracking was performed in DeepLabCut. We evaluated a model that was pre-trained on a human healthy adult data set with an increasing number of manually labeled frames (0, 1, 2, 6, 10, 15 and 20 frames per video). To assess generalizability, we used 80% of videos for the model development and evaluated the generalizability of the model using the remaining 20%. For evaluation the mean absolute error (MAE) between DeepLabCut’s prediction of the position of body points and manual labels was calculated.
Results Using just the pre-trained adult human model yielded a MAE of 121 pixels. An MAE of 4.5 pixels (about 1.5 cm) could be achieved by adding 15-20 manual labels. When applied to unseen video clips (i.e. generalization set), the MAE was 33 pixels with a dedicated model trained on 20 frames per videos.
Conclusion Accuracy of tracking with a standard pre-trained model is insufficiently to automatically assess movement disorders in dyskinetic CP. However, manually adding labels improves the model performance substantially. In addition, the methodology proposed within our study is applicable to check the accuracy of DeepLabCut application within other clinical data set.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
The project is funded by the Netherlands Organization for Health Research and Development (ZonMW, Innovative medical device initiative (IMDI) project number 104022005) Helga Haberfehlner is funded by the Postdoctoral Fellow Marie SkłodowskaCurie Actions Seal of Excellence of the Research Foundation Flanders (SoE fellowship_12ZZW22N).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This secondary analysis of the video data was approved by the local medical ethics committee (METC VU medical center)
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
Raw data of this study are patient videos and can not be made available. The outcome data are available online as data_stickfigure_coordinates_lying.zip within the MODYS-video dataset at zenodo https://doi.org/10.5281/zenodo.5638470
