ABSTRACT
Amyotrophic Lateral Sclerosis (ALS) disease severity is usually measured using the subjective, questionnaire-based revised ALS Functional Rating Scale (ALSFRS-R). An objective measure for tracking disease severity and progression would be a powerful tool for evaluating real-world drug effectiveness, efficacy in clinical trials, as well as identifying participants for cohort studies. Here we develop a machine learning (ML) based objective measure for ALS disease severity, based on voice samples and accelerometer measurements from a longitudinal dataset collected by the ALS Therapy Development Institute (ALS-TDI) over four years. 584 people living with ALS consented and carried out prescribed speaking and limb-based tasks. 542 participants contributed 5814 voice recordings, and 350 contributed 13009 accelerometer samples, while simultaneously measuring ALSFRS-R scores. Using the data from 475 participants, we trained machine learning (ML) models to predict bulbar-related FRS scores from speech, and limb-related scores from accelerometer samples. On the test set (n=109 participants) the voice models achieved a multiclass AUC of 0.86 (95% CI, 0.85-0.88) on speech FRS prediction, whereas the accelerometer models achieved a median multiclass AUC of 0.73 on 6 limb-related functions. Further, the correlation (and inverse correlations) across different bulbar and limb functions observed in the self-reported ALSFRS-R scores are preserved in the ML-derived scores. Next, we used these models and self-reported ALSFRS-R scores to evaluate the real-world effects of edaravone, a drug recently approved for use in ALS. In the cohort of 54 test participants who received edaravone as part of their usual care, the ML-derived objective scores were consistent with the self-reported ALSFRS-R scores, and both showed highly variable outcomes from edaravone treatment from person to person. At the individual level, the continuous ML-derived score is able to capture a gradual change that is absent in the integer ALSFRS-R scores. This demonstrates the value of these tools for assessing both disease severity and potentially drug effects.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This study did not receive any dedicated funding
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This research program has been conducted in accordance with the ethical principles posited in the Declaration of Helsinki - Ethical Principles for Medical Research Involving Human Subjects. Protocol approval was provided by the institutional review board at the Center for IRB Intelligence (ADVARRA CIRBI).
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
All data produced in the present study are available upon reasonable request to the authors
