Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Developing better digital health measures of Parkinson’s disease using free living data and a crowdsourced data analysis challenge

View ORCID ProfileSolveig K. Sieberts, Henryk Borzymowski, Yuanfang Guan, Yidi Huang, Ayala Matzner, Alex Page, Izhar Bar-Gad, View ORCID ProfileBrett Beaulieu-Jones, Yuval El-Hanani, Jann Goschenhofer, Monica Javidnia, Mark S. Keller, Yan-chak Li, Charles S. Venuto, Mohammed Saqib, Greta Smith, Ana Stanescu, Robbie Zielinski, the BEAT-PD DREAM Challenge Consortium, Arun Jayaraman, Luc J.W. Evers, View ORCID ProfileLuca Foschini, Alex Mariakakis, Gaurav Pandey, Nicholas Shawen, Phil Synder, Larsson Omberg
doi: https://doi.org/10.1101/2021.10.20.21265298
Solveig K. Sieberts
1Sage Bionetworks, Seattle, WA 98121
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Solveig K. Sieberts
  • For correspondence: solly.sieberts@sagebase.org larsson.omberg@sagebionetworks.org
Henryk Borzymowski
2Independent researcher
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yuanfang Guan
3Department of Computational Medicine and Bioinformatics, University of Michigan, Ann Arbor, MI, USA, 48109
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yidi Huang
4Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA, 02115
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ayala Matzner
5Gonda Brain Research Center, Bar Ilan University, Israel, 52900
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alex Page
6Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA, 14642
7Cardiology Division, University of Rochester Medical Center, Rochester, NY, USA, 14642
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Izhar Bar-Gad
5Gonda Brain Research Center, Bar Ilan University, Israel, 52900
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Brett Beaulieu-Jones
4Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA, 02115
8Department of Neurology, Brigham and Women’s Hospital, Boston, MA 02115
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Brett Beaulieu-Jones
Yuval El-Hanani
5Gonda Brain Research Center, Bar Ilan University, Israel, 52900
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jann Goschenhofer
2Independent researcher
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Monica Javidnia
6Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA, 14642
9Department of Neurology, University of Rochester, Rochester, NY, USA, 14642
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mark S. Keller
4Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA, 02115
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yan-chak Li
10Department of Genetics and Genomic Sciences, and Icahn Institute for Data Science and Genomic Technology, Icahn School of Medicine at Mount Sinai, New York, NY, USA, 10029
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Charles S. Venuto
6Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA, 14642
9Department of Neurology, University of Rochester, Rochester, NY, USA, 14642
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mohammed Saqib
4Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA, 02115
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Greta Smith
6Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA, 14642
9Department of Neurology, University of Rochester, Rochester, NY, USA, 14642
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ana Stanescu
11Department of Computer Science, University of West Georgia, Carrollton, GA, USA, 30118
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robbie Zielinski
6Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA, 14642
9Department of Neurology, University of Rochester, Rochester, NY, USA, 14642
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Arun Jayaraman
12Max Nader Research Technologies & Outcomes Lab, Shirley Ryan AbilityLab, Chicago, IL 60611
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Luc J.W. Evers
13Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Radboud University Medical Center, Nijmegen, the Netherlands, 6525GC
14Institute for Computing and Information Sciences, Radboud University, Nijmegen, the Netherlands, 6525EC
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Luca Foschini
15Evidation Health, Santa Barbara, CA, USA, 93101
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Luca Foschini
Alex Mariakakis
16Department of Computer Science, University of Toronto, Toronto, ON, Canada M5R 2P6
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gaurav Pandey
10Department of Genetics and Genomic Sciences, and Icahn Institute for Data Science and Genomic Technology, Icahn School of Medicine at Mount Sinai, New York, NY, USA, 10029
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nicholas Shawen
12Max Nader Research Technologies & Outcomes Lab, Shirley Ryan AbilityLab, Chicago, IL 60611
18Medical Scientist Training Program, Northwestern University Feinberg School of Medicine, Chicago, IL 60611
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Phil Synder
1Sage Bionetworks, Seattle, WA 98121
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Larsson Omberg
1Sage Bionetworks, Seattle, WA 98121
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: solly.sieberts@sagebase.org larsson.omberg@sagebionetworks.org
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Preview PDF
Loading

Abstract

One of the promising opportunities of digital health is its potential to lead to more holistic understandings of diseases by interacting with the daily life of patients and through the collection of large amounts of real world data. Validating and benchmarking indicators of disease severity in the home setting is difficult, however, given the large number of confounders present in the real world and the challenges in collecting ground truth data in the home. Here we leverage two datasets with continuous wrist-worn accelerometer data coupled with frequent symptom reports in the home setting, to develop digital biomarkers of symptom severity. Using these data, we performed a public benchmarking challenge in which participants were asked to build measures of severity across 3 symptoms (on/off medication, dyskinesia, and tremor). 42 teams participated and performance was improved over baseline models for each subchallenge. Additional ensemble modeling across submissions further improved performance, and the top models validated in a subset of patients whose symptoms were observed and rated by trained clinicians.

Competing Interest Statement

YG serves as scientific advisor for Eli Lilly and Company and Merck & Co.; serves as scientific advisor and receives grants from Merck KGaA. YH has grant funding through BBJ from Sanofi S.A. and UCB for unrelated projects. BBJ has grant funding from Sanofi S.A. and UCB for unrelated projects. AJ is funded by MJ Fox Foundation for data curation. All other authors report no competing interests.

Funding Statement

The BEAT-PD Challenge was funded by the Michael J. Fox Foundation. The ensemble computations were partly enabled by Scientific Computing resources at the Icahn School of Medicine at Mount Sinai, and YL and GP were supported by NIH R01HG011407-01A1. YG is funded by the Michael J. Fox Foundation. BKBJ was supported by a grant from NIH NINDS (award #: K99NS114850). MSK is supported by a grant from NIH (award #: 5T32HG002295-18). CSV, GS, and RZ received research support funded by the NIH NINDS under award number P50NS108676.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

CIS-PD was sponsored by the Michael J. Fox Foundation for Parkinson's Research and conducted across four US sites: Northwestern University, the University of Cincinnati, the University of Rochester, and the University of Alabama at Birmingham. Each site had local Institutional Review Board (IRB)/Research Ethics Board (REB) approval, and all participants signed informed consent. REAL-PD was sponsored by the Michael J. Fox Foundation for Parkinson's Research. The study protocol was approved by the local medical ethics committee (Commissie Mensgebonden Onderzoek, region Arnhem-Nijmegen, the Netherlands, file number 2016-1776). All participants received verbal and written information about the study protocol and signed a consent form prior to participation, in line with the Declaration of Helsinki.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-ND 4.0 International license.
Back to top
PreviousNext
Posted October 23, 2021.
Download PDF

Supplementary Material

Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Developing better digital health measures of Parkinson’s disease using free living data and a crowdsourced data analysis challenge
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Developing better digital health measures of Parkinson’s disease using free living data and a crowdsourced data analysis challenge
Solveig K. Sieberts, Henryk Borzymowski, Yuanfang Guan, Yidi Huang, Ayala Matzner, Alex Page, Izhar Bar-Gad, Brett Beaulieu-Jones, Yuval El-Hanani, Jann Goschenhofer, Monica Javidnia, Mark S. Keller, Yan-chak Li, Charles S. Venuto, Mohammed Saqib, Greta Smith, Ana Stanescu, Robbie Zielinski, the BEAT-PD DREAM Challenge Consortium, Arun Jayaraman, Luc J.W. Evers, Luca Foschini, Alex Mariakakis, Gaurav Pandey, Nicholas Shawen, Phil Synder, Larsson Omberg
medRxiv 2021.10.20.21265298; doi: https://doi.org/10.1101/2021.10.20.21265298
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
Developing better digital health measures of Parkinson’s disease using free living data and a crowdsourced data analysis challenge
Solveig K. Sieberts, Henryk Borzymowski, Yuanfang Guan, Yidi Huang, Ayala Matzner, Alex Page, Izhar Bar-Gad, Brett Beaulieu-Jones, Yuval El-Hanani, Jann Goschenhofer, Monica Javidnia, Mark S. Keller, Yan-chak Li, Charles S. Venuto, Mohammed Saqib, Greta Smith, Ana Stanescu, Robbie Zielinski, the BEAT-PD DREAM Challenge Consortium, Arun Jayaraman, Luc J.W. Evers, Luca Foschini, Alex Mariakakis, Gaurav Pandey, Nicholas Shawen, Phil Synder, Larsson Omberg
medRxiv 2021.10.20.21265298; doi: https://doi.org/10.1101/2021.10.20.21265298

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neurology
Subject Areas
All Articles
  • Addiction Medicine (216)
  • Allergy and Immunology (495)
  • Anesthesia (106)
  • Cardiovascular Medicine (1099)
  • Dentistry and Oral Medicine (196)
  • Dermatology (141)
  • Emergency Medicine (274)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (502)
  • Epidemiology (9778)
  • Forensic Medicine (5)
  • Gastroenterology (481)
  • Genetic and Genomic Medicine (2316)
  • Geriatric Medicine (223)
  • Health Economics (462)
  • Health Informatics (1563)
  • Health Policy (737)
  • Health Systems and Quality Improvement (605)
  • Hematology (238)
  • HIV/AIDS (505)
  • Infectious Diseases (except HIV/AIDS) (11654)
  • Intensive Care and Critical Care Medicine (617)
  • Medical Education (238)
  • Medical Ethics (67)
  • Nephrology (258)
  • Neurology (2146)
  • Nursing (134)
  • Nutrition (338)
  • Obstetrics and Gynecology (427)
  • Occupational and Environmental Health (518)
  • Oncology (1183)
  • Ophthalmology (365)
  • Orthopedics (128)
  • Otolaryngology (220)
  • Pain Medicine (147)
  • Palliative Medicine (50)
  • Pathology (312)
  • Pediatrics (698)
  • Pharmacology and Therapeutics (302)
  • Primary Care Research (267)
  • Psychiatry and Clinical Psychology (2186)
  • Public and Global Health (4669)
  • Radiology and Imaging (781)
  • Rehabilitation Medicine and Physical Therapy (457)
  • Respiratory Medicine (624)
  • Rheumatology (274)
  • Sexual and Reproductive Health (226)
  • Sports Medicine (210)
  • Surgery (252)
  • Toxicology (43)
  • Transplantation (120)
  • Urology (94)