Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

An automated heart rate-based algorithm for sleep stage classification: validation using conventional PSG and innovative wearable ECG device

View ORCID ProfileNicolò Pini, Ju Lynn Ong, Gizem Yilmaz, Nicholas I. Y. N. Chee, Zhao Siting, Animesh Awasthi, Siddharth Biju, Kishan Kishan, Amiya Patanaik, William P. Fifer, View ORCID ProfileMaristella Lucchini
doi: https://doi.org/10.1101/2021.12.21.21268117
Nicolò Pini
1Department of Psychiatry, Columbia University Irving Medical Center, New York, NY, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Nicolò Pini
Ju Lynn Ong
2Centre for Sleep and Cognition, Yong Loo Lin School of Medicine, National University of Singapore, Singapore
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Gizem Yilmaz
2Centre for Sleep and Cognition, Yong Loo Lin School of Medicine, National University of Singapore, Singapore
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nicholas I. Y. N. Chee
2Centre for Sleep and Cognition, Yong Loo Lin School of Medicine, National University of Singapore, Singapore
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Zhao Siting
3Electronic and Information Engineering, Imperial College, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Animesh Awasthi
4Department of Biotechnology, Indian Institute of Technology, Kharagpur, India
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Siddharth Biju
4Department of Biotechnology, Indian Institute of Technology, Kharagpur, India
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kishan Kishan
5Neurobit Inc., New York, NY, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Amiya Patanaik
5Neurobit Inc., New York, NY, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
William P. Fifer
1Department of Psychiatry, Columbia University Irving Medical Center, New York, NY, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Maristella Lucchini
1Department of Psychiatry, Columbia University Irving Medical Center, New York, NY, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Maristella Lucchini
  • For correspondence: ml3551@cumc.columbia.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Study Objectives Validate a HR-based deep-learning algorithm for sleep staging named Neurobit-HRV (Neurobit Inc., New York, USA).

Methods The algorithm can perform classification at 2-levels (Wake; Sleep), 3-levels (Wake; NREM; REM) or 4-levels (Wake; Light; Deep; REM) in 30-second epochs. The algorithm was validated using an open-source dataset of PSG recordings (Physionet CinC dataset, n=994 participants) and a proprietary dataset (Z3Pulse, n=52 participants), composed of HR recordings collected with a chest-worn, wireless sensor. A simultaneous PSG was collected using SOMNOtouch. We evaluated the performance of the models in both datasets using Accuracy (A), Cohen’s kappa (K), Sensitivity (SE), Specificity (SP).

Results CinC - The highest value of accuracy was achieved by the 2-levels model (0.8797), while the 3-levels model obtained the best value of K (0.6025). The 4-levels model obtained the lowest SE (0.3812) and the highest SP (0.9744) for the classification of Deep sleep segments. AHI and biological sex did not affect sleep scoring, while a significant decrease of performance by age was reported across the models. Z3Pulse - The highest value of accuracy was achieved by the 2-levels model (0.8812), whereas the 3-levels model obtained the best value of K (0.611). For classification of the sleep states, the lowest SE (0.6163) and the highest SP (0.9606) were obtained for the classification of Deep sleep segment.

Conclusions Results demonstrate the feasibility of accurate HR-based sleep staging. The combination of the illustrated sleep staging algorithm with an inexpensive HR device, provides a cost-effective and non-invasive solution easily deployable in the home.

Competing Interest Statement

Financial Disclosure: None Non-Financial Disclosure: Amiya Patanaik and Kishan are shareholders in Neurobit, Inc.

Funding Statement

This work was supported by grants from the Health Technology Consortium grant.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

All participants provided written informed consent in compliance with a protocol approved by the National University of Singapore's Institutional Review Board (NUS-IRB) and were paid for their involvement.

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

The dataset You Snooze You Win - The PhysioNet Computing in Cardiology Challenge 2018 is available online at https://physionet.org/content/challenge-2018/1.0.0/. The dataset Z3Pulse is available upon reasonable request to the authors, subject to review by an ethics committee.

https://physionet.org/content/challenge-2018/1.0.0/

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted January 13, 2022.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
An automated heart rate-based algorithm for sleep stage classification: validation using conventional PSG and innovative wearable ECG device
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
An automated heart rate-based algorithm for sleep stage classification: validation using conventional PSG and innovative wearable ECG device
Nicolò Pini, Ju Lynn Ong, Gizem Yilmaz, Nicholas I. Y. N. Chee, Zhao Siting, Animesh Awasthi, Siddharth Biju, Kishan Kishan, Amiya Patanaik, William P. Fifer, Maristella Lucchini
medRxiv 2021.12.21.21268117; doi: https://doi.org/10.1101/2021.12.21.21268117
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
An automated heart rate-based algorithm for sleep stage classification: validation using conventional PSG and innovative wearable ECG device
Nicolò Pini, Ju Lynn Ong, Gizem Yilmaz, Nicholas I. Y. N. Chee, Zhao Siting, Animesh Awasthi, Siddharth Biju, Kishan Kishan, Amiya Patanaik, William P. Fifer, Maristella Lucchini
medRxiv 2021.12.21.21268117; doi: https://doi.org/10.1101/2021.12.21.21268117

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Health Informatics
Subject Areas
All Articles
  • Addiction Medicine (175)
  • Allergy and Immunology (423)
  • Anesthesia (97)
  • Cardiovascular Medicine (902)
  • Dentistry and Oral Medicine (171)
  • Dermatology (102)
  • Emergency Medicine (257)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (407)
  • Epidemiology (8806)
  • Forensic Medicine (4)
  • Gastroenterology (405)
  • Genetic and Genomic Medicine (1870)
  • Geriatric Medicine (179)
  • Health Economics (389)
  • Health Informatics (1293)
  • Health Policy (644)
  • Health Systems and Quality Improvement (493)
  • Hematology (207)
  • HIV/AIDS (397)
  • Infectious Diseases (except HIV/AIDS) (10587)
  • Intensive Care and Critical Care Medicine (565)
  • Medical Education (193)
  • Medical Ethics (52)
  • Nephrology (218)
  • Neurology (1767)
  • Nursing (105)
  • Nutrition (267)
  • Obstetrics and Gynecology (343)
  • Occupational and Environmental Health (461)
  • Oncology (967)
  • Ophthalmology (285)
  • Orthopedics (107)
  • Otolaryngology (177)
  • Pain Medicine (118)
  • Palliative Medicine (43)
  • Pathology (265)
  • Pediatrics (558)
  • Pharmacology and Therapeutics (266)
  • Primary Care Research (221)
  • Psychiatry and Clinical Psychology (1847)
  • Public and Global Health (3996)
  • Radiology and Imaging (656)
  • Rehabilitation Medicine and Physical Therapy (344)
  • Respiratory Medicine (536)
  • Rheumatology (216)
  • Sexual and Reproductive Health (178)
  • Sports Medicine (166)
  • Surgery (198)
  • Toxicology (37)
  • Transplantation (107)
  • Urology (80)