Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Performance of popular pulse oximeters compared with simultaneous arterial oxygen saturation or clinical-grade pulse oximetry: a cross-sectional validation study in intensive care patients

Ralf E. Harskamp, Luuk Bekker, Jelle C.L. Himmelreich, Lukas De Clercq, Evert P.M. Karregat, Mengalvio E. Sleeswijk, Wim A.M. Lucassen
doi: https://doi.org/10.1101/2021.03.09.21253181
Ralf E. Harskamp
#Amsterdam UMC, University of Amsterdam, Department of General Practice, Amsterdam Cardiovascular Sciences and Amsterdam Public Health Research Institutes, Amsterdam, the Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: r.e.harskamp@amsterdamumc.nl
Luuk Bekker
^Flevoziekenhuis, Department of Intensive Care medicine, Almere, the Netherlands
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jelle C.L. Himmelreich
#Amsterdam UMC, University of Amsterdam, Department of General Practice, Amsterdam Cardiovascular Sciences and Amsterdam Public Health Research Institutes, Amsterdam, the Netherlands
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lukas De Clercq
MSc Eng
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Evert P.M. Karregat
#Amsterdam UMC, University of Amsterdam, Department of General Practice, Amsterdam Cardiovascular Sciences and Amsterdam Public Health Research Institutes, Amsterdam, the Netherlands
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mengalvio E. Sleeswijk
^Flevoziekenhuis, Department of Intensive Care medicine, Almere, the Netherlands
MD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wim A.M. Lucassen
#Amsterdam UMC, University of Amsterdam, Department of General Practice, Amsterdam Cardiovascular Sciences and Amsterdam Public Health Research Institutes, Amsterdam, the Netherlands
MD, PhD
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

ABSTRACT

Background The demand for pulse oximeters is high in the current COVID-19 pandemic. Despite their popularity, clinical studies to evaluate the reliability in obtaining information on a patient’s oxygenation status, are lacking.

Aim To evaluate the performance of pulse oximeters under clinical conditions, with arterial blood gas measurement (SaO2) as reference standard.

Methods We studied the accuracy of ten top-selling pulse oximeters in Europe and the USA in an intensive care population at the Flevoziekenhuis in Almere, the Netherlands. The studied pulse oximeters were: AFAC FS10D, AGPTEK FS10C, ANAPULSE ANP 100, Cocobear, Contec CMS50D1, HYLOGY MD-H37, Mommed YM101, PRCMISEMED F4PRO, PULOX PO-200, and Zacurate Pro Series 500DL. Adult patients in whom an SaO2 measurement was obtained as part of routine care were asked for inclusion. Directly after obtaining the SaO2 blood sample we obtained the pulse oximeter readings (SpO2) of the investigational devices, in random order. Outcomes were bias (SpO2 – SaO2) mean, root mean square difference (ARMS), mean absolute error (MAE), and accuracy in identifying hypoxemia (SaO2≤90%). As a clinical index test, we included a hospital-grade SpO2-monitor.

Results In 35 consecutive patients we obtained 2,258 SpO2-readings and 234 SaO2-samples. Mean bias ranged from −0.6 to −4.8. None of the pulse oximeters had an ARMS≤3%, the requirement set by ISO-standards and required for FDA 501(k) clearance. The MAE ranged from 2.3 to 5.1, and 5 out of 10 pulse oximeters met the requirements of ≤3%. For hypoxemia, negative predictive values were 98-99%. Positive predictive values ranged from 11-30%. Highest accuracy (95%CI) were found for Contec CMS50D1; 91% (86-94) and Zacurate Pro Series 500DL; 90% (85-94). The hospital-grade SpO2-monitor had an ARMS of 3.0 and MAE of 1.9, and an accuracy of 95% (91-97%).

Conclusion Direct-to-consumer pulse oximeters do not meet ISO-standards required for FDA-clearance, but can accurately rule out hypoxemia.

Competing Interest Statement

The authors have declared no competing interest.

Clinical Trial

This study did not involve a clinical trial

Funding Statement

This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

The study was approved by the local ethics committee and the board of directors of the Flevoziekenhuis

All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

All data relevant to the study are included in the article or uploaded as an online supplement. The datasets used during the current study are available from the corresponding author on reasonable request.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted March 12, 2021.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Performance of popular pulse oximeters compared with simultaneous arterial oxygen saturation or clinical-grade pulse oximetry: a cross-sectional validation study in intensive care patients
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Performance of popular pulse oximeters compared with simultaneous arterial oxygen saturation or clinical-grade pulse oximetry: a cross-sectional validation study in intensive care patients
Ralf E. Harskamp, Luuk Bekker, Jelle C.L. Himmelreich, Lukas De Clercq, Evert P.M. Karregat, Mengalvio E. Sleeswijk, Wim A.M. Lucassen
medRxiv 2021.03.09.21253181; doi: https://doi.org/10.1101/2021.03.09.21253181
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Performance of popular pulse oximeters compared with simultaneous arterial oxygen saturation or clinical-grade pulse oximetry: a cross-sectional validation study in intensive care patients
Ralf E. Harskamp, Luuk Bekker, Jelle C.L. Himmelreich, Lukas De Clercq, Evert P.M. Karregat, Mengalvio E. Sleeswijk, Wim A.M. Lucassen
medRxiv 2021.03.09.21253181; doi: https://doi.org/10.1101/2021.03.09.21253181

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Emergency Medicine
Subject Areas
All Articles
  • Addiction Medicine (280)
  • Allergy and Immunology (579)
  • Anesthesia (140)
  • Cardiovascular Medicine (1950)
  • Dentistry and Oral Medicine (253)
  • Dermatology (185)
  • Emergency Medicine (333)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (702)
  • Epidemiology (11114)
  • Forensic Medicine (8)
  • Gastroenterology (628)
  • Genetic and Genomic Medicine (3189)
  • Geriatric Medicine (309)
  • Health Economics (563)
  • Health Informatics (2046)
  • Health Policy (864)
  • Health Systems and Quality Improvement (783)
  • Hematology (310)
  • HIV/AIDS (682)
  • Infectious Diseases (except HIV/AIDS) (12733)
  • Intensive Care and Critical Care Medicine (708)
  • Medical Education (317)
  • Medical Ethics (92)
  • Nephrology (336)
  • Neurology (2996)
  • Nursing (165)
  • Nutrition (465)
  • Obstetrics and Gynecology (589)
  • Occupational and Environmental Health (614)
  • Oncology (1559)
  • Ophthalmology (478)
  • Orthopedics (185)
  • Otolaryngology (266)
  • Pain Medicine (202)
  • Palliative Medicine (57)
  • Pathology (403)
  • Pediatrics (914)
  • Pharmacology and Therapeutics (382)
  • Primary Care Research (355)
  • Psychiatry and Clinical Psychology (2793)
  • Public and Global Health (5604)
  • Radiology and Imaging (1096)
  • Rehabilitation Medicine and Physical Therapy (635)
  • Respiratory Medicine (763)
  • Rheumatology (340)
  • Sexual and Reproductive Health (312)
  • Sports Medicine (289)
  • Surgery (346)
  • Toxicology (48)
  • Transplantation (159)
  • Urology (133)