Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Assessing the accuracy of a digital symptom checker tool for suggestion of reproductive health conditions: a clinical vignettes study

View ORCID ProfileKimberly Peven, Aidan Wickham, Octavia Wilks, Yusuf C. Kaplan, Andrei Marhol, Saddif Ahmed, Ryan Bamford, Carley Prentice, Andras Meczner, Matthew Fenech, Stephen Gilbert, Anna Klepchukova, Sonia Ponzo
doi: https://doi.org/10.1101/2023.02.22.23286305
Kimberly Peven
1Flo Health UK Limited, London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Kimberly Peven
  • For correspondence: k_peven@flo.health
Aidan Wickham
1Flo Health UK Limited, London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Octavia Wilks
1Flo Health UK Limited, London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Yusuf C. Kaplan
1Flo Health UK Limited, London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrei Marhol
1Flo Health UK Limited, London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Saddif Ahmed
1Flo Health UK Limited, London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ryan Bamford
1Flo Health UK Limited, London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Carley Prentice
1Flo Health UK Limited, London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andras Meczner
2Your.MD Limited, London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthew Fenech
3Una Health GmbH, Hamburg, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stephen Gilbert
4Else Kröner Fresenius Center for Digital Health, Technische Universität Dresden, Dresden, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Anna Klepchukova
1Flo Health UK Limited, London, United Kingdom
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sonia Ponzo
1Flo Health UK Limited, London, United Kingdom
5University College London, Institute of Health Informatics
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Reproductive health conditions such as endometriosis, uterine fibroids and polycystic ovary syndrome affect a large proportion of women and people who menstruate worldwide. Prevalence estimates for these conditions range from 5-40% of women of reproductive age. Long diagnostic delays, up to 12 years, are common and contribute to health complications and increased healthcare costs. Symptom checker apps provide users with information and tools to better understand their symptoms and thus have the potential to reduce the time to diagnosis for reproductive health conditions.

Objective This study aims to evaluate the accuracy of three symptom checkers developed by Flo Health assessing symptoms of endometriosis, uterine fibroids and polycystic ovary syndrome (PCOS) against current medical guidelines.

Methods Independent general practitioners were recruited to create clinical case vignettes of simulated users with and without the conditions of interest. Vignettes were reviewed, modified and approved by separate general practitioners. A further independent panel of general practitioners reviewed the cases and designated a final classification. Vignettes were entered into the symptom checkers and the outcomes were compared with the final classification from the panel using accuracy metrics including percent agreement, sensitivity and specificity.

Results A total of 24 cases were created per condition. Overall, exact matches between the vignette classification and the symptom checker outcome was 83.3% for endometriosis and uterine fibroids, and 87.5% for PCOS. While sensitivity was high for all conditions (>81%) and very high (100%) for PCOS, specificity was >81% for endometriosis and uterine fibroids and 75% for PCOS.

Conclusion The single condition symptom checkers have high levels of accuracy for endometriosis, uterine fibroids and PCOS. Given long delays in diagnosis for many reproductive health conditions, which lead to increased medical costs and potential health complications for individuals and healthcare providers, innovative health apps and symptom checkers hold the potential to improve care pathways.

Competing Interest Statement

Conflicts of interest: KP, AW, OW, YCK, AM, SA, RB, CP, AK, and SP were employees at Flo Health, Inc, AW, KP, AM, AK and SP have stock ownership in the company. AM, MF, and SG are paid consultants for Flo Health, Inc. Author S.G. declares no Non-Financial Interests but the following Competing Financial Interests: he has or has had consulting relationships with Una Health GmbH, Lindus Health Ltd.; FLO Ltd, and Thymia Ltd., Ada Health GmbH and holds share options in Ada Health GmbH Author M.F. declares no Non-Financial Interests but the following Competing Financial Interests: he has a consulting relationship with Flo Health UK Ltd, and holds share options in Una Health GmbH.

Funding Statement

This study was funded by Flo Health UK Limited

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Data Availability

All data produced in the present study are available upon reasonable request to the authors

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission.
Back to top
PreviousNext
Posted February 24, 2023.
Download PDF
Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Assessing the accuracy of a digital symptom checker tool for suggestion of reproductive health conditions: a clinical vignettes study
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Assessing the accuracy of a digital symptom checker tool for suggestion of reproductive health conditions: a clinical vignettes study
Kimberly Peven, Aidan Wickham, Octavia Wilks, Yusuf C. Kaplan, Andrei Marhol, Saddif Ahmed, Ryan Bamford, Carley Prentice, Andras Meczner, Matthew Fenech, Stephen Gilbert, Anna Klepchukova, Sonia Ponzo
medRxiv 2023.02.22.23286305; doi: https://doi.org/10.1101/2023.02.22.23286305
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Assessing the accuracy of a digital symptom checker tool for suggestion of reproductive health conditions: a clinical vignettes study
Kimberly Peven, Aidan Wickham, Octavia Wilks, Yusuf C. Kaplan, Andrei Marhol, Saddif Ahmed, Ryan Bamford, Carley Prentice, Andras Meczner, Matthew Fenech, Stephen Gilbert, Anna Klepchukova, Sonia Ponzo
medRxiv 2023.02.22.23286305; doi: https://doi.org/10.1101/2023.02.22.23286305

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Obstetrics and Gynecology
Subject Areas
All Articles
  • Addiction Medicine (270)
  • Allergy and Immunology (552)
  • Anesthesia (135)
  • Cardiovascular Medicine (1760)
  • Dentistry and Oral Medicine (238)
  • Dermatology (173)
  • Emergency Medicine (312)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (659)
  • Epidemiology (10799)
  • Forensic Medicine (8)
  • Gastroenterology (592)
  • Genetic and Genomic Medicine (2950)
  • Geriatric Medicine (287)
  • Health Economics (534)
  • Health Informatics (1928)
  • Health Policy (836)
  • Health Systems and Quality Improvement (745)
  • Hematology (292)
  • HIV/AIDS (630)
  • Infectious Diseases (except HIV/AIDS) (12518)
  • Intensive Care and Critical Care Medicine (692)
  • Medical Education (299)
  • Medical Ethics (86)
  • Nephrology (324)
  • Neurology (2799)
  • Nursing (151)
  • Nutrition (433)
  • Obstetrics and Gynecology (559)
  • Occupational and Environmental Health (597)
  • Oncology (1467)
  • Ophthalmology (444)
  • Orthopedics (172)
  • Otolaryngology (257)
  • Pain Medicine (190)
  • Palliative Medicine (56)
  • Pathology (381)
  • Pediatrics (866)
  • Pharmacology and Therapeutics (366)
  • Primary Care Research (337)
  • Psychiatry and Clinical Psychology (2640)
  • Public and Global Health (5370)
  • Radiology and Imaging (1013)
  • Rehabilitation Medicine and Physical Therapy (596)
  • Respiratory Medicine (726)
  • Rheumatology (330)
  • Sexual and Reproductive Health (289)
  • Sports Medicine (279)
  • Surgery (327)
  • Toxicology (47)
  • Transplantation (150)
  • Urology (125)