Skip to main content
medRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search

Assessing the Feasibility of a Web-based Outcome Measurement System in Child and Adolescent Mental Health Services: myHealthE (MHE) a Randomised Controlled Feasibility Pilot Study

View ORCID ProfileAnna C Morris, Zina Ibrahim, Margaret Heslin, Omer S Moghraby, Argyris Stringaris, Ian M Grant, Lukasz Zalewski, Megan Pritchard, Robert Stewart, Matthew Hotopf, Andrew Pickles, Richard J B Dobson, Emily Simonoff, Johnny Downs
doi: https://doi.org/10.1101/2021.10.07.21264418
Anna C Morris
1South London and Maudsley NHS Foundation Trust, London, UK
2Department of Child and Adolescent Psychiatry, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Anna C Morris
  • For correspondence: anna.morris{at}kcl.ac.uk
Zina Ibrahim
3Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
5NIHR South London and Maudsley Biomedical Research Centre, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Margaret Heslin
4Health Service and Population Research Department, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Omer S Moghraby
1South London and Maudsley NHS Foundation Trust, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Argyris Stringaris
2Department of Child and Adolescent Psychiatry, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
6Emotion & Development Branch, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ian M Grant
3Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lukasz Zalewski
3Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Megan Pritchard
5NIHR South London and Maudsley Biomedical Research Centre, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Robert Stewart
1South London and Maudsley NHS Foundation Trust, London, UK
5NIHR South London and Maudsley Biomedical Research Centre, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthew Hotopf
1South London and Maudsley NHS Foundation Trust, London, UK
5NIHR South London and Maudsley Biomedical Research Centre, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrew Pickles
3Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
5NIHR South London and Maudsley Biomedical Research Centre, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Richard J B Dobson
2Department of Child and Adolescent Psychiatry, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
5NIHR South London and Maudsley Biomedical Research Centre, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Emily Simonoff
1South London and Maudsley NHS Foundation Trust, London, UK
2Department of Child and Adolescent Psychiatry, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
5NIHR South London and Maudsley Biomedical Research Centre, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Johnny Downs
1South London and Maudsley NHS Foundation Trust, London, UK
2Department of Child and Adolescent Psychiatry, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, UK
5NIHR South London and Maudsley Biomedical Research Centre, London, UK
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Data/Code
  • Preview PDF
Loading

Abstract

Background Interest in internet-based patient reported outcome measure (PROM) collection is increasing. The NHS myHealthE (MHE) web-based monitoring system was developed to address the limitations of paper-based PROM completion. MHE provides a simple and secure way for families accessing Child and Adolescent Mental Health Services to report clinical information and track their child’s progress. This study aimed to assess whether MHE improves the completion of the Strengths and Difficulties Questionnaire (SDQ) compared with paper collection. Secondary objectives were to explore caregiver satisfaction and application acceptability.

Methods A twelve-week single-blinded randomised controlled feasibility pilot trial of MHE was conducted with 196 families accessing neurodevelopmental services in south London to examine whether electronic questionnaires are completed more readily than paper-based questionnaires over a 3-month period. Follow up process evaluation phone calls with a subset (n=8) of caregivers explored system satisfaction and usability.

Results MHE group assignment was significantly associated with an increased probability of completing an SDQ-P in the study period (adjusted hazard ratio, (HR) 12.1, 95% CI 4.7-31.0; p= <0.001). Of those caregivers’ who received the MHE invitation (n=68) 69.1% completed an SDQ using the platform compared to 8.8% in the control group (n=68). The system was well received by caregivers, who cited numerous benefits of using MHE, for example, real time feedback and ease of completion.

Conclusions MHE holds promise for improving PROM completion rates. Research is needed to refine MHE, evaluate large scale MHE implementation, cost effectiveness and explore factors associated with differences in electronic questionnaire uptake.

Key practitioner messages

  • Patient reported outcome measures (PROMs) are considered an important tool for measuring treatment success and outcomes in healthcare systems.

  • Adherence to routine PROM guidance in Child and Adolescent Mental Health Services (CAMHS) remains low, largely driven by limitations associated with paper-based data collection.

  • Paperless monitoring systems (i.e., digital) as an alternative to traditional outcome measure delivery and collection are growing in healthcare settings.

  • Remote questionnaire completion using the myHealthE (MHE) system is feasible and acceptable to caregivers of children accessing CAMHS in South London, yielding a 60.3 % increase in Strengths and Difficulties questionnaire reporting compared to standard practice.

  • More research is required to understand whether MHE implementation affords similar improvements in remote PROM completion at scale and whether electronic questionnaire uptake is equal for different socio-demographic and clinical populations.

Competing Interest Statement

The authors have declared no competing interest.

Clinical Trial

ISRCTN22581393

Funding Statement

Z.I. M.P. R.S. M.H. A.P. R.J.B.D. E.S. and J.D. are affiliated with the National Institute of Health Research (NIHR) Biomedical Research Centre for Mental Health (BRC) Nucleus at the South London and Maudsley (SLaM) NHS Foundation Trust and Institute of Psychiatry Psychology and Neuroscience (IoPPN) Kings College London (KCL). Additionally the Clinical Record Interactive Search (CRIS) is supported by the NIHR BRC at the SLaM NHS Foundation Trust and KCL. A.C.M is supported by the Guys and St Thomas (GSST) Charity. Z.I. and R.J.B.D. are additionally supported by the NIHR University College London Hospitals BRC. R.J.B.D. is further supported by (1) Health Data Research (HDR) UK and (2) The BigData@Heart Consortium under grant agreement No. 116074. M.H. reports funding from the NIHR. A.S. is supported by the Intramural Research Program of the National Institute of Mental Health National Institutes of Health (NIH) (Grant No. ZIA-MH002957-01). R.S. is additionally part-funded by i) a Medical Research Council (MRC) Mental Health Data Pathfinder Award to Kings College London; ii) an NIHR Senior Investigator Award; iii) the NIHR Applied Research Collaboration South London (NIHR ARC South London) at Kings College Hospital NHS Foundation Trust. The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care. M.H. declares funding from the Innovative Medicines Initiative for the RADAR-CNS consortium which includes contributions from Janssen MSD UCB Biogen and Lundbeck. A.P. is partially supported by the NIHR (NF-SI-0617-10120). E.S. is supported from the NIHR BRC at SLaM NHS Foundation Trust (IS‐BRC‐1215‐20018) the NIHR through a programme grant (RP‐PG‐1211‐20016) and Senior Investigator Award (NF‐SI‐0514‐10073 and NF‐SI‐0617‐10120) the European Union Innovative Medicines Initiative (EU‐IMI 115300) Autistica (7237) MRC (MR/R000832/1, MR/P019293/1) the Economic and Social Research Council (ESRC 003041/1) and GSST Charity (GSTT EF1150502) and the Maudsley Charity. J.D. is supported by NIHR Clinician Science Fellowship award (CS‐2018‐18‐ST2‐014) and has received support from a Medical Research Council (MRC) Clinical Research Training Fellowship (MR/L017105/1) and Psychiatry Research Trust Peggy Pollak Research Fellowship in Developmental Psychiatry.

Author Declarations

I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.

Yes

The details of the IRB/oversight body that provided approval or exemption for the research described are given below:

Approval for the trial was given by the South London and Maudsley NHS Foundation Trust CAMHS Clinical Audit, Service Evaluation and Quality Improvement Committee (approval date: 07/04/2017). Extraction and analysis of deidentified outcome data were carried out using the CRIS platform and security model approved by Oxford Research Ethics Committee C (reference 18/SC/0372)

I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.

Yes

I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).

Yes

I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.

Yes

Footnotes

  • Trial Registration: International Standard Randomized Controlled Trial Number (ISRCTN) 22581393; https://doi.org/10.1186/ISRCTN22581393

  • Conflict of Interest: None to declare.

  • Ethics statement Approval for the trial was given by the South London and Maudsley NHS Foundation Trust CAMHS Clinical Audit, Service Evaluation and Quality Improvement Committee (approval date: 07/04/2017). Extraction and analysis of deidentified outcome data were carried out using the CRIS platform and security model approved by Oxford Research Ethics Committee C (reference 18/SC/0372).

Data Availability

The data accessed by CRIS remain within an NHS firewall and governance is provided by a patient-led oversight committee. Access to data is restricted to honorary or substantive employees of the South London and Maudsley NHS Foundation Trust and governed by a local oversight committee who review and approve applications to extract and analyse data for research. Subject to these conditions, data access is encouraged and those interested should contact RS (robert.stewart{at}kcl.ac.uk), CRIS academic lead.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted October 11, 2021.
Download PDF

Supplementary Material

Data/Code
Email

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Assessing the Feasibility of a Web-based Outcome Measurement System in Child and Adolescent Mental Health Services: myHealthE (MHE) a Randomised Controlled Feasibility Pilot Study
(Your Name) has forwarded a page to you from medRxiv
(Your Name) thought you would like to see this page from the medRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Assessing the Feasibility of a Web-based Outcome Measurement System in Child and Adolescent Mental Health Services: myHealthE (MHE) a Randomised Controlled Feasibility Pilot Study
Anna C Morris, Zina Ibrahim, Margaret Heslin, Omer S Moghraby, Argyris Stringaris, Ian M Grant, Lukasz Zalewski, Megan Pritchard, Robert Stewart, Matthew Hotopf, Andrew Pickles, Richard J B Dobson, Emily Simonoff, Johnny Downs
medRxiv 2021.10.07.21264418; doi: https://doi.org/10.1101/2021.10.07.21264418
Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Assessing the Feasibility of a Web-based Outcome Measurement System in Child and Adolescent Mental Health Services: myHealthE (MHE) a Randomised Controlled Feasibility Pilot Study
Anna C Morris, Zina Ibrahim, Margaret Heslin, Omer S Moghraby, Argyris Stringaris, Ian M Grant, Lukasz Zalewski, Megan Pritchard, Robert Stewart, Matthew Hotopf, Andrew Pickles, Richard J B Dobson, Emily Simonoff, Johnny Downs
medRxiv 2021.10.07.21264418; doi: https://doi.org/10.1101/2021.10.07.21264418

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Health Systems and Quality Improvement
Subject Areas
All Articles
  • Addiction Medicine (430)
  • Allergy and Immunology (756)
  • Anesthesia (221)
  • Cardiovascular Medicine (3294)
  • Dentistry and Oral Medicine (364)
  • Dermatology (279)
  • Emergency Medicine (479)
  • Endocrinology (including Diabetes Mellitus and Metabolic Disease) (1171)
  • Epidemiology (13376)
  • Forensic Medicine (19)
  • Gastroenterology (899)
  • Genetic and Genomic Medicine (5153)
  • Geriatric Medicine (482)
  • Health Economics (783)
  • Health Informatics (3268)
  • Health Policy (1140)
  • Health Systems and Quality Improvement (1190)
  • Hematology (431)
  • HIV/AIDS (1017)
  • Infectious Diseases (except HIV/AIDS) (14629)
  • Intensive Care and Critical Care Medicine (913)
  • Medical Education (477)
  • Medical Ethics (127)
  • Nephrology (523)
  • Neurology (4925)
  • Nursing (262)
  • Nutrition (730)
  • Obstetrics and Gynecology (883)
  • Occupational and Environmental Health (795)
  • Oncology (2524)
  • Ophthalmology (724)
  • Orthopedics (281)
  • Otolaryngology (347)
  • Pain Medicine (323)
  • Palliative Medicine (90)
  • Pathology (543)
  • Pediatrics (1302)
  • Pharmacology and Therapeutics (550)
  • Primary Care Research (557)
  • Psychiatry and Clinical Psychology (4212)
  • Public and Global Health (7504)
  • Radiology and Imaging (1706)
  • Rehabilitation Medicine and Physical Therapy (1013)
  • Respiratory Medicine (980)
  • Rheumatology (480)
  • Sexual and Reproductive Health (497)
  • Sports Medicine (424)
  • Surgery (548)
  • Toxicology (72)
  • Transplantation (236)
  • Urology (205)