Abstract
Background This review aimed to quantify the impact of allied health professionals (AHPs) embedded in neonatal services on outcomes by asking the following review questions:
Q1. What is the effectiveness of neonatal services with embedded allied health professionals compared to neonatal services without embedded allied health professionals?
Q2. What is the effectiveness of early interventions provided by allied health professionals in neonatal units?
Research Implications and Evidence Gaps There was very little directly relevant evidence on AHPs embedded in neonatal services. Most of the evidence related to multidisciplinary team working or early interventions provided by AHPs. Few early intervention trials were from the UK, leading to uncertainty about the availability and applicability of interventions in the UK setting. Further UK-based research is needed to better understand the best way to integrate allied health professionals in neonatal services.
Economic considerations There is no published evidence on the cost of AHPs working within neonatal units. There is marked variability in the reporting of cost estimates for neonatal care units in the UK, making the evaluation of cost implications of adopting AHP recommendations difficult. Subsequent economic evaluations could explore the Budget Impact to the NHS of increasing AHP presence in neonatal units to align with recommendations from AHP professional bodies and Royal Colleges.
Funding statement Health Technology Wales were funded for this work by the Health and Care Research Wales Evidence Centre, itself funded by Health and Care Research Wales on behalf of Welsh Government.
What is a Rapid Review?Our rapid reviews (RR) use a variation of the systematic review approach, abbreviating or omitting some components to generate the evidence to inform stakeholders promptly whilst maintaining attention to bias.
Who is this Rapid Review for?The review question was suggested by Health Education and Improvement Wales (HEIW). This review is intended to inform those responsible for staffing in neonatal services.
Background / Aim of Rapid Review This review aimed to quantify the impact of allied health professionals (AHPs) embedded in neonatal services on outcomes by asking the following review questions:
Q1. What is the effectiveness of neonatal services with embedded allied health professionals compared to neonatal services without embedded allied health professionals?
Q2. What is the effectiveness of early interventions provided by allied health professionals in neonatal units?
Recency of the evidence base
The review included evidence available up until March 2024. Included studies were published between 2016 and 2024.
Extent of the evidence base for Q1
7 studies were identified: 6 before-after studies and 1 comparative cohort study.
The studies were conducted in Canada (n=2), USA (n=2), Australia (n=1). South Korea (n=1) and Japan (n=1).
1 study compared before with after the implementation of a neonatal intensive care unit (NICU) with embedded physiotherapy staff. The other studies compared neonatal units with and without multidisciplinary teams including AHPs.
Key findings and certainty of the evidence for Q1
Low certainty evidence suggests AHPs embedded in neonatal services may improve gross motor ability and lead to earlier oral feeding.
Results from before-after and cohort studies of multidisciplinary nutrition support teams in neonatal units are too inconsistent to draw conclusions.
Extent of the evidence base for Q2 5 studies were identified: 5 systematic reviews including 57 unique randomised controlled trials (RCTs)
The studies were conducted in the USA (n=23), Iran (n=5), Australia (n=5), Brazil (n=4), India (n=3), France (n=3), UK (n=3), Canada (n=3), Spain (n=2), Switzerland (n=1), Netherlands (n=1), South Korea (n=1), Italy (n=1), Denmark (n=1) and Taiwan (n=1).
The studies investigated early interventions actively involving parents, oral stimulation multisensory stimulation, and early interventions which continue post-discharge.
Key findings and certainty of the evidence for Q2
Moderate certainty evidence suggests that early interventions provided by AHPs in neonatal units are associated with shorter length of stay, better parental sensitivity and quicker oral feeding.
There is moderate certainty that these interventions are associated with small improvements in general cognitive and general gross motor ability in infancy compared to standard care.
There is low certainty evidence from RCTs that early interventions delivered by AHPs do not impact parental stress in the short-term.
Research Implications and Evidence Gaps
There was very little directly relevant evidence on AHPs embedded in neonatal services. Most of the evidence related to multidisciplinary team working or early interventions provided by AHPs.
Few early intervention trials were from the UK, leading to uncertainty about the availability and applicability of interventions in the UK setting.
Further UK-based research is needed to better understand the best way to integrate allied health professionals in neonatal services.
Policy and Practice Implications
AHP professional bodies and Royal Colleges have issued recommendations of number of whole time equivalent (WTE) AHP staff of each type needed for each level of neonatal unit.
This rapid review supports the idea that the involvement of AHPs neonatal units is likely to improve outcomes, but it does not inform the exact numbers of staff required.
Implementing the recommendations of the AHP professional bodies in Welsh neonatal units is likely to be a major change in practice as no Welsh neonatal unit currently has the recommended WTE number of AHP staff.
Economic considerations
There is no published evidence on the cost of AHPs working within neonatal units.
There is marked variability in the reporting of cost estimates for neonatal care units in the UK, making the evaluation of cost implications of adopting AHP recommendations difficult.
Subsequent economic evaluations could explore the Budget Impact to the NHS of increasing AHP presence in neonatal units to align with recommendations from AHP professional bodies and Royal Colleges.
1 BACKGROUND
1.1 Who is this review for?
This Rapid Review was conducted as part of the Health and Care Research Wales Evidence Centre Work Programme. The review question was suggested by Health Education and Improvement Wales (HEIW). The Maternal Neonatal Safety Support Programme Cymru discovery phase report (PHW 2023) identified that to ensure services are equitable for babies across Wales all neonatal units should have a plan and be allocated capacity to have early developmental intervention using allied health professional (AHP) input. HEIW is undertaking a Strategic Perinatal Workforce Plan programme of work (HEIW 2024) to develop a plan to recruit, retain, train, and transform the perinatal workforce including AHPs. This review is intended to support that work.
1.2 Background and purpose of this review
Infants who are critically ill or are born prematurely require medical care in neonatal units to address their immediate physical health needs and ensure survival. These infants also need developmental care, focusing on their longer term neurodevelopmental and psychosocial needs. There can be a perceived trade-off between medical and developmental care for several reasons. Medical care is high intensity with significant staff attention and resources needed – appearing more urgent than developmental care. The busy environment of the neonatal intensive care unit may sometimes interfere with the sleep cycle and sensory development of the infant. Parents and carers may become sidelined if most of their child’s care is provided by healthcare professionals.
Neonatal services, however, increasingly integrate medical and developmental care: an approach which research and guidelines suggest leads to better outcomes for the infant. Examples of this include developmentally supportive care which aims to reduce the stress of the neonatal intensive care unit (NICU) environment on the infant. Family-centred care encourages parents to become involved in the care of their child. Interdisciplinary teams include a range of professionals including allied health professionals who can address all the medical and developmental needs of the infant.
Allied health professionals (AHPs) such as Physiotherapists, Dieticians, Occupational therapists, Speech and language therapists and Psychologists are key members of interdisciplinary/multidisciplinary teams. They provide specialist early interventions and assessments for children in neonatal units. Workforce recommendations for neonatal services (see Table 1) state that AHPs should be embedded as part of the team within neonatal units (BAPM 2022), but currently no Welsh neonatal unit has the recommended whole time equivalent (WTE) number of AHP staff.
This rapid review aims to quantify the impact of the embedded AHP team in neonatal units on outcomes by asking the following review question:
Q1. What is the effectiveness of neonatal services with embedded allied health professionals compared to neonatal services without embedded allied health professionals?
Preliminary literature searches identified very little evidence comparing AHPs embedded in neonatal services to standard care. For this reason, we asked an additional question, to estimate some of the ways AHPs can impact outcomes in neonatal services:
Q2. What is the effectiveness of early interventions provided by allied health professionals in neonatal units?
2. RESULTS
2.1 Q1. Review of neonatal services with embedded allied health professionals
Overview of the Evidence Base
Seven studies were included that addressed Q1 (see section 5.1, Table 5 for full eligibility criteria). Six were before-after studies (Furtado et al. 2016, Jeong et al. 2016, Morioka et al. 2024, Muirhead & Bates 2023, Sneve et al. 2008, Welch et al. 2017) and 1 was a comparative cohort study (Gover et al. 2014). The studies were conducted in Canada (n=2), USA (n=2), Australia (n=1). South Korea (n=1) and Japan (n=1). See section 6.2, Table 8 for a detailed summary of the included studies.
Only 1 study (Morioka et al. 2024) directly addressed the review question by comparing before with after the implementation of a neonatal intensive care unit (NICU) with embedded physiotherapy staff. The other studies compared neonatal units with and without multidisciplinary teams including, but not limited to, AHPs. Four of the studies concerned NICU nutritional support multidisciplinary teams with dieticians (Furtado et al. 2016, Gover et al. 2014, Jeong et al. 2016, Sneve et al. 2008). The remaining 2 studies (Muirhead & Bates 2023, Welch et al. 2017) evaluated NICU multidisciplinary teams including occupational therapists, physiotherapists and speech therapists.
All the studies were considered to be at a high risk of including bias in their results or conclusions. This was because of study designs that were more prone to bias, lack of controlling for confounders and lack of published study protocols. (See section 6.3, Table 10 and Table 11 for the summary of the risk of bias assessment for each study).
The certainty of the evidence on which the findings are based has been categorised using the GRADE approach (Grading of Recommendations Assessment, Development and Evaluation) into high, moderate, low or very low. These ratings provide the degree of confidence we have in the findings, with a high rating indicating, that having assessed the potential problems with the available evidence we are very confident that our summary estimate of the intervention effect represents the true value, whilst very low certainly indicates that we have very little confidence that our summary of the effect represents the true underlying effect. Further detail on how studies were assessed is provided in section 6.4.
Effectiveness of neonatal services with embedded allied health professionals
Length of stay
Very low certainty evidence from 1 before-after study (Morioka et al. 2024) suggests that NICU with embedded physiotherapists compared to standard physiotherapy care does not affect length of stay in NICU.
General gross motor ability
Very low certainty evidence from 1 before-after study shows (Morioka et al. 2024) a benefit in terms of Hammersmith Neonatal Neurological Examination total points score for infants cared for in a NICU with embedded physiotherapists compared to standard physiotherapy care.
Oral feeding
Very low certainty evidence from 1 before-after study (Morioka et al. 2024) that infants cared for in a NICU with embedded physiotherapists reached full oral feeding around 1½ weeks sooner (post menstrual age) than infants receiving standard physiotherapy care.
Mortality
Very low certainty evidence from 3 before-after studies (Furtado et al. 2016, Jeong et al. 2016, Sneve et al. 2008) and 1 cohort study (Gover et al. 2014) shows inconsistent results in terms of mortality when comparing infants cared for by a multidisciplinary nutritional support team including a dietician with those not cared for by such a team. Study results ranged from clinically important benefit to clinically important harm with the nutritional support MDT and it was not appropriate to pool the results.
Length of stay
Very low certainty evidence from 3 before-after studies (Furtado et al. 2016, Jeong et al. 2016, Sneve et al. 2008) and 1 cohort study (Gover et al. 2014) shows inconsistent results in terms of length of stay when comparing infants cared for by a multidisciplinary nutritional support team including a dietician with those not cared for by such a team. Study results ranged from clinically important benefit to clinically important harm with the nutritional support MDT and it was not appropriate to pool the results.
Parental confidence
Very low certainty evidence from 1 before-after study (Muirhead & Bates 2023) showed that NICU staff rated parents as much more likely to contribute to care planning following implementation of multidisciplinary developmental care rounds including an advanced practice nurse, an occupational therapist, a physiotherapist, and a speech therapist.
Oral feeding
Very low certainty evidence from 2 before-after studies (Furtado et al. 2016, Jeong et al. 2016) and 1 cohort study (Gover et al. 2014) shows inconsistent results in terms of time to full oral feeding when comparing infants cared for by a multidisciplinary nutritional support team including a dietician with those not cared for by such a team. Study results ranged from clinically important benefit to clinically important harm with the nutritional support MDT and it was not appropriate to pool the results.
Bottom line results for review of neonatal services with embedded allied health professionals
Evidence from a single before-after study suggests AHPs embedded in neonatal services may improve gross motor ability and lead to earlier oral feeding, but this evidence is uncertain. Results from before-after and cohort studies of multidisciplinary nutrition support teams in neonatal units are too inconsistent to draw conclusions. There was a lack of evidence on general cognitive ability, quality of life, visual or hearing impairment, parental bonding, attachment, mental health or mood outcomes.
2.2 Q2. Review of early interventions provided by allied health professionals in neonatal units
Overview of the evidence base
Five studies were included that addressed Q2 (see section 5.1, Table 6 for full eligibility criteria) all were systematic reviews (Girabent-Farrés et al. 2021, Greene et al. 2023, Lavallée et al. 2021, Orton et al. 2024, Rodovanski et al. 2023). The systematic reviews were checked for trials relevant to our review (where the early intervention was delivered by an AHP while the infant was in a neonatal unit) and 57 relevant randomised controlled trials (RCTs) were identified. See Table 9 for a summary of the included systematic reviews and relevant trials.
The systematic reviews focused on different types of early intervention including: early interventions actively involving parents (Girabent-Farrés et al. 2021, Lavallée et al. 2021), oral stimulation (Greene et al. 2023), early interventions which continue post-discharge (Orton et al. 2024) and multisensory stimulation (Rodovanski et al. 2023).
The systematic reviews were at low (Greene et al. 2023, Lavallée et al. 2021, Orton et al. 2024) or unclear (Girabent-Farrés et al. 2021, Rodovanski et al. 2023) risk of bias (see Table 12). Reasons for unclear risk of bias were concerns with the search strategy and inability to access the review protocol. This means that some relevant trials may have been missed by the systematic reviews.
The risk of bias judgements for the individual trials were also extracted from the systematic reviews and used to inform certainty in the body of evidence (see Forest plots in Appendix 1).
The main risk of bias issue in the randomised trials was lack of blinding, although some of the oral or multisensory stimulation trials did have blinding. Many of the trials were at high or unclear risk of bias from allocation concealment.
Effectiveness of early interventions provided by AHPs in neonatal services
The effectiveness evidence comes from RCTs identified in the included systematic reviews that were relevant to our review question.
Length of stay
Moderate certainty evidence from 10 RCTs (Greene et al. 2023) indicates that length of stay is around 1 week shorter with oral stimulation provided by an AHP compared to standard care.
Low certainty evidence from 13 RCTs (Rodovanski et al. 2023) indicates that length of stay is around 2 days shorter with tactile-kinaesthetic stimulation compared to standard care.
Very low certainty evidence from 9 RCTs (Rodovanski et al. 2023) suggests no difference between length of stay with auditory-tactile-visual-vestibular intervention and with standard care.
Parental bonding and attachment
Moderate certainty evidence from 3 RCTs (Lavallée et al. 2021) shows a small beneficial effect of early interventions delivered by psychologists for parents of preterm babies during NICU stay compared to standard care, in terms of parental sensitivity.
General cognitive ability
Moderate certainty evidence from 7 RCTs (Orton et al. 2024) shows a small beneficial effect of early interventions delivered by AHPs compared to standard care, in terms of developmental quotient in infancy. The estimated improvement is around 3 points on the developmental quotient scale, where 100 is the score for a typically developing infant.
General gross motor ability
Moderate certainty evidence from 8 RCTs (Orton et al. 2024) shows a small beneficial effect of early interventions delivered by AHPs compared to standard care, in terms of developmental quotient in infancy. The estimated improvement is around 5 points on the developmental quotient scale, where 100 is the score for a typically developing infant.
Oral feeding
Moderate certainty evidence from 10 RCTs (Greene et al. 2023) indicates that time to oral feeding is around 1 week shorter with oral stimulation provided by an AHP than with standard care.
Parental stress
Low certainty evidence from 2 RCTs (Girabent-Farrés et al. 2021) found no important difference in short-term parental stress when comparing early interventions actively involving parents delivered by AHPs to standard care.
Bottom line results for review of early interventions provided by allied health professionals in neonatal units
Moderate certainty evidence from RCTs suggests that early interventions provided by AHPs in neonatal units are associated with shorter length of stay, better parental sensitivity and quicker oral feeding. These interventions are also associated with small improvements in general cognitive and general gross motor ability in infancy compared to standard care.
There is low certainty evidence from RCTs that early interventions delivered by AHPs do not impact parental stress in the short-term. There was a lack of evidence on aspiration, cranial head shape, readmission rates, neonatal staff competencies and neonatal staff stress outcomes.
3. DISCUSSION
3.1 Summary of the findings
The aim of this rapid review was to summarise the effectiveness of neonatal services with embedded AHPs compared to neonatal services without embedded AHPs. While minimal directly relevant evidence was found—most of it concerned multidisciplinary team working— the available evidence did support the inclusion of embedded AHPs
The second review question provided indirect evidence to support the place of AHPs in neonatal services with 57 RCTs identified that largely supported the effectiveness of early interventions delivered by AHPs in neonatal units.
3.2 Strengths and limitations of the available evidence
Most of the studies of neonatal services with embedded AHPs were before-after designs. These are at high risk of biases such as trends over time, confounders and regression to the mean. This means that differences in outcomes between the before and after periods may not solely be due to the intervention.
The before-after studies of nutritional support MDTs with dieticians showed a great deal of heterogeneity in their results. This may be because they included somewhat different populations such as infants with gastroschisis, short bowel syndrome or with very low birthweight. In addition, these interventions were primarily aimed at nutritional outcomes such as weight gain. While these studies typically showed benefits for these nutritional outcomes these were not outcomes of interest in this review and so were not included in the evidence.
In the studies of neonatal units with and without MDTs, AHPs were part of the team with a range of other healthcare professionals so it is not possible to assess their individual impact on outcomes.
The majority of the included studies were conducted in neonatal intensive care units (level 3 neonatal units) and it is unclear how it applies to local level 1 or 2 neonatal units were infants may have less complex needs.
The included RCTs of early interventions provided by AHPs covered all types of AHPs in our review protocol (occupational therapists, physiotherapists, speech and language therapists and psychologists) – except for dieticians. This may be because trials of early interventions provided by dieticians did not specifically mention the involvement of the dietitian in the systematic review publication.
The early intervention evidence on cognitive and motor outcomes comes from RCTs that started in the neonatal unit, but the interventions carried on post-discharge. It is unclear how this might apply to the responsibilities of AHPs embedded in neonatal units and to what extent they are involved in the care of the infant post-discharge.
In the evidence on multisensory early interventions carried out in NICU it was difficult to identify exactly who carried out the intervention due to poor reporting. The evidence was downgraded for indirectness, as the interventions were likely delivered by nurses in some cases.
The focus of this review was the involvement of AHPs in services and early interventions rather than which specific early interventions are the most effective. For this reason different types of intervention have been pooled within general classes of intervention. This is likely to contribute to heterogeneity in some cases. A range of interventions were reported in the evidence but it is uncertain how many of these interventions are available in the UK setting. Three included trials were from the UK.
We had anticipated that relevant evidence would come from UK audits of neonatal services. While a national neonatal audit programme (RCPCH 2023) was identified it did not provide data on AHPs and no other relevant audits were found. We also looked for evidence about staffing numbers or AHP to cot ratios to inform the optimal number of AHPs in a neonatal unit, but no relevant evidence was found.
3.3 Strengths and limitations of this Rapid Review
One of the strengths of this review is the systematic and comprehensive search of the literature. This identified a dearth of evidence on the effectiveness of neonatal services with embedded allied health professionals. This is despite national policy and guidance which recognises the importance of AHPs in neonatal services and states AHPs should be embedded in these services.
This review likely underestimates the role of the AHP in neonatal services. Many of the interventions provided in neonatal units are provided using a team approach which becomes part of routine care, such as environmental light or sound modifications, massage, skin to skin care, use of maternal voice or positioning. While the AHP may support these approaches their role is not typically documented as a specific service in trials of these interventions so they would have been excluded from the evidence. Similarly, the Newborn Individualized Developmental Care and Assessment Program (NIDCAP) model of care is a team-based approach that is part of routine care and would be supported by AHPs – but NIDCAP trials typically describe the intervention as being delivered by nurses.
The evidence shows benefits of early interventions delivered by AHPs in neonatal services and if a large part of the AHP’s time is spent in the neonatal unit it may be practical to embed them there. The benefit of AHPs in neonatal services can then extend beyond delivering early interventions themselves. For instance, their presence, advice and training can positively impact other neonatal staff and parents, contributing to a culture of developmental care. AHPs working in neonatal units are typically required to be neonatal specialists (APCP Neonatal Committee 2023, British Dietetic Association 2022, Royal College of Occupational Therapists 2022, Royal College of Speech and Language Therapists 2023), embedding AHPs within units enables them to reach these specialist levels.
3.4 Implications for policy and practice
The GIRFT neonatology workforce national report (GIRFT 2022) recommends “Embed allied health professionals, pharmacy and psychology services into neonatal units and networks, in line with professional standards to improve outcomes for babies.” Clinical guidelines from NICE (NICE 2017, NICE 2020) indicate that AHPs are an essential part of care and follow- up for children born preterm that are being cared for in neonatal units.
National neonatal service and quality standards from BAPM (BAPM 2022) set out the staffing service standards for AHPs in neonatal units. UK AHP professional bodies and Royal Colleges (APCP Neonatal Committee 2023, Association of Clinical Psychologists 2022, British Dietetic Association 2022, Royal College of Occupational Therapists 2022, Royal College of Speech and Language Therapists 2023) have each made specific recommendations about the number of WTE AHP staff of each type needed for each level of neonatal unit (largely based on expert consensus). Findings of this rapid review support the idea that the involvement of AHPs neonatal units is likely to improve outcomes, but it does not inform the exact numbers of staff required.
Implementing the recommendations of BAPM, the AHP professional bodies and Royal Colleges in Welsh neonatal units is likely to be a major change in practice as no Welsh neonatal unit currently has the recommended WTE number of AHP staff. This may be related to a challenging climate in neonatal staffing – the National Neonatal Audit Programme (NNAP) 2022 audit (RCPCH 2023) found only 71% of neonatal nurse shifts were staffed according to recommended levels in England, Wales and Scotland. The GIRFT neonatology workforce national report (GIRFT 2022) found significant shortfall in AHP service provision in England with less than half of neonatal services having regular dietetics, physiotherapy, speech and language therapy and occupational therapy services. In units with AHP services, adherence to staffing standards was very low – the highest being dietetics at only 54% adherence.
It is recognised that additional funding and planning are needed to meet the challenge of AHP staffing in neonatal services (NHSE & NHSI 2019). The 2019 NHS Long Term Plan committed to additional funding (up to 2024) to meet the action plan of the NHS England Neonatal Critical Care Review (NCCR). One of the Long Term Plan’s key commitments was “Further developing the expert neonatal workforce required: extra neonatal nurses and expanded roles for some allied health professionals to support clinical care.” To implement the AHP recommendations of the NCCR, NHS England (NHSE & NHSI 2019) advised “NHS Trusts should develop an AHP strategy as part of workforce planning which sets out the level and expertise of pharmacy and AHP required, the level currently available, and how any gaps will be filled.”
In 2022 the Welsh Government asked Improvement Cymru undertake the Discovery Phase for a new Maternity and Neonatal Safety Support Programme (PHW 2023). This project identified adherence to national workforce standards as a key priority. It acknowledged that national workforce planning needs a strategy to ensure that AHPs are embedded within services in line with national standards. It also highlighted the role of AHP leads within the Maternity and Neonatal Network. HEIW (HEIW 2024) is developing a strategic perinatal workforce plan to recruit, retain, train and transform the current and future perinatal workforce in NHS Wales.
3.5 Implications for future research
Further research is needed on the effective organisation of AHPs within UK neonatal services, including staffing levels, expanding roles and service models.
3.6 Economic considerations*
Cost of neonatal units
There is marked variability in the reporting of cost estimates for neonatal care units in the UK. With reporting differing due to study heterogeneity, differences in data sources, costing methodologies and care requirements for babies (Yang et al. 2023).
Directions for future research
Future research should assess the costs of introducing AHPs in neonatal units. Evaluations should comprehensively consider the costs of AHP staff of each type and band, as defined in recommendations from AHP professional bodies and Royal Colleges. The latest unit costs for AHPs in the UK are presented in the Unit Costs of Health and Social Care 2023 (Jones et al. 2023).
Future research should focus on the relative cost-effectiveness of neonatal units that embed AHPs within their operating model and those that do not. Consideration should be given to the impact of neonatal care not just on babies but upon the wider family including the mother.
Subsequent economic evaluations could explore the Budget Impact to the NHS of increasing AHP presence in neonatal units to align with recommendations from AHP professional bodies and Royal Colleges.
*This section has been completed by the Centre for Health Economics & Medicines Evaluation (CHEME), Bangor University
Data Availability
All data produced in the present study are available upon reasonable request to the authors
Report Contributors
Review Team
Nathan Bromham, Leona Batten and David Jarrom, Health Technology Wales
Elizabeth Gillen, Wales Centre for Evidence Based Care
Juliet Hounsome, Specialist Unit for Review Evidence, Cardiff University
Economic Considerations
Jacob Davies and Rhiannon Tudor Edwards, Centre for Health Economics & Medicines Evaluation (CHEM£), Bangor University
Methodological Advice
Ruth Lewis
Evidence Centre Team
Adrian Edwards, Alison Cooper, Natalie Joseph-Williams, Micaela Gal and Elizabeth Doe involved in stakeholder engagement, review of report and editing
Public Partners
Beti-jane Ingram
Stakeholders
Margaret Manton, Cwm Taf Morgannwg University Health Board
Catherine Pape, Health Education and Improvement Wales (HEIW)
When needing more in-depth profession specific information, the stakeholders were also supported by the following members the Clinical Support Group:
Elen Elias, Betsi Cadwaladr University Health Board
Stephanie Griffiths, Hywel Oda University Health Board
Amanda Lawes, Swansea Bay University Health Board
Louise Leach, Health Education Improvement Wales
Fiona Luff, Betsi Cadwaladr University Health Board
Catriona Matthews, Cardiff & ValeUniversity Health Board
Debbie Paris, Aneurin Bevan University Health Board
Bethan Phillips, Cwm Taf Morgannwg University Health Board
Ceri Selman, Swansea Bay University Health Board
Leah Watson, Swansea Bay University Health Board
Abbreviations
- Acronym
- Full Description
- AHP
- Allied health professional
- BAPM
- British Association of Perinatal Medicine
- ATVV
- Auditory-Tactile-Visual-Vestibular
- CBT
- Cognitive Behavioural Therapy
- CI
- Confidence Interval
- EMDR
- Eye Movement Desensitisation and Reprocessing
- EPOC
- Effective Practice and Organisation of Care
- GRADE
- Grading of Recommendations, Assessment, Development and Evaluation
- HDU
- High Dependency Unit
- ICN
- Intensive Care Nurse
- MD
- Mean Difference
- MDT
- Multidisciplinary Team
- NHSE
- NHS England
- NHSI
- NHS Improvement
- NICU
- Neonatal intensive care unit
- OR
- Odds Ratio
- PMA
- Post Menstrual Age
- PSI
- Parenting Stress Index
- PSI-SF
- Parenting Stress Index – Short Form
- RCT
- Randomized Controlled Trial
- ROB
- Risk of Bias
- SCBU
- Special Care Baby Unit
- SMD
- Standardized Mean Difference
- TC
- Transitional Care
- TDPCI
- Therapist-Delivered Postural Control Intervention
- TKS
- Tactile-Kinaesthetic Stimulation
- WTE
- Whole Time Equivalent
5. RAPID REVIEW METHODS
5.1 Eligibility criteria
5.2 Incorporating data from existing reviews
For review question 2 we used included systematic reviews:
As a source of study characteristics/patient demographics. As a source of outcome and risk of bias data.
5.3 Literature search
Medline, Ovid EMCARE, AMED, CINAHL and Cochrane were searched for review question 1. For review question 2 Ovid EMCARE, AMED, CINAHL and Cochrane were searched. Studies published after 1995 were included due to major advances in neonatal care since that date. Searches were done between 7th and 11th March 2024. See Appendix 2 for search strategy. Websites were also searched for audits of neonatal services, see Appendix 3.
5.4 Study selection process
Using the Covidence systematic reviewing platform, two reviewers dual-screened 10% of titles and abstracts independently. After this, the level of agreement was assessed with disagreements settled by discussion and consensus. Both reviewers had to achieve at least 80% agreement on screened records before progressing to the next stage. The remaining titles and abstracts were screened by the primary reviewer alone. Ten percent of all full texts were screened by both reviewers, with the same agreement threshold (80%) as before, which was necessary before the remaining records could be screened by the primary reviewer alone. During independent screening, the primary reviewer consulted with the secondary reviewer in the case of any uncertainties.
5.5 Data extraction
The following data were extracted where available:
Study information (author, year, country, type of neonatal unit) Population characteristics
Intervention and comparison characteristics
Data on relative effectiveness for example odds ratios, or risk ratios for dichotomous variables and mean differences for continuous variables.
Data were extracted by a single reviewer and quality assured by a second reviewer.
5.6 Study design classification
The included studies were classified as systematic reviews, RCTs, cohort studies or before- after studies.
5.7 Quality appraisal
Different critical appraisal checklists were used to assess risk of bias depending on study design. For systematic reviews we used ROBIS (Whiting et al. 2016). For observational cohort studies the ROBINS-I checklist (Sterne et al. 2016) was used. ROBINS-I was not appropriate for before-after studies so in these cases we used the EPOC risk of bias criteria (EPOC 2017). We used the included systematic reviews as a source of risk of bias data for trials in review question 2. These reviews had used Cochrane RoB 1, Cochrane RoB 2 and the PEDro scale to assess risk of bias in RCTs trials.
5.8 Synthesis
Studies were grouped by intervention and outcome for synthesis. When studies were sufficiently similar in their populations, interventions, comparisons and outcomes we combined their results in meta-analysis using the meta package in R (Balduzzi et al. 2019). Otherwise, the data were synthesised using narrative synthesis. Published meta-analyses of the included systematic reviews were redone, excluding any studies not meeting our inclusion criteria.
5.9 Assessment of body of evidence
Certainty in the overall body of evidence was assessed using GRADE (Guyatt et al. 2008). The GRADE approach provides a formal system to categorises the certainty of (or confidence in) the evidence for each outcome or effect into one of four levels: high, moderate, low and very low. The system for assessing the certainty of evidence includes five domains relating to: risk of bias across the studies, inconsistency (heterogeneity) of the results between studies, indirectness (including subgroup analyses and applicability of the outcome measure), imprecision of the result (number of events, and width of the confidence intervals), and publication bias. At the start it is assumed that randomised controlled trials (RCTs) provide high level evidence and observational studies low, but this evidence is then downgraded or upgraded based on the assessment of the different criteria. A summary of the GRADE ratings and their interpretation is provided in Table 7.
6. EVIDENCE
6.1 Search results and study selection
6.2 Data extraction
Studies included for question 1 are summarised in Table 8, all were primary studies. Studies included for question 2 are summarised in Table 9, all were systematic reviews.
All studies included for question 2 were systematic reviews.
6.3 Quality appraisal
Summary quality appraisal tables
6.4 GRADE profiles
6.5 Information available on request
Protocol, search strategies, and excluded studies.
7. ADDITIONAL INFORMATION
7.1 Conflicts of interest
The authors declare they have no conflicts of interest to report.
The Health and Care Research Wales Evidence Centre
Our dedicated team works together with Welsh Government, the NHS, social care, research institutions and the public to deliver vital research to tackle health and social care challenges facing Wales.
Funded by Welsh Government, through Health and Care Research Wales, the Evidence Centre answers key questions to improve health and social care policy and provision across Wales.
Along with our collaborating partners, we conduct reviews of existing evidence and new research, to inform policy and practice needs, with a focus on ensuring real-world impact and public benefit that reaches everyone.
Acknowledgements
The authors would like to thank Amanda Lawes, Beti-jane Ingram, Bethan Phillips, Catherine Pape, Catriona Matthews, Ceri Selman, Debbie Paris, Elen Elias, Fiona Luff, Leah Watson, Louise Leach, Margaret Manton, and Stephanie Griffiths for their expertise in guiding the review question, and helpful comments on draft versions of the review protocol and rapid review report.
8. APPENDICES
8.1 APPENDIX 1: Forest plots
Forest plots for review question 1: What is the effectiveness of neonatal services with embedded AHPs compared to neonatal services without embedded AHPs?
Forest plots for review question 2: What is the effectiveness of early interventions provided by AHPs in neonatal units?
8.2 APPENDIX 2: Search strategy
8.3 APPENDIX 3: Websites searched for neonatal audits
Audit Commission (up to 2015)
Audit Wales
Audit Scotland
National Audit Office
Guidelines and Audit Implementation Network N.I. (up to 2015).
Regulation and Quality Improvement Authority (N.I.)
https://digital.nhs.uk/data-and-information/clinical-audits-and-registries
https://www.hdruk.ac.uk/access-to-health-data/health-data-research-innovation-gateway/