ABSTRACT
Objective Providing recommended amounts of rehabilitation for stroke and neurological patients is challenging. Telerehabilitation is viable for delivering rehabilitation and an acceptable adjunct to in-person therapy. NeuroRehabilitation OnLine (NROL) was developed as a pilot and subsequently operationalised as a regional innovation embedded across four National Health Service (NHS) Trusts. The aim of this paper is to describe the NROL innovation to assist future implementation and replication efforts.
Methods The Template for Intervention Description and Replication (TIDieR) checklist, with guidance from the TIDieR-Telehealth extension, was used to describe NROL. The description was developed collaboratively by clinical academics, therapists, managers, and researchers. Updated Consolidated Framework for Implementation Research domains were used to describe the context in which the innovation was delivered.
Results NROL delivers online group-based real-time neurorehabilitation with technology assistance provided, incorporating multidisciplinary targeted therapy and peer support. Procedures, materials and structure are detailed to demonstrate how NROL is embedded within a healthcare system. NROL uses existing NHS therapy workforce alongside dedicated NROL roles, including an essential technology support role. Selection of NROL groups is dependent on patient need. The NROL innovation is modified over time in response to patient and staff feedback. NROL described here is situated within a regional stroke and neurorehabilitation network in North-West England, aligns with local and national strategies, and capitalises on an existing clinical-academic partnership.
Conclusion This comprehensive description of a regional NROL innovation, and clarification of core components, should facilitate other healthcare settings to adapt and implement NROL for their context. Continuous evaluation alongside implementation will ensure maximal impact for neurorehabilitation.
STRENGTHS AND LIMITATIONS
A systematic development process was undertaken using the TIDieR checklist, and TIDieR-Telehealth extension, allowing a principled method for clear and user-friendly description of a complex intervention to assist future implementation and replication efforts.
Stakeholder engagement was integral to the collaborative development of the NROL innovation and its description, ensuring informed decision-making representing multiple perspectives.
The TIDieR checklist provides a succinct description of an intervention at a point in time but may not capture the implementation complexities and evolutions. However, the TIDieR checklist allows reporting on modifications and tailoring which can help mitigate these limitations.
The TIDieR checklist does not include an item on context, which is important to fully understand interventions, hence in this article context it is deliberatively reported to help situate the innovation.
BACKGROUND
Despite a wealth of evidence that greater amounts of rehabilitation can improve outcomes(1-4) providing stroke and brain injury patients with the recommended amount of therapy remains a clinical and workforce challenge(5). Increasing access to and opportunity for therapy is a critical step to addressing shortfalls in therapy intensity and ideally needs to be feasible with limited workforce resources.
Telerehabilitation, the provision of rehabilitation remotely via telecommunication devices, has developed as a viable complement to in-person therapy and offers one possible solution to help mitigate challenges. It can deliver conventional in-person therapies online with equivalent outcomes(5-10) and with similar attendance levels and acceptability to patients(11). Patients and staff report advantages in terms of saving time, energy and travel(12-14). Although not a new approach, rapid expanded adoption of telerehabilitation in routine practice was spurred by the COVID-19 pandemic(15-18), with further encouraging data collected during this time(14,19-21). In the UK and Ireland, clinical guidelines for stroke rehabilitation now recommend the provision of therapist monitored, patient-centred remote rehabilitation programmes alongside conventional in-person therapy(22).
A group-based real-time telerehabilitation innovation for patients with acquired brain injury was developed and piloted in London, UK, entitled NROL (NeuroRehabilitation OnLine). This standalone version of NROL demonstrated positive impacts on patient-reported outcomes(20). NROL was subsequently adapted and operationalised within the UK National Health Service (NHS) by embedding a recurring six-week multidisciplinary group-based telerehabilitation innovation into an existing service. Implementation with concurrent evaluation at a single NHS Trust level yielded positive results, demonstrating favourable patient and staff opinion, sustainable staffing and resource efficiencies with good clinical outcomes for patients(14). NROL was then expanded into a regional innovation involving four NHS Trusts in the North-West of England aligning to the NHS new Integrated Care System structure to work collaboratively across regions. It remains part of a hybrid approach to service delivery to complement in-person rehabilitation. NROL is acknowledged as an exemplar initiative for delivering remote rehabilitation(22).
Despite the successful development of NROL, as yet it has only been described in its standalone version(20) with no descriptive detail available for the current regional, multisite model. The Template for Intervention Description and Replication (TIDieR) checklist specifies criteria for the reporting of complex interventions(23). This article describes the NROL innovation developed for regional use within an existing healthcare service using the TIDieR checklist guidance, with the aim of assisting future implementation and replication efforts.
METHODS
This article describes NROL using the 12-items of the TIDieR checklist(23) and incorporates guidance from the TIDieR-Telehealth extension(24). Checklist details were developed iteratively and collaboratively, with input from staff involved in NROL implementation and evaluation including clinical academics, therapists, managers, researchers and a patient volunteer. Initially, individual TIDieR checklists describing each NROL group in a high level of detail were produced. These informed development of NROL staff manual and standard operating procedure documents. Finally, we abstracted from these documents to develop a superordinate TIDieR checklist, aimed at describing NROL as a delivery method within an existing healthcare system for application at a regional level.
Given the extensive interplay between an innovation and context, the settings in which NROL was implemented are described according to the domains of the updated Consolidated Framework for Implementation Research (CFIR)(25).
Patient and public involvement
NROL has been improved by partnership, with patients, carers and staff feedback shaping the intervention described. The NROL patient volunteer co-produced individual TIDieR checklists.
RESULTS
Item 1: Intervention (innovation)name
NeuroRehabilitation OnLine (NROL)
Item 2: Why
The purpose of NROL is to increase access and opportunity to neurorehabilitation for adult patients actively receiving community stroke and neurorehabilitation services within an existing healthcare system. NROL utilises an online delivery platform offering potential advantages to staff and patients in terms of saving time, energy and travel, and enabling delivery of more therapy to more people using an existing therapy workforce(14). Readily accessible technology assistance to learn how to use the required technology and help overcome barriers is important for optimising inclusivity and meeting the needs of this patient population(26-28).
NROL delivers group-based therapy. Group rehabilitation formats can help maximise patient contacts and staffing efficiencies whilst capitalising on the psychosocial benefits of peer support opportunities(20, 29). Peer-based interventions are viewed positively by those with acquired brain injury and neurological conditions(30, 31), and peer support elements are recommended for interventions in stroke(32). Favourable evidence supports the use of group therapy for the aspects of neurorehabilitation included within NROL(29, 33, 34).
NROL was embedded within an existing system (NHS), rather than being standalone, to support a sustainable service delivery model that could augment rehabilitation provision. The innovation aligns with strategic priorities at a local and national level. For example, NHS England recommend using data and digital technologies, making the most effective use of resources and establishing collaborative systems, as encompassed by NHS priorities and the National Stroke Service Model(35, 36).
This TIDieR checklist describes NROL encompassing a regional approach involving four NHS Trusts in the North-West of England. Cross-organisational working should allow a critical mass of patients for groups where impairment incidence is relatively low (i.e., dysphasia group) and a collective use of workforce. Collaborative working should also enable a community of practice and shared learning.
Item 3: What (materials) and Item 4: What (procedures)
The materials and the procedures for NROL were developed for remote delivery. They will be described together for the entry, delivery and exit of the 6-week NROL programme and are depicted in the NROL process chart (Figure 1). A secure ‘NROL hub’ collaboration platform (in Microsoft (MS) Teams) was created as a repository for shared NROL information and resources. Key documents include a ‘NROL standard operating procedure (SOP)’ and relevant organisational and governance approvals (e.g., Data Protection Impact Assessment). NROL was branded with a logo used widely on staff and patient-facing documentation, and t-shirts worn by the NROL team to increase visibility and establish a sense of a cohesive team.
NROL entry materials and procedures
Patients under the care of stroke and neurorehabilitation services with adequate access to computer hardware and connectivity are eligible for NROL. The NROL staff manual provides guidance to help therapy team members identify suitable patients. This living (continually edited and updated) ‘NROL staff manual’ provides an overview of NROL, group information and eligibility criteria, and referral process detail (see Supplementary file). Therapy team members discuss NROL with their patient and gain verbal consent for their participation in specified groups. A ‘NROL patient leaflet’ can be given to patients to complement verbal information. Eligible, consenting patients are referred to NROL using a ‘NROL referral form’. Therapy team members submit the NROL referral form to the NROL hub. NROL support staff enter referral form information onto a ‘NROL database’ (MS Excel), complete timetabling and document technology assistance.
Prior to programme start, a NROL staff member contacts new patients to administer ‘NROL outcome measures’, currently including the EQ-5D-5L for measuring health-related quality of life(37), the Stroke Self-Efficacy Questionnaire (SSEQ) for measuring self-efficacy(38) (modified for use with other neurological conditions), and the Patient Specific Functional Scale (PSFS) for measuring activity performance(39). A NROL technology support staff member completes a technology set-up with each patient to ensure they have the correct equipment (e.g., Information technology (IT) hardware and software (MS Teams, email), connectivity, group-specific requirements) and ability to access NROL, and a suitable home environment to take part in their specified groups. A ‘NROL technology support guide’ can be provided to patients for written guidance. Patients admitted to physical groups are provided with a ‘NROL physical group guide’ describing what they need, and how to set up their environment and webcam to safely perform exercises. Patients receive a ‘NROL entry email’ detailing their personalised NROL 6-week programme, which is also sent to the referrer. Relevant group invites are sent to patients and staff.
NROL delivery materials and procedures
Patients join NROL groups according to their personalised programme. Current groups are described in the NROL staff manual (Supplementary file). Targeted therapy groups can include ‘physical’ groups involving exercise or upper limb rehabilitation led by physiotherapy and occupational therapy staff, and ‘talking’ groups including cognitive rehabilitation, living well, fatigue management or communication therapy, led by occupational therapy, psychology and speech and language therapy staff. Many of the groups are jointly led by more than one discipline. Targeted therapy groups encompass interactive, educational, and practical elements. In addition, community groups are offered to all patients and include an introduction to NROL (Meet and Greet) and an optional weekly peer support group (Café NROL). Patients are sent a prompt (i.e., text, email) in the first two weeks of their programme to assist attendance. Technology assistance is available to patients and staff during each NROL session. Throughout the programme if a patient is expected in a group but does not join, the NROL technology support staff member makes contact to offer assistance.
NROL is delivered online (MS Teams) on existing staff devices. NROL group facilitators and the NROL technology support staff member require webcam and microphone-enabled devices and a stable internet connection to deliver NROL groups. A headset can assist clear communication. For physical groups, a large screen television with a portable microphone is used for monitoring of patients whilst performing exercises. Session content is developed by group facilitators and based on evidence-based practice guidelines, and may include discussions, demonstrations, and shared presentations (MS PowerPoint). Group facilitators and the NROL technology support staff member use the NROL database during sessions for accessing patient details, timetabling information and for recording attendance. Access to a telephone is required in case of adverse events. Group facilitators are required to ensure clinical notes are entered for all patients in attendance at sessions. Weekly NROL staff meetings are held to update and discuss NROL delivery and group facilitators meet separately as required.
Patients require internet connectivity, and a webcam and microphone enabled device appropriate to their groups (e.g., patients in physical groups require a large screen device), with MS teams installed. Patients participating in physical groups require equipment for enabling stability when performing exercises, such as a chair, frame or table. Specific equipment may be requested for functional task practice and patients are advised to wear comfortable footwear and clothing and have access to water or a suitable drink. Patients participating in talking groups are advised to have a pen and paper for making notes or practicing cognitive exercises. All patients should have a telephone in case of technology issues or adverse events and should wear their pendant alarm if they have one.
NROL exit materials and procedures
On programme completion, patients receive a ‘NROL exit email’ with summary information and resources, which is also sent to the referrer. NROL outcome measures are repeated, and patients also complete a patient satisfaction survey.
Evaluation
Evaluation occurs alongside NROL delivery and includes analysis of service and patient level information. Data (quantitative and qualitative) are sourced from the NROL database, and outcome measures, and patient satisfaction surveys responses, and relevant analysis is undertaken by the NROL leads. Data is summarised and feedback at multiple clinical levels (delivery, organisational, regional) and to academic audiences.
Staff training
Meetings are held to discuss NROL evaluation findings. Shared learning sessions are run to optimise learnings across groups. General NROL information is shared with staff across trusts by NROL staff, including NROL leads and nominated NROL champions, during team and service meetings, and via emails and posts on the NROL hub.
New staff are introduced to NROL during orientation. Staff can observe NROL sessions for experiential learning, particularly when training to become a group facilitator. Staff training and guidance is available as required and provided remotely by NROL leadership, support or NROL therapy staff depending on training need. This includes training from technology support and a ‘NROL staff technology guide’ to upskill staff and improve confidence.
Item 5: Who provided
NROL is provided by therapy staff from stroke and neurorehabilitation teams at partnered NHS Trusts. This is supported by a wider NROL team encompassed within a clinical-academic partnership. NROL uses an existing NHS workforce alongside dedicated NROL roles for the operational and administrative oversight, and technology support.
Leadership
NROL leadership is managed through a clinical-academic partnership team consisting of senior NHS Trust management staff, academic project staff, and a dedicated NROL operational lead.
NROL therapy staff
NROL delivery is provided by NROL therapy staff comprised of existing NHS therapists and therapy assistants, with student involvement. NROL therapy staff represent physiotherapy, occupational therapy, speech and language therapy and psychology disciplines at a range of seniority. Online groups are staffed by a minimum of two group facilitators (therapists and/or therapy assistants).
Support staff
NROL delivery is facilitated by support staff. A dedicated NROL technology support staff member provides technology assistance to patients and therapy staff. A NROL administrator assists with processing referrals and patient correspondence.
Volunteers
Volunteers are previous NROL patients or members of the stroke and neurorehabilitation community who support the running of community groups under guidance from the NROL therapy team.
Item 6: How (mode of delivery)
Mode of delivery overlaps with the materials and procedures (see items 3 and 4). In brief, NROL is a service delivery model providing group-based multidisciplinary rehabilitation as an adjunct to in-person therapy. Sessions and meetings are conducted remotely (MS Teams). NROL is embedded within an existing healthcare system (NHS) and makes use of existing infrastructure (IT hardware and software).
Item 7: Where
For NROL delivery, group facilitators and the NROL technology support staff member attend group sessions from a private, well-lit, quiet workspace. This involves real-time online codelivery from facilitators based at different geographical locations and NHS trusts. A room with adequate space is required for demonstrating exercises in physical groups. Patients take part in NROL groups from their own home (or suitable alternative) and also require a quiet, well-lit, private room that is appropriate to the needs of the group.
Item 8: When and how much
NROL delivery is structured into recurring 6-week ‘NROL’ blocks. Blocks facilitate integration of NROL into the existing service as they account for the need for patient flow.
NROL groups run during the working week (Monday to Friday). A NROL introductory group (Meet and Greet) runs at the start of each block. All further group sessions are scheduled for 60 minutes, with most groups run weekly. The NROL timetable is modified over time according to patient need and staffing capacity. Sessions can be rescheduled due to unforeseen circumstances or bank holidays.
The maximum number of patients within a group is determined by the group facilitators and decided pragmatically to ensure the best experience for patients and staff (see NROL staff manual for more detail). In the event of too few or too many referrals for a group, deferral to the next block or the running additional groups are considered.
Item 9: Tailoring
Tailoring is required at patient, group and block levels.
There is flexibility regarding when NROL is integrated within a patient’s rehabilitation, and at present optimal timing is unknown. Patients joining NROL are referred to appropriate targeted therapy groups and a personalised programme created. Clinical reasoning should determine how NROL fits with a patient’s overall rehabilitation package of care. Patients can attend more than one NROL block if clinically indicated and providing they remain under the active care of their stroke or neurorehabilitation team.
The needs of patients in groups will be nuanced over time requiring a responsive approach. All referrals are screened by group facilitators to ensure session content is tailored for the current needs. NROL delivery should be considerate that language used is appropriate for patients with a variety of neurological diagnoses (sudden, intermittent and progressive conditions) and chronicities.
The structure of blocks, in terms of groups offered and frequency, actively considers patient and workforce availability. The groups provided in each block is a balance between patient demand and staff capacity. Some groups run all blocks, whilst others run intermittently. There is an attempt to minimise groups running over holiday periods. Resourceful use of available workforce is encouraged and the remote nature of NROL enables staff to deliver NROL whilst working when from home or requiring work adjustments. Student involvement can be incorporated to support groups.
Item 10: Modifications
This article describes the NROL innovation developed for regional use. It was modified from a standalone version (20) and expanded from a project implemented at a single NHS trust (14). The core components retained include provision of online real-time neurorehabilitation with technology assistance, incorporating multidisciplinary targeted therapy and community groups whilst embodying peer support. Adaptations for integration within an existing healthcare system included inclusion of stroke and other neurological conditions with varying chronicity, delivering as an adjunct to complement existing rehabilitation, use of existing workforce and being run as recurring 6-week NROL blocks to manage patient flow.
NROL continues to be modified over time. New groups are created to meet patient need or to capitalise on changing staff skill sets. Groups can also be deferred, discontinued or replaced based on patient and staff feedback.
Item 11: How well planned & Item 12: How well delivered (including fidelity)
Communication, resources and technology assistance are provided to optimise NROL entry and participation (See Items 3 & 4). Service data are obtained and reviewed to monitor performance.
A detailed mixed-methods evaluation of NROL within a single trust is available(14). Implementation and evaluation of the regional NROL programme in the North-West of England is ongoing. This multi-trust regional innovation has to date delivered 4 x 6-week NROL blocks, with 1082 patient contacts over 172 sessions provided to the 126 patients referred to NROL. Withdrawal prior to programme start (17%) and drop-out (15%) are reasonably low. The median number of patients participating in a NROL block is 32 (range=29-36). Ten different groups are currently offered across a range of therapies, with typically nine groups running per block. Therapy staffing efficiencies (ratio 0.4) are demonstrated compared to one-to-one delivery (ratio 1.0) and currently over 40 staff across the North-West are involved with group delivery. Overall NROL patient attendance is good (70%), with mechanisms in place to facilitate attendance (e.g., patients receive text/email prompts in the first two weeks of their programme). Attendance to the weekly peer support group (Café NROL) is optional however this opportunity is taken up by many patients (58%). NROL outcome measure evaluation indicates improvements for many patients in health-related quality of life and activity performance over the time of their NROL programme, acknowledging that NROL is only one part of their overall rehabilitation. Overall patient satisfaction is high, with 99% of patients reporting they would recommend NROL to another person.
Context
The NROL innovation detailed in this article is delivered within a context that can be described using the domains of inner and outer settings(25).
The inner setting is defined as the four NHS Trusts that are situated within the Lancashire and South Cumbria Integrated Stroke and Neurorehabilitation Delivery Network that provide community-based stroke and neurorehabilitation care for the region. The region has a population of 1.8 million and covers a large geographical footprint with urban and rural settlements, and ethnic diversity. Deprivation and poor health affect many, with differences in life expectancy and quality of life varying significantly(40). In some neighbourhoods, healthy life expectancy is 46.5 years.
Aligning with national strategies and policies, the Lancashire and South Cumbria region has a vision to work collaboratively to share skills and expertise, data and best practice across Trusts(41). A challenge is that Trusts have varied service remits (stroke, neurological or both) and infrastructure (e.g. physical, staffing levels, technology systems, governance processes).With regards to the outer setting, the impetus for starting NROL was the global pandemic, which also influenced sociocultural values of staff and patients to increase the worthiness and openness to use of remote technology. NROL also aligned with wider policy and strategies(42-44), benefitted from an already established clinical-academic partnership between the NHS and a university, and had funding from an external entity(45).
DISCUSSION
NROL utilises an online delivery platform, with dedicated technology assistance, to provide multidisciplinary real-time group therapy to patients actively receiving community stroke and neurorehabilitation. Telerehabilitation is recognised as having a vital role to play in future healthcare delivery(46) but as yet there are limited details of how to do this(47). To address this need, the TIDieR checklist is used as a structured method to provide a comprehensive description of a regional NROL innovation embedded within a healthcare system. The actual process of completing the TIDieR was time intensive but did provide the impetus for the team to clearly describe NROL, agreeing the core components. Consideration was given to the necessary balance of information to ensure comprehensive detail but attempting not to overwhelm. Further documentation is available as a supplementary file and by contacting the corresponding author. This description details an exemplar of telerehabilitation using NROL delivered in one region, and it is acknowledged that NROL will likely need adapting for other areas given the significant interaction between an innovation and its context. This article should facilitate other healthcare settings to adapt and implement NROL for their context.
Optimal adaptation of an innovation requires an understanding of the core components that cannot be changed versus the adaptable periphery that can be changed(25, 48, 49). The core components of NROL include provision of online real-time neurorehabilitation with technology assistance, incorporating multidisciplinary targeted therapy and community groups whilst embodying peer support. It is proposed that these core components should be consistently implemented for NROL but that the processes to achieve them are adapted to fit local conditions. Examples include the use of MS Teams to deliver groups but other online platforms are available; use of recurring 6-week NROL blocks but other timings may suit other services; the number and types of targeted therapy groups will need to reflect workforce capability and capacity. It is known innovations that have adaptability are more likely to be used in clinical practice(50, 51). Further examination of the adaptive components of NROL will help discern how it can be upscaled for use in a variety of contexts.
Context is everything(52). A limitation of the TIDieR checklist is that it does not include an item on context. Arguably to understand the innovation fully and guide future adaptations an understanding of the context is required. This is because innovations are inextricably linked to the context in which they are delivered, and achieving a good fit between these is important to ensure the innovation works as intended(53). In this article, context is deliberatively reported to help situate the innovation. NROL did take resources, time and effort to implement as a regional initiative and details on the implementation will be reported elsewhere. The need for resources to enable implementation is not unexpected(49, 54, 55) and current healthcare systems are often not set-up to facilitate this upfront effort. Influential contextual factors included leadership buy-in and commitment, a clinical-academic partnership and fit with the local and broader strategic landscape.
Inevitably NROL will continue to evolve. The TIDieR checklist does allow for reporting on modifications and tailoring. To date, the checklist has been primarily used for reporting interventions in trials(56, 57) and there are limited examples of its use for adapted interventions over time. This article documents current NROL delivery and captures its retrospective modifications and tailoring. Going forward, transparent reporting of new iterations of NROL together with descriptions of their context should be undertaken to aid comparisons.
CONCLUSION
A hybrid approach incorporating telerehabilitation, to complement in-person therapy, is required for a future-proof service that follows policy and guidelines. This comprehensive description of a regional NROL innovation gives an example of successful implementation within an existing healthcare system. It provides a platform for others to reduce duplication of effort and help facilitate the use of telerehabilitation in clinical practice. Adapted versions of NROL are expected when implementing in different contexts. Transparent reporting and continuous evaluation alongside NROL implementation are encouraged and will ensure maximal impact for neurorehabilitation delivery.
Data Availability
All data produced in the present study are available upon reasonable request to the authors
Availability of data/ resources
Digital copies of NROL materials are available on request by contacting Professor Louise Connell (laconnell{at}uclan.ac.uk).
Funding
This work was supported by a generous donation from the charity SameYou (Charity number 1170102). The funders had no role in writing the manuscript.
Competing interests
The authors declare that they have no competing interests.
Author contributions
SA and LC conceived the study. All authors (SA, LC, NW, PB, RP) were involved in the planning and conduct of the work described in the paper. SA, LC and NW drafted the initial manuscript. All authors were involved in revising the manuscript. All authors have given final approval of the version to be published and agree to be accountable for all aspects of the work.
Acknowledgements
We would like to express our gratitude to the individuals and services that contribute to NROL, and have contributed to this work, from East Lancashire Hospitals NHS Trust, University Hospitals of Morecambe Bay NHS Foundation Trust, Blackpool Teaching Hospitals NHS Foundation Trust and Lancashire and South Cumbria NHS Foundation Trust. Special thanks go to Ian Grimshaw for providing technological support for patients and staff, as well as supporting administrative and organisational operations. We extend our appreciation to the UCL N-ROL team for their sharing of expertise and experience of online delivery and valuable discussions. Many thanks to the SameYou team for their generous fundraising and support which have made NROL possible.
Footnotes
(sackerley{at}uclan.ac.uk)
(nwilson9{at}uclan.ac.uk)
(pboland2{at}uclan.ac.uk)
(rosemary.peel{at}mbht.nhs.uk
(laconnell{at}uclan.ac.uk)
We have added strengths/ limitations to the abstract, added a PPI statement and included the supplementary file.