Establishing the Effectiveness of Enhanced Implementation Methods in Preventative Behavioral Health

Background: More than 20 million Americans ages 12 and older have a past-year substance use disorder. Majority-minority cities, including Flint, MI, suffer disproportionately from higher rates of substance use and are less likely to have access to evidence-based prevention and treatment interventions relative to predominately White and wealthier cities. Thus, identifying approaches that can improve implementation of evidence-based substance use practices is a critical public health goal. In the current report, we provide a detailed protocol for the implementation and evaluation of the Strengthening Flint Families initiative, a community-based implementation study of a multi-level behavioral health intervention that includes peer recovery coaching, the Strengthening Families Program, and a multimedia campaign. Our goal is to improve family resilience and reduce behavioral health disparities in the Flint community, as an example of how this could be done in other communities. Our overall strategy includes community-informed implementation enhancements to increase adoption and sustainment of evidence-based behavioral health services. Methods: This project has 4 phases that align with study aims- 1) a systematic assessment of behavioral health organizations in the Flint Area to understand organizational needs and strengths in Flint; 2) tailoring implementation strategies for one individual-level evidence-based practice, peer recovery coaching, and one family-level evidence-based program, the Strengthening Families Program; 3) building capacity and promoting sustainability; and 4) evaluating primary (implementation) and secondary (effectiveness) outcomes. Implementation outcomes are derived from the RE-AIM framework and effectiveness outcomes will be assessed at the individual, family, and community levels. Discussion: Understanding and addressing the behavioral health organizational needs, strengths, and barriers to program adoption and referral in Flint offers great promise to strengthen the behavioral health network of providers serving Flint residents. Moreover, understanding barriers to accessing and implementing behavioral health services in low-resource communities may prove to be a valuable tool for discovering the most effective implementation methods tailored to specific organizations. These evidence informed approaches may prove useful for cities outside of Flint.

outcomes are derived from the RE-AIM framework and effectiveness outcomes will be assessed at the individual, family, and community levels.
Discussion: Understanding and addressing the behavioral health organizational needs, strengths, and barriers to program adoption and referral in Flint offers great promise to strengthen the behavioral health network of providers serving Flint residents. Moreover, understanding barriers to accessing and implementing behavioral health services in low-resource communities may prove to be a valuable tool for discovering the most effective implementation methods tailored to specific organizations. These evidence informed approaches may prove useful for cities outside of Flint.
Keywords: Community-based, behavioral health, sustainability, adaptation, children and families, substance use, peer recovery, low-income, implementation, health disparities

Contributions to the literature
More research is needed on how best to improve community capacity for substance use services, especially in low-income communities This study will examine implementation strategies for improving community adoption and sustainment of a multilevel suite of substance use interventions Study findings will contribute to improved community-wide implementation of evidence-based behavioral health services and increased access to and participation in these services in lowresource communities . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint The copyright holder for this this version posted September 27, 2020. . https://doi.org/10.1101/2020.09.25.20200444 doi: medRxiv preprint

Background
In the United States, over 20 million Americans ages 12 and older (7.5% of the population) are classified as having a substance use disorder (SUD) in the past year (Substance Abuse and Mental Health Services Administration, 2017a). Poor, primarily minority cities, including Flint, Michigan, often face substance use problems that exceed the national average. In 2013, more than 15% of Flint residents participating in a community-wide survey on health reported that they or a family member used or were addicted to drugs in the past 2 years (Speak To Your Health, 2014). More recent local data have been collected but have not been made available to the public. Other indicators of substance use problems, such as opioid overdose death, have shown steady increases since 2013 (e.g., Sadler and Furr-Holden, 2019). Though substance use disorders are common, recurrent, and associated with excess morbidity and mortality, they are treatable, and people can and do recover. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint The copyright holder for this this version posted September 27, 2020. . https://doi.org/10.1101/2020.09.25.20200444 doi: medRxiv preprint implementation of evidence-based services (Romero et al., 2017).
To improve program uptake at the individual, organizational, and community-level it is important to understand and address the barriers to accessing and implementing evidence-based services while ensuring they are implemented with fidelity (Kilbourne et al., 2013). More research is needed to investigate these barriers, understand why they exist, and how they can be reduced to improve the utilization and implementation of evidence-based services. More specifically, while evidence-based services exist in Flint, Michigan, overdose deaths and substance misuse and abuse among Flint residents continue to increase (Sadler and Furr-Holden, 2019). The goal of the current project is to examine whether community-informed implementation strategies increase adoption, utilization, and sustainment of a multilevel suite of evidence-based substance use interventions. Improving the utilization and implementation of existing evidence-based services in Flint is hypothesized to reduce substance misuse and abuse rates.

Methods / Design
Strengthening Flint Families (SFF) is a multi-level intervention designed to reduce behavioral health disparities and improve family resilience. SFF is a project of the Flint Center for Health Equity Solutions (FCHES) (Ellington et al., 2020). The Center has entered into a number of formal partnerships with organizations and citizens of Flint directly affected by, or helping to alleviate, substance use disorders in the community. SFF has also partnered with a local community-serving organization for this initiative. Our community partner organization, Flint Odyssey House, has decades of experience with substance use treatment and prevention in Flint. These collaborative efforts will explore and work to reduce barriers to the utilization and implementation of behavioral health evidence-based services in Flint, Michigan. Partnering with . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint The copyright holder for this this version posted September 27, 2020. . https://doi.org/10.1101/2020.09.25.20200444 doi: medRxiv preprint this organization and many others in Flint is an important part of Community-Based Participatory Research (CBPR) methods and principles (Israel et al., 2008). Green et al. defined CBPR as an "inquiry with the participation of those affected by an issue for the purpose of education and action for effecting change" (Green et al., 1995). This initiative has partnered with multiple community organizations, including behavioral health providers, the local health coalition, and governmental agencies on the design, execution, and evaluation of the initiative.
SFF includes the implementation of three effective behavioral health interventions to reduce behavioral health disparities and improve family resilience in the Flint Community. These interventions operate at the individual, family, and community levels, and together, are an excellent fit for the needs of economically distressed, minority-majority cities such as Flint. The interventions include; at the individual-level, Peer Recovery Coaches (PRCs); at the familylevel, the Strengthening Families Program (SFP); and at the community-level: a multi-media campaign. While the SFP and PRC services are currently offered in Flint, this implementation research seeks to expand the reach and accessibility of these services as well as work to reduce barriers to access and successful community-wide implementation.

Interventions
PRCs are certified professionals with lived experience of recovery and often work in substance use treatment centers. These recovery professionals provide a unique mentorship experience by helping to enroll community members in substance use treatment, supporting individuals during treatment, and assisting them as they step down levels of care (e.g., intensive outpatient to outpatient), transition out of treatment, or work to maintain their recovery. PRCs work one-on-one with clients in various settings throughout their recovery process. Development plans are created to guide the process and reach milestones along the way (Substance Abuse and . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. Following dinner, the youth and parents/caregivers meet separately to focus on youth well-being and parenting skills, respectively. Each session ends with a family session to review and practice the skills from the session. Finally, at the community-level, a substance misuse prevention multi-media campaign will be developed and tailored specifically for Flint residents. The campaign will focus on messaging to reduce the stigma of recovery help-seeking and advertise the availability of services. The multi-media campaign will include a combination of modalities including social media (e.g., Facebook, Twitter, and Instagram), print media (e.g., bench advertisements in key neighborhoods), and radio content. The use of mass media to advertise service availability has been effective in promoting sustained behavior change across six different behavior domains, including addictive behaviors (Robinson et al., 2014).
. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint The copyright holder for this this version posted September 27, 2020. . https://doi.org/10.1101/2020.09.25.20200444 doi: medRxiv preprint Flint highlights the importance of an implementation-focused study (Bernet et al., 2013) and creating a self-sustaining public health program in this community.

Aims of Strengthening Flint Families
This multi-level implementation study will primarily evaluate the ability of communityinformed implementation strategies to promote reach, effectiveness, adoption, implementation, and maintenance of evidence-based individual, family, and community-level substance use interventions. Secondarily, we will monitor the effectiveness of these programs in low-income communities using the tailored implementation strategies. All study components were reviewed and approved by the Michigan State University Institutional Review Board (IRB# x17-1370e; STUDY00002533; STUDY00002661). Additionally, we will obtain consent from all involved participants before collecting implementation data. In the implementation phase, organizations will receive community-informed implementation support focusing on intervention participants (e.g., providing transportation) and/or focusing on organizations (e.g., cultural competency training) based on information gathered in the exploration phase of the project and developed and tailored in the preparation phase. The overarching goal of SFF is to reduce behavioral health disparities and improve family resilience in the Flint Community.
The RE-AIM model will be used to guide the implementation evaluation. Designed to evaluate public health interventions, RE-AIM focuses on the assessment of five dimensions (i.e., Reach, Effectiveness, Adoption, Implementation, Maintenance); these dimensions will be assessed at the multiple levels of our research initiative (i.e. individual, family, and community) . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint The copyright holder for this this version posted September 27, 2020. . https://doi.org/10.1101/2020.09.25.20200444 doi: medRxiv preprint

Aim 1: Create a network of organizations that taps into the natural strengths of the community and is committed to Strengthening Flint Families
To accomplish our first goal of strengthening connections between existing organizations to effectively leverage existing services in the Flint Community, we first sought to better understand the services currently offered within the community. Second, we connected individual service providers to form a network of organizations serving the behavioral health needs of the Flint community. We accomplished these goals by: 1) identifying existing behavioral health organizations and conducting key informant interviews to validate the listings, and identify non-licensed providers and other potential stakeholders; 2) conducting organizational assessments to identify what existing behavioral health prevention, treatment and recovery services are available; and 3) creating formal networking opportunities to align and streamline these existing resources.

Identifying Organizations for Inclusion
The preparation phase began by identifying organizations in Flint with a stake in behavioral health. The Michigan Department of Licensing and Regulatory Affairs Bureau of Health Systems' License Listing Report contains all behavioral health sites licensed to provide direct services (including inpatient and outpatient drug treatment programs, mental health centers, etc.) within Genesee County that provide some type of behavioral health service.
Seventeen of these sites are within the City of Flint and were identified as potential sites. One of these sites, Flint Odyssey House, was already represented as the community partner for this research project. In addition to licensed behavioral health providers, many community organizations, coalitions, and other grass-roots organizations facilitate behavioral health and health equity work in Flint. The Flint Neighborhoods United and The Flint Water Recovery . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. All organizations were considered as potential contributors of a synergistic community network of adopters, hosts, and referrers. These categories are not mutually exclusive. Adopters are organizations that will be able to directly deliver SFF services. These organizations will host, staff, and provide PRCs and/or SFP sessions to the population they serve. Hosts are organizations that have the physical space and accessibility requirements, but do not have the ability to directly deliver (i.e., adopt) the program due to a lack of staff or appropriate credentials. Referrers (e.g., Parole and Probation, WIC, etc.) are organizations within the community that regularly interact with the focus population and provide resources and/or assistance programs. Using this framework, we assessed the interests and capacities of each organization to determine how they could best operate within this network. . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint The copyright holder for this this version posted September 27, 2020. . https://doi.org/10.1101/2020.09.25.20200444 doi: medRxiv preprint To best understand the needs of the community and to inform the development of implementation strategies, we will use data collected from key informant interviews and organization assessments.

Key Informant Interviews
Key informant interviews were conducted with 9 community stakeholders identified by FCHES members and the project leadership team representing different aspects of the community that are crucial to the success of the SFF initiative. Community experts in behavioral health treatment and prevention programs, family and youth programs, and the faith community were all represented. The semi-structured interviews included questions about barriers that individuals, families, and organizations face when engaging with treatment or prevention programs, and other local knowledge that could affect participation or community engagement.
Feedback on the list of potential sites was also requested, especially for organizations in that expert's field.

Organizational Assessments
The research team developed organizational assessments to assess each organization's interest in collaborating, to learn relevant information about each organization, and to identify potential organizational collaborators. These assessments also doubled as opportunities to generate enthusiasm around this behavioral health initiative. The research team contacted each site, identified through the process described in the above section, and administered the assessment to a mid-to-high level organization leader. The ideal organization leader would have direct experience with that organization's day-to-day activities while also having enough authority to make decisions about the initiatives of their organization or unit within a larger organization. At the end of the assessment, each organization leader was asked if they knew of . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint The copyright holder for this this version posted September 27, 2020. . https://doi.org/10.1101/2020.09.25.20200444 doi: medRxiv preprint any other organizations in the Flint area that they thought would be interested in the SFP or PRC. These suggestions were recorded by the research team and added to the list of potential organizations if they met the criteria of the original list. This was done to ensure that no organizations were left out of this initiative.

Aim 3: Build capacity and promote sustainability.
An objective of our implementation protocol is to increase connections between existing organizations and services and formally develop the SFF network. The network is designed to increase the number of referrals between organizations, the appropriateness of referrals to services, reduce program overlap, and support navigations of referrals to actual services. All organizations who participated in the organization assessment will be provided with referral information and encouraged to refer individuals and families to the SFP or PRC services.
Additionally, we will offer continuing education programming and other networking opportunities for PRCs. Networking and programming opportunities will be available throughout the implementation period and will allow for both formal and informal opportunities to interact with other providers and organizations serving the Flint community. Second, we will work with a local non-profit agency, the Greater Flint Health Coalition, to expand their existing electronic referral system, a clearinghouse of behavioral and physical health care providers in the Flint community. We will use the results of the key informant interviews and organizational assessments to identify agencies that can be added to the referral system, and will promote the system among existing providers during our networking events, in order to increase interconnections between agencies.
In the implementation phase, behavioral health organizations, churches, schools, and other community organizations will be identified as adopters, hosts, and referrers based on the . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review) preprint
The copyright holder for this this version posted September 27, 2020. . https://doi.org/10.1101/2020.09.25.20200444 doi: medRxiv preprint organizational assessments, and will be invited to enroll in a synergistic community network.
This strategy was identified to improve the reach and sustainability of SFF. Reach will increase as a result of the availability of multiple host and/or adopter sites located in different areas of the city, placing programs closer to community members to reduce the burden and increase access Adopter sites are also encouraged to have a strong connection to the community to generate a sustainable referral base, which will be strengthened by the SFF network. These few adopter sites can then offer programming at one of the many host sites, therefore optimizing sustainability and reach in a scalable fashion.
In the implementation phase, all organizations adopting or hosting SFP or PRCs will receive community-informed implementation support focusing on intervention participants (e.g., providing transportation) and/or focusing on organizations (e.g., cultural competency training) based on information gathered in the key informant interviews and continued evaluation of the success of these strategies. The recommended strategies will reflect the barriers that their specific population and/or organization faces.

Implementation Outcomes
. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity.

(which was not certified by peer review) preprint
The copyright holder for this this version posted September 27, 2020. . https://doi.org/10.1101/2020.09.25.20200444 doi: medRxiv preprint Multiple sources of data will be used to synthesize our findings within the RE-AIM framework and describe the cumulative impact of this community-partnered effort to promote behavioral health. Reach, or the proportion of the eligible population that participates in the intervention (Glasgow et al., 2019), will be assessed by documenting the number of eligible participants, the number/percent of those eligible consenting to participate and the percent of participants retained during the study period. Described in greater detail below, we will examine effectiveness of the SFP 10-14 by examining changes in program participants pre-and postintervention, as well as community-level changes in substance use and associated problems.
Adoption refers to the representativeness of settings in which the intervention takes place (Glasgow et al., 2019). We will assess facilitators of, and barriers to, adoption through interviews with program staff and administrators. Willingness of organizations to participate (whether adopting, hosting, or referring) in the SFF framework will be evaluated as a measure of adoption at the organization level. Within organizations, staff will be surveyed on their willingness to participate in the programs. Unique themes will be identified in an inductive manner through iterative stages. Narrative text will be reviewed independently by two researchers to identify themes and sub-themes focused on facilitators of, and barriers to, adoption. Emergent themes will be logged, defined, and sample text illustrating the theme will be noted. Using constant comparative technique, themes will be repeatedly reviewed to determine the need to expand or merge thematic codes. The analysis will be conducted manually. The researchers will compare findings and, if needed, achieve consensus through discussion. Surveys of organization staff on their willingness to use the programs, at the beginning and end of program funding, will be analyzed using a paired samples t-test.
. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. completion of curriculum activities, engagement of youth and parents, and external factors that may affect participation. Acceptability will be assessed with standard SFP brief program evaluation/satisfaction surveys at the end of each cohort. Attendance data, session logs, and program evaluation/satisfaction data will be de-identified and electronically transferred to the research team at the end of each SFP series.
Peer recovery coaching activities are highly individualized based on the needs of the client. PRCs develop a plan with their client that aligns with domains important to recovery (e.g., employment) and traditional measures of fidelity are not applicable to this model of service delivery. Instead, acceptability and feasibility will be determined using focus groups with PRCs that focus on their experiences implementing recovery coaching in the Flint population.
Specifically, PRCs will be asked to report the barriers that they have encountered when working with individuals in recovery, with a specific focus on how feasible it is to deliver services using this model and how they perceive clients' engagement in their services. We will transcribe the recordings from the PRC focus group to use as qualitative data. All de-identified information . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint The copyright holder for this this version posted September 27, 2020. . https://doi.org/10.1101/2020.09.25.20200444 doi: medRxiv preprint will be removed from the transcripts. Common themes will be identified from the focus group.
The themes will be utilized to guide our work in building a strong network of local PRCs and connecting PRCs to community-serving organizations.
Maintenance describes the degree to which an intervention becomes an integral part of an institutional structure (Glasgow et al., 2019). Evaluation and feedback are critical components of the sustainability, or maintenance, phase of evidence-based practices (Schoenwald et al., 2011).
We will document how many of the participating organizations (adoption sites) implement the program in the year following the completion of implementation. We will also measure the maintenance of our referral network by analyzing data on referrals over time.

Effectiveness Outcomes
Although the primary goal of this study is to assess implementation, a secondary goal is to assess and monitor the effectiveness of the programs (i.e., the SFP, and the multi-media campaign).
For the family-level SFP intervention, we will obtain pre-post survey data using the standard SFP surveys (available through the Evidence-Based Prevention & Intervention Support Center, http://epis.psu.edu/ebp/strengthening/outcomemeasurementtools) from parents and youth upon entry into the program and upon completion of the 7-week intervention from the organizations.
The survey focuses on assessing the outcomes of family functioning and communication. Data will be de-identified and electronically transferred to the research team for analysis. For analysis, we will link participant pre-post test data to their family, cohort, facilitator, and organization.
Paired T tests will be conducted to evaluate differences in outcomes before and after the program. We will also analyze the data to evaluate any possible differential effects by the various grouping variables (e.g. organization, family, cohort, or facilitators).
. CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint The copyright holder for this this version posted September 27, 2020. . https://doi.org/10.1101/2020.09.25.20200444 doi: medRxiv preprint Community-level effectiveness outcomes of this project include substance use and substance use treatment data. Substance use data will be obtained through a community-wide survey of Flint residents called the Speak to Your Health Survey. The Speak to Your Health Survey is a biennial survey of Flint residents that began in 2003 to monitor the individual and communitylevel impacts of public health initiatives. Substance use treatment data will be obtained from insurance data from the Genesee Health Plan. Additionally, we will track how organizations are prompted to generate a family referral to the SFP to better understand the best mechanisms for promoting referrals to the program, and the program itself. We will also track social media analytics to assess the level of engagement our social media pages have with the community.

Discussion
Previous studies have documented the need for supplementing effectiveness research with research designs that specifically examine the effect of different implementation conditions on the reach, effectiveness, adoption, implementation and sustainment of interventions (Chaudoir, Dugan, & Barr, 2013). We expect that the evidence produced as a result of this work will contribute towards a better understanding of the importance of purposeful and systematic plans to facilitate reach, successful adoption and better sustainment of behavioral health programs in cities with high levels of inequity. Furthermore, we expect to learn a great deal about the relative effectiveness of different implementation strategies in low-resource settings.

Consent for publication
This manuscript contains no data from individuals for publication.

Competing interests
The authors declare that they have no competing interests. . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. . CC-BY 4.0 International license It is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) preprint The copyright holder for this this version posted September 27, 2020. . https://doi.org/10.1101/2020.09.25.20200444 doi: medRxiv preprint