Implementation strategies used to enhance the implementation of interventions during efficacy and effectiveness studies are rarely reported. Tracking and reporting implementation strategies during these phases has potential to improve future research studies and real-world implementation. We present an exemplar of how this might be executed by specifying and reporting the implementation strategies that were used during a school-based efficacy trial, Project POWER, which tested a trauma-informed prevention program delivered by a university research team, community members, and school staff facilitators in 29 schools. Following the conclusion of the 4-year trial, core Project POWER research team members identified the implementation strategies that supported intervention delivery during the trial using an established taxonomy of school-based implementation strategies. The actors, actions, action targets, temporality, dose, and implementation outcomes were specified using established implementation strategies reporting guidelines. The research team identified 37 implementation strategies that were used during the Project POWER trial. Most strategies fell within the categories of Train and Educate Stakeholders, Use Evaluative and Iterative Strategies, and Develop Stakeholder Interrelationships. Actors included members of the research team and partner schools. Strategies were used multiple times during the preparation and implementation phases. Action targets were most often characteristics of individuals, implementation process, and characteristics of the inner setting. Strategies predominantly targeted the implementation outcomes of fidelity, acceptability, feasibility, and adoption. This study provided evidence that implementation strategies are used and can be identified in efficacy research using a retrospective approach. Identifying and specifying implementation strategies used during the initial phases of the translational research pipeline can inform the implementation strategies that are carried forward, adapted, or discontinued in future trials and routine practice to improve implementation and effectiveness outcomes.

The coronavirus disease 2019 pandemic represents a global crisis that has received extraordinary response from healthcare workers and scientists. One critical but potentially overlooked field in a pandemic is implementation science-the study of methods to reduce the research-to-practice gap. In this Viewpoint, we discuss the important role of implementation science during this and future pandemics and highlight considerations to maximize the utility of implementation research.

Implementation science (IS) has garnered attention within oncology, and most prior IS work has focused on adult, not pediatric, oncology. This narrative review broadly characterizes IS for pediatric oncology. It includes studies through 2020 using the following search terms in PubMed, Ovid Medline, and Cochrane: "implementation science," "pediatric," "childhood," "cancer," and "oncology." Systematic review was not performed due to the limited number of heterogeneous studies. Of 216 articles initially reviewed, nine were selected as specific to IS and pediatric oncology. All nine examined oncologic supportive care, cancer prevention, or cancer control. The supportive care focus is potentially due to the presence of cooperative study groups such as the Children's Oncology Group, which efficiently drive cancer-directed therapy changes through clinical trials. Future IS within pediatric oncology should embrace this ecosystem and focus on cancer control interventions that benefit patients across multiple cancer types and patients treated outside cooperative group studies.

Objectives

Discrepancies, or perceptual distance, between leaders' self-ratings and followers' ratings of the leader are common but usually go unrecognized. Research on discrepancies is limited, but there is evidence that discrepancies are associated with organizational context. This study examined the association of leader-follower discrepancies in Implementation Leadership Scale (ILS) ratings of mental health clinic leaders and the association of those discrepancies with organizational climate for involvement and performance feedback. Both involvement and performance feedback are important for evidence-based practice (EBP) implementation in mental health.

Methods

A total of 593 individuals-supervisors (leaders, N=80) and clinical service providers (followers, N=513)-completed surveys that included ratings of implementation leadership and organizational climate. Polynomial regression and response surface analyses were conducted to examine the associations of discrepancies in leader-follower ILS ratings with organizational involvement climate and performance feedback climate, aspects of climate likely to support EBP implementation.

Results

Both involvement climate and performance feedback climate were highest where leaders rated themselves low on the ILS and their followers rated those leaders high on the ILS ("humble leaders").

Conclusions

Teams with "humble leaders" showed more positive organizational climate for involvement and for performance feedback, contextual factors important during EBP implementation and sustainment. Discrepancy in leader and follower ratings of implementation leadership should be a consideration in understanding and improving leadership and organizational climate for mental health services and for EBP implementation and sustainment in mental health and other allied health settings.

Although often discussed, there is a lack of empirical research on the role of leadership in the management and delivery of health services. The implementation leadership scale (ILS) assesses the degree to which leaders are knowledgeable, proactive, perseverant, and supportive during evidence-based practice (EBP) implementation. The purpose of this study was to examine the psychometric properties of the ILS for leaders' self-ratings using a sample of mental health clinic supervisors (N = 119). Supervisors (i.e., leaders) completed surveys including self-ratings of their implementation leadership. Confirmatory factor analysis, reliability, and validity of the ILS were evaluated. The ILS factor structure was supported in the sample of supervisors. Results demonstrated internal consistency reliability and validity. Cronbach alpha's ranged from 0.92 to 0.96 for the ILS subscales and 0.95 for the ILS overall scale. The factor structure replication and reliability of the ILS in a sample of supervisors demonstrates its applicability with employees across organizational levels.

Background

Parent-mediated early interventions (EI) for children with autism spectrum disorder (ASD) can result in significant improvements in children's cognitive ability, social functioning, behavior, and adaptive skills, as well as improvements in parental self-efficacy and treatment engagement. The common component to efficacious parent-mediated early interventions for ASD is clinician use of parent coaching and occurs when a clinician actively teaches the parent techniques to improve their child's functioning. Available evidence suggests that community-based EI clinicians rarely coach parents when working with families of these children, although specific barriers to coaching are unknown. This consistent finding points to the need to develop strategies to improve the use of parent coaching in community EI programs. The purpose of this community-partnered study is to iteratively develop and pilot test a toolkit of implementation strategies designed to increase EI clinicians' use of parent coaching.

Methods

This study has four related phases. Phase 1: examine how EI clinicians trained in Project ImPACT, an evidence-based parent-mediated intervention, coach parents of children with ASD. Phase 2: identify barriers and facilitators to clinician implementation of parent coaching by administering validated questionnaires to, and conducting semi-structured interviews with, clinicians, parents, and agency leaders. Phase 3: partner with a community advisory board to iteratively develop a toolkit of implementation strategies that addresses identified barriers and capitalizes on facilitators to improve clinician implementation of evidence-based parent coaching. Phase 4: pilot test the feasibility and effectiveness of the implementation strategy toolkit in improving EI clinicians' use of parent coaching with nine EI clinicians and parent-child dyads using a multiple-baseline-across-participants single-case design.

Discussion

Completion of these activities will lead to an in-depth understanding of EI clinicians' implementation of parent coaching in usual practice following training in an evidence-based parent-mediated intervention, barriers to their implementation of parent coaching, a toolkit of implementation strategies developed through an iterative community-partnered process, and preliminary evidence regarding the potential for this toolkit to improve EI clinicians' implementation of parent coaching. These pilot data will offer important direction for a larger evaluation of strategies to improve the use of parent coaching for young children with ASD.

Implementing behavioral health interventions is a complicated process. It has been suggested that implementation strategies should be selected and tailored to address the contextual needs of a given change effort; however, there is limited guidance as to how to do this. This article proposes four methods (concept mapping, group model building, conjoint analysis, and intervention mapping) that could be used to match implementation strategies to identified barriers and facilitators for a particular evidence-based practice or process change being implemented in a given setting. Each method is reviewed, examples of their use are provided, and their strengths and weaknesses are discussed. The discussion includes suggestions for future research pertaining to implementation strategies and highlights these methods' relevance to behavioral health services and research.

Coaching caregivers of young children on the autism spectrum is a critical component of parent-mediated interventions. Little information is available about how providers implement parent coaching for children on the autism spectrum in publicly funded early intervention systems. This study evaluated providers’ use of parent coaching in an early intervention system. Twenty-five early intervention sessions were coded for fidelity to established caregiver coaching techniques. We found low use of coaching techniques overall, with significant variability in use of coaching across providers. When providers did coach caregivers, they used only a few coaching strategies (e.g., collaboration and in vivo feedback). Results indicate that targeted training and implementation strategies focused on individual coaching components, instead of coaching more broadly, may be needed to improve the use of individual coaching strategies. A focus on strengthening the use of collaboration and in vivo feedback may be key to improving coaching fidelity overall.

Background

Although healthcare is delivered in inherently multilevel contexts, implementation science has no widely endorsed methodological standards defining the characteristics of rigorous, multilevel implementation research. We identify and describe eight characteristics of high-quality, multilevel implementation research to encourage discussion, spur debate, and guide decision-making around study design and methodological issues.

Recommendations

Implementation researchers who conduct rigorous multilevel implementation research demonstrate the following eight characteristics. First, they map and operationalize the specific multilevel context for defined populations and settings. Second, they define and state the level of each construct under study. Third, they describe how constructs relate to each other within and across levels. Fourth, they specify the temporal scope of each phenomenon at each relevant level. Fifth, they align measurement choices and construction of analytic variables with the levels of theories selected (and hypotheses generated, if applicable). Sixth, they use a sampling strategy consistent with the selected theories or research objectives and sufficiently large and variable to examine relationships at requisite levels. Seventh, they align analytic approaches with the chosen theories (and hypotheses, if applicable), ensuring that they account for measurement dependencies and nested data structures. Eighth, they ensure inferences are made at the appropriate level. To guide implementation researchers and encourage debate, we present the rationale for each characteristic, actionable recommendations for operationalizing the characteristics in implementation research, a range of examples, and references to make the characteristics more usable. Our recommendations apply to all types of multilevel implementation study designs and approaches, including randomized trials, quantitative and qualitative observational studies, and mixed methods.

Conclusion

These eight characteristics provide benchmarks for evaluating the quality and replicability of multilevel implementation research and promote a common language and reference points. This, in turn, facilitates knowledge generation across diverse multilevel settings and ensures that implementation research is consistent with (and appropriately leverages) what has already been learned in allied multilevel sciences. When a shared and integrated description of what constitutes rigor is defined and broadly communicated, implementation science is better positioned to innovate both methodologically and theoretically.

Cognitive-behavioral therapy (CBT) can improve anxiety and depression in autistic adults, but few autistic adults receive this treatment. We examined factors that may influence clinicians' use of CBT with autistic adults. One hundred clinicians completed an online survey. Clinicians reported stronger intentions (p = .001), more favorable attitudes (p < .001), greater normative pressure (p < .001), and higher self-efficacy (p < .001) to start CBT with non-autistic adults than with autistic adults. The only significant predictor of intentions to begin CBT with clients with anxiety or depression was clinicians' attitudes (p < .001), with more favorable attitudes predicting stronger intentions. These findings are valuable for designing effective, tailored implementation strategies to increase clinicians' adoption of CBT for autistic adults.