A Case-Oriented Approach to Understanding Predictors of Prevention Program Sustainment

1. A Case-Oriented Approach to Understanding Predictors of Prevention Program Sustainment Brittany Rhoades Cooper Angie Funaiole Louise Parker Laura Hill

2. A Case Oriented Approach to Sustainment

3. Predictors of Sustainment Consolidated Framework for Implementation Research (CFIR) Program Sustainability Assessment Tool (PSAT) Damschroder et al., 2009 Schell et al., 2013

4. Study Context Strengthening Families Program for Parents & Youth 10-14 in Washington State WSU Extension & partners have: -Trained over 800 SFP 10-14 facilitators -Implemented more than 500 7-week programs -Reaching over 10,000 parents & youth

5. Study Methods Uses a mixed-method, case-oriented approach to understand predictors of SFP 10-14 sustainment in WA communities.

6. Study Design We used a simultaneous QUANT + qual design to examine convergence and complementarity. QUANT qual Program Sustainability Assessment Tool (PSAT) & self-reported sustainment N = 59 Qualitative Comparative Analysis RESULTS Semi-structured interviews with subset of sites. N = 9 Deductive coding & matrix analysis of low, medium & high sustainment sites.

7. Participants & Programs 89% female 77% White, 16% Hispanic 79% had Bachelor’s degree or higher 48% had 6+ years educator experience

8. Interview Coding* Deductive Coding for CFIR & PSAT Constructs Interview Topics Professional background Program operations Implementation history Sustainability factors Purposively sampled 9 cases based on survey data (current & predicted sustainment) N=3 Low Sustainment Medium Sustainment High Sustainment N=4 All 4 coders came to consensus on codes for 2 transcripts  finalized coding manual N=2 Pair 1 came to consensus on 3 transcripts Pair 2 came to consensus on 6 transcripts Reviewed all transcripts & assigned valence codes to each construct for each site. Conducted qualitative matrix analysis to identify predictors of SFP 10-14 sustainment. *Modeled after Damschroder & Lowery (2013)

9. Valence Coding* *Modeled after Damschroder & Lowery (2013)

10. “I think Strengthening Families program has excellent parenting skills and the youth component is really fun for the kids.” “It’s just really challenging and because of the cost. I think if it were cheaper, not that it can’t be but it’s significant, and when you go to a funder and say, ‘….your grant, this really can provide 10% of what we need.’ They want to see what else, it’s a challenge.”

11. “We could start Strengthening Families tomorrow…he [organization’s director] would say great, I’m glad you’re doing it again.” “You’ll have that coordinator piece, because you can get staff to come in, but to coordinate, get everything together that you need, you need that one person to really solidify the program. I think that’s key to making it really go.”

12. “…the new principal she was on board with it excited about it so was the vice principal.” “As soon as the funding kind of dropped and the collaboration about that, then it just was kind of on our own to do. I think it definitely could be more successful, but without some other players at the table it’s kind of all on us right now to continue it.”

13. Conclusions There was both convergence and complementarity regarding the predictors of SFP 10-14 sustainment. qual QUANT • QCA analyses • Environmental Support • Especially in combination with Organizational Capacity RESULTS • Positive: Environmental Support; Organizational Capacity; Partnerships • Negative: Intervention Cost • Positive beliefs about the program are not enough

14. Thank you! Questions?Brittany.cooper@wsu.edu

15. Modified from: http://www.cfirguide.org/tools.html Codebook Example

16. Sustainment Level Over half reported sustained, routinized program delivery. 57% 18% n = 49 (Pluye, Potvin, Denis, & Pelletier, 2004) 2% 22%

17. Program Sustainability Capacity & Sustainment Level Bivariate Correlations n = 38-43