Update on Evidence Based Practice March 13th, 2009 Lacey, WA Sponsored by:

1. Update on Evidence Based Practice March 13th, 2009 Lacey, WA Sponsored by: University of Washington Division of Public Behavioral Health and Justice Policy Evidence Based Practice Institute (EBPI) and Washington State Department of Social and Health Services (DSHS)

2. Establishing a Context

3. The Estimated Effect on Criminal Recidivism for Different Types of Programs for Youth and Juvenile Offenders The number in each bar is the "effect size" for each program, which approximates a percentage change in recidivism rates. The length of each bar are 95% confidence intervals. Type of Program, and the Number (N) of studies in the Summary -12% Early Childhood Education for Disadvantaged Youth (N = 6) -13% Seattle Social Development Project (N = 1) -31% Quantum Opportunities Program (N = 1) -14% Children At Risk Program (N = 1) -4% Mentoring (N = 2) National Job Corps (N = 1) -8% 10% Job Training Partnership Act (N = 1) Diversion with Services (vs. Regular Court) (N = 13) -5% -2% Diversion-Release, no Services (vs. Regular Court) (N = 7) -1% Diversion with Services (vs. Release without Services) (N = 9) -31% Multi-Systemic Therapy (N = 3) -25% Functional Family Therapy (N = 7) -18% Aggression Replacement Training (N = 4) -37% Multidimensional Treatment Foster Care (N = 2) -27% Adolescent Diversion Project (N = 5) Juvenile Intensive Probation (N = 7) -5% Intensive Probation (as alternative to incarceration) (N = 6) 0% Juvenile Intensive Parole Supervision (N = 7) -4% Coordinated Services (N = 4) -14% Scared Straight Type Programs (N = 8) 13% Other Family-Based Therapy Approaches (N = 6) -17% -15% Structured Restitution for Juvenile Offenders (N = 6) Juvenile Sex Offender Treatment (N = 5) -12% Juvenile Boot Camps (N = 10) 10% Source: Meta-analysis conducted by the -80% -60% -40% -20% 0% 20% 40% Washington State Institute for Public Policy Lower Recidivism Higher Recidivism

4. Economic Estimates From National Research For Adult & Juvenile Justice and Prevention Programs Prevention Programs Drug Courts Ther. Commun. w/Aftercare In-Prison Non Res.Drug TX Adult Offender Programs Sex Off. Prog, Cog. Beh.. Intensive Super, no TX Int Super, w/TX Adult Basic Ed. Vocational Ed. Intensive Super. Probation Functional Family Therapy MultiSystemic Therapy Aggression Replacemnt Trng Juvenile Offender Programs Coordinated Services Scared Straight Programs Intensive Super. Parole Treatment Foster Care Boot Camps Nurse Home Visitation Early Childhood Education Seattle Soc. Devlp. Project Quantum Opportunities Job Training Part. Act Mentoring -$20,000 $0 $20,000 $40,000 $60,000 $80,000 $100,000 Net Loss Net Gain Per Person in Program Break-Even Point

6. Evidence-Based Treatment

7. What is Evidence-Based Treatment? Interventions for which there is consistent scientific evidence indicating that they improve clinical outcomes.

8. Status of Mental Health System and Evidence-Based Treatments • President’s Commission reports public mental health system is “in a shamble” (President’s new Freedom Commission Report, 2004) • 90% of public mental health services do not deliver treatments programs or services that have empirical support (Elliot, 1999; Henggeler et al., 2003)

9. Use of EBTs: Strength of the Evidence • More than 1500 published clinical trials on outcomes of psychotherapies for youth • 6 meta-analyses of their effects • More than 300 published clinical trials on efficacy of psychotropic medications • Approximately 50 field trials of community-based services • Dozens of preventive intervention trials (34 effective interventions cited by Greenberg et al, 1999)

10. Characteristics of EBTs used with Children & Families • Focus on the development of skills, not on catharsis or insight • Active engagement and empowerment of family or caregiver in a culturally competent manner • Utilization of manuals emphasizing adherence and fidelity

11. Characteristics of EBTs used with Children & Families • Consistent supervision of clinicians • Homework or out-of-session work • Focus on problems and solutions, rather than changing personality

12. Use of EBTs: Disconnect between “Science” and “Service” • 80% of programs reviewed for inclusion in the Blueprints for Violence Prevention programs had no evaluation (Elliot, 1999) • 95% of school-based mental health programs reviewed had no evaluation (Rones & Hoagwood, 2000) • The most popular and widely-implemented programs have no evidence behind them, and some do harm (Elliot, 1999; Weisz, et al., 1995; 2001)

13. Implementation Challenges: Clinical • Clinicians must change familiar practices • Traditional mental health settings place a high value on clinician creativity and intuition. • Clinicians often spend much time in therapy “putting out fires”: not much time for a systematic approach • Tension around manualized treatment • Manualized interventions may be viewed as overly simplified, “cookie-cutter” • Intensive feedback, quality improvement loop • Rigorous supervision; ongoing training • Often challenging to provide adequate support

14. Implementation Challenges: Systemic • Inter-system ‘ownership’ of program/service • Identifying and selecting EBTs within a context of a community planning process • Changing administrative processes • Shift to outcomes-based system of care • Developing data base & evaluation capacity • Students not being trained in EBTs • Provider salaries do not support staff retention

15. Implementation Challenges: Financial • Often takes new ‘bridge’ funding up front to finance start up • Very difficult to alter funding patterns that are long established • Mechanics of reimbursement and limitations of fee for service • EBP implementation may be in conflict with traditional productivity approaches

16. Why is Evidence Based Treatment often not implemented or implemented inadequately?

17. Barriers to the Implementation of EBT • Clinical trials are often not generalize-able to the “real world” • Participants in research trials are often carefully selected, and are often screened out if they have multiple problems • Research Clinicians work exclusively with one population and one intervention • Treatment is typically manualized and closely supervised • All materials that are needed for an intervention are not always available

18. Barriers to the Implementation of EBT • Clinicians often work with individuals who vary widely in age, ethnicity, culture, acuity, and presenting problem(s) • Can not be experts on best practice for all diagnoses, all ages • Clinicians working with children must address the treatment needs of the parents and other family members, as well as the children.

19. Barriers to Implementation of EBT • High cost of initial training, too few resources, too little supervision • Clinicians often spend much time in therapy “putting out fires”—not much time for a systematic approach to intervention • Poor dissemination—clinicians may not have access to research literature or time to review it.

20. Barriers to Implementation of EBT • Traditional mental health settings place a high value on clinician creativity and intuition. • Manualized interventions may be viewed as overly simplified, “cookie-cutter” approaches that are dehumanizing to the client and stifling to the therapist.

21. Given these barriers, how can evidence-based treatments be implemented in “real world” settings?

22. Percent of All Children Served Receiving Mental Health Services in FY04 NOTES a Includes all persons served by the Children’s Administration in FY 2004 who were age 0 to 18 as of January 1 2004. b Includes all persons served by the Juvenile Rehabilitation Administration in FY 2004 (not restricted to age 0-18). c Includes all persons served by JRA in FY 2004 with a JRA-identified mental health need (not restricted to age 0-18). d Includes all persons served by HRSA Medical Assistance in FY 2004 who were age 0 to 18 as of January 1 2004. e Includes mental health medications and outpatient services provided through Healthy Options and fee-for-service coverage. Compiled from Department of Social and Health Services’ data by Mental Health Division, Children’s Administration, Juvenile Rehabilitation Administration, and Research and Data Analysis Division staff.

23. Medication and MH TOTAL= 40,526 Children on psychiatric medication 56% received NO outpatient mental health care* 22,498 children 44% received outpatient mental health care 18,028 children Drug classes include: Antidepressant Antipsychotic Antianxiety Antimania ADHD (FY ’04)

24. Developing an Evidence-Based Culture • Washington State committed to promoting a more wide-spread culture supporting EBT’s • SB 5763 (2005) requires RSNs to develop criteria for implementing EBTs. • HB 1088 (2007) requires the access-to-care standards and the benefits packages for children's mental health services be revised, and that the system of care be based on defined elements and evaluated on outcome-based performance measures. • HB 1373 (2009) will improve mental health outcomes for children and the families who care for them by allowing early access to care before problems become too difficult and expensive to treat. • SB 5141 (2009) proposes funding of a pilot program to increase parental participation in evidence-based programs by providing incentives for parents already involved in rehabilitation of their children. • HR 2 State Children’s Health Insurance Program Reauthorization Act of 2009 (SCHIP) • Children’s Mental Health Initiative established a matrix of EBTs for use with youth with behavioral health disorders. • Braam Oversight Panel recommends implementing best practices for youth in the foster care system. • 2006 legislative proviso provided support for pilot implementation of EBTs in children’s mental health and child welfare. • MacArthur Models for Change Program • Reinvesting in Youth • Robert Wood Johnson Reclaiming Futures

25. House Bill 1088 Legislative Goals by 2012 for Children’s Mental Health • A continuum of services from early identification, intervention, and prevention through crisis intervention and inpatient treatment • Equity in access to services for similarly situated children • Developmentally appropriate, high quality, and culturally competent services available statewide • Treatment of each child in the context of his/her family and other person that are a source of support and stability in her/her life

26. House Bill 1088 Legislative Goals by 2012 for Children’s Mental Health, Cont’d • A sufficient supply of qualified and culturally competent children’s mental health providers • Use of developmentally appropriate evidence-based and research-based practices • Integrated and flexible services to meet the needs of children who are at risk of out-of-home placement or involved with multiple child-serving systems

28. Evidence-Based Practice Institute • Sustained training and consultation • Implementation of PfS model • Community empowerment and education • Monitor outcomes and quality assurance • State resource through continuous synthesis of vast information-base

29. Building strong collaborations Increasing community capacity Improving youth outcomes UW PBHJP, Nursing, Social Work, CHMC Sustained training and consultation in MH and Primary Care State resource Monitor outcomes and quality assurance Community empowerment and education Implementation of PfS model Youth receiving appropriate EBP services

30. Evidence-Based Practice Institute • Responsibilities and Goals • Review and summarize current law • Review current practices that actively engage parents • Continue successful implementation of PfS • Develop literature and information sessions for families • Identify outcome-based performance measures

31. Evidence-Based Practice Institute • Responsibilities and Goals, cont’d • Serve as a statewide resource on children’s mental health practices • Implement Wraparound Pilot • Implement Primary Care Pilot

32. Improve Medication Management and care coordination • Develop and implement policies to improve prescribing practices • Improve quality of children’s mental health therapy • Improve communication and care coordination btw primary care and mental health providers • Prioritize care in the family home • Identify children with emotional/behavioral disturbances who may be at high risk due to a variety of reasons • Review and evaluate appropriateness of psychotropic medications given to children under 5 years of age • Track prescriptive practices with goal of reducing use of psychotropic medication

33. Convene a representative group of regional support networks, community mental health centers, and managed care health systems to: • Establish mechanisms and develop contract language that ensures increased coordination of and access to Medicaid mental health benefits available to children and families • Define performance standards that track access to and utilization of services • Set standards for reducing the number of children prescribed antipsychotic drugs and receive no outpatient mental health services with their medication • Submit report on progress and findings to legislature by January 1, 2009

34. Facilitating Medicaid Eligibility • When youth are released from confinement, their medical assistance coverage will be fully reinstated on the day of their release • The department shall establish procedures for coordination between department field offices, JRA institutions, and county juvenile courts that result in prompt reinstatement of eligibility for youth who are likely to be eligible for medical assistance services upon release • The department shall adopt standardized statewide screening and application practices and forms designed to facilitate the application of a confined youth who is likely to be eligible for a medical assistance program

35. Develop revised children’s mental health benefit package • Strong consideration given to: • Developmentally appropriate evidence-based and research-based practices • Family-based interventions • The use of natural and peer support • Community support services • Review of other states’ efforts • Recommend revisions to legislature by January 1, 2009

36. Healthy Options • Expansion from 12 to 20 visits for a child per year for both managed care plans and fee for service plans • Expansion in providers to licensed mental health professionals

37. Performance Measures • Decreased emergency room utilization • Decreased psychiatric hospitalization • Decreased out-of-home placement • Decreased involvement with juvenile justice system • Improved school attendance and performance • Reduced used of medication • Reduced symptomatology

38. Develop recommended revisions to the access to care standards for children.

39. RECOMMENDATIONS • #1: Address limits to access to services posed by current Access to Care Standards (ACS) • #2: Adopt the STI Mental Health Benefits Design report recommendation to shift utilization management from front end restrictions to proactive care management of the most intensive and costly services • #3: Increase access to services for youth and families not covered by Medicaid or insurance

40. RECOMMENDATIONS, Cont’d • #4: Support provider organizations to increase youth and family access to & engagement in services • #5: Increase access to child psychiatrists by expanding the Partnership Access Line (PAL), a primary care consultation program, statewide

41. RECOMMENDATIONS, Cont’d • #6: Implement EBPs that align with stakeholder priorities and systematically engage families in treatment, including: • Intensive models for youth at risk of/transitioning from out-of-home placement : • Multidimensional Treatment Foster Care (MTFC) • Family Integrated Transitions (FIT) • Functional Family Therapy (FFT) • Multisystemic Therapy (MST) • Project MATCH

42. RECOMMENDATIONS, Cont’d • #7: Implement EBPs that align with stakeholder priorities and systematically engage families in treatment, including: • Evidence based models for youth exposed to past trauma, such as • Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT)

43. RECOMMENDATIONS, Cont’d • #8: Implement EBPs that align with stakeholder priorities and systematically engage families in treatment, including: • Evidence-based models for youth with co-occurring mental health and substance abuse disorders • Multisystemic Therapy (MST) • Family Integrated Transitions (FIT) • Multidimensional Family Therapy (MDFT)

44. RECOMMENDATIONS, Cont’d • #9: Implement evidence based models that target early signs of behavioral problems & assist parents in working with oppositional and defiant behaviors: • Parent-Child Interaction Therapy (PCIT) • Positive Parenting Program (Triple-P) • The Incredible Years

45. RECOMMENDATIONS, Cont’d • #10: Implement prevention & early intervention programs with evidence for effectiveness that align with stakeholder priorities, such as: • Nurse-Family Partnership • Positive Parenting Program (Triple-P) • School-based prevention programs with evidence for effectiveness (e.g., Good Behavior Game, School Development Project)

46. RECOMMENDATIONS, Cont’d • #11a: Build infrastructure to support EBP implementation: • Support community and tribal decision-making & oversight of EBP implementation, using models we know work (Partnerships for Success) • #11b: Build infrastructure to support EBP implementation: • Ensure that reimbursement processes align with EBP implementation

47. Future Directions Now is the time! • Expansion of Evidence-Based Practice • Strong stakeholder commitments • Cross System Collaboration

48. Important Websites • PBHJP: http://depts.washington.edu/pbhjp • EBPI: http://depts.washington.edu/ebpi • PAL: http://palforkids.org • Primary Care Principles for CMH: http://palforkids.org/docs/Care_Principles_081508.pdf

49. Eric W. Trupin, Ph.D. Professor & Vice Chairman University of Washington School of Medicine Department of Psychiatry & Behavioral Sciences Director, Division Public Behavioral Health & Justice Policy 2815 Eastlake Avenue East, Suite 200 Seattle, WA 98102 Ph: 206-685-2085; Fx: 206-685-3430