CTNMH

1. CTNMH Recovery domains for care planning and everyday practice: Clinicians’ views andservice directionsTerry J. Lewin, Ketrina A. Sly, Agatha M. Conrad, Barry Frost,Megan Turrell, Suzanne Johnston, SadanandRajkumar,Kerry Petrovic, TirupatiSrinivasan

2. “Learning Objectives” (As stated in Abstract) Learning Objective One: Improved understanding of rehabilitation and recovery domains, and variation across service groups in recovery oriented practice. Learning Objective Two: Greater appreciation of potential collaborative client/clinician assessment tools for care planning(e.g., Recovery Star). While generalist and specialist mental health (MH) teams may differentially impact upon the various recovery domains, we need to develop a consistent, balanced, integrated, and consumer-focused approach to care planning across our services – hopefully using complementary measures.

3. Assessment and Evaluation Framework (1) • A consensus is starting to emerge in the Mental Health literature that seeks to strike a better balance between “clinical recovery” (e.g., symptom reduction, relapse prevention, risk management) and “personal recovery” (e.g., promoting social and personal identity, goals, hope, and responsibility) (Slade, 2010). • “… Quantitative approaches are needed to evaluate interventions that support recovery, and to understand the relationship between changes in recovery domains … and clinical domains of outcome” (Slade et al., 2012). • “… More broadly, best available evidence drawn from international guidelines suggests that mental health systems can support recovery in relation to four domains of practice: promoting citizenship, organisational commitment, supporting personally defined recovery and working relationships (Le Boutillier et al. 2011)” (Slade et al., 2012).

4. Assessment and Evaluation Framework (2) • “… Recovery is an individual and dynamic process, and [this review] is not intended to be a rigid definition of what recovery ‘is’, but rather a resource to inform future research and clinical practice … (Slade et al., 2012). • Within the Australian context, preliminary attempts have been made to assess the value of existing recovery measures for routine use in mental health services, both as tools for “monitoring recovery status and change” (by individual consumers), and the “recovery orientation of services” (Burgess et al., 2011); however, gold standard measures are not yet available (Williams et al., 2012).

6. Considerable variability in domains assessed

7. Service users views of outcome measures • Crawford et al. (2011) - Table II. Features of an appropriate outcome measure according to group members. • Should be based on patient rather than staff-rated judgements • Includes ‘positive’ as well as ‘negative’ items • Is comprehensive – neither too long nor too short • Avoids questions that are intrusive about private issues such as sex life • Makes note of the time and place where the outcome is measured • Includes space for ‘added comments’ • Should be used by staff who have good interpersonal skills and have been properly trained in the use of the outcome measure • If self completed, is presented in a professional manner • “Selecting outcome measures in mental health: the views of service users” • Crawford et al. (2011) Journal of Mental Health, 20(4): 336–346

8. Consensus Domains ? • A decade ago, initial attempts were made to develop a comprehensive • ‘consensus cognitive battery (for schizophrenia)’ for assessing cognitive change in clinical trials • - Resulting in the selection of ten existing tests covering seven domains • - Known as the MATRICS Consensus Cognitive Battery (MCCB) • MATRICS domains: • Speed of processing (e.g., trail making, symbol coding, category fluency) • Attention/vigilance • Working memory (verbal and nonverbal) • Verbal learning • Visual learning • Reasoning and problem solving • Social cognition • Green MF, NuechterleinKH, Gold JM, BarchDM, Cohen J, EssockS, Fenton WS, FreseF, Goldberg TE, Heaton RK, Keefe RSE, Kern RS, Kraemer H, Stover E, Weinberger DR, ZalcmanS, MarderSR. Approaching a consensus cognitive battery for clinical trials in schizophrenia: the NIMH-MATRICS conference to select cognitive domains and test criteria. Biological Psychiatry 2004;56:301-307. • Kern RS, NuechterleinKH, Green MF, LaadeLE, Fenton WS, Gold JM, Keefe RSE, Mesholam-GatelyR, MintzJ, SeidmanLJ, Stover E, MarderSR. The MATRICS consensus cognitive battery, part 2: Co-norming and standardization. American Journal of Psychiatry 2008;165:214-220.

9. http://www.researchintorecovery.com/

10. Slade et al. (2012) .“International differences in understanding recovery: systematic review”, Epidemiology and Psychiatric Sciences, 21: 353-364.

11. Conceptual framework coding for recovery conceptualisations – by Country Slade et al. (2012) .“International differences in understanding recovery: systematic review”, Epidemiology and Psychiatric Sciences, 21: 353-364.

12. Conceptual framework Slade et al. (2012) .“International differences in understanding recovery: systematic review”, Epidemiology and Psychiatric Sciences, 21: 353-364.

14. Illustrative recovery goals identified by participants with ‘psychiatric disability’ (N = 144) Conceptualization that includes: multiple domains, individualized processes, stagesof change/recovery. MH Recovery – “Movement towards” well-being and meaning (versus avoidance of symptoms) • Five stage model of psychological recovery based on Andresen et al. (2003) • Seven overarching value domains • (based on the Recovery Goal Taxonomy) Clarke, Oades & Crowe (2012). Psychiatric Rehabilitation Journal, 35:297-304

15. Illustrative recovery goals identified by participants with ‘psychiatric disability’ (N = 144) Conceptualization that includes: multiple domains, individualized processes, stagesof change/recovery. MH Recovery – “Movement towards” well-being and meaning (versus avoidance of symptoms) • Five stage model of psychological recovery based on Andresen et al. (2003) • Seven overarching value domains • (based on the Recovery Goal Taxonomy) Clarke, Oades & Crowe (2012). Psychiatric Rehabilitation Journal, 35:297-304

16. Flexibility: Different goals for different stages of recovery “… Individuals further along in their recovery set significantly more approach goals and types of goals set appear to reflect broader life roles” (p. 297) MH Recovery – “Movement towards” well-being and meaning (versus avoidance of symptoms) Clarke, Oades & Crowe (2012). Psychiatric Rehabilitation Journal, 35:297-304

17. Assessment and Evaluation Framework (3) • In the Hunter region, we have begun to explore the utility of the Mental Health Recovery Star (MacKeith and Burns, 2010), both as a collaborative assessment and recovery planning tool for working with individuals, and as a frameworkfor examining clinicians’ current views and practices. • “The Mental Health Recovery Star was commissioned in the UK by the voluntary sector umbrella body the Mental Health Providers Forum (MHPF). … Considerable user involvement and extensive mental health service user feedback were integral to the development of the tool. … Recovery Star is predicated on an underlying model of a ‘ladder of change’ comprising five stages: being stuck, accepting help, believing, learning and self-reliance.” (Dickens et al., 2012)

19. Sample Ladder

20. Sample Ladder (Detail)

21. Possible ‘higher-order clusters’ within Recovery Star A: Mental/Physical Health B: Activities & Functioning • Managing mental health • Physical health & self-care • Addictive behaviour • Living skills • Work • Responsibilities (Consistent with Factor 2 from Dickens et al. 2012) • Social networks • Relationships • Identity and self-esteem • Trust and hope C: Networks D: Self-image

22. Possible ‘higher-order clusters’ within Recovery Star A: Mental/Physical Health B: Activities & Functioning • Managing mental health • Physical health & self-care • Addictive behaviour • Living skills • Work • Responsibilities (Consistent with Factor 2 from Dickens et al. 2012) • Social networks • Relationships • Identity and self-esteem • Trust and hope C: Networks D: Self-image

23. Possible ‘higher-order clusters’ within Recovery Star A: Mental/Physical Health B: Activities & Functioning • Managing mental health • Physical health & self-care • Addictive behaviour • Living skills • Work • Responsibilities Meaning in life & Empowerment (Consistent with Factor 2 from Dickens et al. 2012) • Social networks • Relationships • Identity and self-esteem • Trust and hope C: Networks D: Self-image Connectedness Hope and Optimism about the future & Identity “RECOVERY PROCESS” (CHIME) – Slade et al. (2012)

24. Recovery Star – Clinical Outcome Tool vs. Collaborative Care Planning • Several Criticisms: • IRR based on staff only ratings; • Collaborative nature of tool not ‘unusual’ or a major limitation; • Poor choice of comparator; • Need different approaches to validation; • Not designed to be an ‘objective outcome measure’ – but a tool for care planning and change.

25. Responsive to change • Two factors: • internal vs. external management/ relationships • (Likely to be highly dependent on nature of sample and timeframes) • “The ‘work’ item proved to be one of the least amenable to change … there may be a need to clarify the item descriptor to allow for a range of interpretations of ‘work’.”

26. Intermediate Stay Mental Health Unit (ISMHU) • 20 bed non-acute inpatient unit located on the James Fletcher Hospital campus in Newcastle • Opened: November, 2010 • Stand alone unit – separated from acute unit by approx. 9 km • Admissions planned and co-ordinated – utilising rehabilitation co-ordinators providing liaison across inpatient and community services • Recovery/rehabilitation focused model of care – program based - approx. 6 week length of stay • Recovery model underpinned by Recovery Star frameworkand associated, locally devised resources and training materials

27. ISMHU Evaluations – Components & Timelines

28. Participant Characteristics (1) Note: 77.2% of participants were female (304/394) Average age = 44.1 years Moderate overlap across phases: At follow-up, only 32% reported baseline participation and 29% were ‘unsure’

29. Participant Characteristics (2)

30. Analysis Strategy • The major analyses focused on overall comparisons between clinicians from different work • locations, whilst statistically controlling for gender and clinical role effects. • Three-step hierarchical regression analyses were used: • Step 1: Gender, Clinical Role (2 contrast coded variables) • Step 2: Survey Phase, Work Location (see below) • Step 3: Phase by Work Location interactions • (To minimise the number of statistical tests) • Three Work Location related planned orthogonal contrasts were examined: • Long Stay Unit clinicians Vs. the Rest; • Acute Inpatient Unit clinicians Vs. Intermediate Stay and Community MH clinicians; and • Intermediate Stay Unit clinicians Vs. Community MH clinicians • Outcome variables: • Importance placed by unit/service on recovery-oriented practice [Follow-up Only] • Importance given to specific recovery domains in care planning • Perceived impact of current treatment practices • Threshold for statistical significance: p < 0.01

31. Recovery-oriented practice Question 12 from Follow-up Survey: “How much importance does your unit/service place on recovery-oriented practice - e.g., encouraging self-determination and self management, strengths-based care, promoting personal goals and aspirations, addressing multiple factors impacting on wellbeing, carer involvement, supporting social inclusion and participation?”

32. Importance placed on recovery-oriented practice High Considerable Moderate Some None Acute < Community MH and ISMHU (p < 0.001)

34. On-line Survey (Zoomerang/Survey Monkey)

35. Importance for Care Planning

36. Importance for Care Planning

37. Importance for Care Planning

38. Importance for Care Planning

40. Comparison with Individual Interventions: p <.01; ** p<.001

42. Interventions • Comprehensive Individualised rehabilitation program (together with a mixture of Group programs) that aim to enhance: • Symptom control • Resilience and coping skills • Living skills • Personal relationships • Community integration • Social inclusion • Programs available across the whole week • Key worker utilises a collaborative goal setting tool (Recovery Star) to assist in the development and implementation of the care plan

43. Intervention Log (using existing Code Sets)

44. Preliminary Recovery Star Outcomes(ISMHU, N = 102) • 82% of consumers showed an improvement on the Recovery Star as a result of an admission to ISMHU. • Of those who had shown an improvement, 61% had made a substantial improvement, and 21% a small improvement. • Less than 1 in 5 showed either no improvement (11%) or a decrease (7%). • The areas of need that showed the largest positive improvements were: Managing Mental Health (76%), Physical Health & Self Care (68%), Identity and Self Esteem (68%), Social Networks (66%), Living Skills (65%), Trust and Hope (65%), and Relationships (61%). • The areas with the least number of consumers making a positive change were: Work (53%), Addictive Behaviour (50%), and Responsibilities(49%) – which correspond with the domains experiencing the least change reported by Dickens et al. (2012).

45. Conclusions - Rehabilitation and Recovery Domains: • There is considerable variabilityin the domains assessed by current ‘recovery-related’ measures. • We need to develop a ‘flexible consensus’ – a small number of broad (upper-level) domains (≤ 6), with a larger set of sub-domains that can adequately represent individualised (or system-level) recovery processes and goals, and different stages of change/recovery. • Existing and proposed qualitative/quantitative measures can then be mapped onto those domains(and sub-domains) – and evaluated(e.g., acceptability, consistency, sensitivity, utility, etc). Measures may vary but the terminology and goals need to be coherent. • Realistic timeframesneed to be set for evaluating the effectiveness of programs – say, a minimum of 3- or 6-monthly assessments over 2 years (e.g., ‘hope’ and ‘identity’ may change relatively slowly).

46. Collaborative Client/Clinician Assessment Tools: • The Recovery Star has been well-received by clients/clinicianswithin our health service and is reflecting improvementsacross the course of an ISMHU admission. • Knowledgeabout its strengths and weaknesses is (slowly) accumulating. • Particularly positive feature– underpins recovery model and interventions in ISMHU. • Needs better integration with electronic records– across inpatient/community settings.

47. Survey findings: • There was reasonable variation within our services in the ‘recovery orientation’ of clinicians – with a greater emphasis on recovery among our non-acute and community based staff. • Not surprisingly, ISMHU affiliated clinicians tended to view all of the identified recovery domains as important for care planning; however, they only differed from Community MH clinicians in the importance attached to Living Skills and Self-Care & Physical Health. • While generalist and specialist teams may differentially impact upon the various recovery domains, we need a consistent, balanced, integrated, and consumer-focused approach to care planningacross our services – so that (at the very least) we are all talking the same language. • Many of the recovery domains associated with the largest differences between clinician sub-groups could be viewed as elements of ‘personal recovery’ (e.g., Work, Social Networks, Identity & Self-esteem, and Trust & Hope) – suggesting that a greater (service-wide) emphasis may also need to be placed on these domains.

48. Survey findings (Continued): CTNMH • The perceived impact of current treatment practices was lowest for the recovery domains of Addictive Behaviours and Work. • Group interventions are perceived as less likely to produce positive changes(than individual interventions) – but not for domains relating to Managing Mental Health and Connectedness (social networks, relationships). • Many clinicians (approx. 50%) also expressed a desire for additional skills training(beyond refresher courses) in providing interventions, particularly in relation to Addictive Behaviours, Trust & Hope, and Identity & Self-esteem. • Thank youfor listening, and to everyone who participated in the Rehabilitation and Recovery Surveys – and to the ISMHU Evaluation Committee/Team. Thank You