Evaluating implementation of the IRF in Ayrshire & Arran, Highland, Lothian and Tayside

1. Evaluating implementation of the IRF in Ayrshire & Arran, Highland, Lothian and Tayside IRF Clinical Event June 9, 2010 Presentation by Marian Craig

2. The evaluation team • Roddy Ferguson, Fortuno Consulting • Marian Craig, Falcon Craig Consulting • Dr Andrew Walker, University of Glasgow • Professor Sally Wyke, University of Stirling • Ailsa Stewart, Glasgow School of Social Work • Janet Biggar & Ruth Bryan, George Street Research Integrated Resource Framework Evaluation

3. Opportunities from the evaluation • Formative evaluation • Action research • Lessons for wider application • Set up a database for monitoring impact beyond the lifetime of this evaluation Integrated Resource Framework Evaluation

4. Challenges for the evaluation • Attribution • Timescale for measuring change • Different pace of change in different test sites • Judging when to assess impact • Capturing data on soft indicators Integrated Resource Framework Evaluation

5. The evaluation process • Stage 1 – Clarifying the brief March-April 2010 • Evaluation team and SG Integrated Resourcing Team meet to clarify brief and agree scope • Stage 2 – Context analysis (March – May 2010) • Learn from evidence review • Meet IRF Programme Board – national stakeholders’ views & expectations • Meet IRF Steering groups at each test site – local stakeholder views, local variation in approach, scope, focus Integrated Resource Framework Evaluation

6. The evaluation process • Stage 3 – Framework development (May 2010) • National programme evaluation framework • Four local project evaluation frameworks • Evaluation tools to collect data and information Integrated Resource Framework Evaluation

7. The evaluation process • Stage 4 – Action research (June 2010 – August 2011) • 3 phases: baseline, interim, final • Gather quantitative and qualitative information from partners at each of the test sites • Analyse and report back to test sites and SG at end of each phase Integrated Resource Framework Evaluation

8. The evaluation process • Stage 5 – Reporting (August 2011 – November 2011) • Build databank of evidence throughout the evaluation • Local report for each test site based on baseline, interim and final measurement reports • Feedback seminar in each test site • Final report plus 4-page research summary • Guidance notes on resource integration for: • NHS Boards • Local Authorities • Primary Care Providers • Elected members • Patients, families and carers Integrated Resource Framework Evaluation

9. Some key questions • To what extent are pilots successful in developing capitated, risk-adjusted budgets? • Are those who make resource-use decisions i.e. clinical and care staff, involved in planning and implementing the pilot projects? • Are information systems able to support integrated working? • Is there clear leadership from elected members and Health Board members as well as senior managers? • In the absence of real budgets, do governance arrangements enable investment upstream? • Are processes and systems in place to measure the impact of change in the medium- and long-term? Integrated Resource Framework Evaluation