1 / 28

Getting Started with Service Evaluation

This workshop will help you appreciate the benefits of service evaluation, get started with planning a service evaluation, and understand where to find and how to use the toolkit.

rowles
Download Presentation

Getting Started with Service Evaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Getting Started with Service Evaluation [Insert Name of Speaker 1] [Insert Job Title] [Insert Organisation] [Insert Name of Speaker 2] [Insert Job Title] [Insert Organisation]

  2. This workshop will help you to…. Appreciate the benefits of service evaluation Get started with planning a service evaluation Understand where to find and how to use the toolkit

  3. What is Evaluation?

  4. Evaluation Definitions “A study in which data collectionmethodsare used in a systematic way to judge the quality orvalueof a service or intervention, providing evidence that can be used to improve it” (West of England Evaluation Strategy Groups, 2013)

  5. Evidence Data Evaluation Research evidence User feedback

  6. Why might you do an evaluation?

  7. National Drivers “We need to evaluate new care models to establish which produce the best experience for patients and the best value for money”. NHS Five Year Forward View, 2014 Simon Stevens Chief Executive NHS England Ref: http://www.england.nhs.uk/wp-content/uploads/2014/10/5yfv-web.pdf “The provider must continually review and evaluate the Services, must implement Lessons Learned from those reviews and evaluations”…..[…]…”and must demonstrate at Review Meetings the extent to which Service improvements have been made as a result”. NHS Standard Contract Service Conditions, 2015-2016, page 7

  8. Why is evaluation important?

  9. Benefits of evaluation • A way of learning what works, why and how …and why things don’t work • Leads to change and improvement • Enhances quality – safety, effectiveness and experience • Shows accountability and organisational learning • Contributes to the evidence base

  10. “Can one afford not to do a proper evaluation?” HM Treasury (2011) The Magenta Book, Guidance for Evaluation

  11. www.nhsevaluationtoolkit.net

  12. Step 1: Identify and understand • Identify, engage and involve your stakeholders

  13. Understand your service Driver Diagram Process Mapping Logic Modelling or developing a Theory of Change

  14. Step 2: Assess • This stage is about assessing whether an evaluation is needed • Is the purpose clear? • Is it feasible? Will it be useful? • Do benefits outweigh costs/risks? • Is it the right time? • Will your work be an evaluation or research?

  15. Step 3: Plan • This stage is about developing a plan for your evaluation and this involves: • clear Purpose – who is your audience? • setting your aims and objectives • identifying the right approach and data requirements • identifying resources • addressing ethics and governance issues

  16. What should I consider when planning an evaluation?

  17. Quick break

  18. Activity: Setting your Aims andObjectives

  19. Taster exercise: Setting aims and objectives • Discuss the aim & 2-3 objectives for an evaluation of a new staff room in the workplace (Handout) • Remember SMART • Specific • Measurable • Achievable • Relevant • Time bound • Setting your aims and objectives • Aim = overall statement of what the evaluation will do • Objective = specific statements about what the evaluation will try to achieve in order to meet the overall aim

  20. Step 4: Do It is now time to … • Collect the right data using the best methods

  21. Activity: Tasting Game

  22. Different types of data • What information (data) do I need to help me to answer my evaluations aims and objectives? • What information do I already have? Secondary data • What are the gaps and what information (data) do I need to collect to fill them? Primary data • What has happened before and where are we now? Baseline data • What can we compare with? Control / comparator / benchmarking • How big or small? How many people? Sample size • Are there any tools that can help me? Validated tools

  23. Aim: To evaluate the impact of a new staff room on staff stress levels and staff absence Objectives: • To measure staff absence rates before and after the new staff room • To measure usage of the new staff room (numbers of staff, duration of stay) • To measure staff stress levels before and after the new staff room is open • To measure staff satisfaction and understand their experience of using the staff room

  24. Activity: Data Collection • Working in small groups for one of the objectives you have developed • Identify the types of data you need to be able to answer your objective

  25. Step 5: Review and Act • To make sure your evaluation has an impact you need to: • Review: clearly interpret and present your findings • Share: communicate to your intended audience(s) • Act: use your findings to inform your decision making

  26. http://www.nhsevaluationtoolkit.net It's a brilliant website, very informative and easy to use. It's been a lifesaver…!

  27. Now What? • 2-hr workshops on your premises • CLAHRC West courses (free of charge) • Evaluation Online Network – sign up sheet • Contact your GP Clinical Evidence Fellow(s) • Local Acute Trust R&D team/office

  28. Thank You. These slides were developed by CLAHRC West.

More Related