Involving the Public in Priority Setting A case study in NHS Dumfries and Galloway

1. Involving the Public in Priority SettingA case study in NHS Dumfries and Galloway Verity Watson1 Andrew Carnon2 Mandy Ryan1 Derek Cox2 1 Health Economics Research Unit, University of Aberdeen 2 Directorate of Public Health and Strategic Planning, NHS Dumfries and Galloway

2. Structure Introduction to priority setting Overview of priority-setting process in NHS Dumfries & Galloway How discrete choice experiments can be used in priority setting Applying the discrete choice experiment in NHS Dumfries & Galloway How successful was the priority-setting process?

3. How Do We Decide?

4. Introduction Options for health care are constrained by limited funding Choices imply priorities To make priorities explicit requires a priority- setting framework Options appraisal: identified projects are scored based on pre-defined criteria the relative importance of criteria are defined by weights Weights can lack transparency and accountability

5. Portsmouth Scorecard (Sandwell modification)

6. Priority-Setting Principles in NHS Dumfries & Galloway Focus on Delivering for Health Transparency and rigour of process Public involvement Acute services CHP/Long term conditions Annual event Learning process

7. Priority-Setting Criteria Ten Criteria were chosen based on Delivering for Health Location of care Public consultation while developing project Use of latest technology Service availability Patient involvement in own care Management of care Evidence of clinical effectiveness Health gain Risk avoidance Priority area

8. NHS Dumfries & Galloway Programmes Acute Services Cancer CHD/Stroke/Diabetes Child Health Corporate Healthcare-Acquired Infection Learning Disabilities Local Health Partnership/Primary Care Long Term Conditions Mental Health Older People Public Health

9. Process in NHS Dumfries & Galloway Public involvement event 12 programme leads to submit bids Panel to take overview Bids scored on weighted criteria Ranked list of bids produced (Health Intelligence Unit) Corporate Management Team decisions

10. Public involvement event:Discrete Choice Experiment

11. Applying DCEs to Priority Setting To investigate the relative importance of criteria to public in Dumfries and Galloway Attributes are the 10 priority setting criteria Describe the criteria by a number of levels Define all possible combinations of attributes and levels Create choice sets Ask respondents to choose between different hypothetical health services for Dumfries and Galloway.

12. Attributes and Levels Location of care at home at GP at Local Health Partnership at D&G Royal Infirmary outside D&G Public involvement no consultation consultation at final stage consultation at some but not all stages consultation at all stages

13. Attributes and Levels Use of Technology does not use latest technology uses latest technology uses cutting edge technology Service availability office hours only office hours and outside office hours Patient involvement in own care decision by health professional patient shares decision

14. Attributes and Levels Management of care group of health professionals not working as a team an individual health professional group of health professionals working as team Evidence of clinical effectiveness no evidence number of clinical studies at least one RCT at least three RCTs Health Gain small gain to a small number large gain to a small number large gain to a large number

15. Attributes and Levels Risk avoidance low risk to lower than low risk medium risk to low risk medium risk to lower than low risk high risk to medium risk high risk to low risk high risk to lower than low risk Priority area none local priority national priority local and national priority

16. Experimental design 207,360 possible combinations (51x61x43x33x22) Used experimental design techniques and reduce to 64 profiles. These were paired with a mirror image (foldover method) Ensured orthogonality, minimum overlap and level balance Respondents were presented with the choice of two health services and asked to choose their most preferred.

17. Example choice

18. Sample and Setting

19. Sample and Setting

20. Age of Sample and Dumfries & Galloway Population

21. Rurality of Sample and Dumfries & Galloway Population

22. Deprivation of Sample and Dumfries & Galloway Population

23. Analysis

24. Applying DCEs to Priority Setting

25. Applying DCEs to Priority Setting

26. How were the Discrete Choice Experiment results used?

27. Example: Community/Voluntary Sector Health & Wellbeing Database

28. Weighted Bid Scores

29. Programme Bid Scores

30. Top and Bottom Bids Top Scoring Bids DGH capital developments Additional consultant in elderly medicine Expand anaesthetic services Rapid access chest pain service Community/voluntary sector health and wellbeing database Extra IT training staff Bottom Scoring Bids Set up neurology/genetic clinic Increase paediatric clinics Orthoptic vision screening Expand school nursing Appoint NHS Board business continuity manager Provide extra secretarial input for paediatric consultants

31. Outputs of Priority-Setting Process Good spread of weighted bid scores Public involvement, transparency and accountability intrinsic to process Uncertain whether Delivering for Health principles fully reflected in weights (acute services and CHP/ long term conditions) Some anomalies (e.g. school nursing, IT training) Bid scores used as central aid to decision making, along with other factors (directives, risk, available finance)

32. How Successful was the Priority-Setting Process? Limitations Sample size Complex concepts for public Cost of exercise Decision making still difficult Benefits Planned approach to decision making Public response positive Transparency and defensibility Workable process

33. Organisational Priority-setting Decisions