NHS Evidence Alison Turner Associate Director: Commissioned Content

1. NHS EvidenceAlison TurnerAssociate Director: Commissioned Content 14 July 2009

2. The Darzi report: ‘High quality care for all’stated: • ‘NICE will manage the synthesis and spread of knowledge through NHS Evidence – a new single portal through which anyone will be able to access clinical and non-clinical evidence and best practice, both what high quality care looks like and how to deliver it’

3. Launched on 30th April 2009 NHS Evidence Release 1 is: • A single portal which provides clear and easy access to valuable information to develop new services; treatments; knowledge bases; service models • Built around a powerful search engine – ‘Microsoft FAST’ • Underpinned by a quality based accreditation scheme for multiple content sources • Is open to all – but the public should visit NHS Choices • A developing resource involving health and social care staff in its design and development

4. Informed by user testing Process • Over 25 users selected to represent all target groups • Controlled testing process environment • Testing completed over a total of 6 days during a 3 week period • Involved pre-defined search scenarios as well as user-generated scenarios • Feedback captured on video, audio and written reports • Feedback • Specific comments received about the use of navigators, search ranking and returns • Overall feedback confirms that the design succeeds in communicating our intention to provide a ‘simple search’ service (Google) for health and social care professionals and that the search will provide access to authoritative content. • User testing will be undertaken as a core and ongoing activity.

5. What are the benefits? • Provides easy, fast, free, single access to trusted, high quality comprehensive clinical and non-clinical sources of information • Offers support to healthcare staff in accessing and using best practice • Accredits sources of information, driving up the quality of evidence produced • Contributes to increased quality of care due to high quality evidence • Covers both health and social care • Sorts, sifts and prioritises search results

6. Sorting, sifting and prioritising • Exclusion - only those sources likely to present significantly biased opinions • Sorting, sifting and prioritising - three approaches: • A formal system for accrediting producers of ‘guidance’, to enable the best, most trusted sources to be easily recognisable through an accreditation mark • A process for regularly reviewing new publications across a range of topic areas, to highlight significant new evidence on a monthly and annual basis • An effective approach to searching for information and ranking search returns by relevancy and quality.

7. Transparent and based on standardised criteria and processes Unbiased with oversight by an independent Advisory Board Initially focused on ‘guidelines’ sources of evidence Based on the process used to develop evidence  Sources will be accredited, rather than individual articles NHS Evidence accreditation scheme NHS Evidence Accreditation Scheme Key aim: to identify trusted sources of information and set best practice standards Kitemark will become well-known and recognised

8. Accreditation criteria • Based on AGREE • Assesses six domains of guidance production process: • Scope and purpose • Stakeholder involvement • Rigour of development • Clarity and presentation • Applicability • Editorial independence

9. Next steps for accreditation • Accreditation process manual updated and made available following public consultation • Target of ten guidance producers through the accreditation process by 31 Dec 2009 • First accreditation applications received • First draft accreditation decisions made at Advisory Committee meeting 18 June • Subsequent accreditation decisions at Advisory Committee meetings in September, October and December • Increase number of accreditation applications received • Investigate demand and accreditation methods for other types of content

10. Categories of information in NHS Evidence Clinical Commissioning • Service guidance • Tools & models • Care pathways • Indicators & metrics • Improvement information • Guidelines • Systematic Reviews • Other synthesises content (summaries & overviews) • Primary research and ongoing trials Social care Education & Learning tools • Social care information – assured by SCIE • On-line learning modules Drug & Technologies Public Health • Prescribing & safety information • Technology appraisals • Significant new drugs • Devices, diagnostics & IP guidance • Public Health guidance • Systematic reviews • Primary research

11. To prepare for going live we ingested and allocated 93 sources of content against our six areas of interest Number of sources per area of interest Number of our sources Some sources have been allocated across more than one area of interest Areas of interest

12. We are continually identifying new sources of content based upon user needs • Understand search behaviours and results from currently available sources of content • Web-forms to identify new sources of content • Work with organisations that are sharing content to understand their users and their requirements • Creating user panels with representatives from each area of interest to identify and prioritise proposed sources of content • Understand and share information we already hold within NICE and within our 34 Specialist Collections We are still developing the structures, processes and people we need to support our goals

13. Effective searching • Principle objective - to present the user with the most relevant results on the first page. • Relevancy of the information returned is largely informed by the search engine – produces results as close a match as possible to the user’s requirements. •  Ranking policy – to promote certain records higher within the list of search returns and improve the searching experience.

14. Basic Search on NHS Evidence

15. Sample Search on NHS Evidence

16. Search results

17. Additional health information resourcesvia the dropdown menus Conduct a Specialist Search has a link to Search Specialist Databases HDAS (Healthcare Database advanced search), a link to the Athensauthentication system and to the Specialist collections (formerly known as Specialist Libraries).

18. Access to the 34 Specialist Collections via the conduct a specialist search tab

19. Access to Healthcare Databases Advanced Search via the conduct a specialist search tab

20. Further information via About Us • The About Us drop down menu includes information on: • Selecting Information Sources, • Sources by interest area, • Specialist Collections, Accreditation, • How the search works and a Contact us link

21. Outline road map for 2009/10

22. Release 2 – Key IT deliverables

23. Future Developments :highlighting new publications • Alerts through RSS feeds • Significant new information highlighted by topic experts (Specialist Collections) via: • - Web alerts • - Monthly newsletters, in context • - Annual evidence updates

24. Key functions of NHS Evidence • In summary, NHS Evidence: • Provides comprehensive access to information in health and social care via a web-based portal • Commissions the development and collation of evidence-based information from external agencies • Provides a central purchasing function for content • Provides a formal accreditation scheme • Identifies evidence reflecting best practice • Engages with users and stakeholders to support the use of evidence in decision-making, and to provide feedback to develop the service

25. Contacting NHS Evidence • If you have an enquiry for NHS Evidence you can contact us at contactus@evidence.nhs.uk or ring us on 0845 003 77 44