1 / 25

Systematic reviews and meta-analyses: when and how to do them

Systematic reviews and meta-analyses: when and how to do them. Andrew Smith Royal Lancaster Infirmary 18 May 2015. Archie Cochrane 1909-88. Cochrane’s challenge.

dungb
Download Presentation

Systematic reviews and meta-analyses: when and how to do them

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Systematic reviews and meta-analyses: when and how to do them Andrew Smith Royal Lancaster Infirmary 18 May 2015

  2. Archie Cochrane 1909-88

  3. Cochrane’s challenge ‘It is surely a great criticism of our profession that we have not organised a critical summary, by specialty or subspecialty, adapted periodically, of all relevant randomised controlled trials’

  4. Traditional reviews and the ‘desk drawer’ problem

  5. Systematic review ‘A review in which evidence on a topic has been systematically identified, appraised and summarised according to predetermined criteria’

  6. Systematic review Decide scope and purpose (PICO) Exhaustive search for material Inclusion on pre-defined criteria Quality assessment of relevant studies Data extraction Synthesis and integration Interpretation

  7. Primary and secondary research • Reviews are retrospective, observational studies and are subject to both systematic and random error • Bias can be reduced by applying the same principles in reviews as primary studies

  8. Primary Recruitment Selection Allocation Detection Attrition Reporting Secondary Selection Publication Language Inclusion Appraisal Interpretation Bias

  9. Funnel plots

  10. Trial quality assessment

  11. Meta-analysis

  12. Meta-analysis

  13. Meta-analysis

  14. Meta-analysis

  15. Meta-analysis

  16. Meta-analysis

  17. Heterogeneity Heterogeneity: variability in estimates of treatment effects between studies in a meta-analysis Significant heterogeneity suggest that trials are not estimating a single common effect – possibly due to differences in patients, setting, intervention and outcomes Can be clinical, methodological or statistical Can be explored by subgroup and sensitivity analyses Meta-regression can also be applied

  18. Common ‘faults’ Too little thought Too many outcomes Too many subgroups ‘Lumping’ vs. ‘splitting’ Scoring risk of bias Not doing anything with quality assessment

  19. Challenges in systematic reviews The RCT itself Anaesthesia/critical care Changing methodology New review types: DTA, non-randomised, prognostic, network meta-analysis False certainty

  20. Trial sequential analysis

  21. Challenges in systematic reviews The RCT itself Anaesthesia/critical care Changing methodology New review types: DTA, non-randomised, prognostic, network meta-analysis False certainty Uncertainty: inconclusive conclusions

  22. The limits to knowledge certain doubtful unknown

  23. When When you’re thinking about a research project When you need practical guidance When you really can’t do any primary research!

  24. How Think first – write a protocol! Use PICO to specify the question Register the review Use ‘risk of bias’ tool for quality Get as many comments as possible Be explicit about process and judgements Be realistic about what can be achieved Use PRISMA tool for reporting

More Related