1.14k likes | 1.46k Views
Research Design & EBM. Ravi Kant MS, DNB, FAMS, FRCS (Edin), FRCS (Glasg), FRCS (Engl.), FRCS (Irel.), FACS, FICS, FAIS Professor of Surgery. Science. Intelligent Hypothesis Experiments & analysis of results prove that hypothesis is correct. Replicable universally= Most Important.
E N D
Research Design &EBM Ravi Kant MS, DNB, FAMS, FRCS (Edin), FRCS (Glasg), FRCS (Engl.), FRCS (Irel.), FACS, FICS, FAIS Professor of Surgery
Science • Intelligent Hypothesis • Experiments & analysis of results prove that hypothesis is correct. • Replicable universally= Most Important
Evidence based medicine: what it is and what it isn't • Integrating individual clinical expertise and the best external evidence • BMJ 1996;312:71-72 (13 January) • Editorial
Evidence-based health care? • = best evidence
Evidence-based health care? • decision-making
Observational study • Evaluating results of condition or treatment in a defined population
Retrospective: analyzing past events
Prospective: • collecting data contemporaneously
Case-control • Series of patients with a particular disease or condition contrasted with matched control patients
Cross-sectional Measurements mode on a single occasion, not looking at whole population but selecting small similar group & expanding results
Longitudinal • Measurements are taken over a period of time, not looking at whole population but selecting small similar group & expanding results
Experimental • Two or more treatments are compared. Allocation to treatment groups is under the control of the researcher
Randomized • Two randomly allocated treatments
Prospective Randomized controlled Includes control group with no treatment = GOLD STANDARD
Confidence Interval • To p or not to p
RR • Relative Risk
Systemic Review • reliable • systematic • predefined, explicit methodology • minimize bias • Systemic review+ Statistics= meta-analysis
Systemic Review • = ?
Levels of evidence • 1= Meta-analyses of Prospective Double blind randomized controlled trials • 2=Prospective Randomized Controlled study/ Meta-analyses of retrospective studies • 3= Case series/ Cohort study • 4= Case report/ observational • 5= Expert opinion
Evidence grade: I • I (High): the described effect is plausible, precisely quantified and not vulnerable to bias
Evidence grade: I • II (Intermediate): the described effect is plausible but is not quantified precisely or may be vulnerable to bias
Evidence grade : III • III (Low): concerns about plausibility or vulnerability to bias severely limit the value of the effect being described and quantified
Strength of recommendation Definition A • A=Recommendation based on consistent and good quality patient-oriented evidence
Strength of recommendation Definition B • B=Recommendation based on inconsistent or limited quality patient-oriented evidence
Strength of recommendation Definition C • C=Recommendation based on consensus, usual practice, opinion, disease-oriented evidence or case series for studies of diagnosis, treatment, prevention, or screening.
Recommendation grade: A • A (Recommendation): there is robust evidence to recommend a pattern of care
Recommendation grade : B • B (Provisional recommendation): on balance of evidence, a pattern of care is recommended with caution
Recommendation grade : C • C (Consensus opinion): evidence being inadequate, a pattern of care is recommended by consensus
US Government Agency for Health Care Policy and Research (AHCPR):A • A: requires at least one randomized controlled trial as part of the body of evidence.
US Government Agency for Health Care Policy and Research (AHCPR):B • B: requires availability of well-conducted clinical studies but no randomized controlled trials in the body of evidence.
US Government Agency for Health Care Policy and Research (AHCPR):C • C: requires evidence from expert committee reports or opinions and/ or clinical experience of respected authorities. Indicates absence of directly applicable studies of good quality
Grading of evidence • Ia: Systematic review or meta-analysis of randomized controlled trials • Ib: at least one randomized controlled trial • IIa: at least one well-designed controlled study without randomization • IIb: at least one well-designed quasi-experimental study, such as a cohort study • III: well-designed non-experimental descriptive studies, such as comparative studies, correlation studies, case–control studies and case series • IV: expert committee reports, opinions and/or clinical experience of respected authorities
Grading of recommendations • A: based on hierarchy I evidence • B: based on hierarchy II evidence or extrapolated from hierarchy I evidence • C: based on hierarchy III evidence or extrapolated from hierarchy I or II evidence • D: directly based on hierarchy IV evidence or extrapolated from hierarchy I, II or III evidence
Research can be Quantitative: A medical condition is analyzed systematically using hard, objective end point such as death or amputation.
Research can be Qualitative Data come from patient narratives, and the psychosocial impact of the disease and its treatment are analyzed, for example narratives of breast cancer.
Project design include: Sample size. Eliminating bias. Study protocol. Ethics.
Sample size An incorrect sample size is probably the most frequent reason for research to be invalid. Never forget that more patients will need to be randomized than the final sample size to take into account patients who die, drop out or are lost to follow up.
Sample size • nX[r(100-r)+s(100-s)]/(r-s)2
Type I error • Benefit is perceived when really there is none (false positive)
Type II error • Benefit is missed because the study has small numbers (false negative)
Eliminating bias: Single blind The observers or recorders who do not know which treatment has been used.
Eliminating bias: Double blind Neither patient nor researcher is aware of which therapy has been used until after study has finished, & these are the best randomized studies.
The Cochrane Collaboration • Best evidence • an international not-for-profit and independent organization, • It produces and disseminates systematic reviews of healthcare interventions and promotes the search for evidence in the form of clinical trials and other studies of interventions. • The Cochrane Collaboration was founded in 1993 and named after the British epidemiologist, Archie Cochrane.
Current reliable evidence-based medicine resources for the busy clinician -1 • American College of Physicians Journal Club http://www.acpj.org • American Family Physician http://www.aafp.org/afp • Bandolier http://www.rj2.ox.ac.uk/bandolie • Clinical Evidence http://www.clinicalevidence.com