separating snake oil from penicillin how to determine which treatments really work
Download
Skip this Video
Download Presentation
Separating Snake Oil from Penicillin: How to Determine Which Treatments Really Work

Loading in 2 Seconds...

play fullscreen
1 / 25

Separating Snake Oil from Penicillin: How to Determine Which Treatments Really Work - PowerPoint PPT Presentation


  • 334 Views
  • Uploaded on

Separating Snake Oil from Penicillin: How to Determine Which Treatments Really Work. Douglas W. Woods, Ph.D. University of Wisconsin-Milwaukee May 1, 2009. Snake Oil. a derogatory term for compounds offered as medicines which imply they are fake, fraudulent, or ineffective.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Separating Snake Oil from Penicillin: How to Determine Which Treatments Really Work' - KeelyKia


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
separating snake oil from penicillin how to determine which treatments really work

Separating Snake Oil from Penicillin: How to Determine Which Treatments Really Work

Douglas W. Woods, Ph.D.

University of Wisconsin-Milwaukee

May 1, 2009

snake oil
Snake Oil
  • a derogatory term for compounds offered as medicines which imply they are fake, fraudulent, or ineffective.
  • also applied to any product with exaggerated marketing but questionable or unverifiable quality.
why did people buy snake oil
Why Did People Buy Snake Oil?
  • Very few physicians available to treat illnesses
  • Very few effective treatments were available for many illnesses
  • Claims and claimers were convincing
  • People were desperate for relief
penicillin
Penicillin
  • Metaphorical term to describe treatments that are effective in treating a particular disorder/disease
  • Only applies to those treatments who have been subjected to the rigors of scientific inquiry
why do people buy penicillin
Why Do People Buy Penicillin?
  • It works
  • We know what we’re paying for
  • Because it’s researched, we can predict how likely it is to work for us
  • We can understand how safe it is
if penicillin exists why is there still a market for snake oil
If Penicillin Exists, Why Is There Still a Market for Snake Oil?
  • For certain illnesses, there are very few knowledgeable treatment providers
  • For certain illnesses, there are very few effective treatments
  • Claims and claimers are convincing
  • People are desperate for relief
  • Sound familiar?
how can we tell the difference
How Can We Tell the Difference?
  • Understand the Levels of Evidence
    • Snake Oils and Penicillins have various levels of evidence to support their claims
    • The higher the level of evidence, the more confident you can be in the claims made
  • Understand how penicillins are tested and why.
  • Read the literature
    • Scientific Journal articles are subject to review by independent scientists
    • Stuff on the web is not subject to independent review
levels of evidence
Levels of Evidence
  • “Worked for me!”
  • Claims are based on theory, and theory alone
  • Claims are based on data, but data are of poor quality and/or from a few isolated cases
  • Claims are based on good data with a lot of cases, but are uncontrolled
  • Claims are based on results of a randomized controlled trial (RCT).
  • Claims are based on RCT, and treatment works for reasons developers think it works
works for me
“Works for Me”
  • Friends, family members, chatroom members, or providers tell you they have a treatment that works….but they don’t have data
  • Treatment may be effective, but we don’t really know
  • A number of possible explanations exist for why the effect happened
  • Claims about effectiveness of treatment are premature
based on theory and theory alone
Based on Theory…and Theory Alone
  • Claims are only as good as the theory they’re based on
  • In the absence of controlled studies,

bad theory = bad claims

  • Even with bad theory, a treatment may still work, but then becomes ripe for abuse
  • Facilitated Communication
based on bad data or a few cases
Based on Bad Data or a Few Cases
  • Claims are only as good as the data you collect
  • Types of Data
    • Subjective questions (How are you doing?)
    • Objective questions (MGH-HS)
    • Direct Observation (measuring bald spots)
    • Blinded evaluation
  • Problem with a Few Cases
    • These may be the only 2 cases in the world for whom the treatment had an effect
good data lots of cases but uncontrolled
What is “controlled”

When scientists try to rule out other explanations for an effect, they “control for” these explanations

What else could explain why someone got better?

Time

Resolution of other issues

Change in the environment/world events

Having attention paid to you

Placebo effect

Etc.

Open label trials

These will often show up in medical journals

Again, doesn’t mean the treatment is ineffective

Good data, lots of cases, but uncontrolled
open trial
Open trial

Measure Subjects Symptoms After Treatment

Subjects Receive Treatment

Measure Subjects Symptoms Before Treatment

randomized controlled trial
Randomized Controlled Trial
  • RCTs attempt to control other explanations for effects
  • Used to compare 2 or more conditions
  • Randomized
  • Control groups
    • Wait-list
    • Placebo
    • Other established treatment
  • Double-blind
  • RCTs tell you if a treatment works, and if it is that treatment causing the change
slide18
RCT

Person who did the assessment of progress does not know which treatment the person received

Random Assignment

ACT/HRT N=12Completed 10 sessions in 12 wks

All do 2nd Assess

N=25

1st Assess

Wait-List N=13No Contact for 12 wks

MGH-HSPulling CountsNIMH-CIRAAQPAI-AnxietyPAI-DepressionTEI-SF*Tx Compliance*Tx Utilization*

*ACT/HRT only

MGH-HSPulling CountsNIMH-CIRAAQPAI-AnxietyPAI-DepressionSCIDWASI

treatment works and it works for why we think it works
Treatment works, and it works for why we think it works
  • Penicillin works, and it works because it breaks down bacterial cell walls
  • CBT works for depression.
    • We used to think it worked because it changed your negative thoughts
    • Not sure that’s true anymore
  • If it works, and is proven by RCT, who cares?
    • Proprietary issue (think generic drug vs. brand name drug)
    • EMDR example…
what do snake oil salesmen emphasize
What Do Snake Oil Salesmen Emphasize?
  • “Worked for me!”
    • Advertisers or promoters with testimonials and flashy websites in the absence of data
  • Claims based on theory and theory alone
    • Scientific or logical sounding
    • Resistance to challenging or testing the theory
  • Claims are based on data, but data are of poor quality and/or from a few isolated cases
    • Claims go beyond data
    • Resistance to complete testing of the treatment, or claims that testing the treatment isn’t possible
how to find penicillin
How to Find Penicillin
  • Claims are based on good data with a lot of cases, but are uncontrolled
    • Usually the starting point to figure out if something is really going to be penicillin
    • Not an end point
  • RCT results
are snake oil salesmen charlatans
Are Snake Oil Salesmen Charlatans?
  • People promote treatments for a variety of reasons
    • Profit
    • They really want to help people with a disorder
    • They were trained a certain way, and don’t know of other treatment options
    • The treatment may actually work but hasn’t been studied adequately enough to be considered penicillin
what about ttm treatments
What about TTM Treatments
  • “Works for Me” & Theory Alone
    • Diet
    • “No Trichs Trigger”
    • Energy therapies
    • Acupuncture
    • Etc.
  • Poor data or few cases
    • Hypnosis
    • Awareness enhancement devices
    • Bupropion
    • Risperidone
    • Quentiapine
    • Inositol
    • Haloperidol
    • Paroxetine
    • Aversion (shock) therapy
    • Child-centered play therapy
what about ttm part 2
What About TTM-Part 2
  • Uncontrolled larger studies
    • Escitalopram
    • Topiramate
    • Olanzapine
    • Hydroxyzine
    • Venlaxafine
    • Citalopram
  • RCTs
    • Clomipramine*
    • Sertraline*
    • Habit reversal
    • Acceptance-enhanced Behavior Therapy
  • RCTs with support for mechanisms of change
    • Preliminary for Acceptance-enhanced Behavior Therapy
ad