1 / 25

An Area of the Dwelling: Cause and Effect in Research Designs

An Area of the Dwelling: Cause and Effect in Research Designs. Michael Hendryx, PhD Department of Community Medicine West Virginia University. Knowing Cause and Effect. Experimental design Non-experimental Quasi-experimental Natural experiments. Experiments.

hu-williams
Download Presentation

An Area of the Dwelling: Cause and Effect in Research Designs

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. An Area of the Dwelling: Cause and Effect in Research Designs Michael Hendryx, PhD Department of Community Medicine West Virginia University

  2. Knowing Cause and Effect • Experimental design • Non-experimental • Quasi-experimental • Natural experiments

  3. Experiments • Well-suited to studying causal relationships • Control of the setting and variables to know that: • Cause precedes effect • Cause is related to effect • No other plausible explanations for the effect

  4. Limits of Experiments • Can’t address non-manipulable causes • (sex, age, environmental toxins) • Including some issues of great importance • Sacrifice external for internal validity

  5. Non-experiments • May be observational or correlational • Many non-experimental studies are seriously flawed • Correlation versus causation • Lack of control or comparison group

  6. Quasi-Experiments • An experiment in which units are not assigned to conditions randomly • To “approach the dwelling” • Accumulation of evidence that rules out alternatives, i.e., “no other plausible explanation.” • Not only accumulation of facts, but logic and reason and (dare I say) verifiable intuition • Can approach convincing knowledge of matters of importance when experiments are impossible

  7. Quasi-Experiments • Self-selection; no random assignment • But cause, or treatment, can still be manipulated • Dependent measures may be controllable • So: • Cause precedes effect? (Yes) • Cause is related to effect? (Maybe) • No other plausible explanations for the effect? (More difficult to establish)

  8. Examples of non-random assignment • Smoking prevention program in some schools and not others • Medicaid enrollees self-select for new program

  9. One group pretest posttest design

  10. Control group pretest posttest design: Scenario 1

  11. Control group pretest posttest design: Scenario 2

  12. Ruling out alternatives • Being able to falsify a causal claim • Ruling out threats due to: • Statistical artifact • Power, unreliability, type I error • History • Maturation • Selection • Testing • Instrumentation • Attrition • Statistical regression

  13. Natural Experiments • A naturally occurring contrast between a treatment and comparison condition • Still need to: • Accumulate facts • Rule out alternatives • Theory based predictions that are refutable and compelling • E.g., Einstein’s prediction of the perihelion of Mercury • We should be so lucky…

  14. Case Study • Does pollution from coal mining cause harm to population health? • Mortality rates • A natural experiment • Can we accumulate facts • Rule out alternatives • Use theory, logic, and verifiable intuition

  15. What is the Evidence? • Cause precedes effect? • (Yes, to a degree: duration of residence, migration) • Cause is related to effect? (Yes) • No other plausible explanations for the effect? • Age, poverty, smoking, health care, etc.

  16. Use the Whitman Model: Accumulating Facts

  17. Adjusted Risk Related to Amount of Coal for: • Lung cancer mortality • Chronic lung disease mortality • Chronic heart disease mortality • Kidney failure mortality • Self-reported health status and chronic heart, lung and kidney disease

  18. Mortality Risk Not Related to Amount of Coal for: • Acute conditions (eg AMI) • But AMI does correlate to poverty and smoking • Infections (e.g. pneumonia) • Diabetes • Colon cancer • Motor vehicle accidents • Suicide or homicide

  19. Using the Whitman Model: Ruling Out Alternatives • Statistical adjustment for age, poverty, smoking, education, rural setting, insurance, etc.

  20. Threats to Validity • Internal validity • History • Selection • Attrition • Statistical conclusion validity • Unreliability of treatment implementation • Extraneous variance • But these make detecting effects more difficult

  21. The Whitman Model: Using logic and intuition • Effects for lung cancer, chronic lung disease, chronic heart disease, kidney disease • Consistent with expected explanations • Activities of the coal mining industry • Risk increases with tonnage • No effects for acute heart disease, colorectal cancer, pneumonia, diabetes, accidents • If coal is not a cause, but socioeconomic or demographic variables are, then shouldn’t these be higher too?

  22. Facts and Truth • Facts can help you approach the truth, but by themselves cannot reveal the truth • Need theory, logic, intuition

  23. “My tongue, every atom of my blood, form'd from this soil, this air, Born here of parents born here from parents the same, and their parents the same, I, now thirty-seven years old in perfect health begin, Hoping to cease not till death.”

More Related