260 likes | 804 Views
EXPERIMENTAL DESIGN. Experimental and Pre (Quasi) Experimental Designs. Basic Issues in Experimental Design. Manipulation of the Independent Variable Selection of the Dependent Variable Assignment of subjects (or other test units) Control over extraneous variables.
E N D
EXPERIMENTAL DESIGN Experimental and Pre (Quasi) Experimental Designs
Basic Issues in Experimental Design • Manipulation of the Independent Variable • Selection of the Dependent Variable • Assignment of subjects (or other test units) • Control over extraneous variables
Manipulation of the Independent Variable • In a classical experiment, the researcher measures the condition of the subjects – both treatment and control groups - on the dependent variable and then “manipulates” the independent variable for the “treatment group” while not “manipulating” that variable for the “control” group, and then “re-measures the dependent variable for both groups while controlling “all other variables”.
Artificial – Low Realism Few Extraneous Variables High Control Low Cost Short Duration Subjects Aware of Participation Natural – High Realism Many Extraneous Variables Low Control High Cost Long Duration Subjects Aware of Participation Laboratory vs Field Experiments
“ONE-SHOT” CASE STUDY T1 T2 T3 X O Where: X = Treatment O = Observation
How good is this research design? • Scientifically it is not good at all • However, that the classical case studies in all of the social sciences have contributed more to those discipline’s knowledge than any other design • First – much of the pioneer work that shaped the social sciences was accomplished before the advent of sophisticated research designs • Second –research is always the enterprise of individuals and individual skill can “substitute” for sophisticated design controls • Third – research designs which require sophisticated controls are limited to different kinds of inquires
“ONE-GROUP” PRETEST - POSTTEST T1 T2 T3 O X O
“STATIC GROUP” COMPARISON T1 T2 T3 X O O
“PRETEST - POSTTEST”CONTROL GROUP DESIGN T1 T2 T3 Trt O X O Ctrl O O
Posttest-Only Control Group T1 T2 T3 O X O O
“SOLOMON” FOUR - GROUP DESIGN T1 T2 T3 O X O O O X O O
More Complex Experimental Designs • Completely randomized designs • Randomized block design • Factorial design • Latin square design
Experimental Conditions • Double Blind experiment – neither “observer” nor the “subjects” know whether the subject are in the treatment or control groups or receiving a placebo. • Placebo effect – One experimental group is given the “treatment” that is being tested while another “treatment” group receives a “treatment” but one that is, by design, “benign” in its effect.
Extraneous Variables • History • Maturation • Testing • Instrumentation • Selection • Mortality
Extraneous Variables • History – specific events in the environment between the before and after measurement that are beyond the experimenter’s control e.g. a major employer closes its plant in a test market area • Maturation – subjects change during the course of the experiment e.g. subjects become tired
Extraneous variables(cont -2) • Testing – the before measurement alerts subject to the nature of the experiment • e.g. questionnaire about traditional role of women triggers enhanced awareness of women in the experiment • Instrumentation – changes in measuring instrument result in response bias • e.g. new questions about women are interpreted differently than earlier questions
Extraneous variables(cont -3) • Selection – sample selection error occurs because of differential selection of comparison groups • e.g. control and experimental groups are assigned self-selecting groups based on preference for soft drinks • Mortality – sample attrition, some subjects withdraw from experiment • e.g. subjects in one group of students withdraw from school
Control for Extraneous Variation • Eliminate Extraneous Variables • Hold Conditions Constant • Randomization • Matching Subjects
Demand Characteristics • Design procedures that “hint” to subjects about the experimenter’s hypothesis • Guinea Pig effect – when subjects exhibit behavior that they feel is expected of them • Hawthorne effect – causes people to perform differently just because they know they are experimental subjects
Ethical Issues • Harm • “Unfair benefit” • Privacy • Confidentiality • Deception • Not using debriefing