150 likes | 298 Views
Control. Any means used to rule out threats to validity Example Hypothesis: Rats learned to press a bar when a light was turned on. Data for 10 rats bar pressing behavior when the light was on (on board) Did the experiment work?. Control: 2 Uses.
E N D
Control • Any means used to rule out threats to validity • Example • Hypothesis: Rats learned to press a bar when a light was turned on. • Data for 10 rats bar pressing behavior when the light was on (on board) • Did the experiment work?
Control: 2 Uses • Control = providing a standard for comparison • Control = reducing error variability
Control as Providing a Standard for Comparison • Control Group • Control Condition • Two or more levels of an IV • Known base rate in the population What is an example of each for the bar-pressing experiment? Which is the weakest method of control? Which is best for the bar-pressing experiment?
Example of a Control Condition DV = number of bar presses (SPSS data file)
Example of a Control Condition, revised experimental procedure DV = number of bar presses (SPSS data file)
Control as Reducing Error Variability • The meaning of “control” in Skinner’s work • Increases statistical power
Control: 2 Uses • Control = providing a standard for comparison • Ruling out confounds • Increases internal validity • Control = reducing error variability • Increases statistical power • Increases statistical validity
Strategies for Control • Subject as Own Control (within-subjects) • Random Assignment • Matching • Building in Nuisance Variables • Statistical Control • Replication
Subject as Own Control (within-subjects designs) • Generally better than between-subjects • Rules out more possible confounds • Provides more statistical power • When is a within-subjects design inappropriate? • Not logically possible • Participating in more than one condition will reveal the hypothesis or introduce demand characteristics • Contrast effects between conditions are likely
Random Assignment • “each subject has an equal and independent chance of being assigned to every condition” • Reduces the likelihood of confounds(Excel spreadsheet demo) • The defining feature of a “true experiment” • Quasi-experiment: when participants are not randomly assigned to groups
Matching • Procedure to ensure that experimental and control groups are equated on one or more variables before the experiment • Only useful when the matched variable correlates substantially with the DV (example) • Howto: • Create pairs matched on some variable you think will be correlated with the DV • Randomly assign members of each pair to conditions
Building in Nuisance Variables • Nuisance variable = a variable that is not relevant to the hypothesis, but is difficult to remove from an experiment and is therefore made part of the design • Not a confound! Not confounded with IV. • Including a nuisance variable can increase statistical power • Examples: • night vs. day student (text, p. 200) • Counterbalancing variables
Statistical Control • Mathematical (statistical) way of equating subjects who differ on a nuisance variable that is correlated with the DV • “Analysis of Covariance” • Useful when random assignment and matching are not possible • Example: Studying effects of teaching techniques on grades, using IQ as covariate
Replication = repeating an experiment to see if the results will be the same • Direct replication – repeating an experiment exactly • Systematic replication – extending an experiment to new subjects, dependent variables, independent variables, etc.
Strategies for Control:Related to which type of Validity? • Subject as Own Control • Random Assignment • Matching • Building in Nuisance Variables • Statistical Control • Replication