ANOVA II (Part 1)

1. ANOVA II (Part 1) Class 15

2. Follow-up Points • size of sample (n) and power of test. • How are “inferential stats” inferential?

3. Logic of F Ratio Differences Among Treatment Means F = Differences Among Subjects Treated Alike Treatment Effects + Experiment Error F = Experiment Error Between Group Differences F = Within Group Differences

4. Variance Code Calculation Meaning Mean Square Between Groups MSA SSA dfA Between groups variance Mean Square Within Groups MSS/A SSS/A dfS/A Within groups variance Mean Squares Calculations Degrees of Freedom (df) for between groups = (no. groups – 1) Degrees of Freedom (df) for within groups = (no. subjects – no. groups)

5. Decision Rule Regarding F Reject null hypothesis when F (x,y) observed> (m,n) Reject null hypothesis when F (1,8) observed> 5.32. F (1,8) = 8.88 > 5.32   . Decision:Reject null hypothesis Accept alternative hypothesis

6. Analysis of Variance Summary Table One Factor (One Way) ANOVA Source of Variation Sum of df Mean Square F Significance of Squares (MS) F Between Groups 13.61 1 13.61 8.87 .02 Within Groups 12.27 8 1.53 Total 25.88 9

7. TYPE I AND TYPE II ERRORS

8. Errors in Hypothesis Testing Reality Null Hyp. True Null Hyp. False Alt. Hyp. False Alt. Hyp. True Decision Reject Null Incorrect: Correct Accept Alt. Type I Error Accept Null Correct Incorrect: Reject Null Type II Error Type ? Error Type ? Error

9. Errors in Hypothesis Testing Reality Null Hyp. True Null Hyp. False Alt. Hyp. False Alt. Hyp. True Decision Reject Null Incorrect: Correct Accept Alt. Type I Error Accept Null Correct Incorrect: Reject Null Type II Error Type I Error Type II Error

10. Avoiding Type I and Type II Errors Avoiding Type I error: 1. ??? sample size 2. Reduce random error a. ??? b. ??? c. Pilot testing , etc. Avoiding Type II error 1. Reduce size of ????, BUT a. Not permitted by sci. community b. But, OK in some rare applied contexts

11. Avoiding Type I and Type II Errors Avoiding Type I error: 1. Increase sample size 2. Reduce random error a. Standardized instructions b. Train experimenters c. Pilot testing , etc. Avoiding Type II error 1. Reduce size of rejection region, BUT a. Not permitted by sci. community b. But, OK in some rare applied contexts

12. Assumptions of One Way ANOVA 1. Normally distributed error variance 2. Homogeneity of error variance 3. Independence of error components 4. Additivity of components 5. Equal sample sizes

13. Non-Normal Distributions Distort 2%-3%

14. Effect of Different Variances on ANOVA

15. Effect of Different Variances on ANOVA

16. Additivity of Components ASij = + (j - ) + (ASij - j)

17. UNEQUAL SAMPLE SIZES Not a problem if: a. Differences in sample sizes is small b. Size of smallest sample is relatively large Is a problem if: a. Differences in sample sizes is large b. Samples differ in variances

18. Unplanned and Unequal Subject Loss 1. Subject loss due to "real world" circumstances 2. Subjects fail to meet inclusion criterion 3. Subjects fail to meet response-level criterion

19. N Total Subject Loss Motivated Subject Loss (n = 15) Unmotivated Subject Loss (n = 15) Peer Study Condition 30 5 (.17) 2 (.13) 3 (.20) Solo Study Condition 30 9 (.30) 2 (.13) 7 (.47) Unequal Subject Loss and Compromised Randomness

20. Variance as a Descriptive Statistic How much do groups differ in their within groups variance? One-Way ANOVA??? Test for Homogeneity of Variance μ1 = μ2 =μ3 = μx σ1 = σ2 = σ3 = σx SPSS Conducts ??? Test for Homogeneity of Variance

21. Variance as a Descriptive Statistic How much do groups differ in their within groups variance? One-Way ANOVALevene Test for Homogeneity of Variance μ1 = μ2 =μ3 = μx σ1 = σ2 = σ3 = σx SPSS Conducts Levene Test for Homogeneity of Variance

24. Birth Order Means

25. Limitations of Main Effects • Show “what” but not “???” • Fail to account for the “what ifs” • Cannot show ???-eration • Cannot account for underlying ???

26. Limitations of Main Effects • Show “what” but not “why” • Fail to account for the “what ifs” • Cannot show moderation • Cannot account for underlying causes

32. Verbal Definitions of Interaction Effects (Keppel, 178) 1. "Two variables interact when the effect of one variable changes at different levels of the other variable". 2. "An interaction is present when the simple main effects of one variable are not the same at different levels of the second variable".

33. Implications of Interaction 1. ??? effects, alone, will not fully describe the results. 2. Each factor (or IV) must be interpreted in terms of the factor(s) with which it ???. 3. Analysis of findings, when an interaction is present, will focus on individual treatment means rather than on overall factor (IV) means. 4. Interaction indicates ???-eration.

34. Implications of Interaction 1. Main effects, alone, will not fully describe the results. 2. Each factor (or IV) must be interpreted in terms of the factor(s) with which it interacts. 3. Analysis of findings, when an interaction is present, will focus on individual treatment means rather than on overall factor (IV) means. 4. Interaction indicates moderation.

35. Interactions are Non-Additive Relationships Between Factors 1. Additive: When presence of one factor changes the expression of another factor consistently, across all levels. 2. Non-Additive: When the presence of one factor changes the expression of another factor differently, at different levels.

36. Birth Order Main Effect: NO Gender Main Effect: NO Interaction: NO

37. Birth Order Main Effect: YES Gender Main Effect: NO Interaction: NO

38. Birth Order Main Effect: NO Gender Main Effect: YES Interaction: N0

39. Birth Order Main Effect: YES Gender Main Effect: YES Interaction: NO

40. Birth Order Main Effect: NO Gender Main Effect: NO Interaction: YES

41. Birth Order Main Effect: YES Gender Main Effect: NO Interaction: YES

42. Birth Order Main Effect: NO Gender Main Effect: YES Interaction: YES

43. Birth Order Main Effect: YES Gender Main Effect: YES Interaction: YES