Post-Test Data Analysis Workshop

1. Post-Test Data Analysis Workshop

2. Agenda • Analyze 2014 TerraNova Results • Comparative Data Analysis: TerraNova & Explore Test Results • Using CTB Online Reporting • Generate & Analyze Subgroups • Deep Dive: Measurable Learning Objectives

3. Data Rich…….Information Poor Many schools invest a great of time in creating elaborate analyses of the end-of-year assessment. Such reports are often exhaustively detailed, breaking down student results by every conceivable demographic or academic attribute. Yet despite the huge amount of data it generates, analysis of these test is of little use to the students who took them. Indeed, it may show what went wrong, but it comes too late to make a difference. Rather than pouring time into figuring out what students failed to learn at year’s end, it is much more effective to focus on interim assessments and avoid failures altogether. - Paul Bambrick-Santoyo, Driven by data (2010)

4. I. Analyze 2014 TerraNovaResults

5. TerraNova Template

6. Data Points: NP of the Mean NCE vs Mean NCE • National Percentile (NP) • Normal Curve Equivalent (Mean NCE)

7. Mean Anticipated NCE • Quartiles

8. Analyze 2014 TerraNova Results • Which areas are above the expected levels of performance? • Which areas are below the expected levels of performance? • What is the achievement gap between student performance in reading and mathematics, and the mean NCE of 76 (90th percentile)? • Is the percent of students above the national mean greater than or equal to 66%? • What is the percent of students that are in Quartile 1? • Which of the above reported findings are consistent with findings from previous TerraNova results?

9. II. Comparative Analysis: TerraNova & Explore Results

10. Understand Explore Results • Use the Profile Summary Report

11. Explore Test Frequencies & National Averages • Table 1a • Columns: - Explore score range- Freq- CP*- Local & Nat’l

12. Explore Test Quartiles & Score Ranges • Score Ranges vary by test • Q1 = 1-24% • Q2 = 25-49% • Q3= 50-74% • Q4= 75-100%

13. Three Analysis Types • Status Analysis: percent performing at or above grade-level • Impact Analysis: impact teacher has on different groups of students • Growth Analysis: academic growth with cohort of students

14. Status Analysis • Use the 2012, 2013, and 2014 TerraNova results • What is the percent performing at or above grade-level for the last three years? • Is the level of performance on the TerraNova consistent? • Use the 2012, 2013, and 2014 Explore results • What is the percent performing at or above grade-level for the last three years? • Is the level of performance on the Explore consistent?

15. Impact Analysis • Use the 2012, 2013, and 2014 TerraNovaresults • Reading: Is the Mean NCE within ±7 points for all years tested? • Reading: Are the Quartile distributions consistent for all years tested?

16. Impact Analysis • Math: Is the Mean NCE within ±7 points for all years tested? • Math: Are the Quartile distributions consistent for all years tested? • Which subject areas indicate the overall highest performance? • Which subject areas indicate the overall lowest performance?

17. Growth Analysis • Use the 2012, 2013, and 2014 TerraNovaresults • Compare Mean NCE scores for a cohort of students. For example, grade 3 students in 2012 are in grade 4 in 2013, and in grade 5 in 2014 • Analyze reading: Is there significant growth (+7 Mean NCE), significant regression (-7 Mean NCE), or even performance (±6Mean NCE)? • Analyze math: Is there significant growth (+7 Mean NCE), significant regression (-7 Mean NCE), or even performance (±6 Mean NCE)? • Analyze the other subject tests

18. Growth Analysis • Describe the areas that show a positive trend in performance. • Describe the areas that show a negative trend in performance. • Which areas indicate the overall highest performance? • Which areas indicate the overall lowest performance?

19. Growth Analysis: Student Performance on Different Psychometric Summative Assessments • Cohort Quartile performance on TerraNova to quartile performance on Explore Diagnostic Questions: • Top performing subject test: What is the top performing subject test and what is the quartile distribution on the TerraNovain grade 7? Is student performance consistent on the Explore test? Is there a growth? Is there regression?

21. Student Performance on Different Psychometric Summative Assessments • Cohort Quartile performance on TerraNova to quartile performance on Explore Diagnostic Questions: • Least performing subject test: What is the least performing subject test and what is the quartile distribution on the TerraNova in grade 7? Is student performance consistent on the Explore test? Is there a growth? Is there regression?

23. III. CTB Online Reporting

24. Log into CTB Online Reporting

25. Guide to CTB Online Reporting- Spring 2014 • Summary Report: Combination • Summary Report: Objectives • Roster Report • Item Summary • Cohort Comparison Report

26. IV. Generate & Analyze Subgroups

27. Are there Achievement Gaps in Sub-Groups? • School’s demographics shape the subgroups • Types of sub-groups: ethnicity, gender, Title 1, English Language Learners, transfer-in, other • Identify at least one sub-group but no more than three

28. V. Deep Dive: Measurable Learning Objectives

29. Deep Dive: Measurable Learning Objectives • CTB Online Reporting • Summary Report: Objectives • Item Summary • Objectives and Subskills (OCS Resource Portal- Academic Excellence- Assessment)

30. Your Questions

31. “I Choose C” • https://www.youtube.com/watch?v=dY2mRM4i6tY

32. I Appreciate Our Time Together!