Findings on Alignment of Instruction using Enacted Curriculum Data

1. Findings on Alignment of Instruction using Enacted Curriculum Data Rolf K. Blank Director, Education Indicators Rolfb@ccsso.org AERA, April 2004

2. Surveys of Enacted Curriculum Data: Design, Multiple Uses Rolf K. Blank Director, Education Indicators Rolfb@ccsso.org AERA, April 2004

3. Surveys of Enacted Curriculum Now available, K-12: English Language Arts, Mathematics, Science

4. SEC Collaborating Organizations • Council of Chief State School Officers www.SECsurvey.org • Wisconsin Center for Education Research www.SEConline.org • Learning Point Associates/NCREL www.SECsupport.org • TERC Regional Alliance DEC Project www.ra.terc.edu

5. Key Question addressed by SEC Tool: • How can Educators obtain reliable, valid data to determine degree of alignment of instruction with state standards and assessments? • Then, How can the Data inform strategies for improvement?

6. Rationale Standards Assessment Curriculum

8. Content Maps

9. What teachers teach What standards require Curriculum Analysis:EnactedIntended

10. SEC Content TopicsMath, Science, ELA The SEC provides a neutral, research-based language to describe content of English language arts, mathematics, and science. NCLB anyone?

11. Expectations (Cognitive Demand)for Students

12. Descriptive results can be reported using a variety of graphic displays

13. Survey Sections • Instructional Readiness • Teacher Opinions • Professional Development • Types • Content Focus • Active Learning • Collegial Participation • Coherence • Time Span • Teacher Characteristics • Instructional Content • School & Class Description • Instructional Activities • General • Problem Solving Activities • Pairs & Small Group Work • Use of Hands-on Materials • Use of Calculators/Computers & other Ed. Tech. • Assessment Use • Instructional Influences

17. SEC Applications--NCLB • Alignment analysis (instruction, standards, assessments) • Instructional improvement in schools • Needs assessment/ Evaluation • Indicators – monitoring change over time

18. Data on Enacted Curriculum PROJECT DESIGN Five Urban Districts—40 Mid. Schools Teacher & School Data Reports Teacher Data Measure Change Standards Assessment Curriculum Improved Student Achievement Science/Math Initiatives Professional Development Assist Schools/ Professional Development Assist Schools/ Professional Development

19. To view Surveys, Reporting, Methods www.SECsurvey.orgat CCSSO www.Online.orgweb-based Survey at WCER www.SECsupport.org at Learning Point/NCREL

20. A neutral content grid with cognitive demand Surveys of Enacted Curriculum The intended curriculum: State content standards—What students should learn The assessed curriculum: State (and other) assessments—tested learning The learned curriculum: Student outcomes based on school learning The enacted curriculum: What teachers teach

21. SEC Alignment Analysis Intended— standards Enacted— taught Assessed— state tests

22. Analysis Objectives Purpose: Use by District, Schools, TA providers What Topics, Expectations are taught, as compared to Standards, Assessments? To what extent? Which are NOT taught? How does Instructional content relate to Achievement? Analysis Methods: A) Descriptive -- Content Maps % Instructional time by Emphasis of Standards/Assessments B) Correlation -- Alignment Index

23. Results from 2 Districts/States Miami-Dade: 12 Middle Schools (6-8) 219 Teachers Y1, 171 Y3 (Math,Sci) Winston-Salem: 10 Middle Schools 136 Teachers Y1 (Math,Sci)

24. Alignment Analysis • Topic Differences in Alignment • School Differences • 2 State Standards by Instruction • Change over time: Year 1 to Year 3

25. Alignment Level Alignment index (0 to 1): Miami, Math, 6-8 • Gr 6 FL Standards x Instr = .19 • Gr 8 FL Assessment x Instr. = .22 • School Level, Gr. 6 Stands = .20 to .17 • School level, Gr. 8 Assess = .22 to .24