A Serving of Science with Y our Breakfast

1. A Serving of Sciencewith Your Breakfast

2. Science Assessment News June 7, 2011

3. Grades 5 and 8 First assessment of the K-12 Science Learning Standards (adopted June 2009) 2011 SCIENCE MSP

4. Big Ideas in 2009 Science Standards

5. Scenarios and Items • Scenarios provide context for sets of items. • Systems, Inquiry, and Application • Physical, Earth/Space, and Life Science • The items associated with a scenario cover a range of standards & range of cognitive complexity. • Items not connected to a scenario are called “Stand Alone” items, which is clearly marked for students.

6. From WASL to Measurements of Student Progress Embedded pilot items makes the total number of items 35.

7. From WASL to Measurements of Student Progress Embedded pilot items makes the total number of items 40.

8. Test Specifications Grade 5 & 8 The test map designates the following proportions:  • At least 20% Systems (with connected EALR 4 content) • 30% Inquiry • 20% Application (which will apply EALR 4 content) • At most 30% EALR 4 domain knowledge that is not associated with a cross-cutting concepts or abilities* *EALR 4 content may be assessed in questions that only assess EALR 4 or in questions that cut across both EALR 4 and a cross-cutting concept or ability (Systems, Inquiry, Application).

9. Science Assessment Development Cycle Develop Test and Item Specifications Scenario & Item Writing Committee Content Review & Bias/Sensitivity Committees Scenario & Items reviewed for content by OSPI/contractor Scenario & Item Pilot Testing Pilot Range Finding Committee Items available for Operational Testing Data Review Committee Pilot Scoring Operational Range Finding Committee Operational Scoring

10. Summer 2011 for Grades 5 and 8 Following the process used by Mathematics in grades 3-8 last year STANDARD SETTING

11. Standard Setting • A new performance standard must be set for a test assessing new learning standards • Three components • Performance Level Descriptors • Contrasting Groups Study • Standard Setting Panel Recommendation • A panel recommends the “cut score” for proficient, based on data gathered and on evaluation of items on the test. • The State Board of Education uses recommendation to set the new performance standard.

12. Performance Level Descriptor Training & the Contrasting Groups Study GOAL: Everyone in the state who teaches science to fifth and eighth grade students can be part of standard setting on the new tests. Performance Level Descriptors (PLDs) were developed for what it means to be Basic, Proficient, and Advanced. Web-based training on PLDs was available to science educators from February through April. In April, participating teachers judged each of their students as being “Basic or below” or “Proficient or above”

13. Performance Level Descriptor Training & the Contrasting Groups Study After students take the tests (and they are scored), two distributions of scores are produced: Scores obtained by students rated as “Basic”, and scores for “Proficient”

14. Students rated as “Basic or below” using criteria in PLD for Basic Number of students Raw score points

15. Students rated as “Proficient or above” using criteria in PLD for Proficient Number of students Raw score points

16. Performance Level Descriptor Training & the Contrasting Groups Study 5. The place where the two distributions merge represents the separation point between “Basic” and “Proficient.”

17. Intersection indicates a region for where “Basic” separates from “Proficient” Number of students Raw score points

18. Performance Level Descriptor Training & the Contrasting Groups Study The region separating Basic from Proficient will be provided to standard setting panels in August Panelists will be instructed to use this as a “starting point” for where to locate the cut point for “Proficient” performance

19. BIOLOGY EOC

20. Implementation Timeline • HSPE for 2011 assessed the 2005 GLEs • Biology EOC in 2012 will be administered to any student enrolled in a course credited as high school level biology • K-12 Science Learning Standards • First retake opportunity for biology EOC is likely to be January/February 2013 • Recommendation for additional EOCs

21. From WASL to High School Proficiency Exam to End of Course Embedded pilot items bring the item total to 45. Completion items will be piloted in 2011 and will be operational in 2012. The K-12 Science Learning Standards will be assessed beginning in 2012.

22. Scenarios and Items • Scenarios provide context for sets of items. • Systems, Inquiry, and Application • Life Science domain of EALR 4 • The items associated with a scenario cover a range of standards & range of cognitive complexity. • Items not connected to a scenario are called “Stand Alone” items, which is clearly marked for students.

23. Science Assessment Development Cycle Develop Item and Test Specifications Scenario & Item Writing Bio EOC is here Scenario & Items Reviewed for Content & Bias/Sensitivity by Committees Scenario & Items Reviewed for Content by OSPI Scenario & Item Pilot Testing Pilot Rangefinding Operational Testing Data Review Pilot Scoring Operational Rangefinding Operational Scoring

24. Upcoming events Resources OTHER NEWS

25. Upcoming Events • Measurements of Student Progress • Grade 5 and 8 Pilot Rangefinding – July • Grade 5 and Grade 8 Standard Setting – August 1-4 • Biology end-of-course exam • Scenario and Item Writing – June • Pilot Rangefinding – July • Content Review – August 15-19 • PLD Development – September 2011 • PLD Training – Winter 2011/12 • Contrasting Groups Study – April 2012 • Standard Setting – August 2012

26. Science Assessment Resourceswww.k12.wa.us/Science/Assessment.aspx • Teacher Resource Tool • Test and Item Specifications • Grade 5 and 8 MSP updated this fall • Biology EOC posted this fall • Released Item Documents • WASL released scenarios and items • Powerful Classroom Assessments • WASL released scenarios and items • Scoring information, including rubrics

27. Science Assessment Resourceswww.k12.wa.us/Science/Assessment.aspx • Educator Resources • Short Answer Item Templates • Common 2-point items for classroom practice • Inquiry: Conclusion, New Procedure and New Field Study (Grade 5 and 8) • Application: Research & Explore (Grade 8), Plan & Test and Redesign (Grade 5 and 8) • Additional presentations • Science Assessment Updates for 2011 • General information on the 2011 test • Sample items for classroom use • Scoring information, including rubrics and sample student responses

28. Science Assessment Resourceswww.k12.wa.us/Science/Assessment.aspx • Teacher Resource tool • Types of scenarios • Generic questions • Item specifications • Cognitive complexity • State-wide statistics

29. www.k12.wa.us/Science/Assessments.aspx www.k12.wa.us/TeacherResourceTool2009-10/default.aspx TEACHER RESOURCE TOOL Select Teacher Resource Tool Select Science Select a Grade and a Year

30. TEACHER RESOURCE TOOL Type of scenario Generic question, rolls over to item specification Percent correct or mean score

31. Email Jessica Cole (jessica.cole@k12.wa.us) to sign up to receive announcements of science assessment development opportunities and news STAY INFORMED

32. Elaine Wood, Science Assessment Specialist THANK YOU

33. Next Generation Science Standards ?? ? Summer 2012 • WA • Science • Stds Summer2011 Spring 2011

36. Table Task: Pass out cards Read contents of card aloud Discuss placement on an ‘element’

39. New Evaluation Criteria Principal Teacher

40. Effective Professional Learning In most schools, a large gap exists between what is known about professional learning that affects teaching and improves student achievement and the professional development that teachers and principals regularly experience. The solution to [this] problem, I believe, is high-quality, school-based professional learning and collaborative work that affects all teachers virtually every day. - Dennis Sparks

41. What did professional learning in education used to look like? How might the new evaluation criteria impact your work?

43. Exit Slip • One take-away from this morning • What support for science do my teachers need? • What support for science do I need?