Smarter Balanced in Washington

1. Smarter Balanced in Washington Preparing for the Transition Webinar #4 March 20, 2014

2. Organization of Webinars Series • Future webinars are scheduled for 3:30-4:30 PM on: April 9 May 13 June 10 July 15 August 13 • PowerPoints and answers to questions raised during the webinars are posted on OSPI’s Smarter Balanced web-page http://www.k12.wa.us/smarter/default.aspx; audio recording of webinars are included. • We will minimize repeating previously provided information, so please check the webpage.

3. Summative Field Tests Getting Ready for the Tests

4. Field Testing Countdown to Test Administration! • Whoa!!! The delay of one week caught everyone by surprise. • OSPI had no input on the issue, but is deeply sorry for the disruption and the late notice. • Thanks to everyone who recognized the delay was no one’s preference and would have been avoided if it were not necessary. • The first field test window opens Tuesday, March 25.

5. Scheduled Downtimes Remain the Same

6. Field Testing Windows and Scheduled Downtimes • There are four test administration blocks: • March 25 – April 4 • April 7 – April 25 • April 28 – May 16 • May 19 – June 6 (not for grades 9-10) • Those who got bumped from week one can test any time before June 6 • EdWeek and Seattle Times mentioned an additional week of June 9 – that was a mistake on the part of the Smarter Balanced spokesperson

7. Field Testing Updates and the Countdown to Test Administration! • Students are permitted and encouraged to use their own ear buds or headsets, but districts and schools should also plan on having some available. USB headphones are recommended as they are typically plug-and-play devices. Districts and schools are responsible for ensuring that each participating student has a headset. 

8. Field Testing Updates • Continue accessing resources and materials for the Field Test scheduling, administration, and communication. • Ensure your district and school coordinators and teacher administrators are carefully reviewing the training modules posted on the Field Test Portal.

9. Training and Resources • Field Test Portal Recent Additions • Classroom Activity and Performance Task Administration Guidelines: How to identify the performance task topic for each school and grade, download the classroom activity, and administer the classroom activity and performance task. • Keyboard Command Chart for Students: This document explains the keyboard commands that students can use to navigate between test features and tools. • Test Security Incident Log: This document provides instructions and a template of the incident log that Test Administrators, School Test Coordinators, and District Test Coordinators will use to report any Test Security Incidents that occur during testing.

10. Training and Resources • Field Test Portal Recent Additions, continued • Scribing Protocol for Smarter Balanced Assessments: This document is designed to assist staff, test administrators, educators, and scribes in ensuring scribing is standardized and contributes to valid measures of students' college and career readiness. • Embedded Designated Support Glossaries: Further information on the glossary supports that are available. • Communications Toolkit: The communications toolkit for the Field Test includes 12 documents that support communications efforts surrounding the launch of the Field Test. Materials include Field Test FAQs, talking points, parent/guardian notification letter template, and other helpful resources.

11. Training and Resources • Field Test Portal Recent Additions, continued • ORS User Guide: The Online Reporting System (ORS) enables authorized users to view test progress information for students participating in the Spring 2014 Smarter Balanced Field Test. • Field Test Portal Recent Updates • Test Administrator User Guide: (Updated March 16) • Guidelines: Frequently Asked Questions for the Usability, Accessibility, and Accommodations Guidelines (Updated March 16) • Technical Specifications Manual for Online Testing (Updated March 17)

12. Pre-ID’ing and Data Topic Updates • TEST TICKETS!!! • Test tickets are available in WAMS Profile Downloads under ‘8. Smarter Balanced Field Test’ • 2 tickets per student: ELA and MATH • For HS testing single subjects – discard extra tickets • Sorted by school name, grade, group name (if applied), student last/first/middle • Additional Test Ticket Resources: • MS Access DB/Form posted to: http://www.k12.wa.us/SMARTER/Tests.aspx • Excel Student list posted in WAMS Profile Downloads currently

13. Pre-ID’ing and Data Topic Updates • Student Data TIDE tasks prior to testing: 1) Block 1 test sites must identify remaining students (“stragglers”) and enter them into TIDE prior to testing 2) Correcting Demographics in TIDE • Demographic data in TIDE is used in item analysis • Make corresponding updates in Local SIS’s and CEDARS 3) Uploading supports/accommodations • TIDE User Guide, pages 30–35 and Test Administration Manual, section 7.0

14. Pre-ID’ing and Data Topic Updates • New and Moved Student Files Schedule: • Will reflect students from most recent CEDARS submission • Students enrolled between most recent CEDARS submission and the start of testing must be added by a District Administrator

15. Pre-ID’ing and Data Topic Updates • New and Moved Student Files (continued) • EXAMPLES • School is testing both ELA and Math during window 2 and most recent CEDARS submission before window 2 new and moved extract was on March 21: • Window 2 extract will include all students enrolled between February 10 (initial statewide student upload) and March 21 • School is testing ELA in window 2 (same CEDARS date as above) and Math in window 3; most recent CEDARS prior to window 3 extract was April 7: • Window 2 new and moved includes same students as above. Window 3 new and moved includes students enrolled between February 10 and April 7 with duplicates of window 2 new and moved records removed.

16. Why Field Test? Dry Run • Although this is a field test, we must have valid responses to shape our future tests. • Accurate item data will determine difficulty, bias and sensitivity, whether items are kept, and ultimately the cut scores (or what score is needed to meet standard). Field Tests Operational Tests Item Data

17. Security • Test Administrators must ensure that all conditions of test security are maintained. • Report all security incidents witnessed or suspected. • Only students who are testing can observe assessment items. • Students who are not being tested or unauthorized staff must not be in the room where a test is being administered. • Based on the item type (i.e., performance tasks), trained TAs may also have limited exposure to assessment items in the course of properly administering the assessment; • however, even TAs may not actively review or analyze any assessment items.

18. Security • TAs and SCs or other individuals who have witnessed, been informed of, or suspect the possibility of a test security incident that could potentially affect the integrity of the tests or the data should follow the steps outlined in Appendix B of the Test Administration Manual and the TIDE User Guide located at: http://sbac.portal.airast.org/wp-content/uploads/2014/01/Smarter_TIDE_UserGuide_Spring2014.pdf

19. Security • The Test Security Incident Log (on the Smarter Balanced Portal http://sbac.portal.airast.org/field-test/resources/) is the document of record for all test security incidents. • TAs must download the template and log incidents immediately and submit via email (or alternate agreed-upon process) to their SCs and DCs. • Instructions on how to complete the Log, including a listing of the column headers and descriptions, are located within the EXLS file, under tab ‘Instructions’.

20. Security • At the close of the testing window, ensure that all test security incidents were reported in accordance with the guidelines in Appendix B in the TAM and the TIDE User Guide.

21. Operational Summative Assessments

22. Administration Window • The 2015 summative operational assessment windows/dates are still being discussed… • The complexities include: • Per Smarter Balanced Consortium: • High schools need to test on Smarter Balanced w/in final 7 weeks of school • Grades 3-8 test in final 12 weeks of school • In Washington: • Grade 3 results must be returned in time for principals to meet with parents before the end of the year • High school exit exams need to be scheduled as well (ELA for 10th and EOC in math and biology) - these will be paper/pencil

23. Interim Assessments We are all life long learners… patiently learning a little each month about interim assessments

24. Interim Assessments • No updates have been provided to states on interim assessments. • A letter will soon be sent to districts with schools who are in Priority, Focus or Emerging status: • Smarter Balanced interims will replace Reading Benchmark and Math Benchmark assessments (RBAs and MBAs) • OSPI is still discussing appropriate interims for grades 1-2 (WaKIDS can be used in kindergarten)

25. Digital Library Educator resources for formative assessment practices to improve instruction

26. A Balanced Assessment System Summative assessments Benchmarked to college and career readiness Teachers and schools have information and tools they need to improve teaching and learning Common Core State Standards specify K-12 expectations for college and career readiness All students leave high school college and career ready Educator resources for formative assessment practices to improve instruction Interim assessments Flexible, open, used for actionable feedback

27. Summative Assessments for Accountability • Coverage of full breadth/depth of Common Core • Computer Adaptive Testing (CAT) • Precise assessment of all students • More engaging assessment experience • Performance Tasks – real world problems Formative Tools and Resources for Improved Instruction • Digital library gives access to high-quality resources • Tools/materials for classroom-based assessments • Professional social networking (Web-based PLCs) • Useful for in-service and pre-service development ✔ Balanced Assessment Interim Assessments to Signal Improvement • Optional for district, school or classroom use • Fully aligned with Common Core – same item pool • Focus on set of standards or mirror summative test • Teachers can review and score responses ✔ ✔

28. Smarter Balanced Digital Library:Formative Assessment Practices and Professional Learning – educator involvement

29. Digital Library Basics • One Stop: • Accessed through a single sign-on with user permission levels • Educators have access to all of the instructional and professional learning resources for each grade band (Grades K-2, 3-5, 6-8, 9-12) • There will be resources that educators can share or use with students and families, but students and families will not be able to access materials directly. • It WILL NOT be a “bank” of formative assessment items alone. All resources will have the formative assessment process embedded within them. • All submitted materials will be vetted through a Quality Criteria Review Process by SNEs across the nation. • Each resource will be reviewed and rated by at least 3 SNEs • If they do not meet the quality criteria, resources will not be included in the library • Functionality • The applications uses state-of-the art tagging and search features so that educators will be able to: • Quickly find resources by CCSS, formative assessment process attributes, etc. • View and download resources • Rate resources • Use social networking features to collaborate with other educators across the Consortium by posting questions and sharing their knowledge.

30. Resources in the Digital Library Assessment Literacy Modules • Commissioned professional development modules • Resources for students and families • Frame formative assessment within a balanced assessment system • Articulate the formative assessment process • Highlight formative assessment practices and tools Exemplar Instructional Modules • Commissioned professional development modules • Instructional materials for educators • Instructional materials for students • Demonstrate/support effective implementation of the formative process • Focus on key content and practice from the Common Core State Standards for Mathematics and English Language Arts Education Resources • High-quality vetted instructional resources and tools for educators • High-quality vetted resources and tools for students and families • Reflect and support the formative process • Reflect and support the Common Core State Standards for Mathematics and English Language Arts • Create Professional Learning Communities * Resources include the following file types: Video, HTML5, Audio, PPT, Excel, Word, and PDF.

31. Resources in the Digital Library Assessment Literacy Modules • Not an assessment bank • Not an item bank • Not a learning management system where educators can register for training or receive credit by completing specific online courses • Not a library for general public (will require registration and login) • Not a site where any resource can automatically be posted; all resources must be vetted through the Quality Criteria Exemplar Instructional Modules Education Resources * Resources include the following file types: Video, HTML5, Audio, PPT, Excel, Word, and PDF.

32. Grounded in this Definition of Formative Assessment Process Formative Assessment is a deliberate process used by teachers and students during instruction that provides actionable feedback that is used to adjust ongoing teaching and learning strategies to improve students’ attainment of curricular learning targets/goals. ~ Compiled by the Digital Library National Advisory Panel

33. All Resources are Grounded in the Four Attributes of the Formative Assessment Process and Reviewed using Quality Criteria Clarify Intended Learning Elicit Evidence Act on Evidence Interpret Evidence

34. Quality Criteria for Professional Learning Resources

35. Quality Criteria for InstructionalResources

36. Recommend with revisions SNE Resource Recommendation Options Do not recommend Recommend with distinction Recommend Recommend with revisions Do not recommend

37. Resource Posting Work Flow Step 1: Resource Submitted Step 2: GatekeepingCriteria Applied Step 3: Quality Criteria Applied Step 4: Decision Posted Cover Profile Sent to SLT SNE 2 SNE 3 SNE 1 SNE 1 Returned to Submitter

38. Smarter Balanced – Who and When? • OSPI staff involved in workgroups 2010-2014 • WA teachers involved 2011-2014 • Item and stimulus writing and review • Alignment Study • Achievement Level Descriptors • Pilot in spring 2013 • Practice Tests widely available in May 2013 • Comprehensive summative field test in 2013-14 • Digital Library - State Networks of Educators began vetting resources to populate the library in Fall 2013 • “Soft Launch” of the Digital Library in late Spring 2014 • All components of Smarter Balanced operational in 2014-15 • Full Digital Library in fall 2014 • Interim assessments available late fall 2014 • Summative assessments administered in spring 2015

39. Resources For You! • For the latest news and developments on Smarter Balanced in Washington: http://www.k12.wa.us/smarter/default.aspx • Materials for administration, as well as communication templates for parents and community: http://sbac.portal.airast.org/field-test/resources/ • For questions about Smarter Balanced or the assessment system transitions, contact:Assessment@k12.wa.us360-725-6348

40. Happy Field Testing!!!!!

41. Thank you!