Smarter Balanced 201: Next Generation Assessment Environment

1. Smarter Balanced 201: Next Generation Assessment Environment Rachel Aazzerah Math, Science and Social Sciences Assessment Specialist Email: rachel.aazzerah@state.or.us 503-947-5835

2. WebEx Agenda • Smarter Balanced Pilot Test Overview (High Level) • Accommodations and Tools Available on the Smarter Balanced Pilot Test • Instructional Best Practices • Resources • Smarter Balanced 202: Evidence Centered Design • ODE Contact Information

3. Smarter Balanced Pilot Test Window(s) • The Scientific Sample Pilot testing will take place between February 20 and May 10, 2013 (Non-Scientific Pilot Test will occur between April 15 and May 10, 2013).

4. Smarter Balanced Pilot Test • The assessment is computer based and will feature the new selected-response and performance task item types.www.smarterbalanced.org • Minimum technical requirements can also be found on http://www.smarterbalanced.org/smarter-balanced-assessments/technology/#specificationsThis website will also provide you with a resource for checking the sufficiency of your school’s bandwidth for testing.

5. Smarter Balanced Pilot Test Resources • Several training opportunities will be provided to assist schools and districts in preparing for the pilot. http://sbac.portal.airast.org/. • A training test will be available on January 15 so that students, teachers, coordinators, and administrators will have an opportunity to view the item types presented on the pilot forms and interact with the online test delivery system. http://sbac.portal.airast.org/.

6. Smarter Balanced Pilot Test Resources • Accommodations guidance for the Pilot Test is expected to be published in early January on the Smarter Balanced portal http://sbac.portal.airast.org/ • The Pilot Test Administrator Manual and Test Coordinator Manual will be posted in early January to the Smarter Balanced Portal at http://sbac.portal.airast.org/ • Again, you may also visit these sites for additional information on the pilot: • www.smarterbalanced.org • http://sbac.portal.airast.org/

7. Smarter Balanced Pilot Test Contacts • Should you have additional questions about participating in the Scientific Sample of the pilot, please contact DRC: Phone: 800-847-3193 E-mail: SmarterBalancedRecruitment@DataRecognitionCorp.com • Should you have additional questions about the Smarter Balanced Pilot Test (Volunteer), please contact the AIR Help Desk: Phone: 866-815-7246 E-mail: smarterbalancedpilot@air.org

8. Volunteer for the SBAC Pilot Test (Non-Scientific Sample) • All schools are encouraged to volunteer to participate in the Smarter Balanced Pilot Test. • Schools and Districts have until March 27, 2013 to sign up: • To sign up for the volunteer pilot: https://www.surveymonkey.com/s/SmarterBalancedPilot

9. Interactive Poll Session • On the chat feature, you will see an online virtual poll that you will need to click on/or type a response in order to answer questions about the SBAC Pilot Test. • Was your school or district selected to participate in the Scientific Sample of the SBAC Pilot Test? (Yes/No) • Is your school or district planning on volunteering for the SBAC Pilot Test (non-scientific sample)?(Yes/No) • What questions do you still have in regard to the SBAC Pilot Test at this time? (Type questions in)

10. Smarter Balanced Pilot Test Accommodations Guidance • Universal Design- Increased Accessibility • Overall Goal is to only exempt the 1% Alternative Assessment Students • State Practices • Literature Reviews • Policy Recommendations • Advisory Committees (ELL, Students with Disabilities (SWD), Cross-consortia ELL)

11. Smarter Balanced Pilot Overview of Tools • ELA Writing Tools for Performance Tasks only: available to all students • General tools for Math and ELA: most are available to all students • Accessibility Pilot Studies: content and grades specified

12. Digital Tools – All Grades Writing ELA Performance Tasks Only Universal Digital Tool All Students Bold Yes Italics Yes Underline Yes Indent Yes Cut Yes Copy Yes Paste Yes Spell Check Yes Undo/Redo Yes

13. Additional Tools – All Grades Universal Digital Tool ELA Math All Students Pausing Yes Yes Yes Font Size (5 sizes) Yes Yes Yes Highlight Yes Yes Yes Mark for review Yes Yes Yes Answer eliminator Yes Yes Yes Expandable passages Yes Yes Yes Print on request (stimuli/passages)* Yes Yes No Print on request (items & passages)* Yes Yes No * Note: Given the high security risk, tool is available only for students who cannot use a computer screen.

14. Additional Tools and Resources (All Grades) • Universal Digital Tool ELA Math All Students • Tab-Enter Navigation Yes Yes Yes • Font Background • (Color Alternatives ) Yes Yes Yes • Testing Breaks Yes Yes Yes • Additional Time Yes Yes Yes • Calculator* N/A Yes Yes • *Note: Calculators available on items when they do not interfere with intended computational construct. • *Students are only allowed to use the calculators (basic (4 function), Scientific, Graphing) that are provided (pop-up) on the assessment. Handheld calculators are prohibited during the Math SBAC assessment.

15. Accessibility Pilot Studies Features Full Spanish Translation Customized Spanish glossaries Online refreshable Braille* Text to speech Customized English glossaries Math Grades 3, 7, 11 3, 7, 11 3, 7, 11 3, 7, 11 3 ELA Grades --- --- 4, 7, 11 4, 7, 11 (items only) 4 (items only) * Note: Special equipment provided locally.

16. Pilot Studies Results • Gather information about the process of providing accommodations and results of offering them. • Provide feedback to states, work groups, experts. • Incorporate what we learn into field test development work.

17. Pilot Administration Guidance • SBAC is currently finalizing comprehensive accessibility framework for summative assessment. •Forpilot only, may exempt students who need supports that are not available. • No student will get scored based on the pilot test. • No teacher results (scores and reports)based on the pilot test. • When in doubt, please include the student. • All students (except ALT 1%) will participate in 2015 when full framework is available.

18. Interactive Poll Session • On the chat feature, you will see an online virtual poll that you will need to click on/or type a response in order to answer questions about the SBAC Pilot Test Accommodations and Tools. • What concerns do you have about the current available accommodations for the SBAC Pilot Test? • Are there any additional tools or accommodations that you feel need to be addressed on the Field Test in 2014? • Are there any additional tools or accommodations that you feel need to be addressed before the 2014-2015 Operational Assessment starts for students?

19. Instructional Best Practices (How do we as educators get students ready for the new SBAC assessments?) • Have students become familiar with the new item types and performance tasksfor both ELA and Math • Have students become familiar with using the SBAC online based calculators (four function, scientific and graphing) (not hand-held) • Have students complete multiple assessments in their Math and ELA classes where a classroom or partner discussion component is included.

20. Instructional Best Practices • Have students complete math and ELA assignments that have technology enhanced components (You-Tube videos, Teacher Tube video, Websites, Web Links, Blogs, Audio Recordings) • Have students complete multi-step-thematic problems and assignments in both math and ELA • Have students take the SBAC training test to become familiar with the new item types and test design system (tools and accommodations) (http://sbac.portal.airast.org/)

21. Instructional Best Practices • Have students become familiar with listening to audio clips or watching digital video clips, while taking notes at the same time. (Claim 3 ELA: Listening and Speaking) • Increase the emphasis of informational text in all of the subject areas (cross-curricular emphasis).(Claim 1 and 2 ELA: Reading and Writing) • Increase the emphasis of using multiple sources (technology based, literature articles, class discussions) to be used for developing research based writings. (Argumentative Essays) (Claim 4 ELA: Research)

22. Interactive Poll Session • On the chat feature, you will see an online virtual poll that you will need to click on/or type a response in order to answer questions about the SBAC Pilot Test Accommodations and Tools. • Based on what you have learned and or observed about the SBAC Math and ELA assessments, what additional Best Practices need to be implemented to prepare students for this new testing environment? • What instructional shifts need to occur in order to prepare students for this new testing environment? • On a scale of 1-5 (1 being not prepared-5 being totally prepared), how prepared do you think your students are currently for this new testing environment?

23. Resources • Smarter Balanced Website • http://www.smarterbalanced.org/ • Smarter Sample Items and Performance Tasks • http://www.smarterbalanced.org/smarterbalancedassessments/#item • Smarter Item Writing and Review Materials • http://www.smarterbalanced.org/smarter-balanced-assessments/item-writing-and-review/ • Common Core State Standards Toolkit • http://www.ode.state.or.us/search/page/?id=3430 • Common Core State Standards Assessment Resources • http://www.ode.state.or.us/search/page/?id=3298 • Thank You!!! www.ode.state.or.us/go/assessment

24. Next Smarter Balanced Webinar: • Smarter Balanced 202: Evidence Centered Design • February 5, 2013 (3:30-4:30 p.m.) * Pilot Test Update * Item Development Process (Evidence Centered Design) *Smarter Balanced FAQ and Misconceptions Update For information about joining the SBAC webinars will be posted prior to each event on ODE’s Calendar Events Registration web page at: http://www.ode.state.or.us/news/events/.

25. Thank you! Please send additional input, questions, or anecdotes to: Rachel Aazzerah (Math/Smarter Balanced) Rachel.Aazzerah@state.or.us Derek Brown (Essential Skills) Derek.Brown@state.or.us Mark Freed (Math) Mark.Freed@state.or.us Ken Hermens (English/Language Arts) Ken.Hermens@state.or.us www.ode.state.or.us/go/assessment