assessment Guidance

1. assessment Guidance • http://www.ode.state.or.us/go/ LocalAssessmentGuidance

2. assessment Guidanceincluding Oregon Criteria for High Quality AssessmentsCristen McLean, Policy AnalystBrian Putnam, Education Specialist June 24, 2014Oregon Department of Education

3. Purpose • Introduce Assessment Guidance, which was developed to assist districts in the evaluation of assessment options (commercial or locally developed). • Developed through collaboration with other State Departments of Education and researchers, including Rick Stiggins.

4. Agenda • Introduce Assessment Guidance • Answer, “How can the Assessment Guidance be used?” • Answer, “What is included in the Assessment Guidance?” • Provide time to review Assessment Guidance and ask questions.

5. Assessment Guidance Contents • Assessment considerations related to whether to develop or obtain assessments • Assessment vocabulary • Oregon Criteria for High Quality Assessments

6. How Can the Assessment Guidance be used?

7. Two immediate Applications • Educators at all levels of leadership are faced with many complex decisions around assessment planning, including two immediate planning needs: • Category 2 Assessments for Student Learning and Growth Goals for Educator Effectiveness matrix • Use of funds for Formative and Interim Common Core Assessments

8. Student Learning and Growth Goals • Category 1 • Statewide test • OAKS • Smarter Balanced • Extended Assessment

9. Student Learning and Growth Goals • Category 2 • Locally developed test • Commercially developed test • Results from proficiency-based assessment system • Locally developed collections of evidence • For educators in tested grades, must be used for at least one student learning and growth goal

10. Student Learning and Growth Goals • Teachers in Tested Grades • Student Learning and Growth Goal 1: Category 1 • Student Learning and Growth Goal 2: Category 1 OR Category 2

11. Student Learning and Growth Goals • Teachers in Non-Tested Grades • Student Learning and Growth Goal 1: Category 2 • Student Learning and Growth Goal 2:Category 2 OR Category 1

13. Category 2 • Take 5 minutes… • Think of an example of how your district is planning for Category 2 assessments in non-tested subjects. • Discuss at your table. • Then we’ll popcorn around the room and ask for tables to share out.

14. Common Core Assessments • State Board approved Smarter Balanced Assessment • Ways and Means Joint Committee (i.e., legislative budget committee) provided additional funding for assessments, but divided the budget authority. • For the summative assessment, ODE has the budget authority (in order to purchase Smarter Balanced). • For the formative and interim assessment, districts have the budget authority.

15. Interim and Formative Common Core Assessments • Monies provided to school districts to secure  formative and interim assessment tools aligned to the Common Core State Standards.  • Districts received a letter with amount of funding and assessment tool guidelines.

16. Interim and Formative Common Core Assessments • Options for how to spend monies: • Develop assessments locally • Obtain assessments from outside source (commercially developed or open educational resource) • Combined approach (develop some and obtain some; pilot multiple approaches within a district)

17. Interim and Formative Assessment • To get a sense of what people are planning, please… • Raise your hand if you will be using purchasing an assessment.

18. Interim and Formative Assessment • To get a sense of what people are planning, please… • Raise your hand if you will be using developing the assessments.

19. Interim and Formative Assessment • To get a sense of what people are planning, please… • Raise your hand if you are not yet sure what you will do for these assessments.

20. What is included in the Assessment guidance?

21. Assessment Guidance Contents • Assessment considerations related to whether to develop or obtain assessments • Assessment vocabulary • Oregon Criteria for High Quality Assessments

22. Future Development • Questions for test developers about how test questions or tasks are created and then evaluated for quality. • Questions that educators could ask themselves across a series of steps as they locally develop an assessment. • Information about sources for assessments (commercial and open education resources) to support districts in their procurement decisions.

23. Considerations: Transparent Assessments • Transparent assessments means that educators know: • Purpose of the assessment • What is covered on the assessment (standards) • How the assessment was developed (alignment of items to standards, etc.)

24. Non-Transparent Assessments Example Scenario Assessment was obtained from an outside source and dropped into the class Training was not provided related to purpose, contents of assessment (and/or information was not accessible) Students completed the assessments without educators knowing anything about the questions Educators have to trust that questions are aligned to standards but do not have any way to confirm Results came back without them being tied to standards or useable by educators

25. Non-Transparent Assessments • Take 5 minutes… • Think of an example of non-transparent assessment that you have used in your district. • Discuss at your table. • Then we’ll popcorn around the room and ask for tables to share out.

26. Transparent Assessments Example Scenario Assessment was developed locally (or obtained from outside source) and reflects same standards that drive local curriculum Training was provided related to purpose, contents of assessment (and accompanying information is accessible) Educators are familiar with questions or types of questions and can confirm the alignment of the questions to the standards. Results are tied to standards and useable by educators.

27. Transparent Assessments • Take 5 minutes… • Think of an example of transparent assessment that you have used in your district. • Discuss at your table. • Then we’ll popcorn around the room and ask for tables to share out.

29. Assessment Criteria USe • Flexibly developed so that it can be used to evaluate specific assessments, including: • Locally developed assessments • Commercially developed assessments • Assessments from outside resources, including open educational resources

30. Criteria

31. How to Read The Criteria Tables

32. Assessment Guidance Review • Page through the Assessment Guidance document and discuss it at your table. • Write down any questions or feedback you have, then we’ll go around the room to answer questions.

33. Feedback • Feedback on the Assessment Guidance is welcomed and will be collected through the Summer Assessment Institute: http://www.cosa.k12.or.us/events/2014-oregon-summer-assessment-institute • Please send suggestions to Cristen McLean(cristen.mclean@state.or.us).