1 / 40

The Summary of Answers and Skills (SOAS) Tutorial

The Summary of Answers and Skills (SOAS) Tutorial. SOAS Introduction. Audience Administrators Department heads Curriculum specialists Teachers Other staff interested in students’ college preparatory skills

sadie
Download Presentation

The Summary of Answers and Skills (SOAS) Tutorial

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Summary of Answers and Skills (SOAS)Tutorial

  2. SOAS Introduction Audience • Administrators • Department heads • Curriculum specialists • Teachers • Other staff interested in students’ college preparatory skills Note: the more inclusive the testing within each grade, the more meaningful and applicable the results.

  3. Logging In Repeat Users www.collegeboard.com/results

  4. Logging In New Users If it’s your first time, you’ll need your school’s SOAS access code

  5. Supporting Materials SOAS Resources

  6. Your Reports

  7. Report Orientation Table of Contents Page(s) • Title Page • Performance Overview 1 • Skills Analysis 2, 6-7, 11 • Question Analysis 3-4, 8-9, 12-13 • Comparable Group Analysis 5, 10, 14

  8. Performance Overview Page 1 • Number of students in report • Mean scores and • score distribution • College Readiness Benchmarks

  9. Skills Analysis Pages: 2, 6-7, 11 • Skills • Triangles show a comparison to the state and nation • Each test question is linked to a skill

  10. Activity B Review Skills Analysis Instructions • Work within your own school group/academic area, using your school’s SOAS report. • Identify the skill that your students had the lowest performance on. • Using the Test Question and Answer Explanations, look at each question aligned to that skill. • Things to look for: Skills furthest below the state/national average. Skills that are furthest to the left (i.e. those that are the weakest for the group). Skills that came to your attention after review of Question Analysis.

  11. Activity B Review Skills Analysis Questions for Consideration Within your group, please answer the following: • Is there any pattern in the skills you identified as problematic? • Are there actions or strategies that might help address where students are struggling with certain skills? • What skills are relatively strong for your students? Why?

  12. Question Analysis Pages: 3-4, 8-9, 12-13 • Student responses and answer patterns • Comparisons to the state and nation

  13. Question Analysis Tips: Look for questions your Students answered incorrectly that the students in the state and nation answered correctly Look for commonly Wrong answers

  14. Activity C Review Question Analysis Instructions • Work within your own school group/academic area, using your school’s SOAS report. • Refer to the Test Questions and Answer Explanations to make note of problem questions and how they might be addressed. • Things to look for: Easier questions (difficulty level 1-3) where fewer than 2/3 of the students answered correctly. A larger proportion of your students answered incorrectly or omitted an answer in comparison to the state/nation. Commonly wrong answers. Review any questions that generated interest when you reviewed the test questions in Activity A.

  15. Activity C Review Question Analysis Questions for Consideration Within your group, please answer the following: • Are there any patterns in the questions you identified as problematic? • Are there actions or strategies that might help students master the skills assessed by these questions? • What are the key highlights from your discussion that your group would like to share? Please include both strengths and areas of concern.

  16. Comparable Group Analysis Pages: 5, 10, 14

  17. SOAS Comparable Group What is a comparable group? • A useful statistical model • A statistically created group (virtual group) • Mirrors your group’s performance profile • This creates an expected performance indicator for your group on each question • Provides more “actionable” feedback than state or national averages on questions/skills

  18. Comparable Group Analysis Pages: 5, 10, 14 Darker blue = significantly below the comparable group Lighter blue = significantly above the comparable group

  19. Activity D Comparable Group Analysis Instructions • Work within your own school group/academic area, using your school’s SOAS report. • Using the Test Question and Answer Explanations, look at each question. • Things to look for: Questions that fall into the dark blue area, where your students performed below expectation. Questions that fall into the light blue area, where your students performed higher than expectation.

  20. Activity D Comparable Group Analysis Questions for Consideration Within your group, please answer the following questions: • Is there a pattern in the skills aligned with the test questions on which your students performed below expectation? • Is there a pattern in the skills aligned with the test questions on which your students performed above expectation? • What new information, if any, have you learned from this analysis? Has this changed your thoughts about anything that your group previously discussed? Why or why not?

  21. Resources

  22. Resources Test Questions and Answer Explanations

  23. How does it all add up? Critical Reading example Step 1 of 4: Use reports to find a question you’d like to analyze. Critical Reading Question 5

  24. How does it all add up? Critical Reading example Step 2 of 4: Identify the skill measured by this question. Critical Reading Question 5

  25. How does it all add up? Critical Reading example Step 3 of 4: Review the question, answer, and answer explanation. Critical Reading Question 5

  26. How does it all add up? Critical Reading example Reading: Question 5 Venomous fish are often ------- in appearance; their intense colors may serve to warn enemies away. (A) flamboyant (B) clumsy (C) tranquil (D) elephantine (E) diminutive Question 5 measures the skill: Determining the Meaning of Words

  27. How does it all add up? Critical Reading example Step 4 of 4: Making connections to state and Common Core Standards. Critical Reading Question 5 Determining the Meaning of Words

  28. How does it all add up? Critical Reading example Step 4 of 4: Making connections to state and Common Core Standards. Critical Reading Question 5 Determining the Meaning of Words

  29. How does it all add up? Critical Reading example The skill Determining the Meaning of Words aligns to the State Standard and the Common Core State Standard. Insert State Standard Determining the Meaning of Words Insert Common Core State Standard

  30. How does it all add up? Math example Question 25 (Multiple Choice) Level of Difficulty = (E) Skill = Data, Statistics, and Probability According to the pictogram above, if China had 100 million Internet users in 2005, approximately how many million did India have? A) 54 B) 48 C) 37 D) 25 E) 18

  31. How does it all add up? Math example Step 1 of 4: Use reports to find a question you’d like to analyze. Math Question 25

  32. How does it all add up? Math example Step 2 of 4: Identify the skill measured by this question. Math Question 25

  33. How does it all add up? Math example Step 3 of 4: Review the question, answer, and answer explanation. Math Question 25

  34. How does it all add up? Question 5 measures the skill: Data, Statistics, and Probability Math: Question 5

  35. How does it all add up? Math example Step 4 of 4: Making connections to state and Common Core Standards. Math Question 25 Data, Statistics, and Probability

  36. How does it all add up? Math example Step 4 of 4: Making connections to state and Common Core Standards. Math Question 25 Data, Statistics, and Probability

  37. How does it all add up? Math example The skill Data, Statistics, and Probability aligns to State Standards and the Common Core Standards. Data, Statistics, and Probability Insert State Standard Data, Statistics, and Probability Insert Common Core Standard

  38. Using Your SOAS Data Identify the skills associated with the questions students answered incorrectly. Make inferences about what led to errors. Identify where in the curriculum the skills are (or are not) taught. Work with departments and classrooms to review common concerns. What recommendations can you make to your school for increased student success?

  39. Using Assessments for School Improvement • Identify skills to help guide instruction and curriculum planning. • Connect more students with challenging high school courses and then college. • Identify students who would likely benefit from the rigor of an Advanced Placement course in your school. • Help close the achievement gap in your school community.

  40. Looking Ahead:2012 PSAT/NMSQTWednesday, October 17thSaturday, October 20th

More Related