1 / 117

PVAAS F2F Overview: Evaluating Growth, Projecting Performance

PVAAS F2F Overview: Evaluating Growth, Projecting Performance. Fall 2013. Welcome!. IU Facilitators Who is here today? District level administrators? School level administrators? Teachers? Instructional coaches? Guidance counselors? Other?. Partners & Teams for Session Activities.

leroy
Download Presentation

PVAAS F2F Overview: Evaluating Growth, Projecting Performance

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PVAAS F2F Overview:Evaluating Growth,Projecting Performance Fall 2013

  2. Welcome! • IU Facilitators • Who is here today? • District level administrators? • School level administrators? • Teachers? • Instructional coaches? • Guidance counselors? • Other? F2F Overview 2013

  3. Partners & Teams for Session Activities • Some activities throughout the session will be completed in pairs or small groups, while others will be done independently. • Take a few minutes now to divide yourselves into: • Partners (groups of 2), AND • Small groups (groups of 4-6). F2F Overview 2013

  4. Goal of Session By the end of the session, participants will be able to answer the following questions: • What is PVAAS? • How does PVAAS measure growth? • What does PVAAS tell us about growth in our district and school(s)? • What does PVAAS tell us about how students are projected to perform on a future state assessment? • Which reports are most meaningful for school level planning, course level planning, grade level planning, and student level planning? F2F Overview 2013

  5. What Is PVAAS? F2F Overview 2013

  6. What is PVAAS? • Longitudinal analysis of existing state assessment data • Reliable estimates of academic growth & projections of future performance • Effectiveness of the educational system F2F Overview 2013

  7. What is PVAAS? Grade 5 Grade 6 • Growth of a group of students over time • NOT a simple comparison of test scores Grade 3 Grade 4 F2F Overview 2013

  8. PVAAS Addresses Complex Issues! Research-based Statistical Modeling F2F Overview 2013

  9. Demographics and Growth As long as you can sufficiently account for the prior achievementof the student,… …there is NO significant relationship between demographics and student progress, or growth! F2F Overview 2013

  10. Prior Achievement How can we adequately account for prior achievement? • The SAS EVAAS team has found that the only way to adequately account for prior achievement is to use ALL available test data for each student to dampen the effects of measurement error. • PVAAS does NOT need to adjust for the demographic status of students directly since it is accounting for students’ prior achievement. • In other words, demographics are inherently controlled for in PVAAS by the use of all longitudinal data on all students. F2F Overview 2013

  11. Activity Work with a partner to decide if each statement is true or false. F2F Overview 2013

  12. For More Information Virtual Learning Module PVAAS Misconceptions: Clarifying Questions and Misunderstandings F2F Overview 2013

  13. Two Types of PVAAS Information F2F Overview 2013

  14. What is PVAAS? F2F Overview 2013

  15. LOOKING AHEAD LOOKING BACK F2F Overview 2013

  16. PVAAS Value-Added ReportingHow is growth measured in PVAAS? F2F Overview 2013

  17. PVAASValue-Added Reporting F2F Overview 2013

  18. Measuring Academic Growth Students don’t all start the year at the same place academically F2F Overview 2013

  19. Measuring Academic Growth • Standard for PA Academic Growth • Regardless of their entering achievement level, students should not lose ground academically • Is it not a reasonable goal to maintain the achievement level of a group of students? • Not necessarily increase their achievement level, but maintain their achievement level. F2F Overview 2013

  20. PVAAS Growth Measure &Color Indicators • The Growth Measure represents the amount of growth a group of students has made. • The Color Indicators represent the level of evidence we have in the data to say whether the group of students: • Did NOT meet the standard for PA Academic Growth • Met the standard for PA Academic Growth • Exceeded the standard for PA Academic Growth PVAAS yields a Growth Measure AND a Growth Color Indicator. F2F Overview 2013

  21. Concept of Measuring Growth in PVAAS Prior Achievement for Group Higher Achievement Lower Achievement F2F Overview 2013

  22. Concept of Measuring Growth in PVAAS Prior Achievement for Group Higher Achievement Lower Achievement • For grades 4-8, Math and Reading - represents the mean achievement level of the group of student • For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students F2F Overview 2013

  23. Concept of Measuring Growth in PVAAS Most Recent School Year for Group Prior Achievement for Group Higher Achievement Higher Achievement Lower Achievement Lower Achievement • For grades 4-8, Math and Reading - represents the mean achievement level of the group of student • For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students F2F Overview 2013

  24. Concept of Measuring Growth in PVAAS Most Recent School Year for Group Prior Achievement for Group Higher Achievement Higher Achievement Lower Achievement Lower Achievement • For grades 4-8, Math and Reading - represents the mean achievement level of the group of student • For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students F2F Overview 2013

  25. Concept of Measuring Growth in PVAAS Most Recent School Year for Group Prior Achievement for Group Higher Achievement Higher Achievement Lower Achievement Lower Achievement • For grades 4-8, Math and Reading - represents the mean achievement level of the group of student • For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students F2F Overview 2013

  26. Concept of Measuring Growth in PVAAS Most Recent School Year for Group Prior Achievement for Group Higher Achievement Higher Achievement Lower Achievement Lower Achievement • For grades 4-8, Math and Reading - represents the mean achievement level of the group of student • For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students F2F Overview 2013

  27. Concept of Measuring Growth in PVAAS Most Recent School Year for Group Prior Achievement for Group Higher Achievement Higher Achievement Lower Achievement Lower Achievement • For grades 4-8, Math and Reading - represents the mean achievement level of the group of student • For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students F2F Overview 2013

  28. Regardless of the entering achievement level of the group… F2F Overview 2013

  29. Regardless of the entering achievement level of the group… • Students should not lose ground academically F2F Overview 2013

  30. Regardless of the entering achievement level of the group… • Students should not lose ground academically • A reasonable goal would be to at least maintain the achievement level of the group F2F Overview 2013

  31. Regardless of the entering achievement level of the group… • Students should not lose ground academically • A reasonable goal would be to at least maintain the achievement level of the group • All groups of students can make growth F2F Overview 2013

  32. Practice! • Turn to a partner • Explain the concept of growth Current School Year Previous School Year Higher Achievement Higher Achievement Lower Achievement Lower Achievement F2F Overview 2013

  33. For More Information TWO Virtual Learning Modules Introduction to Measuring Academic Growth Concept of Growth: Connections to Value-Added Reporting F2F Overview 2013

  34. Questions F2F Overview 2013

  35. PVAAS Growth Measure &Color Indicators • The Growth Measure represents the amount of growth a group of students has made. • The Color Indicators represent the level of evidence we have in the data to say whether the group of students: • Did NOT meet the standard for PA Academic Growth • Met the standard for PA Academic Growth • Exceeded the standard for PA Academic Growth PVAAS yields a Growth Measure AND a Growth Color Indicator. F2F Overview 2013

  36. Measuring Growth in PVAAS • Remember, PVAAS does NOT compare the achievement of one group of students in a particular subject and grade with the previous year’s students in the same subject and grade. • PVAAS does NOT use the percentages of students at various academic performance levels to measure growth. • PVAAS uses students’ scale scores within those performance levels to better estimate growth. F2F Overview 2013

  37. PVAAS Value-AddedGrowth Indicators F2F Overview 2013

  38. PVAAS Value-AddedGrowth Indicators F2F Overview 2013

  39. Growth Measures Not Reportedfor Prior Years • PA’s state assessment system is transitioning to include Keystone end-of-course exams and statewide assessments aligned to the PA Common Core over the next several years. • Growth Measures in prior years will NOT be included in fall 2013 reporting (SY12-13). • Anticipated that Growth Measures from up to 3 previous years with 3-year averages will be yielded and reported beginning with fall 2015 reporting (SY14-15). F2F Overview 2013

  40. School Value-Added ReportsGrades 4-8 Math & Reading F2F Overview 2013

  41. PVAAS Value-AddedGrowth Measures • For Reading and Math in grades 4-8, Growth is measured in Normal Curve Equivalent (NCE) units as scale scores cannot be compared from grade to grade and year to year. • The Growth Measure is NOT reported in years and cannot be referenced in terms of number of year’s growth. • The Growth Measure is NOT reported in percentages and cannot be referenced in terms of an increase or decrease in percentage points. F2F Overview 2013

  42. RescalingGrades 4-8: Math & Reading 1000 1100 1200 1300 1400 1500 Scale Score Points • 0 10 20 30 40 50 60 70 80 90 100 NCE Units F2F Overview 2013

  43. Activity:How would you interpret? F2F Overview 2013

  44. School Value-Added ReportsScience, Writing, & Keystone content areas School A School B F2F Overview 2013

  45. PVAAS Value-AddedGrowth Measures • For Science, Writing and Keystone content areas, Growth is measured in scale score points. • The Growth Measure is NOT reported in years and cannot be referenced in terms of number of year’s growth. • The Growth Measure is NOT reported in percentages and cannot be referenced in terms of an increase or decrease in percentage points. F2F Overview 2013

  46. Activity:How would you interpret? F2F Overview 2013

  47. For More Information TWO Virtual Learning Modules Value-Added Report F2F Overview 2013

  48. Performance Diagnostic Report Missing Bar – Insufficient Number of Students Blue Bar – Current Year Whisker – Margin of Error on Growth Value F2F Overview 2013

  49. PVAAS Performance Diagnostic Growth Descriptors - Interpretation What the whiskers tell us… Exceeded the standard for PA Academic Growth Met the standard for PA Academic Growth Zero (0) Line Growth Did not meet the standard for PA Academic Growth F2F Overview 2013

  50. Performance Diagnostic Patterns Reverse Shed Pattern Shed Pattern System benefits higher-achieving students System benefits lower-achieving students F2F Overview 2013

More Related