1 / 44

The TWO PVAAS Methodologies

PVAAS – Pennsylvania Value-Added Assessment System http://www.portal.state.pa.us/portal/server.pt/community/pa_value-added_assessment_system_(pvaas)/8751. The TWO PVAAS Methodologies. Looking Forward/Planning… PVAAS Projection Reports For Individual Students and Cohorts of Students.

Download Presentation

The TWO PVAAS Methodologies

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. PVAAS – Pennsylvania Value-Added Assessment Systemhttp://www.portal.state.pa.us/portal/server.pt/community/pa_value-added_assessment_system_(pvaas)/8751

  2. The TWO PVAAS Methodologies Looking Forward/Planning… PVAAS Projection Reports For Individual Students and Cohorts of Students Looking Back/Evaluation… Value-added Growth Reports For Cohorts of Students Today NO individual student growth measure

  3. PVAASIS: • A statistical analysis of existing assessment data (PSSA). • A realistic measurement of a school’s progress/growth over time. • Progress data to add to achievement data as schools are analyzing their work with students and making improvement plans.

  4. PVAASIS NOT: • Another test. • A method for providing a measure of growth for an individual student.

  5. Current Data Collection Approaches High Achievement Average Achievement Low Achievement Achievement is based on each student’s ending point.

  6. PVAAS Adds Another Variable To Achievement…Progress Below Growth Standard At or Above Growth Standard Progress is based on each student’s starting point.

  7. Viewing Achievement and Progress Together Scatter Plots

  8. Scatter Plot Quadrants and Their Meanings Achieving but Slipping Excelling Underperforming and Slipping Underperforming but Improving

  9. Please review this document in your folder…

  10. Example: Regional Scatter Plot

  11. Scatter Plot Comparison State vs. IU 12 vs. YCSD Math and Reading Grades 4 – 8

  12. Statewide to IU Region to DistrictGrade 4 Math

  13. Statewide to IU Region to DistrictGrade 4 Reading

  14. Statewide to IU Region to DistrictGrade 5 Math

  15. Statewide to IU Region to DistrictGrade 5 Reading

  16. Statewide to IU Region to DistrictGrade 6 Math

  17. Statewide to IU Region to DistrictGrade 6 Reading

  18. Statewide to IU Region to DistrictGrade 7 Math

  19. Statewide to IU Region to DistrictGrade 7 Reading

  20. Statewide to IU Region to DistrictGrade 8 Math

  21. Statewide to IU Region to DistrictGrade 8 Reading

  22. 11th Grade Scatterplots The PSSA-PVAAS Scatter Plots visually display the following data from the statewide distribution of PSSA results for 2009-10: • Achievement • The mean predicted performance of the cohort. • The actual mean performance of all students in the state is displayed for reference • Growth • School Effect ≈ Observed Mean – Predicted Mean • Standardized School Effect = School Effect relative to its error – displays degree of confidence The following two slides explain the meaning of each of the regions of an 11th grade scatter plot.

  23. The Scatter Plot Coordinate System for Grade 11 Vertical Axis Mean Predicted Scaled Score Growth Descriptor Boundaries (±2SEs) Horizontal Axis Growth Measure in Standard Errors 2010 Mean Scaled Score

  24. Scatter Plot Regions and Their Meanings for Grade 11 Higher Performing Met Expectations Higher Performing Below Expectations Higher Performing Above Expectations Lower Performing Above Expectations Lower Performing Below Expectations Lower Performing Met Expectations

  25. Statewide to IU Region to DistrictGrade 11 Math

  26. Statewide to IU Region to DistrictGrade 11 Reading

  27. Overview of PVAAS Reporting

  28. PVAAS Reporting • District Level Reporting • School Level Reporting • Grade Level Reporting • Reading (Grades 4-8, 11) • Math (Grades 4-8, 11) • Science (Grades 4, 8, 11) • Writing (Grades 5, 8, 11) • Subgroups Reporting (ex. IEP, ED, ELL) • Performance Levels (Advanced, Proficient, Basic, Below Basic) • Student Level Reporting • Reading, Math, Science, Writing (grades vary based on content area)

  29. Have all of our groups of students experienced one year of academic growth during the last school year? Value-added Growth Reports

  30. PVAAS Value-added CohortGrowth Descriptors – Grade 4 – 8 Math and Reading

  31. District/School Report Example

  32. PVAAS Predictive School Report

  33. How are our best students, our average students, our struggling students growing? Performance Diagnostic Report

  34. Growth Standard MethodologyWhat the whiskers tell us… Exceeded Growth Standard; More than One Year’s Growth Green Met the Growth Standard; Made One Year’s Growth Yellow Growth Standard (One Year’s Growth) Below Growth Standard; Less than One Year’s Growth Rose

  35. Predictive MethodologyWhat the whiskers tell us… ABOVE Expectations -- Observed Score Was Greater Than Predicted Score NDD – No Detectable Difference Between Observed Score and Predicted Score Observed – Predicted (One Year’s Growth) BELOW Expectations -- Observed Score Was Less Than Predicted Score

  36. Performance Diagnostic Report

  37. Performance Diagnostic Report

  38. What is the likelihood that a student will be proficient on a future PSSA exam? PVAAS Projections

  39. Student Projection Methodology • A separate longitudinal modeling process focused on the performance scores of individual students. • The model uses all of the available data (both math and reading) to project future PSSA performances in Math, Reading, Science and Writing. • Projections can be calculated for an individual student or groups of students.

  40. PVAAS Student Projection Report

  41. Identified Students Meeting Search Requirements

  42. District (Single Grade)Projection Summary Report

  43. PVAAS Fall 2009 Reporting: Projections to Basic, Proficient, Advanced Grade PSSA Last Taken Grade PSSA Last Taken Grade PSSA Last Taken

  44. Approved: PA’s Proposal for Growth Model as Means to Make AYP

More Related