PPT Presentation Template:This PPT includes all slides to present a district-level overview of PVAAS. This was used with a district-wide elementary faculty group.
PVAAS Overview:Evaluating Growth,Projecting PerformanceFaculty Introduction
PVAASIS: • Analysis of existing assessment data • Longitudinal PSSA scores in available content areas • Math, Reading, Science, Writing • Provides reliable estimates • A measure of a school’s effectiveness • Critical Relationship: Growth Data vs. Achievement Data
PVAAS: • Is not another test • Is not a comparison of single test scores • Critical concept: Does not provide a measure of growth for an individual student
Current Data Collection Approaches High Achievement Average Achievement Low Achievement Achievement is based on each student’s ending point.
PVAAS Adds Another Variable To Achievement…Progress Below Growth Standard At or Above Growth Standard Progress is based on each student’s starting point.
Viewing Achievement and Progress Together Scatter Plots: Grades 4-8 Reading and Math
The Scatter Plot Coordinate System Vertical Axis PSSA Percent Proficient or Advanced Growth Standard Boundary One Year Growth AYP Percent Proficient Target Horizontal Axis PVAAS Growth Measure
Scatter Plot Quadrants and Their Meanings Quad 2 Adequate Achievement Negative Growth Quad 1 Adequate Achievement Positive Growth Quad 4 Below Adequate Achievement Positive Growth Quad 3 Below Adequate Achievement Negative Growth
District Scatter Plots District vs. IU Region vs. State Math and Reading Grades 4 – 8
Viewing Achievement and Progress Together Scatter Plots: Grade 11 Reading and Math
Grade 11 Scatter Plots The PSSA-PVAAS Scatter Plots visually display the following data from the statewide distribution of PSSA results for the most current school year. • Achievement • The mean predicted performance of the cohort. • The actual mean performance of all students in the state is displayed for reference • Growth • School Effect ≈ Observed Mean – Predicted Mean • Standardized School Effect = School Effect relative to its error – displays degree of confidence The following two slides explain the meaning of each of the regions of an 11th grade scatter plot.
The Scatter Plot Coordinate System for Grade 11 Vertical Axis Mean Predicted Scaled Score Growth Descriptor Boundaries (±2SEs) Horizontal Axis Growth Measure in Standard Errors 2010 Mean Scaled Score
The TWO Types ofPVAAS Information Looking Forward/Planning… PVAAS Projection Reports For Individual Students and Cohorts of Students Looking Back/Evaluation… Value-Added Growth Reports For Cohorts of Students Today NO individual measure of student growth. .
PVAAS Reporting Projections to Basic, Proficient, and Advanced Grade Last Tested Grade Last Tested Grade Last Tested
How do I know that the projectionis accurate? • The projection is precise, and is created using a model that has been reviewed and approved by four different peer review panels and the GAO (US Government Accountability Office). • The most recent 2008 growth model proposal to USDOE includes information regarding the statistical model and projection reliability study. (http://www.ed.gov/admins/lead/account/growthmodel/pa/index.html) • Recent studies have confirmed that the PVAAS projections (even as far as 3 years into the future) are more reliable at looking at the future performance of a student than the most recent PSSA score.
PVAAS Projections for Groups of Students Student Search
Identified Students Meeting Search Requirements
District (Single Grade) Projection Summary Report – Grade 3 District (Single Grade) Projection Summary Report for Grade 3 to be inserted here
District (Single Grade) Projection Summary Report – Grade 4 District (Single Grade) Projection Summary Report for Grade 4 to be inserted here
District (Single Grade) Projection Summary Report – Grade 5 District (Single Grade) Projection Summary Report for Grade 5 to be inserted here
District (Single Grade) Projection Summary Report – Grade 6 District (Single Grade) Projection Summary Report for Grade 6 to be inserted here
District (Single Grade) Projection Summary Report – Grade 7 District (Single Grade) Projection Summary Report for Grade 7 to be inserted here
District (Single Grade) Projection Summary Report – Grade 8 District (Single Grade) Projection Summary Report for Grade 8 to be inserted here
Value-Added Wouldn’t it be great to know if you made at least one year’s growth with students last tested in grades 4-8 and ingrade 11?
Value-added Measure ofCohort GrowthGrades 4 through 8 in Reading and Math • Comparison to a State Growth Standard • The Growth Standard specifies the minimal acceptable academic gain from grade to grade for a cohort of students. • The use of a Growth Standard creates the possibility that ALL schools can demonstrate appropriate growth.
Four Important Issues Difference in scores in consecutive years. 1. Measuring Gain 2. Growth Standard Convert all scores to same scale – NCE scale 3. Comparing Scores from year to year Combine current observed scores with all previous scores in students’ histories. 4. Estimating Achievement
What Value-added Gain Means! Cohort’s Achievement 6th grade 64.6 Cohort’s Achievement 5th grade 60.7 0 10 20 30 40 50 60 70 80 90 100 NCE Scale State Mean = 50 PVAAS Gain ≈ Change in position from 5th to 6th grade ≈ 64.6 – 60.7 ≈ 4.0 NCE points
PVAAS School ReportHigh School Math and ReadingScience and Writing Based on a predictive methodology: • A predicted score is calculated for each student; • Mean of predicted scores is calculated for students in a cohort; • Mean of observed scores of students in the cohort; • School Effect is the difference between the Observed and the Predicted Scores.
PVAAS District ReportGrades 11- Math and Reading Grades 4, 8 & 11 – Science Grades 5, 8 & 11 – Writing
Growth Standard MethodologyWhat the whiskers tell us… Exceeded Growth Standard; More than One Year’s Growth Green Met the Growth Standard; Made One Year’s Growth Yellow Growth Standard (One Year’s Growth) Below Growth Standard; Less than One Year’s Growth Rose
Predictive MethodologyWhat the whiskers tell us… ABOVE Expectations -- Observed Score Was Greater Than Predicted Score NDD – No Detectable Difference Between Observed Score and Predicted Score Observed – Predicted (One Year’s Growth) BELOW Expectations -- Observed Score Was Less Than Predicted Score