slide1 n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
PVAAS Statewide Core Team Fall, 2011 PowerPoint Presentation
Download Presentation
PVAAS Statewide Core Team Fall, 2011

Loading in 2 Seconds...

play fullscreen
1 / 72

PVAAS Statewide Core Team Fall, 2011 - PowerPoint PPT Presentation


  • 130 Views
  • Uploaded on

Pennsylvania Value-Added Assessment System (PVAAS): Effectively Communicate PVAAS with your Board and Community. PVAAS Statewide Core Team Fall, 2011. Session Description.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PVAAS Statewide Core Team Fall, 2011


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide1

Pennsylvania Value-Added Assessment System (PVAAS):Effectively Communicate PVAAS with your Board and Community

PVAAS Statewide Core Team

Fall, 2011

session description
Session Description

This 60 minute session will provide strategies and approaches for discussing PVAAS with your local school board and community, as well as communicating PVAAS results. Approaches that have been used by actual districts in Pennsylvania will be discussed. Materials and resources to use as tools for communication about PVAAS to your local school board and community will be reviewed. Opportunities for questions and discussion will be provided.

There are trainer notes included for this presentation.

agenda
Agenda

Documents & Suggested Handouts to use with School Board Members

Considerations for Communicating PVAAS to School Boards and Your Community

PVAAS Public Reporting Site

Examining the School Board PowerPoint template

Questions

suggested approach for initial session with school board
Suggested Approach for InitialSession with School Board
  • Keep it simple…keep it conceptual
  • Discuss what PVAAS is and is not
    • Start with a focus on Scatter Plots: Achievement vs. Growth
  • Summarize important reports!
    • Suggest starting with Reading and Math only
    • District Value-Added Report
    • Value-Added Summary Report (building level results)
    • District (Single Grade) Projection Summary Report
    • Performance Diagnostic Summary Report (if needed)

Go For The BIG IDEAS!

suggested approach for discussion with community members
Suggested Approach for Discussion with Community Members
  • Keep it simple…keep it conceptual
  • Discuss what PVAAS is and is not
  • Start with a focus on Scatter Plots: Achievement vs. Growth (Across Grades Only!)
  • Summarize important information!
    • District & School Value-Added
      • Across Grades Only
    • School Search
      • Average Growth Index
      • Across Grades Only

Go For The BIG IDEAS!

supports and resources to prepare present at pvaas to school board members and or community
Supports and Resources to Prepare & Present atPVAAS to School Board Members and/or Community
show dvd for school boards
Show: DVD for School Boards

PVAAS for

School Board Members

by School Board Members

  • Tom Gentzel, PSBA
  • 2 Superintendents
  • School Board Members
  • 12 minutes
  • Email pdepvaas@iu13.org for a copy of the DVD
suggested resources documents for board members
Suggested Resources & Documents for Board Members
  • Copy of PPT Presentation
  • Guides to PVAAS Reporting 2011
    • Guide to PVAAS Reporting for LEAS 2011
    • Guide to PVAAS Public Reporting 2011
suggested resources documents for board members1
Suggested Resources & Documents for Board Members
  • Copies of Key District Reports
    • District Value-Added Summary Reports
    • District Value-Added Reports
    • District Projection Summary Reports
  • District Scatter Plots
    • Web-based Scatter Plots (demonstrate on public reporting site)
      • Grade level or Across Grades
slide11

PDE PVAAS Webpage

Help Menus, PPT Presentationswith Trainer Notes, Resource Materials, Video Clips, & District Case Studies

slide12

SAS PVAAS Website

New & Archived Webinars, Podcasts, Guide to PVAAS Reporting for LEAs, Guide to PVAAS Public Reporting, & Intermediate Unit Supports

https://pvaas.sas.com

key concepts any pvaas session
Key Concepts: ANY PVAAS Session

Achievement

Progress

  • Measures students’ performance at a single point in time
  • Compares student performance to a standard
  • Critical to students’ post-secondary opportunities
  • Highly correlated with demographic factors, such as socioeconomic status
  • Measures students’ progress across time/years
  • Compares student performance to his/her own prior performance
  • Critical to ensuring students’ future academic success
  • Not correlated with demographic factors
key concept any pvaas session
Key Concept:ANY PVAAS Session
  • PVAAS reporting reflects the effectiveness of your district’s or school’s Standards-Aligned System
  • PVAAS reporting reflects the district’s or school’s system regarding curriculum, assessment, and instruction
key concepts any pvaas session1
Key Concepts: ANY PVAAS Session
  • There is NO relationship between demographic variables such as socioeconomic status and growth.
    • There are high achieving schools making high growth;
    • There are high achieving schools making low growth;
    • There are low achieving schools making high growth;
    • There are low achieving schools making low growth.
  • Growth reporting reflects what WE do with students in terms of academic growth in schools/districts.
  • -- VAAS can remove the effects of factors not under the control of the school. (McCaffrey, Lockwood, Koretz & Hamilton, 2003; Ross, Wang, Sanders, Wright & Stringfield, 1999a; Wright, Horn & Sanders, 1997).
key concept any pvaas session1
Key Concept:ANY PVAAS Session
  • PVAAS District and School Value-Added Reports do NOT provide a measure of teacher effectiveness!
  • Often people ask about the meaning of these reports, especially in situations where there is only one classroom teacher in a grade level. This is NOT a report on the effectiveness of the classroom teacher, even in that situation!
  • Teacher effectiveness reporting would be done using a different statistical analyses than the one used for reporting on district or school effectiveness. Additional data would be collected as well.
decision point audience
Decision Point: Audience
  • What are the backgrounds of school board members?
  • Do the board members have experience with growth data/PVAAS?
  • Do the board members have any background knowledge/foundation in Statistics?
decision point intended goal for session s
Decision Point: Intended Goal for Session (s)
  • PVAAS Overview?
  • Review of Actual District/School Data?
  • Part of Planning Process?
    • Comprehensive Planning
    • School Improvement Planning
decision point focus of data
Decision Point: Focus of Data
  • District?
  • School?
  • Grade?
  • Subgroups?
  • Which subjects?
    • Math, Reading, Science, Writing
  • Remember, less is more!
decision point reports needed
Decision Point: Reports Needed

District-wide Focus

  • Scatter Plots
  • District Value-Added
    • Think ahead if there is only one building per grade
  • Value-Added Summary/Individual schools
  • District (Single Grade) Projection Summary Reports
  • (Optional) Performance Diagnostic Summary
    • If your audience is interested in growth of students at different achievement levels
talking about your results
Talking About Your Results

Think about your message before sharing your results!

  • What do the results mean?
  • Do you have a plan of action regarding the areas needing improvement (Yellow and Red)?
  • What is your plan of action for attending to the Green, Light Blue, and Dark Blue areas?
talking about your results1
Talking About Your Results

Think about your message before sharing your results!

  • What do the results mean?
  • Do you have a plan of action regarding the areas needing improvement (Yellow and Red)?
  • What is your plan of action for attending to the Green, Light Blue, and Dark Blue areas?
decision point session facilitators s
Decision Point: Session Facilitators(s)
  • Principal
  • Team of Principals
  • District Administrator(s)
  • District Administrator(s) + Principal(s)
  • Support from Intermediate Unit PVAAS Contacts
  • PVAAS Statewide Team for PDE
    • Regional sessions for district administrators and School Board members
pvaas public reporting site
PVAAS Public Reporting Site
  • Value-Added (Growth) Reports at District and School Levels
    • Math, Reading, Science, and Writing
    • Grades 4 through 8, and 9-11
  • School Search Capability
    • Allows users to find and view the achievement and progress of groups of students in public schools across the Commonwealth of Pennsylvania.
    • Can search for similar schools based on grade levels tested and various demographics.
  • Web-based scatter plots
preparing for parent requests
Preparing for Parent Requests
  • Parents may ask about data or students.
  • What is available at the student level? Projections!
    • Percent likelihood of a student reaching Basic, Proficient and/or Advanced levels on future PSSA
  • Some PA districts have shared PVAAS student projections with parents.
  • Plan in advance for how to respond such requests
pennsylvania value added assessment system pvaas a compass for improvement

Pennsylvania Value-Added Assessment System (PVAAS):A Compass for Improvement

Presented at [District] School Board Meeting

[Date]

dvd for school boards
DVD for School Boards

PVAAS for

School Board Members

by School Board Members

  • Tom Gentzel, PSBA
  • 2 Superintendents
  • School Board Members
  • 12 minutes
two types of pvaas information
TWO Types of PVAAS Information

Looking Forward/Planning…

PVAAS Projection Reports For Individual Students and Groups of Students

Looking Back/Evaluation…

Value-added Growth Reports For Groups of Students

Today

pvaas is
PVAASIS:
  • Analysis of existing assessment data
    • Longitudinal PSSA scores in available content areas
      • Math, Reading, Science, Writing
    • Provides reliable estimates
  • A measure of a school’s effectiveness
  • Critical Relationship:

Growth Data vs. Achievement Data

pvaas
PVAAS:
  • Is not another test

Critical concept

    • Is not a comparison of single test scores
review of literature
Review of Literature

Is there a relationship between…

  • Demographics vs. Achievement?

YES

  • Demographics vs. Growth?

NO

Demographics are inherently controlled for in PVAAS due to the use of all longitudinal data on students!

slide39

Current Data Collection

Approaches

High Achievement

Average Achievement

Low Achievement

Achievement is based

on each student’s ending point.

slide40

PVAAS Adds Another Variable To Achievement…GROWTH!

Below

Growth

Standard

At or Above

Growth

Standard

Growth is based

on each student’s starting point!!

viewing achievement and progress together

Viewing Achievement and Progress Together

PVAAS Web-based Scatter Plots

scatter plot quadrants and their meanings
Scatter Plot Quadrants and Their Meanings

Quad 2 - Slipping

Higher Achievement

Lower Growth

Quad 1 - Excelling

Higher Achievement

Higher Growth

Quad 4 - Improving

Lower Achievement

Higher Growth

Quad 3 - Underperforming

Lower Achievement

Lower Growth

district scatter plots

District Scatter Plots

Math and Reading

pvaas reporting
PVAAS Reporting
  • District Level Reporting
  • School Level Reporting
  • Grade Level Reporting
    • Reading (Grades 4-8, 11)
    • Math (Grades 4-8, 11)
    • Science (Grades 4, 8, & 11)
    • Writing (Grades 5, 8, & 11)
  • Subgroup Reporting (ex. IEP, ED, ELL)
  • Student Level Reporting
    • Projections to Future PSSA Performance
    • Reading, Math, Science, Writing
    • Grades vary based on subject area
have all of our groups of students met the standard for pa academic growth grades 4 8 grades 9 11

Have all of our groups of students met the standard for PA Academic Growth?Grades 4-8?Grades 9-11?

Value-Added Growth Reports

district school value added report grades 4 through 8 math reading
District/School Value-added ReportGrades 4 through 8: Math & Reading

NOT on Public Site

Question for Educators:

Are all grade levels meeting the standard for PA Academic Growth?

slide59

District/School Value-added ReportGrades 9-11 Math & Reading; Science; & Writing

NOT on Public Site

Question for Educators:

Are all grade levels meeting the standard for PA Academic Growth?

district value added summary report
District Value-added Summary Report

NOT on Public Site

Question for Educators:

Which schools at which grade levels are exceeding the standard for PA Academic Growth?

how well are we supporting our high achieving students or low achieving students

How well are we supporting our high achieving students or low achieving students?

Performance Diagnostic Summary Reports

performance diagnostic summary report
Performance Diagnostic Summary Report

NOT on Public Site

Questions for Educators:

How effective are schools across the district in making academic progress with groups of students at different predicted performance levels? Are there difference in growth patterns across schools?

pvaas projection summary reports pvaas student projection reports

What is the likelihood that students will be reach a Proficient level or higher on a future PSSA? What is their likelihood of reaching an Advanced level?

PVAAS Projection Summary Reports

PVAAS Student Projection Reports

student projection methodology
Student Projection Methodology
  • Is this the same methodology as the one used to estimate growth?
    • No, the projection methodology is a separate modeling process that focuses on individual students.
  • What data are used in this methodology?
    • ALL available longitudinal data in both Reading and Math are used in projection calculations for all four subjects.
  • What students have projections? In what subjects?
    • Projections are available for all students who have a minimum of 2 years of historical data. The next slide details the grade levels and subjects in which projections are reported.
pvaas fall 2011 reporting projections to basic proficient advanced
PVAAS Fall 2011 Reporting: Projections to Basic, Proficient, Advanced

Grade PSSA

Last Taken

Grade PSSA

Last Taken

Grade PSSA

Last Taken

slide67

District (Single Grade)

Projection Summary Report

NOT on Public Site

slide70
Questions:PVAAS Materials or Statewide Implementationpdepvaas@iu13.org717-606-1911PVAAS Report Web Sitehttps://pvaas.sas.com
slide71

www.pde.state.pa.us

333 Market Street Harrisburg, PA 17126

questions from this webinar session pdepvaas@iu13 org 717 606 1911
Questions from this webinar session?pdepvaas@iu13.org717-606-1911