accountability scorecards n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Accountability Scorecards PowerPoint Presentation
Download Presentation
Accountability Scorecards

Loading in 2 Seconds...

play fullscreen
1 / 34

Accountability Scorecards - PowerPoint PPT Presentation


  • 87 Views
  • Uploaded on

Accountability Scorecards. An Early Orientation to the Future of Michigan School Accountability October 23-24, 2012. Background Information. Michigan applied and was approved for ESEA flexibility for 2012-13 school year and onward.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

Accountability Scorecards


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
accountability scorecards

Accountability Scorecards

An Early Orientation to the Future of Michigan School Accountability

October 23-24, 2012

background information
Background Information
  • Michigan applied and was approved for ESEA flexibility for 2012-13 school year and onward.
  • MDE worked extensively with stakeholder groups and negotiations with USED to determine necessary changes and a new direction for Michigan’s School Report Cards.
  • The preliminary and public accountability results for the 2012-13 school year will look and feel brand new but have familiar pieces and parts.
  • The new report cards will be known as the:

“Michigan School Accountability Scorecards”

logistics
Logistics
  • Preliminary Scorecards for2012-13 will reside on the newly-redesigned BAA Secure Site (set to launch July 2013).
      • Users will have to be authorized and login to the site using their MEIS account.
      • Permissions to view the report cards will be handled in the district.
      • Any appeals to the preliminary scorecards will be handled through the new BAA Secure Site, similar to previous years.
  • Public Scorecards will reside on MISchoolData.org with the other accountability designation results such as the Top-to-Bottom Rankings.
overview
Overview
  • Two “levels” of Accountability Scorecards:

DistrictScorecards & SchoolScorecards

  • Scorecards will use a color coding system (green, light green, yellow, orange, and red) to indicate school performance.
  • Combines traditional accountability metrics with Top-to-Bottom labels and other state/federal requirements.
  • Overall color is determined by Top to Bottom status as well as points earned by meeting traditional AYP requirements.
      • Individual “cells” use red/yellow/green coding scheme
      • Points-based system where full points earned for meeting a target, half points earned for meeting safe harbor
color coded scorecards
Color-Coded Scorecards
  • Colors are given to schools and districts for each “scorecard component” and an overall color.
  • Overall status color is determined using a point-based system from the number of target areas the school/district has met and the school ranking.

Decreasing # points received and increasing # targets not met…

*These may not be the exact shades utilized in the final scorecard product (still under development).

what changed
What Changed?
  • Additional subgroup: Bottom 30%
  • Attendance target of 90% -(only for school, no subgroups)
  • Differentiated proficiency targets
      • Based on a school’s past performance
      • Goal of 85% proficient at end of 2021-22
      • Targets increase in 10 equal increments
  • Safe Harbor based on 80th percentile of statewide proficiency
      • Use school/district improvement slope to determine met/not met
  • Inclusion of Educator Effectiveness label reporting and TSDL completion in Scorecards
  • Inclusion of Compliance Factors (SIP & SPR)
slide8

Most of the nuts and bolts of AYP

have remained the same!

what stayed the same
What Stayed the Same?
  • Participation requirement = 95% for school/district overall and all valid subgroups
    • Multi-year averaging remains in place (up to three years)
  • Graduation requirement = 80% for school/district overall and all valid subgroups
    • Four, five, and six-year rates
    • Graduation “safe harbor”
  • Use of provisional and growth scores for accountable proficiency rates
school and district scorecard subgroups
School and District Scorecard Subgroups
  • All Students
  • Bottom 30% (for proficiency calculations only) NEW!
  • American Indian or Alaska Native
  • Asian
  • Black or African American
  • Native Hawaiian or Pacific Islander
  • White
  • Two or more races
  • Hispanic of any races
  • Economically Disadvantaged
  • English Language Learners
  • Students with Disabilities
  • Shared Education Entity (SEE) (district-level only)
participation
Participation
  • 95% of students are still required to be tested to meet the assessment participation target for the scorecard.
      • If student group size is 30-39, target is no more than two non-participants (this makes it so that a single student cannot result in not meeting the target participation rate).
      • If student group size is 40 or more, target is 95% participation
      • Participation rate is rounded to nearest hundredth
      • If the “All Students” group does not have at least 30 students in one test cycle, a participation average will be calculated using up to three years of data in order to accumulate at least 30 students
      • Multi-year averaging used help meet the participation req.
participation target
Participation Target
  • Two options for school/district color status for this target area.

95% Assessed Met 95% Assessed Not Met

*These colors are given ONLY on the participation target portion of the scorecard. This does not change your entire school/district status.

proficiency targets
Proficiency Targets

Targets are based on 2011-12 proficiency rates:

  • (85 – current percent proficient) / 10 = annual increment
  • Increments do not reset
  • Example (next slide)
example proficiency targets
Example Proficiency Targets

School has 65% proficiency in 2011-12 school year. School must be 85% proficient by 2021-22 school year.

Subtract baseline target from end target rate and divide by the number of school years in between.

(85 – 65)/10 = +2% annual increment of target

The school’s target would be 67% in 2012-13, 69% in 2013-14, 71% in 2014-15, and so on.

proficiency targets example
Proficiency Targets Example

Example school ends at (at least) 85% proficient in subject

Example school starts from 65% proficient in subject

multi year proficiency calculations
Multi-year Proficiency Calculations
  • Multi-year weighted proficiency averages are used in cases where a single year’s proficiency rate is not meeting the school’s target
  • Weighting is based on the school’s assessed enrollment in each year
  • Up to three years are used in this sequence:

1. Calculate single year proficiency rate. Go to 2 if target is not met.

2. Calculate weighted two year proficiency rate. Go to 3 if target is not met.

3. Calculate weighted three year proficiency rate. Go to 4 if target not met.

4. Calculate Safe Harbor. If not met, cell is red (0 points).

proficiency cell basics
Proficiency “Cell” Basics
  • All valid subgroups will have a proficiency cell with possible points
  • Districts will potentially have a SEE subgroup if they are a SEE member district with at least 30 FAY SEE students
  • Schools and districts will always have an “All Students” group, even with one FAY student
  • All assessed content areas will have cells (Reading, Mathematics, Writing, Science, and Social Studies)
proficiency cell colors and points
Proficiency Cell Colors and Points
  • Green cells are worth two points and are earned by meeting the school’s or district’s proficiency target
  • Yellow cells are worth one point and are earned by meeting the Safe Harbor target (instead of meeting the proficiency target)
  • Red cells are worth zero points and are earned by not meeting proficiency or Safe Harbor targets
  • The Bottom 30% subgroup will earn a green cell and two points by meeting the Safe Harbor target
accountable proficient versus proficient
“Accountable Proficient” versus Proficient

Students considered proficient are…

vs.

For ‘True Proficiency’ purposes:

  • Performance Level 1 or 2

For ‘Accountable Proficiency’ purposes:

  • Students must attain a performance level of 1 or 2 –OR–
  • Students must attain a scale score that is within 2 standard errors of the proficient cut score (provisionally proficient). –OR–
  • Students must demonstrate growth at a rate that will allow them to reach proficiency in three years (growth proficient).
accountable proficient versus proficient1
“Accountable Proficient” versus Proficient

Considerations:

  • Provisional proficiency and growth proficiency are helpful in meeting proficiency target rates but do not match your MEAP/MME raw reports and MISchoolData.
  • Proficiency rates in MISchoolData and on MME/MEAP reports will also be different from from accountable proficiency rates because the accountable rates only reflect Full Academic Year (FAY) students.
graduation rates
Graduation Rates

3 Possible colors to receive for this target area:

  • If a school/subgroup has a graduation rate of at least 80%, it will receive a green cell (2 points).
  • If it makes the graduation rate improvement target, it will receive a yellowcell (1 point).
  • If it misses both the rate and the improvement target, they will receive a red cell (0 points).

Audit:

* A school/district’s overall status color is automatically yellow if it has a redfor the “All Students” group for this target.

attendance rates
Attendance Rates

2 Possible colors to receive for this target area:

  • If a school meets the attendance target, it will receive a green cell (2 points) for attendance rate.
  • If a school meets the attendance improvement target, it will receive a yellowcell (1 point).
  • If it misses the attendance target, they will receive a redcell (0 points).

Audit:

*A school/district receiving a red indicator for attendance cannot have an overall color ranking better than yellow.

educator evaluations new
Educator Evaluations (NEW!)
  • Educator Evaluations are based on State law. All of Michigan’s educators will be evaluated using measures of student growth and the results of these evaluations will be reported into MDE’s data systems.
  • Educator Evaluations will be reported as “In Good Standing” or “Not in Good Standing” based on compliance with State law.
  • Two components make up the Educator Evaluations section
    • Effectiveness Labels Completion rate (100% target)
    • TSDL Student Inclusion rate (95% target)
  • 2 Possible colors to receive for this target:
    • Those in good standing will receive a green cell.
    • Those not in good standing will receive a red cell.
compliance factors partially new
Compliance Factors (PARTIALLY NEW!)
  • Compliance Factors are based on State law. All schools are required by State law to have a School Improvement Plan (SIP), and to complete School Performance Indicator (SPR)reports.
  • If a school completes all of its required reports it will receive a green cell for the Compliance Factors. If a school does not complete its required reports, it will receive a red cell for Compliance Factors.
  • 2 Possible colors to receive for this target:
    • Those with completed reports receive a green cell.
    • Those with incomplete reports receive a red cell.
the point based system for overall school district color status
The Point-Based System for Overall School/District Color Status
  • Target areas on the Accountability Scorecard are worth points that contribute to your school or district overall status color.
  • In general, meeting a target will yield 2 pts or the full point value.
  • Meeting a target through safe harbor or improvement will yield 1 point or half the point value (NOT true for Ed Evals and Compliance Factors targets)
  • Not meeting a target will yield 0 points.
  • We determine the school/district’s % points received and apply it the color scale: Green: pts>85% Orange: 50%<pts<60% Light Green: 70%<pts<85% Red: pts<50% Yellow:: 60%<pts<70%
totaling up your points
Totaling up your Points
  • Add up the number of received points for your school/district
  • Add up the number of possible points for your school/district

# Received Pts = % Points Received

# Possible Pts

  • Apply the percent of received points to the color scale
  • Apply “secondary rules” for target areas if applicable
    • ie: % points indicates this to be a green school BUT the school did not have teacher effectiveness labels reported, school’s overall color now becomes yellow.
how do we receive an overall green status
How do we receive an overall‘green’ status?
  • School not labeled as Priority
  • School/district meets 95% participation requirement for all valid student groups
  • School/district attains 85% or greater of possible points in AYP areas
how do we receive an overall light green status
How do we receive an overall ‘light green’ status?
  • School/district attains at least 70% but less than 85% of possible points in AYP areas
  • School/district meets 95% participation requirement for all valid student groups
how do we receive an overall yellow status
How do we receive an overall ‘yellow’ status?
  • School/district has a red in one or more subgroups because of not meeting proficiency targets
  • School/district has a red because of not meeting overall graduation target (“All Students” group)
  • School/district has a red because of not meeting overall attendance targets
  • School/district has one red in one of the subgroups or one “All Students” group because of not meeting participation target
  • School/district has a red in the Educator Evaluation section
  • School has a red in the Compliance with State Law section
  • School/district attains 60% - less than 70% of possible points in AYP areas
how do we receive an overall orange status
How do we receive an overall ‘orange’ status?
  • School/district attains at least 50% but less than 60% of possible points in AYP areas
  • School/district has two red subgroup participation cells or a combination of one red “All Students” group and one red subgroup cell
how do we receive an overall red status
How do we receive an overall ‘red’ status?
  • School labeled as Priority
  • School/district attains less than 50% of possible points in AYP areas (more details later)
  • School/district has less than 95% participation rate (red cell) in at least two content areas for the “All Students” group
  • School/district has more than two red subgroup participation cells or a combination of one red “All Students” group and two or more red subgroup cells
timeline for the accountability scorecards
Timeline for the Accountability Scorecards
  • Winter 2013 – Continued development of Scorecard Website
  • Spring 2013 – Staff Training and Support Materials Development
  • Summer 2013 – Release of Preliminary and then Public Results
questions comments
Questions? Comments?

We’re here to help!

Ask us today or contact:

MDE-Accountability@Michigan.gov

-OR- (517) 373-1342