Know your accountability 2013
This presentation is the property of its rightful owner.
Sponsored Links
1 / 146

Know Your Accountability 2013 PowerPoint PPT Presentation


  • 96 Views
  • Uploaded on
  • Presentation posted in: General

Know Your Accountability 2013. Marianne Mottley , Assistant Director, Office of Accountability June 28, 2013. Today’s Topics. New Report Card Calculations Graduation Rate Achievement Gap Closing Progress K-3 Literacy Prepared for Success. Today’s Topics.

Download Presentation

Know Your Accountability 2013

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Know your accountability 2013

Know Your Accountability 2013

Marianne Mottley, Assistant Director, Office of Accountability June 28, 2013


Today s topics

Today’s Topics

  • New Report Card Calculations

    • Graduation Rate

    • Achievement

    • Gap Closing

    • Progress

    • K-3 Literacy

    • Prepared for Success


Today s topics1

Today’s Topics

  • New Report Card Screen Shots

  • New Secure Data Center (SDC) Reports

  • Five Ranking Reports

  • Dropout Recovery Report Card

  • Closure Requirements


Know your accountability 2013

Ohio’s New Report Card

A better tool for parents


Measures phased in

Measures Phased In


Know your accountability 2013

New Report Card Based on Letter Grades

Report card measures grouped into 6 components in 2015.

The 6 components make up the overall grade in 2015.


Know your accountability 2013

Overall Grade & Components

Achievement

Graduation Rate

Overall

Grade

(2015)

K-3 Literacy

Progress

Prepared for Success

Gap Closing


Report card components

Report Card Components


Graduation rate

Graduation Rate

  • Same longitudinal “cohort” calculation used on 2012 report cards

  • Cohort: Students accountable to the school and/or district who were first-time 9th graders four years earlier

    • Accountable: Last school and/or district of accountability

    • Numerator: Number of students in the adjusted cohort who graduated in four years or less

    • Denominator: Total number of students in the adjusted cohort for that class


Graduation rate calculation

Graduation Rate Calculation

  • Adjustments to the cohort made for students who join or leave the school at grade level during the four-year period

  • Adjustments may not be made to reassign a student to a new cohort


Graduation rate1

Graduation Rate

  • Data lagged one year (four-year rate) or two years (five-year rate) to allow summer graduates to be counted

  • Final percentages for Classes of 2011 and 2012 available now


Four year graduation calculation

Four-Year Graduation Calculation

#FY12 Cohort Graduates (includes summer 2012 grads)

# of FY2009 1stTime 9th Graders (grads & non-grads)

plus

# of FY09 1stTime 9th Grade Transfers In (grads & non-grads)

plus

# of Dropouts reported any year from FY2009-FY2012

minus

# of FY2009 First-Time Ninth Grader Transfers Out*

*NOTE: Transfers to Other Ohio Public Schools Must Be Picked Up By Another District or they are Reinstated Transfers that are returned to the withdrawing district/school


4 year graduation rate

4 Year Graduation Rate

** Specified in legislation


4 year graduation rate1

4 Year Graduation Rate


4 year graduation rate2

4 Year Graduation Rate


Five year graduation calculation

Five-Year Graduation Calculation

  • 2011 graduating class updated to reflect mobility during the 2011-12 school year

  • Same business rules apply to the five-year rate that apply to four-year rate

  • Summer graduates from the fifth year are included in the numerator


Five year graduation calculation1

Five-Year Graduation Calculation

#FY11 Cohort Graduates (includes summer 2012 grads)

# of FY2008 1st Time 9th Graders (grads & non-grads)

plus

# of FY08 1st Time 9th Grade Transfers In (grads & non-grads)

plus

# of Dropouts reported any year from FY2008-FY2012

minus

# of FY2008 First-Time Ninth Grader Transfers Out*

*NOTE: Transfers to Other Ohio Public Schools Must Be Picked Up By Another District or they are Reinstated Transfers that are returned to the withdrawing district/school


5 year graduation rate

5 Year Graduation Rate

New Measure

** Specified in legislation


Supplementary emis forms

Supplementary EMIS Forms

  • The process of creating and adjusting graduation cohorts is critical.

  • Problems can arise when an LEA is unable to make necessary adjustments because the appropriate EMIS reporting period has closed.

  • This supplementary EMIS data submission process is NOT designed to give LEAs the opportunity to correct erroneous data submitted during a previous EMIS reporting period.


Supplementary emis forms1

Supplementary EMIS Forms

Two basic requirements:

  • During the appropriate EMIS reporting period, an LEA reported a withdrawal code and reason for a student that kept the student in the denominator of the graduation rate calculation. AND

  • After the appropriate EMIS reporting period had closed, the LEA obtained evidence indicating that a different withdrawal code and reason should have been used and that new code would have removed the student from the denominator of the calculation.


Supplementary emis forms2

Supplementary EMIS Forms

  • LEA is responsible for retaining all supporting evidence for the supplementary EMIS data submission (e.g., transcript requests, record requests, court documents, medical documents, legal documents), which is subject to audit at any time.

  • Any approved cohort reassignments will impact only the Four-Year and/or Five-Year Adjusted Cohort Graduation Rate calculation(s). No other calculations or processes using the EMIS Withdrawal Reason Element will be affected by the supplementary data provided on this form.


Supplementary emis forms3

Supplementary EMIS Forms

  • LEAs must complete a separate form for EACH student where an adjustment is being requested.

  • Deadline to submit requests fro the 2011 graduation rate data was:

    MAY 31, 2013

  • Any requests for changes are subject to audit.


Report card components1

Report Card Components


State indicators

State Indicators

  • 24 Indicators

    • Grades 3-8 Reading (6 tests)

    • Grades 3-8 Math (6 tests)

    • Grades 5 & 8 Science (2 tests)

    • 10th Grade OGT (5 tests)

    • 11th Grade OGT (5 tests)

  • No Attendance or Graduation


State indicators1

State Indicators

  • Same Where Kids Count Rules (FAY applies)

  • Same FERPA masking rules (At least 10 accountable students to have an indicator reported)


State indicators2

State Indicators

  • 2013 – 75% proficiency standard (85% required for 11th grade OGT)

  • 2014 Proficiency standard increases to 80% (11th grade stays at 85%)

  • 2015 New assessments implemented; do not know what new standard will be


State indicators3

State Indicators

  • One extra step in calculation

  • Once number of indicators met is calculated, turn the number into a percentage of the total indicators possible and assign a letter grade

  • Denominator is the number of indicators with unmasked (“N” >=10) data for the school or district – it can be less than 24


State indicators current 75 proficient standard

State Indicators – Current 75% Proficient Standard

** Specified in legislation


State indicators current 75 proficient standard1

State Indicators – Current 75% Proficient Standard


State indicators 75 proficient

State Indicators – 75% Proficient


2014 state indicators 80 proficient

2014 State Indicators – 80% Proficient

** Specified in legislation


State indicators 80 proficient

State Indicators – 80% Proficient


State indicators 80 proficient1

State Indicators – 80% Proficient


Performance index

Performance Index

  • Measures the achievement of every student, not just whether or not they reach proficient.

  • Schools receive points for every student’s level of achievement.


Performance index1

Performance Index

  • Same Where Kids Count Rules (FAY applies)

  • Same basic calculationof assigning points based on percentages in each performance category

  • Same weights for each existing category

  • One new weight


Performance index new weight

Performance Index – New Weight

  • Students on formal “Acceleration” plans earn higher weights

    • Students in “Proficient” range = “Accelerated” weight

    • Students in “Accelerated” range = “Advanced” weight

    • Students in “Advanced” range = “Advanced Plus” weight of 1.3


Performance index calculation

Performance Index Calculation


Performance index calculation1

Performance Index Calculation

  • “Perfect” PI Score = 120 Points

  • Calculate percentage of points earned

    91.6/120 = 76.3%


Performance index2

Performance Index

** Specified in legislation


Performance index3

Performance Index


Performance index4

Performance Index


Report card components2

Report Card Components


Gap closing annual measurable objectives

Gap Closing (Annual Measurable Objectives)

  • Measures the academic performance of specific groups of students

  • Replaces old AYP calculation

  • More realistic targets, but more aggressive improvement (gap closing) expected to earn top letter grades


Gap closing similarities to ayp

Gap Closing-Similarities to AYP

  • Same Where Kids Count Rules

  • Same 10 subgroupsevaluated

  • Same “N” size of 30 for Proficiency

  • Same “N” size of 40 for Participation

  • Same Attendance Goal (93%)

  • Same Participation Rate Goal (95%)


Gap closing differences from ayp

Gap Closing – Differences from AYP

  • A single AMO for reading and math versus seven different AYP goals

  • Graduation AMO for 4-Year Rate Only


Gap closing differences from ayp1

Gap Closing – Differences from AYP

  • AYP calculation yielded a “Met” or “Not Met” label.

  • AMO calculation yields a letter grade of “A” through “F”.

  • Final AMO grade of “C” or better analogous to “meeting” AYP


Gap closing differences from ayp2

Gap Closing – Differences from AYP

  • No School or District Improvement Status

    • No public school choice or supplemental educational services

    • No parent letters

  • Replaced by “Priority” (lowest 5%) and “Focus” (lowest 10%) schools

    • Waiver requires implementation of school turnaround model


Gap closing differences from ayp3

Gap Closing – Differences from AYP

  • If AMO is not met, points are awarded based on amount of improvement (Gap Closing) between prior year and current year.

  • No Safe Harbor provision

  • No Growth provision


Gap closing differences from ayp4

Gap Closing – Differences from AYP

  • Attendance Rate used as demotion tool

  • Participation Rate used as demotion tool

  • Low subgroup performance on reading/math/graduation used as demotion tool


Gap closing points calculation

Gap Closing – Points Calculation

Four Rules

  • If the AMO is met assign 100 points

  • If the amount of improvement exceeds the current year gap assign 100 points

  • If improvement is made, but it does not exceed the gap, assign points between zero and 100

  • If the performance declines, and AMO is not met, assign zero points


Gap closing points calculation1

Gap Closing – Points Calculation

Rule 1 - If the AMO is met assign 100 points

  • 2013 AMOs

    • Reading = 83.4%

    • Math = 78.5%

    • Graduation 75.9%


Gap closing points calculation2

Gap Closing – Points Calculation

Equals

Improvement

Current Year Gap

Current Year Proficiency – Previous Year Proficiency

Current Year AMO – Current Year Proficiency


Gap closing points calculation3

Gap Closing – Points Calculation

Improvement

100

Points Awarded

X

=

Current Year Gap

Calculation used to determine points awarded

for

Rules 2, 3 and 4


Gap closing points calculation4

Gap Closing – Points Calculation

Rule 2 – If the amount of improvement exceeds the current year gap assign 100 points

  • Calculation

    • 2013 Percentage – 2012 Percentage = Improvement

    • 2013 AMO – 2013 Percentage = Current Year Gap


Gap closing reading example 1

Gap Closing – Reading Example 1

2012 – Proficiency = 70%

2013 Proficiency = 80%

2013 Reading AMO = 83.4%

80.0%-70.0% = 10%

83.4% - 80% = 3.4%

Note – Fraction 10/3.4 is greater than 1.0 --- this means the amount of improvement (10%) exceeds the current year Gap (3.4%) and 100 points are assigned per Rule #2


Gap closing points calculation5

Gap Closing – Points Calculation

Rule 3 - If improvement is made, but it does not exceed the gap, assign points between zero and 100

  • Calculation

    • 2013 Percentage – 2012 Percentage = Improvement

    • 2013 AMO – 2013 Percentage = Current Year Gap


Gap closing reading example 2

Gap Closing – Reading Example 2

2012 – Proficiency = 70%

2013 Proficiency = 75%

2013 Reading AMO = 83.4%

75.0%-70.0% = 5%

59.5 Points Awarded

=

100

X

83.4% - 75% = 8.4%

Note – Fraction 5/8.4 is less than 1.0 --- this means the amount of improvement (5%) was less than the current year Gap (8.4%) and points are assigned per Rule #3


Gap closing points calculation6

Gap Closing – Points Calculation

Rule 4 - If the performance declines, and AMO is not met, assign zero points

  • Calculation

    • Compare 2013 percentage to 2012 percentage

    • If 2013 percentage is smaller; and,

    • If 2013 AMO is not met

    • Award ZERO points


Gap closing reading example 3

Gap Closing – Reading Example 3

2012 – Proficiency = 75%

2013 Proficiency = 70%

2013 Reading AMO = 83.4%

70.0%-75.0% = -5%

0 Points Awarded

=

100

X

83.4% - 70% = 13.4%

Note – Fraction -5/13.4 is a negative number -- this means there was no improvement and instead the gap grew so no points are assigned per Rule #4


Gap closing

Gap Closing

Two Final Rules

  • Points are capped at 100

  • Points are “floored” at ZERO


Gap closing1

Gap Closing


Gap closing2

Gap Closing


Gap closing3

Gap Closing


Gap closing4

Gap Closing

Once sub-component points are awarded, they are averaged to get the letter grade.

Note --- reading, math and graduation are weighted EQUALLY in the final calculation.


Gap closing5

Gap Closing


Gap closing demotions

Gap Closing Demotions

  • Four rules can demote the preliminary letter grade.

  • Two rules only apply if the preliminary grade equals an “A”

  • Two rules apply to ALL letter grades, including an “F”


Gap closing demotions1

Gap Closing Demotions

Cannot earn an “A” if a subgroup has a proficiency % <=70%*

Cannot earn an “A” if a subgroup has a graduation % <=70%*

*- This is done by deducting 10 percentage points from the preliminary score or . 10.1 points in the special case where the school/district has a perfect score of 100%


Gap closing demotions2

Gap Closing Demotions

Any preliminary grade will be demoted by one level if a subgroup has less than 95% participation rate*

Any preliminary grade will be demoted by one level if a subgroup has less than 93% attendance rate*

*- This is done by deducting 10 percentage points from the preliminary score or 10.1 points in the special case where the school/district has a perfect score of 100%


Gap closing6

Gap Closing


Gap closing7

Gap Closing


Gap closing8

Gap Closing


Gap closing9

Gap Closing

Final Rules

  • Maximum of one letter grade demotion regardless of how many criteria are met

  • Demotions handled through a 10 point deduction to move to next lower level (10.1 points for LEAs with 100% met)

  • “F” grades also have the 10 point deduction


Gap closing annual measurable objectives1

Gap Closing (Annual Measurable Objectives)


Gap closing10

Gap Closing


Gap closing11

Gap Closing


Report card components3

Report Card Components


Progress component

Progress Component

  • All Students (overall rating of a school or district)

  • Gifted Students (math, reading or superior cognitive only)

  • Students with Disabilities (all students who have an IEP and take the OAA)

  • Students in the Lowest 20 Percent of Achievement Statewide (based on distribution of scores for the entire state)


Value added progress

Value-Added-Progress


Value added overall

Value-Added: Overall


Value added overall1

Value-Added: Overall


Value added gifted

Value-Added: Gifted


Value added gifted1

Value-Added: Gifted


Value added lowest 20

Value-Added: Lowest 20%


Value added lowest 201

Value-Added: Lowest 20%


Value added students with disabilities

Value-Added: Students with Disabilities


Value added students with disabilities1

Value-Added: Students with Disabilities


Report card components4

Report Card Components


K 3 literacy

K- 3 Literacy

2013-2014 – Measure Graded

2014-2015 – Component Graded


Report card components5

Report Card Components


Prepared for success

Prepared for Success

  • College Admission Test (participation rate and percent receiving non-remediation score)

  • Dual Enrollment Credits (percent earning at least three credits)

  • Industry Credentials (percent of students with a credential)

  • Honors Diplomas Awarded (percent of students with an Honors Diploma)

  • Advanced Placement (participation rate and percent scoring three or above)

  • International Baccalaureate Program (participation rate and percent scoring four or above)


Prepared for success1

Prepared for Success

2013-2014 – Measures Reported

2014-2015 – Component Graded


Local report card rollout timeline august 2013

Local Report Card Rollout TimelineAugust 2013

No Component or Overall Grade Calculated


Local report card rollout timeline august 2014

Local Report Card Rollout TimelineAugust 2014

No Component or Overall Grade Calculated


Local report card rollout timeline august 2015

Local Report Card Rollout TimelineAugust 2015

Component and Overall Grade Calculated


Local report card rollout timeline august 2016

Local Report Card Rollout TimelineAugust 2016

Component and Overall Grade Calculated


Rankings

Rankings

Five different “lists” that rank from top to bottom

Applies To:

  • Traditional Districts and Schools

  • Community Schools

  • STEM schools

    Dropout Recovery School Exempt


Performance index score rankings

Performance Index Score Rankings

Ranking of PI Scores from highest to lowest

  • Traditional Districts

  • Community Schools

  • STEM schools

  • Proxy for entities with no PI score


Performance growth ranking

Performance Growth Ranking

Student performance growth from year to year, using the value-added progress dimension

Other measures of student performance growth designated by the superintendent of public instruction for subjects and grades not covered by the value-added progress dimension


Operating expenditures rankings

Operating Expenditures Rankings

  • Current operating expenditures per pupil

  • Of total current operating expenditures, percentage spent for classroom instruction


Gifted data ranking

Gifted Data Ranking

Performance of students identified as gifted

Opportunities provided to students identified as gifted

Must use value-added progress dimensions, if applicable


Local report card landing page

Local Report Card Landing Page


Know your accountability 2013

Planned Fiscal Button


Graduation sdc report

Graduation SDC Report


Graduation sdc report1

Graduation SDC Report


Sdc pi score

SDC PI Score


Know your accountability 2013

SDC Indicators


Gap closing12

Gap Closing


Know your accountability 2013

DOPR School Definition

Community schools that primarily serve students enrolled in dropout prevention and recovery programs.

  • Community schools with closure waivers or that meet the closure waiver criteria

  • Conversion community schools with roll up waivers

  • Community schools that operate a drug recovery program in cooperation with a court


2012 2013 dopr report card

2012-2013 DOPR Report Card

Reported Indicators

  • 4, 5 and 6 Year Graduation Rates*

  • High School Assessment Passage*

  • Annual Measurable Objectives

    * Statewide average score for DOPRs will be reported


2013 2014 dopr report card

2013-2014 DOPR Report Card

Rated Indicators

  • 4, 5, 6 and 7 Year Graduation Rates

  • High School Assessment Passage

  • Annual Measurable Objectives

    Reported Indicators

  • Growth (reported if available)

  • Student Outcomes


2014 2015 dopr report card

2014-2015 DOPR Report Card

Rated Indicators

  • 4, 5, 6, 7 and 8 Year Graduation Rates

  • High School Assessment Passage

  • Annual Measurable Objectives

  • Growth

  • Overall Designation

    Reported Indicators

  • Student Outcomes


Overall designation relative weight of indicators

Overall DesignationRelative Weight of Indicators

  • Graduation Rate - 30 Percent

  • High School Assessment Passage – 20 Percent

  • Annual Measurable Objectives – 20 Percent

  • Growth – 30 Percent


Applicable performance levels

Applicable Performance Levels

  • Exceeds Standards

  • Meets Standards

  • Does Not Meet Standards


Graduation rate2

Graduation Rate

4 Year Rate

5 Year Rate

6 Year Rate

7 Year Rate

8 Year Rate


Know your accountability 2013

Dropout Ratings


Dropout ratings

Dropout Ratings


Dropout ratings1

Dropout Ratings


Know your accountability 2013

High School

Assessment

Passage


2012 data

2012 Data


Annual measurable objectives amos

Annual Measurable Objectives (AMOs)


Amo benchmarks

AMO Benchmarks


Know your accountability 2013

Statement of Intent

By March, 2015Based on analysis of 2013 and 2014 dropout prevention and recovery dataReview performance levels and amend benchmarks if warranted


Know your accountability 2013

DOPR Closure Criteria

Any DOPR school rated “Does Not Meet Standards” for 2 out of the 3 most recent school years will have to close.First Identified 2015-2016First Closed 2016-2017


Know your accountability 2013

General Ed Closure Criteria

Group 1 The school does not offer a grade level higher than grade 3Group 2 The school offers any of grade levels 4 through 8 but none higher than grade 9Group 3 The school offers any of grade levels 10 through 12, regardless of lower grades offered


Group 1 general ed closure criteria

Group 1 General Ed Closure Criteria

In 2 of the 3 most recent school years the school has been:

  • Academic Emergency (ends 11-12); or

  • F on Improving K-3 Literacy (starts 13-14); or

  • Overall Grade of F (starts 14-15)


Group 2 general ed closure criteria

Group 2 General Ed Closure Criteria

In 2 of the 3 most recent school years the school has been:

  • Academic Emergency (ends 11-12); or

  • F on Performance Index Score and F on Value-Added (starts12-13); or

  • Overall Grade of F andF on Value-Added (starts14-15)


Group 3 general ed closure criteria

Group 3 General Ed Closure Criteria

In 2 of the 3 most recent school years the school has been:

  • Academic Emergency (ends 11-12); or

  • F on Performance Index Score and Has Not Met Annual Measurable Objectives (starts 12-13); or

  • Overall Grade of F andF on Value-Added (starts 14-15)


Value added and the closure criteria

Value-Added and the Closure Criteria

For the purpose of the closure criteria only, value-added will be calculated using assessment scores only for students enrolled in the school for the full academic year for at least the 2 most recent school years.

This will not impact value-added calculations used in the traditional Local Report Card system.


Exemptions from general ed closure criteria

Exemptions from General Ed Closure Criteria

Special Education Schools: Schools in which a majority of students are children with disabilities receiving special education and related services are not evaluated for closure.

Dropout Prevention and Recovery Schools:Schools that primarily serve students enrolled in dropout prevention and recovery programs are evaluated for closure under ORC 3314.351.


Social media

Social Media

Ohio Families and Education

Ohio Teachers’ Homeroom

ohio-department-of-education

storify.com/ohioEdDept

@OHEducation

OhioEdDept


Education ohio gov

education.ohio.gov


  • Login