Reading your accountability reports u pass ayp amao
Download
1 / 116

Reading your Accountability Reports U-PASS AYP AMAO - PowerPoint PPT Presentation


  • 249 Views
  • Uploaded on

Reading your Accountability Reports U-PASS AYP AMAO. Judy Park, Assessment & Accountability Director Russell Klein, Results Coordinator Utah State Office of Education August 2006. Reading your Accountability Reports U-PASS, AMAO, AYP. August 18 – Sevier D.O., 180 E 600 N, Richfield

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Reading your Accountability Reports U-PASS AYP AMAO' - Leo


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Reading your accountability reports u pass ayp amao l.jpg

Reading your Accountability Reports U-PASSAYPAMAO

Judy Park, Assessment & Accountability Director

Russell Klein, Results Coordinator

Utah State Office of Education

August 2006


Reading your accountability reports u pass amao ayp l.jpg

Reading your Accountability ReportsU-PASS, AMAO, AYP

August 18 – Sevier D.O., 180 E 600 N, Richfield

August 22 – Granite D.O., 2500 S. State St., Salt Lake

August 23 – Weber D.O., 5320 S. Adams Ave. Pkwy, Ogden

August 25 – Nebo Learning Center, 570 S. Main St., Springville



U pass l.jpg
U-PASS

  • State Accountability

  • Required by State Law

  • School level report

  • Based on multiple assessments

  • Includes attendance & graduation rate

  • 2006 – schools without a 12th grade only

  • 2007 – all schools


U pass accountability plan l.jpg
U-PASSAccountability Plan

  • Student Participation on Assessments

  • Status Scores

    • Percentage of students proficient on the collection of assessments and other indicators

  • Progress Scores

    • Longitudinal measure based on comparing the achievement levels of the same student from one year to the next



U pass accountability plan7 l.jpg
U-PASSAccountability Plan

  • Student Participation

    • 95%

  • Acceptable Status Score

    • 80%

  • Progress Score

    • Low 0 – 189

    • Medium 190 - 214

    • High 215 - 400



Schools will be identified as l.jpg
Schools will be identified as:

  • Achieved State Level of Performance

    • Participation is 95% and

    • Total School AND Subgroup Status is acceptable (80%) or progress is medium (190) or high

  • Needs assistance

    • Participation is less than 95% or

    • Total School or Subgroup Status is not acceptable and progress is low


Schools without a 12 th grade status and progress score l.jpg

Language Arts (35%)

ELA CRT (35%)

Or

ELA CRT (30%)

& DWA 5%

Math (35%)

Math CRT

Science (20%)

Science CRT

Attendance (10%)

Schools without a 12th gradeStatus and Progress Score


U pass accountability plan11 l.jpg
U-PASS Accountability Plan

  • Aggregate Subgroup Accountability

    • Every student who belongs to a subgroup other than white

    • Individual student proficiencies are added together and divided by the number of students to determine the subgroup proficiency level

  • Any individual subgroup not meeting proficiency will appear on the front page of the report


U pass accountability plan12 l.jpg
U-PASS Accountability Plan

  • Subgroup Status Accountability.

    • Allows greater accountability.

      • Students in a subgroup with less than 10 are now included in the aggregate calculation.

    • Students are more fairly represented.

      • Each student only counts once, regardless of the number of subgroups in which the student qualifies.

    • Increased reliability.

      • We are evaluating a larger group.

      • More students and more schools are represented.

    • Increased validity.

      • We do not overweight small populations.

      • This lifts the burden of one subgroup being the sole determinant of unacceptable status of the school.


The 2006 u pass report l.jpg
The 2006 U-PASS Report

  • Web-based report format

  • An increased amount of information available on each school

  • Allows for “drill-down” information


Slide15 l.jpg

1


Slide16 l.jpg

2


Slide17 l.jpg

3



Slide19 l.jpg

Subgroups

Needing

Assistance


Slide20 l.jpg

Status

“Drill Down”



Slide22 l.jpg

Click on Grade Score for Further Drill Down

Second Level “Drill Down”


Slide23 l.jpg

Third Level “Drill Down”

Boxes expand on ‘mouseover’


Slide24 l.jpg

Progress

“Drill Down” coming in October



U pass26 l.jpg
U-PASS

  • Additional Information:

    • NRT

    • ACT/SAT

    • AP

    • Concurrent Enrollment

    • School Summary Information

    • Student Summary Information

    • Percent of student reading on grade level

      • (reported for grades 1-10)

    • Dropout Rate (disaggregated by ’08)

    • Disciplinary Action

    • Course Taking Patterns and Trends



Schools with a 12 th grade l.jpg
Schools with a 12th Grade

  • Assessment Drill Downs

  • Additional Information




Slide34 l.jpg
AYP

  • Federal Accountability

  • Required by Federal NCLB Title I Law

  • School, District & State level Reports

  • Based on Language Arts CRT & Math CRT

  • Includes attendance & graduation rate


Ayp 2006 level 1 l.jpg
AYP 2006Level 1

  • Three parts:

    • Participation in testing

    • Academic achievement

    • School attendance / graduation

  • All-or-nothing concept


Slide36 l.jpg

1

3

2


Ayp 2006 level 137 l.jpg
AYP 2006Level 1

  • Did the school make AYP?

  • Math vs. Language Arts?

  • AMO (Annual Measurable Objectives) same as last year

  • Consequences only for Title I schools


Slide38 l.jpg

4

1

3

3

2


Ayp 2006 level 140 l.jpg
AYP 2006Level 1

  • WHICH STUDENTS ARE IN THE AYP SCHOOL REPORTS?


Students in ayp u pass school reports l.jpg
Students in AYP & U-PASS School Reports

  • Two large data collections

    • 1) End-of-Year Clearinghouse

    • 2) Core CRT Files

  • These Two Files Need To Match To Be On AYP & U-PASS School Reports!

  • 6 Fields for Matching: District#, School#, Last Name, First Name, Date of Birth, Gender

  • As of Spring ’06 – SSID!





Ayp 2006 level 145 l.jpg
AYP 2006Level 1

  • Questions?


Ayp 2006 level 2 l.jpg
AYP 2006Level 2

  • Status vs. Safe Harbor (Improvement)

  • Safe Harbor

    • 10% reduction in % of students not proficient


Ayp 2006 safe harbor improvement l.jpg
AYP 2006Safe Harbor (Improvement)

Not Proficient

Proficient

Status


Ayp 2006 safe harbor improvement48 l.jpg
AYP 2006Safe Harbor (Improvement)

Not Proficient

Proficient

Status


Ayp 2006 safe harbor improvement49 l.jpg
AYP 2006Safe Harbor (Improvement)

Improvement


Ayp 2006 safe harbor improvement50 l.jpg
AYP 2006Safe Harbor (Improvement)

Improvement


Ayp 2006 safe harbor improvement51 l.jpg
AYP 2006Safe Harbor (Improvement)

Good for Improvement

Shows Improvement

Good

for

Status

Improvement

Does not show improvement

Not Proficient

Proficient

Status


Ayp 2006 safe harbor improvement52 l.jpg
AYP 2006Safe Harbor (Improvement)

Made AYP

Made AYP

Shows Improvement

Improvement

Made AYP

Does not show improvement

Not Proficient

Proficient

Status




Ayp 2006 level 255 l.jpg
AYP 2006Level 2

  • Safe Harbor

    • Additional Indicator is only used when Safe Harbor calculation is needed


Ayp 2005 level 2 l.jpg
AYP 2005Level 2

  • Confidence Interval on Status

    • 99%

  • Confidence Interval on Safe Harbor

    • 75%

  • Participation & Additional Indicator

    • N/A


Confidence interval l.jpg
ConfidenceInterval

  • Voting – exit polls




Ayp 2006 level 260 l.jpg
AYP 2006Level 2

  • N size – 10 vs. 40

  • Small N = Automatic YES


Ayp 2006 level 261 l.jpg
AYP 2006Level 2

  • N=40 participation, attendance, and graduation

  • N=10 academic achievement


Ayp 2006 l.jpg
AYP 2006

  • Graduation rate – 85.7%

    • One year delayed (have until Sep 1)

    • 05 data from warehouse

    • 04, 03 data from USOE statistical files

  • Quality of data has improved

  • 40 ways to make (or not make) AYP


Slide67 l.jpg

Times 10

40 ways to make (or not make) AYP






Ayp 2006 level 272 l.jpg
AYP 2006Level 2

  • Questions?


Ayp 2006 level 3 l.jpg
AYP 2006Level 3

  • Definition of “safe harbor”

  • Definition of “participation”

  • Definition “confidence intervals”

  • Definition of “graduation rate”

  • UAA


Ayp 2006 level 374 l.jpg
AYP 2006Level 3

  • Questions?


Ayp 2006 did your school make it l.jpg
AYP 2006Did your school “make it”?

  • Participation – DID YOU MEET IT?

  • Participation – Is the N size less than 40?

  • Did they have 95% participation?

  • Did they average 95% participation over the last three (or two) years?


Ayp 2006 did your school make it76 l.jpg
AYP 2006Did your school “make it”?

  • Status – Is the subgroup size less than 10?

  • Status – Is the % proficient enough?

  • Status – If the % proficient is not enough – does the confidence interval change it?


Ayp 2006 did your school make it77 l.jpg
AYP 2006Did your school “make it”?

  • Safe Harbor – Is there a 10% reduction in students not proficient?

  • Safe Harbor – Is the % reduction of students not proficient within the confidence interval?


Ayp 2006 did your school make it78 l.jpg
AYP 2006Did your school “make it”?

  • Attendance/Graduation Rate – Is the subgroup less than 40?

  • Attendance/Graduation Rate – Did the school meet 93% attendance rate or 85.7 graduation rate

  • Attendance/Graduation Rate – has there been an increase from the previous year?



Ayp 2006 level 380 l.jpg
AYP 2006Level 3

  • Participation Category – Students enrolled on test date.

  • Participation within tests – Students you’ve had for the full academic year. (subset of “category” set)

  • Participation – grad/attend. Is ALL students…





Additional indicator ayp graduation rate 85 7 l.jpg
Additional Indicator AYPGraduation Rate 85.7%


Uaa testing special ed alternate assessment l.jpg
UAA TestingSpecial Ed Alternate Assessment

  • Grade level is derived based on birthdate.

  • Core Test Id and grade level will be used to determine which Actual Test ID to assign a student to. LA and grade level will correspond to an Actual Language (Reading) class for that student. MA and grade level will correspond to a math course.

  • UAA students whose birthdate is in 9-12th grades will be added to GE0812R Geometry. They are part of High School Math AYP!

  • UAA in 7-8th grade will be added to 7th grade math.


Out of level testing l.jpg
Out-of-Level Testing

  • Not allowed

    • No for participation

    • No for academic achievement

  • Math Levels:

    • 6th – Math 6; 7th – Math 7; 8th – Pre-Alg. Anything lower for the grades is Out-of-Level and considered Not Proficient.


District ayp reports l.jpg
District AYP Reports

  • Previous District AYP Report

    • Grades 3 – 8 only


District ayp reports88 l.jpg
District AYP Reports

  • 2006 District AYP Report

    • Grades 3 – 8

    • Grades 10 – 12

      Business Rule

      An LEA will receive a report based on both 3-8th and 10-12th grade AMO's.  An LEA must fail at both the 3-8 AND the 10-12 grade levels to fail AYP.  (Either subject)


District ayp reports89 l.jpg
District AYP Reports

  • 2006 District AYP Report

    • Grades 3 – 8

    • Grades 10 – 12

  • Program Improvement

    Business Rule

    An LEA is identified for improvement only when it misses AYP in the same subject and in all grade spans for two consecutive years, or the other academic indicator in all grade spans for two consecutive years.

    (It is possible for an LEA to not pass AYP and yet not be put into 'Improvement' because 'Improvement' considers 'subject' in addition to grade levels whereas 'not making AYP' does not. 



Slide91 l.jpg
AMAO

  • Federal Accountability

  • Required by NCLB Title III Law

  • District & State Level Reports

  • Based on

    • IPT progress

    • IPT proficiency

    • AYP for ELL


Slide94 l.jpg

  • Enrollment Information

  • AMAO #1 – Annual increases in the number or percentage of children making progress in learning English

  • AMAO #2 – Annual increases in the number or percentage of children attaining English proficiency

  • AMAO #3 – AYP for ELL


Ell enrollment l.jpg
ELL Enrollment

  • Grade Span

  • Language Proficiency Category

  • 2005 ELL Enrollment

  • 2006 ELL Enrollment


Ell enrollment96 l.jpg
ELL Enrollment

Grade Span

The grade span used for AMAO targets is grades K-6 and 7-12.


Ell enrollment97 l.jpg
ELL Enrollment

Language Proficiency Category

  • A - Non-English proficient in speaking, reading and writing

  • B - Limited English proficient (student is non in at least one of the language modalities of speaking, reading and writing or at least limited in two of the language modalities of speaking, reading and writing)

  • C - Fluent in two of the language modalities and limited in one


Ell enrollment98 l.jpg
ELL Enrollment

Language Proficiency Category

  • D - Monitored student for minimum of two years for English proficiency (student is fluent in all language modalities).

  • E - Exited, Former LEP student who is fully proficient in English speaking, reading and writing and has been exited from an alternative language services program and fully assimilated into the mainstream.

  • O - Identified as LEP but opted out of services by parent.


Ell enrollment99 l.jpg
ELL Enrollment

2005 ELL Enrollment

The number of ELL students enrolled in 2005 for the full academic year. For E students, only those students who have exited within the last 3 years are included.


Ell enrollment100 l.jpg
ELL Enrollment

2006 ELL Enrollment

The number of ELL students enrolled in 2006 for the full academic year. For E students, only those students who have exited within the last 3 years are included.


Amao requirement 1 l.jpg
AMAO Requirement #1

  • Grade Span

  • % of 2005 students making progress learning English in 2006 (AMAO 80%)

  • District made the AMAO targets for making progress learning English


Amao requirement 1102 l.jpg
AMAO Requirement #1

Grade Span

The grade span used for AMAO targets is grades K-6 and 7-12.


Amao requirement 1103 l.jpg
AMAO Requirement #1

% of 2005 Students making progress

learning English in 2006

The percentage of ELL students who made progress in one or more domains (speaking, reading, writing). Progress is defined as moving from non speaking to limited or limited to fluent.


Amao requirement 1104 l.jpg
AMAO Requirement #1

District made the AMAO targets for

making progress learning English

This column is Yes if the district made the AMAO target of 80% of students showing progress in one or more domains (speaking, reading, writing).


Amao requirement 2 l.jpg
AMAO Requirement #2

  • % of 2005 students Attaining English Proficiency in 2006

    • K-6, 16.2%

    • 7-12, 21.6%

  • District made the AMAO target for Attaining English Proficiency


Amao requirement 2106 l.jpg
AMAO Requirement #2

% of 2005 students Attaining English

Proficiency in 2006 (K-6, 16.2%) (7-12,

21.6%)

Percentage of students enrolled for both the 2005 and 2006 full academic year, with a language proficiency of D or E in 2006.


Amao requirement 2107 l.jpg
AMAO Requirement #2

District made the AMAO target for

Attaining English Proficiency

The column is Yes if the district made the AMAO target.

For grade ranges K-6, 16.2% of the students are at the D or E level.

For grade ranges 7-12, 21.6% of the students are at the D or E level.


Amao requirement 3 l.jpg
AMAO Requirement #3

  • Grade Span

  • % Participation of ELL for AYP Language Arts

  • District made AYP for the ELL subgroup in Language Arts

  • % participation of ELL for AYP Math

  • District made AYP for the ELL subgroup in Math


Amao requirement 3109 l.jpg
AMAO Requirement #3

Grade Span

The grade span used for AYP targets is grades 3-8 and grades 10-12.

% Participation of ELL for AYP Language

Arts

The percentage of ELL students who participated in the language arts CRT.


Amao requirement 3110 l.jpg
AMAO Requirement #3

District made AYP for the ELL subgroup

in Language Arts

The ELL subgroup attained 95% participation and for the 3-8 grade span attained 71% of the students proficient on the language arts CRT; and for the 10-12 grade span attained 70% of the students proficient on the language arts CRT.


Amao requirement 3111 l.jpg
AMAO Requirement #3

% Participation of ELL for AYP Math

The percentage of ELL students who participated in the Math CRT.


Amao requirement 3112 l.jpg
AMAO Requirement #3

District Made AYP for the ELL subgroup

in Math

The ELL subgroup attained 95% participation and for the 3-8 grade span attained 64% of the students proficient on the Math CRT; and for the 10-12 grade span attained 47% of the students proficient on the Math CRT.


District made amaos l.jpg
District Made AMAOs

  • The District is “Yes” if there is a “Yes” in every column. One “No” in any column will result in a “No” for District Made AMAOs.


Appeals l.jpg
Appeals

1. An error in the aggregating and merging of data and/or a calculation error, or other errors that directly affects school or district status.

2. Extreme circumstances that affected data and/or test administration that had a significant impact on the school (e.g., flood, fire, natural disaster).


Appeal process l.jpg
Appeal Process

  • September 11

    • Deadline for District Superintendent to submit a written appeal request for U-PASS, school AYP, District AYP, or District AMAO stating the reason for the appeal An E-mail response from USOE will confirm receipt of the appeal.

      Data and documentation that directly influences the appeal needs to be stored at the district.


Slide116 l.jpg

  • September 12-15

    • USOE reviews appeals and makes changes to the U-PASS, AYP & AMAO school or district designation.

  • September 16

    • Districts release U-PASS, school AYP, district AYP & district AMAO to the public.

  • September 17

    • U-PASS, AYP & AMAO reports posted on the web. Reports for granted appeals, changed from a No to a Yes (by appeal).


ad