utah comprehensive accountability system ucas n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Utah Comprehensive Accountability System (UCAS) PowerPoint Presentation
Download Presentation
Utah Comprehensive Accountability System (UCAS)

Loading in 2 Seconds...

play fullscreen
1 / 32

Utah Comprehensive Accountability System (UCAS) - PowerPoint PPT Presentation


  • 110 Views
  • Uploaded on

2013 . Utah Comprehensive Accountability System (UCAS) . Hal Sanderson, Ph.D. Research and Assessment August 21, 2013. UCAS performance d ata is embargoed. September 3 rd is the public release. Utah Comprehensive Accountability System (UCAS).

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Utah Comprehensive Accountability System (UCAS)' - sunee


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
utah comprehensive accountability system ucas

2013

Utah Comprehensive Accountability System (UCAS)

Hal Sanderson, Ph.D.

Research and Assessment

August 21, 2013

utah comprehensive accountability system ucas1
Utah Comprehensive Accountability System (UCAS)
  • Incorporates both student achievement and growth toward improvement in a composite score for each school (range 0 to 600). This is largely based on the Core CRTs.
  • UCAS provides summary data for the entire school, as well as disaggregated results by ethnicity, and for economically disadvantaged, English language learners, and students with disabilities.
  • UCAS achievement and growth results are for students who are in school for a full academic year (160 days in membership).
key features of ucas
Key Features of UCAS
  • Each school can earn up to 300 points in Achievement and 300 points in Growth.
  • Achievement (Percent of students proficient on CRTs in Math, Language Arts, Science and DWA). This is similar to previous accountability reports.
  • Growth (Year-to-year scale score gain compared to like scoring “academic” peers across the state). This is a very different approach to calculating growth/progress.
  • Subgroup(s). Identifies below proficient students as a single subgroup. Defined as all students who scored below proficiency (level 1 or 2) on the previous year’s CRT
key features of ucas continued
Key Features of UCAS continued
  • Participation. A school must meet the 95% participation rate for the whole school and non-proficient subgroup of 40 students or more in each content area
  • High School (Graduation Rate = College Readiness)
  • AMO Information for schoolsis reported.
elementary middle school ucas report
ELEMENTARY/MIDDLE SCHOOL UCAS REPORT

Report Info

Total Points

School Info.

Achievement Points

Growth Points

high school ucas report
HIGH SCHOOL UCAS REPORT

Report Info

Total Points

School Info.

Achievement Points

Grad Rate Points

Growth Points

comparison to ayp u pass achievement
Comparison to AYP/U-PASSAchievement

Achievement – is calculated by dividing the number of students scoring proficient or above (Levels 3 and 4) in each content area using the CRT/DWA/UAA tests by the number of students who were enrolled at the same school for the full academic year and took each test.

comparison to ayp u pass growth
Comparison to AYP/U-PASSGrowth
  • UCAS Student Growth Percentile (SGP) – For students taking the CRTs, growth is determined by comparing the performance of a student with all other students in the state with the same past performance (1-3 years of CRT scores). Next, determine how performance in the current year compares with that of the student’s peer group to produce a growth percentile. Range from 0 to 100.
2013 ucas assessments
2013 UCAS Assessments
  • CRT LANGUAGE ARTS – Elementary Grades 3 – 6; Secondary Grades 7 - 11
  • CRT MATH - Elementary Grades 3– 6; Math 7 CRT, Math 8 CRT, Algebra 1, Geometry, Algebra 2
  • CRT SCIENCE – Elementary Grades 4 – 6; Secondary 7th Integrated Science, 8th Integrated Science, Earth Systems Science, Biology, Chemistry, Physics
  • Direct Writing Assessment – Grades 5 and 8
point structure for elementary and middle schools
Point Structure for Elementary and Middle Schools

Schools without a 12th grade includes students in grades 3-8

slide12

Point Structure for

High Schools

Schools with a 12th grade includes students in grades 9-12

subgroups
Subgroups
  • Identifies belowproficient students as a single subgroup
    • Below Proficient Subgroup = All students who scored below proficiency (level 1 or 2) on the previous year’s CRT
    • Below Proficient Subgroup is determined independently for each content area (ELA, Math, Science)
  • Ensures all students who are below standard, regardless of group, are the focus for improvement
  • Below proficient subgroup is double weighted in the growth calculation to increase focus on those most at risk
  • Complete disaggregated data for all 10 subgroups will be included in UCAS report including gap analysis
participation requirement
Participation Requirement
  • A school must meet the 95% participation rate for the whole school and non-proficient subgroups of 40 students or more in each content area
  • Participation is calculated for the whole school and the non-proficient subgroup
  • Schools not meeting the participation requirement will receive a UCAS total score of 0
sample elementary achievement calculation
Sample ElementaryAchievement Calculation

Note: Schools without DWA , content areas are weighted equally (1/3 each)

high schools college career readiness
High SchoolsCollege & Career Readiness
  • College and Career Readiness accounts for 150 of the 300 points for high schools in the achievement component.
  • The readiness component is the federal graduation rate calculation as approved by USED. All graduation reporting includes this rate.
  • For purposes of calculating UCAS, the graduation rate is calculated by multiplying the graduation rate by 150 (e.g. .70 x 150 = 105).
student growth percentile
Student Growth Percentile
  • Student growth is determined by comparing the performance of a student with all other students in the state with the same past scale score performance (1-3 years of CRTs). How does your gain compare to that of your like scoring peers? What is my percentile rank based on gain?
  • The Student Growth Percentile is also known as the “Colorado Growth Model”. It is used for accountability in the following states: Colorado, Nevada, Indiana, Massachusetts, New Hampshire, Maine, Arkansas, Rhode Island, Virginia, West Virginia, New York, Hawaii, Idaho, Georgia, Wyoming and Utah.
normative
Normative

How does it work?

Think of a group of students, where each student has two test scores – one for 2009 and one for 2010.

We could show the distribution of these scores at the same time as pictured.

normative1
Normative

We could ‘slice’ through the picture to show the 2010 distribution for just one 2009 score. This is called a conditional distribution.

The red shaded curve shows the conditional distribution in 2010 for all students who scored 166 in 2009.

normative2
Normative

Assume we are interested in just one score, 170, in 2010.

We could ask, what percentage of students who scored 166 in 2009 scored at or below a 170 in 2010?

In this case, that turns out to be 75%. In other words, a score of 170 is at the 75th percentile.

SGP = 75

why use sgp
Why use SGP?
  • Determines growth based on multiple years of data for each student
  • Honors variable amounts of growth (including small changes)
  • Does not replicate proficiency
  • Recognizes growth for students who are achieving at low and high rates
  • Growth percentiles are calculated for every student, but can be aggregated to the classroom, subgroup, school, district, and state
new ucas growth calculation

ALL STUDENT Growth TABLE

New UCAS Growth Calculation
  • More finite point calculation vs. old table (2012) below.

OLD Growth TABLE

new ucas below proficient student growth calculation

BELOW PROFICIENT STUDENT Growth TABLE

New UCAS Below Proficient Student Growth Calculation
  • More finite point calculation vs. old table (2012) below.

OLD Growth TABLE

slide27

Growth Calculation

Example calculation

Total Growth Points

School Total Growth Points 133 + 58 = 191

annual measureable objectives
Annual Measureable Objectives

Federal Requirement to establish and report AMOs

Utah’s Minimum Compliance Plan

  • AMOs are not used in any UCAS calculation
  • AMO trajectory will reduce in half the percent of non-proficient over six years
  • AMOs will be established separately for each subgroup at each school
  • UCAS reporting will list the AMO and performance of each school subgroup
  • AMO reporting page will be a drill down page in the UCAS report
  • AMOs will be used in identifying and exiting Focus schools
establishing amos
Establishing AMOs
  • AMOs will be based on the percent of students achieving proficiency on the state’s Criterion-Referenced Tests (CRTs) separately in English language arts and mathematics.
  • ELA: CRT results in grades 3-8 and 10 are used to determine the percent of students proficient
  • Mathematics: results are based on CRTs in grades 3-6 and in the course appropriate CRT thereafter which includes math 7, algebra, or geometry for grades 7 and 8. High schools will be determined by calculating the percent of 10th grade students who scored proficient on the Algebra I CRT in 10th grade year or a prior year
  • Results from the Utah Alternative Assessment (UAA) are included for students with significant cognitive disabilities approved to participate in this assessment
amo sample calculation for a school subgroup with ela proficient 82

AMO Sample Calculation

AMO Sample Calculation for a School Subgroup with ELA Proficient = 82%
  • 100% – 82% = 18%
  • ½ of 18 is 9
  • 9 / 6  years = 1.5 per year
  • Year one   82.0 + 1.5 = 83.5
  • Year two   83.5 + 1.5 = 85.0
  • Year three 85.0 + 1.5 = 86.5
  • Year four  86.5 + 1.5 = 88.0
  • Year five  88.0 + 1.5 = 89.5
  • Year six   89.5 + 1.5 = 91.0  (half way to 100 percent)