2007 08 post test workshop n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
2007-08 Post-Test Workshop PowerPoint Presentation
Download Presentation
2007-08 Post-Test Workshop

Loading in 2 Seconds...

play fullscreen
1 / 68

2007-08 Post-Test Workshop - PowerPoint PPT Presentation


  • 95 Views
  • Uploaded on

2007-08 Post-Test Workshop. Wisconsin Student Assessment System and Accountability Updates. Workshop Overview. Topics: General Information WKCE WAA-SwD ACCESS AMAOs NAEP Adequate Yearly Progress (AYP) Questions & Answers Send your questions anytime.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about '2007-08 Post-Test Workshop' - nuwa


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
2007 08 post test workshop

2007-08Post-Test Workshop

Wisconsin Student Assessment System

and Accountability Updates

workshop overview
Workshop Overview
  • Topics:
  • General Information
  • WKCE
  • WAA-SwD
  • ACCESS
  • AMAOs
  • NAEP
  • Adequate Yearly Progress (AYP)
  • Questions & Answers
  • Send your questions anytime
if you cannot hear the presenter check to be sure
If you cannot hear the presenter check to be sure:
  • The volume on MediaSite is turned up. The Volume button is located below the speaker box
  • The volume on your computer is turned up. Adjust on the toolbar on lower right side of screen
  • Contact your IT Staff
oea website
OEA Website
  • OEA’s Web site - http://dpi.wi.gov/oea
    • Organized by Accountability, Assessments, and Resources
    • DAC Corner:
      • MediaSite/Webcast Trainings
      • DAC correspondence
      • DAC responsibilities and New DAC information
      • Calendar/Important Dates
      • Quick contacts
update your contact information
Update Your Contact Information
  • DACs will receive a DAC Update Form via email on May 1, 2008;
  • Please complete this form by May 31, 2008 & return (even if you are not a new DAC as this keeps our email records current. )
online reporting system ors
Online Reporting System (ORS)
  • To access data through the ORS (“TurnLeaf site”) new DACs may receive usernames & passwords, from Phil Cranley at (608) 266-9798. All other DACs should have their usernames and passwords.
  • The “ORS 101” presentation covers general use and navigation and is available in the DAC corner of the OEA website at http://dpi.wi.gov/oea/webcasts.html
test security
TEST SECURITY

During WKCE Item Analysis Workshops & Data Retreats

  • Test books from this year and previous years have LIVE ITEMS and should be secured at all times
  • NO COPIES should be made!
  • Participants must sign a Confidentiality Agreement Form available at http://dpi.wi.gov/oea/dacforms.html
test security continued
TEST SECURITY continued
  • Do NOT alter/modify items for student practice or any other use – There are released items available for use at (http://dpi.wi.gov/oea/releaseitems.html)
  • Account for and secure all test books
  • Explain consequences of security violations to participants
  • More information is available in the Test Security Webcast training at http://dpi.wi.gov/oea/webcast.html.
fall 2008 testing window
Fall 2008 Testing Window
  • Fall 2008 WKCE & WAA-SwD testing window is October 27 – November 28
  • Testing windows through 2014-15 are available at http://dpi.wi.gov/oea/calendar.html.
fall 2008 testing window1
Fall 2008 Testing Window
  • Testing for both the WKCE and the WAA-SwD may not begin before the testing window based on the recommendation of the Wisconsin Technical Advisory Committee.
fall 2008 testing window2
Fall 2008 Testing Window
  • DPI suggests scheduling the WSAS during the first 2 weeks of the window and using the remaining time to give make-ups. This will eliminate some of the problems with students moving in the middle of the window.
participation in the wkce or the waa swd
Participation in the WKCE or the WAA-SWD
  • Beginning with Fall 2008 a student must participate in either the WKCE or the WAA-SwD based on the decision of the IEP team as to which set of standards is appropriate for that student.
    • A student who is taught from the Extended Grade Band Standards must take the WAA-SwD.
    • A student who is taught from the Wisconsin Model Academic Standards must take the WKCE.
    • A student may not take part of the WKCE and part of the WAA-SwD
  • Please consider this prior to the testing window and during IEP planning.
accommodations
Accommodations
  • The “Accommodation Matrix” (describing allowable testing accommodations and practices) will be updated and re-posted shortly. See http://dpi.wi.gov/oea/pdf/accom08.pdf.
    • Braille – Reading the reading test to newly blind students
    • Minor Clarifications

The matrix will also appear in the Guide for District Assessment Coordinators (“DAC Guide”), distributed before Fall 2008 testing.

review of 2007 08 wkce testing
Review of 2007-08 WKCE Testing
  • The Office of Educational Accountability (OEA) would like to thank you for your work in ensuring a successful & timely administration in conjunction with other responsibilities
  • WKCE Test books were returned on time
  • RES was earlier to allow for IPRs in districts by the end of February.
wkce development process
WKCE Development Process
  • Extensive input from Wisconsin educators is part of the year-round development process of the WKCE:
      • Passage review
      • Item content and bias review
      • Range finding
      • ELL Translations
wkce scale scores
WKCE Scale Scores
  • 2007-08 WKCE scale scores remain the same as 2005-06 administration.
  • Scale scores are available online at http://dpi.wi.gov/oea/wkce-crtcuts.html
schedule for the release of the 2007 08 wkce data
Schedule for the Release of the 2007-08 WKCE data:
  • Phase III (final set of reports) are available and were posted on the Online Reporting System (ORS) website on April 21.
  • Phase II reports were available through ORS on March 28.
  • Individual Profile Reports (IPRs) were shipped to districts on February 29, and should have been sent home to parents shortly after receipt in the district.
public release of data
Public Release of Data
  • No public release of WSAS data is permitted until May 30, 2008.
  • This date is later this year due to the late administration of the WAA-SwD and the need to wait until WAA-SwD Standard Setting was held in April.
  • Results may be shared internally with educators but not released to the public
  • WINSS will be updated with the 2007-08 data on May 30, 2008.
fall 2008 wkce
Fall 2008 WKCE
  • Fall 2008 WKCE testing times similar to last year
  • Science will still be tested only at 4, 8, & 10
  • Two WKCE test books at grades 4, 8, & 10
    • After testing, please check for merged records during Record Editing System
waa swd
WAA-SwD

The Office of Educational Accountability (OEA) would like to thank you for your work in ensuring a successful & timely administration in conjunction with other responsibilities

THANK YOU!

waa swd development process
WAA-SwD Development Process
  • Extensive input from Wisconsin educators is part of the year-round development process of the WAA-SwD:
      • Extended Grade Band Standards
      • Item Content and Bias Review
      • Standard Setting
waa swd standard setting
WAA-SwD Standard Setting
  • A process that lets experts make judgments about the content that students in each achievement level should know.
  • Achievement standards define what students should know and be able to do at each proficiency achievement level (minimal, basic, proficient, advanced) .
    • Extended Grade Band Standards
review of 2007 08 waa swd
Review of 2007-08 WAA-SwD
  • Overall, positive feedback and a successful administration
  • WAA-SwD Trainings
    • Extended Grade Band Standards
    • WAA-SwD Administration
  • First time administration concerns
    • Correct quantity of materials per grade level – we are addressing this with our vendor
waa swd survey results
WAA-SwD Survey Results
  • Approximately 500 educators participated in the survey
    • 77% were classroom teachers
  • How long did it take to PREPARE for the test administration. In general, Mathematics, Reading, and Science:
    • 73 % 0-29 minutes
    • 23 % 30-59 minutes
    • 3 % 60-89 minutes
    • 2 % 90 or more minutes

*Percentages are rounded

waa swd survey results1
WAA-SwD Survey Results
  • How long did it take your student to COMPLETE the test per content area (indicate average if more than one student)?
  • In general, Mathematics, Reading, and Science:
    • 21% 0-29 minutes
    • 52% 30-59 minutes
    • 20% 60-89 minutes
    • 7 % 90 or more minutes

*Percentages are rounded

waa swd survey results2
WAA-SwD Survey Results
  • How appropriate was this test in measuring the academic knowledge of the students to whom it was administered?
    • 21% Too difficult
    • 48% Appropriate
    • 31% Too easy

*Percentages are rounded

waa swd survey results3
WAA-SwD Survey Results
  • Some comments:

“ I liked this assessment much better than those we have used in the past. I felt that it gave an accurate picture of my student's abilities.”

“ Much preferred giving a test like this as opposed to having to collect evidence. Like the extended band standards also.”

“ In general I felt the test was appropriate. The range of the students abilities that will be taking this test makes it difficult to develop a test that is appropriate for all students.”

“ I am very happy that we now have expectations for students with cognitive disabilities. I like the changes but do see the difficulties some teachers are having administering it to very severe students.”

schedule for the release of the 2007 08 waa swd data
Schedule for the Release of the 2007-08 WAA-SwD data:
  • WAA-SwD Individual Profile Reports (IPRs) have been sent out to districts and should be arriving shortly. IPRs should be sent home to parents shortly after receipt.
  • District Assessment Coordinators will be able to check the WAA-SwD reports on the Online Reporting System (ORS – “TurnLeaf site”).
public release of data1
Public Release of Data
  • No public release of WSAS data is permitted until May 30, 2008.
  • This date is later this year due to the late administration of the WAA-SwD and the need to wait until WAA-SwD Standard Setting was held.
  • Results may be shared internally with educators but not released to the public
  • WINSS will be updated with the 2007-08 data on May 30, 2008.
fall 2008 waa swd
Fall 2008 WAA-SwD
  • Performance-Task assessment
      • Reading and Mathematics at grades 3-8, and 10
      • Science at grades 4, 8, and 10
  • Rater Form Assessment
      • Social Studies and Language Arts/Writing at grades 4, 8, and 10
      • Knowledge and skills inventory
      • Record the results on the WAA-SwD answer document
  • WAA-SwD will be given during the SAME window as the WKCE.
fall 2008 waa swd1
Fall 2008 WAA-SwD
  • Participation Checklist
  • IEP Team decision
  • A student must participate in either the WKCE or the WAA-SwD based on the decision of the IEP team as to which set of standards is appropriate for that student.
  • Available at: http://dpi.wi.gov/sped/assmt-waa.html
waa swd questions
Office of Educational Accountability

Brian Johnson

brian.johnson@dpi.wi.gov

608-267-1290

Kristen Kehoe

kristen.kehoe@dpi.wi.gov

608-267-3164

Special Education Team

Sandy Berndt

sandra.berndt@dpi.wi.gov

608-266-1785

Eva Kubinski

Eva.kubinski@dpi.wi.gov

608-266-2899

WAA-SwD Questions?
assessment of english language learners
Assessment of English Language Learners
  • Spanish and Hmong Pilot Translations - DPI provided for 2007 administration
    • 2008 Administration similar to 2007 with incorporated suggestions from survey and educators
  • ELL students will continue to take the WKCE with allowable accommodations
accommodations for ells
Accommodations for ELLs
  • Spanish & Hmong Pilot: testing scripts and audio recordings
    • Survey indicated that the scripts were used in more frequency than the audio recordings
    • Audio recordings were useful to some but had some technical quality issues.
    • Will re-evaluate process and procedures for next years administration.
  • Content-specific word-to-word glossaries in Spanish and Hmong
accommodations for ells1
Accommodations for ELLs
  • Accommodations Matrix
    • DPI recognizes that 15% of the Wisconsin ELL population speaks a language other than Spanish or Hmong. Districts who serve students who speak languages other than Spanish or Hmong may use qualified translators to provide oral translation support to students.
assessment of ell students
Assessment of ELL Students

For Fall 2008: use same procedures as Fall 2007:

  • ELL Levels 1 and 2 less than 1 year in country: must take Mathematics and Science; may take Reading
  • Levels 1 and 2 more than 1 year in country: must take Mathematics, Science, and Reading
access for ells
ACCESS for ELLs
  • New Electronic data clean-up window was used due to district requests.
    • April 15-April 25
  • All paper reports will be delivered the week of May 12.
  • After paper reports are delivered districts will have two more weeks to make any additional corrections.
access for ells1
ACCESS for ELLs
  • 2008-2009 Testing Window
    • December 1, 2008- February 13, 2009
ell amao s what are they
ELL AMAO’s - What are they?
  • Annual Measurable Achievement Objectives (AMAOs) for the Attainment of English Language Proficiency
  • AMAOs are used for Title III Accountability – not for AYP
specific targets for each amao
Specific Targets for each AMAO
  • AMAO 1 → Progress ELP Assessment
  • AMAO 2 → Attainment
  • AMAO 3 → Title I AYP → Content Assessment
  • Must meet each of the required indicators to meet AMAO’s. If one of the components is not meet than the district or consortium does not meet their AMAO.
ell amao calculations
ELL AMAO Calculations
  • Three specific AMAO target areas have been established under the law:
    • AMAO 1: Progressing in English language acquisition annual increases in the number or percentage of students making progress in learning English
    • AMAO 2: Exiting or reaching English language proficiency annual increases in the number or percentage of students attaining English language proficiency by the end of each school year

ELL exit rate is calculated as:

100% of students who achieve ELP level 6

100% of students eligible to achieve Level 6

    • AMAO 3: ELL-Adequate Yearly Progress (AYP)AYP for the ELL subgroup (under Title I) in meeting grade-level academic achievement standards in English Language Arts (Reading) and Mathematics
  • The above Title III AMAOs are not used for school/district accountability (AYP purposes).
amao timeline
AMAO Timeline
  • AMAO results will be distributed at the beginning of the school year.
  • 30-day appeal process after results are given to districts.
ell assessment questions
ELL Assessment Questions
  • ELL Assessment
    • Brian Johnson

brian.johnson@dpi.wi.gov

608-267-1290

  • ELL Accountability (AMAOs)
    • Susan Ketchum

susan.ketchum@dpi.wi.gov

608-267-0245

looking ahead to 2008 09 naep

National Assessment of Educational Progress

Main NAEP

Long Term/ Special Studies

NATIONAL

(Public & Non-Public)

(9, 13, and 17-year olds)

(4th, 8th and 12th grade)

STATE

(Public)

(grades 4 & 8)

NATIONAL

(Public & Non-Public)

(grades 4, 8, and 12)

Looking Ahead to 2008–09: NAEP
2007 08 school year naep testing

National Assessment of Educational Progress

Main NAEP

Long Term/ Special Studies

NATIONAL

(Public & Non-Public)

(9, 13, and 17-year olds)

(4th, 8th and 12th grade)

STATE

(Public)

(grades 4 & 8)

NATIONAL

(Public & Non-Public)

(grades 4, 8, and 12)

2007–08 School Year NAEP Testing
2008 09 school year naep testing

National Assessment of Educational Progress

Main NAEP

Long Term/ Special Studies

NATIONAL

(Public & Non-Public)

(9, 13, and 17-year olds)

(4th, 8th and 12th grade)

STATE

(Public)

(grades 4 & 8)

NATIONAL

(Public & Non-Public)

(grades 4, 8, and 12)

2008–09 School Year NAEP Testing
2008 09 school year naep testing1
2008–09 School Year NAEP Testing
  • Main NAEP
    • Grades 4 and 8
      • Reading, mathematics, and science
      • State and national results
      • Nationwide, 500,000 public school students at each grade
    • Grade 12
      • Reading, mathematics, science
      • National results
      • Nationwide, about 100,000 public school students
2008 09 school year naep testing2
2008–09 School Year NAEP Testing
  • Pilot Studies
    • Grades 4 and 8
      • Reading, math, U.S. history, geography, and civics pilots
      • Science Interactive Computer Test (SICT) and Hands On Tasks (HOT)
      • Nationwide about 13,000 public school students per grade
    • Grade 12
      • U.S. history, geography, and civics pilots
      • Science Interactive Computer Test (SICT) and Hands On Tasks (HOT)
      • Nationwide about 6,000 public school students
2008 09 school year naep testing3
2008–09 School Year NAEP Testing
  • Selected districts and schools will receive notification of NAEP participation in late May.
  • Letters will be mailed to District Superintendents, Administrators, DACs, and principals in early May.
  • Assessment date notification sent in June
  • Additional information on the assessments will be provided in early Fall.
  • Contact: Abby Potter aubree.potter@dpi.wi.gov, 608-267-5153
slide59

Determining AYP: 2007-08

Schools & districts must meet criteria for four AYP objectives:

95% of total # of students enrolled in the tested grades

Test Participation

74% Proficiency Index (FAY)

Reading

Mathematics

58% Proficiency Index (FAY)

Other Indicator

90% of statewide average or growth:

80% graduation or 85% attendance

(Attendance/graduation)

2007 08 ayp notification
2007-08 AYP Notification
  • Only districts/schools that are in one or more of the following four categories will be notified in writing of their preliminary AYP status by June 6, 2008:
    • missed AYP for 2007-08, or
    • are identified for improvement at the school or district (SIFI or DIFI), or
    • missed AYP in 2006-07 and have now met AYP in all areas, or
    • were identified for improvement previously and are now in satisfactory status.
2007 08 ayp notification1
2007-08 AYP Notification
  • The letters for schools in those four categories only will be sent to the district administrators and copied to principals and district assessment coordinators in those districts.
  • All Wisconsin districts may access and print all their AYP sheets from the ORS website after June 30. The DAC is responsible for distributing these within the district, as no printed copies will be mailed. Be sure someone in your district has the ORS password and is available to do this if the DAC is not available.
2007 08 ayp notification2
2007-08 AYP Notification
  • For complete information on how Adequate Yearly Progress is calculated, see http://dpi.wi.gov/oea/annrvw08.html.
  • For information on sanctions that apply to schools or districts identified for improvement, see http://dpi.wi.gov/oea/doc/sifilevels.doc.
ayp changes for 2007 08
AYP Changes for 2007-08
  • Adequate Measurable Objectives (AMOs) for Reading and Math have gone up; more students must be proficient to make Adequate Yearly Progress (AYP).
    • Reading - 74%
    • Mathematics - 58%
  • These AMOs will stay in effect for 2008-09 and 2009-10.
slide64

100

3-8 testing began 2005-06

80

61%

60

Accelerated annual gains beginning 2010-11

40

20

0

Determining AYP: Annual Measurable Objectives (AMOs)

Required Proficiency by 2013-14= 100%

2007-08:

AMOs go up

74%

58%

% Proficient/Advanced

37%

Reading

Mathematics

2012-13

2013-14

2011-12

2010-11

2001-02

2009-10

2002-03

2003-04

2004-05

2005-06

2006-07

2007-08

2008-09

slide65

Changes for AYP in 2007-08

New beginning in 2007-08: cell size of 40

for students with disabilities

Minimum cell size 2007-08:

changes for ayp in 2007 08
Changes for AYP in 2007-08
  • The US Department of Education now allows states to include exited students with disabilities (SwD) in the Students with Disabilities subgroup, if they have been exited within the past two years.
  • Wisconsin will add these exited special education students into the denominator only if the school benefits.
  • For example:
    • A school has 60 SwD and misses AYP. When 10 exited SwD are added back in, they have 70 SwD, and when it is recalculated they now make AYP.
    • If a school makes AYP without the exited students, those students are not added into the denominator.
growth and ayp
Growth and AYP

Some states are beginning to use growth models as part of calculating AYP.

  • WI will be eligible beginning 2008-09.
  • Research studies are under way to explore how our data works with different approaches to growth modeling.
  • Currently approvable growth models used by some states do not produce significantly different results from the current status approach of NCLB.
  • WI is exploring multiple approaches to growth to prepare for potential broader options that might be allowable pending any changes that could come with NCLB reauthorization.