1 / 68

Florida Alternate Assessment Administrators’ Management Meeting September 17-19, 2008

Florida Alternate Assessment Administrators’ Management Meeting September 17-19, 2008. 2008 Standard Setting. Initial Standard Setting. April 7-11 Field test data 14 standard setting panels Panels of special educators, general educators, administrators and parents

lotus
Download Presentation

Florida Alternate Assessment Administrators’ Management Meeting September 17-19, 2008

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Florida Alternate AssessmentAdministrators’ Management Meeting September 17-19, 2008

  2. 2008 Standard Setting

  3. Initial Standard Setting • April 7-11 • Field test data • 14 standard setting panels • Panels of special educators, general educators, administrators and parents • Alternate achievement standards set for all grade levels and content areas

  4. Initial Standard Setting • Using descriptors of Levels of Complexity and Performance Level Descriptors • Panelists set cuts for Levels of Complexity (LOC) • Panelists set Performance Level cuts within each of the LOCs

  5. Levels of Complexity • Participatory, Supported, Independent • FDOE provided descriptors of the levels of complexity to panels • Panels provided feedback on descriptors

  6. Standard Setting

  7. Performance Levels • Basic: Students at the basic performance level have little success with the challenging access points • Proficient: Students at the proficient level are having some success mastering the access points • Advanced: Students at the advanced level are very successful with the access points • At each grade level and content are these are tied to specific access points measured on the assessment

  8. Performance Levels • Basic: Students who score as basic can independently demonstrate less than 50% of all skills measured in the _____ level access points. • Proficient: Students who score as basic can independently demonstrate between 50% and 75% of all skills measured in the _____ level access points. • Advanced: Students who score as basic can independently demonstrate more than 75% of all skills measured in the _____ level access points.

  9. Performance Levels • Performance level descriptors at a grade level are lengthy • Include all access points assessed • Example: 3rd grade math • 3 Big Ideas and 4 Supporting Ideas • 19 (independent), 16 (supported), and 20 (participatory) access points • 11 (independent), 9 (supported), and 11 (participatory) access points assessed

  10. Standard Setting Validation • July 15-18 • Operational test data • Same procedures • Panelists set Performance Level cuts within each LOC • Preliminary results under review

  11. Standard Setting - Next Steps • State Board Rule under development • Establishes the cut scores • Out for comment in the Fall • Revision to performance level descriptors and labels based on feedback from standard setting and Technical Advisory Committee

  12. 2008 Results

  13. Spring 2008 Administration • 27,683 answer sheets scanned • 3,616 not assessment for various reasons • 734 duplicates or invalid bubble • 126 cannot be scored in any content area • 23,207 students have at least one valid content score

  14. Spring 2008 Administration • Invalid Records • Incomplete scoring within a content area • Double bubbles • Grade level and content area mismatch • Invalid bubble filled in on document

  15. Spring 2008 Administration • Districts Received • Individual student reports • School reports • District reports

  16. Spring 2008 - 1% Cap • Calculation • Numerator = Number of SWD reported as proficient or advanced on Florida Alternate Assessment in grades 3-10 • Denominator = Number of students participating in an assessment in grades 3-10 • Calculated separately for reading and math • Calculated at the district level

  17. Spring 2008 - 1% Cap • Decision Rules • If district exceeds cap, students with a primary exceptionality of specific learning disability and no other exceptionalities are reverted to non-proficient • Calculations are re-run • If district still exceeds the cap, they may apply for a waiver

  18. Spring 2008 - 1% Cap • Waiver consideration is given to districts who submit data in support of the following explanations: • House multi-district programs for students with significant cognitive disabilities • Are very small, such that a slight change in number of students produces a large change in percentage

  19. Spring 2008 - 1% Cap • Waiver consideration is given to districts who submit data in support of the following explanations: • House high-quality, research based programs for students with significant cognitive disabilities that attract families from around the state and country

  20. Spring 2009 - 1% Cap • Districts will need to submit waiver requests by May 15, 2009 • Decisions about waiver requests will be made prior to final AYP calculations

  21. 2008-2009 Activities

  22. Train-The-Trainer • June 23 & 24, 2008 • Provided updated materials and information • Reading fluency items • Renaming of materials • Test book wording – Teacher will script • Four field test items per content area

  23. Content/Bias Review • June 25 & 26, 2008 • Approximately 120 participants • Panelists include content expects (general and special education teachers, and administrators • New item review • Eight items per grade in Reading, Mathematics, and Writing • Twenty-five Items for Science based on newly approved standards

  24. Item Specs for New Development • Revisions to standards/access pts. • Item development occurs between January and May for the following year • New items for field testing in 2009-2010 for revised math access points • Language arts will depend on when revised standards/access points are approved by the State Board

  25. Item Specs for New Development • Item specifications • Reading Passages • Length • Readability • Addition of Reading Fluency Strand • Elementary – letter and word identification • Secondary – range from reading sentences to one to two paragraphs

  26. Item Specs for New Development • Graphics • PECs symbols • Heavier line weight • Reduced detail

  27. Accommodations • Accommodations Workgroup • Met via conference call on August 13 • Approximately 25 special education teachers and administrators participated in one of three conference calls • Developed recommendations for additional accommodations for VI, DHH, ASD, MH and ELL students

  28. Accommodations • Preliminary Recommendations • Light box • Touch points on number cards • Broader use of concrete items • Use of total communication

  29. Web-Base Ordering • Available through Piedra Data Services website • Braille and tactile graphics for students with visual impairments • One sided response booklets • One sided materials will allow teachers to cut out items to have flexibility in item placement

  30. Web-Base Ordering • Available September 4-17, 2008 • http://www.piedradata.com/VIS/Login.php

  31. Practice Materials • Released items from Spring 2008 administration • Delivered to school district alternate assessment coordinators week of September 8th • Includes two items per content area and grade

  32. Practice Materials • All grades and content areas packaged together • Test Booklet • Response Booklet • Passage Booklet • Cards Packet • Strips Packet

  33. Test Booklet • Items for all grades and content area are in one test booklet • Content standards assessed are listed in the front of the test booklet • Required teacher gathered materials are provided by content area • Item Identifiers • Item number, grade level, content area, and LOC

  34. Passage Booklet • Passages and passages picture cards for all grades are in one test booklet • Items are presented grouped by grade • Item Identifiers – Coded by content area, grade level, and item number • Ex: Reading Grade 3 Item 1

  35. Response Booklet • With the exception of Writing and a few cutouts, the response items are provided in one 11 by 17 booklet • Items are presented grouped by grade and content area

More Related