1 / 102

Department of Student Assessment (DoSA) Assessment Overview September 9 and 10, 2009

CHICAGO PUBLIC SCHOOLS 125 S. CLARK STREET, 11th FLOOR ∙ CHICAGO, ILLINOIS 60603 STUDENT ASSESSMENT (773) 553-2430 Department of Student Assessment (DoSA) Assessment Overview September 9 and 10, 2009 Assessment Strategy for 2009-2010 2009-2010 Online Assessment Overview

Sophia
Download Presentation

Department of Student Assessment (DoSA) Assessment Overview September 9 and 10, 2009

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CHICAGO PUBLIC SCHOOLS 125 S. CLARK STREET, 11th FLOOR ∙ CHICAGO, ILLINOIS 60603 STUDENT ASSESSMENT (773) 553-2430 Department of Student Assessment (DoSA)Assessment OverviewSeptember 9 and 10, 2009

  2. Assessment Strategy for 2009-2010

  3. 2009-2010 Online Assessment Overview

  4. ASSESSMENT AND TECHNOLOGY ROLLOUT FOR 2009-2010 SPRING TESTING WINDOW FALL TESTING WINDOW WINTER TESTING WINDOW 2009 2010 Oct Nov Jan Feb March April June Sept Aug GO LIVE Schools in Areas 6,7,9,11,15,16 that did not have sufficient technology in the fall will be offered Scantron for spring testing window in addition to benchmark assessments for spring testing window • Schools in Areas1,2,4,18,10 that did not have sufficient technology in the fall will be offered Scantron for winter testing window in addition to benchmark assessments for winter testing window Areas 3,13,14,17 plus any of additional 116 elementary with sufficient technology (see list) offered Scantron computer adaptive assessment in addition to benchmark assessments for fall testing window Complete high school technology rollout (areas 19,21,23,24,25,26) Complete elementary rollout (area 27, 28, 29 and 51) All schools prepared for online assessment for 2010-11 academic year 4

  5. ASSESSMENT REQUIREMENTS FOR 2009-2010 Please note that schools in particular programs (e.g. Reading First ) may be required to do specific or other assessments (e.g. DIBELS). Please review the assessment calendar at http://research.cps.k12.il.us for all assessment dates. *Charters and contract schools may opt in to these assessments (contract schools must participate in District-Wide Writing Assessment and Summer School Testing (SAT10)). **CAO may approve opt-out of district-provided choices. To do so, schools must have alternate assessments in place for which data can be captured and aggregated at the area and district level; see “Guidelines for Assessment Decisions”; AMPS out schools will implement the NWEA Computer Adaptive Assessment. 5

  6. ASSESSMENT REQUIREMENTS FOR 2010-2011 Please note that schools in particular programs (e.g. Reading First ) may be required to do specific or other assessments (e.g. DIBELS). Please review the assessment calendar at http://research.cps.k12.il.us for all assessment dates. *Charters and contract schools may opt in to these assessments (contract schools must participate in District-Wide Writing Assessment and Summer School Testing (SAT10)). **CAO may approve opt-out of district-provided choices. To do so, schools must have alternate assessments in place for which data can be captured and aggregated at the area and district level; see “Guidelines for Assessment Decisions”; AMPS out schools will implement the NWEA Computer Adaptive Assessment. 6

  7. Key Information for 2009-2010

  8. State Testing for 2009-2010 • Required state tests are ISAT, IAA, PSAE, and ACCESS • Every student at the appropriate grade level MUST take one of the academic achievement tests (ISAT, PSAE, IAA) • ELL students must also take ACCESS, the state’s English language proficiency exam, in addition to the appropriate academic achievement test • For ACCESS, a certified professional must administer the test • IMPACT SIM data MUST be accurate – for instance, scores ARE invalidated if student grade level is incorrect • 9-digit state ID numbers required • If you have any questions, please contact DoSA (773) 553-2430

  9. Special Education Students and State Testing • Students MUST take either IAA or ISAT/PSAE • ELL students in a special education program MUST also take ACCESS; there is no exemption or alternate test for students with severe and cognitive disabilities • Work with case managers or others now to check IEPs and ensure appropriate accommodations are selected (e.g. audio of a reading test or reading aloud a reading test will NOT be allowed) • Ensure information is accurate in Specialized Services Management (SSM) - this is how students are flagged for IAA • Ensure only students with significant cognitive disabilities are identified for IAA (refer to Illinois State Board of Education website for definitions and criteria or call DoSA or Office of Specialized Services) • IAA scores MUST be entered online • We do not know when/if ISBE plans to provide other alternate assessment options for students with IEPs

  10. ELLs and State Testing • ELLs are required once again to take ACCESS in addition to the ISAT/PSAE or IAA. • Data MUST be correct in IMPACT for correct ELL identification: • Home Language Survey (HLS) • Screener Scores • Student Reclassification Request (SRR) • Work with your bilingual lead teacher or test coordinator NOW to ensure they know what accommodations are available and that they present these accommodations to students early on in the year (see next slide and check ISBE website). • Test coordinators are responsible for ensuring that all students, including ELLs, are tested appropriately.

  11. CPS - IMPACT ISBE SCORES SIM SIS Scores Preprint Testing ISBE/CPS Matching CPS enrollment from last day of testing Assessment Correction Results

  12. DQI Subject Areas and Measures 12

  13. Data Quality Screenshot 13

  14. Where to Find Test Results • REA Principal Login site http://research.cps.k12.il.us/ • IMPACT CIM https://cim.cps.k12.il.us/ • IMPACT Report Portal https://impact.cps.k12.il.us/ • The Dashboard https://dashboard.cps.k12.il.us/.

  15. Assessment Information

  16. Assessment listserve

  17. DoSA Info • Website: http://research.cps.k12.il.us/cps/accountweb/Assessment • listserve: http://research.cps.k12.il.us/cps/accountweb/ENews • Phone: (773) 553-2430; Fax: (773) 553-2421 • Staff: • Mariann Lemke, Director, mlemke@cps.k12.il.us • Linda Abdul, Assessment Specialist, lmabdul@cps.k12.il.us • Peg Bartz, Assessment Specialist, mbartz@cps.k12.il.us • Randi Forrest, Assessment Specialist, rvforrest@cps.k12.il.us • Sherese Johnson, Assessment Consultant, sjohnson104@cps.k12.il.us • Sherri Lee, Administrative Assistant, smlee@cps.k12.il.us • Carrie Lynch, Assessment Specialist, cclynch@cps.k12.il.us • Julie Robbins, Assessment Specialist, jarobbins@cps.k12.il.us • April Stevens, Assessment Specialist, astevens1@cps.k12.il.us

  18. Upcoming Events • ISAT & IAA • Detailed information about ordering materials for ISAT and IAA from Pearson • One representative from each school should attend • ACT Online • Detailed information on importing student rosters into ACT database • At least one representative from each high school should attend • EXPLORE • November 2009: In-service on reading and interpreting EXPLORE reports • ACCESS • Preliminary student rosters will be posted to REA Principal login site in October for school review. • Schools will have approximately 1 week to request changes through OLCE

  19. Break out into groups • Elementary School Staff • Remain seated • High School Staff • September 9: Proceed to room 1207 • September 10: Proceed to room 113

  20. Elementary Assessments • DIBELS/ISEL/STEP • Reading Benchmark Assessment • Math Benchmark Assessment • District–Wide Writing Assessment • EXPLORE • Limited October Testing

  21. 2009-2010 Elementary Early Literacy Assessments 3 options available for early literacy assessments 21

  22. Reading 3D: DIBELS + TRC • Dynamic Indicators of Basic Early Literacy + Text Reading and Comprehension • Individually-administered, developmental reading assessment (screener and diagnostic) to identify which students may need additional support and to identify specific learning needs • Administered three times per year via PDA • Estimated administration time is 10 minutes per student 22

  23. ISEL • Illinois Snapshots of Early Literacy • Individually-administered, developmental reading assessment (screener and diagnostic) to identify which students may need additional support and to identify specific learning needs • Administered three times per year via PDA • Estimated administration time is 20-25 minutes per student 23

  24. STEP • Strategic Teaching and Evaluation of Progress • Individually-administered, developmental reading assessment (screener and diagnostic) to identify which students may need additional support and to identify specific learning needs • Administered three times per year • Estimated administration time is 20 minutes per student • Administered/scored on paper and data entered manually into online system . 24

  25. Math and Reading Benchmark Assessments • Purpose • New this year • What are the Math and Reading Benchmarks • Who should take the Math and Reading Benchmarks • When are the Math and Reading Benchmarks administered • Materials • Results

  26. Purpose of Math Benchmark Provide school personnel with timely and instructionally useful data. Provide a link between the mathematics curriculum being implemented in schools and the state and district-wide goals for mathematics learning Provide students with exposure to multiple assessments that are aligned to Illinois Learning Standards. Create opportunities for schools and Areas to engage in conversations around student work (constructed response). 26

  27. Purpose of Reading Benchmark • Provide school personnel with timely and instructionally useful data. • Provide students with exposure to multiple assessments that are aligned to Illinois Learning Standards. • Create opportunities for schools and Areas to engage in conversations around student work (extended response).

  28. New for Reading and Math Benchmarks in 2009-2010 28 -Online Reading and Math Benchmarks available for Winter 2010 and Spring 2010 administrations -Data CD containing PDF reports and Excel item analysis no longer available. All data available in new and improved CIM/IMPACT and REA Principal Log-In Site. -The Benchmark Assessments will be managed by the Department of Student Assessment (DoSA) in 2009-2010. Please contact Randi Forrest (rvforrest@cps.k12.il.us) for information on the Math Benchmark Assessment and/or April Stevens (astevens1@cps.k12.il.us) for information on the Reading Benchmark Assessment. -There will be three administrations of the Benchmark Assessments in 2009-2010. -For school with branches/annexes/satellite buildings, test materials for all buildings will be sent to the main school building. Please ensure arrangements are made to transfer test materials for students in other buildings. -CPS six-digit school ID numbers replace four-digit unit numbers on all Benchmark documents, including answer sheets and headers.

  29. What is the Math Benchmark? • Test organized to map to pacing of 4 district-supported mathematics curricula • Grades 3-5: Math Trailblazers and Everyday Math • Grades 6-8: Math Thematics and Connected Math • 45 multiple choice questions per grade, plus short answer and extended response (as tear-off sheets)

  30. What is the Reading Benchmark? • Assessment developed by ETS • 45 multiple choice item assessment • Reading passages cover the following genres: literary, poetry, informational, and functional • Extended response prompt per grade incorporated as perforated pages • Built around the comprehension standard (1C) and sub-standards/benchmarks for all grades rather than just the frameworks • Distractor analysis added • Incorporates District Writing Prompts as perforated pages for grade 7-8

  31. Who should take the Math andReading Benchmark Assessments? • All students in grades 3 through 8 who will participate in the ISAT. • In general, all English Language Learners (ELL) who will take the ISAT should take the benchmark assessments. • Office of Language and Cultural Education (OLCE) recommends students in PY 2+ participate. • All students with Individualized Education Plans (IEPs) who will take the ISAT should take the benchmark assessments. • As with the ISAT, all students should take the assessment at the grade level in which they are enrolled.

  32. Benchmark Assessment Accommodations for Students with IEPs • These students should be allowed the same accommodations specified in theirIEPs that are permitted on the ISAT (for example, extended time and individual/small-group testing). • Teachers may also assist students with the reading and oral interpretation of questions (not reading passages). • Large-print test formats must be requested via the online ordering system.

  33. Benchmark Assessment Accommodations for Students Based on ELL Status • ELL students are eligible for the following accommodations based on their ELL status: • extended time • large print test format • translated instructions • instructions and questions (but not reading passages) in the Reading Benchmark Assessment read aloud in English by school personnel • instructions, questions, and answer choices in the Mathematics Benchmark Assessment read aloud in English by school personnel • written response to constructed-response items in the students’ native language (as long as teacher can score responses in that language) • oral English and Spanish responses to constructed-response items dictated by student to a live scribe

  34. Benchmark Assessments Administration Window • Assessments are intended to be untimed. However, 1-2 class periods for each assessment is recommended to cover both multiple choice and extended response questions (65-90 minutes)

  35. Math and Reading Benchmark Materials Materials will be delivered to schools via mail run the week prior to the assessment window. These will include: Separate Math and Reading Test Booklets Answer Sheets (one for both math and reading) Pre-Identification Labels Test Coordinator Manual (TCM) Directions for Administration (DFA) 3rd grade & 4th-8th grade rulers School & Grade Headers Sheets Request for Additional Materials Order Form Returning Materials to ETS instructions Pre-paid UPS Pak for returning answer documents Extended response and short answer questions included in test booklets. Scoring materials (rubrics, sample student work), Distractor Analysis, Alignments, Answer Keys, and Goals and Standards to be provided separately online at DoSA website and CIM. 35

  36. Math and Reading Benchmark Results – Fall 2009Paper and Pencil Administration 36

  37. Math and Reading Benchmark Results – Winter 2010Paper and Pencil Administration 37

  38. Math and Reading Benchmark Results – Spring 2010 Paper and Pencil Administration 38

  39. Online Math and Reading Benchmark Administration Results Immediate results for multiple-choice items Math short answer and constructed-response questions are to be scored by teachers. Scores are entered by teachers directly into CIM/IMPACT. Electronic ISAT Prediction Reports in CIM/IMPACT approximately one week later. Paper Parent Reports available one month later. 39

  40. Ordering Additional and/or Accommodation Materials • The link to our online ordering site can be found on the Mathematics or Reading Benchmark pages of the DoSA website at http://research.cps.k12.il.us/cps/accountweb/Assessment/. • Orders placed by 3 p.m. on the Friday before the test window are available to be sent via GSR. Any orders placed after 3 p.m. on that Friday must be picked up at the CPS Test Intake Center by school personnel. • Please allow 48 hours to process requests and deliver materials through the mail run; allow up to 24 hours to process requests for warehouse pick-up by school personnel.

  41. For Questions or More Information: • For general Benchmark Assessment questions, contact the Benchmark Assessment team at (773) 553-5060. • For Mathematics Benchmark Assessment resources, visit http://research.cps.k12.il.us/cps/accountweb/Assessment/Mathematics_Benchmark_Assessment. • For Reading Benchmark Assessment resources, visit http://research.cps.k12.il.us/cps/accountweb/Assessment/BenchmarkAssessment/. • For questions regarding IMPACT CIM training, email Impact@cps.k12.il.us

  42. District-Wide Writing Assessment • Purpose and uses of the DWWA for CPS • What is assessed and components of the program • Who is assessed • When and how long is assessment • Materials • Results • Upcoming events and more information

  43. Purpose and Use of the DWWA • CPS Promotion Policy that went into effect in 08-09 requires that 8th grade students demonstrate proficiency in writing as a condition for promotion. • 8th grade promotion in writing based on two criteria: • A final grade of C or better in Writing or 2. A passing score on the Spring District Wide Writing Assessment (DWWA) • If a student does not meet EITHER of the criteria, student would be required to attend summer school Writing workshops - Workshops to be part of the Step Up to High School program

  44. Purpose and Use of DWWA (cont) • In order to be promoted, students must satisfactorily complete workshops (satisfactory completion determined by passing grade achieved at the end of the workshops). • It is possible for a student to be required to attend both Summer Bridge (for Reading and Math) and the Writing Workshops before being promoted.

  45. What is the DWWA? Four writing prompts during the course of the year Three are incorporated into Reading Benchmark as perforated sheets (Fall, Winter, and Spring) and administered during Benchmark Assessment window. Prompts are scored by the teacher. One is administered in a separate test window and externally scored (used for promotion policy). This is a secure test. Similar to ISAT, the externally scored assessment will be either a narrative or persuasive prompt. 45

  46. Who Takes the DWWA? Students in grade 7 and 8 take prompts throughout the year Grade 8 students who take the ISAT take the externally scored spring prompt - Promotion policy not applicable to English Language Learners (ELL) PY0-5. - Students with Individualized Education Programs (IEPs) who take ISAT should also take the DWWA (should be allowed the same accommodations permitted on ISAT). 46

  47. DWWA for Schools that Opt Out of Benchmark Assessments Grade 8 students must still participate in all four DWWA administrations Optional for grade 7 students to participate in three practice prompts (Fall, Winter, and Spring) Prompts must be administered during specified test windows Sufficient Fall prompt test materials for all grade 7 and 8 students and Directions for Administration will automatically be sent to schools the week prior to testing 47

  48. DWWA Administration Window

  49. DWWA Administration Timing • Students should be allowed 45 minutes, plus up to 10 additional minutes if students are still engaged. • This does not include the time necessary for test instructions.

  50. Upcoming DWWA Events • Professional Development: Fall 09, Winter 10, Spring 10 • Office of Reading and Language Arts and Literacy Coaches will work with 7th and 8th grade teachers on scoring of the 3 centrally-developed and locally administered prompts • CPS will work with external vendor on validation of teacher scores using the ISAT rubric • Sessions will immediately follow each administration of the Benchmark Assessment. Exact dates will follow. • For more information, please contact the Department of Student Assessment at (773) 553-2430.

More Related