DAC Academy 2012 August 23, 2012 Colorado Department of Education Assessment Unit

1. DAC Academy 2012 August 23, 2012 Colorado Department of Education Assessment Unit

2. Welcome! • Introductions • Assessment News and Reviews • Introduction to Partnership for Assessment of Readiness for College and Careers (PARCC) - 15 Minute Break • Introduction of New Science and Social Studies Assessments • Update on the Colorado Content Collaboratives - Lunch • Afternoon Break-Out Sessions

3. Meet the Assessment Leadership and Support Team Joyce Zurkowski Executive Director of Assessment Christina Wirth-Hawkins Assistant Director of Assessment Margo Allen Business Process Manager

4. Meet the Assessment Team Christine Deines CO ACT Glen Sirakavit New Assessment Jason Clymer TCAP Pam A. Sandoval NAEP Coordinator Mira Monroe Special Ed. Angela Norlander Content Collaboratives Heather Villalobos Pavia ELL

5. Meet the Assessment Data Team Jessica Allen Data Jasmine Carey Psychometrician

6. Additional CDE Staff Bill Bonk Accountability Linda Lamirande Special Ed.

7. Jason Clymer Transitional Colorado Assessment program (TCAp)

8. TCAP and Summative Assessment Timeline

9. TCAP 2012 • Congratulations on a successful first year of TCAP!

10. The State of Reading Grades 3, 4, 6 and 7 demonstrate upward trends in reading proficiency

11. The State of Writing • Grades 5, 7 and 8 have higher proficiency levels than 2005 levels.

12. The State of Mathematics • All grade levels have higher proficiency levels than 2005 levels

13. The State of Science • All grades show improvement in proficiency compared to the 2008 scores

14. TCAP 2012 Issues • Parent “Opt Out” • All students must test • Letter addressing opt out will be updated and re-released in 2013 • Multiple Misadministrations • Wrong session given: Reading/Writing • Using old items for test preparation • Students discussing items

15. Clarifying Procedures • New test security: forthcoming • Procedures Manual update: coming in September • Frequently Asked Questions (FAQ) • Reading after the test: updated script in Test Proctor’s Manual • Supplementary training: Oral Scripts, Teacher Read Directions, and other topics

16. TCAP 2013 • Will still assess the same content as noted in the TCAP Frameworks • Will still be administered at the same time and in the same manner • Training schedule will remain the same • Scoring and reporting will remain on the same timeline

17. Mira Monroe Accommodations

18. Accommodations What’s New? • Format: • Includes instructions on all accommodations • Tables appear to have more restricted accommodations – but… • iPad: Not allowed • Verification of Removal Form • ACCESS for ELLs®

19. Accommodations • September: Training • Statewide • 10/31 – 11/23: Order Special TCAP • Navigator • November 15: Extra Special TCAP Due • Mira • December 15: Non-standard Accommodations • Mira

20. Accommodations State Monitoring Visits • Coordinating visits with Title programs • Mira and Heather will be doing visits

21. Mira Monroe and Linda Laraminde Colorado Alternate (Coalt)

22. Colorado Alternate Assessment CoAlt • October 10 – 24: Order Material • November: Administration Training • February 6 – March 22: Test Window • March 26: Schedule Pick-up

23. Alternate Standards and Assessment Eligibility Criteria Worksheet • Eligibility is determined • by the IEP team • 1stDetermine Academic Standard • 2nd Determine Assessment • Questions Contact: • Linda Lamirande • Exceptional Student Services Unit • 303.866.6863 • lamirande_l@cde.state.co.us

24. Christine Deines Colorado ACT (CO ACT)

25. DAC Academy 2011 Colorado ACT College Entrance Exam • Accepted by U.S. Colleges, Universities, Military Academies and NCAA Colorado ACT (COACT) • State test date: April 23, 2013 • Make-up test date: May 7, 2013 • 2013 Test Date on TUESDAY • Accommodations Testing Dates: April 23 – May 7, 2013 • All 11th grade students by law 11th Grade Alternate for students eligible to take CoAlt • Managed by Exceptional Student Leadership Unit • Testing Window: April 1 – April 26, 2013 • Contact Linda Lamirande, ESSU 303-866-6863 Lamirande_L@cde.state.co.us

26. DAC Academy 2011 Colorado ACTCOACT Test Supervisor (TS) DACs may need to develop a communication process with Test Supervisors for Accountability*. CONTRACT DAC COMMUNICATION *Test Supervisors must develop a communication plan with Back-up Test Supervisors and Test Accommodations Coordinators.

27. DAC Academy 2011 CO ACT UPDATES ONLINE Schools • New changes online schools: Two national tests date options to online students ONLY: • February 9, 2013 & April 13, 2013 • Student can choose either OPTION • Student can pay $20 to take April 13, 2013 if they registered and miss Feb. , 2013 test option

28. DAC Academy 2011 ACT Graduating Class Reporthttp://www.cde.state.co.us/assessment/documents/coact/data/DifCOACTProfileReport_GradClassReport.pdf • ACT Profile Report • Results of All Colorado Public School’s Spring Testing Population • Results for State Mandated Test • ACT Graduating Class Report • Most recent test Date for each student in most recent graduating class in a Colorado HS (both private & public)

29. DAC Academy 2011 ACT Graduating Class Report

30. Pam A. Sandoval National Assessment of educational Progress (NAEP)

31. DAC Academy 2012 National Assessment of Educational Progress NAEP 2013 National and state sample of grades 4 & 8 and national sample of grade 12 (Close to 17,000 schools and 795,000 students nationwide) NAEP 2013 Assessment Window *Each selected student is tested in one subject, only.

32. DAC Academy 2012 National Assessment of Educational Progress NAEP Participating schools selected by National NAEP Statisticians • Most schools identified last May • 99% of participating NAEP districts have received initial notification from NAEP State Coordinator • Will receive state & national results for grades 4 and 8 in reading and math in fall of 2013. A few districts will also take the TEL test (technology & engineering literacy) which is a computer-based field test. In NAEP, we do not receive disaggregated results for districts or individual schools- not designed for this.

33. DAC Academy 2012 National Assessment of Educational Progress NAEP Roles National NAEP Office NAEP State Coordinator NSC School & Community Contracted Assessment Team: Westat

34. DAC Academy 2012 National Assessment of Educational ProgressNAEP- Relationship between NAEP & School Community NAEP State Coordinator NAEP School Coordinator • Confirms the assessment date • Provides schools with info for parental notification • Responds to questions • Works with district/school personnel to ensure a smooth process • Reports the results District Contact • Assists NSC in School • communications • Works with NSC and the Supervisor to • Oversee the process School & Community

35. 2011 Math Grade 4: Average Scale Score Higher Not significantly different Lower

36. 2011 Reading Grade 4 *Significantly different (p < .05) from 2011

37. 2011 Math Grade 8: Average Scale Score Higher Not significantly different Lower

38. 2011 Reading Grade 8 *Significantly different (p < .05) from 2011

39. NAEP-The Nation’s Report Card® public web site: http://nces.ed.gov/nationsreportcard/

40. NAEP-The Questions Tool http://nces.ed.gov/nationsreportcard/itmrls/

41. Jessica Allen Data Operations

42. DAC Academy 2012 DATA OPERATIONS • CDE’s role is to support districts in data collection activities for TCAP/CoAlt, CO ACT and ACCESS for ELLs. • This presentation will provide a brief overview of major data and logistic activities. • A Handout with dates, resources specific to each activity and assessment is posted on the website.

43. DAC Academy 2012 Data OperationsEssentials for DACs • Materials Ordering • Automatic Data Exchange (ADE)Collections • Collect accurate data for test book labels (Pre-Coded Labels). • Verify student biographical data after testing (Student Biographic Data (SBD)). • Logistics • Handling of testing materials before, during, and after testing • Final Assessment Results

44. DAC Academy 2012 Data Operations Ordering Materials • TCAP • October Count is used for initial order, December/January Pre-Coded labels used to adjust list. • CoAlt • Online Enrollments –CTB Navigator • ACCESS for ELLs • Online - MetriTech's website • CO ACT • Order Online. • Email sent via ACT

45. DAC Academy 2011 Data Operations Pre-Coded Labels (PCL) • Label applied to test booklet that links student information (e.g. name, gender) and eliminates having to ‘bubble’ this information on test booklet. • TCAP/CoAlt and CO ACT-Students data sources • October Student Count and December/January PCL Collection. • ACCESS for ELLs • October Student Count information.

46. DAC Academy 2011 Data Operations: LogisticsReceiving, processing, and shipping test materials • Training posted on the assessment website in November. • Topics will include • Recording test invalidations and accommodations at time of testing. • Creating the School Group List (SGL) • Tracking the number of tests returned by content area, grade, and school • Procedures for Home Schooled students • N Count on Navigator

47. DAC Academy 2012 Data OperationsStudent Biographical Data (SBD) Review • Opportunity to review and verify SBD data. • Training will be online in late February 2013. • Optional but necessary for any accountability appeals that use assessment data.

48. DAC Academy 2012 Data OperationsN Counts – TCAP and CoAlt Only • Review and verification number of test booklets submitted to CTB. • Districts work directly with CTB.

49. DAC Academy 2012 Data Operations Final Assessment Results • Districts receive information directly from testing companies. • All results are embargoed from public distribution until a specific date

50. DAC Academy 2011 Data Operations: ADE • CDE system • Each collection requires registration • Assessment Collections • Pre-Coded Labels • Student Biographical Data Collection (Two stages) • Stage 1: Download, edit and upload an approved file. • State 2: Review of approved file