1 / 99

Miami-Dade County Public Schools September 30 or October 2, 2014

Miami-Dade County Public Schools September 30 or October 2, 2014. Test Chairperson’s Orientation. Agenda. Morning Session 2014-15 Testing Calendar Accountability Update Test Security, Reporting Violations, and Responding to Inquiries Updates to the Testing Programs PMRN / FAIR-FS FSA

hilda-downs
Download Presentation

Miami-Dade County Public Schools September 30 or October 2, 2014

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Miami-Dade County Public SchoolsSeptember 30 or October 2, 2014 Test Chairperson’s Orientation

  2. Agenda • Morning Session • 2014-15 Testing Calendar • Accountability Update • Test Security, Reporting Violations, and Responding to Inquiries • Updates to the Testing Programs • PMRN / FAIR-FS • FSA • FCAT/FCAT 2.0 • EOC • DDEOC • SAT • Grade 3 Opportunities for Promotion

  3. Agenda • Morning Session • Updates to the Testing Programs (cont.) • PERT • CELLA • CELLA Online • NAEP/TIMMS • Interim Assessments • Afternoon Session • Test Chair 101 • Test Chair 201 • Questions and Answers

  4. 2014-15 Testing Calendar

  5. CBT Testing Platforms, 2014-2015

  6. CBT Testing Platforms, 2014-2015

  7. FLDOE Framework for the School Grading System for 2014-15 and Beyond Gisela Feild Administrative Director Assessment, Research and Data Analysis July 2014

  8. Revised Education Accountability • Governor’s Education Accountability Summit and Executive Order • Provide stability and clarity with the transition to a new assessment • Pursue Florida’s course of action regarding English Language Learners (ELL) in the ESEA waiver • Ensure the accountability system is fair and transparent and promotes improvement in student outcomes • Senate Bill 1642 provides the framework for the updated school accountability system consistent with those objectives

  9. Senate Bill 1642–Education Accountability Revisions • Re-focuses the school grading formula on student success measures • Achievement • Learning gains • Graduation • Earning College Credit and/or Industry Certifications • Maintains a focus on students who need the most support • ELLs included in Achievement after 2 years • Establishes a learning gains calculation that (1) requires students scoring below grade level to grow toward grade level performance, and (2) requires students already at grade level to progress beyond grade level performance

  10. Senate Bill 1642–Education Accountability Revisions - continued • Eliminates provisions that over-complicate the formula and muddle the meaning of a school grade • No bonus factors or additional weighting that may raise a school grade • No additional requirements or no automatic adjustments that may lower a school grade • Ensures that the level of performance associated with an A-F school grade is transparently evident • Report all school grade components as percentages, each worth a maximum of 100 points • Report A-F grades based on a percentage of points earned (e.g., 70%, 80%), rather than a point total

  11. Senate Bill 1642–Education Accountability Revisions - continued • Requires the State Board to reset the grading scale avoiding the compression of the current scale • There must be at least five percentage points separating the percentage thresholds needed to earn each of the school grades • The State Board must periodically review the scale to determine whether the expectations should be raised to encourage increased student achievement • If the Board adjusts the grading scale upward, it must inform the public and the school districts of the reasons for the adjustment and the anticipated impact on school grades

  12. Elementary School Grades Model(700 points) • The school grade is based on the percentage of total points earned • Provisions that may raise or lower a school’s grade beyond what the percentage of points would indicate are eliminated (no additional requirements; no additional weights/bonus; no automatic adjustments) • Writing is included within the English/Language Arts components

  13. Middle School Grades Model(900 points) • The school grade is based on the percentage of total points earned • Provisions that may raise or lower a school’s grade beyond what the percentage of points would indicate are eliminated (no additional requirements; no additional weights/bonus; no automatic adjustments) • Writing is included within the English/Language Arts components

  14. Senior High School Grades Model(1000 points) • The school grade is based on the percentage of total points earned • Provisions that may raise or lower a school’s grade beyond what the percentage of points would indicate are eliminated (no additional requirements; no additional weights/bonus; no automatic adjustments) • Writing is included within the English/Language Arts components • Additional graduation rates (At-Risk and 5-year), college readiness measures (based on SAT, ACT, and PERT), and a stand-alone acceleration participation measure are eliminated from the model

  15. Senate Bill 1642–Education Accountability Transition Year • For the current school year (pending senior high, 2013-14), there are no changes to the school grading system, except those already directed by existing statute or State Board rule • After Florida students take the new assessments for the first time in 2014-15, student performance level expectations (“cut scores”) will be set in the summer immediately following the first administration of the new assessment • A new baseline calculation of school grades will occur in Fall 2015, which accurately reflects student performance on the Florida Standards and FSA • This baseline, informational approach in the first year provides everyone – parents, schools, districts, the general public – a clear understanding of a student’s and a school’s starting point on the new, more rigorous Florida Standards and FSA

  16. Senate Bill 1642–Education Accountability Transition Year No Consequences from the Baseline 2014-15 School Grades • No interruption in current support to underperforming schools through our Differentiated Accountability teams • A school may not be required to select and implement a turnaround option in the 2015-16 school year based on the 2014-15 grade or school improvement rating • A district or charter school system designated as high-performing may not lose the designation based on the 2014-15 grades • For purposes of determining grade 3 retention and high school graduation, student performance on the 2014-15 assessments shall be linked to 2013-14 student performance expectations • Same process used for FCAT to FCAT 2.0

  17. Senate Bill 1642–Education Accountability Implementation Schedule • Commissioner re-establishing advisory groups to receive input • LPAC, Leadership Policy Advisory Committee • AAAC, Assessment and Accountability Advisory Committee • LPAC and AAAC will meet in the summer and fall • Draft of school grades rule to the State Board in early 2015 • Standards setting meetings held summer 2015 • Draft of rule on school grading scale to the State Board in Sept/Oct 2015 • 2014-15 Grades calculated in Oct/Nov 2015

  18. Spring 2014: FCAT 2.0 Administered Spring 2016: FSA administered for the 2nd time Summer 2015: Standard setting begins to establish cut scores for the FSA Spring 2015: New Florida Standards Assessment (FSA) administered Summer 2014: School Grades released with current formula and accountability measures  Fall 2015: Baseline School Grades released based on FSA results and new cut scores Assessment and Accountability Transition 2013-2014 2015-2016 2014-2015 Summer 2016: School Grades released with consequences

  19. Test Security, Reporting Violations, and Responding to State Inquiries Dr. Sally A. Shay

  20. Security • Standards, Guidelines, and Procedures for Test Administration and Test Security available at http://oada.dadeschools.net/TestChairInfo/InfoForTest Chair.asp • General guidelines adopted by School Board • Florida Test Security Statute and Rule

  21. From Standards: Designation of District Assessments (DDEOC) • Validity of assessments • Sources for selection • Results: reporting and application • Security concerns • Development • Materials • Administration

  22. FCAT/FCAT 2.0/NGSSS EOC • Caveon Data Forensics • The FLDOE has contracted with Caveon Test Security to provide its Caveon Data Forensics™ for all statewide assessments. • Caveon will analyze data to identify highly unusual test results for two primary groups: • Students with extremely similar test responses; and • Schools with improbable levels of similarity, gains and/or erasures. • Flagging only the most extreme results.

  23. Most Powerful & “Credible” Statistic Measures degree of similarity between two or more test instances Analyze each test instance against all other test instances in the school Possible causes of extremely high similarity: Answer Copying Test Coaching Proxy Test Taking Collusion • Caveon Similarity Index

  24. A Comparison…

  25. Based on estimated answer changing rates from: Wrong-to-Right Anything-to-Wrong Find answer sheets with unusual WtR answers Extreme statistical outliers could involve tampering, “panic cheating”, etc. • Caveon Erasure Analyses Important! No student–level score invalidations based on erasure analysis; erasure analysis limited to school-level flagging for additional review.

  26. FSA and FS EOC AIR Data Forensics • American Institutes for Research (AIR) will conduct data forensics using their own methodology. • New model for similarity indices to be proposed at Technical Advisory Committee (TAC) meeting in November. • Webinars for districts after the TAC meeting; dates TBD.

  27. Updates to the Testing Programs:

  28. Progress Monitoring and Reporting Network (PMRN v4) K-2/WAM Updates • Mayda Cabeza, Director I

  29. Progress Monitoring and Reporting Network (PMRN v4)/ • Access to PMRN via http://www.fldoe.org/sso • Login with employee credential • From SSO site click on PMRN • Principal: Required task for establishing SSO/PMRN access for school level users http://www.justreadflorida.com/pmrnfair-fs/pdf/ssoprincipal.pdf • Heat Tickets • IENHELP@fldoe.orgor 855-814-2876 • Toubleshooting: Use Firefox

  30. Florida Standards Assessments (FSA); Florida Comprehensive Assessment Test (FCAT/FCAT 2.0); and Next Generation Sunshine State Standards (NGSSS) End-of-Course (EOC) Assessments • Maria C. Bruguera, Director I • Mara Ugando, Staff Specialist

  31. FSA/FCAT/FCAT 2.0/EOC 31

  32. FSA/FCAT/FCAT 2.0/EOC 32

  33. www.FSAssessments.org www.PearsonAccess. com/fl 33

  34. 34

  35. FSA/FCAT/FCAT 2.0/EOCComputer-Based Testing 35

  36. FSA/FCAT/FCAT 2.0/EOC Computer-Based Testing 36

  37. FSA/FCAT/FCAT 2.0/EOC CBT Practice Tests 37

  38. What You Need to Know About FSA • American Institutes for Research (AIR) • CBT test delivery and support • TIDE, TDS, and ORS management • Data Recognition Corporation (DRC) • Materials shipping and return • Materials production 38

  39. What You Need to Know About FSA • The online FSA Portal is the starting place for all FSA programs, resources, and information. • Information previously published on the FDOE website will now be available on the portal. • You can register for email alerts and be notified when new announcements or resources are posted. • Users will access TIDE, TDS, and ORS through the portal. • www.FSAssessments.org 39

  40. What You Need to Know About FSA • The Test Delivery System (TDS) requires a secure browser download on each computer/device that will be used for testing. • Response files are not saved locally. If there is a disruption in connectivity during testing, the student will be prevented from continuing to test until the issue is resolved. • Handheld calculators may not be provided to students for CBT tests (unless specified on an IEP). • Online calculators are only provided for Sessions 2 and 3 of grades 7 and 8 mathematics and EOCs. • CBT Accommodations can be set for students through an upload OR by the test administrator prior to testing. 40

  41. What You Need to Know About FSA • Test administrators, not school coordinators, will create test sessions and authorize students in their testing room to log in. Test administrators will complete a TDS Certification Process. • Test administrators must be familiar with all students in their testing room. • Test administrators must have a computer or mobile device for test management before and during testing. • Headphones are required for all students for Grades 5-11 ELA listening items (CBT). 41

  42. What You Need to Know About FSA • Training tests are available for students to become familiar with the CBT platform and item types. • Training tests are available by grade band, not grade level. Answer keys and a user guide are available on the portal. • Training tests with CBT accommodations will be available in the fall when the secure browser is available for download. • Grade-level/subject-specific practice tests will be available in Fall 2015. • Students will be able to skip items on live tests and detailed instructions will be provided in administration scripts. • Paper-based Sample Test Materials for grades 3 and 4, including large print and braille (all grades), are being developed. 42

  43. Test Information Distribution Engine (TIDE) User-specific roles Accounts may be created individually or through a file upload Users may create users at or below their level We will provide you with a list of user roles and instructions Assigned roles will apply to all systems (TIDE, TDS, ORS) 43

  44. TIDE PreID upload Add/Edit/Delete Students Print PreID labels Assign Accommodations Invalidate CBT tests Check Answer Document Tracking Reports 44

  45. Test Delivery System (TDS) • Create Test Sessions • Created by test administrator right before testing • Session information is posted for students in the room so they may log in • Student Login/Testing • Approve Students • Once students log in, the test administrator must approve them in TDS before they can access the test • Pause Students • Test administrators may pause student tests for a break, etc. 45

  46. PROPOSED FSA English Language Arts - Writing Component ONLY • The FSA ELA has a Text-Based Writing Component that is administered separately from the rest of the FSA ELA, but it is reported as part of the ELA score. (It is administered earlier to allow time for handscoring.) 46

  47. PROPOSED FSA English Language Arts (Not Including the Writing Component) *All sessions administered over two days. 47

  48. PROPOSED FSA Mathematics *All sessions administered over two days. For Grades 6-8, Session 1 is on Day 1, Sessions 2 & 3 on Day 2. 48

  49. Additional Notes for Mathematics Assessments Students in grades 7-8 and those taking Algebra 1, Algebra 2, and Geometry EOC Assessments will be permitted to use the calculator provided within the assessment platform for certain items. Calculators will not be permitted for session 1 but will be permitted for session 2 for the above mathematics assessments. Practice calculators are available on the FSA Portal at www.FSAssessments.org. 49

  50. Accommodations for Testing • Beginning with Winter 2014, One-Item-Per-Page (PBT and CBT) and Large Print (CBT) are no longer “unique accommodations.” • Student eligibility for ALL paper-based accommodations must be confirmed at the district level and submitted to FDOE. • Remember: paper-based accommodations should only be provided for CBT tests if students CANNOT access assessments on the computer. • CBT accommodations include: Text to Speech (same as Screen Reader currently used with TestHear) and Masking (new) 50

More Related