Examining Data for the 1% Waiver

1. Examining Data for the 1% Waiver Kentucky Department of Education’s Use of Data to Monitor Appropriate Use of Alternate State Assessments Kentucky Department of Education (KDE) Office of Special Education and Early Learning (OSEEL)

2. OSEP Disclaimer 2019 OSEP Leadership Conference DISCLAIMER: The contents of this presentation were developed by the presenters for the 2019 OSEP Leadership Conference. However, these contents do not necessarily represent the policy of the Department of Education, and you should not assume endorsement by the Federal Government. (Authority: 20 U.S.C. 1221e-3 and 3474)

3. Tools • Kentucky Statewide Student Information System – Infinite Campus • Includes Special Education Module • Alternate Assessment based on Alternate Academic Achievement Standards (AA-AAAS) Eligibility • Learner Characteristics Inventory (LCI) • Justification Survey Data – required for all districts with more than 1% of students participating in the alternate assessment • Training Participation Data – participation in online training modules

4. Additional Tools • EDFacts data (C175, C178, C179, C185, C188, C189)/Other Assessment Data • Participation Rate for State • Participation Rate for LEAs • Significant Disproportionality Data for State by Student Group • Significant Disproportionality Data for each LEA • Scale – up plan for categories • Economically Disadvantaged in 2017-2018 • Economically Disadvantaged, Pacific Islanders, English Learners, and Males in 2018-2019 • Achievement Rate

5. What tools are your state using?

6. Timeline • Spring/Summer – begin planning for waiver application • Summer - seek and respond to public comment for 1% waiver • Early August – submit waiver application • End of October - receive preliminary data from KDE/OSAA • Mid-December – EDFacts files available • Mid-December - pull numbers of students by district and by disability who are eligible for alternate assessment according to their IEPs • January – submit addendum with final data

7. Timeline (continued) • January/February - districts are notified that they have a greater than 1% participation rate in AA-AAAS in any subject area • February/March – districts analyze data and provide justification for exceeding 1% • Spring – monitoring of student files for those participating in alternate assessment participation • Training modules ongoing • Alternate Assessment and Diploma Advisory Group meets throughout

8. Data For the Waiver

9. Initial Waiver Request (2017-2018) • Use previous year’s data (2016-2017) for initial waiver request • Participation rate for state • Calculated based on EDFacts data for mathematics, reading/language arts, and science • Data for social studies and writing obtained directly from Kentucky Department of Education (KDE)/Office of Standards, Assessment and Accountability (OSAA) • Calculated by number of students participating in AA-AAAS divided by all students participating (EDFacts data/OSAA) • 170 out of 175 districts had more than 1% of students participating in the alternate assessment

10. Monitoring • Monitor a sample of districts based on data • Districts over 1% • Districts under 1% • Specific student characteristics • LCI • Specific disabilities • Achievement scores • Districts with highest disproportionality • Analysis of justification responses • Training Data • Other – based on extraneous information

11. District Data for Students Eligible to Participate • Pulled from the Kentucky Statewide Student Information System • Infinite Campus (IC) • Special Education Module (IEP) • Alternate assessment eligibility • Provide data to districts by disability for districts to analyze • District reviews student files for “red flags” • Student achievement • Disability eligibility • LCI data • Disproportionality • Other factors

12. District Rate of Participation in AA-AAAS • Using EDFacts files and additional data obtained by KDE/OSAA • Sample: Also calculated for Social Studies and Writing for each district

13. Students Eligible for AA-AAAS Data based on eligibility data in student IEPs

14. Learner Characteristics Inventory (LCI) • Designed to identify levels of communication and other complex characteristics of students participating in alternate assessment • Embedded in IEP • Districts review • Desk reviews at state level • Developed by the National Center and State Collaborative • LCI included in Kentucky’s Alternate Assessment Participation Guidelines

15. How do you monitor participation?

16. Disproportionality • Kentucky uses 2.0 and above as the threshold • Do not eliminate any district based on n-size or cell-size, but it is considered • Highest rate of disproportionality in 2016-2017 was in the content areas of reading and math among those students who are Economically Disadvantaged • This data was considered in decisions regarding monitoring • Scale up plan was developed for future years

17. The risk for all students NOT in that student group to participate in alternate assessment Calculation – Risk Ratio A risk ratio is the comparison of two different risks: • The risk for a specific student group to participate in alternate assessment • Compared To

18. Categories for Risk Ratio Calculation Subjects Student Groups Race Gender Free/Reduced Lunch Eligible English Learners Migrant Homeless • Reading (Elementary/Middle) • Math (Elementary/Middle) • Writing (Elementary/Middle/High) • Science (Elementary/Middle) • Social Studies (Elementary/Middle) • English II (High) • Algebra II (High) • US History (High)

19. White students taking alternate assessment: 2 All white students assessed in the district: 250 Non-white students taking alternate assessment: 4 Non-white students assessed in the district:2000 Risk of white students taking alt. assessment: 2/250 = 0.008 = 0.8% Risk of non- white students taking alt. assessment: 4/2000 = 0.002 = 0.2% Risk ratio = 0.8/0.2 = 4.00 White students are 4.00 times more likely than non-white students to take the alternate assessment Example

20. Questions? Is your state using a different method?

21. Justification Survey • Required for Directors of Special Education in LEAs over 1% • KY Justification Survey • KY Alternate Assessment Participation Waiver

22. What choices do you provide for justification? How did you determine them?

23. Training and Guidance • Extensive statewide training, coaching, and support plan, known as the Participation for Alternate Assessment (P4AA) Project • Online training modules • Regional cooperative ARC (IEP team meeting) simulations • Regional cooperative coaching (in-person and by teleconferencing) • Guidance documents • Record review document

24. Online Training Modules • Housed at Human Development Institute at the University of Kentucky • Developed by KDE advisory group • KDE and district monitors completion • Required survey for each module to provide feedback (data) • Module 5 focuses on data

25. 2017-2018 Waiver

26. Comparison of SY 2016-17 and SY 2017-18 Alternate Assessment Participation by Subject

27. Overall Statewide Participation

28. Overall Statewide Percentage of Students Eligible to Participate in the AA-AAAS

29. Districts Assessing More than 1% of Students in the Alternate Assessment

30. OSEP Disclaimer1 2019 OSEP Leadership Conference DISCLAIMER: The contents of this presentation were developed by the presenters for the 2019 OSEP Leadership Conference. However, these contents do not necessarily represent the policy of the Department of Education, and you should not assume endorsement by the Federal Government. (Authority: 20 U.S.C. 1221e-3 and 3474)