1 / 62

How Assessment uses data

How Assessment uses data. NMPED Data Conference Fall, 2007 Cindy Gregory Kate Cleary. New Mexico State Assessments. NM Standards Based Assessment (SBA) NM Alternate Performance Assessment (NMAPA) NM English Language Proficiency Assessment (NMELPA NMELPAPT)

lorretta
Download Presentation

How Assessment uses data

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. How Assessment uses data NMPED Data Conference Fall, 2007 Cindy Gregory Kate Cleary

  2. New Mexico State Assessments • NM Standards Based Assessment (SBA) • NM Alternate Performance Assessment (NMAPA) • NM English Language Proficiency Assessment (NMELPA NMELPAPT) • NM High School Competency Exam (NMHSCE) • National Assessment of Educational Progress (NAEP) • General Equivalency Diploma (GED)

  3. Assessment Mission Develop, implement and promote quality assessment, research, and evaluation design from which to draw meaningful conclusions. • State and Federal reporting of student proficiencies • State, district, and school Report Cards • Support to the Bureau of Indian Affairs Schools • In-house research • Collaboration with external research requests • Production of public use data sets • Training and monitoring test administration and security Objectives AYP

  4. Background • No Child Left Behind Act of 2001 (NCLB) • Applies to all public schools • Test reading and math in grades 3-9 and 11. • Test science at least once in each grade span (elementary, middle & high school) in 2007-2008 (does not count toward AYP)

  5. AYP Has Three Parts • Student Participation in Testing • Proficiency in reading and math • Graduation and attendance rates (called Other Academic Indicators)

  6. Implications AYP results contribute to decisions about: • Title 1 Allocations • Special Ed Programs • Bilingual Programs • Curriculum Design • School Autonomy • Public Perceptions

  7. Data Collection and Reporting Year-Round Process • Data Reporting in STARS & SIS (40D, 80D, 120D, EOY) [attendance, FAY, graduation] • This year there may be a PreID Label Snapshot (January) and/or a Test Window Snapshot (March) • PreID Labels (December & January) • Biogrid (February & March) • Biodata Review (April & May) • Graduation and Attendance Rates (June) • AYP Calculations & Designations (July & August)

  8. Groups that Impact AYP

  9. Additional Variables Required for Reporting • Plan 504 – Student and Student Snapshot templates, Field # 70 • Title I-A (Targeted and School-wide Assistance) - Programs Fact template, Field # 5 • Title I-C (Migrant) - Programs Fact template, Field # 5 • Immigrant - Student and Student Snapshot templates, Field # 152 • Bilingual Education - Programs Fact template, Field # 5 • Enrollment US Schools 3 Yrs - Student and Student Snapshot templates, Field # 125 • Language Waiver (Yr 1) - Not collected in STARS • Language Waiver (Yr 2) - Not collected in STARS

  10. What Data is Required? 1. Ethnicity • Hispanic • Caucasian • Native American • Asian • African American Student and Student Snapshot templates, Field # 21 The Importance of GROUP SIZE

  11. What Data is Required? • ELL Status Student and Student Snapshot templates, Field # 113 0 = No/Never an ELL Student 1 = Yes, Currently ELL (NEP/LEP) 2 = Exited Year 1 (FEP) 3 = Exited Year 2 (FEP) 4 = Exited Year 3+ (FEP) Codes that indicate ELL= Yes

  12. What Data is Required? FRLP may be shared only with authorized student nutrition personnel 3. Economically Disadvantaged – Student and Student Snapshot templates, Field # 33 (Free and Reduced Lunch Program) Every Student and Student Snapshot record needs this indicator FRLP is about eligibility, not participation

  13. What Data is Required? • Students with Disabilities - - Student and Student Snapshot templates, Field # 38 Special Education, not Gifted - Use Student and Student Snapshottemplates, Field # 34 to indicate challenge type Students with an IEP - - Special Education Snapshot template, Field # 13

  14. What Data is Required? Where there are fewer than 25 students, AYP must be calculated anyway 5. All Students

  15. Which Students contribute to ratings? • All students (in treatment or correctional facility, suspended, retained, moving during test window, part time, open enrollment, non attending, GED prep program) • Exempted: foreign exchange, private schools, home schooled students, expelled students not receiving services, and confirmed eligible dropouts • Full Academic Year

  16. Data Issues • Quality of STARS submissions • Full Academic Year • PreID Labels Process • Biogrid Process • Coding of ELL, SWD, and FRL • Duplicates • Graduation • Attendance

  17. STARS Submissions Values Miscoded? Missing data? Student IDs wrong? Students mislabeled? Submission errors will not be considered a valid reason for an AYP Appeal

  18. Full Academic Year The definition of a Full Academic Year is continuous enrollment in the: • School • District In other words, there are two kinds of Full Academic Year Or “FAY”

  19. Full Academic Year Regular FAY SCHOOL = YES if student is: • Enrolled on 120th day of previous school year AND • Enrolled on 40th day and 80th day of current school year AND • “Enrolled on the first day of the test window” (takes the test)

  20. Full Academic Year Transition Grade x 120D 40D 80D Test Day

  21. Full Academic Year New School x 120D 40D 80D Student Snapshots (120D, 40D, 80D) are used to compute FAY SCHOOL and DISTRICT Test Day

  22. FAY - District If FAY SCHOOL = Yes… FAY DISTRICT= Yes School =Yes District = Yes

  23. PreID Labels • For all students grades 3-9, 11 • Districts collect data for Charter Schools • More efficient and accurate than “bubbling” Biogrid • Longest opportunity to correct information

  24. PreID Labels Process Submit January snapshot Review reports in STARS January Resubmit corrected data to STARS Early February Data sent to vendors Vendors send labels & rosters to districts March Districts distribute to schools

  25. X Fill out name, ID, and DOB on Biogrid. Destroy PreID Label When… • Student’s name is wrong (first, last, middle) • State Student ID number is incorrect (not match SIS) • Date of Birth is wrong (not match SIS)

  26. X Destroy PreID Label When… • Student is no longer enrolled in school

  27. Use Only One! Correct Identifiers? X Incorrect Identifiers? Bubble ! Must match STARS

  28. Don’t Forget. . . Must bubble Section 2 for all students: • If applicable, • Test Completion Status • If applicable, • Accommodations • All students (grades 4 and above) • Form number

  29. This Year’s Biogrid… Identifiers are crucial ID Name Because all demographics come from STARS DOB Test Information (Pre-ID Label)

  30. ELL Coding • 0 = No/Never an ELL Student • 1 = Yes, Currently ELL (NEP/LEP) • 2 = Exited Year 1 (FEP) • 3 = Exited Year 2 (FEP) • 4 = Exited Year 3+ (FEP) Codes that indicate ELL= Yes

  31. SWD Coding • SPED = “Yes” • Primary Disability = not “Gifted” No other distinction is made in Students with Disabilities

  32. Economically Disadvantaged Coding • FRL = “Schoolwide” • FRL = “Targeted” If field is missing, it defaults to “No”

  33. Who is an Immigrant? (for NCLB Federal Reporting) • An Immigrant is a student who is: • Aged 3 through 21 AND • Not born in any state AND… Which means: student was born in another country, not on US Territory, to non US citizens. If born to US citizens in another country or on US Territory (military bases, etc.), they are not an immigrant even if they have dual citizenship.

  34. Who is an Immigrant? (continued) • Attended school in the United States for 3 or fewer, consecutive, full academic years. (K does not count as a consecutive year) This rule is unique to Standards-Based Testing and is a separate variable for reporting in STARS. • Kindergarten does not count toward the 3 consecutive academic years.

  35. Possible Causes for Duplicates • Large print test • Corruption of answer sheet • Tested in English & Spanish • Student mobility caused retesting • Precoded label applied to wrong student’s answer document • Incorrect student ID (twins, name similarities) • Student utilized 2 test booklets

  36. Consequences of Unresolved Duplicates • Any score report returned by the test company will not reflect accurate assessment results for that student. • Both tests must be removed from the dataset. • The student will not count toward the school participation rate.

  37. Feeder Schools • Schools of any configuration within grades K-2 • Must give AYP rating although current students are not tested • Find alumnae who are now in 3rd grade Only students who have remained WITHIN DISTRICT

  38. Districts with Feeder Schools 2005

  39. Attendance • Student Summary Attendance Template • Per STUDENT • No minimum on duration of enrollment • One student can contribute to several schools • Every student has the same weight in the calculation Old Calculation INCORRECT! Total Days Attended Total Days Enrolled

  40.    Attendance = 70% 50% 30% 100% 100% The old calculation: Days Attended = 5 + 6 + 120 + 120 = 251 Days Enrolled = 10 + 20 + 120 + 120 = 270 = 93%

  41. Who is a “Graduate”? • Enrolled as 9th grader in 2004 • Receives a standard diploma • Graduates in 2008 • (5 years may be allowed for special subgroups)

  42. Who is not a “Graduate”? • Recipients of GED • Recipients of Certificates of Completion (did not pass NMHSCE) • Students exiting from your school who do not graduate elsewhere in the state

  43. Who is Exempt from Grad Calculation? • Foreign exchange students • Students who transfer out of state • Returning 12th graders with IEPs continuing to receive services • Students exiting to private or home school • Deceased

  44. Keys to Accurate Rates • Document any senior who leaves the state, or the public education system (PED does not get this data) • Record all of your graduates in STARS including winter (early) graduates. • Finalize EOY reporting early to allow additional time to review grad lists. • Ensure that staff are available in summer months to review lists.

  45. Utilize STARS reports… Attendance, rate for each reporting period Graduation, list of eligible graduates for your school Demographics, student rosters as well as aggregate summaries Yearly AYP Summaries, 2 years Achievement Gap Summaries, 2 years Check Data Submissions throughout year. Don’t Wait until AYP!

  46. Update your Contact Information We maintain special lists: • Superintendents & Principals • Data (registrars, test coordinators, STARS) • Clerical support Current email address is vital. Ensure that we have at least 2 good contacts at all times, Especially SUMMER

  47. AYP Questions? Helpdesk 827-6508 (Cindy) 827-6509 (Stephanie) 827-6528 (Tom) 827-6799 (Margaret) Procedure Manual http://www.ped.state.nm.us/ search “Procedure Manual” and get latest version Accountability Workbook http://www.ped.state.nm.us/ search “Accountability Workbook” and get latest version

  48. Where is the data located • Student - NCLB subgroup designations, feeder schools, immigrant indicator, US 3 years, Plan 504 • Student Snapshot – FAY, NCLB subgroup designations, feeder schools, immigrant indicator, US 3 years, Plan 504 • Student Summary Attendance - Attendance rate • School Enrollment - Graduation rate (?) • Programs Fact – Title1A, Title1C, BEP • Items in red indicate AYP data

  49. Where is the data located

  50. Where is the data located For FAY Only A student record MUST be present for all FAY students in the previous year’s 120D, and the Current year’s 40D, 80D, and test window snapshot.

More Related