How Assessment
Download
1 / 62

New Mexico State Assessments - PowerPoint PPT Presentation


  • 78 Views
  • Uploaded on

How Assessment uses data. NMPED Data Conference Fall, 2007 Cindy Gregory Kate Cleary. New Mexico State Assessments. NM Standards Based Assessment (SBA) NM Alternate Performance Assessment (NMAPA) NM English Language Proficiency Assessment (NMELPA NMELPAPT)

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'New Mexico State Assessments' - lorretta


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

How Assessment

uses

data

NMPED Data Conference

Fall, 2007

Cindy Gregory

Kate Cleary


New mexico state assessments
New Mexico State Assessments

  • NM Standards Based Assessment (SBA)

  • NM Alternate Performance Assessment (NMAPA)

  • NM English Language Proficiency Assessment (NMELPA NMELPAPT)

  • NM High School Competency Exam (NMHSCE)

  • National Assessment of Educational Progress (NAEP)

  • General Equivalency Diploma (GED)


Assessment mission
Assessment Mission

Develop, implement and promote quality assessment, research, and evaluation design from which to draw meaningful conclusions.

  • State and Federal reporting of student proficiencies

  • State, district, and school Report Cards

  • Support to the Bureau of Indian Affairs Schools

  • In-house research

  • Collaboration with external research requests

  • Production of public use data sets

  • Training and monitoring test administration and security

Objectives

AYP


Background
Background

  • No Child Left Behind Act of 2001 (NCLB)

  • Applies to all public schools

  • Test reading and math in grades 3-9 and 11.

  • Test science at least once in each grade span (elementary, middle & high school) in 2007-2008 (does not count toward AYP)


Ayp has three parts
AYP Has Three Parts

  • Student Participation in Testing

  • Proficiency in reading and math

  • Graduation and attendance rates (called Other Academic Indicators)


Implications
Implications

AYP results contribute to decisions about:

  • Title 1 Allocations

  • Special Ed Programs

  • Bilingual Programs

  • Curriculum Design

  • School Autonomy

  • Public Perceptions


Data collection and reporting year round process
Data Collection and Reporting Year-Round Process

  • Data Reporting in STARS & SIS (40D, 80D, 120D, EOY) [attendance, FAY, graduation]

  • This year there may be a PreID Label Snapshot (January) and/or a Test Window Snapshot (March)

  • PreID Labels (December & January)

  • Biogrid (February & March)

  • Biodata Review (April & May)

  • Graduation and Attendance Rates (June)

  • AYP Calculations & Designations (July & August)



Additional variables required for reporting
Additional Variables Required for Reporting

  • Plan 504 – Student and Student Snapshot templates, Field # 70

  • Title I-A (Targeted and School-wide Assistance) - Programs Fact template, Field # 5

  • Title I-C (Migrant) - Programs Fact template, Field # 5

  • Immigrant - Student and Student Snapshot templates, Field # 152

  • Bilingual Education - Programs Fact template, Field # 5

  • Enrollment US Schools 3 Yrs - Student and Student Snapshot templates, Field # 125

  • Language Waiver (Yr 1) - Not collected in STARS

  • Language Waiver (Yr 2) - Not collected in STARS


What data is required
What Data is Required?

1. Ethnicity

  • Hispanic

  • Caucasian

  • Native American

  • Asian

  • African American

    Student and Student Snapshot templates, Field # 21

The Importance of GROUP SIZE


What data is required1
What Data is Required?

  • ELL Status

    Student and Student Snapshot templates, Field # 113

    0 = No/Never an ELL Student

    1 = Yes, Currently ELL (NEP/LEP)

    2 = Exited Year 1 (FEP)

    3 = Exited Year 2 (FEP)

    4 = Exited Year 3+ (FEP)

Codes that indicate

ELL= Yes


What data is required2
What Data is Required?

FRLP may be shared only with authorized student nutrition personnel

3. Economically Disadvantaged – Student and Student Snapshot templates, Field # 33

(Free and Reduced Lunch Program)

Every Student and Student Snapshot record needs this indicator

FRLP is about eligibility, not participation


What data is required3
What Data is Required?

  • Students with Disabilities - - Student and Student Snapshot templates, Field # 38

Special Education,

not Gifted - Use Student and Student Snapshottemplates, Field # 34 to indicate challenge type

Students with an IEP - - Special Education Snapshot template, Field # 13


What data is required4
What Data is Required?

Where there are fewer than 25 students, AYP must be calculated anyway

5. All Students


Which students contribute to ratings
Which Students contribute to ratings?

  • All students (in treatment or correctional facility, suspended, retained, moving during test window, part time, open enrollment, non attending, GED prep program)

  • Exempted: foreign exchange, private schools, home schooled students, expelled students not receiving services, and confirmed eligible dropouts

  • Full Academic Year


Data issues
Data Issues

  • Quality of STARS submissions

  • Full Academic Year

  • PreID Labels Process

  • Biogrid Process

  • Coding of ELL, SWD, and FRL

  • Duplicates

  • Graduation

  • Attendance


Stars submissions
STARS Submissions

Values Miscoded?

Missing data?

Student IDs wrong?

Students mislabeled?

Submission errors will not be considered a valid reason for an AYP Appeal


Full academic year
Full Academic Year

The definition of a Full Academic Year is continuous enrollment in the:

  • School

  • District

In other words,

there are two kinds of Full Academic Year

Or “FAY”


Full academic year regular
Full Academic Year Regular

FAY SCHOOL = YES if student is:

  • Enrolled on 120th day of previous school year

    AND

  • Enrolled on 40th day and 80th day of current school year

    AND

  • “Enrolled on the first day of the test window” (takes the test)


Full academic year transition grade
Full Academic Year Transition Grade

x

120D

40D

80D

Test Day


Full academic year new school
Full Academic Year New School

x

120D

40D

80D

Student Snapshots (120D, 40D, 80D) are used to compute FAY SCHOOL and DISTRICT

Test Day


Fay district
FAY - District

If FAY SCHOOL = Yes…

FAY DISTRICT= Yes

School =Yes

District = Yes


Preid labels
PreID Labels

  • For all students grades 3-9, 11

  • Districts collect data for Charter Schools

  • More efficient and accurate than “bubbling” Biogrid

  • Longest opportunity to correct information


Preid labels process
PreID Labels Process

Submit January snapshot

Review reports in STARS

January

Resubmit corrected data to STARS

Early February

Data sent to vendors

Vendors send labels & rosters to districts

March

Districts distribute to schools


Destroy preid label when

X

Fill out name, ID, and DOB on Biogrid.

Destroy PreID Label When…

  • Student’s name is wrong (first, last, middle)

  • State Student ID number is incorrect (not match SIS)

  • Date of Birth is wrong (not match SIS)


X

Destroy PreID Label When…

  • Student is no longer enrolled in school


Use Only One!

Correct Identifiers?

X

Incorrect Identifiers?

Bubble !

Must match STARS


Don t forget
Don’t Forget. . .

Must bubble Section 2 for all students:

  • If applicable,

    • Test Completion Status

  • If applicable,

    • Accommodations

  • All students (grades 4 and above)

    • Form number


This year s biogrid
This Year’s Biogrid…

Identifiers

are crucial

ID

Name

Because all demographics

come from STARS

DOB

Test

Information

(Pre-ID Label)


Ell coding
ELL Coding

  • 0 = No/Never an ELL Student

  • 1 = Yes, Currently ELL (NEP/LEP)

  • 2 = Exited Year 1 (FEP)

  • 3 = Exited Year 2 (FEP)

  • 4 = Exited Year 3+ (FEP)

Codes that indicate

ELL= Yes


Swd coding
SWD Coding

  • SPED = “Yes”

  • Primary Disability = not “Gifted”

No other distinction is made in

Students with Disabilities


Economically disadvantaged coding
Economically Disadvantaged Coding

  • FRL = “Schoolwide”

  • FRL = “Targeted”

If field is missing, it defaults to “No”


Who is an immigrant for nclb federal reporting
Who is an Immigrant? (for NCLB Federal Reporting)

  • An Immigrant is a student who is:

  • Aged 3 through 21

    AND

  • Not born in any state

    AND…

Which means: student was born in another country, not on US Territory, to non US citizens.

If born to US citizens in another country or on US Territory (military bases, etc.), they are not an immigrant even if they have dual citizenship.


Who is an immigrant continued
Who is an Immigrant? (continued)

  • Attended school in the United States for 3 or fewer, consecutive, full academic years. (K does not count as a consecutive year)

This rule is unique to

Standards-Based Testing

and is a separate variable

for reporting in STARS.

  • Kindergarten does not count toward the 3 consecutive academic years.


Possible causes for duplicates
Possible Causes for Duplicates

  • Large print test

  • Corruption of answer sheet

  • Tested in English & Spanish

  • Student mobility caused retesting

  • Precoded label applied to wrong student’s answer document

  • Incorrect student ID (twins, name similarities)

  • Student utilized 2 test booklets


Consequences of unresolved duplicates
Consequences of Unresolved Duplicates

  • Any score report returned by the test company will not reflect accurate assessment results for that student.

  • Both tests must be removed from the dataset.

  • The student will not count toward the school participation rate.


Feeder schools
Feeder Schools

  • Schools of any configuration within grades K-2

  • Must give AYP rating although current students are not tested

  • Find alumnae who are now in 3rd grade

Only students who have

remained

WITHIN DISTRICT



Attendance
Attendance

  • Student Summary Attendance Template

  • Per STUDENT

  • No minimum on duration of enrollment

  • One student can contribute to several schools

  • Every student has the same weight in the calculation

Old Calculation

INCORRECT!

Total Days Attended

Total Days Enrolled


Attendance1

Attendance

= 70%

50%

30%

100%

100%

The old calculation:

Days Attended = 5 + 6 + 120 + 120 = 251

Days Enrolled = 10 + 20 + 120 + 120 = 270

= 93%


Who is a graduate
Who is a “Graduate”?

  • Enrolled as 9th grader in 2004

  • Receives a standard diploma

  • Graduates in 2008

  • (5 years may be allowed for special subgroups)


Who is not a “Graduate”?

  • Recipients of GED

  • Recipients of Certificates of Completion (did not pass NMHSCE)

  • Students exiting from your school who do not graduate elsewhere in the state


Who is exempt from grad calculation
Who is Exempt from Grad Calculation?

  • Foreign exchange students

  • Students who transfer out of state

  • Returning 12th graders with IEPs continuing to receive services

  • Students exiting to private or home school

  • Deceased


Keys to Accurate Rates

  • Document any senior who leaves the state, or the public education system (PED does not get this data)

  • Record all of your graduates in STARS including winter (early) graduates.

  • Finalize EOY reporting early to allow additional time to review grad lists.

  • Ensure that staff are available in summer months to review lists.


Utilize stars reports
Utilize STARS reports…

Attendance, rate for each reporting period

Graduation, list of eligible graduates for your school

Demographics, student rosters as well as aggregate summaries

Yearly AYP Summaries, 2 years

Achievement Gap Summaries, 2 years

Check Data Submissions throughout year.

Don’t Wait until AYP!


Update your Contact Information

We maintain special lists:

  • Superintendents & Principals

  • Data (registrars, test coordinators, STARS)

  • Clerical support

Current email address is vital.

Ensure that we have at least

2 good contacts at all times,

Especially SUMMER


AYP Questions?

Helpdesk

827-6508 (Cindy)

827-6509 (Stephanie)

827-6528 (Tom)

827-6799 (Margaret)

Procedure Manual

http://www.ped.state.nm.us/ search “Procedure Manual” and get latest version

Accountability Workbook

http://www.ped.state.nm.us/ search “Accountability Workbook” and get latest version


Where is the data located
Where is the data located

  • Student - NCLB subgroup designations, feeder schools, immigrant indicator, US 3 years, Plan 504

  • Student Snapshot – FAY, NCLB subgroup designations, feeder schools, immigrant indicator, US 3 years, Plan 504

  • Student Summary Attendance - Attendance rate

  • School Enrollment - Graduation rate (?)

  • Programs Fact – Title1A, Title1C, BEP

  • Items in red indicate AYP data



Where is the data located2
Where is the data located

For FAY Only

A student record MUST be present for all FAY students in the

previous year’s 120D, and the Current year’s 40D, 80D,

and test window snapshot.


Where is the data located3
Where is the data located

Carefully review the DAYS PRESENT and DAYS ENROLLED numbers




How can the data be reviewed
How can the data be reviewed

  • https://nmreport.escholar.com

  • Public Folders > eScholar Framework for Cognos – Verify > District/Location Reports > Other/Validation Reports > Student Reports > Student AYP NCLB Subgroup totals by NCLB Subgroup – AYP

  • Public Folders > eScholar Framework for Cognos – Verify > District/Location Reports > Verification Reports > Student Reports


How can the data be reviewed1
How can the data be reviewed

Public Folders > eScholar Framework for Cognos – Verify > District/Location Reports > Other/Validation Reports > Student Reports >

Student AYP NCLB Subgroup totals by NCLB Subgroup – AYP – Check at each reporting period to review the subgroup members


How can the data be reviewed2
How can the data be reviewed

Public Folders > eScholar Framework for Cognos - Verify > District/Location Reports > Other/Validation Reports > Student Reports

AYP Student Roster

Lists those students who took the NMSBA and NMAPA

Includes Demographics, Test Status, Score, Proficiency Level for all tests taken


How can the data be reviewed3
How can the data be reviewed

Public Folders > eScholar Framework for Cognos - Verify > District/Location Reports > Verification Reports > Student Reports

Student and Student Snapshot Template Verifications - to review the student level demographic data

Student Summary Attendance Verification – to review Days Enrolled and Days Attended per student


How can the data be reviewed4
How can the data be reviewed

To learn more about Assessment reports, please attend the ‘Running AYP Reports’, ‘AYP Biographical Data Review’, ‘Student Roster Reports’, and ‘Assessment Cube:Using the Cubes in STARS to analyze the data’ Sessions.


How can the data be reviewed5
How can the data be reviewed

Some examples of helpful reports:

AYP District

AYP School

Achievement Gap

AYP Performance by Level, Grade and Disaggregation

Programs Fact Template Verification for Title I, Title IC, BEP

Student AYP NCLB Subgroup totals by NCLB Subgroup - AYP

Membership Report


How can the data be updated
How can the data be updated

Key field changes require a delete of the previous data then resubmission; updatable fields require a resubmission

Key fields:

  • Student:

    • District Code, School Year Date, Student ID

  • Student Snapshot:

    • District Code, School Year Date, Student ID, Snapshot Date

  • Student Summary Attendance:

    • District Code, Location, School Year Date, Student ID, Period Start Date, Period End Date

  • School Enrollment:

    • District Code, School Year Date, Student ID, Location, Activity Date, Enrollment Date, Enrollment Code

  • Programs Fact:

    • District Code, School Year Date, Student ID, Programs Code, Beginning Date (not used for assessment)


How can the data be updated1
How can the data be updated

  • To update any student demographics, Special Ed Status, Challenge Code, FRLP, English Proficiency:

    • 1. Request to be opened for reporting period

    • 2. Submit updated Student Snapshot file

    • 3. Repeat as necessary through end of submission period

      Remember key field changes require a delete of the record prior to resubmission !


How can the data be updated2
How can the data be updated

  • To update attendance information:

    • 1. Request to be opened for reporting period

    • 2. Submit updated Student Summary Attendance file

    • 3. Repeat as necessary through end of submission period

      Remember key field changes require a delete of the record prior to resubmission !


ad