How Assessment
This presentation is the property of its rightful owner.
Sponsored Links
1 / 62

How Assessment uses data PowerPoint PPT Presentation


  • 47 Views
  • Uploaded on
  • Presentation posted in: General

How Assessment uses data. NMPED Data Conference Fall, 2007 Cindy Gregory Kate Cleary. New Mexico State Assessments. NM Standards Based Assessment (SBA) NM Alternate Performance Assessment (NMAPA) NM English Language Proficiency Assessment (NMELPA NMELPAPT)

Download Presentation

How Assessment uses data

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


New mexico state assessments

How Assessment

uses

data

NMPED Data Conference

Fall, 2007

Cindy Gregory

Kate Cleary


New mexico state assessments

New Mexico State Assessments

  • NM Standards Based Assessment (SBA)

  • NM Alternate Performance Assessment (NMAPA)

  • NM English Language Proficiency Assessment (NMELPA NMELPAPT)

  • NM High School Competency Exam (NMHSCE)

  • National Assessment of Educational Progress (NAEP)

  • General Equivalency Diploma (GED)


Assessment mission

Assessment Mission

Develop, implement and promote quality assessment, research, and evaluation design from which to draw meaningful conclusions.

  • State and Federal reporting of student proficiencies

  • State, district, and school Report Cards

  • Support to the Bureau of Indian Affairs Schools

  • In-house research

  • Collaboration with external research requests

  • Production of public use data sets

  • Training and monitoring test administration and security

Objectives

AYP


Background

Background

  • No Child Left Behind Act of 2001 (NCLB)

  • Applies to all public schools

  • Test reading and math in grades 3-9 and 11.

  • Test science at least once in each grade span (elementary, middle & high school) in 2007-2008 (does not count toward AYP)


Ayp has three parts

AYP Has Three Parts

  • Student Participation in Testing

  • Proficiency in reading and math

  • Graduation and attendance rates (called Other Academic Indicators)


Implications

Implications

AYP results contribute to decisions about:

  • Title 1 Allocations

  • Special Ed Programs

  • Bilingual Programs

  • Curriculum Design

  • School Autonomy

  • Public Perceptions


Data collection and reporting year round process

Data Collection and Reporting Year-Round Process

  • Data Reporting in STARS & SIS (40D, 80D, 120D, EOY) [attendance, FAY, graduation]

  • This year there may be a PreID Label Snapshot (January) and/or a Test Window Snapshot (March)

  • PreID Labels (December & January)

  • Biogrid (February & March)

  • Biodata Review (April & May)

  • Graduation and Attendance Rates (June)

  • AYP Calculations & Designations (July & August)


Groups that impact ayp

Groups that Impact AYP


Additional variables required for reporting

Additional Variables Required for Reporting

  • Plan 504 – Student and Student Snapshot templates, Field # 70

  • Title I-A (Targeted and School-wide Assistance) - Programs Fact template, Field # 5

  • Title I-C (Migrant) - Programs Fact template, Field # 5

  • Immigrant - Student and Student Snapshot templates, Field # 152

  • Bilingual Education - Programs Fact template, Field # 5

  • Enrollment US Schools 3 Yrs - Student and Student Snapshot templates, Field # 125

  • Language Waiver (Yr 1) - Not collected in STARS

  • Language Waiver (Yr 2) - Not collected in STARS


What data is required

What Data is Required?

1. Ethnicity

  • Hispanic

  • Caucasian

  • Native American

  • Asian

  • African American

    Student and Student Snapshot templates, Field # 21

The Importance of GROUP SIZE


What data is required1

What Data is Required?

  • ELL Status

    Student and Student Snapshot templates, Field # 113

    0 = No/Never an ELL Student

    1 = Yes, Currently ELL (NEP/LEP)

    2 = Exited Year 1 (FEP)

    3 = Exited Year 2 (FEP)

    4 = Exited Year 3+ (FEP)

Codes that indicate

ELL= Yes


What data is required2

What Data is Required?

FRLP may be shared only with authorized student nutrition personnel

3. Economically Disadvantaged – Student and Student Snapshot templates, Field # 33

(Free and Reduced Lunch Program)

Every Student and Student Snapshot record needs this indicator

FRLP is about eligibility, not participation


What data is required3

What Data is Required?

  • Students with Disabilities - - Student and Student Snapshot templates, Field # 38

Special Education,

not Gifted - Use Student and Student Snapshottemplates, Field # 34 to indicate challenge type

Students with an IEP - - Special Education Snapshot template, Field # 13


What data is required4

What Data is Required?

Where there are fewer than 25 students, AYP must be calculated anyway

5. All Students


Which students contribute to ratings

Which Students contribute to ratings?

  • All students (in treatment or correctional facility, suspended, retained, moving during test window, part time, open enrollment, non attending, GED prep program)

  • Exempted: foreign exchange, private schools, home schooled students, expelled students not receiving services, and confirmed eligible dropouts

  • Full Academic Year


Data issues

Data Issues

  • Quality of STARS submissions

  • Full Academic Year

  • PreID Labels Process

  • Biogrid Process

  • Coding of ELL, SWD, and FRL

  • Duplicates

  • Graduation

  • Attendance


Stars submissions

STARS Submissions

Values Miscoded?

Missing data?

Student IDs wrong?

Students mislabeled?

Submission errors will not be considered a valid reason for an AYP Appeal


Full academic year

Full Academic Year

The definition of a Full Academic Year is continuous enrollment in the:

  • School

  • District

In other words,

there are two kinds of Full Academic Year

Or “FAY”


Full academic year regular

Full Academic Year Regular

FAY SCHOOL = YES if student is:

  • Enrolled on 120th day of previous school year

    AND

  • Enrolled on 40th day and 80th day of current school year

    AND

  • “Enrolled on the first day of the test window” (takes the test)


Full academic year transition grade

Full Academic Year Transition Grade

x

120D

40D

80D

Test Day


Full academic year new school

Full Academic Year New School

x

120D

40D

80D

Student Snapshots (120D, 40D, 80D) are used to compute FAY SCHOOL and DISTRICT

Test Day


Fay district

FAY - District

If FAY SCHOOL = Yes…

FAY DISTRICT= Yes

School =Yes

District = Yes


Preid labels

PreID Labels

  • For all students grades 3-9, 11

  • Districts collect data for Charter Schools

  • More efficient and accurate than “bubbling” Biogrid

  • Longest opportunity to correct information


Preid labels process

PreID Labels Process

Submit January snapshot

Review reports in STARS

January

Resubmit corrected data to STARS

Early February

Data sent to vendors

Vendors send labels & rosters to districts

March

Districts distribute to schools


Destroy preid label when

X

Fill out name, ID, and DOB on Biogrid.

Destroy PreID Label When…

  • Student’s name is wrong (first, last, middle)

  • State Student ID number is incorrect (not match SIS)

  • Date of Birth is wrong (not match SIS)


New mexico state assessments

X

Destroy PreID Label When…

  • Student is no longer enrolled in school


New mexico state assessments

Use Only One!

Correct Identifiers?

X

Incorrect Identifiers?

Bubble !

Must match STARS


Don t forget

Don’t Forget. . .

Must bubble Section 2 for all students:

  • If applicable,

    • Test Completion Status

  • If applicable,

    • Accommodations

  • All students (grades 4 and above)

    • Form number


This year s biogrid

This Year’s Biogrid…

Identifiers

are crucial

ID

Name

Because all demographics

come from STARS

DOB

Test

Information

(Pre-ID Label)


Ell coding

ELL Coding

  • 0 = No/Never an ELL Student

  • 1 = Yes, Currently ELL (NEP/LEP)

  • 2 = Exited Year 1 (FEP)

  • 3 = Exited Year 2 (FEP)

  • 4 = Exited Year 3+ (FEP)

Codes that indicate

ELL= Yes


Swd coding

SWD Coding

  • SPED = “Yes”

  • Primary Disability = not “Gifted”

No other distinction is made in

Students with Disabilities


Economically disadvantaged coding

Economically Disadvantaged Coding

  • FRL = “Schoolwide”

  • FRL = “Targeted”

If field is missing, it defaults to “No”


Who is an immigrant for nclb federal reporting

Who is an Immigrant? (for NCLB Federal Reporting)

  • An Immigrant is a student who is:

  • Aged 3 through 21

    AND

  • Not born in any state

    AND…

Which means: student was born in another country, not on US Territory, to non US citizens.

If born to US citizens in another country or on US Territory (military bases, etc.), they are not an immigrant even if they have dual citizenship.


Who is an immigrant continued

Who is an Immigrant? (continued)

  • Attended school in the United States for 3 or fewer, consecutive, full academic years. (K does not count as a consecutive year)

This rule is unique to

Standards-Based Testing

and is a separate variable

for reporting in STARS.

  • Kindergarten does not count toward the 3 consecutive academic years.


Possible causes for duplicates

Possible Causes for Duplicates

  • Large print test

  • Corruption of answer sheet

  • Tested in English & Spanish

  • Student mobility caused retesting

  • Precoded label applied to wrong student’s answer document

  • Incorrect student ID (twins, name similarities)

  • Student utilized 2 test booklets


Consequences of unresolved duplicates

Consequences of Unresolved Duplicates

  • Any score report returned by the test company will not reflect accurate assessment results for that student.

  • Both tests must be removed from the dataset.

  • The student will not count toward the school participation rate.


Feeder schools

Feeder Schools

  • Schools of any configuration within grades K-2

  • Must give AYP rating although current students are not tested

  • Find alumnae who are now in 3rd grade

Only students who have

remained

WITHIN DISTRICT


Districts with feeder schools 2005

Districts with Feeder Schools 2005


Attendance

Attendance

  • Student Summary Attendance Template

  • Per STUDENT

  • No minimum on duration of enrollment

  • One student can contribute to several schools

  • Every student has the same weight in the calculation

Old Calculation

INCORRECT!

Total Days Attended

Total Days Enrolled


Attendance1

Attendance

= 70%

50%

30%

100%

100%

The old calculation:

Days Attended = 5 + 6 + 120 + 120= 251

Days Enrolled = 10 + 20 + 120 + 120= 270

= 93%


Who is a graduate

Who is a “Graduate”?

  • Enrolled as 9th grader in 2004

  • Receives a standard diploma

  • Graduates in 2008

  • (5 years may be allowed for special subgroups)


New mexico state assessments

Who is not a “Graduate”?

  • Recipients of GED

  • Recipients of Certificates of Completion (did not pass NMHSCE)

  • Students exiting from your school who do not graduate elsewhere in the state


Who is exempt from grad calculation

Who is Exempt from Grad Calculation?

  • Foreign exchange students

  • Students who transfer out of state

  • Returning 12th graders with IEPs continuing to receive services

  • Students exiting to private or home school

  • Deceased


New mexico state assessments

Keys to Accurate Rates

  • Document any senior who leaves the state, or the public education system (PED does not get this data)

  • Record all of your graduates in STARS including winter (early) graduates.

  • Finalize EOY reporting early to allow additional time to review grad lists.

  • Ensure that staff are available in summer months to review lists.


Utilize stars reports

Utilize STARS reports…

Attendance, rate for each reporting period

Graduation, list of eligible graduates for your school

Demographics, student rosters as well as aggregate summaries

Yearly AYP Summaries, 2 years

Achievement Gap Summaries, 2 years

Check Data Submissions throughout year.

Don’t Wait until AYP!


New mexico state assessments

Update your Contact Information

We maintain special lists:

  • Superintendents & Principals

  • Data (registrars, test coordinators, STARS)

  • Clerical support

Current email address is vital.

Ensure that we have at least

2 good contacts at all times,

Especially SUMMER


New mexico state assessments

AYP Questions?

Helpdesk

827-6508 (Cindy)

827-6509 (Stephanie)

827-6528 (Tom)

827-6799 (Margaret)

Procedure Manual

http://www.ped.state.nm.us/ search “Procedure Manual” and get latest version

Accountability Workbook

http://www.ped.state.nm.us/ search “Accountability Workbook” and get latest version


Where is the data located

Where is the data located

  • Student - NCLB subgroup designations, feeder schools, immigrant indicator, US 3 years, Plan 504

  • Student Snapshot – FAY, NCLB subgroup designations, feeder schools, immigrant indicator, US 3 years, Plan 504

  • Student Summary Attendance - Attendance rate

  • School Enrollment - Graduation rate (?)

  • Programs Fact – Title1A, Title1C, BEP

  • Items in red indicate AYP data


Where is the data located1

Where is the data located


Where is the data located2

Where is the data located

For FAY Only

A student record MUST be present for all FAY students in the

previous year’s 120D, and the Current year’s 40D, 80D,

and test window snapshot.


Where is the data located3

Where is the data located

Carefully review the DAYS PRESENT and DAYS ENROLLED numbers


Where is the data located4

Where is the data located


Where is the data located5

Where is the data located


How can the data be reviewed

How can the data be reviewed

  • https://nmreport.escholar.com

  • Public Folders > eScholar Framework for Cognos – Verify > District/Location Reports > Other/Validation Reports > Student Reports > Student AYP NCLB Subgroup totals by NCLB Subgroup – AYP

  • Public Folders > eScholar Framework for Cognos – Verify > District/Location Reports > Verification Reports > Student Reports


How can the data be reviewed1

How can the data be reviewed

Public Folders > eScholar Framework for Cognos – Verify > District/Location Reports > Other/Validation Reports > Student Reports >

Student AYP NCLB Subgroup totals by NCLB Subgroup – AYP – Check at each reporting period to review the subgroup members


How can the data be reviewed2

How can the data be reviewed

Public Folders > eScholar Framework for Cognos - Verify > District/Location Reports > Other/Validation Reports > Student Reports

AYP Student Roster

Lists those students who took the NMSBA and NMAPA

Includes Demographics, Test Status, Score, Proficiency Level for all tests taken


How can the data be reviewed3

How can the data be reviewed

Public Folders > eScholar Framework for Cognos - Verify > District/Location Reports > Verification Reports > Student Reports

Student and Student Snapshot Template Verifications - to review the student level demographic data

Student Summary Attendance Verification – to review Days Enrolled and Days Attended per student


How can the data be reviewed4

How can the data be reviewed

To learn more about Assessment reports, please attend the ‘Running AYP Reports’, ‘AYP Biographical Data Review’, ‘Student Roster Reports’, and ‘Assessment Cube:Using the Cubes in STARS to analyze the data’ Sessions.


How can the data be reviewed5

How can the data be reviewed

Some examples of helpful reports:

AYP District

AYP School

Achievement Gap

AYP Performance by Level, Grade and Disaggregation

Programs Fact Template Verification for Title I, Title IC, BEP

Student AYP NCLB Subgroup totals by NCLB Subgroup - AYP

Membership Report


How can the data be updated

How can the data be updated

Key field changes require a delete of the previous data then resubmission; updatable fields require a resubmission

Key fields:

  • Student:

    • District Code, School Year Date, Student ID

  • Student Snapshot:

    • District Code, School Year Date, Student ID, Snapshot Date

  • Student Summary Attendance:

    • District Code, Location, School Year Date, Student ID, Period Start Date, Period End Date

  • School Enrollment:

    • District Code, School Year Date, Student ID, Location, Activity Date, Enrollment Date, Enrollment Code

  • Programs Fact:

    • District Code, School Year Date, Student ID, Programs Code, Beginning Date (not used for assessment)


How can the data be updated1

How can the data be updated

  • To update any student demographics, Special Ed Status, Challenge Code, FRLP, English Proficiency:

    • 1. Request to be opened for reporting period

    • 2. Submit updated Student Snapshot file

    • 3. Repeat as necessary through end of submission period

      Remember key field changes require a delete of the record prior to resubmission !


How can the data be updated2

How can the data be updated

  • To update attendance information:

    • 1. Request to be opened for reporting period

    • 2. Submit updated Student Summary Attendance file

    • 3. Repeat as necessary through end of submission period

      Remember key field changes require a delete of the record prior to resubmission !


  • Login