12 th grade naep preparedness research plans and progress
This presentation is the property of its rightful owner.
Sponsored Links
1 / 18

12 th Grade NAEP Preparedness Research Plans and Progress PowerPoint PPT Presentation


  • 55 Views
  • Uploaded on
  • Presentation posted in: General

12 th Grade NAEP Preparedness Research Plans and Progress. Cornelia Orr, Executive Director National Assessment Governing Board. The Board’s Work on Preparedness Has Been Underway for Nearly a Decade. 2002. 2005. 2006. 2009. 2010-2012. 12 th Grade Commission Established.

Download Presentation

12 th Grade NAEP Preparedness Research Plans and Progress

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


12 th grade naep preparedness research plans and progress

12th Grade NAEPPreparedness ResearchPlans and Progress

Cornelia Orr, Executive Director

National Assessment Governing Board


The board s work on preparedness has been underway for nearly a decade

The Board’s Work on Preparedness Has Been Underway for Nearly a Decade

2002

2005

2006

2009

2010-2012

12th Grade Commission Established

Board Resolution on Reporting12th Grade Preparedness

Grade 12 Reading& Mathematics Frameworks Revised

Board Approves Preparedness Research Plan

Conduct Research Studies and Develop Preparedness Report

  • The Governing Board has demonstrated a rigorous, comprehensive, and methodical approach to research and has not presumed the equivalence of college and career preparedness. This research will help inform the definition of preparedness in terms of NAEP.

Cornelia Orr, NAGB


Key considerations for the governing board

Key Considerations for the Governing Board

  • Statements in NAEP reports must be shaped and supported by validity evidence (validity framework)

  • Recognize NAEP has limitations

  • Reporting on NAEP 12th grade preparedness may or may not prove to be feasible

  • Consider additional Grade 12 academic areas in the future

Cornelia Orr, NAGB


Purpose technical panel on 12 th grade preparedness research

Purpose: Technical Panel on 12th Grade Preparedness Research

  • Identify technically appropriate and valid ways to use grade 12 NAEP for reporting preparedness

  • Assist in planning research and validity studies

  • Recommend research designs and priorities for implementation in 2008, 2009, and thereafter

  • Focus on 12th grade reading and mathematics

Cornelia Orr, NAGB


Technical panel on 12 th grade preparedness research members

Technical Panel on 12th Grade Preparedness Research: Members

Cornelia Orr, NAGB


Panel s key conclusions

Panel’s Key Conclusions

  • Reporting on 12th grade preparedness seems feasible

  • Use multipronged approach to collect validity information

  • Avoid representing 12th grade NAEP as the single authoritative definition or conception of preparedness

  • Consider the national context related to preparedness

Cornelia Orr, NAGB


Preparedness working definitions

Preparedness: Working Definitions

  • Preparedness for College:reading and mathematics knowledge and skills to qualify for placement into entry level college credit courses that meet general education requirements, without the need for remedial coursework in math or reading

  • Preparedness for Workplace Training:reading and mathematics knowledge and skills needed to qualify for a job trainingprogram without remediation in math or reading

  • “Preparedness” versus “Readiness”

Cornelia Orr, NAGB


Types of research studies

Types of Research Studies

  • Content alignment

  • Judgmental standard-setting

  • Statistical relationship

  • Survey of Postsecondary Institutions

  • Benchmarking Studies

Cornelia Orr, NAGB


Study interrelationships

Study Interrelationships

Cornelia Orr, NAGB


Data for preparedness research

Data for Preparedness Research

  • 2009 NAEP 12th grade Reading and Mathematics

    • National and state level data

    • 11 states voluntarily participated

  • Linkages to state data systems (only 1 in 2009)

    • Advance planning

    • Confidentiality assurance processes

    • Follow-up for post secondary college/career status

  • Planning for 2013

Cornelia Orr, NAGB


Grade 12 naep results for 11 states

Grade 12 NAEPResults for 11 states

Cornelia Orr, NAGB


Research studies

Research Studies

Cornelia Orr, NAGB


Reference points on the naep scale scenario 1

Reference Points on the NAEP Scale (Scenario 1)

Cornelia Orr, NAGB


Reference points on the naep scale scenario 2

Reference Points on the NAEP Scale (Scenario 2)

Cornelia Orr, NAGB


Reference points on the naep scale scenario 3

Reference Points on the NAEP Scale (Scenario 3)

Cornelia Orr, NAGB


Next steps

Next Steps

  • Develop summary report of validity evidence

    • Validity Framework – external reviews

  • Develop preparedness reports

    • Based on national data analyses

    • Research-focused report

    • Public-focused report

  • Issue Preparedness Report in 2012

Cornelia Orr, NAGB


Questions and discussion

Questions and Discussion

  • What are the results from the preparedness research so far?

    • The content of NAEP is similar to the content assessed on common indicators of college preparedness, that is, the ACT, SAT, and ACCUPLACER.

    • Some content on NAEP is similar to WorkKeys, though the content on NAEP is generally broader than the content on WorkKeys and WorkKeys measures some content that is not in NAEP.

    • The linking of NAEP to SAT: NAEP proficient is about at 500 on the SAT for both reading and mathematics, the college board readiness benchmark.

  • How can states use the NAEP preparedness research?

    • As a resource for state and/or consortia standard setting

    • To provide reference points for state readiness/preparedness definitions

Cornelia Orr, NAGB


Other questions

Other Questions?

Dr. Cornelia S. Orr

Executive Director

National Assessment governing Board

800 North Capitol Street NW, Suite 825

Washington, DC 20002-4233

www.nagb.org

Cornelia Orr, NAGB


  • Login