National Assessment of Educational Progress (NAEP) Overview and Tools Workshop

1. National Assessment of Educational Progress (NAEP) Overview and Tools Workshop

2. NAEP: The Nation’s Report Card • NAEP is the Nation’s only monitor of what students know and can do in various subject areas • NAEP is a survey designed to produce national and state level results • NAEP produces results for populations, not individuals

3. NAEP Components MAIN LONG -TERM National Public and Nonpublic (Grades 4, 8, and 12) National Public and Nonpublic (9-, 13-, and 17-year olds) State Public (Grades 4 and 8) TUDA (Grades 4 and 8)

4. NAEP Assessments • Main NAEP • Grades 4, 8 and 12 • Began in 1969 • Follow NAGB Frameworks, content change about every 10 years • Every two years for mathematics and reading • State and TUDA in odd years, national in even years • Long Term Trend • Ages 9, 13 and 17 • Began in 1970s • National assessment only • Every four years • Mathematics and Reading only, content mostly unchanged • Last given in 2008 • Special assessments • High School Transcript Study • National Indian Education Survey

5. NAEP Organization U.S. Department of Education Institute of Education Sciences (IES) National Assessment Governing Board (NAGB) National Center for Education Statistics (NCES) Assessment Division NAEP Program Contractors

6. NAEP Contractors 1. Alliance Coordination ETS 8.Quality Assurance HumRRO 2. Design, Analysis & Reporting ETS 7.Dissemination & Outreach Hager Sharp 3. Item Development AIR ETS NCES Assessment Division 6. Web Operations and Maintenance GMRI 4. Material Preparation, Distribution & Scoring Pearson 5.Sampling & Data Collection, Training and Support Westat

7. NAEP Frameworks • Each NAEP assessment is built around an organizing framework, which is the blueprint that guides the development of the assessment instrument and determines the content to be assessed. • The High Schools That Work program develops its assessments from the NAEP frameworks.

8. NAEP Frameworks • Frameworks have been developed for: • Reading - Economics • Mathematics - Civics • Science - Foreign Language • U.S. History - Writing • Geography - Arts

9. Participation • The Elementary and Secondary Education Act (ESEA – formerly NCLB) requires states/districts who receive Title I funding to participate in the biennial NAEP assessment in reading and mathematics at grades 4 and 8. • Georgia law and State Board of Education rules require participation in all NAEP assessments.

10. School Sampling • School samples are randomly selected from groups of schools that have been stratified by variables such as: • Region • Extent of urbanization • Minority enrollment • Median household income • Results of state achievement assessments • Unique to the state/district

11. Student Sampling • Student samples are randomly selected from each school • All students are included • New students also have opportunity to be included • IEP guidelines may be disregarded

12. Contextual Background Variables • In addition to assessing subject area knowledge and abilities, NAEP collects information from students, teachers, and principals about contextual or background variables that are related to student achievement: • student questionnaires, which examine background characteristics and subject area instructional experience; • teacher questionnaires, which gather data on teacher training and classroom instruction; • school questionnaires, which gather information about school characteristics and policies; and • SD/ELL questionnaires, which provide information about students within the sample who have disabilities or are limited-English-proficient.

13. Analysis and Reporting Average scale scores and achievement levels reported for reading, mathematics, and science • Scale Scores • Subgroup comparisons (e.g., SD, ELL) • State and regional comparisons • Reading and Mathematics scale score range is 0-500 • Science scale score range is 0-300 • Achievement Levels • Indicate the students within the total population, or in a particular subgroup, that meet or exceed expectations of what they should know and be able to do • Advanced, Proficient, Basic

14. Results • State and national results only (No student, classroom, school, county, or RESA results) • Trial Urban District Assessment (TUDA) in Atlanta Public Schools will report district level results • State results are usually reported within six months of the assessment cycle.

15. Future Assessments

16. Resources • General information • Assessment results • Item maps • Frameworks • Data analysis tool • Released questions • Scoring detail • State profiles • http://www.nces.ed.gov/nationsreportcard

17. Resources

35. Important Information • NAEP website: http://nces.ed.gov/nationsreportcard • NAEP Data Tool: http://nces.ed.gov/nationsreportcard/naepdata/ • NAEP Questions Tool: http://nces.ed.gov/nationsreportcard/itmrls

36. Workshops • NAEP Questions Tool workshops are available to systems and schools • The workshops provide participants with hands-on training with an interactive-internet based item bank and data analysis tool • For more information or to schedule a workshop, contact Bobbie Bable at the GADOE

37. Contact Information Bobbie Bable NAEP State Coordinator bbable@doe.k12.ga.us 404-657-6168