2011-2012 NAEP Program International Assessments

1. 2011-2012 NAEP ProgramInternational Assessments District Assessment Coordinator Annual Meeting September 7, 2011 Michele Sonnenfeld

2. Race to the Top - NAEP Florida’s Key Goal #3 • Increase the percentage of students scoring at or above proficient on NAEP by 2015, to or beyond the performance levels of the highest-performing states. • Florida aims to go beyond setting goals for moving students to basic levels on NAEP, focusing on moving more students to proficiency and advanced levels.

3. 2011-2012 NAEP Program

4. NAEP 2011 Results • October 2011 – Reading and Mathematics, grades 4 and 8 • November 2011 – Reading and Mathematics, grades 4 and 8, Miami-Dade and Hillsborough County Public Schools • Spring 2012 – Science, grade 8, State and District-level results

5. Inclusion on NAEP National Assessment Governing Board (NAGB) issued a Policy Statement on NAEP Testing and Reporting on SD and ELL on March 6, 2010 Policy intended to maximize student participation, minimize potential for bias, promote fair comparisons between states, and maintain trends Lori Rodriguez, Bureau Chief, Student Achievement Through Language Acquisition; and Karen Denbroeder, Senior Educational Program Director of the office of Program Accountability, Assessment & Data Systems, Exceptional Education and Student Services, assisted with encouraging including more students to be included in NAEP

6. New Inclusion Guidelines for NAEP • Proportion of all students excluded from NAEP sample should not exceed 5% • 85% of students classified as either ELL or SD must be included in the NAEP

7. ELL and SD Participation in NAEP • Allows SD and ELLs to experience a large-scale assessment administration w/o high-stakes consequences • SD and ELLs are provided with accommodations so they can demonstrate their content knowledge and skills on NAEP • NAEP does not allow the use of a word-to-word dictionary on NAEP Reading

8. Pre-Pilot of Technology and Engineering Literacy (TEL) Tasks Will take approximately 90 minutes to complete 30 students per school Two sessions of 15 students per school Last 2 weeks in March (March 19 – March 30, 2012) Students will take 2-3 scenario-based tasks on a computer provided by NAEP Tasks are designed to be 10, 20, or 30 minutes long Approximately 10 schools in Florida will be selected to participate

9. Technology and Engineering Literacy Framework for the 2014 NAEP The assessment targets are organized into three major areas of technology and engineering literacy, each corresponding to a broad body of knowledge and skills with which students should be familiar http://www.nagb.org/publications/frameworks/prepub_naep_tel_framework_2014.pdf

10. Best Practices Guides • Will be provided to the 24 schools participating in the Grade 12 NAEP and the 21 schools participating in the 17-year-old LTT • Will be mailed mid-November either to the district office or directly to the schools, as designated by the DAC • Purpose is to provide motivational materials to encourage the older students to participate in the assessment in a meaningful way

11. NAEP Assessment Schedule 2013 and 2014 • 2013 – TUDA, State, and National Reading and Mathematics, grades 4 and 8. National and 11 states, including Florida, Reading and Mathematics, grade 12; National grade 4 Writing • 2014 – National Civics, Geography, U.S. History, and Technology and Engineering Literacy

12. Florida State Statute, Revised by 2011 Legislature 1008.22 Student assessment program for public schools.  (2) NATIONAL AND INTERNATIONAL EDUCATION COMPARISONS.—It is Florida's intent to participate in the measurement of national educational goals. The Commissioner of Education shall direct Florida school districts to participate in the administration of the National Assessment of Educational Progress, or a similar national or international assessment program, both for the national sample and for any state-by-state comparison programs which may be initiated.

13. International Assessments ,con’t • Florida will participate in benchmarking studies for Trends in International Mathematics and Science Study (TIMSS), Progress in International Reading Literacy Study (PIRLS), and the Program for International Student Assessment (PISA). • Todd Clark, Director, Race to the Top Assessments, is responsible for managing Florida’s contract with Westat for TIMSS, PIRLS, and PISA. • Michele Sonnenfeld is responsible for the coordination piece of the international assessments, just as she is for NAEP.

14. International Assessments • Enable the U.S. to benchmark its performance to that of other countries • Each is designed to serve a different purpose • Each is based on a separate and unique framework and set of assessment items • Participation in international assessments to measure state progress is required by Florida’s RTTT Application

15. Race to the Top (RTTT) Initiative 2, RTTT Activities Florida will increase resources for teachers to perform effective instruction through high-quality assessments by providing information that allows international comparisons of student achievement in Science, Technology, Engineering, and Mathematics (STEM) and literacy.

16. Race To The Top (RTTT), con’t Areas of need revealed by these measures will allow Florida to adjust priorities for development of resources and strategies prior to the initiation of the internationally-benchmarked common summative assessments of the Common Core State Standards (CCSS).

17. TIMSS 2011 Trends in International Mathematics and Science Study (TIMSS) • Measures student learning in mathematics and science since 1995 • Administered at grades 4 and 8 every 4 years in the spring • U.S. and Florida data will be compared to that of other countries • Results released in late 2012 or early 2013 • See handout for results from 2007 • http://timss.bc.edu/timss2007/PDF/TIMSS2007_InternationalScienceReport.pdf • http://timss.bc.edu/timss2007/mathreport.html

18. PIRLS 2011 Progress in International Reading Literacy Study (PIRLS) • Measures both trends in fourth-grade students’ reading literacy achievement, as well as school and teacher practices related to reading instruction since 2001 • Administered every 5 years in the spring. • U.S. and Florida data will be compared to that of other countries • Results released in late 2012 or early 2013 • See handout for results from 2006 • http://timss.bc.edu/PDF/PIRLS2006_international_report.pdf

19. TIMSS and PIRLS Participation

20. PISA 2012 Program for International Student Assessment (PISA) • Measures how far students approaching the end of compulsory education (15-year-olds) have acquired some of the knowledge and skills essential for full participation in an information society • Administered every 3 years in the fall. • U.S. and Florida data will be compared to that of other countries • Results released in late 2013 or early 2014 • See handout for results from 2009 • http://browse.oecdbookshop.org/oecd/pdfs/free/9810071e.pdf

21. PISA 2012 con’t Will be administered September 24 to November 2, 2012 Focus will be on Mathematics Reading and Scientific Literacy will also be assessed Separate national and state samples Approximately 10 FL schools will be selected for the national sample and 50 FL schools for the state sample

22. PISA 2012 con’t School PISA coordinators will be invited to attend an informational meeting in DC that will include education experts from the U.S. and from other countries Westat staff will administer PISA, the same as with NAEP

23. Websites For additional information about the International Assessments, please access http://www.fldoe.org/asp/naep/iah.asp For additional information about the 2011-2012 Program, including the Long-term Trend Assessment, please access http://www.fldoe.org/asp/naep/naep1112.asp http://www.fldoe.org/asp/naep/naep2011trend.asp

24. Social Networking

25. Social Networking

26. Florida NAEP State Coordinator Michele Sonnenfeld 325 W. Gaines Street, Room 414 Tallahassee, FL 32399 850.245.0787 Michele.Sonnenfeld@fldoe.org http://www.fldoe.org/asp/naep/