1 / 68

Highlights from PIRLS and TIMSS 2011

Highlights from PIRLS and TIMSS 2011. Jack Buckley National Center for Education Statistics Washington, DC December 11, 2012. Overview. What are PIRLS and TIMSS and which education systems participate in them? How are U.S. students performing compared to their international peers in:

marcel
Download Presentation

Highlights from PIRLS and TIMSS 2011

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Highlights from PIRLS and TIMSS 2011 Jack Buckley National Center for Education Statistics Washington, DC December 11, 2012

  2. Overview • What are PIRLS and TIMSS and which education systems participate in them? • How are U.S. students performing compared to their international peers in: • 4th-grade reading? • 4th- and 8th-grade mathematics? • 4th- and 8th-grade science? • How are students performing in participating U.S. states?

  3. What are…? PIRLS TIMSS • Trends in International Mathematics and Science Study (TIMSS) • 4th- and 8th-grade mathematics and science assessment • Progress in International Reading Literacy Study (PIRLS) • 4th-grade reading assessment • Developed by the TIMSS & PIRLS International Study Center at Boston College, under contract to the International Association for the Evaluation of Educational Achievement (IEA) • 2001 2006 2011 1995 1999* 2003 2007 2011 * In 1999, no grade 4 assessment.

  4. PIRLS participating education systems (in 4th grade) 32 education systems 26 education systems 53 education systems 2011

  5. TIMSS participating education systems (in either/both grades) 37 education systems 74 education systems 57 education systems 44 education systems 47 education systems 2011

  6. Participating states • 9 states participated as separate entities to obtain scores in PIRLS or TIMSS or both • Each participated as part of the nation and on its own • NCES funded participation at grade 8 of all states except Florida as part of a study to statistically link NAEP (National Assessment of Educational Progress) and TIMSS (Florida received other Education Department funding)

  7. U.S. national sample size PIRLS TIMSS 4th grade Schools: 370 Students: 12,726 4th grade Schools: 369 Students: 12,569 8th grade Schools: 501 Students: 10,477

  8. U.S. state sample sizes(public schools only) PIRLS TIMSS 4th grade (FL) Schools: 77 Students: 2,598 4th grade (FL, NC) Schools: 46 – 77 Students: 1,792 – 2,661 8th grade (AL, CA, CO, CT, FL, IN, MA, MN, NC) Schools: 53 – 82 Students: 1,712 – 2,614

  9. READING

  10. PIRLS 2011 framework

  11. What is on the PIRLS assessment? Percentage of 4th-graders answering correctly: U.S.: 90% Int’l Avg.: 89%

  12. What is on the PIRLS assessment? Percentage of 4th-graders answering correctly: U.S.: 42% Int’l Avg.: 29%

  13. U.S. average score (556) higher than the PIRLS scale average (500) Higher than U.S. Not measurably different than U.S. Lower than U.S.

  14. U.S. average score (556) lower than in 5 education systems Higher than U.S. Not measurably different than U.S. Lower than U.S.

  15. U.S. average (556) not measurably different than in 7 education systems Higher than U.S. Not measurably different than U.S. Lower than U.S.

  16. U.S. average score (556) higher than in 40 education systems Higher than U.S. Not measurably different than U.S. Lower than U.S.

  17. Average reading scores of 4th-grade students increasedfrom 2006 to 2011 in 13 education systems, including the U.S. Change in average score *p < .05. Change in average scores is significant. NOTE: Education systems ordered according to average reading score in 2011.

  18. Average reading scores of 4th-grade students decreased from 2006 to 2011 in 8 education systems *p < .05. Change in average scores is significant. NOTE: Education systems ordered according to average reading score in 2011.

  19. PIRLS international reading benchmarks

  20. Percentages of U.S. 4th-grade students reaching PIRLS reading benchmarks were higher than international medians in 2011 NOTE: All U.S. percentages are significantly higher than the corresponding PIRLS international median at the .05 level of statistical significance.

  21. Two systems had higher percentages of 4th-grade students reaching Advanced than the U.S. Higher than U.S. (p < .05) Not measurably different than U.S. (p < .05) NOTE: Education systems with lower percentages of students reaching the Advanced benchmark than the percentage of U.S. students reaching the Advanced benchmark are not included in figure.

  22. MATHEMATICS

  23. TIMSS 2011 mathematics framework

  24. What is on the TIMSS mathematics assessment? GRADE 4 Percentage of 4th-graders answering correctly: U.S.: 80% Int’l Avg.: 54%

  25. What is on the TIMSS mathematics assessment? GRADE 4 Percentage of 4th-graders answering correctly: U.S.: 76% Int’l Avg.: 65%

  26. What is on the TIMSS mathematics assessment? GRADE 8 GRADE 8 Percentage of 8th-graders answering correctly: U.S.: 87% Int’l Avg.: 70%

  27. What is on the TIMSS mathematics assessment? GRADE 8 Percentage of 8th-graders answering correctly: U.S.: 66% Int’l Avg.: 45%

  28. U.S. average score (541) higher than the TIMSS scale average (500) Higher than U.S. Not measurably different than U.S. Lower than U.S.

  29. U.S. average score (541) lower than in 8 education systems Higher than U.S. Not measurably different than U.S. Lower than U.S.

  30. U.S. average (541) not measurably different than in 6 education systems Higher than U.S. Not measurably different than U.S. Lower than U.S.

  31. U.S. average score (541) higher than in 42 education systems Higher than U.S. Not measurably different than U.S. Lower than U.S.

  32. U.S. average score (509) higher than the TIMSS scale average (500) Higher than U.S. Not measurably different than U.S. Lower than U.S.

  33. U.S. average score (509) lower than in 11 education systems Higher than U.S. Not measurably different than U.S. Lower than U.S.

  34. U.S. average (509) not measurably different than in 12 education systems Higher than U.S. Not measurably different than U.S. Lower than U.S.

  35. U.S. average score (509) higher than in 32 education systems Higher than U.S. Not measurably different than U.S. Lower than U.S.

  36. Average mathematics scores of 4th-grade students increased from 2007 to 2011 in 12 education systems, including the U.S. *p < .05. Change in average scores is significant. NOTE: Education systems ordered according to average mathematics score in 2011.

  37. Average mathematics scores of 8th-grade students increased from 2007 to 2011 in 10 education systems *p < .05. Change in average scores is significant. NOTE: Education systems ordered according to average mathematics score in 2011.

  38. Average mathematics scores of 8th-grade students decreased from 2007 to 2011 in 6 education systems *p < .05. Change in average scores is significant. NOTE: Education systems ordered according to average mathematics score in 2011.

  39. TIMSS international mathematics benchmarks

  40. Percentages of U.S. 4th-graders reaching TIMSS mathematics benchmarks were higher than international medians in 2011 NOTE: All U.S. percentages are significantly higher than the corresponding TIMSS international median at the .05 level of statistical significance.

  41. Seven systems had higher percentages of 4th-grade students reaching Advanced than the U.S. Higher than U.S. (p < .05) Not measurably different than U.S. (p < .05) NOTE: Education systems with lower percentages of students reaching the Advanced benchmark than the percentage of U.S. students reaching the Advanced benchmark are not included in figure.

  42. Percentages of U.S. 8th-graders reaching TIMSS mathematics benchmarks were higher than international medians in 2011 NOTE: All U.S. percentages are significantly higher than the corresponding TIMSS international median at the .05 level of statistical significance.

  43. Eleven systems had higher percentages of 8th-graders reaching Advanced than the U.S. Higher than U.S. (p < .05) Not measurably different than U.S. (p < .05) NOTE: Education systems with lower percentages of students reaching the Advanced benchmark than the percentage of U.S. students reaching the Advanced benchmark are not included in figure.

  44. SCIENCE

  45. TIMSS 2011 science framework

  46. What is on the TIMSS science assessment? GRADE 4 Percentage of 4th-graders answering correctly: U.S.: 96% Int’l Avg.: 83%

  47. What is on the TIMSS science assessment? GRADE 4 Percentage of 4th-graders answering correctly: U.S.: 90% Int’l Avg.: 73%

  48. What is on the TIMSS science assessment? GRADE 8 Percentage of 8th-graders answering correctly: U.S.: 28% Int’l Avg.: 27%

  49. What is on the TIMSS science assessment? GRADE 8 Percentage of 8th-graders answering correctly: U.S.: 76% Int’l Avg.: 61%

  50. U.S. average score (544) higher than the TIMSS scale average (500) Higher than U.S. Not measurably different than U.S. Lower than U.S.

More Related