1 / 48

International comparisons of science and mathematics education : PISA and TIMSS

International comparisons of science and mathematics education : PISA and TIMSS. Harrie Eijkelhof Freudenthal Institute for Science and Mathematics Education. Outline of this session. Why comparing countries ? PISA Age 15 Mathematics and Science TIMSS Grades 4 & 8

bdoss
Download Presentation

International comparisons of science and mathematics education : PISA and TIMSS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. International comparisons of science andmathematicseducation: PISA and TIMSS Harrie Eijkelhof Freudenthal Institutefor Science andMathematicsEducation

  2. Outline of thissession • Whycomparingcountries? • PISA • Age 15 • Mathematics and Science • TIMSS • Grades 4 & 8 • Mathematics and Science • Implications of comparing countries • Learning from other countries Summerschool

  3. Why comparing countries in science and mathematics education? • Economic importance of science and mathematics education • Internationalisation: mobility of students • Tool for educational policy: monitoring, reform • Learning from other systems: relative strengths and weaknesses Summerschool

  4. Programme for International Student Assessment (PISA) • Created in 1997 by OECD • Aim: to monitor outcomes of educational systems in terms of student achievement • Age: 15 years • Surveysevery 3 yearssince 2000 in reading, mathematicalandscientificliteracy • 2000 reading, math, science [43] • 2003 reading, math, science [41] • 2006 reading, math, science[57] • 2009 reading, math, science [65] • 2012 reading, math, science [65] • 2015 reading, math, science[?? ] http://www.youtube.com/watch?v=q1I9tuScLUA Summerschool

  5. Focus of PISA • Collaborative effort: OECD + non-member partner economies • To measure how well students at age 15 are prepared to meet challenges in future life • Beyond school-based approach: use of knowledge in everyday tasks and challenges • Based on model of lifelong learning • Not only assessing knowledge: also how to apply knowledge in real-life issues Summerschool

  6. PISA-definition of Mathematical literacy An individual’scapacity: • toidentifyandunderstand the rolethatmathematicsplays in the world • to make well-foundedjudgements • touseandengagewithmathematics in waysthat meet the needs of thatindividual’s life as a constructive, concernedandreflectivecitizen. Summerschool

  7. PISA-definition of Scientificliteracy • The abilitytoengagewith science-related issues, andwith the ideas of science as a reflectivecitizen • Thisrequires the competenciesto: • Explainphenomenascientifically • Evaluateand design scientificenquiry • Interpret data andevidencescientifically Summerschool

  8. PISA 2012 Mathematics Framework Summerschool

  9. PISA 2015 Science Framework Summerschool

  10. Contexts for the PISA 2015 science assessment Summerschool

  11. Scientific knowledge Of science: • Physical systems • Living systems • Earth andspace systems About science: • Procedural knowledge: variables, measurement, replicability, representing data, control of variables • Epistemic knowledge: purposes, nature, values, justification, errors, collaboration and critique Summerschool

  12. Attitudes in science (PISA 2015) • Interest in science: e.g. curiosity, willingness to acquire knowledge, career aspirations • Valuing scientific approaches to enquiry: e.g. commitment to evidence, criticism • Environmental awareness: e.g. concern, disposition to sustainable behaviour Summerschool

  13. Sample PISA-items (released) • Study sample questions • 3 mathematics • 3 science • Look at • the question type • level of difficulty • Giveyour opinion on the natureand level of the questions: feasible in your country? Summerschool

  14. PISA-questions MATHEMATICS EXAMPLES Question 1: SAVINGS ACCOUNT 1 000 zed is put into a savings account at a bank. There are two choices: one can get an annual rate of 4% OR one can get an immediate 10 zed bonus from the bank, and a 3% annual rate. • Which option is better after one year? • After two years? Summerschool

  15. Question 2: SCIENCE TESTS In Mei Lin’s school, her science teacher gives tests that are marked out of 100. Mei Lin has an average of 60 marks on her first four Science tests. On the fifth test she got 80 marks. What is the average of Mei Lin’s marks in Science after all five tests? Average: ............................................... Summerschool

  16. Question 3: BOOKSHELVES To complete one set of bookshelves a carpenter needs the following components: 4 long wooden panels, 6 short wooden panels, 12 small clips, 2 large clips and 14 screws. The carpenter has in stock 26 long wooden panels, 33 short wooden panels, 200 small clips, 20 large clips and 510 screws. How many sets of bookshelves can the carpenter make? Answer: ................................................. Summerschool

  17. PISA-questions: Science example (1) TOBACCO SMOKING Tobacco is smoked in cigarettes, cigars and pipes. Research shows that tobacco related diseases kill nearly 13 500 people worldwide every day. It is predicted that, by 2020, tobacco-related diseases will cause 12% of all deaths globally. Tobacco smoke contains many harmful substances. The most damaging substances are tar, nicotine and carbon monoxide. Question 1: TOBACCO SMOKING Tobacco smoke is inhaled into the lungs. Tar from the smoke is deposited in the lungs and this prevents the lungs from working properly. Which one of the following is a function of the lungs? A To pump oxygenated blood to all parts of your body B To transfer some of the oxygen that you breathe to your blood C To purify your blood by reducing the carbon dioxide content to zero D To convert carbon dioxide molecules into oxygen molecules Summerschool

  18. PISA-questions: Science example (2) Question 2: TOBACCO SMOKING Tobacco smoking increases the risk of getting lung cancer and some other diseases. Is the risk of getting the following diseases increased by tobacco smoking? Circle “Yes” or “No” in each case. Is the risk of contracting this disease increased by smoking? Bronchitis Yes / No HIV/AIDS Yes / No Chicken pox Yes / No Summerschool

  19. PISA-questions: Science example (3) Question 3: TOBACCO SMOKING Some people use nicotine patches to help them to give up smoking. The patches are put on skin and release nicotine into the blood. This helps to relieve cravings and withdrawal symptoms when people have stopped smoking. To study the effectiveness of nicotine patches, a group of 100 smokers who want to give up smoking is chosen randomly. The group is to be studied for six months. The effectiveness of the nicotine patches is to be measured by finding out how many people in the group have not resumed smoking by the end of the study. Which one of the following is the best experimental design? A All the people in the group wear the patches. B All wear patches except one person who tries to give up smoking without them. C People choose whether or not they will use patches to help give up smoking. D Half are randomly chosen to use patches and the other half do not use them. Summerschool

  20. Pisa tests in schools • Selection of schools • Schoolcoordinator appointed • Random selection of 35 15year olds per school • Permission from parents • Tests session organized by test administrator • 13 different booklets with sets of questions • 2 hours for knowledge testing of students • 30 minutes for student questionnaire: personal background, learning habits, attitudes, motivation • School questionnaire (headmaster): demographic characteristics, quality of the learning environment Summerschool

  21. Proficiency levels mathematics PISA 2012(500 = OECD average) OECD % Level 6 > 669 3.3 Level 5 607 - 669 9.3 Level 4 545 – 607 18.2 Level 3 482 – 545 23.7 Level 2 420 – 482 22.5 Level 1 358 – 420 15.0 Below 1 < 358 8.0 Summerschool

  22. PISA 2012 – cognitive performance Summerschool

  23. Motivationtolearnmathematics(PISA 2012) Summerschool

  24. How toexplain PISA-results? • Whichresults are striking toyou? • Give at least five reasonswhichmightexplaindifferencesbetweencountries in results: Summerschool

  25. How toexplain PISA-results? • Cultural factors • Value of knowledge in society • Value of arguing • Science in the media (TV, journals, newspapers) • Educational factors • Organization of education • Nature of the school curricula • Quality of teaching • Quality of assessment • Investments in education • PISA-factors • Attitude towards PISA-test by 15-year oldsand society • Nature of the PISA-questions Summerschool

  26. Objectionsraisedagainst PISA • Escalation of standardizedtesting • Leads to short-term policies • Narrowingtomeasurableeducationalobjectives • Bias toeconomicrole of schooling • Alliance withfor-profit companies • Decreasesautonomy of teachers Summerschool

  27. PISA-sources • http://www.pisa.oecd.org/ • http://www.oecd.org/pisa/pisaproducts/ Summerschool

  28. Trends in International Mathematics and Science Study (TIMSS) • Started in 1995 by IEA (International Associationfor the Evaluation of EducationalAchievement) • Aim: tomeasuremathandscienceknowledgeand skills alignedwith curricula in participatingcountries • Age: grades 4, 8, 12 • Surveysevery 4 years in manycountries: Grade 4 Grade 8 Grade 12 • 1995 26 41 5 • 1999 -- 38 -- • 2003 25 46 -- • 2007 36 48 10 (2008) • 2011 50 42 -- http://timss.bc.edu/timss2011/index.html Summerschool

  29. TIMSS Frameworks and tests • Mathematics • Grade 4 • Content domains: number, geometricshapesandmeasures, data display • Grade 8 • Content domains: number, algebra, geometry, data and chance • Science • Grade 4 • Content domains: life science, physicalscience, earthscience • Grade 8 • Content domains: biology, chemistry, physics, earthscience • Mathematics + Science • Cognitive domains: knowing, applying, reasoning Summerschool

  30. Content and Cognitive Domains Grade 4 Science Mathematics Content Domains 50% Number 35% Geometric Shapes and Measures 15% Data Display Cognitive Domains 40% Knowing 40% Applying 20% Reasoning • Content Domains 45% Life Science 35% Physical Science 20% Earth Science • Cognitive Domains 40% Knowing 40% Applying 20% Reasoning Summerschool

  31. Sample of released math items TIMSS grade 4 1. In a car park, 762 cars were parked in 6 equal rows. How many cars were in each row? 2. Subtract 5.3 – 3.8 3. The temperature at 7 a.m. one morning was 12º. It increased by 2ºC every hour until it reached 20ºC at 11 a.m. What was the temperature at 9 a.m.? a. 14ºC b. 15ºC c. 16ºC d. 17ºC 4. Last year there were 92 boys and 83 girls in Fairmont School. This year there are 210 students, and 97 boys. How many more girls are there this year than last year? Show your work. Summerschool

  32. Sample of released math items TIMSS grade 8 Summerschool

  33. Sample of released science items TIMSS grade 4 • What do birds, bats and butterflies have in common? a. feathers b. hair c. internalskeleton d. wings • Write down one form of energy Earth receives from the sun • Which of these soil changes is due only to natural causes: a. loss of minerals due to farming b. deserts forming due to tree cutting c. flooding due to dam construction d. minerals washing out due to heavy rain Summerschool

  34. Released science item TIMSS grade 4 Summerschool

  35. Sample of released science items TIMSS grade 8 Summerschool

  36. Released science item TIMSS Grade 8 Summerschool

  37. TIMSS Results2011Grades 4 & 8 Math & Science Grade 4 (N=50)Math Science Singapore 606 (1) 583 (2) Korea 605 (2) 587 (1) Hong Kong 602 ( 3) 535 (9) Chinese Taipei 591 (4) 552 (6) Japan 585 (5) 559 (4) Belgium (Flemish) 549 (7) 509 (27) Finland 545 (8) 570 (3) England 542 (9)529 (15) Russian Feder. 542 (10) 552 (5) USA 541 (11) 544 (7) Netherlands 540 (12)531 (14) Germany 528 (16) 528 (17) Norway 495 (29) 494 (33) Tunisia 359 (47) 346 (48) Morocco 335 (49) 264 (49) Yemen 248 (50) 209 (50) No significant difference with NL Grade 8 (N=42) Math Science Korea613 (1) 587(3) Singapore 611 (2) 590 (1) Chinese Taipei 609 (3) 564 (2) Japan570 (5) 558 (4) Russian Feder. 539 (6) 542 (7) Finland 514 (8) 552 (5) USA 509 (9) 525 (10) England 507 (10) 533 (9) Norway 475 (20) 494 (19) Tunisia 425 (32) 439 (29) Qatar 410 (33) 419 (37) Indonesia 386 (38) 406 (40) Morocco 371 (40) 376 (41) Ghana 331 (42) 306 (42) Botswana (G9) 397 404 South Africa (G9) 352 332 Summerschool

  38. Trends Between 1995 and 2011 TIMSS Grade 4 Mathematics CountriesImproving CountriesDeclining Austria CzechRepublic Netherlands • Australia • England • Hong Kong SAR • Iran • Japan • Korea • New Zealand • Norway • Portugal • Singapore • Slovenia • United States Summerschool

  39. Trends Between 1995 and 2011 TIMSS Grade 4 Science CountriesImproving CountriesDeclining Norway • Hong Kong SAR • Hungary • Iran • Japan • Korea • Portugal • Singapore • Slovenia Summerschool

  40. Progress in USA at local levels Minnesota: http://www.youtube.com/watch?v=r4Xbej4Ncow Michigan: http://www.youtube.com/watch?v=AtGlPOp-96M&playnext=1&list=PLF81F896453A0BC40&feature=results_video Summerschool

  41. Policy Implications of TIMSS & PISA • Assessment of problems/successes • Lookingabroadforsolutions • Focus on assessment • Developing new curricula • Policy shifts, e.g.: • focus on excellence • investing in backward regions or populations • Acting on comparisons at system level Summerschool

  42. The Learning CurveLessons in country performance in educationPearson,2012 http://thelearningcurve.pearson.com/videos http://thelearningcurve.pearson.com • 40 countries compared • Index cognitive skills & educational attainment • Top-countries Finland and South Korea • NL in subtop (7) • www.thelearningcurve.pearson.com Summerschool

  43. School responsibility & autonomy compared Summerschool

  44. Country profiles Summerschool

  45. Global index of cognitive skills and educational attainment Summerschool

  46. Comparing educational systems South Korea Finland late start in schooling less lessons no homework only some frontal teaching focus on applying knowledge small classes rel. low salaries teachers importance of teacher training education seen as act of social justice • exam driven • rigid curriculum • reproduction oriented • frontal teaching • private crammer schools (hagwans) • large classes • rel. high salaries teachers • importance of teacher training • learning seen as moral duty to family and society Summerschool

  47. Strong Performers and Successful Reformers in Education A video series profiling policies and practices of education systems that demonstrate high or improving performance in the PISA tests. Belgium (Flanders), Brazil, Canada (Ontario), Finland, Germany, Japan, Korea, Netherlands, Poland, Portugal, Shanghai, Singapore http://www.pearsonfoundation.org/oecd/ Summerschool

  48. Strong Performers and Successful Reformers in Education: Lessons from PISA for the United States • Chapter 1 Introduction • Chapter 2 Viewing Education in the United States Through the Prism of PISA • Chapter 3 Ontario, Canada: Reform to Support High Achievement in a Diverse Context • Chapter 4 Shanghai and Hong Kong: Two Distinct Examples of Education Reform in China • Chapter 5 Finland: Slow and Steady Reform for Consistently High Results • Chapter 6 Japan: A story of Sustained Excellence • Chapter 7 Singapore: Rapid Improvement Followed by Strong Performance • Chapter 8 Brazil: Encouraging Lessons from a Large Federal System • Chapter 9 Germany: Once Weak International Standing Prompts Strong Nationwide Reforms for Rapid Improvement • Chapter 10 Vignettes on education reforms: England and Poland • Chapter 11 Lessons for the United States http://www.oecd.org/pisa/46623978.pdf Summerschool

More Related