1 / 37

Learning How Pupils Make Sense of Algebra Word Problems: Tool Development

Robert E. Floden & Algebra Teaching Study (ATS) Team Michigan State University & UC-Berkeley. Learning How Pupils Make Sense of Algebra Word Problems: Tool Development.

smithray
Download Presentation

Learning How Pupils Make Sense of Algebra Word Problems: Tool Development

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Robert E. Floden & Algebra Teaching Study (ATS) Team • Michigan State University & UC-Berkeley Learning How Pupils Make Sense of Algebra Word Problems: Tool Development

  2. This material is based upon work supported by the National Science Foundation under Collaborative Grant Nos. NSF collaborative grant DRL-0909815 & DRL-090985. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation Support from NSF

  3. MSU: Robert Floden, Rachel Ayieko, Sihua (Adrienne) Hu, Jerilynn Lepak Jamie Wernet • Berkeley: Alan H. Schoenfeld, Evie Baldinger, Danielle Champney, Fady El Chidiac, Denny Gillingham, Hee-Jeong Kim, Jerilynn Lepak, Nicole Louie, Sarah Nix, Daniel Reinholz, Alyse Schneider, Mallika Scott, Kim Seashore, Niral Shah, and alumni ATS Team

  4. Take situations described in words • Build mental models • Represent using algebra symbolism • Operate on symbols • Check results Classroom learning to make sense of algebra word problems

  5. Link to CCSSM: • Standards for Mathematical Practice • Domains • Expressions & Equations • Functions • Mathematics researchers & educators • Recommendations for instructional practices • Little empirical work, especially at scale Why important?

  6. Classroom Practices ? Student Learning Research on the Linkage

  7. Complexities of teaching and learning • Conceptualize key dimensions of student learning • Measuring learning along these dimensions • Conceptualizing key dimensions of classroom practice • Recording those dimensions • Keeping mathematics prominent Challenges for research

  8. Robust algebraic understanding • Interpret text; understand context • Identify salient quantities & relationships • Algebraic representations of relationships • Execute calculations and procedures • Explain and justify Conceptualizing focus for student learning

  9. Draw inferences about competence from performance on complex tasks • MARS tasks (built from Balanced Assessment) • MARS scoring is global, with no detail about dimensions for robust understanding • Modest attention to asking for explanations Measuring student learning

  10. Illustrative excerpt

  11. Selection of tasks, largely from MARS • Cognitive interviews to compare yield from written response to yield from interview • Rubrics generate • Overall score • Score for each dimension of robust understanding (robustness criteria or RC) • Multiple 45-minute forms Iterative development of scoring rubric

  12. Validity studies • Agreement with holistic scoring • Agreement of correctness score with MARS • Comparisons with MARS population • Reliability studies • Compare to “expert” • Random assignment to scorers • Almost all inter-rater reliability >.75 • Will be higher for classroom means Reliability and validity

  13. Sample Rubric Hexagons – Part 2

  14. Robustness Criteria As A Framework To Capture Students’ Algebraic Understanding Through Contextual Algebraic Tasks • Sihua Hu, Rachel Ayieko, Jerilynn Lepak, Jamie Wernet Scoring rubricsposter session at PME-NA

  15. Developing a classroom observation scheme

  16. CLASS (UVA) • IQA (Pittsburgh) • Plato (Stanford) • MQI (Michigan) Review existing schemes

  17. IQA comes closest: • Cognitive demand • Accountable talk • One thing missing is attention to classroom dimensions that capture tight plausible link to developing robust understanding of algebra What is missing?

  18. Few publicly available recordings of entire lessons (about to change with Gates MET) • ATS data collection Michigan and California • Evolving agreement on promising dimensions • Teaching for Robust Understanding of Mathematics (TRU MATH). Begin development by watching algebra classes

  19. Mathematical Focus, Coherence & Accuracy • Cognitive Demand • Access • Agency: Authority & Accountability • Uses of assessment Broad dimensions

  20. Robust algebraic understanding • Interpret text; understand context • Identify salient quantities & relationships • Algebraic representations of relationships • Execute calculations and procedures • Explain and justify Specific to robust understanding

  21. 3a and 3b RC 3 Rubrics from scheme

  22. Follow teacher, including during group work • Divide lesson into episodes, with new episode when: • Move to different mode of instruction (e.g., whole class to group work) • Move to new mathematical topic • When five minutes have gone by since beginning of episode • Code five general dimensions for every episode • Code for robust understanding when activity warrants When and what to record

  23. Teaching for Robust Understanding • Hee-jeong Kim, Kimberly Seashore, Daniel Reinholz Scheme poster session at PME-NA

  24. Illustrative preliminary analyses

  25. Data are episodes, length of time in episode, rubric score for episode for each dimension • Student learning related to amount of time spent in activity • Many possible ways to aggregate, e.g., • Average rubric score, weighted by time • Time spent at particular level of rubric Aggregating Dimension Scores

  26. Data are episodes, length of time in episode, whether RC-activity happens during episode, rubric score for RC when it happens • Student learning related to amount of time spent in activity • Many possible ways to aggregate, e.g., • Total time in episodes with RC activity • Time spent at particular level of RC rubric Aggregating RCs Scores

  27. 4 Teachers-3 Lessons

  28. Between-teacher difference

  29. 4 Teachers-3 Lessons

  30. Between-teacher difference

  31. Average gain in score (%) Student Gains in Target Classrooms

  32. Observation scheme • Can capture differences among teachers in general dimensions • Still working on criteria for recording events tied to robust understanding • Student assessment • Reliable scoring • Challenges with student motivation Initial thoughts

  33. Transitioning From Executing Procedures To Robust Understanding Of Algebra • Rachel Ayieko and Jamie Wernet, with Sihua Hu and Daniel Reinholz Paper session at PME-NA

  34. Working version of rubric for scoring student work, with all scoring completed for last year’s data • Close to working version of observation scoring system, with initial scoring for 3 observations in each of 4 classes • Exploring approaches to analysis • Many conference presentations; one publication • Seeking funding to validate on Gates MET videos • Exploring use for capturing classroom processes in Shell Center formative assessment lessons • Projected paper making comparisons to other observation schemes Where we are

  35. ATS Web site: http://ats.berkeley.edu • NSF REESE projects: https://arc.uchicago.edu For more information

More Related