1 / 18

Evaluation

Evaluation. Drawing on the work of Ivan Moore (Higher Education Curriculum Advisor, Engineering Subject Centre and RAEng). Why evaluate?. What do we know about the role of evaluation in teaching and learning? What kinds of evaluation do we currently use?.

mele
Download Presentation

Evaluation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluation Drawing on the work of Ivan Moore (Higher Education Curriculum Advisor, Engineering Subject Centre and RAEng)

  2. Why evaluate? • What do we know about the role of evaluation in teaching and learning? • What kinds of evaluation do we currently use?

  3. Evaluation for accountability (measuring results or efficiency) Evaluation for development (providing information to help to improve practice) Evaluation for knowledge (to obtain a deeper understanding of some particular area of practice such as student learning or change management) Chelimsky (1997) Summative Formative Research The purposes of evaluation

  4. Principles of evaluation • An integral part of our teaching practice • An ongoing process, so that we learn from systematic reflection • Should be participatory • Should enable us to make appropriate modifications along the way • Should enable us to make judgments on specific sessions, but also to draw out wider implications

  5. Useful evaluation resources • http://www.icbl.hw.ac.uk/ltdi/cookbook/contents.html • http://www.materials.ac.uk/guides/evaluating.asp

  6. Evaluation To Date • There have been a number of different evaluations used to date • Discuss in groups of 3 the relative merits for each type of elevation and the value of the information provided • Prepare to feedback to the group

  7. The minute paper – Classroom Assessment Technique (Angelo and Cross 1992) • What was the most useful of meaningful thing you learned during this session? • What question(s) remain uppermost in your mind as we end this session? • What was the ‘muddiest’ point in this session? • OR • What would you like me to stop doing? • What would you like me to start doing? • What would you like me to continue doing?

  8. When should we evaluate? • At the beginning of a course • Uncover students' motivations, expectations, skills and abilities in order to take account of them in course design and teaching practice • During the course • to focus on your student's learning, identify gaps, provide support materials and ‘adjust’ teaching in response to feedback • At the end of the course • to inform any redesign for the next running of the course • All 3 can be used or a combinaition

  9. Purposes of evaluation • Quality Assurance • student satisfaction • the mean score is important as a measure of quality • Quality Enhancement • Student conceptions/how they experience the course • The deviation is important: more focused view Mike Prosser

  10. Is the learning environment/teaching approach having any influence on student conceptions/approaches? • A student experience survey is more important than a student satisfaction survey Mike Prosser

  11. Approaches • Off the peg questionnaires • Learning Styles (Honey and Mumford) • Motivated Strategies for Learning • Learning and Study Strategies Inventory (LASSI) • Approaches to Study Inventory • Course Experience Questionnaire (Ramsden)

  12. The Course experience questionnaire(P. Ramsden) • Designed as a performance indicator • 24 statements relating to 5 aspects • 1 overall satisfaction statement • Research-based • Drawn from statements made by students in interviews • Students with positive responses take a deep approach

  13. The five sub-scales • Good teaching • Clear goals and standards • Appropriate assessment • Appropriate workload • Generic skills

  14. Context-free evaluation • Since the beginning of the year: • What skills, if any, have you developed? • What helped you to develop these skills? • How have you changed the way you study? • What prompted you to make these changes?

  15. Other methods • Focus groups • Structured interviews • Continuous feedback • What did you find most difficult/confusing today? • What things did you find helped you learn last week? • What should I: • Start/stop/continue?

  16. Other instruments • Kolb’s Learning Style Inventory (LSI) • Honey and Mumford’s LSQ • Sternberg’s thinking styles • Felder’s Index of Learning Styles • Weinstein’s Learning and Study Strategies Inventory (LASSI) • Entwistle’s Approaches to Study Inventory

  17. Feedback and Evaluation for the SC • In pairs design an evaluation strategy for this workshop. • What specific areas, if you were a presenter, would you like feedback on? • Who are the key stakeholders? • How will you gather your information and what would the timescale for the evaluation be? • Reflect on how your think this evaluation plan would aid you in planning improvements in the course.

  18. Feedback and Evaluation for the SC • Please complete feedback form • Where next? • What will you take away from this workshop? • What are your plans and ideas? • Notes on the postcard

More Related