1 / 21

The UQ Course Insights Journey: Linking Learning Analytics, Learning Design and Feedback

The UQ Course Insights Journey: Linking Learning Analytics, Learning Design and Feedback. Dr Aneesha Bakharia Acting Manager Learning Analytics and Learning Technologies Institute of Teaching and Learning Innovation ( ITaLI ) The University of Queensland Twitter: @ aneesha.

raquelr
Download Presentation

The UQ Course Insights Journey: Linking Learning Analytics, Learning Design and Feedback

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The UQ Course Insights Journey:Linking Learning Analytics, Learning Design and Feedback Dr Aneesha Bakharia Acting Manager Learning Analytics and Learning Technologies Institute of Teaching and Learning Innovation (ITaLI) The University of Queensland Twitter: @aneesha

  2. Course Insights Dashboard Vision • Filterable and comparative user interface for teaching staff to gain actionable insight from student data • Project began in September 2018 Pic from http://kathyhadleylifecoach.com/the-beginning-of-a-journey-day-1-of-30-days-of-renewal/ Teacher Dashboard Demonstration and Feedback Session

  3. Multidisciplinary Team from ITaLI and ITS Learning Tool Developers (Course Design and Development) Learning Designers (Course Design and Development) Data Analyst & Applied Learning Analyst (Learning Analytics) Deputy Director Digital Learning Senior Lecturer in Learning Analytics (Higher Education Group) Support and Training (eLearning Support) Close collaboration with ITS Data as a Service Team Teacher Dashboard Demonstration and Feedback Session

  4. Teacher Dashboard Demonstration and Feedback Session

  5. Teacher Dashboard Demonstration and Feedback Session

  6. Course Insights Dashboard Design Principles • Filterable and comparative user interface for teaching staff to gain actionable insight from student data • Involve instructors in the co-design of dashboard • Provide filterable and comparative student sub-cohort visualisations • Provide analytics across the course life-cycle • Facilitate the provision of personalised feedback Actionable Insight Learning Design Learning Analytics Feedback Teacher Dashboard Demonstration and Feedback Session

  7. Involve Instructors in the Co-Design of the Dashboard • Began as Mockup in Powerpoint • Created a working Prototype with Dummy Data • Validated in Workshops • Additional requirements • Changed Workshop focus – Interventions What can be done with the data?Thinking about Interventions drove selection of new datasources • Semester 1 Trial with Blended Courses (UQ2U Program) • Semester 2 Trial with Blended Courses (UQ2U Program) and Volunteer Courses • New features based on feedback from Instructors • Dr Hassan Khosravi facilitating a workshop on interventions Teacher Dashboard Demonstration and Feedback Session

  8. Provide filterable and comparative sub-cohort visualisations  Conceptual Framework Linking Learning Analytics and Learning Design Bakharia, A., Corrin, L., De Barba, P., Kennedy, G., Gašević, D., Mulder, R., ... & Lockyer, L. (2016, April). A conceptual framework linking learning design with learning analytics. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (pp. 329-338). ACM. Teacher Dashboard Demonstration and Feedback Session

  9. Provide filterable and comparative sub-cohort visualisations  • When a filter is applied all visualisations become comparative. Teacher Dashboard Demonstration and Feedback Session

  10. Linking Learning Analytics to Learning Design Slide adapted from Sue Bennett's ALASI 2018 Keynote • Who are my students? • What programs/careers are they enrolled in? • Information about previous delivery of this course • What is the course design? Before Semester • How are my students going? • What are they doing? • What are they understanding? • Are they having problems in specific areas? During Semester • What did my students do? • What did they learn? • How does the content align to the program objectives? • Are there any trouble spots in the course design or technology used? • What improvements can be made?  • What did the students think? After Semester Teach Course Again • Re-design aspects of course • Adapt to a different Course • Expand repertoire Teacher Dashboard Demonstration and Feedback Session

  11. Provide analytics across the course life-cycle  • Include data from a variety of systems with appropriate visualisation for each system • Blackboard  • Blackboard GradeCentre • Edx Edge (Blended Courses) • Student Information System • Eventually Echo360 Lecture Capture and ALP, Kultura, UQ Active Learning Tools Teacher Dashboard Demonstration and Feedback Session

  12. Teacher Dashboard Demonstration and Feedback Session

  13. Teacher Dashboard Demonstration and Feedback Session

  14. Facilitate the Provision of Personalised Feedback • Whole-class scaffolding • Instructor devoting face-to-face time to provide additional explanation of a concept, Teachback) (Xhakaj et al., 2017) • Aggregated cohort analytics and visualisation  • Enrolment, Engagement and Assessment • Provide personalised feedback • Eg OnTask (Pardo, et  al., 2018; Pardo, et al., 2019) • Individual student view of Enrolment, Engagement and Assessment • Intermediate Query Builder to identify students matching criteria Teacher Dashboard Demonstration and Feedback Session

  15. Facilitate the Provision of Personalised Feedback Teacher Dashboard Demonstration and Feedback Session

  16. Facilitate the Provision of Personalised Feedback Teacher Dashboard Demonstration and Feedback Session

  17. Facilitate the Provision of Personalised Feedback What other columns/features are needed? Teacher Dashboard Demonstration and Feedback Session

  18. Teacher Dashboard Demonstration and Feedback Session

  19. Challenges/Opportunities -> Future Directions • Analysis is very exploratory • Working on Filter Recommendations • How to avoid instructor bias? • Access for Different Course Roles  • Lead Tutor • Learning Designer • Increased appetite for advanced/more in-depth visualisations and data sources • Incorporate new LA research finding • Diversify LA products and data science service • Not only an Instructor dashboard • Student Facing • Many more opportunities for LA embedded in Learning Tools (egnStudy, AWA, Ripple) • Secure funding but be scholarly and pivot regularly Teacher Dashboard Demonstration and Feedback Session

  20. Questions? https://medium.com/nightingale/100-days-of-dataviz-comics-9a24789f3f69

  21. Thank you

More Related