Geoffrey Crisp ALTC National Teaching Fellow

1. Assessment 2.0 – assessment in an interactive, participatory and distributed environment Geoffrey Crisp ALTC National Teaching Fellow Director, Centre for Learning and Professional Development University of Adelaide

2. Examples and presentations available at http://www.transformingassessment.com Mathew Hillier Shamim Joarder 19/11/2014 2

3. Outline of presentation QUT context introduction to learning and assessment traditional e-assessments examples of interactive e-assessments assessment in virtual environments assessment tasks for the future 19/11/2014 3

4. 2010 FaST Curriculum Review 2.4 Aspirations in Teaching and Learning Design • Recommendation 25 Design, develop and implement an award architecture which is backward mapped, employs ‘inverted curricula’ and includes exposure to the breadth of Faculty offerings in the sciences, mathematics, information and the application of technologies • Recommendation 26 Embed principles of good curricular design, assessment, first year experience, graduate outcomes, participation, capstone, work integrated learning and research pathway construction and leverage the support, resources and communities of practice available within the University

5. QUT Assessment Policy • Assessment is valued as a strategy to support student learning • Assessment cohesively links the learning outcomes, content, and learning and teaching approaches at the unit and course levels • Assessment is an integral part of the whole of course design and gives particular attention to the needs of first year students • Assessment provides valid evidence of learning outcomes at the unit level and may contribute to assessment of student learning at the course level including graduate capabilities • Assessment approaches are consistent with QUT’s approach to real world learning and teaching and include a variety of assessment tasks • Assessment reflects rigorous academic standards associated with the discipline and is based on pre-determined and clearly articulated criteria, associated standards and weightings • Assessment is fair, equitable and inclusive and clearly communicated to students • Assessment approaches ensure that reliable and consistent judgments are made about a student's performance and that academic integrity is promoted

6. Outline of presentation QUT context introduction to learning and assessment traditional e-assessments examples of interactive e-assessments assessment in virtual environments assessment tasks for the future 19/11/2014 6

7. Typical learning and assessment today? http://www.flickr.com/photos/cristic/359572656/ http://www.pharmtox.utoronto.ca/Assets/Photos/pcl473+classroom+editted.JPG 7

8. New learning environments for students and teachers 19/11/2014 8

9. Authentic learning and assessment – inverted curriculum approach http://www.nasaimages.org/luna/servlet/detail/nasaNAS~9~9~58363~162207: 9

10. Do you want the red pill or the blue pill? http://www.urvoting.com 19/11/2014 10

11. Assessment tasks should be worth doing if students can answer questions by copying from the web, you are asking the wrong questions if students can answer questions by using Google, you are asking the wrong questions if students can answer questions by guessing, you are asking the wrong questions Why the hell am I doing this course? 19/11/2014 11

12. Different assessment typesAssessment is valued as a strategy to support student learningAssessment cohesively links the learning outcomes, content, and learning and teaching approaches at the unit and course levels

13. Outline of presentation QUT context introduction to learning and assessment traditional e-assessments examples of interactive e-assessments assessment in virtual environments assessment tasks for the future 19/11/2014 13

14. Question types - LMS 19/11/2014 14

15. Bobby Elliot and assessment 1.5 to 2.0

16. Assessment 1.0 v Assessment 2.0 Assessment 1.0 Assessment 2.0 http://www.scribd.com/doc/461041/Assessment-20 Given Done alone Descriptive Text Closed book Done in class Teacher assessed Negotiated Done collaboratively Researched/Deep Text/audio/video Open web Done anywhere Self- and peer-assessed

17. Outline of presentation QUT context introduction to learning and assessment traditional e-assessments examples of interactive e-assessments assessment in virtual environments assessment tasks for the future 19/11/2014 17

18. Interactive e-assessment designAssessment approaches are consistent with QUT’s approach to real world learning and teaching and include a variety of assessment tasks Separate the interactive tool/object/artefact from the question and the feedback

19. Guessing answers

20. QuickTime VR 19/11/2014

21. Interactive spreadsheets

22. Interactivity - Chemistry Java applet 22

23. 19/11/2014 23

24. Process of problem solving - IMMEX http://www.immex.ucla.edu

25. Process of problem solving - IMMEX http://www.immex.ucla.edu

26. IMMEX output – capability maps Kong, S.C., Ogata, H., Arnseth, H.C., Chan, C.K.K., Hirashima, T., Klett, F., Lee, J.H.M., Liu, C.C., Looi, C.K., Milrad, M., Mitrovic,A., Nakabayashi, K., Wong, S.L., Yang, S.J.H. (eds.) (2009). Proceedings of the 17th International Conference on Computers in Education

27. Outline of presentation QUT context introduction to learning and assessment traditional e-assessments examples of interactive e-assessments assessment in virtual environments assessment tasks for the future 19/11/2014 27

28. Characteristics of Web 2.0 • user-generated content • encouragement and facilitation of participation • access and openness • (almost) unlimited data sources • power of the crowd

29. Self and Peer Assessment Tools

30. What Happens in a Role Play? Reflection & Learning Adopt a role Issues & problems occur Interaction & debate

31. Scenario-based learning http://www.pblinteractive.org 31

32. Second Life – Virtual worlds 32

33. Second Life examples http://www.youtube.com/watch?v=Ncj7xokweOc

34. Second Life examples http://www.youtube.com/watch?v=ZgkUtSSEpBc

35. Second Life examples http://www.youtube.com/watch?v=eQruIhMVgYI

36. Serious Games Institute http://www.seriousgamesinstitute.co.uk/ 36

37. 37

38. Simulations and games

39. Augmented reality 39

40. Outline of presentation QUT context introduction to learning and assessment traditional e-assessments examples of interactive e-assessments assessment in virtual environments assessment tasks for the future 19/11/2014 40

41. Future assessments? • Will we see universal development of immersive and authentic learning and assessment environments? • Will assessments measure approaches to problem solving and student responses in terms of efficiency, ethical considerations and the involvement of others? • Will teachers be able to construct future assessments or will this be a specialty activity? 41

42. The e-Assessment Handbook and HERDSA Guide 42

43. References • Nicol, D. J. 2009. Assessment for learner self-regulation: enhancing achievement in the first year using learning technologies. Assessment & Evaluation in Higher Education, 34, no. 3: 335–352 • Knight, P. 2007. Fostering and assessing ‘wicked’ competences. http://www.open.ac.uk/cetl-workspace/cetlcontent/documents/460d1d1481d0f.pdf • Joughin, G. 2009. Assessment, Learning and Judgement. In G. Joughin (Ed) Assessment, Learning and Judgement in Higher Education. Springer p215-221 • Yorke, M. 2005. Increasing the chances of student success. In Improving student learning 12: Diversity and inclusivity, ed. C. Rust, 35–52. Oxford: Oxford Centre for Staff and Learning Development