Assessment and Evaluation for Online Courses

1. Assessment and Evaluation for Online Courses Associate Professor Dr. Annabel Bhamani Kajornboon (kannabel@chula.ac.th) CULI’s 6th Intl Conference: Facing ELT Challenges Nov. 27- 29, 2006

2. Focus • Assessment • Evaluation

3. Introduction • Computers a part of education • T technology & pedagogical problems • T concern attend seminars, conferences etc. • “In keeping with a learner-centered approach, evaluation and assessment should be part of the learning-teaching process, embedded in class activities and in the interactions between learners and teachers” (Harasim et al. 1996:167).

4. Terminology • E-learning and online – interchangeably • Assessment– -the act of judging or assessing a person, situation or event -learning outcomes assessment provides what ss know and can do at specific points designed to improve learning

5. Evaluation (1) • Assess effectiveness of an ongoing program in achieving its objective(s) • Relies on standards of project design to distinguish a program’s effect from those of other forces • Aims at program improvement through a modification of current operation

6. Evaluation (2) • Collect infor. (assessments) to make informed decisions about continued instruction, programs, or activities. • Evaluation can assess both the process and outcomes. • Judging the quality, value or worth of a program or student performance using established criteria, using gathering data.

7. Process of determining the adequacy, value, outcomes and impact of instruction & learning, Assessment at a point in time of the value, worth of impact of a project or program, Can be conducted at various points in a project. Evaluation (3)

8. Technology E-learning course Teacher Students Chart 1: Linkage of e-learning courses to assessment and evaluation s Assessment & Evaluation

9. Action-Reflection Cycle Planning Reflecting Acting Observing

10. Websites Assessments • Quiz • Test • Papers Let's look at examples of websites assessment

11. Examples of Websites Assessments Example A: About English as a 2nd Language Prepositions of Place – in/at/on- • There are 15 questions. Ss click the mouse to answer the question. • Ss are given 10 seconds to answer each question with only one correct answer. • Feedback is provided at the end of the quiz.

12. Example A: About English as a 2nd Language Prepositions of Place – in/at/on

13. Example A: About English as a 2nd Language Prepositions of Place – in/at/on (2) Last line from previous example: More prepositions quizzes • Example B: About English as a 2nd Language Prepositions of Place – in/at/on- • Feedback is given for correct answer

14. Example B: About English Language Prepositions of Place – in/at/on-

15. Example C: About English as a 2nd Language Prepositions of Place – in/at/on-If ss do not click an answer the following appears

16. If students click the incorrect answer the following appears look atExample D: About English as a 2nd Language Prepositions of Place – in/at/on-

17. Example D: Prepositions of PlaceThat answer was not correct.

18. Example E: Lang. Prep. of Place(1) • When students complete the quiz, the score will appear and other quizzes are offered. • Let’s look at the score and what else is offered.

19. Example E: Lang. Prep. of Place(2)

20. Other form of assessments • Electronic portfolios • Computer-based work checklist • Peer review • Sheets • Close texts • Learning logs • Multimedia projects

21. Example G: Example of Portfolio Scoring Rubric

22. E-portfolio • It is a collection of students’ work that shows students’ efforts, progress, and achievements in more or more areas or the curriculum.

23. Example H: E-portfolio

24. Example I:E-portfolio

25. What to include in an e-portfolio?Collection can include: • Ss participation in selection content • Criteria for selection • Criteria for judging merits • Evidence of ss self-reflection • A collection of ss best work or efforts, ss choose samples to meet assignment. Show growth & development.

26. Equipment Software Training Play Plan An assessment tool depending on knowledge level of T,time T have & can invest What is necessary to create e-portfolio?

27. Example J: Example of an e-portfolio

28. E-Portfolio • An e-portfolio is an organized, purposeful collection of students’ work that displays knowledge, understanding, skills, accomplishments, interest and achievement over a period. • Time and planning is essential.

29. Example l: Sarah’s work

30. Example M: T’s feedback(1)

31. Evaluation(1) • The evaluation can be conducted via qualitative methods which are often used. • They tell the program’s story by capturing and communicating the participants’ stories. • The action-reflection cycle can be used.

32. Evaluation (2) It would be assessing the program. • Systematic collection of information about the activities characteristics, and outcomes of programs to make judgments about the program, improve program effectiveness and/or inform decisions about future programs.

33. An Example of Evaluation (Research) (1) • Ajarns teaching oral com. courses were interviewed to find out the predicaments they were facing. • What were some of the problems they had encountered teaching, • The interviews were analyzed. • The data was presented in a matrix form to find a common thread.

34. An Example of Evaluation (Research)(2) • Kajornboon (2005) investigated issues that teachers face in teaching oral com. in the Thai context and examined existing teaching method in oral communication that teachers found effective and productive. • The study aimed to provide a practical guideline or checklist to assist ajarns in teaching oral communication in order to improve students’ language development.

35. Conclusion • Web assessment & evaluation can take many dimensions. • T set their goal and know what they want to measure, such as the course, students, or program. • T choose to do assessment or evaluation that is best for their students and course.

36. Q & A • Comments • Questions • Thank you Email: kannabel@chula.ac.th annabelbk@yahoo Subj.: assessment/evaluation