Confidence-Based Assessment of Two-Alternative Format Tests AHMED A. BELAL (1) & DIALA F.AMMAR (2)

1. Confidence-Based Assessment of Two-Alternative Format Tests AHMED A. BELAL (1) & DIALA F.AMMAR (2) (1)Computer Engineering and Informatics- Beirut Arab University, Lebanon (2)Psychology department, Lebanese American University, Lebanon abelal@bau.edu.lb

2. Computer Aided Assessment • Multiple Choice Exams : • No Partial Credit • Penalty for Wrong Answers

3. Designing good distracters • Multiple Select Exams • Penalty for Wrong Answers • Multiple T/F Exams • Question may have no correct answers • No partial credit • Individual T/F questions • Weak resistance to guessing

4. Correct =+ X • No Answer = 0 • Wrong Answer= -Y • Poor discrimination • Confidence-based Assessment

5. The Element Of Uncertainty improves Discrimination Three Questions

6. Adding an element of uncertainty

7. Incorporating uncertainty in the test Leclereq [1,2] • Hard to correctly estimate one’s confidence level • Humans are more oriented to judge their uncertainty in things relative to each other

8. Relative Uncertainty • Student ranks questions relative to each other. • Value of correct answer decreases as level of confidence decreases. • Wrong answers change the confidence level. • Use a step size and a reduction function to assign values for a correct answer.

9. Relative Uncertainty : An Example

10. Relative Uncertainty (Cont) 10 Questions : answer vector 1101001100

11. Answering Form

18. Thank you