1 / 16

Evaluating the Effectiveness of Feedback in SQL-Tutor

Evaluating the Effectiveness of Feedback in SQL-Tutor. Antonija Mitrovic, Brent Martin Intelligent Computer Tutoring Group Computer Science Department University of Canterbury Christchurch, New Zealand. Overview. SQL-Tutor Feedback types Evaluation study Results.

manny
Download Presentation

Evaluating the Effectiveness of Feedback in SQL-Tutor

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluating the Effectiveness of Feedback in SQL-Tutor Antonija Mitrovic, Brent Martin Intelligent Computer Tutoring Group Computer Science Department University of Canterbury Christchurch, New Zealand

  2. Overview • SQL-Tutor • Feedback types • Evaluation study • Results

  3. Architecture of the standalone version of SQL-Tutor

  4. SQLT-Web: a Web-enabled SQL tutor • http://ictg.cosc.canterbury.ac.nz:8000/sql-tutor/ • Interface developed in CL HTTP-server • Used in COSC courses since 1999 • Open for outside users on March 29, 2000

  5. Architecture of SQLT-Web

  6. Feedback types • Positive/negative • Error flag • Hint • All errors • Partial solution • Complete solution

  7. Hypothesis: • Positive/negative and Error flag too general • Low-level feedback contraproductive (partial and complete solution) • Constraint-based feedback most effective (hint and all errors)

  8. Evaluation study • COSC313, May 1999 (Web) • Single 2-hour session • 6 lectures + 8 hours of labs • 33 students

  9. Three groups: • Detailed (complete and partial solution) • General (hint and all errors) • Limited (pos/neg and error flag)

  10. Results 1 Difference in times is significant

  11. Results 2

  12. Initial learning rate • All errors 0.44 • Error Flag 0.40 • Pos/Neg 0.29 • Hint 0.26 • Partial 0.15 • Full solution 0.13

  13. Conclusions • General feedback is most effective • Detailed feedback is detrimental to learning • Feedback level needs to be adapted

More Related