1 / 9

Optimizing Exam Strategy: Leveraging Database Insights for Improved Assessment

This document outlines a comprehensive strategy for improving exam content and performance tracking. By transitioning from traditional Word documents to a structured exam database, we can enhance the drafting process for 21 specialty areas. The database allows for cataloging questions by subject, linking to specific exam provisions, and tracking question authorship and validity. We've developed tools to analyze multiple-choice and essay performance, ensuring coverage aligns with topic importance. This system simplifies revisions and retirement of obsolete questions, leading to a more robust examination system.

hiroko
Download Presentation

Optimizing Exam Strategy: Leveraging Database Insights for Improved Assessment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ABA RoundtableMay 2014

  2. IN THE BEGINNING, . . . . • There was nothing.

  3. OVERALL EXAM STRATEGY • A MOVE TO CONSCIOUSNESS

  4. SOME EXAMPLES • Format • Specifications • Purpose • Drafting guidelines

  5. STRATEGY FOR EXAM DATABASE • Make maximum use of available exam information each year

  6. TACTICAL EXAMPLES • We can now generate an exam in final format from the database • This was humongous for us – we had previously used Word documents in preparing exam content for 21 specialty areas • It reduced the work for our volunteers

  7. MORE TACTICAL EXAMPLES • Questions can be cataloged by subject and a unique ID number • Questions can be tied to a specific provision in the exam specifications • We can track who drafted, graded or reviewed • We have authority for the correct answer • We can determine if the question needs to be revised • We can revise a model answer if needed

  8. CONTINUED • We can track performance on multiple choice and essay questions • We can determine if a question is invalid and adjust scores accordingly in the database • We generate a detailed report on multiple choice performance • We can easily use different combinations of questions to keep an exam from being too predictable

  9. CONTINUED • We can better quantify the coverage of the exam so that topics were covered in the proper proportion to their importance in the specialty area • We can determine how examinees performed by topic • We can much more easily track changes to questions and retire items which are no longer valid

More Related