Designing Good Tests: Item Analysis is Part of the Equation!

1 / 10

# Designing Good Tests: Item Analysis is Part of the Equation! - PowerPoint PPT Presentation

Designing Good Tests: Item Analysis is Part of the Equation!. Molly Herman Baker, Ph.D. Black Hawk College. Planning Tests. Determine amt of time, location, level of difficulty desired, resources available during test, and \% weight of test compared to total # of assessments

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.

## PowerPoint Slideshow about 'Designing Good Tests: Item Analysis is Part of the Equation!' - onella

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

### Designing Good Tests: Item Analysis is Part of the Equation!

Molly Herman Baker, Ph.D.

Black Hawk College

Planning Tests
• Determine amt of time, location, level of difficulty desired, resources available during test, and % weight of test compared to total # of assessments
• Based on objectives, determine what is important to know, not “nice to know”
• Based on amt of time, estimate number of questions possible (see Test Writing Basics handout for estimates)
• Prepare specifications chart
Specification Chart Basics
• Specifications chart:
• Type and number of items for each content area or objective.
• Type and number of items for each type of HOT skill (HOT=discipline-specific; Bloom often selected, but others may be more relevant for your discipline)
Writing/Choosing Good Items
• Write good objectives, using verbs that indicate desired performance; share with students
• Write/select test items based on these verbs;
• See “Comparison of Bloom and Ebel’s Taxonomies” handout for samples
• See “Test Writing Basics” handout
• Discuss strategies for selecting test bank items
• HOTS (Higher order thinking skills)=application, analysis, prediction, synthesis, evaluation or alternative taxonomy relevant to your discipline
• Important: practice HOT in class (critical thinking, creative thinking, problem-based learning, case-based learning, scenario-based lng)
• Important: provide guidance, practice & feedback on preparing for and answering HOT exam questions
• # correct and # missed per item
• What does this tell you?
• # who answered each MC distractor
• What does this tell you?
• Correlation between answers and overall test performance (Discrimination Index/Pt. Biserial)
• What could this tell you?
• Questions with poor item analysis score
• Discuss with students to determine item problems
Testing Services at BHC
• Administer individual tests to students in Study Unlimited or online classes
• Administer individual tests to students taking make-up exams
• Score and return Scantron tests if the key is provided by the instructor (campus mail or file drawer). More Scantron scoring machines in Bldg 2 and 3.
• Email [email protected] or submit ILC Testing Form to make arrangements for online testing (course, instructor, exam#, student(s), deadline for completing, time limit, allowable notes or books, test password, what to do with hard copies)
QuickScore II Tips
• Item analysis software in QC1-106 (ILC)
• Use score sheet #101864-ERI-L only
• Options for output:
• Save electronic analysis reports in PDF format to your H: drive ( or floppy, Flash drive)
• Print reports (bring paper from your dept)