Item Analysis - Outline. 1. Types of test items Selected response items Constructed response items 2. Parts of test items 3. Guidelines for writing test items. Item Analysis - Outline. 4. Item Analysis Distracter measures Item difficulty measures Item discrimination measures
Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
1. Types of test items
2. Parts of test items
3. Guidelines for writing test items
4. Item Analysis
5. Item Response Theory
Parking costs at the university are fair
1 2 3 4 5
Strongly agree neutral disagree strongly
What did you do last time?
Did that work?
How many people have to be tested?
How much time is available?2. Parts of test items
Generate a pool of potential items
Monitor reading level
Use unitary items
Avoid long items
Break any response “set”
Use reverse-scored items to prevent test-taker’s from getting into a response set such as just responding “5” for every item on a Likert scale3. Writing test items - guidelines
P(i) = # got item correct
# taking testB. Item Difficulty Measure P
One curve for each test item
X axis: test-taker ability (given by test score)
Y axis: probability of choosing an answerA. Item characteristic curves
IRT model assumes that the trait being measured is one-dimensional. It may not be.Problems with Item Response Theory
lets you tailor questions for each test-taker
test-taker does not spend most of their time with questions that are too easy or too difficultB. Adaptive Testing Using Computers