Oklahoma core curriculum tests
1 / 33

Oklahoma Core Curriculum Tests - PowerPoint PPT Presentation

  • Uploaded on

Oklahoma Core Curriculum Tests. General Item Writer Training Session February 14, 2008. Meeting Goal. To provide information about the DRC item writing process and our guidelines for writing sound items that assess the construct being taught. Item Writers. Selection criteria

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about ' Oklahoma Core Curriculum Tests' - march

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Oklahoma core curriculum tests

Oklahoma Core Curriculum Tests

General Item Writer Training Session

February 14, 2008

Meeting goal
Meeting Goal

To provide information about the DRC item writing process and our guidelines for writing sound items that assess the construct being taught.

Item writers
Item Writers

  • Selection criteria

  • Contracts and Confidentiality statements

Item writer training materials

Oklahoma PASS

Oklahoma Test and Item Specifications

Oklahoma Style Guide

DRC Item Writer Training Manual

DRC Fairness in Testing Manual

DRC Universal Design Guide

Item/Passage Writing Templates

Item Writer Training Materials

Parts of an item
Parts of an Item

  • Multiple-choice items

    • Stem

    • Response Options

    • Correct Answer

    • Distractors

    • Graphics/Artwork (if applicable)

    • Distractor Rationales (mathematics)

Components of an Item

The lengths of some of the biggest ships ever built are shown in the table below.




What is the range of the lengths of the ships in the table?

(A) 105 [last length – first length]

(B) 263

(C) 775.5 [mean]

(D) 795.5 [median]





  • Present one clearly stated question

  • Include information that avoids a repeat in each option

  • Are clear and concise

  • Use the active voice

  • Use grade-level appropriate vocabulary

  • Include only what is necessary

  • Do not cue the answer or miscue a distractor

Distractors and answer
Distractors and Answer

  • Distractors (Options) Should

    • include only what is necessary

    • be parallel in structure

    • not contradict or negate the stem

    • be as brief as possible

    • fit grammatically and syntactically with the stem

  • Answers

    • There should only be one correct answer

  • All distractors should be plausible

  • Graphics artwork

    • Graphics/Artwork

      • Stimuli are necessary and functional

      • Stimuli are clear, simple, and considerate of students with special needs

      • Stimuli are properly labeled

      • Stimuli are complete

      • Content is current and accurate

      • When used as options, are parallel in style and layout

    Good items should
    Good Items Should

    • Measure the intended skill or standard

    • Be consistent with item writer guidelines and specifications

    • Be of appropriate difficulty for the grade level

    • Be grammatically correct

    • Assess meaningful concepts

    • Assess comprehension of the concept

    Content of items should
    Content of Items Should

    • Allow students to show their understanding of the curriculum being tested

    • Test knowledge and skills that are important

    • Provide passage-dependent connections for reading test.


    • Follow the Oklahoma style guide

    • Be consistent in tone

    Ensuring fairness for all students
    Ensuring Fairness for All Students

    Standard 7.4: Test developers should strive to identify and eliminate language, symbols, words, phrases, and content that are generally regarded as offensive by members of racial, ethnic, gender, or other groups, except when judged to be necessary for adequate representation of the domain.

    Standards for Educational and Psychological Testing (AERA, APA, NCME, 1999)

    Definition of bias
    Definition of Bias

    Bias is the presence of some characteristic of an item that results in differential performance for two individuals of the same ability but from different sub groups.


    • Depicting members of either gender

      • Experiencing stereotyped emotions

      • Participating in stereotyped activities

      • Working in stereotyped occupations

      • Portraying stereotyped characteristics

      • Portraying stereotyped situations

      • Using demeaning labels

      • Showing stereotyping through pictures

    Gender bias
    Gender Bias

    • Titles and specific terms referring to humanity in general (manpower)

    • Gender-specific terms for occupations (fireman)

    • Use of pronouns that imply a stereotype

      • The nurse went to the hospital, and she was able to talk with the patient.

    • Use of phrases that identify genders in terms of their roles or occupations

      • The travelers took their wives and children with them.

    Gender bias continued
    Gender Bias (continued)

    • Use of words and phrases that are not parallel

      • The men’s department is on the right; the ladies’ department is on the left.

    • Use of figures of speech

      • Old wives' tale

      • Man versus nature

    • Use of gender-specific terms

      • Career girl


    • Terms not commonly used nationwide or used only within a particular region or state

      • Davenport

      • Toboggan

      • Bubbler

      • Pike

      • Soda

    Ethnic or cultural
    Ethnic or Cultural

    • Terms that are demeaning and/or offensive to a particular ethnic group or culture

    • Terms that depict a particular group as poor or uneducated

    Class or socioeconomic
    Class or Socioeconomic

    • Activities, possessions, or ideas that are not common to all students within a given strata

      • Country club

      • Snow skiing

      • Town home or loft

      • European vacations

      • Private swimming pool

    Religious or cultural
    Religious or Cultural

    • Terms that are demeaning and/or offensive to a particular religious group

      • Halloween

      • Rock-and-roll dance

    • Terms that portray a particular belief or practice as the norm or as inferior or superior to any other

    Other types of bias
    Other Types of Bias

    • Ageism (bias against a particular age group)

      • Irresponsible teens

    • Bias against persons with disabilities

      • Despite disability, she was able to . . .

      • Content should show people in everyday situations, and groups should be depicted as fully integrated in the society


    • The questions and activities reflected in the questions should be relevant to the life experiences of the persons responding to the items.

    • For a student to respond sensibly to test questions, he/she must know what the question is talking about.

    Experiential examples
    Experiential examples

    • 1 under par

    • Tossed the hat in the ring

    • Subway turnstile

    • Took the skyway

    • Running neck-and-neck

    Sensitivity concerns
    Sensitivity Concerns

    • Sensitive and offensive topics should be avoided

    • Also to be avoided are

      • Highly charged or controversial topics

      • Topics and/or items that appear to promote or defend a particular set of values

      • References to tragedies or hardships, such as floods or earthquakes, tornados, dust storms

    Special circumstances
    Special Circumstances

    • Historical Contexts

    • Literary Contexts

    Universal design
    Universal Design

    Universally designed assessments are based on the premise that each student in school is a part of the population to be tested and that testing results should not be affected by disability, gender, race, or English language ability.

    Universal design1
    Universal Design

    • Test questions have concise and readable text.

      • Simple, clear, commonly used words are used whenever possible.

      • Unnecessary words and extraneous text are omitted.

      • Vocabulary and sentence complexity is appropriate for the grade level assessed.

      • Technical terms and abbreviations are used only if they are related to the content being measured.

      • Definitions and examples are clear and understandable.

    Ideas item banking system
    IDEAS Item Banking System

    Item Development and Educational Assessment System (IDEAS)

    • Houses OCCT items

    • Web-based, secure server

    • Maintains “history” of an item

    • Item editing tool

    • Forms construction tool

    • Delivery system to our online partner CAL

    Ideas item banking system1
    IDEAS Item Banking System

    • Information placed on item writer template

    • Coded electronically in IDEAS

    • Editing occurs within system

    • Document specific information and/or consider certain criteria as each item is developed.

    Content presentations
    Content Presentations

    • Mathematics

    • Reading

    • Science

    • Social Studies