Oklahoma core curriculum tests
This presentation is the property of its rightful owner.
Sponsored Links
1 / 33

Oklahoma Core Curriculum Tests PowerPoint PPT Presentation


  • 61 Views
  • Uploaded on
  • Presentation posted in: General

Oklahoma Core Curriculum Tests. General Item Writer Training Session February 14, 2008. Meeting Goal. To provide information about the DRC item writing process and our guidelines for writing sound items that assess the construct being taught. Item Writers. Selection criteria

Download Presentation

Oklahoma Core Curriculum Tests

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Oklahoma core curriculum tests

Oklahoma Core Curriculum Tests

General Item Writer Training Session

February 14, 2008


Meeting goal

Meeting Goal

To provide information about the DRC item writing process and our guidelines for writing sound items that assess the construct being taught.


Item writers

Item Writers

  • Selection criteria

  • Contracts and Confidentiality statements


Item writer training materials

Oklahoma PASS

Oklahoma Test and Item Specifications

Oklahoma Style Guide

DRC Item Writer Training Manual

DRC Fairness in Testing Manual

DRC Universal Design Guide

Item/Passage Writing Templates

Item Writer Training Materials


Parts of an item

Parts of an Item

  • Multiple-choice items

    • Stem

    • Response Options

    • Correct Answer

    • Distractors

    • Graphics/Artwork (if applicable)

    • Distractor Rationales (mathematics)


Oklahoma core curriculum tests

Components of an Item

The lengths of some of the biggest ships ever built are shown in the table below.

Graphic

Stem

Question

What is the range of the lengths of the ships in the table?

(A) 105[last length – first length]

(B) 263

(C) 775.5[mean]

(D) 795.5[median]

Options

Rationales

Distractors


Stems

Stems

  • Present one clearly stated question

  • Include information that avoids a repeat in each option

  • Are clear and concise

  • Use the active voice

  • Use grade-level appropriate vocabulary

  • Include only what is necessary

  • Do not cue the answer or miscue a distractor


Distractors and answer

Distractors and Answer

  • Distractors (Options) Should

    • include only what is necessary

    • be parallel in structure

    • not contradict or negate the stem

    • be as brief as possible

    • fit grammatically and syntactically with the stem

  • Answers

    • There should only be one correct answer

  • All distractors should be plausible


  • Graphics artwork

    Graphics/Artwork

    • Graphics/Artwork

      • Stimuli are necessary and functional

      • Stimuli are clear, simple, and considerate of students with special needs

      • Stimuli are properly labeled

      • Stimuli are complete

      • Content is current and accurate

      • When used as options, are parallel in style and layout


    Good items should

    Good Items Should

    • Measure the intended skill or standard

    • Be consistent with item writer guidelines and specifications

    • Be of appropriate difficulty for the grade level

    • Be grammatically correct

    • Assess meaningful concepts

    • Assess comprehension of the concept


    Content of items should

    Content of Items Should

    • Allow students to show their understanding of the curriculum being tested

    • Test knowledge and skills that are important

    • Provide passage-dependent connections for reading test.


    Style

    Style

    • Follow the Oklahoma style guide

    • Be consistent in tone


    Ensuring fairness for all students

    Ensuring Fairness for All Students

    Standard 7.4: Test developers should strive to identify and eliminate language, symbols, words, phrases, and content that are generally regarded as offensive by members of racial, ethnic, gender, or other groups, except when judged to be necessary for adequate representation of the domain.

    Standards for Educational and Psychological Testing (AERA, APA, NCME, 1999)


    Definition of bias

    Definition of Bias

    Bias is the presence of some characteristic of an item that results in differential performance for two individuals of the same ability but from different sub groups.


    Stereotyping

    Stereotyping

    • Depicting members of either gender

      • Experiencing stereotyped emotions

      • Participating in stereotyped activities

      • Working in stereotyped occupations

      • Portraying stereotyped characteristics

      • Portraying stereotyped situations

      • Using demeaning labels

      • Showing stereotyping through pictures


    Gender bias

    Gender Bias

    • Titles and specific terms referring to humanity in general (manpower)

    • Gender-specific terms for occupations (fireman)

    • Use of pronouns that imply a stereotype

      • The nurse went to the hospital, and she was able to talk with the patient.

    • Use of phrases that identify genders in terms of their roles or occupations

      • The travelers took their wives and children with them.


    Gender bias continued

    Gender Bias (continued)

    • Use of words and phrases that are not parallel

      • The men’s department is on the right; the ladies’ department is on the left.

    • Use of figures of speech

      • Old wives' tale

      • Man versus nature

    • Use of gender-specific terms

      • Career girl


    Regional

    Regional

    • Terms not commonly used nationwide or used only within a particular region or state

      • Davenport

      • Toboggan

      • Bubbler

      • Pike

      • Soda


    Ethnic or cultural

    Ethnic or Cultural

    • Terms that are demeaning and/or offensive to a particular ethnic group or culture

    • Terms that depict a particular group as poor or uneducated


    Class or socioeconomic

    Class or Socioeconomic

    • Activities, possessions, or ideas that are not common to all students within a given strata

      • Country club

      • Snow skiing

      • Town home or loft

      • European vacations

      • Private swimming pool


    Religious or cultural

    Religious or Cultural

    • Terms that are demeaning and/or offensive to a particular religious group

      • Halloween

      • Rock-and-roll dance

    • Terms that portray a particular belief or practice as the norm or as inferior or superior to any other


    Other types of bias

    Other Types of Bias

    • Ageism (bias against a particular age group)

      • Irresponsible teens

    • Bias against persons with disabilities

      • Despite disability, she was able to . . .

      • Content should show people in everyday situations, and groups should be depicted as fully integrated in the society


    Experiential

    Experiential

    • The questions and activities reflected in the questions should be relevant to the life experiences of the persons responding to the items.

    • For a student to respond sensibly to test questions, he/she must know what the question is talking about.


    Experiential examples

    Experiential examples

    • 1 under par

    • Tossed the hat in the ring

    • Subway turnstile

    • Took the skyway

    • Running neck-and-neck


    Sensitivity concerns

    Sensitivity Concerns

    • Sensitive and offensive topics should be avoided

    • Also to be avoided are

      • Highly charged or controversial topics

      • Topics and/or items that appear to promote or defend a particular set of values

      • References to tragedies or hardships, such as floods or earthquakes, tornados, dust storms


    Special circumstances

    Special Circumstances

    • Historical Contexts

    • Literary Contexts


    Universal design

    Universal Design

    Universally designed assessments are based on the premise that each student in school is a part of the population to be tested and that testing results should not be affected by disability, gender, race, or English language ability.


    Universal design1

    Universal Design

    • Test questions have concise and readable text.

      • Simple, clear, commonly used words are used whenever possible.

      • Unnecessary words and extraneous text are omitted.

      • Vocabulary and sentence complexity is appropriate for the grade level assessed.

      • Technical terms and abbreviations are used only if they are related to the content being measured.

      • Definitions and examples are clear and understandable.


    Ideas item banking system

    IDEAS Item Banking System

    Item Development and Educational Assessment System (IDEAS)

    • Houses OCCT items

    • Web-based, secure server

    • Maintains “history” of an item

    • Item editing tool

    • Forms construction tool

    • Delivery system to our online partner CAL


    Ideas item banking system1

    IDEAS Item Banking System

    • Information placed on item writer template

    • Coded electronically in IDEAS

    • Editing occurs within system

    • Document specific information and/or consider certain criteria as each item is developed.


    Content presentations

    Content Presentations

    • Mathematics

    • Reading

    • Science

    • Social Studies


    Questions

    Questions


    Oklahoma core curriculum tests1

    Oklahoma Core Curriculum Tests


  • Login