Missouri Assessment Program
Download
1 / 42

Overview - PowerPoint PPT Presentation


  • 120 Views
  • Uploaded on

Missouri Assessment Program Examiner’s Manual Training Spring 2009 Produced by the Missouri Department of Elementary and Secondary Education in collaboration with CTB/McGraw-Hill . Overview.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Overview' - rafe


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Missouri assessment program examiner s manual training spring 2009 produced by the missouri department of elementary

Missouri Assessment Program Examiner’s Manual Training Spring 2009Produced by the Missouri Department of Elementary and Secondary Education in collaboration with CTB/McGraw-Hill


Overview
Overview

  • Missouri Assessment Program is one of several educational initiatives mandated by the Outstanding School Act of 1993.

  • The State Board of Education mandated the Department of Elementary and Secondary Education (DESE) to identify the knowledge, skills, and competencies that Missouri students should acquire.


Missouri assessment program examiner s manual training spring 2009 produced by the missouri department of elementary

DESE uses testing information to:

  • Monitor the progress of Missouri students in meeting the Show-Me standards

  • Inform the public and state legislature about students’ performance

  • Inform state and federal accountability decisions

  • Make informed decisions about educational issues

  • Improve the services provided to Missouri students


Missouri assessment program grade level assessments for spring 2009
Missouri Assessment Program Grade-level Assessments for spring 2009

Communication Arts: Grades 3-8

Mathematics: Grades 3-8

Science: Grades 5 and 8


Missouri assessment program examiner s manual training spring 2009 produced by the missouri department of elementary

Testing Time Guidelines:

  • Testing times vary per grade level – consult the “Testing Schedules” within the examiner’s manual for timing guidelines.

  • Testing time has increased given the fact that additional Field Test items are embedded (EFT).


Types of questions
Types of Questions

Students’ content knowledge is measured using

three types of test items:

  • Selected Response Items (multiple-choice questions)

  • Constructed-response items (short answers)

  • Performance Events or Writing Prompt


Missouri assessment program examiner s manual training spring 2009 produced by the missouri department of elementary

Field Test Items

  • Field Test items are embedded throughout the test (EFTs)

  • The testing period includes additional time for the EFTs


Missouri assessment program examiner s manual training spring 2009 produced by the missouri department of elementary

The Test Examiner’s Manual

is constructed so that an Examiner can administer more than one content area in a grade level using one manual.

Steps 1-4: Contain the same information in all content areas

Step 5: Contains test administration directions specific to Communication Arts, Mathematics, and Science for relevant grade level

Steps 6-8: Contain the same information in all content areas


Table of contents
Table of Contents

Step 1: Preparing for Testing and Testing Schedule

Step 2 Organize Your Classroom

Step 3 Check Your Testing Materials

Step 4 Before Testing

Step 5 Administer the Test

Step 6 Invalidations and Make-ups

Step 7 After Testing: Student Status Coding

Step 8 Assemble Materials for Return

Glossary


Glossary
Glossary

  • Located on the last 2 pages in each Examiner’s Manual

  • An extensive list of terms and definitions used for testing materials and administering the assessment

  • Helpful resource while reviewing the procedures/guidelines for administering the grade-level test


Step 1 preparing for testing pages 1 4
Step 1: Preparing for Testing(Pages 1-4)

  • Testing Schedules – Page 1 for all content areas

  • Review the test directions in the Examiner’s Manual in advance

  • Testing materials shall not be viewed by Examiners before testing with few exceptions, e.g. translators

  • Some sessions are strictly timed. Other sessions allow students who are making adequate progress to complete the test

  • Each test session must be completed in one sitting

  • Proctors – One proctor for every 20 students in excess of 30

  • Accommodations – Discussed in Step 7 (ELL and IEP)


Use standardized testing procedures
Use Standardized Testing Procedures

  • Follow the instructions to ensure similar testing conditions are used in all classrooms:

    • Read test directions exactly as written

    • Observe time allowances for strictly-timed sections

  • Verify that students understand the directions and how to mark answers:

    • Test directions in the manual can be clarified if necessary

    • Test items and their directions CANNOT be clarified or paraphrase


Large print and braille
Large Print and Braille

  • Accommodations must be coded on SIS on inside of front cover of the test book

  • Manipulatives are included with Braille and Large Print editions

  • Brailler can be used for the Braille edition

  • Braille and Large Print test books must be transcribed to regular test book

  • Braille and Large Print test books have special instructions that accompany the test books rather than the TC Kit

  • Mark the Braille and Large Print book with the words, “Contents transcribed to a regular test book. DO NOT SCORE”, and return those test book editions to CTB/McGraw-Hill with the unused test books


Step 2 organize your classroom page 4
Step 2: Organize Your Classroom (Page 4)

Plan and organize for:

  • Distributing and collecting materials

  • Making seating arrangements

  • Using a “Do Not Disturb Sign” (not provided)

  • Note start and stop times on the board for the timed sections of the test


Do remove all information from the room that might cue students about test content or process
Do remove all information from the room that might cue students about test content or process

FOUR DO’S FOR EXAMINERS

Do eliminate noise distractions

Do prepare students the day

before the test to get a good night’s sleep

Do remind students to use

ONLY No. 2 non-mechanical pencils

to bubble in their answers


Don t limit students encourage students as a group to attempt all items
Don’t limit students -- encourage students as a group to attempt all items

FOUR DON’TS FOR EXAMINERS

Don’t correct answers that are wrong

Don’t return books to students

to have them revise or complete answers


Step 3 check your testing materials pages 5 7
Step 3: Check Your Testing Materials(Pages 5-7)

Examiner materials:

  • Examiner’s Manual

  • Student barcode labels

  • Test Books

  • Manipulatives - Prepare by having all manipulatives “punched-out” prior to testing

  • One Group Information Sheet (GIS) per Examiner/Grade

  • Large white envelopes

  • A box or envelope for unused test books

  • Do Not Disturb sign (not provided)


Missouri assessment program examiner s manual training spring 2009 produced by the missouri department of elementary

  • Student materials

  • Items not provided but specified for use in various testing sessions. Read instructions in Examiner’s Manual:

    • Writing instruments are not provided – students must use non-mechanical, No. 2 pencils

    • Scratch, graph or grid paper for all Mathematics sessions

    • Book markers (such as blank paper strips or index cards)


Missouri assessment program examiner s manual training spring 2009 produced by the missouri department of elementary

Ancillary Materials for Mathematics:

Manipulatives:

Students will be provided with a standard set of manipulatives for use during the test. No other classroom sets of manipulatives will be allowed.

Reference Sheets:

Grades 3 through 7are provided all necessary formulas and conversions

with the items. No separate reference sheet will be provided.

Grades 8 will be provided with a reference sheet that contains formulas and conversions.

Calculators:

Grades 3 through 5 are not allowed to use calculators during any session of the test.

  • Grades 6 through 8 may use calculators except during Session 2, Parts 1 and 3. If schools choose to use calculators on the other parts of the test, students should be given advanced notice and given access to a calculator


Missouri assessment program examiner s manual training spring 2009 produced by the missouri department of elementary

Ancillary Materials for Communication Arts:

Grade 3: A standard dictionary and extra paper for writing first drafts may be used only during Session 2.

Grades 7: A standard dictionary, thesaurus, grammar handbook, and extra paper for first drafts may be during Session 2.

Grades 4, 5, 6, 8: No tools may be used for any sessions of the test.


Missouri assessment program examiner s manual training spring 2009 produced by the missouri department of elementary

Ancillary Materials for Science:

REFERENCE SHEETS:

Grade 5:willnot be provided a reference sheet. Necessary formulas and conversions will be included with the item

Grades 8:will beprovided with a reference sheet that contains formulas and conversions when required by particular items

CALCULATORS:

Grade 5 and 8:will not be allowed to use calculators during anysession of the test


Security shall nots
Security “Shall Nots”

  • Testing materials shall not be photocopied, duplicated or made accessible to non-testing personnel

  • Testing materials shall not be viewed by Examiners before testing

  • Testing materials shall not be left in an unsecured area at any time, for any reason -- must be locked in a secure cabinet or in a secure room before, between and after testing sessions

  • Testing materials shall not be discussed between Examiners

  • Test books shall not be shared between schools


Security barcode
Security Barcode

  • Each test book has a unique barcode, numbered in consecutive order for security and inventory.

  • Security barcodes are located on the lower right-hand corner of the students’ test books.

  • Barcodes should be checked by DTC and STC, and books counted by the Examiner.


Accommodations for ell
Accommodations for ELL

  • All tests, except Communication Arts, may be read to ELL students in their native language

  • ELL students may give responses orally or in writing in their native language

  • All native language written responses must be transcribed verbatim to another test book

  • Translators must be trained in giving the assessments


Step 4 before testing pages 7 9
Step 4: Before Testing(Pages 7-9)

When all information

on the student

pre-code roster is correct

Affix the barcode label

Do not complete the SIS

Do not use the barcode label

Bubble in ALL info on SIS

Error in

Student Name, Birth Date, Race/Ethnicity, Gender, MOSIS State ID

Place one blank label

over the incorrect label

Then affix correct label

Wrong student label

is affixed


Using student barcode labels
Using Student Barcode Labels

Label attached with error in

Student Name, Birth Date,

Race/Ethnicity, Gender,

MOSIS State ID

Place 2 blank labels over

incorrect label

Bubble in all info on SIS

No student barcode

label

Enroll/submit to core data

Leave barcode area blank

Bubble in all info on SIS


How to fill out the sis page 8
How to Fill Out the SIS (Page 8)

  • Student Name

  • Birth Date

  • Race/Ethnicity

  • Gender

  • MOSIS State ID


Missouri assessment program examiner s manual training spring 2009 produced by the missouri department of elementary
Step 5: Administer the Test(Begins on Page 11. Section 5 will vary in length depending on grade level or content being tested).

  • Help students relax and be positive

  • Explain the purpose of the test

  • Point out that some items may be more difficult or may be new to students – they are not expected to know all the answers. They are only expected to do their best.


Specific instructions for test
Specific Instructions for Test

  • Examiner’s instructions are arranged by grade level across content areas

  • Content area is in alphabetical order– Communication Arts, Mathematics, and Science

  • Sample questions are illustrated and printed in the Examiner’s Manual for each content

  • A starting/stopping time graphic is printed for Examiner’s to follow

  • Sessions cannot be split over 2 days or over lunch periods

  • Break times are printed in the Examiner’s Manual

  • Notice the wording about not paraphrasing test questions and pronouncing only one word per sentence


Step 6 invalidations and make ups page 37 page numbers will vary due to variation in step 5
Step 6: Invalidations and Make-upsPage 37 – Page numbers will vary due to variation in Step 5)

Six categories for test invalidation:

  • Student discovered cheating

  • Examiner reads any part of the C.A. test to student(s) other than students who are Blind/Visually impaired who do not read Braille

  • Examiner signs any part of the C.A. test

  • Examiner paraphrases test questions in any content area

  • Examiner reads any part of the C.A. test to a student in the student’s native language

  • A student uses a bilingual dictionary for any part of the C.A. test


Examiner s and stc s responsibilities regarding invalidations
Examiner’s and STC’s Responsibilities regarding Invalidations

  • The Examiner must provide STC with student information and the reason for the invalidation

  • The Examiner and STC must be in agreement about the invalidation due to cheating

  • The STC is responsible for filling in appropriate bubble in Accommodations Section of SIS


Missouri assessment program examiner s manual training spring 2009 produced by the missouri department of elementary

Make-ups Invalidations

Students who are absent during one or more sessions of testing should make-up the sessions If a student cannot participate in make-up testing sessions, follow the procedures in the Examiner’s Manual listed in Step 6


Accommodations footnotes
Accommodations Footnotes Invalidations

  • Please observe the footnotes at the bottom of Accommodations pages:

    • Oral reading of CA except for blind students who do not read Braille

    • Paraphrasing test questions invalidates that student’s scores for accountability purposes.

    • If paraphrasing is used, student scores cannot be compared with scores generated under standard conditions.

    • Use of magnifying equipment, amplification equipment, graph paper, and testing with the teacher facing student are not listed as accommodations because these are no longer required to be reported as accommodations for the MAP tests.


Students not tested in content area assessments
Students Not Tested Invalidationsin content area assessments

  • Only two groups of students are not required to take the MAP:

    • MAP Alternate (MAP-A) students

    • ELL (English Language Learner) in the United States 12 months or fewer at the time of administration of MAP assessments may be exempted fromtheCommunication Arts test. All other content areas must be assessed.


Step 8 assemble materials for return pages 43 48 page numbers will vary due to step 5
Step 8: Assemble Materials for Return InvalidationsPages 43-48 (Page numbers will vary due to Step 5)

Checklist after testing:

  • All student barcode labels are accurate and attached correctly

  • All student identifying information is correct and complete according to Step 7

  • The SIS should not be damaged or torn

  • All applicable accommodations are completed accurately

  • Non-mechanical, No. 2 pencil was used

  • Test books with issues/problems were transcribed and recorded

  • (Continued on next slide)


Assemble materials cont
Assemble Materials Invalidations(cont.)

  • All loose papers, scratch paper, etc., are removed and securely destroyed

  • The STC completes and checks Group Information Sheets (GIS)

  • Examiners must count the test books against the pretest total – both used and unused

  • Organize test books whose scores are to be reported together


Assemble materials cont1
Assemble Materials Invalidations(cont.)

Organize materials as shown on picture of envelope

  • MAP test books – each with a student barcode label or with a completed SIS

  • GIS for class/group

    NOTE: Do not seal the envelopes. The DTC will verify the contents before sealing them.


Large white envelopes
Large White Envelopes Invalidations

  • Each envelope will hold approximately 5–10 test books, depending on grade level

  • If an Examiner has more than one envelope, put the GIS in the Examiner’s first envelope with as many test books as will fit.

  • If multiple envelopes are needed to hold large groups of books, the envelopes should be bundled together and marked on the front upper-left corner “1 of X,” “2 of X,” “3 of X,” etc., with “X” being the total number of envelopes

  • The information requested on the front of each envelope must be completed


Assemble materials cont2
Assemble Materials Invalidations(cont.)

  • Unused test books, Large Print and Braille test books can be placed in a box together labeled “Unused Test Books”

  • Draft copies of writing prompt and scratch, graph or grid paper should be given to STC for secure destruction.


What should an examiner do if a problem occurs
What should an Examiner do Invalidations if a problem occurs?

  • For any problems or questions, contact the STC who will, in turn, contact the DTC

  • The DTC is the sole channel for all communication between districts and CTB/McGraw-Hill customer service line.

  • The DTC should also be the channel of communication regarding testing issues with DESE


Local map office contacts
Local MAP Office Contacts: Invalidations

  • Patricia Johnsonmapstl@umsl.edu

    Regional Instructional Facilitator for Math

  • Sherri Samsonmapcarif@umsl.edu

    Regional Instructional Facilitator for Communication Arts

  • Paula Youngmapscrif@umsl.edu

    Regional Instructional Facilitator for Science