slide1
Download
Skip this Video
Download Presentation
The Use of Accommodations for a K-12 Standardized Assessment: Practical Considerations from a State Perspective 1999 through 2004

Loading in 2 Seconds...

play fullscreen
1 / 91

The Use of Accommodations for a K-12 Standardized Assessment: Practical Considerations from a State Perspective 1999 thr - PowerPoint PPT Presentation


  • 146 Views
  • Uploaded on

The Use of Accommodations for a K-12 Standardized Assessment: Practical Considerations from a State Perspective 1999 through 2004. Patricia Almond, University of Oregon      Meagan Karvonen, Western Carolina University March 21, 2006 Savannah, GA.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'The Use of Accommodations for a K-12 Standardized Assessment: Practical Considerations from a State Perspective 1999 thr' - natasha


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
slide1

The Use of Accommodations for a K-12 Standardized Assessment:Practical Considerations from a State Perspective 1999 through 2004

Patricia Almond, University of Oregon     Meagan Karvonen, Western Carolina University

March 21, 2006

Savannah, GA

Almond, Karvonen Savannah, GA March 2006

although swd often take state tests with accommodations
Although SWD often take state tests with accommodations

States often have a hard time determining which accommodations to allow . . .(Olson, 2004)

Almond, Karvonen Savannah, GA March 2006

accommodations from a state perspective in the context of requirements and responsibilities

Accommodations from a State PerspectiveIn the Context of Requirements and Responsibilities

IDEA/NCLB

State Legislation

State Policies (testing, promotion, graduation, etc.)

Training and Guidelines

Assessment Technical Adequacy

Almond, Karvonen Savannah, GA March 2006

multiple purposes and full participation

Multiple Purposes and Full Participation

“To earn their keep, state assessment systems attempt to do it all, often by asking the same assessment to fulfill several purposes.”

(Almond, Lehr, Thurlow, Quenemoen, 2002, p. 346)

Almond, Karvonen Savannah, GA March 2006

purposes that can be applied to large scale assessment
Purposes that can be applied to large-scale assessment:
  • Aiding in instructional decisions about individual students
  • Providing information about the status of the education system
  • Motivating change
  • Evaluating program
  • Holding schools accountable for student performance
  • Encouraging change in classroom instruction
  • Certifying individual student achievement and mastery

(Heubert and Hauser, 1999)

Almond, Karvonen Savannah, GA March 2006

types of decisions based on results obtained from assessments taken with accommodations
School and District Accountability

Schools are effective or in need of improvement

High stakes rewards and sanctions will cause improved achievement

Individual Student Proficiency

Promotion to next grade

Graduation from high school

Certification

Types of decisions based on results obtained from assessments taken with accommodations:

Almond, Karvonen Savannah, GA March 2006

standard 13 2 the standards
Standard 13.2 the Standards

In educational settings, when a test is designed or used to serve multiple purposes, evidence of the test’s technical quality should be provided for each purpose.

Almond, Karvonen Savannah, GA March 2006

aligning the newly reauthorized idea with title 1
Aligning the Newly Reauthorized IDEA with Title 1

. . . States have an affirmative obligation to determine what types of accommodations can be made to assessments while maintaining their reliability and validity

House Committee Report on IDEA reauthorization? (108-77, April 29, 2003)

Almond, Karvonen Savannah, GA March 2006

state responsibilities
State Responsibilities
  • Documentation for Peer Review
    • Written policies, lists of allowable accommodations, score reports, empirical studies
  • Training for educators on how to select appropriate accommodations that will not invalidate the scores

- Peer Review Guidance (2004)

Almond, Karvonen Savannah, GA March 2006

state policies on accommodations
State Policies on Accommodations
  • Differentiating between accommodations (allowable, standard) and modifications (not allowable, nonstandard)
  • Variations in documentation policies, reporting practices, eligibility guidelines (IEP, 504, ELL, universal)
  • Some decision making criteria:
    • Use of instructional accommodations (sometimes used for period of time prior to assessment)
    • Accommodation does not provide unfair advantage/change validity
    • Prohibitions against decisions based on program setting, disability category
    • Thurlow, Lazarus, Thompson, & Morse, 2005

Almond, Karvonen Savannah, GA March 2006

potential problems in decision making school level
Potential problems in decision-making(school level)
  • Offering more (or fewer) accommodations than might be needed
  • Mismatch between instructional and assessment accommodations
  • Lack of documentation about decisions made
  • Lack of knowledge about accommodation vs. modification

Almond, Karvonen Savannah, GA March 2006

guidance from the standards
Guidance from the Standards
  • Those who make accommodation decisions should be aware of existing research on the effects of disabilities on performance (10.2).
  • Decision-makers need to have access to accurate and current information about potential accommodations and modifications (10.8).
  • Accommodations and their rationales need to be described in detail (in administration manual and technical documents), including possible limits on validity of inferences (10.4, 10.5)

Almond, Karvonen Savannah, GA March 2006

progress and room for growth
Progress, and room for growth…
  • Increased use of accommodations in large-scale assessments (Ysseldyke et al., 2004)
  • States recently identified as current and emerging issues related to accommodations:
    • Determination of appropriate and allowable accommodations
    • Technical assistance on appropriateness of specific accommodations for both instruction and assessment
    • Professional development, especially for general education teachers
    • Degree of specificity required in state guidance

-NCEO 2005 State Report

Almond, Karvonen Savannah, GA March 2006

in the opening session we received a report on the status of accommodations
In the Opening Session we received a report on the status of accommodations:

Accommodations in State Policies-What a Wonderful World of Diversity: Issues and Implications     Martha Thurlow, NCEO

Almond, Karvonen Savannah, GA March 2006

slide15

In this Session We ProvideA Case Study: One State’s Approach to Determining “Allowable” Testing Accommodations From 1999 through 2004

Almond, Karvonen Savannah, GA March 2006

chronology
Chronology

Almond, Karvonen Savannah, GA March 2006

comprehensive not alternate
Comprehensive notAlternate
  • Integral part of the whole assessment system
  • Inclusive of all students

Almond, Karvonen Savannah, GA March 2006

oregon s comprehensive assessment system in 1999 2000
Knowledge & Skills

Reading/Literature

Mathematics

Science

Perf. Assessments

Writing

Math Problem Solving

All with Adaptations

Accommodations

Modifications

Extended Perf. Measures

X-Reading

X-Math

X-Writing

X-CLRAS

Oregon’s Comprehensive Assessment System In 1999-2000

Almond, Karvonen Savannah, GA March 2006

nceo description of accommodations
NCEO Description of Accommodations

“Accommodations are changes in testing materials or procedures that enable students to participate in assessments in a way that allows abilities to be assessed rather than disabilities. They are provided to ’level the playing field.’ Without accommodations, the assessment may not accurately measure the [individual] student’s knowledge and skills.”

Emphasis added.

Almond, Karvonen Savannah, GA March 2006

accommodations and modifications tables in test administration manuals
Accommodations and Modifications Tables in Test Administration Manuals

Almond, Karvonen Savannah, GA March 2006

the settlement feb 2001
The Settlement Feb. 2001

. . . Accommodations shall be considered allowable, valid, and scorable if they are used during instruction[1] . . . and are listed on a student’s IEP or Section 504 plan, unless [the department] can show that the accommodation invalidates the score interpretation.[2]

Almond, Karvonen Savannah, GA March 2006

the settlement feb 2001 continued
The Settlement Feb. 2001 continued

. . . Rather than consider all accommodations first invalid until proven to be valid, [the department] shall consider all accommodations valid unless [it] can show that the accommodation would invalidate the score interpretation.

Almond, Karvonen Savannah, GA March 2006

the settlement feb 2001 continued23
The Settlement Feb. 2001 continued

Any list of approved or not approved accommodations published by [the department] as a guide for school districts shall not be deemed exclusive . . .

Almond, Karvonen Savannah, GA March 2006

the settlement feb 2001 continued24
The Settlement Feb. 2001 continued

When . . . a particular accommodation would invalidate the score interpretation, [the department] must provide an alternate assessment and/or alternate scoring procedures . . . to afford . . . students an assessment option that leads to the Certificate of Initial Mastery.

Almond, Karvonen Savannah, GA March 2006

2000 2001 expanded menu of testing options for full participation
2000-2001 Expanded Menu of Testing Options for Full Participation
  • Regular Tests & Achievement Level Testing (Rdg/Lit & Math)*
  • Challenge up or down
  • Accommodations
  • Modifications
  • Extended Reading, Math, Writing
  • Ext. Career and Life Role Assessment
  • Juried Assessment

* Regular refers to tests administered with and without accommodations.

Almond, Karvonen Savannah, GA March 2006

juried assessment
Juried Assessment
  • Juried CIM Assessment
  • Juried Modifications

Almond, Karvonen Savannah, GA March 2006

pathways to certificate of initial mastery cim
Pathways to Certificate of Initial Mastery (CIM)

Collections

  • ODE Collection of Evidence
  • OR University System—Proficiency Based Admission Standards System (PASS)
  • Statewide Assessments
  • CIM level State Tests (w/ or w/o accommodations)
  • CIM level State Tests w/ individually approved modifications

Almond, Karvonen Savannah, GA March 2006

juried modifications
Juried Modifications
  • Available at CIM Level
  • District brings request forward
  • Student must be able to meet state standards
  • Decision is student-by-student & test-by-test

Almond, Karvonen Savannah, GA March 2006

three examples of such requests for a juried review of a modification follow
“Three examples of such requests for a juried review of a modification follow:
  • A student literate in a language other than English, Spanish or Russian, wishes to take the mathematics test translated into his or her primary language. Such a translation would typically be considered a modification.

2. A student with limited physical dexterity writes using a special word processing program that creates words or phrases from a few keystrokes and the student wishes to take the writing test using the software.

3. A student with a significant learning disability such as dyslexia, affecting the student’s ability to read and write, uses auditory methods such as taped texts and readers as a primary learning mode.”

Almond, Karvonen Savannah, GA March 2006

slide30
“The panel might approve this modification as an accommodation for the particular student after reviewing the student\'s case if:

The student is skilled in using the read aloud adaptations

The measure of comprehension reflects the student’s own knowledge and understanding

The student achieves the same standards for interpreting text required of all students”

“ . . . a significant learning disability who uses assistive technology, screen readers, and recorded text . . . understanding text and interpreting “meaning”.

Almond, Karvonen Savannah, GA March 2006

slide31
“If approved, the student would be permitted to use the "read aloud" modification with the Reading/Literature Knowledge and Skills assessment and have the opportunity to "meet" (e.g. be determined "proficient" on the standard.)”

Almond, Karvonen Savannah, GA March 2006

accommodations in oregon
Accommodations in Oregon

Almond, Karvonen Savannah, GA March 2006

the accommodations panel

The Accommodations Panel

Almond, Karvonen Savannah, GA March 2006

purpose
Purpose:

Conduct review of proposed additions to the accommodations table for the test administration manual to assure that that the adaptation will not invalidate interpretations and judgments based on the resulting test score.

Almond, Karvonen Savannah, GA March 2006

process
Process
  • Proposal to add adaptation to the Accommodations Table
  • Staff analysis of relevant research and legal decisions about the effects of an adaptation on score validity
  • Accommodations Panel review of evidence and deliberation

Almond, Karvonen Savannah, GA March 2006

results
Results
  • A recommendation to include the adaptation either on the Accommodations Table or the Modifications Table
  • A decision by the Associate Superintendent of Assessment and Evaluation about the status of the adaptation
  • Publication in test administration manual and revised tables

Almond, Karvonen Savannah, GA March 2006

accommodations panel membership
Deaf Educator

Math Content Specialist*

ESL Teacher

Vision Specialist

District Test Administrator

Special Ed. Director

English Language Arts Content Specialist*

Parent

Educational Measurement Expert

University Researcher

School Principal

Special Ed. Teacher

Accommodations Panel Membership

* Formerly assessment item writers and assessment content panel members.

Almond, Karvonen Savannah, GA March 2006

panel members will
Panel members will:
  • Review adaptations, research reports, and assessment materials,
  • Participate in deliberations and decision-making based on review criteria, and
  • Advise the department regarding test accommodations and modifications

Almond, Karvonen Savannah, GA March 2006

member responsibilities
Member Responsibilities:
  • Represent area of knowledge and expertise represented by position on panel
  • Be familiar with the State Assessments
  • Attend all meetings
  • Apply review criteria fairly and ethically
  • Work collaboratively with other members

Almond, Karvonen Savannah, GA March 2006

panel member requirements
Panel Member Requirements:
  • Knowledge: Masters or analogous
  • Education Experience: 5 years or equivalent
  • Advisory Experience: Prior experience on advisory or content panel
  • Test Experience: Prior testing experience
  • Teamwork: Effectively work as a member of a group

Almond, Karvonen Savannah, GA March 2006

terminology for testing accommodations
Terminology for Testing Accommodations

ADAPTATION

  • Change made to the environment, curriculum, instruction, and/or assessment practices in order for a student to be a successful learner. Adaptations include accommodations and modifications. Adaptations are based on an individual students’ strengths and needs, and may vary in intensity and degree (originally from the Colorado Department of Education, 1995).

Almond, Karvonen Savannah, GA March 2006

terminology continued
Terminology continued

ACCOMMODATION

  • An alteration in how a test is presented to or responded to by the person tested; includes a variety of alterations in presentation format, response format, setting in which the test is taken, timing or scheduling. The alterations do not substantially change level, content or performance criteria. The changes are made in order to provide a student equal access to learning and equal opportunity to demonstrate what is known.

Almond, Karvonen Savannah, GA March 2006

terminology continued43
Terminologycontinued

MODIFICATION

  • Substantial changes in what a student is expected to learn and/or demonstrate. The changes are made to provide a student opportunities to participate meaningfully and productively in learning experiences and environments. They include changes in instructional level, content, and performance criteria.

Almond, Karvonen Savannah, GA March 2006

review criteria
Review Criteria
  • Standards
  • Purpose
  • Function
  • Consequence
  • Social Consequence
  • Systems Change

Almond, Karvonen Savannah, GA March 2006

review criteria continued 1 content and performance standards
Review Criteria Continued:1. Content and Performance Standards:
  • What is intended to be measured by the assessment?
  • Clarification for this question provided by department of education staff.

Almond, Karvonen Savannah, GA March 2006

review criteria continued 2 purpose
Review Criteria Continued:2. Purpose:
  • What is the requestor’s intent?
  • For example, to enhance access to test or to increase number of students who can participate?
  • Why was the request made to add the adaptation?

Almond, Karvonen Savannah, GA March 2006

review criteria continued 3 function
Review Criteria Continued:3. Function:
  • What is the effect of the adaptation?
  • How does it work?
  • How will the accommodation be used?
  • How does it need to be done? For example, scribe accommodation required protocols for training and implementation.

Almond, Karvonen Savannah, GA March 2006

review criteria continued 4 consequence
Review Criteria Continued:4. Consequence:
  • What inferences are being made or jeopardized?
  • What mistakes will be made if the adaptation is used as an accommodation? Ripple effect?

Almond, Karvonen Savannah, GA March 2006

review criteria continued 5 social consequences
Review Criteria Continued:5. Social Consequences:

What affect will the testing adaptation have on students across settings?

What is the impact on students of using the adaptation?

Also look more globally—Does adaptation influence general perceptions of the public about the validity of assessment?

Almond, Karvonen Savannah, GA March 2006

review criteria continued 6 system change
Review Criteria Continued:6. System change:
  • Would proposed adaptation constitute a system change outside the Accommodation Panel’s sphere of responsibility?
  • Does it propose a change to the assessment system and/or to the content and performance standards?

Almond, Karvonen Savannah, GA March 2006

context within which to consider criteria
Context within which to consider criteria:
  • Equity—accessibility of resources
  • Instructional alignment
  • Reality (employability)
  • Fairness (advantage or disadvantage)

Almond, Karvonen Savannah, GA March 2006

sources of evidence
Sources of Evidence:
  • Research
  • Professional expertise and judgment
  • Court/Hearing Decisions

Almond, Karvonen Savannah, GA March 2006

how it worked

How it worked!

Almond, Karvonen Savannah, GA March 2006

slide54

http://www.ode.state.or.us/opportunities/grants/sig/statewide-assessment/validated.pdfhttp://www.ode.state.or.us/opportunities/grants/sig/statewide-assessment/validated.pdf

Almond, Karvonen Savannah, GA March 2006

slide55

http://www.ode.state.or.us/teachlearn/testing/manuals/tables/nominationaccomform.dochttp://www.ode.state.or.us/teachlearn/testing/manuals/tables/nominationaccomform.doc

Almond, Karvonen Savannah, GA March 2006

for example proposed adaptation feb 01 scribe

For Example:Proposed Adaptation (Feb ‘01): Scribe

Assessment: Mathematics Problem Solving

Almond, Karvonen Savannah, GA March 2006

slide57
Point to or dictate multiple-choice responses to a scribe*

Footnote:

* Test administrators, proctors, scribes, page-turners, educational assistants, and others supporting a student’s test taking must be neutral in responding to the student during test administration. Assistance in test administration must not give away the correct answer. The student’s response must accurately represent the student’s own choice.

Scribe as it appeared on accommodations table for multiple choice assessment in 2000 prior to Settlement

Almond, Karvonen Savannah, GA March 2006

adaptation as proposed from the field

Adaptation as proposed from the field:

Almond, Karvonen Savannah, GA March 2006

description student dictates mathematics problem solving response to a scribe
Description: Student dictates mathematics problem solving response to a scribe.

Student

  • Reads mathematics problem
  • Solves problem using manipulatives, straight edge, and stencils
  • Dictates written response to scribe

Almond, Karvonen Savannah, GA March 2006

rationale from person submitting nomination
Rationale from Person Submitting Nomination:

The use of a scribe in MPS opens up the context to more accurately represent society norms.

Training scribe removes mantel of the “unfair” biases of using a scribe and is consistent with what others receive.

Other factors:

None specified.

Almond, Karvonen Savannah, GA March 2006

research review

Research Review

Almond, Karvonen Savannah, GA March 2006

dictation to a proctor or scribe conclusions tindal fuchs 1999
Dictation to a Proctor or Scribe Conclusions, Tindal & Fuchs (1999)
  • Dictation consistently boosts performance on both objective and performance assessments
  • True both for students with & without disabilities in elementary through college
  • Evidence was inconclusive either in support or in criticism of dictation as an accommodation

Almond, Karvonen Savannah, GA March 2006

research on dictation to proctor scribe in math
Limited focus in empirical studies, mixed results

Implausibly high scores for some groups and in some grades

Benefit in problem-solving CBM, but not concept & application (Fuchs et al., 2000)

Use of accommodations (including dictation) did not benefit SWD compared with those without disabilities on a state performance assessment (Elliott et al., 1999)

Conflicting results on 3 related studies re: impact of dictation on score (Koretz, 1997; Koretz & Hamilton, 1999; Koretz & Hamilton, 2000); scores ranged from lower than those without disabilities

Research on Dictation to Proctor/Scribe in Math

Almond, Karvonen Savannah, GA March 2006

panel review

Panel Review

Almond, Karvonen Savannah, GA March 2006

panel deliberation
Purpose:

Capture a response otherwise unavailable

Capture an optimal response (minimize interfering behavior or maximize ‘capable’ recording)

In MPS student interprets task, chooses strategies, shows path of thinking

Function of Allowing/Disallowing:

Student’s motor skills do not preclude participation

Allows unconfounded assessment of the MPS construct

Scribes may have limited knowledge and may alter the student’s response

Performance can be generalized

Panel Deliberation:

Almond, Karvonen Savannah, GA March 2006

panel deliberation continued
Social consequences:

Problem solving can be contextualized in multiple ways

Accommodation can be shaped and become time limited

Increases participation & may bring down scores

Scores document individual competence, may lead to improved instruction

Medium

Computer

Video

Scribe (unfamiliar/

trained)

Panel Deliberation continued:

Almond, Karvonen Savannah, GA March 2006

panel recommendation
Add Scribe to MPS Accommodations Table

Conditions

Must be a trained scribe

Student’s response must be transcribed verbatim. The role of the scribe is recorder.

Translating, interpreting, and clarifying student’s intention not permitted.

Panel Recommendation

Almond, Karvonen Savannah, GA March 2006

associate superintendent response
Associate Superintendent Response

Conditional approval pending:

  • Guidelines for use by scribes
  • Procedures for training scribes

Almond, Karvonen Savannah, GA March 2006

panel s amended recommendation
Panel’s Amended Recommendation
  • Literal transcription may ask student to repeat but not to explain
  • May read back and make changes when directed by student
  • Training should cover speed/rate, conventions of scribing, and format or layout
  • Training might be conducted through brief video sequence

Almond, Karvonen Savannah, GA March 2006

wording as it appeared on the 2001 mps accommodations table
Accommodation:

Student requiring a scribe dictates mathematics problem solving.

Footnote:

A scribe needs to provide a literal transcription of the students response without inserting any information not presented directly by the student. The following three clarifications . . . .

Wording as it appeared on the 2001 MPS accommodations table.

Almond, Karvonen Savannah, GA March 2006

scribe accommodation footnote continued
Scribe accommodation footnote continued

. . . should be followed and assume that the student has the scoring guide or knowledge of it. The purpose of these clarifications is to ensure the response is that of the student not the scribe.

1. When the scribe does not understand (e.g., misses or tracks) what the student has said, s/he may ask a clarifying question such as “could you repeat that?” Scribes may not ask any other questions.

2. Scribes may not ask questions to clarify information when they know what the student has said but do not understand what it means or why it was said.

3. If asked by the student, the scribe is allowed to read what the student has said. They are then allowed to make changes, insertions, or deletions that are initiated by the student.

Almond, Karvonen Savannah, GA March 2006

scribe accommodation footnote continued72
Scribe accommodation footnote continued

At the end of the session the scribe should ask as a final question “Did I accurately record what you have said?” Students should review (look at) what they have had scribed to edit the total response.

Both the student and the scribe need to sign off at the bottom of the test protocol to reflect agreement that all recorded information is correct. Scribes need to be familiar with the needs of the student (and have worked with students and scribing before) and not be scribing for the first time with a student during the test.

Training of scribes needs to address three important issues to ensure accurate recording: (a) speed or rate of recording, (b) conventions for (en)coding symbols, and (c) format and layout of the response. Practice sessions should be held with students and scribes in advance of actual use so the scribe understands students’ articulation. During the administration of the test, school districts, students and/or parents have the option to request an audio or videotape of the session.

Almond, Karvonen Savannah, GA March 2006

slide73

Example

A Nomination

For session participants to review and deliberate.

-----Original Message-----From: TiffanieSent: April 02To: PatSubject: Accomodations Panel

. . . the student’s math problem solving test has been marked “modified” because he received assistance with spelling and grammar in his writing. The IEP team requests . . . consider whether this modification may be considered an accommodation. The student performed all math-related tasks individually on the test.

Almond, Karvonen Savannah, GA March 2006

alex s tiles grade 5 statistics and probability

Example

Alex’s TilesGrade 5 – Statistics and Probability

Alex had a bag filled with colored tiles. It contained: 4 red tiles, half as many green tiles as red tiles, 8 purple tiles, twice as many blue tiles as purple tiles, and 3 times as many yellow tiles as green tiles. If Alex reached into his bag and pulled out 1 tile without looking, what is the probability that he will pull out a yellow tile?

Almond, Karvonen Savannah, GA March 2006

mathematics problem solving student directions
Please, show your answer and all of your work (first efforts and those that worked) in the spaces provided, so everything you do is clear to the readers.

You may use manipulatives or a calculator to work on your problem.

1. CONCEPTUAL UNDERSTANDING - the “what”

2. PROCESSES & STRATEGIES - the “how”

3. VERIFICATION - the “defense”

4. COMMUNICATION - the “connecting path”

5. ACCURACY - “correctness”

Example

Mathematics Problem SolvingStudent Directions

To receive the highest score in each of the five areas, you will want to be certain your work SHOWS each of these parts of a successful solution.

Almond, Karvonen Savannah, GA March 2006

student response part 1

Example

Student response part 1

Almond, Karvonen Savannah, GA March 2006

student response part 2

Example

Student response part 2

Almond, Karvonen Savannah, GA March 2006

review of relevant research
Review of relevant research

Almond, Karvonen Savannah, GA March 2006

break into groups for discussion review criteria

Example

Break into Groups for DiscussionReview Criteria
  • Standards
  • Purpose
  • Function
  • Consequence
  • Social Consequence
  • Systems Change

Almond, Karvonen Savannah, GA March 2006

recommendations for mps spelling and grammar assistance
Recommendations for MPS Spelling and Grammar Assistance

Session Participant Recommendations

  • -
  • -
  • -

Almond, Karvonen Savannah, GA March 2006

the panel recommendations
ACC: Assistance with spelling (needs to be discrete) ◊

◊ Provide assistance one-on-one without disturbing or cuing other students. (Spelling is NOT a part of the assessment.)

MOD: Assistance with grammar.

The Panel Recommendations

Almond, Karvonen Savannah, GA March 2006

overall the panel deliberations and decisions focused on
Overall the Panel Deliberations and Decisions focused on:
  • Affects on Individual Student
  • Maintaining the same content and difficulty for tests and items
  • Removing construct irrelevant variance
  • Instructing in “how to” through wording and footnotes in the tables

Almond, Karvonen Savannah, GA March 2006

slide84
School and District Accountability

Schools are effective or in need of improvement

High stakes rewards and sanctions will cause improved achievement

Individual Student Proficiency

Promotion to next grade

Graduation from high school

Certificate of Mastery

The Accommodations Panel tended to make their recommendations by considering how test results would affect the student.

Almond, Karvonen Savannah, GA March 2006

conclusion one
Conclusion One

The state had tables listing accommodations and an accommodations panel in place before the legal action, however, the process became more structured and assertive about increasing the number of allowable accommodations and more carefully prescriptive about how-to administer testing accommodations.

Almond, Karvonen Savannah, GA March 2006

conclusion two
Conclusion Two

Classifying adaptations as modifications triggered a demand for an alternate route or appeals process when decisions about certifying individual students were the stakes from the assessment results.

Almond, Karvonen Savannah, GA March 2006

conclusion three
Conclusion Three

A State, as the test sponsor, carries the major weight for establishing policy and procedures around test accommodations and is dependent on research that informs judgments about appropriate and allowable accommodations.

Almond, Karvonen Savannah, GA March 2006

conclusion four
Conclusion Four

Describing accommodations with both “is” and “is not” examples, that is, ways in which an accommodation can be provided that will and will not invalidate the assessment results is useful in communicating appropriate and allowable uses of testing accommodations.

Almond, Karvonen Savannah, GA March 2006

is and is not examples help communicate to proctors and testing coordinators
Accommodation Table (2002)

“Read Mathematics and science, (not reading/literature), items and response choices aloud to the student.”

Modifications Table (2002)

“Read the reading/literature passages, items, and distractors aloud to the student.”

“Is” and “Is not” Examples help communicate to proctors and testing coordinators

Almond, Karvonen Savannah, GA March 2006

we need judges because the laws are rules that don t fit the exceptions

we need judges because the laws are rules that don’t fit the exceptions

Grant Wiggins’ paraphrase of Aristotle

Almond, Karvonen Savannah, GA March 2006

aristotle

Law should be the final sovereign; and personal rule, whether it be exercised by a single person or a body of persons, should be sovereign in only those matters which law is unable, owing to the difficulty of framing general rules for all contingencies, to make an exact pronouncement.

- Aristotle

Almond, Karvonen Savannah, GA March 2006

ad