2012 core crt training for schools n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
2012 Core CRT Training for Schools PowerPoint Presentation
Download Presentation
2012 Core CRT Training for Schools

Loading in 2 Seconds...

play fullscreen
1 / 69

2012 Core CRT Training for Schools - PowerPoint PPT Presentation


  • 104 Views
  • Uploaded on

Hal Sanderson, PhD Institutional Research & Assessment March 2012. 2012 Core CRT Training for Schools. Student Achievement Plan for Canyons School District. All students will graduate from Canyons School District College- and Career Ready. ADVANCED ORGANIZER.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about '2012 Core CRT Training for Schools' - amelia


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
2012 core crt training for schools
Hal Sanderson, PhD
  • Institutional Research & Assessment
  • March 2012
2012 Core CRT Training for Schools
slide3
ADVANCED ORGANIZER

1.Key CRT Dates & Information2.Testing Ethics3. CRT Policy & Procedures4. Assessing Students with a Disability and ELL Students5. CRT Specifics for Each Content Area6.CRT Results Timeline

table of contents
Table of Contents
  • Key CRT Dates & Info . . . . . . . . . . . . . . . . . 6-8
  • Ethics & Test Security . . . . . . . . . . . . . . . . 9-18
  • CRT Policy & Procedures . . . . . . . . . . . . . . 19-23
  • Testing Special Education Students . . . . . . 24-50
  • Testing English Language Learners . . . . . . 51-56
  • CRT Specifics for Each Content Area. . . . . 57-68
    • Science. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
    • Math . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61-66
    • Language Arts. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
  • CRT Results Timeline . . . . . . . . . . . . . . . . 69-70
number of sessions per crt
Number of Sessions Per CRT
  • Science CRTs
    • Elementary – 2 Sessions
    • Secondary – 2 Sessions
  • Math CRTs
    • Elementary – 2 Sessions
    • Secondary – 2 Sessions
  • English Lang. Arts CRT
    • Elementary – 2 Sessions
    • Secondary – 3 Sessions
  • Each session lasts approximately 45 minutes. However, students should be allowed additional time if needed. It is not a timed test.
non participation and ayp
Non-Participation and AYP
    • What is non-participation?
  • Simply put, it means the student did not take ANY PART of the exam.
  • What part of non-participation affects AYP participation?
  • The only non-participation
  • code that counts in AYP is
  • 1 – Absent.
    • Non-Participation Codes
    • (1 ) Absent- unable to make up test
    • (2 ) Excused- Medical emergency
    • (3 ) Unknown Student
    • (4 ) Officially Withdrawn from class/school
    • (5 ) ELL -1st year in U.S. before April 15
    • (6 ) ELL -ELL 1st year in U.S. April 15 or later
    • (7 ) Private or Home school Non Participation
    • (8 ) RT (refused to test)
testing ethics and test security
Canyons School District
  • Institutional Research & Assessment
  • Dr. Hal Sanderson
Testing Ethics and Test Security
principal testing ethics procedures
PRINCIPAL TESTING ETHICS PROCEDURES
  • Principals are required to provide training for standard test administration and testing ethics procedures to all educators involved in testing.
  • The following activities must occur before April 23, 2012
    • Provide testing ethics and test administration training by going through the 2012 PDF presentation produced by USOE titled “Standard TestAdministration Testing Ethics”.
    • Make sure you have on file a 2011-2012 signed form from each educator involved in testing.
    • Fill out, sign, and return the accompanying “Principal’s Testing ProcedureChecklist” form by FAX (801-826-5065) or district mail to Hal Sanderson, Research and Assessment, on or before Friday, June 8th, 2012.
appropriate teaching practices
Appropriate Teaching Practices
  • Ethical testing begins with ethical teaching
    • Ensure that students are enrolled in the appropriate course so that they receive appropriate instruction.
    • Provide instruction on the entire curriculum for a course.
    • Provide accommodations during instruction to eligible students.
appropriate testing practices
Appropriate Testing Practices
  • In preparation for testing:
    • Appropriate environment is set.
    • Personnel who will administer tests must be trained and employed by the district.
    • All information in the Test Administration Manual (TAM) is reviewed.
    • Test material is secure at all time.
appropriate testing practices1
Appropriate Testing Practices
  • During testing:
    • All students who are eligible for testing are tested.
    • All students are given the correct test.
    • Information from the TAM is followed exactly.
    • Accommodations are provided to eligible students.
  • Appropriate Proctoring Includes:
    • The importance of the test, test participation.
    • The good faith efforts of all students is not undermined!
unethical practices
Unethical Practices
  • It is unethical for educators to jeopardize the integrity of an assessment or the validity of student responses.
  • Some examples:
  • Providing students with questions from the test to review before taking the test.
  • Rewording or clarifying.
  • Allowing students to use unauthorized resources to find answers, including having materials on wall which provide answers to questions on the test.
  • Read the Ethics Policy Manual for a complete list of unethical practices and for more specific information on ethics.
is it appropriate
Is It Appropriate?
  • ASK YOURSELF: If my student is to get a valid and reliable score that accurately portrays his/her ability to understand the material, will this action…
  • Allow the student to answer a question that does not reflect his/her knowledge?
  • If the action did not occur, would the student response be different?
  • Would my practice change if I were being monitored??
potential ethics violations
Potential Ethics Violations
  • Ethical violations are to be reported to the supervisor of the person who may be investigated, the school administrator.
  • Protocol
    • Follow district policies and procedures.
    • Canyons School District’s procedure is to follow the steps described in the “Investigation of Violation” described in USOE’s ethics training.
    • An initial investigation will be conducted at the school level and needs to be well documented (interviews, written statements, etc).
    • The research & assessment director along with the deputy superintendent will review the initial investigation and determine findings and possible next steps.
ethics violations
Ethics Violations
  • Protocol (Continued)
    • If the violation is of sufficient concern, the incident may also be forwarded to the Utah Professional Practices Advisory Commission (UPPAC) for review.
    • If inappropriate practices are found, teachers may receive further training or a reprimand, be subject to disciplinary action, be terminated, and/or lose their Utah teaching license (see 53A-1-608; R277-473-9).
standard testing administration testing ethics
Standard Testing Administration & Testing Ethics
  • Know the Utah State Law & Utah State Board Rule
  • http://le.utah.gov/~code/TITLE53A/53A01.htm
  • http://www.rules.utah.gov/publicat/code/r277/r277.htm
  • Demonstrate ethical behavior
  • For questions
    • Review testing ethics frequently asked questions at http://www.schools.utah.gov/assessment/documents/AAEthicsPolicyFAQ.doc
    • Contact LEA assessment director
crt policy and procedures
Canyons School District
  • Institutional Research & Assessment
  • Dr. Hal Sanderson
  • March 2012
CRT Policy and Procedures
policy and rules
Policy and Rules
  • See Criterion-Referenced Tests (CRT) Policy for complete details (Blue Sheet)
  • CRT Retakes
      • Students are not required to take the same CRT more than once. If a student takes two courses, two separate years (Chemistry, AP Chemistry) it is a local decision if the student is to retake the chemistry CRT.
  • The CRT is a grade/course specific test. All enrolled students must take the corresponding CRT Test.
policy and rules1
Policy and Rules
  • CRTs, AYP and Retakes
    • For the purposes of U-PASS and NCLB, the first time a student takes a course for which there is an associated CRT, the student is required to take that CRT. The score/proficiency determination from CRTs will be used. This policy applies to all grades/courses assessed by CRTs.
    • Exception:The AYP math calculation for high schools will be determined by calculating the percent of 10th graders who score proficient on the Algebra 1 CRT in the 10th grade year OR prior years.
home and private school
Home and Private School
  • See Core CRTTesting Procedures for Home and Private School Students for complete details (Purple Sheet)
  • Private School Students MAY participate in CRT administration
    • Payment in advance for assessment costs to USOE.
    • Payment in advance for administration costs (LEA).
    • Participation under the supervision of LEA.
    • Board Rule R277-604.
home and private school1
Home and Private School
  • Home School Students SHALL be allowed to participate in CRT administration
    • May participate in CRTs only at the boundary school of the home school student’s parent/legal guardian.
    • For secondary students: Must be enrolled in at least one Core course in public school.
    • Must occur during the school’s scheduled CRT testing.
    • Costs the same as public students (no cost to the student).
    • Participation under the supervision of LEA.
    • Bureau of Indian Affair (BIA) students
    • -No cost to student.
assessment participation accommodation policy
Assessment Participation & Accommodation Policy
  • The key policy and procedures guide for IEP teams in selecting appropriate accommodations is Utah Assessment Participation and Accommodation Policy.
  • Located at: http://www.schools.utah.gov/assessment/documents/Special_Needs_Accommodations_Policy.pdf
  • This document has many important best practices for IEP teams and examining student accommodations.
accommodations overview
Accommodations - Overview
  • Accommodations are practices and procedures in the areas of presentation, response, setting, and timing/scheduling that provide equitable access during instruction and assessments for students with disabilities.
  • Accommodations are intended to reduce or even eliminate the effects of a student’s disability; they do not reduce learning expectations.
accommodations overview1
Accommodations - Overview
  • The accommodations provided to a student must be the same for classroom instruction, classroom assessments, and district and state assessments.
  • Research indicates that more is not necessarily better, and that providing students with accommodations that are not truly needed may have a negative impact on performance.
  • Recent and ongoing advances in assistive technologies are changing the ways in which many accommodations may be provided.
accommodations during testing
Accommodations During Testing
  • Planning for Test Day. The logistics of providing the actual accommodations must be mapped out prior to testing!
  • Be certain the test administrator knows what accommodations each student will be using and how to administer them properly.
  • Have accommodations entered into the test system prior to testing.
  • It is important to monitor accommodations during testing to ensure they are delivered appropriately and technology is working as it should.
all students must be included
All Students MUST be included!

All students with disabilities are required to participate in the statewide assessment program. During the meeting in which the individualized education program (IEP) is developed, the IEP team must determine how the student will participate in U-PASS. Three options are available for students with an IEP:

  • Participation under standard test administration conditions.
  • Participation with an accommodated test administration.
  • Participation through administration of Utah’s Alternate Assessment (UAA). Data entered online by each school.
utah alternate assessment uaa
Utah Alternate Assessment (UAA)
  • A student takes all subjects in either the UAA or the CRT. All or nothing!
  • The teacher should fill in ONLY 1 TASK on each of the three UAA content areas of English Language Arts, Math, and Science.
    • 1 English task
    • 1 Math task
    • 1 Science task
  • No Accommodations are marked because the UAA is individually accommodated.
  • UAA Testing will be entered into an online system starting this Spring!
recording of uaa results new
Recording of UAA Results - New
  • Please refer to the directions provided by the Utah State Office of Education.
  • The research and assessment office has verified with your school what students will be administered UAA.
  • We are suggesting that one special ed. teacher gather and enter UAA score information into the online system.
  • We want the UAA roster completed and returned to Research & Assessment at the end of the CRT tests.
  • We want this paper backup to verify the online information is accurate and complete.
  • Questions? Call Cindy Perry 826-5029.
type of accommodations an overview

Type of Accommodations: An Overview

NOTE: The key policy and procedures guide for IEP teams in selecting appropriate accommodations is Utah Assessment Participation and Accommodation Policy.

presentation accommodations
Presentation Accommodations
  • Directions Read Aloud in English, Signed and Screen Reader.
  • Questions Read Aloud in English and Screen Reader.
  • Provided Text-to-Speech tool (preferred).
    • Must use accommodation code #5, Screen Reader, prior to student logging into each CBT.
    • Students cannot control reader speed.
    • Students can test in regular setting with headphones.
read aloud
Read-Aloud
  • Three options
    • Use the CBT system’s Text-to Speech tool.
    • Access the on-screen version of the test via the proctor test workstation (PTW)
    • Teacher reads aloud from either PBT or CBT
screen reader
SCREEN READER
  • http://stream.schools.utah.gov/videoarchive/assessment/screenreader.swf
screen reader read aloud
Screen Reader/Read-Aloud
  • Screen reader should be used to provide this accommodation for all CRTs
  • Students may have a human read-aloud, but is not the preferred option
  • 3rd party assistive technology products are no longer supported.
  • Students using the screen reader accommodation with headsets may be assessed with their peers.
  • They may no longer need to be assessed individually or in a small group.
read aloud from proctor workstation
Read Aloud from Proctor Workstation
  • To ensure all students in a school receive the same form the accommodation must be marked prior to the student logging into the test if a student receives:
    • Directions and/or questions read aloud,
    • Directions and/or questions signed, or
    • Directions and/or questions for oral translation.
presentation accommodations1
Presentation Accommodations
  • Oral Translations
    • CRT Math and Science may be orally translated.
    • CRT Language Arts passages, questions, and options may NOT be translated (incl. ASL).
    • Language Arts may be read aloud in English only. The screen reader (text-to-speech) is the preferred accommodation for Language Arts CRTs.
large print
Large Print
  • Large Print. Large print editions of tests and instructional materials are required for some students with visual impairments. It is recommended that regular print materials be manipulated to reformat test items and enlarge or change the font as needed.
  • Canyons SD recommends that large print is provided via the computer instead of paper-based, since the text can be enlarged via computer-based administration!
  • CRT: Student responses must be submitted via the CBT system if the school is administering that assessment via computer.
large print on the computer
Large Print on the Computer
  • If large font tool on CBT system is not adequate-
    • Move student closer to monitor.
    • Provide larger monitor to enlarge font size.
    • An on-screen magnification software is available for purchase.
braille
Braille
  • Braille assessments are only available in paper format. Note: No answer documents are provided for CRTs that are 100% CBT.
  • Students can input their responses via the computer.
  • If using CBT system to enter answers must mark read-aloud accommodation (#5) to ensure that questions will match the Braille form.
presentation acco mmodations
Presentation Accommodations
  • Sign directions and questions.
  • Oral Translations of directions and questions for English language learners.
  • Magnification devices.
  • Audio amplification devices.
  • Visual cues-hearing impaired.
  • Talking materials.
  • Translated formulas (ELL).
  • Not allowed: Bilingual word lists (ELL).
calculation devices
Calculation Devices
  • Elementary CRT Math Non-calculator Section: Any calculator that is equivalent to the calculator used in instruction may be used on the CRT (non- calculator section) as an accommodation.
  • Students must bring this calculator to computer- based testing for use on non-calculator sections of the test.
  • Elementary and Secondary CRT Math Calculator Allowed Sections: Any calculator that is equivalent to the calculator used in instruction may be used for all students.
graphic organizers visual organizers
Graphic Organizers & Visual Organizers
  • These accommodations only provide a student with a blank sheet of paper or blank graph paper for assessment.
response accommodations
Response Accommodations
  • Word Processor-not needed on CRT/CBT
  • Write in test booklet.
  • Speech-to-text conversion.
  • Brailler.
  • Recording device.
setting accommodations
Setting Accommodations
  • Reduce Distractions to Student
    • Change in location.
  • Reduce distractions to Others
    • Change in location
      • Students who need a reader or scribe.
      • Students who read or think out loud.
      • Students who make noises.
  • Students using the screen reader accommodation with headsets may be assessed with their peers. They may no longer need to be assessed individually or in a small group
timing scheduling accommodations
Timing/Scheduling Accommodations
  • Extended Time
    • Common--often time and one half.
    • Reader or scribe- often double time.
    • CRT- recommended that sections be completed on same day as started.
    • If necessary, additional completion session should be scheduled within the testing window.
timing scheduling accommodations1
Timing/Scheduling Accommodations
  • Multiple Breaks
    • Supervision required for students.
    • If student has multiple breaks or needs to stop testing before the section is completed, make sure the student does not have access to item previously completed before break, etc.
  • Schedule Change
    • Best time of day & multiple days.
accommodated or modified
Accommodated or Modified?
  • Accommodations do NOT alter the test construct (what is meant to be measured).
  • Modifications DO alter what is meant to be tested and, therefore, they compromise test validity and reliability. An example of a modification is off-grade level testing.
  • Do not modify a CRT test.
testing english language learners ell
Canyons School District
  • AnalisCarratini-Ruiz & Hal Sanderson
  • March 2012
Testing English Language Learners (ELL)
assessment accommodations for english language learners
Assessment Accommodations for English Language Learners
  • Federal and State laws require the participation of English Language Learners in standards-based instruction and assessment programs.
  • Purpose:
    • Assessment accommodations are applied to more accurately measure the knowledge and skills of ELL students and to diminish the effects of language differences.
    • Decisions about accommodations should be made by the ELL team. These decisions must be reviewed annually.
ell testing decision tree
ELL Testing Decision Tree

USOE Special Needs Accommodation Policy

August 2011

ell students crt participation first year in u s
ELL Students- CRT Participation-First Year in U.S.
  • less than one year in a U.S. school
  • enrolled AFTER April 15, 2011,
  • mark this code.
  • less than one year in a U.S. school
  • enrolled BEFORE April 15, 2011,
  • mark this code.
assessment participation accommodation policy1
Assessment Participation & Accommodation Policy
  • Designed to be an on-line document
  • Located at: http://www.schools.utah.gov/assessment/documents/Special_Needs_Accommodations_Policy.pdf
  • A school copy is provided in your folder.
crt specifics for each content area
CRT Specifics for Each Content Area

All this information is in the Test Admin. Manual (TAM)

test administration manual tam
Test Administration Manual (TAM)

Core CRT administration requires two TAMs

1. TAM Policies and Procedures

  • This is a general information document for ALL CBT Administrations

2. Single TAM per content area

  • ELA 3, Elementary ELA 4-6, Secondary ELA, Elementary Math, Secondary Math, Elementary Science, Secondary Science
science crt specifics
Science CRT Specifics
  • Information below is appropriate for all (elementary and secondary) Science CRTs
  • Use of five-function calculator – Allowed on all science CRTs – Provided via computer
  • Chemistry and Physics have reference sheets
    • – will be available onscreen
    • are available currently at the USOE Science CRT webpage
secondary science crt specifics
Secondary Science CRT Specifics
  • Science 7, Science 8, Biology
  • One Technology-enhanced item (TEI) will appear for each student
  • These items are now operational items (they count towards a student’s score)
math crt specifics
Math CRT Specifics
  • Math CRT Specifics

• Administer the Correct Test - Math 3, 4, 5 is grade specific.

  • Math 6 –

• Existing Core or Common Core

math crt specifics1
Math CRT Specifics
  • Math CRT Specifics Administer the Correct Test (continued)
  • Math in grades 7-12 – course specific
  • Administer the CRT for the course the student is enrolled in
  • This includes Math 8 Common Core which has a CRT
  • Other Common Core courses do not have an associated CRT
  • All students must have an Algebra 1 by end of 10th grade (AYP requirement)
math crt specifics2
Math CRT Specifics
  • Math CRT Specifics - Reference Sheets
    • Available onscreen
    • are available currently at the Math CRT webpage
  • Which tests?
    • Elementary grades 4, 5, 6
    • All secondary courses
    • Not in Math 3
math crt specifics3
Math CRT Specifics
  • Calculator Usage: Which tests?
  • – Elementary (3-6):
    • Allowed on Section 2 ONLY
  • – Secondary:
    • Allowed on ALL Secondary Math CRTs on ALL sections
math crt specifics4
Math CRT Specifics
  • Calculator Usage: What calculator?
  • Elementary(3-6):
    • Students should bring or have made available to them a calculator for section 2 of the test. They may use the calculator that they have used during instruction.
    • A five function calculator is available onscreen for allowed sections for CBT
    • For grades 5 and 6, students may have a scientific calculator available for use
    • CBT does NOT provide an onscreen scientific calculator
math crt specifics5
Math CRT Specifics
  • Calculator Usage: What calculator?
  • Secondary
    • A five function calculator is available onscreen for allowed sections for CBT
    • No trig. Functions
  • Students may use ANY calculator similar to the one used during course instruction.
    • They may use their own or one provided by the testing proctor
    • There are NO memory clearing requirements.
elementary lang arts crt specifics
Elementary Lang Arts CRT Specifics
  • No extra materials are necessary
  • Only ELA 3 requires administrator read scripting beyond the general directions
remember
Remember…
  • CRTs are UNTIMED tests
    • However, most students can complete a test section in the normal class period.
    • Allow each student to complete each section.
    • Make up any incomplete sections.
    • Don’t test multiple sections at the same time unless in a make-up session.
crt results
Canyons School District
  • Institutional Research & Assessment
  • Dr. Hal Sanderson
  • March 2012
CRT Results
results are coming faster
Results are coming faster!
  • The following tests will have raw score and final proficiency scores within 24 hours of submitting all tests for scoring!
    • Elementary Language Arts
    • Elementary Science
    • Secondary Language Arts
    • Secondary Science
    • Secondary Math
  • Due to alignment to the new Common Core, Elementary Math will take the usual amount of time for scoring.
contacts research assessment
Contacts- Research & Assessment
  • Dr. Hal Sanderson, Director of Institutional Research & Assessment
  • Dr. Jami-Jon Pearson, Assessment Coordinator ,801-826-5134
  • Cindy Perry, Test Data & Logistics Manager, 801-826-5029
  • MariLee Ostrowski, Administrative Assistant, 801-826-5091