Goal Overview of New State Test Support Structures and Test Administration • Participants will: • Become familiar with key responsibilities and roles of District/School Test Coordinators. • Understand changes in state testing processes and procedures. • Understand links to Oregon EdVantage™. • Identify future district/school training needs.
New District Support Structure • ESD’s are involved in training and providing state assessment support. • ODE will be providing information to ESD’s. • There will be no support staff dedicated to answering questions at ODE as in the past. • For the questions and training the state has been divided into three regions.
Region 1 Support Important numbers to remember: • Susan Halliday, LBL 541-812-2600 • Region 1 TESA Help Desk 800-970-TESA (8372) • Vantage Learning Help Desk 800-326-8328
What will your ESD partner do for you? • Remind you of the need for consistent statewide assessment administration. • Assist with TESA and paper/pencil test support. • Provide you additional paper/pencil testing materials in emergency situations. • Provide e-mail updates of current news and needs. • Provide a link between you and the ODE Office of Assessment and Information Services.
What will your ESD partner not do for you? • Take the place of your district or school testing coordinator. • Order your paper/pencil state test materials through the ODE site.
Administration Manual The single Administration Manual for the 2005 – 2006 school year will ONLY be found on the web at : http://www.ode.state.or.us/teachlearn/testing/manuals/
Administration Manual - Appendix The Appendix for the Administration Manual for the 2005 – 2006 school year will ONLY be found on the web at : http://www.ode.state.or.us/teachlearn/testing/manuals/
TESA User’s Guide TESA Users Guide 2005-06 Getting Started http://www.ode.state.or.us/search/ results/?id=164
Purposes of State Testing • Individual student learning. • Student performance by various groups for student learning purposes: • Cohort Data • Year-to-Year Data • Student performance by various groups for compliance purposes. LBL: Real Solutions for Education
Test Schedule • Located on ODE’s Webpage • http://www.ode.state.or.us/search/results/?id=169 • Highlights include: • Writing window: January 9 – February 24 • Social Sciences: Optional and Web only • Grade 3 Reading test – available in Spanish! • English Language Proficiency Assessment (ELPA) Test Window: April 4 – June 9
Knowledge and Skills Testing Schedule • TESA: September 27-May 19 • Availability of test based on SSID. • Paper/Pencil: March 13-April 21 • Assessment Collection for bar code schools sent at end of the testing window, based on tests coded. Go To: https://district.ode.state.or.us/apps/login/ • Bar Code Schools select: BCSpring2006MC
Grade LevelPerformance Standards Performance standards for math and reading knowledge and skills tests are based on content expectations consistent with previous benchmarks. Final performance standards were adopted by the State Board in October 2005.
Grade Level Performance Standards Reading and Literature: 4th Grade: 223 (Exceeds) 208 (Meets) 6th Grade: 233 (Exceeds) 219 (Meets) 7th Grade: 236 (Exceeds) 226 (Meets) Mathematics: 4th Grade: 223 (Exceeds) 208 (Meets) 6th Grade: 233 (Exceeds) 219 (Meets) 7th Grade: 236 (Exceeds) 226 (Meets)
Writing Testing Schedule • Grades 4, 7, & CIM students: • January 9 - February 24 • Or – • CIM students only: • April 14 - May 5. • Senior Writing Retests on TESA • Either October 31 – November 18 (Early Graduating Seniors Only) • Or April 14 to May 5
Approved Grade LevelPerformance Standards Writing Composite Scores: 7th Grade: 50 Exceeds 40 Meets 4th Grade: 40 Exceeds 32 Meets A score of three or higher in each of the Following traits: Ideas and Content Sentence Fluency Organization *Conventions * Conventions score doubled for 7th grade.
Writing Assessment Opportunities • Students at Grades 9 and 11 may test once during one of the two regular windows; Grade 10 students must test once during one of the two windows • Grade 9 students should only be tested if they are taking CIM-level classes and have produced work that shows they are capable of meeting CIM standards; • Only early-graduating seniors may participate in the October/November window; all other seniors may re-test during either or both of the two later windows.
“Practice Testing” ONLY those grade 9 students, receiving instruction at the CIM level, and showing CIM level proficiency, should test at the CIM level. Using the state test as a format for “practice testing” is out of compliance with state policy.
Accommodations Overview Accommodation—a change in how a test is presented to or responded to by a student. • Provides the student equal access and equal opportunity to demonstrate proficiency. • Considered “standard administration” and have the opportunity to “meet” or “exceed” the standard.
Modification Overview A Modification is a substantial change in the standard administration of the test. • Allows the student to engage productively in the assessment which includes changes in the instructional level, content, and performance criteria. • Under modified conditions scores are not considered for determining whether the student “meets” or “exceeds” the CIM benchmark. Scores obtained under modified conditions: • Are included in AYP (“does not meet”) • Do NOT count toward meeting performance standards for individual students • Are included in participation counts for AYP and Report Card
Other Assessments • Targeted Assessments • Either TESA or Paper Pencil • Side-by-Side • Spanish (Mathematics, Science, Social Sciences) • Russian (download only) • Mathematics grades 3, 4, 5, 6, 7, 8, & CIM • Science benchmarks 2, 3, & CIM • Career and Life Role Assessment System (CLRAS) • Extended Reading, Mathematics, Writing, and Science • Juried Assessments • Appeals • English Language Proficiency Assessment
Targeted Assessments A Targeted Assessment (formerly challenge) is from a different level than the grade of enrollment – and is consistent with the level of instruction. A student may target a lower grade level ONLY if doing so is described in the students’ IEP. If approved by the USDOE for 2005 – 2006, 2% of all assessments used to determine a district’s AYP may include these tests.
Side – by - Side The side-by-side assessments have the same items presented in both Spanish and English or in both Russian and English. Students benefiting from seeing the items in both languages can meet standards for both the CIM and for AYP. These are “standard administration” tests.
Extended Assessments/CLRAS What are they? • Alternatives to grade level assessments Who takes them? • Students with significant disabilities that are unable to take the general statewide assessment Who gives them? • Only “qualified” assessors should administer extended assessments For more information about Extended Assessments & CLRAS go to: http://www.ode.state.or.us/search/results/?id=178
Juried Assessments What is it? • Juried Assessments are an alternative path for students who can meet the CIM standards, but are unable to demonstrate mastery on one or more statewide assessments. Who uses the Juried Assessment process? • Any student who has mastered grade level content, but is unable to demonstrate the mastery on statewide assessments. • Students who have entered Oregon schools at grades 11 or 12, and choose not to take the statewide assessments. • “Eligible” students demonstrating reading and/or writing skills at the standard level, but in their native language.
Juried Assessments What is a Collection of Evidence? • A set of materials gathered to show that the student is performing at the standard level on the grade level content. • The collection must address the State Board-adopted content and performance standards How does the Juried Assessment Process begin? • Districts are required to notify parents of the opportunity for students to use the Juried Assessment Process Do JA’s “count” for AYP and/or CIM? • In general, yes! For detailed requirements and intent to submit deadlines go to: http://www.ode.state.or.us/search/results/?id=175
Writing Test Appeals • State scores must be in the appropriate range of composite scores. • CIM: 25 – 39 • 7th: 25 – 39 • 4th: 20 – 31 • Trained rater re-scores paper. If score appears higher, re-submit paper. • Attach original paper to ‘Appeals Form’. • Completely fill out form. • Local rater and district test coordinator must sign form. • ODE must receive by May 31, 2006. • Appealed scores always replace original score.
Test Security Security procedures are designed to protect the integrity and confidentiality of those test questions, prompts, and problems that are not released for public use; the security of these materials is necessary so that they can be used in later years to measure trends in performance. Test administration procedures are to ensure consistent statewide test administration. When this doesn’t happen: • Report to ODE Office of Assessment and Information Services • Determine an action plan • Conduct an investigation • Report the results of the investigation • If appropriate – contact TSPC re: possible loss of licensure A PowerPoint presentation about test security is available on the ODE website. Go to: http://www.ode.state.or.us/teachlearn/testing/admin/testsecurity.ppt
Test Security Q/A • To maintain secure and fair test administration: • Teachers and proctors must sign the Assurance of Test Securityform to communicate the importance of “standardized” administration of tests each year. These are to be kept at the district office for one year. • Concepts that had not been taught earlier may not be introduced to students prior to giving the test (don’t give test materials out too soon) • Proctors may not suggest which prompt a student ought to select for writing • Unused test materials, after each testing window, must be returned to the District Test Coordinator. Schools may not keep extra booklets or copy test forms for practice or future instructional use • Test forms have a “core” set of items that are the same year to year. This set links the current test to previous years’ tests and ensures the test is consistent and fair from year to year • Any teacher responsible for proctoring test administration for students “must be in the room monitoring this process and be available for students who may have operational questions.”
Online Ordering Tests available for order online • Writing Performance Assessments November 2 – November 23, 2005 February 10 – February 24, 2006 • Knowledge and Skills Tests January 10 – January 27, 2006 • Grade 3 Reading in Spanish January 10 – January 27, 2005 Lincoln County School District staff will work with schools to order appropriate numbers of paper/pencil test documents.
Student Staging (formerly PADM) Student Staging Overview: • The intent of the Student Staging web site is to make Assessment data more complete and accurate before state-generated reports are issued. • The Student Staging web site is preloaded with the demographic portion of student records. • Each Assessment Window is a different Student Staging database file. • One student record is displayed on the screen at a time. • Each student will have multiple records if s/he has taken more than one test. For instructions on accessing and using the Student Staging site go to: https://district.ode.state.or.us/docs/asmt/tststg/ StudentStagingUserGuide.pdf NOTE: TESA data updates student staging daily!
Work Sample Requirements • For writing, speaking, and mathematicsproblemsolving, students in grades 3, 4, 5, 6, 7 & 8 must complete one work sample scored with the state scoring guide. • Students at the CIM levelmust complete 2 work samples from different strands (SRCs 3, 4, or 5) in mathematics problem solving; and 3 samples in writing (one persuasive, one expository AND one imaginative or narrative). In speaking, CIM students must complete 3 samples (one persuasive, one informative, and one unrehearsed).
Work Sample Requirements • For scientific inquiry, students in grades 4 – 8 and at the CIM level must complete one work sample, scored in the required dimensions. • For social sciences analysis, students in grades 6 – 8 and at the CIM level may complete one work sample, scored in the required dimensions, beginning in 2005 – 06. The Overview of Oregon’s assessment system can be found at: http://www.ode.state.or.us/search/results/?id=239 The phase in schedule for science work samples can be found at: http://www.ode.state.or.us/search/results/?id=240 The phase in schedule for social science work samples can be found at: http://www.ode.state.or.us/teachlearn/subjects/socialscience/assessment/survey
English Language Proficiency Assessments (ELPA) • Districts have traditionally used one of four purchased assessments • As of 05-06, schools must use Oregon’s ELPA Assessment • There are two field test opportunities: fall and spring • The operational assessment will be April - June • Web-Based assessment, with K-12 being assessed • Questions: please contact Elaine Hultengren at 503.378.3600 ext. 2345 or email@example.com
Sample Tests • The Oregon Department of Education provides sample tests to demonstrate the types of questions students might encounter on the Oregon Statewide Assessment. • The sample questions were taken from previous years’ tests, are no longer secure and have been released for public use. Sample tests are available in: • Mathematics and Reading at grades 3, 4, 5, 6, 7, 8, and CIM • Science and Social Sciences at benchmarks 2, 3, and CIM • Extended Mathematics, Reading and Writing Sample tests can be found on TESA or on the ODE website at: http://www.ode.state.or.us/search/results/?id=226
Bar-Coding Districts • LBL will bar code ordered documents for the state writing test. • LBL will be prepared to begin coding state writing test answer documents well ahead of testing window. • School districts will be responsible for bar coding all knowledge and skills answer documents locally.
WebEx Training Available Go to http://techserv.lblesd.k12.or.us/software/secure/webex/index.php Select: “Other Student Applications” “OSAT” Three options are available for viewing: “OSAT Introduction” “OSAT Secondary School Student Assignments” “OSAT Printing”
Bar Code Availability • Bar coding options for the Writing Performance Test will be available in early December. This will allow you to select students well ahead of testing. • Please provide LBL with five working days of lead time for printing of answer documents.
Score Loading and Resolution • All state test scores will be loaded into the LBL Student Information System on a weekly basis. • For resolution of duplicates, please view option DO 155 or SO 135. • Changes in scores may only be made through the ODE site.
TESA for 2005-2006 A Look at What’s New
TESA Access • Secure Browser (Recommended) • TESA Web site