District Assessment Coordinator Training for the COE 2014-15

1. District Assessment Coordinator Training for the COE2014-15 Collection of Evidence Office of Superintendent of Public Instruction

2. Topics • What’s new? • Calendar for 2014-15 • DAC responsibilities and preparation • Policies • Test Security • Test Irregularities • Tools and manipulatives • Principal, teacher and student responsibilities • For Assistance

3. COE Teacher Training Similar to the HSPE and EOC proctor training, the COE training is designed to provide the critical information to appropriately implement the COE assessment. It is expected that all COE teachers participate in this training prior to implementing the COE assessment. The District Assessment Coordinator should communicate this expectation to COE educators.

4. Teacher Training Teachers are expected to: • Utilize the COE Teacher Training Checklist to indicate the completion date of the training items below • Read the Guidelines for the COE • Register for and participate in a COE webinar • Read, sign and date the Test Security Acknowledgement • Deliver the checklist and Acknowledgement Form to their Building Administrator (to be retained in the educators file)

5. What’s New Students may access the COE after one attempt at the HSPE or EOC. Augmentation is no longer available - subsequent COEs are available to any student who did not meet standard with their full COE. DAC online page to: • assist with tracking student eligibility • approve subsequent submissions • process test irregularities Teacher online page to: • Add/remove students to groups • Activate and move students within the system Transition to COE based on Common Core standards A “Basic” cut-score is available for use by students receiving special education services, if determined appropriate by the IEP team

6. COE calendar for 2014-15 *COE augmentation is no longer available. A subsequent COE is available to any student who did not meet standard with their original collection. Additional information can be found at: http://www.coe.k12.wa.us/Page/124

7. Post scoring WAMS, Score and Stipend reports

8. DAC Responsibilities Oversight of COE implementation in the district to include: Initiate teacher training Student access to COE Data tracking of student participation Approval of subsequent COEs Test irregularity investigations Test security investigations ‘Submitting your COE’ process Shipping process for math COEs Main OSPI COE contact

9. DAC-Preparation for COE • Read the COE Guidelines and Policies • Review the ‘Admin information’ page on the COE website • Know where the COE forms can be found • Identify COE educators for each high school in the district • Understand what the teachers need to learn and know about the COE • provide the necessary support and learning time required • Review the COE teacher training packet • Ask each educator to attend the COE training prior to working with students on the assessment • Track teacher attendance for training

10. DAC - Student Data • Ensure that student data in your Student Information System is up to date • Identify students that are eligible for the COE • Inform school of COE students • Keep track of COE students’: • Progress • Submissions • Score results • Manage eligibility issues well ahead of the submission dates • Process forms for Direct Access • Log into COE system and approve ‘subsequent’ submissions for students

11. EDS Log-in District and School Personnel must have access to eCOE roles in EDS (provided by the District Security Manager). Roles for eCOE: • DAC must have eCOEDistrictAssessmentCoordinator and eCOEDistrictAdmin • Principal must have eCOESchoolPrincipal • Teacher roles: • eCOESchoolAdvisorReading • eCOESchoolAdvisorWriting • eCOESchoolAdvisorBiology • eCOESchoolAdvisorMath

12. DAC-Submission confirmation Make sure all students that should be submitting a COE, actually have the COE submitted. • Log in to eCOE through EDS. • Click the “Status Summary” link on the top left. • This screen will show you the current status of every student who is enrolled in COE. • If a student submission is complete, the status will be “Submitted to OSPI” • If the status is “Teacher signature” or “Principal Signature” then the work has not been submitted. • All approvals must be completed by 5:00 on the submission deadline date. • To download the information to a spreadsheet, click the “Export to Excel” button in the top right.

13. Policies • COE policies are revised each year • COE policies can be found at: http://www.coe.k12.wa.us/Page/124 • We will communicate revised or new policies through the Washington Assessment Weekly and as a COE e-alert

14. Who can submit a COE ? • Any student who has attempted the state test one time and not met standard • Transfer students who are eligible through the Direct Access protocols • Students who have been authorized to complete a subsequent COE • Students in the graduation cohort of 2015 or earlier (winter submission is only for these students)

15. Subsequent COE policy Students have an opportunity to submit a subsequent COE after not meeting standard on a previous one. A subsequent COE must follow similar protocols for submission as those for original COEs in terms of using inclusion bank tasks, meeting sufficiency requirements and submitting the collection during the submission windows published by the state. Subsequent COEs do not qualify for the stipend and incur a $200 scoring fee. District Assessment Coordinators must authorize the development of a subsequent COE. Instructions can be found at: http://www.coe.k12.wa.us/domain/53

16. Standard Subsequent COE If a student’s original COE score is above 50% of the proficient cut-score the student is limited to a subsequent COE with exactly four new work samples. It is recommended that at least one of the four new samples be completed as an on-demand task. If the decision is not to include a new on-demand task, the student’s previous on-demand tasks will be included in deriving a new total score. Sufficiency requirements are outlined as follows: Sufficiency requirements for Expanded Subsequent COE submission: • Biology and Mathematics: Examples of every strand must be represented in the collection. • Reading: Two literary work samples and two informational (including functional text and CTE options) work samples required. • Writing: Two expository work samples and two persuasive work samples required.

17. Expanded Subsequent COE An expanded subsequent COE may be submitted if the student’s full collection has a score that is less than or equal to 50% of the proficient cut-score for the content area (e.g., Year 1 Math proficient cut-score is 24 and the student’s submission is scored 12 or less). An expanded subsequent collection contains 5 or 6 new work samples with two on-demand tasks required. Sufficiency requirements for Expanded Subsequent COE submission: • Biology and Mathematics: Examples of every strand must be represented in the collection. • Reading: At least two literary work samples and two informational (including functional text and CTE options) work samples required. At least 2 on-demand work samples are required with at least one literary and at least one informational included. • Writing: At least two expository work samples and two persuasive work samples required. At least two on-demand work samples are required with at least one expository and one persuasive sample included.

18. Authorizing a Subsequent COE Log in to eCOE through EDS Choose any school in your district from the list Choose “Subsequent Submission” from the bottom left A list of students who are eligible to submit a subsequent COE will appear Click the check box for students who are authorized to submit a COE, then click the Approve button Teachers will now have access to add those students to a group.

19. Students with invalidated COEs • Students with invalidated collections are not eligible to submit a subsequent COE. • These students must compile a full collection consisting of entirely new tasks • 6 – 8 samples • Minimum of two on-demand • Full strand coverage

20. COE and Basic-Level 2 The L2 cut-score for COEs and the ability of students to meet standard at a ‘Basic’ level in a given subject in accordance with IEPs are effective now. “Retro Basic” updates will be available to any students still enrolled in the K-12 system, per concurrence of the IEP team.

21. To submit a Retro Basic Request for Level 2 COE As is the case with all other assessments, Retro Basic forms are to be submitted by District Assessment Coordinators or their designees, following this process: • The Retro Basic Request form can be found at this link: http://www.k12.wa.us/TestAdministration/Data/default.aspx • Fax the form to OSPI at: 360-725-6509

22. Content specific submission requirements Mathematics: Eligible to Compile: Students are eligible to work on a mathematics year 1 COE if they have taken or are currently enrolled in a high school algebra 1 or integrated mathematics course. Students are eligible to work on a mathematics year 2 COE if they have taken or are currently enrolled in a high school geometry or integrated 2 mathematics course. Eligible to Submit: A student must have attempted and not met standard on a mathematics EOC one time before being eligible to submit a COE.

23. Content specific submission requirements continued Reading/Writing: Eligible to Compile: Any high school student who has taken at least two years of high school English. Eligible to Submit: A student must have attempted and not met standard on the reading and/or writing HSPE one time before being eligible to submit a COE. Biology: Eligible to Compile: Students are eligible to work on a biology COE if they have taken or are currently enrolled in a high school biology course.Eligible to Submit : A student must have attempted and not met standard on a biology EOC one time prior to being able to submit a COE.

24. Test Security • State Laws Governing Security All test content including, but not limited to, the COE inclusion bank of tasks and completed student work are confidential and must not be reviewed except to the extent required as part of administration procedures. • Secure Testing Environment-Who and what can be in the testing room • Trained educators only, not volunteers • No media (i.e., journalists/press) • Only approved electronic devices • No internet access or outside sources are allowed when student’s are working on actual COE responses

25. Test Irregularities An irregularity is evidence discovered in a student’s COE during scoring that is problematic for one of two different reasons: a troubled child alert or evidence of inauthentic student work. What happens? Troubled child alert – district is informed of the alert to allow check-in on the student’s safety/well-being Evidence of inauthentic student work - Student scores are held. Districts are notified and required to conduct an investigation and report back to OSPI. • The state makes final determination to release or invalidate scores, based on available information from the investigation. • No district response to the irregularity notification defaults to score invalidation. Please review the test irregularity section of the Guidelines found at: http://www.coe.k12.wa.us/Page/130

26. Other Test Irregularities Breach in test materials security • Improper use of assessment materials by educators. • Inclusion bank tasks, passages, scenarios, and prompts are not to be used for instruction or curriculum. • COE assessment materials are not to be used, in part or entirety, as a template or sample for instruction; COE materials are for the assessment only. • Duplication of the COE materials for any purpose other than providing students with the materials for responding to assigned tasks is not allowed. • The only acceptable printing of the COE materials are the tasks that will be submitted in the final collection (where print format is the method of submission). Tasks, passages, scenarios, and prompts may be printed one per student for the sole purpose of student completion of assigned tasks making up the student’s collection. • All assessment materials must be secured between sessions, with access by COE educators, only.

27. Tools and Manipulatives There are general guidelines for the appropriate tools and manipulatives supporting assessments in mathematics. Policy specific to the COE is covered in content area information. For general policy and guidelines for test administration refer to the ACM which can be found at: http://www.k12.wa.us/TestAdministration/Instructions/default.aspx

28. Principal – Responsibilities • Know appropriate implementation of the COE • Keep a record of COE building implementation • Who are the teachers • Who are the students • Monitor overall COE pass rate for your school • Ensure all COE educators have been trained per state guidelines • Provide support and time for teachers to learn how to implement the COE • Read guidelines • Learn how to manage the electronic system • Prepare instructional materials • Organize classroom preparation and schedule computer time

29. Principal – Tracking students Track all COE students’ status • Are they eligible to submit • Are they compiling a COE • Did they submit as planned • Principals MUST click each COE – this is the actual electronic submission • Be sure to check that the COE actually was submitted • What were the student’s results • Did they meet standard or do they need to compile a subsequent COE

30. Principal Preparation • Review the COE website • Know the COE policies • Create a system to track COE building level implementation

31. Teacher Responsibilities • Participate in COE training • Know appropriate implementation of the COE • Develop plan for instructional intervention • Provide appropriate instruction to students • Communicate to principal if students are compiling a COE but NOT eligible to submit • Follow test security protocols • Submit the COE on time • Mail paper-based portion of math COE and Biology diagrams • Inform the principal when electronic COE is ready to be submitted (needs to be completed by principal) - reading, writing, math and biology

32. Adding students to groups • Students who are compiling a COE for a full submission can be added to a group regardless of eligibility • Students may only submit when their eligibility code is “Y” and the submission window is open • Students who are compiling a subsequent COE must be authorized by the district before they can be added to a group • Students who are compiling a subsequent COE need to be placed in a “Subsequent” group

33. Adding students to groups continued • Three columns relate to eligibility on the add/remove students page:Full Elg? • Possible codes: Y, N, A, W • Y = Yes, student is eligible • N = No, student is not eligible • A = Already met standard (not eligible to submit) • W = Not eligible for winter submission because not in the graduation cohort group of 2015 or earlier; will be eligible for spring submission Subs Elg? • Possible codes: Y, N • Y = Yes, student may submit a subsequent COE with authorization • N = Not eligible for subsequent COE Subs Auth? • Possible codes: Y, N • Y = Yes, student has been authorized and can be added to a group • N = No, student is not authorized. Contact your district assessment coordinator.

34. Updating student records • Teachers, principals and DACs are now able to move students into their school and/or activate students that are in an inactive status • On the Add/Remove students screen, look for the Search by SSID box.

35. Updating student records continued • Enter the SSID number then click Search. • A dialog box pops up with the student information. • If the student is listed in the wrong school, change the district and/or school with the drop-down menus. • Click “Activate” to save the changes or to update the student’s record so he or she may submit.

36. Teacher Preparation Know: • the guidelines and policies • how to use the COE online system • Obtain login from your District Security Manager • how to set-up your classroom • test security procedures Prepare for COE students by: • developing plan for instructional intervention • scheduling computer lab time for COE students

37. Student Responsibilities • Attend COE class or scheduled COE development time • Complete each task - MUST be all individual student work • Check all completed work • Do not use any outside sources • Review collection prior to submitting it to teacher • Submit the COE to the teacher

38. Student preparation – reading and writing • All students compiling a reading or writing COE should watch the video clip on plagiarism • sign the attached form attesting that they understand: (1) the consequences of plagiarism, and (2) how to appropriately show text-based evidence. • The signed forms are to be retained by the school. • Found at: http://www.coe.k12.wa.us/Page/283

39. COE e-alerts To sign up to receive e-alerts: Contact COE Technical Support at-coe@esd113.org and request to be added to the mailing list

40. For Assistance COE OSPI information, coe@k12.wa.us Lesley Klenk, ELA COE Specialistlesley.klenk@k12.wa.us(360) 725-6330 Kim Andersen, Mathematics COE Specialistkim.andersen@k12.wa.us (360) 725-6237 Scott Killough, Science COE Specialistscott.killough@k12.wa.us (360) 725-6316 Amanda Mount, COE Operations Specialistamanda.mount@k12.wa.us(360) 725-6037 COE ESD 113 Technical Support Monday – Friday 8am to 5pm coe@esd113.wa.us (360) 464-6708