Preparing for the 2014 HSTW Assessment. Mike Ross Consultant, HSTW / MMGW SW Ohio Susanne Davis HSTW Assessment Coordinator, Ohio. What is the HSTW Assessment? Administration Nuts & Bolts Best Practices for Successful Assessments. Topics Covered. What is the HSTW Assessment?.
Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
Preparing for the2014HSTW Assessment Mike Ross Consultant, HSTW / MMGW SW Ohio Susanne Davis HSTW Assessment Coordinator, Ohio
What is the HSTW Assessment? Administration Nuts & Bolts Best Practices for Successful Assessments Topics Covered
What is the HSTW Assessment? • Required in even-numbered years • Subject tests in Reading, Mathematics and Science based on NAEP frameworks • Student Survey • Course-taking patterns • School and classroom experiences • Teacher Survey • Provides schools with comprehensive school-level data breaking out student achievement by experiences
Examples of How Schools Use the Results • Identify improvement needs • Serves as basis for Site Review Process (SRP) • Gain support for school improvement • Engage the entire faculty in school improvement • Set priorities and goals for school improvement • Improve classroom practices
New for 2014 • There will be no individual Student Reports!
Five Components • Reading test • Mathematics test • Science test • Student survey • Course-taking patterns • School and classroom experiences • Teacher survey (online)
Testing Times • Reading 75 min. • Mathematics 80 min. • Science 55 min. Total 3.5 hours • Student Survey Section 1 - staff person completes Sections 2 & 3 - untimed (about 35-45 min.)
Test Content • Used 2009 NAEP frameworks as a starting point • Modified to reflect college and career readiness goals • Reading – focus on informational texts • Mathematics – topics through Algebra II and some pre-calculus • Science – life, physical and earth science
Reading Test • 75 minutes • 80% informational texts; 20% literary nonfiction • Includes meaning vocabulary • Includes paired texts (to assess critical analysis) • Does not include literary fiction or poetry
Reading Test • Passage length: 500-1500 words • Cognitive targets • 15% locate/recall • 55% integrate/interpret • 30% critique/evaluate
Mathematics Test • 80 minutes • Scientific or graphing calculators permitted for one section • Type of calculator will neither advantage nor disadvantage student • Topics • Pre-algebra through Pre-calculus, including Algebra II
Mathematics Test • Content • 11% - Number Properties and Operations • 29% - Measurement/Geometry • 24% - Data Analysis, Statistics and Probability • 36% - Algebra
Mathematics Test • Cognitive Targets • 50% - Low Complexity recall routine procedures • 45% - Moderate Complexity make connections within mathematics or between mathematics and real world • 5% - High Complexity analyze a problem mathematically
Science Test • 55 minutes • Content • 43% - Life science • 42% - Physical science • 15% - Earth and space science
Science Test • Science Practices • 70% • Identifying science principles • Using science principles • 30% • Using scientific inquiry • Using technological design
Student Survey • Section 1– Course Experience • Staff member should complete this section for each student • Based on Course Matching and Transcript Analysis • Section 2 – School Experience • Students complete this section • School and classroom experiences • Based on HSTW key practices • Section 3 – General Information • Students complete this section
Teacher Survey Online survey! School and classroom experiences • School mission • High expectations and extra help • Guiding and supporting students • Curriculum content and engaging students in learning • Transitions • Leadership and professional growth
Results Reporting • School Report (June, 2014) PDF file on CD • HSTW Award of Educational Achievement (by May 2, 2014) • Student Reports - Discontinued
HSTW Assessment Report Mailed to schools June, 2014 Executive Summary -“3-minute report” • One page summary of performance and implementation Overview -“30-minute report” • Slightly longer summary Full report -“3-hour report” • Tables breaking out achievement by experiences • Teacher survey results
School Report • Executive Summary • One-page snapshot • Graphs and charts • Includes: • Implementation summary • Percentage of students meeting readiness goals: 250, 257, 258 • Percentage of students at each proficiency level • Blank quadrant for state data
School Report • The Overview • Approximately 15 pages • Graphs and charts • Includes: • Mean scores • Percent meeting readiness goals • Percent at each proficiency level • Performance on HSTW indices • More detailed implementation summary
School Reports • Full report • All those tables! • Student achievement broken out by survey questions • Teacher survey results
HSTW Award of Educational Achievement • Award certificates mailed to schools by May 2, 2014 • Awarded to students who: • Meet all three readiness goals (reading 250, math 257, science 258) • Complete at least 2 of 3 HSTW recommended curriculum goals • English/language arts, mathematics, science • Complete a concentration • Career/technical, mathematics/science, humanities
Award of Educational Achievement Opportunities for High Schools • Local community colleges • Local employers • Additional incentives for students
2014 Student Assessment and Teacher Survey Window January 24– February 14 (3 weeks) Plan ahead to get the best results!
Conducting the Assessment Process • Ordering • Preparing • Administering • Returning materials
Ordering the Assessment • Submit orders today if possible, but no later than Friday, Sept. 27. • Do NOT order online! Do NOT send order to SREB! The good news : There is nocost to your school! HSTW SWO pays for the entire Assessment!
Other Ordering Information • Unless there are special reasons, we encourage you to test no more than 60 students. • You will receive extra test sets. However, when submitting scan sheets to be scored, do not exceed the number ordered! • Schools testing more than 60 must pay for each additional student: $44 per student. • A cancellation fee may be charged if you cancel testing or miss the return deadline.
Administration Materials Onlinewww.sreb.org • Test Administration Guide • Sampling Instructions • Student Roster Form • Checklist • Test Description and Sample Question Booklet • Tasks and Timelines • Course Description Guide • Course Matching Chart
Preparing for the Assessment • Administration materials are now available online at: www.sreb.org • Booklets & scan sheets will arrive by January 17, 2014
Tasks & Timeline Per Regional Office instructions
Preparing for the Assessment Identify Students for the Assessment • Select one of two options: • RANDOM SAMPLE OF 60 SENIORS - OR - • ALL SENIORS (ENTIRE CLASS) • Select a true random sample by using the instructions provided. You must also select fivealternates at random.
Other Tips for Selecting Students • Only include currently enrolled seniors. • Only exclude students if their IEP exempts them from state assessments. • Same accommodations provided for state assessments should be provided for this assessment.
Other Tips for Selecting Students • Administrator Guide will contain suggested accommodations for English-language learners. • Contact ETS by October 25 to request large-print or audio CD versions . • Be reasonably assured that all students can complete ALL 4 components – reading, math, science, AND student survey.
Random Sampling Options • What is a “random sample”? • What is the easiest way to draw a random sample? • How to use random number tables
Random Sampling • Simple random sample - every time a selection is made, every student on the list has an equalchance of being the one selected. • Selection Bias – anything that contaminates or distorts the process.
What’s the easiest way to select a random sample? • Draw names from a hat, box, bowl, or drum! • Draw until you have selected 60 + 5 names!
Group ActivityRandom Sampling Procedures: Random Number Table • Develop a list of all eligible students (delete names of students who moved or have IEP’s stating they may not participate). • Number the remaining names of students on the list • Use the random number sheet to select students, starting with column one and working down. • The table provided works for classes of up to 350. For larger classes, obtain a larger random number table from SREB. • Add student names to the roster until you have the appropriate number.
CAREER CENTERS and HOME SCHOOLS: How to handle “double-selected” students • Career Center selects random sample. • Home School selects random sample. • Center and home school should compare lists to see if any students were “double-selected” (i.e., randomly selected by BOTH schools). • If a student is double-selected, test the student at the site where he/she takes senior academic courses. • Contact ETS (Lisa Rion – firstname.lastname@example.org 609-734-5646) to obtain a special student code. • Enter that special code on the double-selected student’s answer document. That student’s results will go into both reports.
Preparing for the Assessment Complete the Student Roster - VERY IMPORTANT!! • Fully complete form including assessment answer document ID numbers. • File with school testing records for five years! Also give one copy to principal. • You will need this fully completed roster form in Spring 2015 to conduct the follow-up survey of graduates • Also needed to identify students who fail to include their names (for student reports and awards)
Preparing for the Assessment Notification • Notify students, parents and teachers • Provide information on assessment and/or schedule informational meeting • Refer to your Board of Education policy where applicable Scheduling • Schedule time and place (SREB recommends administering over 2-3 days) • Include make-up sessions • Identify assistants (follow recommended ratios)
Preparing for the Assessment Course-Taking Preparation • Work with department chairs to complete course-matching chart (may update previous work) • Prepare student transcripts (including Fall grades and Spring schedule)
Other Tips for Course-Matching • Get each department head for English, math and science to help with this process. • Include any courses the seniors have taken from grades 9-12 within English, math, science or career-technical areas. • Using the course description guide, match each course from your school’s master schedule to the SREB course title on the course-matching chart. Example from the course-matching guide Regular, Advanced, or College Prep Algebra I: “Algebra I courses include the study of properties and operations of the real number system, evaluating rational algebraic expressions …”