130 likes | 262 Views
Designing and Implementing Evaluation of School-wide Positive Behavior Support. Rob Horner Holly Lewandowski University of Oregon Illinois State Board of Education Slides at www.pbis.org. Goals. Provide a framework for building state-level evaluation of school-wide PBIS. Main Messages.
E N D
Designing and Implementing Evaluation of School-wide Positive Behavior Support Rob Horner Holly Lewandowski University of Oregon Illinois State Board of Education Slides at www.pbis.org
Goals • Provide a framework for building state-level evaluation of school-wide PBIS
Main Messages • Start with the evaluation questions • Define information needed for good decisions • What information, in what form, at what time, for whom. • Invest in evaluation plan and evaluation group early. • Use evaluation information at multiple levels
Visibility Political Support Funding Leadership Team Active Coordination Behavioral Expertise Training Coaching Evaluation Local School Teams/Demonstrations
Levels of Evaluation Nation State District School Classroom Student
Evaluation Areas/ Questions • Assessment • Are we implementing these procedures already? • What do we need to do? • What is the smallest change that will lead to the largest gain? • Implementation • Who is involved? (What schools, activities, effort) • Are we implementing SW-PBIS at criterion? • Practices, Systems, Data, Outcomes • What type and level of Technical Assistance is needed? • What is the cost of implementation? • What is the cost to continue implementation? • How does this approach compare with alternatives? • Most common alternative is what is currently being done
Evaluation Areas/ Questions • Outcomes • Behavioral outcomes (Is student social behavior improving?) • Office discipline referrals • Suspensions/ Expulsions • Rate of referrals to special education • Attendance • Check-in/ Check-out data • Individual student progress monitoring • Academic outcomes (Are student academic gains occurring?) • Literacy progress monitoring (soon math progress monitoring) • Standardized test scores • Graduation rate; Grades • Drop out rate
Evaluation Areas/ Questions • Sustainability • Do schools sustain implementation fidelity? • Do schools sustain student outcome gains?
Matching Measures to Questions • Scott Spaulding and Claudia Vincent • Every State/District will have additional data sources unique to the setting, or context, that can be integrated into the plan. • Examples: • Iowa Youth Survey, • Illinois wraparound tools
Establishing Evaluation as a Priority • Identify and Fund Evaluation Coordinator • Internal versus external • Build evaluation plan early • Approved by Leadership Team • Agree on questions, measures, report schedule • Invest in data collection, summarization, and storage • Different levels of investment are possible • Report Evaluation results regularly • At least twice a year
Evaluation on www.pbis.org • Evaluation Template (Online library/ Tools) • Evaluation Tools/ Measures • Evaluation Examples Holly