Evaluation Tools and On-Line Systems

1. Evaluation Tools and On-Line Systems Adapted from the Illinois PBIS Network

2. www.pbisapps.org

3. Pbisapps.org • SWIS – School-Wide Information System • PBIS Assessments • School Evaluation Tool (SET) • Self-Assessment Survey (SAS) • Team Implementation Checklist (TIC)

4. Outcomes of Session • Introduction of Tier 1 Evaluation Tools • Understand purpose of Tools • Understand process of Tool completion • Know where to complete surveys and generate reports on www.pbisapps.org Dirty Data http://www.youtube.com/watch?v=B_USu49aCs0&feature=channel&list=UL

5. Effort data (Are we working the plan?) • Team Implementation Checklist (TIC) • Self-Assessment Survey (SAS) • Outcome data (Is it having an effect?) • Core Reports - Graphs • Triangle % • Fidelity data (Are we following the plan?) • School Evaluation Tool (SET)

6. School-Wide Information System • Brief introduction • SWIS – www.pbisapps.org • Login as demo user • ebs, ebs

7. Precise or Primary Statement? Children are using inappropriate language with a high frequency in the presence of both adults and other children. This is creating a sense of disrespect and incivility in the school. James D. is hitting others in the cafeteria during lunch, and his hitting is maintained by peer attention.

8. Precise or Primary Statement? ODRs during December are higher than in any other month. Minor disrespect and disruption are increasing over time, and are most likely during the last 15 minutes of our block periods when students are engaged in independent seat work. This pattern is most common in 7th and 8th grades, involves many students, and appears to be maintained by escape from work (but may also be maintained by peer attention… we are not sure).

9. Precise or Primary Statement? Three 5th grade boys are name calling and touching girls inappropriately during recess in an apparent attempt to obtain attention. Boys are engaging in sexual harassment.

10. PBIS Assessment Account • School Evaluation Tool • Self Assessment Survey • Team Implementation Checklist 3.1

11. A Brief Overview of PBIS Assessment:School Account Login

12. Select “Surveys”Access your open survey by clicking on “Launch”

13. Total Score PBIS Assessment Reports Subscale Score Three reports are available for the Tools: Individual Item

14. School-Wide Evaluation Tool SET

15. School-Wide Evaluation Tool (SET) • The SET is a research-validated instrument that is designed to assess and evaluate the critical features of school-wide effective behavior support across an academic school year.

16. Information Gathered Can Be Used To: • Assess features that are in place • Determine annual goals • Evaluate on-going efforts • Design and revise procedures • Compare year to year efforts in the area of PBIS

17. SET Evaluates Questions Across Seven Featured Areas: • Expectations defined • Behavioral expectations taught • Acknowledgement procedures • Correction procedures • Monitoring and evaluation • Management • District-level support

18. Self Assessment Survey(SAS)

19. Self Assessment Survey (SAS) SAS assesses the extent to which PBIS practices and systems (essential components) are in place within a school School-wide Non-classroom Classroom Individual Student SAS provides entire staff (certified and non-certified) perspective

21. Self-Assessment Survey (SAS) • WHO: Completed by all teachers, staff and administrators in your school building • WHAT: Examines the status and need for improvement of four behavior support systems (school-wide, classroom, non classroom, individual students) • WHERE: At your school • WHEN: Annually, usually at the beginning or towards the end of each school year • HOW: All school staff take the survey online at PBIS Assessment: www.pbisapps.org

22. Online View of Self-Assessment Survey (SAS)

23. Online View of Self-Assessment Survey (SAS)

24. SAS Total Score Report • Classroom • Individual • School-wide • Non-classroom

25. SAS Subscale Report

26. SAS Individual Items Report

27. Team Implementation Checklist (TIC)

28. Team Implementation Checklist (TIC) • Self-assessment tool for monitoring the implementation of school-wide PBS • Team self-assessment in six core areas • Establish commitment • Establish and maintain team • Self-assessment • Establish school-wide expectations • Establish information system • Build capacity for function-based support

30. Team Implementation Checklist (TIC) • WHO: Completed by the Universal PBIS Team • WHAT: Guides the development, implementation, monitoring and revision process for building a positive school culture • WHERE: At your school during a Universal PBIS Team meeting • WHEN: 3x per year • HOW: One person, usually the Internal PBIS Coach, enters the data online at www.pbisaapps.org

31. Online View of Team ChecklistEnter date the survey was completed

32. Enter the TIC Data

33. TIC Total Score Report

34. Windom’s Report

35. TIC Subscale Report

36. TIC Individual Items Report

37. What to think about when filling out your TIC. • Realize you are just starting. It is okay if you don’t know or the answer is no. • Be honest. • The information will come back to help you develop PBIS in your school. • Know that this is constantly needing development even if you have 100% in one TIC…keep working. • This information and any other data, will help rest of staff understand how PBIS works and where more work is necessary.

38. Complete the Team Implementation Checklist (TIC)