Framework for Teaching Proficiency System (FFTPS ) a lso known as FOCUS Arkansas TESS

1. Framework for Teaching Proficiency System (FFTPS) also known as FOCUS Arkansas TESS Administrator Training

2. A Complete Solution for Evaluators Framework for Teaching Observer Training Increase the reliability and accuracy of observers Deepen observer knowledge of the components and performance levels in the Framework for Teaching Promote bias awareness Framework for Teaching Scoring Practice Provide observers with opportunities to practice before live observations Deliver feedback to observers including answer key and evidence rationale Framework for Teaching Proficiency Assessment Train observers to deliver valid, reliable judgments based on teaching evidence Increase defensibility of the district’s evaluation system

3. FOCUS: Home Page Traing

4. Evaluator Training: Overview • ~20 hours of video and training content provided • Self paced - total training time may vary • 11 online learning modules for observers • Orientation to observer training • Minimizing bias • 9 modules on Framework for Teaching • Overview • Framework for Teaching Components in Domain 2 and Domain 3 detailed rater training on each component and performance level • Over 100+ master scored videos

5. Best Practices for Evaluators to Pass Assessment

6. Evaluator Training: Home Page

7. Evaluator Training: Overview Page

8. Evaluator Training: Master Scored Videos

9. Evaluator Training: Exercise Example

10. Scoring Practice: Description • Provides opportunities for evaluators to practice: • Identifying and recording instructional evidence • Aligning the evidence to a specific component of the Framework for Teaching • Scoring classroom practice based on the evidence • Receiving feedback on the score versus expert-assigned rubric and rationale

11. Scoring Practice: Evidence and Scoring

12. Scoring Practice: Feedback Page

13. Proficiency Assessment: Overview • Two stages. Recommend time to take each stage ~3-3.5 hrs • Stage 1: multiple choice and videos. Stage 2: videos (selected based on user’s grade span) • Passing score based on total score of both stages: Stage 1+ Stage 2 • Each stage takes ~3-3.5 hours (user has up to 6 hours to take a stage). • If a user passes each stage on their first attempt, the total testing time will take 6-7 hours • Users should only takes one test attempt per day so test usually takes at least 2 days to complete • 2 chances to pass each stage of assessment (see next page for visual examples) • Must pass Stage 1 before moving to Stage 2 • If the user passes both Stage 1 and Stage 2 they are considered “proficient” • If user fails a stage twice, they are deemed not proficient and are eligible for “retest” • If a user fails an assessment, they must wait a period of time before their next attempt • Fail one attempt: 24 hour lockout period before next attempt at stage • Fail on second attempt: 21 day lockout period before next attempt • Fail overall assessment (i.e., fail a stage twice): lockout period TBD (several weeks) before “retest” • “Retest’ follows the same exact process as the “initial test” • Two stages • User starts at Stage 1 • Two attempts to pass each stage • If the user is not proficient (fails a stage twice) after retest, there are no additional testing rounds

14. Pass/Fail Paths – Initial Testing Round Stage 1 Stage 2 Outcome for initial test 1st attempt Pass 1st attempt Pass Pass 1st attempt Pass 1st attempt Fail Pass 2nd attempt Pass 1st attempt Fail 2nd attempt Pass 1st attempt Pass Pass Fail 1st attempt 1st attempt Fail 2nd attempt Pass 2nd attempt Pass Pass 1st attempt Fail 2nd attempt Fail Fail (can “retest”) 1st attempt Fail 2nd attempt Pass 1st attempt Fail Fail (can “retest”) 2nd attempt Fail 1st attempt Pass 1st attempt Fail Fail (can “retest”) 2nd attempt Fail

16. Overview of System Requirements FOCUS training, practice, and proficiency assessment rely heavily on videos. Users systems must be optimized to view videos.

17. System Check Tool: The user’s and IT staff’s best friend Where to access the “System Check” tool from Help page

18. System Check Tool: Screenshot • In seconds, automatically detects if user meets system requirements for • Hardware • Browser • Monitor • JavasScript, Cookies, Pop Ups • Allows user to check if internet connection meets requirements (“speedtest.net”) • Allows user to watch a video and listen to audio as a final system test

19. Additional Support Resources

20. Local Support • Co-op/school district cadre of facilitators for • administrative support of content • Webinar for Co-op Tech Coordinators • Webinar for Local Tech Coordinators • Arkansas TeachscapeImplementation • Managers can be reached at: • ade.artess.teachscape@arkansas.gov

21. Customer Support: Role of Local IT and Teachscape Local district IT staff • Enable users to access Teachscape related domains and sites • Allow Teachscape to use support tool (e.g., Teamviewer) on users hardware if required to resolve a support issue • Be the point of contact for users to address any issues identified by the system check tool • Contact Teachscape if user continues to experience system problems after local hardware, software, or connectivity issues have been addressed • 1-888-479-7600 • support@teachscape.com Teachscape Be the point of contact for users when they experience problems while taking a proficiency assessment Work with local IT team to resolve issues that cannot be fixed at local level

22. GETTING STARTED IN TEACHSCAPE Emails were sent on January 7 with user names and temporary passwords. Grade spans were chosen when registering accounts (Has already been entered for you). Grade spans: K-5, K-8, 6-8, 9-12, and K-12 These grade spans determine the videos you will watch for practice scoring and the assessment. If you need to change grade span, contact Teachscape Tech Support. You will change your password upon first log-in. Make sure you read system requirements and run system check.

23. TIPS: Proficiency Test • Set a goal for yourself. • Using Mozilla Firefox helps with technical issues. • Log out before you exit Teachscape. • Work through training modules regardless of your familiarity with Danielson Framework. DO NOT SKIP!! • View and score practice videos with colleagues using the 2011 edition of FFTPS/FOCUS. • Review and discuss with colleagues the rationale behind the scoring. • Proficiency Test has to be taken independently.

24. More Tips: Proficiency Test • Take certification test outside school day due to bandwidth issues. • Set aside an uninterrupted time period (3-4 hours) for each stage of the test. • You can pause videos without penalty. • Record evidence on paper or directly into Teachscape. • If you record evidence on paper, put “see notes” in the evidence box and code that to all components.

25. And More Tips: Proficiency Test • Remember you are not tested only on scoring the videos, but also on bias, interpretation, and applying the framework. • After passing Stage 1, it is recommended to wait at least one day before beginning Stage 2. • If you are unsuccessful, review your score report and determine a plan of action. • During the training process, each co-op/district has facilitators available to assist you.

26. Even More Tips: Proficiency Test • Using a larger monitor aids in seeing more of what is happening in each video • Use of an Ethernet connection instead of wireless in highly recommended since Ethernet connections are generally more stable than wireless connections • Use of a headset can help users filter out other sounds and distractions in their training and testing situation.

27. Teachscape Demo Site for FFTES • Site can be accessed at http://www.teachscape.com • User name: arkansas.demo • Password: teach • To access the FFTES, click on Framework for Teaching Effectiveness Series • Teachers may access the site NOW! • A QuickStart Guide has been developed to assist demo users in navigating the site.