Classrooms for the Future

1. Classrooms for the Future Pennsylvania Department of Education Edward G. Rendell, Governor Gerald Zahorchak, Secretary of Education

2. CFF Evaluation Training Dr. Kyle Peck, Associate Dean, College of Education, The Pennsylvania State University Robin Clausen, Co-director, CFF Evaluation, The Pennsylvania State University Holly Jobe, Project Manager, Classrooms for the Future

3. AGENDA • Overview of CFF Evaluation • Results of years 1 and 2 • What does good instruction using Technology look like? • TPR Data Collection Tool • CFF Observation Tool • Using the CFF Dashboard • Questions/Answers

4. Major Goals • Improve teaching and learning in English, math, science, and social studies. • Change classroom practice. • Change student-teacher relationships. • Increase student engagement. • Students responsible for learning. • Students developing 21st century skills. • Preparing students for career and higher ed • Increase Academic achievement.

6. Year 3 (2008-09) Implementation • 543 schools in 453 districts • Urban, suburban, rural, small, large • Over 140,000 laptops • 500,000 Students

7. Evaluation • Program requirement • Penn State University - Lead Casenex, University of Virginia Metiri

8. Data Collection • School responsibility • PSU – data analysis, reporting • Purpose – to show districts how to collect data, how to submit data

9. CFF Evaluation Instruments • TPR data collection tool – Casenex (pre and post - 2 people twice) • CFF data collection tool – PSU (pre and Post - 2 people once) • Surveys (pre and post) • Teacher surveys • Student surveys • PATI surveys (one time) • School technology survey • Teacher and principal survey • Interviews, principal, coach, project manager (randomly chosen)

10. PATI 2008-09 Data Collection • Technology Phase window October 27 - December 19, 2008.  This involves the IU, LEA, and school level technology surveys. • Webinars scheduled: • Monday, October 20 (1:00pm – 3:30pm) • Wednesday, October 22 (10:30am – 1:00pm)  To review recordings, http://vclass.cciu.org • click on recordings, click on the date of the webinar • Usernames and passwords have be mailed (US mail) and emailed to all LEA tech directors on record.  If an LEA has not received their information, they should contact Metiri at support@metiri.com. • Instructional Phase will occur March 2 – May 15, 2009.  This phase includes school administrators and teachers. • PATI is required for all CFF schools.

11. Additional Information • CFF Dashboard: http://cff.psu.edu • Ed Hub: http://www.pde.state.pa.us/edhub • CFF Handbook: on Ed Hub CFF/Administrators/ in the middle of the page

12. Questions???

13. Understanding the Impact ofClassrooms for the Future:An Overview of the Evaluation Process and Results from Years One & Two Kyle L. Peck, Ph.D.Penn State UniversityOctober, 2008

14. CFF IS… • Changing how Teachers setup the classroom (fewer desks in rows) • Changing how teachers teach (less lecture) • Changing what teachers teach (more emphasis on higher order, more authentic) • Increasing attention to 21st Century Skills How do I know that?

15. Good Evaluation Data.

16. A Collaborative Effort! • PDE • CaseNex (Universityof Virginia) • The Metiri Group • A PA-Based Team • Interviewers • Data Analysts • Authors

17. Teacher & Student Attitudes Knowledge & Skill Development Technology Use Student Activity Teacher Activity CFF Evaluation Overview • Surveys • Observations • Interviews • District Data

18. “Pre” and “Post” Post only CFF Evaluation Overview • Surveys • Observations • Interviews • District Data

19. “Pre Window” For Cohort 3 (New to CFF) Novemer 10 to December 5 For Cohorts 1& 2 CFF Evaluation Overview • Surveys • Observations • Interviews • District Data

20. “Post Window” CFF Evaluation Overview • Surveys • Observations • Interviews • District Data

21. “Pre Window” “Post Window” For ALL Cohorts November 10 to December 5 For ALL Cohorts May 4 to May 29 CFF Evaluation Overview • Surveys • Observations • Interviews • District Data

22. Observations Two Types: • “TPR” • About teaching practices related to student performance • “CFF” • About technology use, teaching goals and methods, & 21st century skills

23. Who Gets Observed?

24. Who Do I Observe? • 2 Teachers using the TPR • 2 Teachers using the CFF • A total of 4 teachers, randomly selected by the evaluation team

25. All teachers CFF teachers “PRE” “POST” When and How Many? • “TPR” • “CFF” November 10 - December 5 √ √ √ √ √ √ √ √ √ √ √ √ May 4 - 29

26. CFF Evaluation Overview • Surveys We randomly select 30: • Observations • Coaches • Principals • Technology Coordinators • CFF Contacts • Interviews • District Data (We will call to set appointments toward the end of the school year.)

27. CFF Evaluation Overview • Surveys PDE will provide: • Observations • PSSA Data • Graduation rates • Attendance data • Interviews • District Data

28. CFF Evaluation Overview We need you! You are the key to a quality evaluation. Your role is to: • Inform teachers and ensure their participation • Maintain data on your school’s CFF people and equipment To help you do this we developedThe CFF Evaluation Dashboard.

29. Guiding Questions • How does CFF affect what teachers do? • How does CFF affect what students do? • How does CFF affect how teachers feel? • How does CFF affect how students feel? • How does CFF affect students’ academic performance? • How does CFF affect the acquisition of 21st century skills?

30. To what extent do you think the new technology will change what teachers do? • Teacher behavior will not change much. (Teachers tend to teach as they have been taught.) • Less teacher talk, more student talk. • Less teacher talk, and students will talk less, too. (Since each student has a computer, teachers will assign more individual work, and less group work.)

31. All 3 answers are plausible! Whether teachers change will depend in large measure on your work!

32. Given the results you have seen, do you predict significant changes in student engagement? • More students will be engaged. • Students will be engaged through more of the lesson. • Students will be more intensely engaged. • All of the above. • None of the above. • (0) Other Combination

33. How do you think your CFF participation will affect student achievement NEXT year? • It might cause a slight "dip" in performance as we get things figured out. • It probably will not affect student achievement this year. • Student achievement will increase a little. • Student achievement will increase a lot.

34. How do you think CFF will make teachers feel? • More effective. • Like they are working harder. • Like they are working longer. • All of the above. • None of the above.

35. How does CFF affect…how teachers feel? September January April

36. So… What do we know?

37. Progress is being made. Classroom organization is changing. Less time is spent in lecture. Significant increases in: higher order thinking problem-based learning project-based learning authentic learning multi-modal teaching peer teaching, and both informal & formal collaborative learning and collaborative learning.

38. Progress is being made. More time spent on the development of most identified 21st century skills, including: Visual Literacy Teaming or Collaboration Skills E-communication Skills Social or Personal Responsibility Self Direction Creativity Use of Real World Tools The Ability to Produce High-Quality Products, and Planning, Prioritizing, and Managing Work. Significant differences were not found for Scientific Literacy, Cultural Literacy or Global Awareness, and Higher Order Thinking.

39. Teaching activity changed and was more likely to cause student achievement. Increases were noted on all five domains of the “Teaching Performance Record (TPR).

40. Students were more engaged.Teachers’ perceptions of the value of technologies started high, and increased.Teachers felt better prepared than last year and felt that they could give their students a better education.

41. Teachers valued their coaches.Some teachers reported that their principals had played an important role, while others did not.

42. (CFF Handbook, p 37) Evaluation Calendar (Cohort 3)

43. Thank You!

44. Questions?