Joint Infant and Toddler Steering Committee/Early Learning Regional Coalition Statewide Meeting

1. Joint Infant and Toddler Steering Committee/Early Learning Regional Coalition Statewide Meeting “Using our Data for Continuous Improvement” Organizational Research Services May 15, 2013

2. Designing and Test Driving the Infant and Toddler Child Care Initiative: aka a Strategic Learning Evaluation Kids' Potential, Our Purpose

3. The Drawing Board: Why I/T CCC? Kids' Potential, Our Purpose

4. WAKids Love.Talk.Play

5. Infant Toddler Highway Kids' Potential, Our Purpose

6. Design Features of the I/T CCC Car • The Motor: the Essentials • Interdisciplinary approach with focus on attachment • One-on-one consultation with child care providers serving children in vulnerable situations • Data-informed design: • I/T Steering Committees conducted needs assessment to develop Regional Service Models Kids' Potential, Our Purpose

7. Check Points for Strategic Learning: Data collected so far Report the Test Drive Results Check Under the Hood Check Conditions of the Road Check the Mileage of the Car Kids' Potential, Our Purpose

8. Check the Mileage of the Car: Report Distance Traveled Data Collected: Output data submitted by each region every 4 months in a periodic report on implementation of their model Check the Mileage of the Car Kids' Potential, Our Purpose

9. Progress of Implementation through Periodic Reports Year 1 of I/T CCC Consultation What We Learned C3 C2 C3 C2 C3 C1 Sustainability Formalize core model strategies and contracting process C1 C1 C2 Innovation Revise Regional Service Models based on year one evaluation/ reflection Full Operation Delivering consultation at nearly full capacity Initial Implementation Recruiting providers, beginning consultation services Program Installation Building infrastructure for implementation Exploration & Adaptation Regional Strategies/RSM 2011 2012 2013 Regions position during Periodic Report 1 (Prior to Dec. 31, 2011) Regions position during Periodic Report 2 (Jan. 1 2012 to March 31, 2012) Regions position during Periodic Report 3 (Apr. 1 2012 to June 30, 2012) Kids' Potential, Our Purpose

10. What We Learned Aspects of Regional Variability • How licensed care providers were recruited • Types of providers • Consultant pool • Type of assessment done in the classroom • Focus of individual consultation • Dosage of consultation • Timelines for each region The need for shared vocabulary to tell a statewide story • Clarity around children served • Clearer definitions of providers • Clearer definition of consultation hours • More explanation on consultation goals Kids' Potential, Our Purpose

11. Check Conditions of the Road: Assess Infrastructure Data Collected: Findings from 20 key informant interviews with Regional Leads and Steering Committee members on influentialsystems level factors Check Conditions of the Road Kids' Potential, Our Purpose

12. What We Learned Supports to implementation • Broad and regionally representative steering committees built trust with providers • A history of regional relationships enhanced provider and consultant recruitment • Developing a communication system facilitated interdisciplinary consultation • Implementing the RSM unified the steering committee Challenges to implementation • Some regional geography made it challenging to recruit consultants and providers serving children in vulnerable situations Kids' Potential, Our Purpose

13. Check Under the Hood: Look More Deeply at Moving Parts Data Collected: Survey responses from 157 providers to better understand who and how Check Under the Hood Kids' Potential, Our Purpose

14. What We Learned: Reach of I/T CCC Regions were reaching kids in vulnerable situations Percent of children living below 200% of the FPL level study samplecompared to Washington State and U.S. 43% 44% 39% I/T CCC WA State National Regions were reaching ethnically diverse populations I/T CCC WA State National

15. What We Learned In spite of regional differences there were shared Core Implementation components: • Consultant meets with a child care provider and they discuss potential needs • Consultant uses some form of assessment tool to determine needs more formally • Consultants and provider jointly set goals • Consultation typically is hands on in the classroom with opportunities for one-on-one debriefing and answering questions Kids' Potential, Our Purpose

16. Report the Test Drive Results: Sharing Outcomes and Findings Report the Test Drive Results Data Collected: Evidence of changes in teachers, consultants, directors and learning environment from over 150 provider and consultant interviews and 9 classroom observations Kids' Potential, Our Purpose

17. What We Learned Key Outcomes: • Providers are hungry for enhancing their skills • Providers can demonstrate new skills and attitudes toward sensitive care giving • Changing the physical environment is an important step toward promoting sensitive caregiving and healthy attachment • A trusting relationship between the consultant and provider is essential and takes time • Consultation dosage matters: more than 5 sessions leads to greater increase in knowledge and skills Kids' Potential, Our Purpose

18. A Detailed Look: Providers increase knowledge and skills

19. More Details: High Level of Satisfaction Child Care Center Directors 82% were very satisfied with overall consultation experience 94% were very satisfied with their relationship with primary consultant 92% would participate in more consultation if offered 76% were very satisfied with hours of consultation received Teachers/caregivers 88% were very satisfied with overall consultation experience 83% were very satisfied with their relationship with primary consultant 83% would participate in more consultation if offered 67% were very satisfied with hours of consultation received

20. Progress of Implementation through Periodic Reports Year 1 of I/T CCC Consultation C3 C2 C3 C2 C3 C1 Sustainability Formalize core model strategies and contracting process C1 C1 C2 Innovation Revise Regional Service Models based on year one evaluation/ reflection Full Operation Delivering consultation at nearly full capacity Initial Implementation Recruiting providers, beginning consultation services Program Installation Building infrastructure for implementation Exploration & Adaptation Regional Strategies/RSM Reflecting on the Test Drive 2011 2012 2013 Regions position during Periodic Report 1 (Prior to Dec. 31, 2011) Regions position during Periodic Report 2 (Jan. 1 2012 to March 31, 2012) Regions position during Periodic Report 3 (Apr. 1 2012 to June 30, 2012) Incorporating Learnings from Our Test Drive We plan to: • Revise Regional Service Model • Begin formalizing model by adopting components of success across all regions • Adapt and improve data collection tools* • Strengthen capacity in the regions for self-evaluation • Explore using standardized assessment tools to track teacher/caregiver outcomes Recommendations for Using a Strategic Learning Approach for Other Test Drives • Have a firm understanding of the WHAT and HOW (process) • Be adaptable- don’t be afraid to make changes to data collection process in the initial stages • Triangulate data- gather data from lots of perspectives • Match data collection and analysis to the stage of the implementation- don’t try to reach conclusions too early or demonstrate impact before it can be done Kids' Potential, Our Purpose

21. Contact Information Paula Rowland, PhD prowland@organizationalresearch.com, ext. 228 Cameron Clark, MPA/MAIScclark@organizationalresearch.com, ext. 223 Organizational Research Services www.organizationalresearch.com 206-728-0474

22. www.del.wa.govwww.twitter.com/DEL_wa