Using the Web to Support Data-based Decision Making

1. Using the Web to Support Data-based Decision Making Jay Buzhardt, Dale Walker, Charles Greenwood Juniper Gardens Children’s Project Division of Early Childhood Conference October 15, 2010

2. IGDI Website: www.igdi.ku.edu Publicly accessible material IGDI descriptions Materials needed for IGDI implementation Scoring definitions Scoring sheets Administration checklists Toys for administration Psychometric properties Training and certification resources Intervention materials Contact information Online data system (password-protected) Data management Web-based certification Assessor management Child rosters and demographics Program-wide aggregated reports Data-based intervention decision making tools Making Online Decisions (MOD)

3. Current Data System and MOD Use IGDI Online data system use Over 32,000 assessments entered into the data system Over 11,000 infants and toddlers assessed Approximately 1,100 user accounts (certified assessors, program directors, data entry personnel, trainees, etc.) Usage covers 22 states and three countries MOD currently being tested in a limited number of midwestern Early Head Start and Part C programs Five Kansas Early Head Start programs currently using the MOD Iowa Heartland Area Agency (Part C)

4. Graphs and Reports that SupportData-based Decision Making • Base level support… • Progress Monitoring Graphs • Weighted Total Communication • Key Skill Elements • Program Reports • Identify children falling below benchmark • Identify children due for an assessment • Individual Child Reports

5. Individual Child Report Child’s Data Table Child’s Data Summary

6. Progress Monitoring Graph:Weighted Total Early Communication Slightly Below Benchmark Below Benchmark

7. Key Skill Elements: Gestures Graph

8. Key Skill Elements: Vocalizations Graph

9. Key Skill Elements: Single Words Graph

10. Key Skill Elements: Multiple Words Graph

11. Additional Support: Making Online Decisions (MOD) System Automate identification of low-performing children Document decision making progress within the data system Intervention(s) used Work with caregivers on implementing intervention strategies Caregiver intervention implementation Intervention changes Analysis of child’s response to the intervention

12. MOD Overview Yes Yes Is the intervention working? What is causing the problem? No How is the intervention being used? What intervention should be used Quarterly ECI Assessments No Is there a problem?

13. Randomized Trial of the MOD’s Efficacy Primary Research Questions Does the MOD impact child outcomes? Does the MOD affect service providers’ decision-making behavior? Participants: 5 Kansas Early Head Start programs Home visitors in each program randomly assigned to either use the MOD (n=28) or continue standard services (n=24) NonMOD group (standard services): used the ECI, entered data into data system, provided and/or referred child for intervention services as needed MOD group: Standard services + the MOD Children whose ECI score fell at least 1 sd below benchmark either receive MOD services (n=45) or standard services (n=53)

14. Effect of the MOD on ECI OutcomesLevel-1 Analysis(Children who score at least 1 sd below benchmark on the ECI)

15. Effect of the MOD on ECI OutcomesLevel-2 Analysis(Children who score at least 1 sd below benchmark on the ECI)

16. Effect of the MOD on Home Visitors’ Intervention Services

17. Effect of the MOD on Home Visitors’ Intervention Services

18. Home Visitor Perception of the MOD