Making Data Work for You II

1. Making Data Work for You II Shauna Reinhart, MPA Pennsylvania Child Welfare Training Program The Pennsylvania Child Welfare Training Program Making Data Work for You II

2. Agenda • Introductions • Learning objectives • Building a data-driven culture • Tips & techniques • Tools & resources • Small group discussion & sharing • Evaluations The Pennsylvania Child Welfare Training Program Making Data Work for You II

3. Learning Objectives Participants will be able to: • Discuss the framework and guiding thoughts to help develop, instill or enhance a data-driven culture within an agency; • Identify the key components of a data-driven organization; • Share tips and techniques that support a data-driven culture; and • Explore tools to identify, collect and use data. The Pennsylvania Child Welfare Training Program Making Data Work for You II

4. What is a data-driven culture? Systematically collecting and analyzing data to guide a range of decisions to help improve an organization’s success (Wohlstetter, Datnow, & Park, 2008) . Effective data use that enables organizations to learn more about their programs, pinpoint successes and challenges, identify areas of improvement, and help evaluate the effectiveness of programs and practices (Ikemoto & Marsh, 2007) The Pennsylvania Child Welfare Training Program Making Data Work for You II

5. The Pennsylvania Child Welfare Training Program Making Data Work for You II

6. Perceptions The Pennsylvania Child Welfare Training Program Making Data Work for You II

7. How do you do it? • Motivation & Values • Communicate Priorities • Commitment • Plan • Process • Commitment The Pennsylvania Child Welfare Training Program Making Data Work for You II

8. Tips • Build data teams. • Look for others’ insights. • Align priorities- yours, mine & ours. • Build networks. • Remember: You don’t know what you don’t know. • Share inaccuracies strategically. • Laryngitis- don’t get it. The Pennsylvania Child Welfare Training Program Making Data Work for You II

9. Things to remember • Best offense is a good defense. • When did you stop learning? • Data has no value. • Data will confess to anything. • Continuous Quality Improvement is not an initiative. • This will not pass. The Pennsylvania Child Welfare Training Program Making Data Work for You II

10. Action Steps • Share • Take small steps • Drive up and down the organization • Use a Logic Model • Use Resources • Climate The Pennsylvania Child Welfare Training Program Making Data Work for You II

11. Tools • Data Planning Template (American Public Human Services Association). • Solving the Data Puzzle: Tool B (Legal Center for Foster Care and Education). • CLIP Inquiry Template Plan. • Data Collection and Information Management Template (Urban Institute). The Pennsylvania Child Welfare Training Program Making Data Work for You II

12. Beware…. • Doing nothing with the results • No staff input, support or training • Chasing funding • Starting too soon • Selective measurement & reporting • Number overload (Child Welfare League, 2002) The Pennsylvania Child Welfare Training Program Making Data Work for You II

13. Resources • Program Managers Guide to Evaluation • W. K. Kellog Foundation Evaluation Handbook • United Way • University of Wisconsin Evaluation Extension • American Evaluation Association The Pennsylvania Child Welfare Training Program Making Data Work for You II

14. Acknowledgments • Maryrose McCarthy • Deborah Mock • Gene Caprio • Maryann Marchi • Mike Byers • Mary Beth Rauktis, PhD The Pennsylvania Child Welfare Training Program Making Data Work for You II

15. “All organizations [and systems] are designed, intentionally or unwittingly, to achieve precisely the results they get.” -R. Spencer Darling The Pennsylvania Child Welfare Training Program Making Data Work for You II

16. Sources • Child Welfare League of America, National Center for Research and Data Research to Practice Initiative. (2002). Using program evaluation and outcome measurement (Issue 1). Washington, Dc: Retrieved from http://www.cwla.org/programs/r2p/toolkitcs.pdf The Pennsylvania Child Welfare Training Program Making Data Work for You II

17. Sources (continued) • Ikemoto, G, & Marsh, J. (2007). Cutting through the "data-driven' mantra different concepts of decision making (Adobe PDF), Retrieved from http://www.rand.org/pubs/reprints/RP1372/ • Pierce, K. (2006). Nine habits of effective data-driven performance management. Government Finance Review, Retrieved from http://www.gfoa.org/downloads/NineHabitsofEffectiveDataDrivenPerformanceManagement.pdf The Pennsylvania Child Welfare Training Program Making Data Work for You II

18. Sources (continued) • Webster, D, Needell, B, & Wildfire, J. (2002). Data are your friends: child welfare agency self-evaluation in Los Angeles county with the Family to Family Initiative. Children and Youth Services Review, 24(6/7), 471-484. • Wohlstetter, P, Datnow, A, & Park, V. (2008). Creating a system for data-driven decision-making: applying the pricipal-agent framework. School Effectiveness and School Improvement, 19(3), 239-259. The Pennsylvania Child Welfare Training Program Making Data Work for You II