Download
1 / 16
180 likes | 207 Views
Using Data to Inform Practice. Using Data to Inform Practice. Carol A. Schubert Edward P. Mulvey Marcel Schipper. Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010. Pennsylvania Mental Health and Justice Center of Excellence Workshop:
E N D
Using Data to Inform Practice Using Data to Inform Practice Carol A. Schubert Edward P. Mulvey Marcel Schipper Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010 Pennsylvania Mental Health and Justice Center of Excellence Workshop: Expanding Specialized Police Response and Collaboration with BHS in Pennsylvania Grantville, PA November, 2010
What we’ll cover today Using Data to Inform Practice • Introductions/Goals • Self Assessment • Case study – Day Reporting Center • Exercise /application to CIT Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010
Using Data to Inform Practice The Technical Assistance Role Of the Center of Excellence Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010
Why Data Matters Using Data to Inform Practice • Anecdote versus numbers Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010 • Quality Improvement • Funding
Common Barriers Using Data to Inform Practice • Confidentiality Issues • Funding Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010 • Time • Lack of cooperation/buy-in • Knowledge/skills
Using Data to Inform Practice Self Assessment Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010
How the Center of Excellence Can Help Using Data to Inform Practice • Assessing existing database structure and content • Planning for data collection (e.g. identification of outcomes) and analysis strategies • Designing data collection instruments Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010 • Implementing standardized reporting components • Monitoring data quality • Integrating relevant information from multiple sources • Analyzing and interpreting data analyses
Advantages of COE Technical Assistance Using Data to Inform Practice • Individualized • Experienced Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010 • Responsive • Flexible • Free
Using Data to Inform Practice Case Study: Westmoreland County Day Reporting Center Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010
Using Data to Inform Practice Practical Application to CIT Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010
Key Consideration Using Data to Inform Practice • Audience • Purpose • Data collection • Interpretation Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010
Using Data to Inform Practice Purpose Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010
Using Data to Inform Practice Data Collection Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010
Using Data to Inform Practice Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010 Data Collection: Some lessons learned Get data in specific form. Letting people “choose all that apply” creates uninterpretable data. People will rarely distribute forms for you to recruit people or to fill out surveys. All data points have to be collected from everyone in the same way. All fields in a form have to be filled out. Open-ended responses can be valuable, but turning them into data that is reportable across a whole sample is an involved coding task. Response options to any question have to be mutually exclusive. The name given to a scale doesn’t necessarily mean that it measures it.
Using Data to Inform Practice Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010 Analysis and Interpretation
Using Data to Inform Practice Carol Schubert Marcel Schipper PA Community Providers Association Conference October, 2010 Analysis and Interpretation: Some lessons learned There is nothing magical about statistical significance; think of clinical significance. Effect size does matter. Just because a variable can be found in an official record doesn’t mean it is worth coding or analyzing. Any data set can only do so much. It usually only does what it is designed to do. Patterns of missing data matter. Sensitivity analyses can be very convincing to make a point. The observed performance of any predictive instrument in a particular sample is as good as it is going to get. A “predictor” variable in a regression equation doesn’t really “predict” anything.
