180 likes | 303 Views
This presentation by Shalini Santhakumaran, a statistician at Imperial College London, explores critical reporting issues in neonatal outcome assessments. It emphasizes the need for accurate data reporting, addressing challenges such as completeness and accuracy, case definitions, and variations in care. Unadjusted data can be valuable for certain analyses, while detailed statistical modeling is essential for others. The importance of understanding variations in outcomes due to case mix differences, random variation, and care practices is discussed, along with the relevance of the National Neonatal Database for population-based reporting.
E N D
Risk adjustment and other reporting issues Shalini Santhakumaran NDAU Statistician Imperial College London
Why report outcomes ? Comparison Transparency Audit Commissioning Accountability Improvements in neonatal care and outcomes
Data Issues • Completeness • Accuracy
Data Issues Completeness Accuracy • Agreed case definitions
Data Issues Completeness Accuracy • Agreed case definitions • Neonatal transfers
Analysis issues • Unadjusted data is useful for some purposes • For others a more detailed analysis is required
Analysis issues • Unadjusted data is useful for some purposes • For others a more detailed analysis is required • 3 reasons for variation in outcome:
Analysis issues • Unadjusted data is useful for some purposes • For others a more detailed analysis is required • 3 reasons for variation in outcome: • Differences in case-mix • Random variation • Differences in care provided
Analysis issues • Differences in case-mix • Random variation • Differences in care provided • Selection of variables • Use of appropriate statistical models • Cannot completely control for case-mix
Analysis issues • Differences in case-mix • Random variation • Differences in care provided • Occurs by chance even if the underlying mortality rate is the same for all providers • Illustrate significance using funnel plots
Funnel plot for adjusted SMR 95% confidence interval limits = “warning” 99.8% confidence interval limits = “alarm” ●= complete networks ○= incomplete networks
Analysis issues • Differences in case-mix • Random variation • Differences in care provided • Not necessarily due to good/poor performance • ‘Constant risk fallacy’ and other local effects • Cannot tell us whether deaths were preventable • Needs to be linked to process measures
The National Neonatal Database • Individual, not aggregated • Population-based • Detailed clinical record • Electronic • Collaborative access to denominator data
The National Neonatal Database • Individual, not aggregated • Population-based • Detailed clinical record • Electronic • Collaborative access to denominator data • …ideal for reporting outcomes
Acknowledgements • All neonatal units contributing to the NDAU • NDAU Team • NDAU Steering Board • Jane Abbott (BLISS) Jacquie Kemp • Prof. Peter Brocklehurst Prof. Azeem Majeed • Prof. Kate Costeloe Prof. Neena Modi • Prof. Liz Draper Prof. Andrew Wilkinson • Imperial College London Academic Neonatal Medicine Unit