1 / 13

Acknowledgements

Development and Use of Ambulatory Adverse Event Trigger Tools Jonathan R. Nebeker AHRQ Conference Sept. 29, 2010 Boston University School of Public Health, Boston, MA, VA Center for Organization, Leadership and Management Research (COLMR), Boston MA akrosen@bu.edu. Acknowledgements.

hawa
Download Presentation

Acknowledgements

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Development and Use of Ambulatory Adverse Event Trigger ToolsJonathan R. NebekerAHRQ Conference Sept. 29, 2010Boston University School of Public Health, Boston, MA, VA Center for Organization, Leadership and Management Research (COLMR), Boston MAakrosen@bu.edu

  2. Acknowledgements Sponsored by AHRQ Contract No. HHSA290200600012, Task Order Officer: Amy Helwig, MD • PI Amy Rosen, PhD • Co-PI Jonathan Nebeker, MD, MS • Co-Investigators: • Stephan Gaehde, MD • Haytham Kaafarani, MD, MPH • Brenna Long, MA • Hillary Mull, MPP • Brian Nordberg, BS • Steve Pickard, MS • Peter Rivard, PhD • Lucy Savitz, PhD, MBA • Chris Shanahan, MD, MPH • Stephanie Shimada, PhD

  3. What’s new? • ADE Surveillance rules • Complex to maximize PPV and Sensitivity • Action-Oriented to make a difference for patient • Use input from system-based focus groups and experts with practical experience

  4. Study Flow

  5. Epidemiological Design Mull H & Nebeker JR, Informatics Tools for the Development of Action-Oriented Adverse Drug Event Triggers, 2008. AMIA Annual Symposium Proceedings. Nov 6:505-9. http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2655939/

  6. Example of Complex Trigger • [Dose change in GFR reducer or renal toxin and subsequent creatinine > 50% from average baseline creatinine value or > 33% from last post dose change creatinine value] AND (No new trimethoprim within 1 day prior to 7 days after creatinine lab value firing) AND (GFR Reducer or renal toxin used within 90 days prior to lab value) • Suppress If: Renal toxin or GFR reducer dose reduced 0-7 days after lab) OR ( new creatinine lab result within 1-6days of firing lab value)

  7. Results: Focus Group/Interviews

  8. Delphi Highlights • 50% national experts, 50% local clinical leaders • Got perspectives that represented emphasis of research or clinical experience. • ED doc liked delirium trigger • Various, contradictory input on thresholds • Helpful modifications • Interesting insights on what would be useful

  9. Analysis • Sample • Requested sets of 2,000 pts based on exposure to target meds • Got 1,059 to 9,339 -> IRB amendment • Restricted to patients with 2 notes in 1 year • Analysis • 1° PPV = number of patients with AE/number of cases triggered • 2° Sensitivity, if prevalence >5% (for 25% CI width) (highest was 4%)

  10. Ignore the CI behind the curtain Nebeker JR, Stoddard GJ & Rosen AK, Considering Sensitivity and Positive Predictive Value in Comparing the Performance of Triggers Systems for Iatrogenic Adverse Events, Proceedings of the Trigger and TIDS Expert Meeting, Agency for Healthcare Research and Quality, June 2008. Bethesda, MD. http://www.ahrq.gov/QUAL/triggers/triggers2.htm

  11. End Points • Harm • PSO Harm scale • WHO Causality criteria (certain or probable) • Explicit criteria • Lab values without symptoms are not harm • Change in care (useful) • E.g., prevented additional lab draw

  12. Trigger Performance

  13. Summary • Harm is in the eye of the beholder: less or more? • Doomed to benchmarking apples with oranges? • Explicit criteria • Potential to affect practice • Are complex trigger better?

More Related