Skip to main content
Top
Published in: BMC Health Services Research 1/2014

Open Access 01-12-2014 | Research article

Validation of triggers and development of a pediatric trigger tool to identify adverse events

Authors: Maria Unbeck, Synnöve Lindemalm, Per Nydert, Britt-Marie Ygge, Urban Nylén, Carina Berglund, Karin Pukk Härenstam

Published in: BMC Health Services Research | Issue 1/2014

Login to get access

Abstract

Background

Little is known about adverse events (AEs) in pediatric patients. Record review is a common methodology for identifying AEs, but in pediatrics the record review tools generally have limited focus. The aim of the present study was to develop a broadly applicable record review tool to identify AEs in pediatric inpatients.

Methods

Using a broad literature review and expert opinion with a modified Delphi process, a pediatric trigger tool with 88 triggers, definitions, and descriptions including AE preventability decision support was developed and tested in a random sample of 600 hospitalized pediatric patients admitted in 2010 to a single university children’s hospital. Four registered nurse-physician teams performed complete two-stage retrospective reviews of 150 records each from either neonatal, surgical/orthopedic, medicine, or emergency medicine units.

Results

Registered nurse review identified 296 of 600 records with triggers indicating potential AEs. Records (n = 121) with only false positive triggers not indicating any potential AEs were not forwarded to the next review stage. On subsequent physician review, 204 (34.0%) of patients were found to have had 563 AEs, range 1–27 AEs/patient. A total of 442 preventable AEs were found in 161 patients (26.8%), range 1–22. Overall, triggers were found 3,598 times in 417 (69.5%) records, with a mean of 6 (median 1, range 0–176) triggers per patient. The overall positive predictive value of the triggers was 22.9%, (range 0.0-100.0%). The final pediatric trigger tool, developed with a second Delphi round, required 29 triggers.

Conclusions

AEs are common in pediatric patients and most are preventable. The main contributions of this study are to further develop and adapt trigger definitions, including AE preventability decision support, to introduce new triggers in pediatric care, as well as to apply pediatric triggers in different clinical specialties. Our findings resulted in a national pediatric trigger tool, and might also be adapted internationally. The pediatric trigger tool can help healthcare organizations to measure and analyze the AEs occurring in hospitalized children in order to improve patient safety.
Appendix
Available only for authorised users
Literature
1.
go back to reference Classen DC, Resar R, Griffin F, Federico F, Frankel T, Kimmel N, Whittington JC, Frankel A, Seger A, James BC: 'Global trigger tool' shows that adverse events in hospitals may be ten times greater than previously measured. Health Aff (Millwood). 2011, 30: 581-589. 10.1377/hlthaff.2011.0190.CrossRef Classen DC, Resar R, Griffin F, Federico F, Frankel T, Kimmel N, Whittington JC, Frankel A, Seger A, James BC: 'Global trigger tool' shows that adverse events in hospitals may be ten times greater than previously measured. Health Aff (Millwood). 2011, 30: 581-589. 10.1377/hlthaff.2011.0190.CrossRef
2.
go back to reference Naessens JM, Campbell CR, Huddleston JM, Berg BP, Lefante JJ, Williams AR, Culbertson RA: A comparison of hospital adverse events identified by three widely used detection methods. Int J Qual Health Care. 2009, 21: 301-307. 10.1093/intqhc/mzp027.CrossRefPubMed Naessens JM, Campbell CR, Huddleston JM, Berg BP, Lefante JJ, Williams AR, Culbertson RA: A comparison of hospital adverse events identified by three widely used detection methods. Int J Qual Health Care. 2009, 21: 301-307. 10.1093/intqhc/mzp027.CrossRefPubMed
3.
go back to reference Olsen S, Neale G, Schwab K, Psaila B, Patel T, Chapman EJ, Vincent C: Hospital staff should use more than one method to detect adverse events and potential adverse events: incident reporting, pharmacist surveillance and local real-time record review may all have a place. Qual Saf Health Care. 2007, 16: 40-44. 10.1136/qshc.2005.017616.CrossRefPubMedPubMedCentral Olsen S, Neale G, Schwab K, Psaila B, Patel T, Chapman EJ, Vincent C: Hospital staff should use more than one method to detect adverse events and potential adverse events: incident reporting, pharmacist surveillance and local real-time record review may all have a place. Qual Saf Health Care. 2007, 16: 40-44. 10.1136/qshc.2005.017616.CrossRefPubMedPubMedCentral
4.
go back to reference Sari AB, Sheldon TA, Cracknell A, Turnbull A: Sensitivity of routine system for reporting patient safety incidents in an NHS hospital: retrospective patient case note review. BMJ. 2007, 334: 79-10.1136/bmj.39031.507153.AE.CrossRefPubMed Sari AB, Sheldon TA, Cracknell A, Turnbull A: Sensitivity of routine system for reporting patient safety incidents in an NHS hospital: retrospective patient case note review. BMJ. 2007, 334: 79-10.1136/bmj.39031.507153.AE.CrossRefPubMed
5.
go back to reference Unbeck M, Muren O, Lillkrona U: Identification of adverse events at an orthopedics department in Sweden. Acta Orthop. 2008, 79: 396-403. 10.1080/17453670710015319.CrossRefPubMed Unbeck M, Muren O, Lillkrona U: Identification of adverse events at an orthopedics department in Sweden. Acta Orthop. 2008, 79: 396-403. 10.1080/17453670710015319.CrossRefPubMed
6.
go back to reference Agarwal S, Classen D, Larsen G, Tofil NM, Hayes LW, Sullivan JE, Storgion SA, Coopes BJ, Craig V, Jaderlund C, Bisarya H, Parast L, Sharek P: Prevalence of adverse events in pediatric intensive care units in the United States. Pediatr Crit Care Med. 2010, 11: 568-578. 10.1097/PCC.0b013e3181d8e405.CrossRefPubMed Agarwal S, Classen D, Larsen G, Tofil NM, Hayes LW, Sullivan JE, Storgion SA, Coopes BJ, Craig V, Jaderlund C, Bisarya H, Parast L, Sharek P: Prevalence of adverse events in pediatric intensive care units in the United States. Pediatr Crit Care Med. 2010, 11: 568-578. 10.1097/PCC.0b013e3181d8e405.CrossRefPubMed
7.
go back to reference Kirkendall ES, Kloppenborg E, Papp J, White D, Frese C, Hacker D, Schoettker PJ, Muething S, Kotagal U: Measuring adverse events and levels of harm in pediatric inpatients with the global trigger tool. Pediatrics. 2012, 130: e1206-e1214. 10.1542/peds.2012-0179.CrossRefPubMed Kirkendall ES, Kloppenborg E, Papp J, White D, Frese C, Hacker D, Schoettker PJ, Muething S, Kotagal U: Measuring adverse events and levels of harm in pediatric inpatients with the global trigger tool. Pediatrics. 2012, 130: e1206-e1214. 10.1542/peds.2012-0179.CrossRefPubMed
8.
go back to reference Larsen GY, Donaldson AE, Parker HB, Grant MJ: Preventable harm occurring to critically ill children. Pediatr Crit Care Med. 2007, 8: 331-336. 10.1097/01.PCC.0000263042.73539.99.CrossRefPubMed Larsen GY, Donaldson AE, Parker HB, Grant MJ: Preventable harm occurring to critically ill children. Pediatr Crit Care Med. 2007, 8: 331-336. 10.1097/01.PCC.0000263042.73539.99.CrossRefPubMed
9.
go back to reference Matlow AG, Baker GR, Flintoft V, Cochrane D, Coffey M, Cohen E, Cronin CM, Damignani R, Dube R, Galbraith R, Hartfield D, Newhook LA, Nijssen-Jordan C: Adverse events among children in Canadian hospitals: the Canadian paediatric adverse events study. CMAJ. 2012, 184: E709-E718. 10.1503/cmaj.112153.CrossRefPubMedPubMedCentral Matlow AG, Baker GR, Flintoft V, Cochrane D, Coffey M, Cohen E, Cronin CM, Damignani R, Dube R, Galbraith R, Hartfield D, Newhook LA, Nijssen-Jordan C: Adverse events among children in Canadian hospitals: the Canadian paediatric adverse events study. CMAJ. 2012, 184: E709-E718. 10.1503/cmaj.112153.CrossRefPubMedPubMedCentral
10.
go back to reference Matlow AG, Cronin CM, Flintoft V, Nijssen-Jordan C, Fleming M, Brady-Fryer B, Hiltz MA, Orrbine E, Baker GR: Description of the development and validation of the Canadian paediatric trigger tool. BMJ Qual Saf. 2011, 20: 416-423. 10.1136/bmjqs.2010.041152.CrossRefPubMedPubMedCentral Matlow AG, Cronin CM, Flintoft V, Nijssen-Jordan C, Fleming M, Brady-Fryer B, Hiltz MA, Orrbine E, Baker GR: Description of the development and validation of the Canadian paediatric trigger tool. BMJ Qual Saf. 2011, 20: 416-423. 10.1136/bmjqs.2010.041152.CrossRefPubMedPubMedCentral
11.
go back to reference Woods D, Thomas E, Holl J, Altman S, Brennan T: Adverse events and preventable adverse events in children. Pediatrics. 2005, 115: 155-160.PubMed Woods D, Thomas E, Holl J, Altman S, Brennan T: Adverse events and preventable adverse events in children. Pediatrics. 2005, 115: 155-160.PubMed
12.
go back to reference Woods DM, Holl JL, Klein JD, Thomas EJ: Patient safety problems in adolescent medical care. J Adolesc Health. 2006, 38: 5-12. 10.1016/j.jadohealth.2004.11.128.CrossRefPubMed Woods DM, Holl JL, Klein JD, Thomas EJ: Patient safety problems in adolescent medical care. J Adolesc Health. 2006, 38: 5-12. 10.1016/j.jadohealth.2004.11.128.CrossRefPubMed
13.
go back to reference Griffin F, Resar R: IHI global trigger tool for measuring adverse events (second edition). 2009, Institute for Healthcare Improvement, Cambridge, Massachusetts, 2 Griffin F, Resar R: IHI global trigger tool for measuring adverse events (second edition). 2009, Institute for Healthcare Improvement, Cambridge, Massachusetts, 2
14.
go back to reference Burch KJ: Using a trigger tool to assess adverse drug events in a Children's rehabilitation hospital. J Pediatr Pharmacol Ther JPPT Off J PPAG. 2011, 16: 204-209. Burch KJ: Using a trigger tool to assess adverse drug events in a Children's rehabilitation hospital. J Pediatr Pharmacol Ther JPPT Off J PPAG. 2011, 16: 204-209.
15.
go back to reference Lander L, Roberson DW, Plummer KM, Forbes PW, Healy GB, Shah RK: A trigger tool fails to identify serious errors and adverse events in pediatric otolaryngology. Otolaryngol Head Neck Surg. 2010, 143: 480-486. 10.1016/j.otohns.2010.06.820.CrossRefPubMed Lander L, Roberson DW, Plummer KM, Forbes PW, Healy GB, Shah RK: A trigger tool fails to identify serious errors and adverse events in pediatric otolaryngology. Otolaryngol Head Neck Surg. 2010, 143: 480-486. 10.1016/j.otohns.2010.06.820.CrossRefPubMed
16.
go back to reference Sharek PJ, Horbar JD, Mason W, Bisarya H, Thurm CW, Suresh G, Gray JE, Edwards WH, Goldmann D, Classen D: Adverse events in the neonatal intensive care unit: development, testing, and findings of an NICU-focused trigger tool to identify harm in north american NICUs. Pediatrics. 2006, 118: 1332-1340. 10.1542/peds.2006-0565.CrossRefPubMed Sharek PJ, Horbar JD, Mason W, Bisarya H, Thurm CW, Suresh G, Gray JE, Edwards WH, Goldmann D, Classen D: Adverse events in the neonatal intensive care unit: development, testing, and findings of an NICU-focused trigger tool to identify harm in north american NICUs. Pediatrics. 2006, 118: 1332-1340. 10.1542/peds.2006-0565.CrossRefPubMed
17.
go back to reference Takata GS, Mason W, Taketomo C, Logsdon T, Sharek PJ: Development, testing, and findings of a pediatric-focused trigger tool to identify medication-related harm in US children's hospitals. Pediatrics. 2008, 121: e927-e935. 10.1542/peds.2007-1779.CrossRefPubMed Takata GS, Mason W, Taketomo C, Logsdon T, Sharek PJ: Development, testing, and findings of a pediatric-focused trigger tool to identify medication-related harm in US children's hospitals. Pediatrics. 2008, 121: e927-e935. 10.1542/peds.2007-1779.CrossRefPubMed
18.
go back to reference Chapman SM, Fitzsimons J, Davey N, Lachman P: Prevalence and severity of patient harm in a sample of UK-hospitalised children detected by the paediatric trigger tool. BMJ Open. 2014, 4: e005066-10.1136/bmjopen-2014-005066.CrossRefPubMedPubMedCentral Chapman SM, Fitzsimons J, Davey N, Lachman P: Prevalence and severity of patient harm in a sample of UK-hospitalised children detected by the paediatric trigger tool. BMJ Open. 2014, 4: e005066-10.1136/bmjopen-2014-005066.CrossRefPubMedPubMedCentral
19.
go back to reference Hasson F, Keeney S, McKenna H: Research guidelines for the Delphi survey technique. J Adv Nurs. 2000, 32: 1008-1015.PubMed Hasson F, Keeney S, McKenna H: Research guidelines for the Delphi survey technique. J Adv Nurs. 2000, 32: 1008-1015.PubMed
20.
go back to reference Unbeck M, Schildmeijer K, Henriksson P, Jurgensen U, Muren O, Nilsson L, Pukk Harenstam K: Is detection of adverse events affected by record review methodology? an evaluation of the "harvard medical practice study" method and the "global trigger tool". Patient Saf Surg. 2013, 7: 10-10.1186/1754-9493-7-10.CrossRefPubMedPubMedCentral Unbeck M, Schildmeijer K, Henriksson P, Jurgensen U, Muren O, Nilsson L, Pukk Harenstam K: Is detection of adverse events affected by record review methodology? an evaluation of the "harvard medical practice study" method and the "global trigger tool". Patient Saf Surg. 2013, 7: 10-10.1186/1754-9493-7-10.CrossRefPubMedPubMedCentral
21.
go back to reference SFS 2010:659: Patient Safety Act. 2010, Riksdagen, Stockholm SFS 2010:659: Patient Safety Act. 2010, Riksdagen, Stockholm
22.
go back to reference Structured record review to identify and measure occurrence of adverse events in health care according to the method Global Trigger Tool [handbook in Swedish]. Stockholm: Kommentus förlag; 2008. Structured record review to identify and measure occurrence of adverse events in health care according to the method Global Trigger Tool [handbook in Swedish]. Stockholm: Kommentus förlag; 2008.
23.
go back to reference Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, Newhouse JP, Weiler PC, Hiatt HH: Incidence of adverse events and negligence in hospitalized patients. Results Harv Med Pract Study I N Engl J Med. 1991, 324: 370-376. Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, Newhouse JP, Weiler PC, Hiatt HH: Incidence of adverse events and negligence in hospitalized patients. Results Harv Med Pract Study I N Engl J Med. 1991, 324: 370-376.
24.
go back to reference Wilson RM, Runciman WB, Gibberd RW, Harrison BT, Newby L, Hamilton JD: The quality in Australian health care study. Med J Aust. 1995, 163: 458-471.PubMed Wilson RM, Runciman WB, Gibberd RW, Harrison BT, Newby L, Hamilton JD: The quality in Australian health care study. Med J Aust. 1995, 163: 458-471.PubMed
26.
go back to reference Marker based record review to identify and measure harm in health care: [handbook in Swedish]. Stockholm: Sveriges kommuner och landsting; 2012. Marker based record review to identify and measure harm in health care: [handbook in Swedish]. Stockholm: Sveriges kommuner och landsting; 2012.
27.
go back to reference Solevag AL, Nakstad B: Utility of a paediatric trigger tool in a Norwegian department of paediatric and adolescent medicine. BMJ Open. 2014, 4: e005011-10.1136/bmjopen-2014-005011.CrossRefPubMedPubMedCentral Solevag AL, Nakstad B: Utility of a paediatric trigger tool in a Norwegian department of paediatric and adolescent medicine. BMJ Open. 2014, 4: e005011-10.1136/bmjopen-2014-005011.CrossRefPubMedPubMedCentral
28.
go back to reference Brenner S, Detz A, Lopez A, Horton C, Sarkar U: Signal and noise: applying a laboratory trigger tool to identify adverse drug events among primary care patients. BMJ Qual Saf. 2012, 21: 670-675. 10.1136/bmjqs-2011-000643.CrossRefPubMedPubMedCentral Brenner S, Detz A, Lopez A, Horton C, Sarkar U: Signal and noise: applying a laboratory trigger tool to identify adverse drug events among primary care patients. BMJ Qual Saf. 2012, 21: 670-675. 10.1136/bmjqs-2011-000643.CrossRefPubMedPubMedCentral
29.
go back to reference Carnevali L, Krug B, Amant F, Van Pee D, Gerard V, de Bethune X, Spinewine A: Performance of the adverse drug event trigger tool and the global trigger tool for identifying adverse drug events: experience in a Belgian hospital. Ann Pharmacother. 2013, 47: 1414-1419. 10.1177/1060028013500939.CrossRefPubMed Carnevali L, Krug B, Amant F, Van Pee D, Gerard V, de Bethune X, Spinewine A: Performance of the adverse drug event trigger tool and the global trigger tool for identifying adverse drug events: experience in a Belgian hospital. Ann Pharmacother. 2013, 47: 1414-1419. 10.1177/1060028013500939.CrossRefPubMed
30.
go back to reference Resar RK, Rozich JD, Simmonds T, Haraden CR: A trigger tool to identify adverse events in the intensive care unit. Jt Comm J Qual Patient Saf. 2006, 32: 585-590.PubMed Resar RK, Rozich JD, Simmonds T, Haraden CR: A trigger tool to identify adverse events in the intensive care unit. Jt Comm J Qual Patient Saf. 2006, 32: 585-590.PubMed
31.
go back to reference Rosen AK, Mull HJ, Kaafarani H, Nebeker J, Shimada S, Helwig A, Nordberg B, Long B, Savitz LA, Shanahan CW, Itani K: Applying trigger tools to detect adverse events associated with outpatient surgery. J Patient Saf. 2011, 7 (1): 45-59. 10.1097/PTS.0b013e31820d164b.CrossRefPubMed Rosen AK, Mull HJ, Kaafarani H, Nebeker J, Shimada S, Helwig A, Nordberg B, Long B, Savitz LA, Shanahan CW, Itani K: Applying trigger tools to detect adverse events associated with outpatient surgery. J Patient Saf. 2011, 7 (1): 45-59. 10.1097/PTS.0b013e31820d164b.CrossRefPubMed
32.
go back to reference Sari B: Study of the scale, nature and causes of adverse events and methods to identify them. PhD thesis. University of York; 2009.. Sari B: Study of the scale, nature and causes of adverse events and methods to identify them. PhD thesis. University of York; 2009..
33.
go back to reference Olsen S: Detection of adverse events in surgery by record review. PhD thesis. University of London; 2006.. Olsen S: Detection of adverse events in surgery by record review. PhD thesis. University of London; 2006..
34.
go back to reference Adverse events in health care - overview of adverse events and costs. Marker based record review during January - June 2013 (in Swedish). Stockholm: Sveriges Kommuner och Landsting; 2013. Adverse events in health care - overview of adverse events and costs. Marker based record review during January - June 2013 (in Swedish). Stockholm: Sveriges Kommuner och Landsting; 2013.
35.
go back to reference Schildmeijer K, Unbeck M, Muren O, Perk J, Pukk Harenstam K, Nilsson L: Retrospective record review in proactive patient safety work - identification of no-harm incidents. BMC Health Serv Res. 2013, 13: 282-10.1186/1472-6963-13-282.CrossRefPubMedPubMedCentral Schildmeijer K, Unbeck M, Muren O, Perk J, Pukk Harenstam K, Nilsson L: Retrospective record review in proactive patient safety work - identification of no-harm incidents. BMC Health Serv Res. 2013, 13: 282-10.1186/1472-6963-13-282.CrossRefPubMedPubMedCentral
Metadata
Title
Validation of triggers and development of a pediatric trigger tool to identify adverse events
Authors
Maria Unbeck
Synnöve Lindemalm
Per Nydert
Britt-Marie Ygge
Urban Nylén
Carina Berglund
Karin Pukk Härenstam
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2014
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-014-0655-5

Other articles of this Issue 1/2014

BMC Health Services Research 1/2014 Go to the issue