Skip to main content
Top
Published in: BMC Health Services Research 1/2011

Open Access 01-12-2011 | Research article

To what extent are adverse events found in patient records reported by patients and healthcare professionals via complaints, claims and incident reports?

Authors: Ingrid Christiaans-Dingelhoff, Marleen Smits, Laura Zwaan, Sanne Lubberding, Gerrit van der Wal, Cordula Wagner

Published in: BMC Health Services Research | Issue 1/2011

Login to get access

Abstract

Background

Patient record review is believed to be the most useful method for estimating the rate of adverse events among hospitalised patients. However, the method has some practical and financial disadvantages. Some of these disadvantages might be overcome by using existing reporting systems in which patient safety issues are already reported, such as incidents reported by healthcare professionals and complaints and medico-legal claims filled by patients or their relatives. The aim of the study is to examine to what extent the hospital reporting systems cover the adverse events identified by patient record review.

Methods

We conducted a retrospective study using a database from a record review study of 5375 patient records in 14 hospitals in the Netherlands. Trained nurses and physicians using a method based on the protocol of The Harvard Medical Practice Study previously reviewed the records. Four reporting systems were linked with the database of reviewed records: 1) informal and 2) formal complaints by patients/relatives, 3) medico-legal claims by patients/relatives and 4) incident reports by healthcare professionals. For each adverse event identified in patient records the equivalent was sought in these reporting systems by comparing dates and descriptions of the events. The study focussed on the number of adverse event matches, overlap of adverse events detected by different sources, preventability and severity of consequences of reported and non-reported events and sensitivity and specificity of reports.

Results

In the sample of 5375 patient records, 498 adverse events were identified. Only 18 of the 498 (3.6%) adverse events identified by record review were found in one or more of the four reporting systems. There was some overlap: one adverse event had an equivalent in both a complaint and incident report and in three cases a patient/relative used two or three systems to complain about an adverse event. Healthcare professionals reported relatively more preventable adverse events than patients.
Reports are not sensitive for adverse events nor do reports have a positive predictive value.

Conclusions

In order to detect the same adverse events as identified by patient record review, one cannot rely on the existing reporting systems within hospitals.
Appendix
Available only for authorised users
Literature
1.
go back to reference Zegers M, de Bruijne MC, Wagner C, Groenewegen PP, Waaijman R, van der Wal G: Design of a retrospective patient record study on the occurrence of adverse events among patients in Dutch hospitals. BMC Health Serv Res. 2007, 7: 27-10.1186/1472-6963-7-27.CrossRefPubMedPubMedCentral Zegers M, de Bruijne MC, Wagner C, Groenewegen PP, Waaijman R, van der Wal G: Design of a retrospective patient record study on the occurrence of adverse events among patients in Dutch hospitals. BMC Health Serv Res. 2007, 7: 27-10.1186/1472-6963-7-27.CrossRefPubMedPubMedCentral
2.
go back to reference Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, Newhouse JP, Weiler PC, Hiatt HH: Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med. 1991, 324: 370-376. 10.1056/NEJM199102073240604.CrossRefPubMed Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, Newhouse JP, Weiler PC, Hiatt HH: Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study I. N Engl J Med. 1991, 324: 370-376. 10.1056/NEJM199102073240604.CrossRefPubMed
3.
go back to reference Wilson RM, Runciman WB, Gibberd RW, Harrison BT, Newby L, Hamilton JD: The Quality in Australian Health Care Study. MJA. 1995, 163: 458-471.PubMed Wilson RM, Runciman WB, Gibberd RW, Harrison BT, Newby L, Hamilton JD: The Quality in Australian Health Care Study. MJA. 1995, 163: 458-471.PubMed
4.
go back to reference Thomas EJ, Studdert DM, Burstin HR, Orav EJ, Zeena T, Williams EJ, Howard KM, Weiler PC, Brennan TA: Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000, 38: 261-271. 10.1097/00005650-200003000-00003.CrossRefPubMed Thomas EJ, Studdert DM, Burstin HR, Orav EJ, Zeena T, Williams EJ, Howard KM, Weiler PC, Brennan TA: Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000, 38: 261-271. 10.1097/00005650-200003000-00003.CrossRefPubMed
5.
go back to reference Schioler T, Lipczak H, Pedersen BL, Mogensen TS, Bech KB, Stockmarr A, Svenning AR, Frolich A: Danish Adverse Event Study: Incidence of adverse events in hospitals. A retrospective study of medical records. Ugeskr Laeger. 2001, 163: 5370-5378.PubMed Schioler T, Lipczak H, Pedersen BL, Mogensen TS, Bech KB, Stockmarr A, Svenning AR, Frolich A: Danish Adverse Event Study: Incidence of adverse events in hospitals. A retrospective study of medical records. Ugeskr Laeger. 2001, 163: 5370-5378.PubMed
6.
go back to reference Vincent C, Neale G, Woloshynowych M: Adverse events in British hospitals: preliminary retrospective record review. BMJ. 2001, 322: 517-519. 10.1136/bmj.322.7285.517.CrossRefPubMedPubMedCentral Vincent C, Neale G, Woloshynowych M: Adverse events in British hospitals: preliminary retrospective record review. BMJ. 2001, 322: 517-519. 10.1136/bmj.322.7285.517.CrossRefPubMedPubMedCentral
7.
go back to reference Davis P, Lay-Yee R, Briant R, Ali W, Scott A, Schug S: Adverse events in New Zealand public hospitals 1: occurrence and impact. N Z Med J. 2002, 115: U271.PubMed Davis P, Lay-Yee R, Briant R, Ali W, Scott A, Schug S: Adverse events in New Zealand public hospitals 1: occurrence and impact. N Z Med J. 2002, 115: U271.PubMed
8.
go back to reference Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, Etchells E, Ghali WA, Hebert P, Majumdar SR, O'Beirne M, Palacios-Derflingher L, Reid RJ, Sheps S, Tamblyn R: The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ. 2004, 170: 1678-1686.CrossRefPubMedPubMedCentral Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, Etchells E, Ghali WA, Hebert P, Majumdar SR, O'Beirne M, Palacios-Derflingher L, Reid RJ, Sheps S, Tamblyn R: The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ. 2004, 170: 1678-1686.CrossRefPubMedPubMedCentral
9.
go back to reference Zegers M, de Bruijne MC, Wagner C, Hoonhout LHF, Waaijman R, Smits M, Hout FAG, Zwaan L, Christiaans-Dingelhoff I, Timmermans DRM, Groenewegen PP, Van der Wal G: Adverse events and potentially preventable deaths in Dutch hospitals. Results of a retrospective patient record review study. Qual Saf Health Care. 2009, 18: 297-302. 10.1136/qshc.2007.025924.CrossRefPubMed Zegers M, de Bruijne MC, Wagner C, Hoonhout LHF, Waaijman R, Smits M, Hout FAG, Zwaan L, Christiaans-Dingelhoff I, Timmermans DRM, Groenewegen PP, Van der Wal G: Adverse events and potentially preventable deaths in Dutch hospitals. Results of a retrospective patient record review study. Qual Saf Health Care. 2009, 18: 297-302. 10.1136/qshc.2007.025924.CrossRefPubMed
10.
go back to reference Michel P, Quenon JL, de Sarasqueta AM, Scemama O: Comparison of three methods for estimating rates of adverse events and rates of preventable adverse events in acute care hospitals. BMJ. 2004, 328: 199-10.1136/bmj.328.7433.199.CrossRefPubMedPubMedCentral Michel P, Quenon JL, de Sarasqueta AM, Scemama O: Comparison of three methods for estimating rates of adverse events and rates of preventable adverse events in acute care hospitals. BMJ. 2004, 328: 199-10.1136/bmj.328.7433.199.CrossRefPubMedPubMedCentral
11.
go back to reference Woloshynowych M, Neale G, Vincent C: Case record review of adverse events: a new approach. Qual Saf Health Care. 2003, 12: 411-415. 10.1136/qhc.12.6.411.CrossRefPubMedPubMedCentral Woloshynowych M, Neale G, Vincent C: Case record review of adverse events: a new approach. Qual Saf Health Care. 2003, 12: 411-415. 10.1136/qhc.12.6.411.CrossRefPubMedPubMedCentral
12.
go back to reference Department of Health: An organisation with a memory: Report of an expert group on learning from adverse events in the NHS. 2000, London: The Stationery Office Department of Health: An organisation with a memory: Report of an expert group on learning from adverse events in the NHS. 2000, London: The Stationery Office
13.
go back to reference Sari ABA, Sheldon TA, Cracknell A, Turnbull A: Sensitivity of routine systems for reporting patient safety incidents in an NHS hospital: retrospective patient case note review. BMJ. 2007, 334: 79-10.1136/bmj.39031.507153.AE.CrossRefPubMed Sari ABA, Sheldon TA, Cracknell A, Turnbull A: Sensitivity of routine systems for reporting patient safety incidents in an NHS hospital: retrospective patient case note review. BMJ. 2007, 334: 79-10.1136/bmj.39031.507153.AE.CrossRefPubMed
14.
go back to reference Cullen DJ, Bates DW, Small SD, Cooper JB, Nemeskal AR, Leape LL: The incident reporting system does not detect adverse events: a problem for quality improvement. Jt Comm J Qual Improv. 1995, 21: 541-548.PubMed Cullen DJ, Bates DW, Small SD, Cooper JB, Nemeskal AR, Leape LL: The incident reporting system does not detect adverse events: a problem for quality improvement. Jt Comm J Qual Improv. 1995, 21: 541-548.PubMed
15.
go back to reference Olsen S, Neale G, Schwab K, Psaila B, Patel T, Chapman EJ, Vincent C: Hospitals should use more than one method to detect adverse events and potential adverse event: incident reporting, pharmacist surveillance and local real-time record reviews may all have a place. Qual Saf Health Care. 2007, 16: 40-44. 10.1136/qshc.2005.017616.CrossRefPubMedPubMedCentral Olsen S, Neale G, Schwab K, Psaila B, Patel T, Chapman EJ, Vincent C: Hospitals should use more than one method to detect adverse events and potential adverse event: incident reporting, pharmacist surveillance and local real-time record reviews may all have a place. Qual Saf Health Care. 2007, 16: 40-44. 10.1136/qshc.2005.017616.CrossRefPubMedPubMedCentral
16.
go back to reference Bismark MM, Brennan TA, Paterson RJ, Davis PB, Studdert DM: Relationship between complaints and quality of care in New Zealand: a descriptive analysis of complainants and non-complainants following adverse events. Qual Saf Health Care. 2006, 15: 17-22. 10.1136/qshc.2005.015743.CrossRefPubMedPubMedCentral Bismark MM, Brennan TA, Paterson RJ, Davis PB, Studdert DM: Relationship between complaints and quality of care in New Zealand: a descriptive analysis of complainants and non-complainants following adverse events. Qual Saf Health Care. 2006, 15: 17-22. 10.1136/qshc.2005.015743.CrossRefPubMedPubMedCentral
17.
go back to reference WHO Draft Guidelines for Adverse Event Reporting and Learning. 2005 WHO Draft Guidelines for Adverse Event Reporting and Learning. 2005
18.
go back to reference Friele RD, Sluijs EM: Patient expectations of fair complaint handling in hospitals: empirical data. BMC Health Serv Res. 2006, 6: 106-10.1186/1472-6963-6-106.CrossRefPubMedPubMedCentral Friele RD, Sluijs EM: Patient expectations of fair complaint handling in hospitals: empirical data. BMC Health Serv Res. 2006, 6: 106-10.1186/1472-6963-6-106.CrossRefPubMedPubMedCentral
19.
go back to reference Vincent C, Stanhope N, Crowley-Murphy M: Reasons for not reporting adverse incidents: an empirical study. J Eval Clin Pract. 1999, 5: 13-21. 10.1046/j.1365-2753.1999.00147.x.CrossRefPubMed Vincent C, Stanhope N, Crowley-Murphy M: Reasons for not reporting adverse incidents: an empirical study. J Eval Clin Pract. 1999, 5: 13-21. 10.1046/j.1365-2753.1999.00147.x.CrossRefPubMed
20.
go back to reference Leape LL: Reporting of adverse events. N Engl J Med. 2002, 347: 1633-1638. 10.1056/NEJMNEJMhpr011493.CrossRefPubMed Leape LL: Reporting of adverse events. N Engl J Med. 2002, 347: 1633-1638. 10.1056/NEJMNEJMhpr011493.CrossRefPubMed
21.
go back to reference van der Schaaf T, Kanse L: Biases in incident reporting databases: an empirical study in the chemical process industry. Safety Science. 2004, 42: 57-67. 10.1016/S0925-7535(03)00023-7.CrossRef van der Schaaf T, Kanse L: Biases in incident reporting databases: an empirical study in the chemical process industry. Safety Science. 2004, 42: 57-67. 10.1016/S0925-7535(03)00023-7.CrossRef
22.
go back to reference Evans SM, Berry JG, Smith BJ, Esterman A, Selim P, O' Shaughnessy J, DeWit M: Attitudes and barriers to incident reporting: a collaborative hospital study. Qual Saf Health Care. 2006, 15: 39-43. 10.1136/qshc.2004.012559.CrossRefPubMedPubMedCentral Evans SM, Berry JG, Smith BJ, Esterman A, Selim P, O' Shaughnessy J, DeWit M: Attitudes and barriers to incident reporting: a collaborative hospital study. Qual Saf Health Care. 2006, 15: 39-43. 10.1136/qshc.2004.012559.CrossRefPubMedPubMedCentral
23.
go back to reference Christiaans-Dingelhoff I, Doppegieter RMS, Legemaate J: Knelpunten rond het melden. Melden van incidenten in de Gezondheidszorg. Report of ZonMw Utrecht. 2006, 59-63. (Barriers towards reporting. Report: Incident Reporting in Health Care). Christiaans-Dingelhoff I, Doppegieter RMS, Legemaate J: Knelpunten rond het melden. Melden van incidenten in de Gezondheidszorg. Report of ZonMw Utrecht. 2006, 59-63. (Barriers towards reporting. Report: Incident Reporting in Health Care).
24.
go back to reference Jennings PA, Stella J: Barriers to incident notification in a regional prehospital setting. Emerg Med J. 2010. Jennings PA, Stella J: Barriers to incident notification in a regional prehospital setting. Emerg Med J. 2010.
25.
go back to reference Schectman JM, Plews-Ogan ML: Physician perception of hospital safety and barriers to incident reporting. Jt Comm J Qual Patient Saf. 2006, 32: 337-343.PubMed Schectman JM, Plews-Ogan ML: Physician perception of hospital safety and barriers to incident reporting. Jt Comm J Qual Patient Saf. 2006, 32: 337-343.PubMed
26.
go back to reference Kreckler S, Catchpole K, McCulloch P, Handa A: Factors influencing incident reporting in surgical care. Qual Saf Health Care. 2009, 18: 116-120. 10.1136/qshc.2008.026534.CrossRefPubMed Kreckler S, Catchpole K, McCulloch P, Handa A: Factors influencing incident reporting in surgical care. Qual Saf Health Care. 2009, 18: 116-120. 10.1136/qshc.2008.026534.CrossRefPubMed
27.
go back to reference Hayward RA, Hofer TP: Estimating hospital deaths due to medical errors: preventability is in the eye of the reviewer. JAMA. 2001, 286: 415-420. 10.1001/jama.286.4.415.CrossRefPubMed Hayward RA, Hofer TP: Estimating hospital deaths due to medical errors: preventability is in the eye of the reviewer. JAMA. 2001, 286: 415-420. 10.1001/jama.286.4.415.CrossRefPubMed
28.
go back to reference Lipsitz SR, Studdert DM, Brennan TA: The reliability of medical record review for estimating adverse event rates. Ann Intern Med. 2002, 136: 812-816.CrossRefPubMed Lipsitz SR, Studdert DM, Brennan TA: The reliability of medical record review for estimating adverse event rates. Ann Intern Med. 2002, 136: 812-816.CrossRefPubMed
Metadata
Title
To what extent are adverse events found in patient records reported by patients and healthcare professionals via complaints, claims and incident reports?
Authors
Ingrid Christiaans-Dingelhoff
Marleen Smits
Laura Zwaan
Sanne Lubberding
Gerrit van der Wal
Cordula Wagner
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2011
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-11-49

Other articles of this Issue 1/2011

BMC Health Services Research 1/2011 Go to the issue