Skip to main content
Top
Published in: BMC Health Services Research 1/2015

Open Access 01-12-2015 | Research article

A systematic review of hospital accreditation: the challenges of measuring complex intervention effects

Authors: Kirsten Brubakk, Gunn E. Vist, Geir Bukholm, Paul Barach, Ole Tjomsland

Published in: BMC Health Services Research | Issue 1/2015

Login to get access

Abstract

Background

The increased international focus on improving patient outcomes, safety and quality of care has led stakeholders, policy makers and healthcare provider organizations to adopt standardized processes for evaluating healthcare organizations. Accreditation and certification have been proposed as interventions to support patient safety and high quality healthcare. Guidelines recommend accreditation but are cautious about the evidence, judged as inconclusive. The push for accreditation continues despite sparse evidence to support its efficiency or effectiveness.

Methods

We searched MEDLINE, EMBASE and The Cochrane Library using Medical Subject Headings (MeSH) indexes and keyword searches in any language. Studies were assessed using the Cochrane Risk of Bias Tool and AMSTAR framework. 915 abstracts were screened and 20 papers were reviewed in full in January 2013. Inclusion criteria included studies addressing the effect of hospital accreditation and certification using systematic reviews, randomized controlled trials, observational studies with a control group, or interrupted time series. Outcomes included both clinical outcomes and process measures. An updated literature search in July 2014 identified no new studies.

Results

The literature review uncovered three systematic reviews and one randomized controlled trial. The lone study assessed the effects of accreditation on hospital outcomes and reported inconsistent results. Excluded studies were reviewed and their findings summarized.

Conclusion

Accreditation continues to grow internationally but due to scant evidence, no conclusions could be reached to support its effectiveness. Our review did not find evidence to support accreditation and certification of hospitals being linked to measurable changes in quality of care as measured by quality metrics and standards. Most studies did not report intervention context, implementation, or cost. This might reflect the challenges in assessing complex, heterogeneous interventions such as accreditation and certification. It is also may be magnified by the impact of how accreditation is managed and executed, and the varied financial and organizational healthcare constraints. The strategies hospitals should impelment to improve patient safety and organizational outcomes related to accreditation and certification components remains unclear.
Appendix
Available only for authorised users
Literature
1.
go back to reference Viswanathan HN, Salmon JW. Accrediting organizations and quality improvement. Am J Manage Care. 2000;6(10):1117–30. Viswanathan HN, Salmon JW. Accrediting organizations and quality improvement. Am J Manage Care. 2000;6(10):1117–30.
2.
go back to reference Jovanovic B. Hospital accreditation as method for assessing quality in health care. Arch Oncol. 2005;13(3/4):156. Jovanovic B. Hospital accreditation as method for assessing quality in health care. Arch Oncol. 2005;13(3/4):156.
3.
go back to reference Shaw C, Groene O, Mora N, Sunol R. Accreditation and ISO certification: do they explain differences in quality management in European hospitals? Int J Qual Health Care. 2010;22(6):445–51.CrossRefPubMed Shaw C, Groene O, Mora N, Sunol R. Accreditation and ISO certification: do they explain differences in quality management in European hospitals? Int J Qual Health Care. 2010;22(6):445–51.CrossRefPubMed
5.
go back to reference Greenfield D, Braithwaite J. Developing the evidence base for accreditation of healthcare organisations: a call for transparency and innovation. Qual Saf Health Care. 2009;18(3):162–3.CrossRefPubMed Greenfield D, Braithwaite J. Developing the evidence base for accreditation of healthcare organisations: a call for transparency and innovation. Qual Saf Health Care. 2009;18(3):162–3.CrossRefPubMed
6.
go back to reference Grepperud S. Is the hospital decision to seek accreditation an effective one? Int J Health Plann Manage. 2015;30(1):E56–68.CrossRefPubMed Grepperud S. Is the hospital decision to seek accreditation an effective one? Int J Health Plann Manage. 2015;30(1):E56–68.CrossRefPubMed
7.
go back to reference Greenfield D, Braithwaite J. Health sector accreditation research: a systematic review. Int J Qual Health Care. 2008;20(3):172–83.CrossRefPubMed Greenfield D, Braithwaite J. Health sector accreditation research: a systematic review. Int J Qual Health Care. 2008;20(3):172–83.CrossRefPubMed
8.
go back to reference Nicklin W, Dickson S. The Value and Impact of Health Care Accreditation: A Literature Review. 2011. Nicklin W, Dickson S. The Value and Impact of Health Care Accreditation: A Literature Review. 2011.
9.
go back to reference Al-Awa B, De Wever A, Melot C, Devreux I. An overview of patient safety and accreditation: a literature review study. Res J Med Sci. 2011;5:200–23. Al-Awa B, De Wever A, Melot C, Devreux I. An overview of patient safety and accreditation: a literature review study. Res J Med Sci. 2011;5:200–23.
10.
go back to reference Hinchcliff R, Greenfield D, Moldovan M, Westbrook JI, Pawsey M, Mumford V, et al. Narrative synthesis of health service accreditation literature. BMJ Qual Saf. 2012;21(12):979–91.CrossRefPubMed Hinchcliff R, Greenfield D, Moldovan M, Westbrook JI, Pawsey M, Mumford V, et al. Narrative synthesis of health service accreditation literature. BMJ Qual Saf. 2012;21(12):979–91.CrossRefPubMed
11.
go back to reference Vist GE, Nøstberg AM, Brubakk K, Munkeby BH. Effects of Certification and Accreditation of Hospitals. Oslo: Nasjonalt Kunnskapssenter for helsetjenester (Norwegian Knowledge Center for the Health Services); 2009. Report No.: 1890-1298/978-82-8121-315-9 Contract No.: Report. Vist GE, Nøstberg AM, Brubakk K, Munkeby BH. Effects of Certification and Accreditation of Hospitals. Oslo: Nasjonalt Kunnskapssenter for helsetjenester (Norwegian Knowledge Center for the Health Services); 2009. Report No.: 1890-1298/978-82-8121-315-9 Contract No.: Report.
12.
go back to reference Loland NW. Effekts av ISO sertifisering og akkreditering av sykehus (effects of ISO certification and accreditation in hospitals). Oslo: Nasjonalt Kunnskapssenter for helsetjenester (Norwegian Knowledge Center for the Health Services); 2006. Report No.: 82-8121-140-7 Contract No.: Report. Loland NW. Effekts av ISO sertifisering og akkreditering av sykehus (effects of ISO certification and accreditation in hospitals). Oslo: Nasjonalt Kunnskapssenter for helsetjenester (Norwegian Knowledge Center for the Health Services); 2006. Report No.: 82-8121-140-7 Contract No.: Report.
13.
go back to reference Shaw CD, Groene O, Botje D, Sunol R, Kutryba B, Klazinga N et al. The effect of certification and accreditation on quality management in 4 clinical services in 73 European hospitals. Int J Qual Health Care. 2014. doi:10.1093/intqhc/mzu023. Shaw CD, Groene O, Botje D, Sunol R, Kutryba B, Klazinga N et al. The effect of certification and accreditation on quality management in 4 clinical services in 73 European hospitals. Int J Qual Health Care. 2014. doi:10.1093/intqhc/mzu023.
14.
go back to reference Ho M-J, Chang H-H, Chiu Y-T, Norris JL. Effects of hospital accreditation on medical students: a national qualitative study in Taiwan. Acad Med. 2014;89(11):1533–9.CrossRefPubMed Ho M-J, Chang H-H, Chiu Y-T, Norris JL. Effects of hospital accreditation on medical students: a national qualitative study in Taiwan. Acad Med. 2014;89(11):1533–9.CrossRefPubMed
15.
go back to reference Flodgren G, Pomey MP, Taber SA, Eccles MP. Effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour or patient outcomes. Cochrane Database Syst Rev. 2011;11:CD008992.PubMed Flodgren G, Pomey MP, Taber SA, Eccles MP. Effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour or patient outcomes. Cochrane Database Syst Rev. 2011;11:CD008992.PubMed
16.
go back to reference de Santé HA. Literature Review on the Impact of Hospital Accreditation. Paris: MATRIX Knowledge group; 2010. de Santé HA. Literature Review on the Impact of Hospital Accreditation. Paris: MATRIX Knowledge group; 2010.
17.
go back to reference Alkhenizan A, Shaw C. Impact of accreditation on the quality of healthcare services: a systematic review of the literature. Ann Saudi Med. 2011;31(4):407–16.CrossRefPubMedPubMedCentral Alkhenizan A, Shaw C. Impact of accreditation on the quality of healthcare services: a systematic review of the literature. Ann Saudi Med. 2011;31(4):407–16.CrossRefPubMedPubMedCentral
18.
go back to reference Salmon JW, Heavens J, Lombard C, Tavrow P. The impact of accreditation on the quality of hospital care: KwaZulu-Natal Province, Republic of South Africa. Oper Res Results. 2003;2:17. Salmon JW, Heavens J, Lombard C, Tavrow P. The impact of accreditation on the quality of hospital care: KwaZulu-Natal Province, Republic of South Africa. Oper Res Results. 2003;2:17.
19.
go back to reference Shea B, Grimshaw J, Wells G, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7(1):10.CrossRefPubMedPubMedCentral Shea B, Grimshaw J, Wells G, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7(1):10.CrossRefPubMedPubMedCentral
20.
go back to reference Higgins JPT, Altman DG. Assessing Risk of Bias in Included Studies. Cochrane Handbook for Systematic Reviews of Interventions. Chichester: Wiley; 2008. p. 187–241.CrossRef Higgins JPT, Altman DG. Assessing Risk of Bias in Included Studies. Cochrane Handbook for Systematic Reviews of Interventions. Chichester: Wiley; 2008. p. 187–241.CrossRef
21.
go back to reference Bohmer AB, Poels M, Simanski C, Trojan S, Messer K, Wirtz MD, et al. Quality management in acute pain therapy: results from a survey of certified hospitals. Schmerz (Berlin, Germany). 2012;26(4):425–30, 32–4. doi:10.1007/s00482-012-1205-x.CrossRef Bohmer AB, Poels M, Simanski C, Trojan S, Messer K, Wirtz MD, et al. Quality management in acute pain therapy: results from a survey of certified hospitals. Schmerz (Berlin, Germany). 2012;26(4):425–30, 32–4. doi:10.​1007/​s00482-012-1205-x.CrossRef
22.
go back to reference Al Awa B, Jacquery A, Almazrooa A, Habib H, Al-Noury K, El Deek B, et al. Comparison of patient safety and quality of care indicators between pre and post accreditation periods in King Abdulaziz University Hospital. Res J Med Sci. 2011;5(1):61–6. Al Awa B, Jacquery A, Almazrooa A, Habib H, Al-Noury K, El Deek B, et al. Comparison of patient safety and quality of care indicators between pre and post accreditation periods in King Abdulaziz University Hospital. Res J Med Sci. 2011;5(1):61–6.
23.
go back to reference Al Awa B, de Wever A, Almazrooa A, Habib H, al-Noury K, el Deek B, et al. The impact of accreditation on patient safety and quality of care indicators at King Abdulaziz University Hospital in Saudi Arabia. Res J Med Sci. 2011;5(1):43–51. Al Awa B, de Wever A, Almazrooa A, Habib H, al-Noury K, el Deek B, et al. The impact of accreditation on patient safety and quality of care indicators at King Abdulaziz University Hospital in Saudi Arabia. Res J Med Sci. 2011;5(1):43–51.
25.
go back to reference Menachemi N, Chukmaitov A, Brown LS, Saunders C, Brooks RG. Quality of care in accredited and nonaccredited ambulatory surgical centers. Jt Comm J Qual Patient Saf. 2008;34(9):546–51.PubMed Menachemi N, Chukmaitov A, Brown LS, Saunders C, Brooks RG. Quality of care in accredited and nonaccredited ambulatory surgical centers. Jt Comm J Qual Patient Saf. 2008;34(9):546–51.PubMed
26.
go back to reference Al Tehewy M, Salem B, Habil I, El Okda S. Evaluation of accreditation program in non-governmental organizations’ health units in Egypt: short-term outcomes. Int J Qual Health Care. 2009;21(3):183–9.CrossRefPubMed Al Tehewy M, Salem B, Habil I, El Okda S. Evaluation of accreditation program in non-governmental organizations’ health units in Egypt: short-term outcomes. Int J Qual Health Care. 2009;21(3):183–9.CrossRefPubMed
28.
go back to reference Lichtman JH, Allen NB, Wang Y, Watanabe E, Jones SB, Goldstein LB. Stroke patient outcomes in US hospitals before the start of the Joint Commission Primary Stroke Center certification program. Stroke. 2009;40(11):3574–9.CrossRefPubMedPubMedCentral Lichtman JH, Allen NB, Wang Y, Watanabe E, Jones SB, Goldstein LB. Stroke patient outcomes in US hospitals before the start of the Joint Commission Primary Stroke Center certification program. Stroke. 2009;40(11):3574–9.CrossRefPubMedPubMedCentral
29.
30.
go back to reference Al-Awa B, Al Mazrooa A, Rayes O, El Hati T, Devreux I, Al-Noury K, et al. Benchmarking the post-accreditation patient safety culture at King Abdulaziz University Hospital. Ann Saudi Med. 2012;32(2):143–50.PubMed Al-Awa B, Al Mazrooa A, Rayes O, El Hati T, Devreux I, Al-Noury K, et al. Benchmarking the post-accreditation patient safety culture at King Abdulaziz University Hospital. Ann Saudi Med. 2012;32(2):143–50.PubMed
31.
go back to reference Chen J, Rathore SS, Radford MJ, Krumholz HM. JCAHO accreditation and quality of care for acute myocardial infarction. Health Aff. 2003;22(2):243–54.CrossRef Chen J, Rathore SS, Radford MJ, Krumholz HM. JCAHO accreditation and quality of care for acute myocardial infarction. Health Aff. 2003;22(2):243–54.CrossRef
36.
go back to reference Alkhenizan A, Shaw C. The attitude of health care professionals towards accreditation: a systematic review of the literature. J Family Community Med. 2012;19(2):74.CrossRefPubMedPubMedCentral Alkhenizan A, Shaw C. The attitude of health care professionals towards accreditation: a systematic review of the literature. J Family Community Med. 2012;19(2):74.CrossRefPubMedPubMedCentral
37.
go back to reference Köpke S, McCleery J. Systematic reviews of case management: too complex to manage? Cochrane Database Syst Rev. 2015;1:ED000096-ED. Köpke S, McCleery J. Systematic reviews of case management: too complex to manage? Cochrane Database Syst Rev. 2015;1:ED000096-ED.
39.
go back to reference Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, et al. Can we systematically review studies that evaluate complex interventions? PLoS Med. 2009;6(8):e1000086.CrossRefPubMedPubMedCentral Shepperd S, Lewin S, Straus S, Clarke M, Eccles MP, Fitzpatrick R, et al. Can we systematically review studies that evaluate complex interventions? PLoS Med. 2009;6(8):e1000086.CrossRefPubMedPubMedCentral
40.
go back to reference Council MR. A Framework for Development and Evaluation of RCTs for Complex Interventions to Improve Health. London: Medical Research Council; 2000. Council MR. A Framework for Development and Evaluation of RCTs for Complex Interventions to Improve Health. London: Medical Research Council; 2000.
43.
go back to reference Lutfiyya MN, Sikka A, Mehta S, Lipsky MS. Comparison of US accredited and non-accredited rural critical access hospitals. Int J Qual Health Care. 2009;21(2):112–8.CrossRefPubMed Lutfiyya MN, Sikka A, Mehta S, Lipsky MS. Comparison of US accredited and non-accredited rural critical access hospitals. Int J Qual Health Care. 2009;21(2):112–8.CrossRefPubMed
44.
go back to reference Ramsay CR, Matowe L, Grilli R, Grimshaw JM, Thomas RE. Interrupted time series designs in health technology assessment: lessons from two systematic reviews of behavior change strategies. Int J Technol Assess Health Care. 2003;19(4):613–23.CrossRefPubMed Ramsay CR, Matowe L, Grilli R, Grimshaw JM, Thomas RE. Interrupted time series designs in health technology assessment: lessons from two systematic reviews of behavior change strategies. Int J Technol Assess Health Care. 2003;19(4):613–23.CrossRefPubMed
45.
go back to reference Øvretveit J. Does improving quality save money. A review of evidence of which improvements to quality reduce costs to health service providers. London: The Health Foundation; 2009. Øvretveit J. Does improving quality save money. A review of evidence of which improvements to quality reduce costs to health service providers. London: The Health Foundation; 2009.
47.
go back to reference Cross M. Money pit: is accreditation always worth the cost? Manag Care. 2003;12(7):26–30.PubMed Cross M. Money pit: is accreditation always worth the cost? Manag Care. 2003;12(7):26–30.PubMed
48.
go back to reference Rockwell DA, Pelletier LR, Donnelly W. The cost of accreditation: one hospital’s experience. Hosp Community Psychiatry. 1993;44(2):151–5.PubMed Rockwell DA, Pelletier LR, Donnelly W. The cost of accreditation: one hospital’s experience. Hosp Community Psychiatry. 1993;44(2):151–5.PubMed
49.
go back to reference Braithwaite J, Westbrook J, Pawsey M, Greenfield D, Naylor J, Iedema R, et al. A prospective, multi-method, multi-disciplinary, multi-level, collaborative, social-organisational design for researching health sector accreditation [LP0560737]. BMC Health Serv Res. 2006;6:113.CrossRefPubMedPubMedCentral Braithwaite J, Westbrook J, Pawsey M, Greenfield D, Naylor J, Iedema R, et al. A prospective, multi-method, multi-disciplinary, multi-level, collaborative, social-organisational design for researching health sector accreditation [LP0560737]. BMC Health Serv Res. 2006;6:113.CrossRefPubMedPubMedCentral
50.
go back to reference Hinchcliff R, Greenfield D, Moldovan M, Pawsey M, Mumford V, Westbrook JI et al. Evaluation of current Australian health service accreditation processes (ACCREDIT-CAP): protocol for a mixed-method research project. BMJ Open. 2012;2(4). doi: 10.1136/bmjopen-2012-001726. Hinchcliff R, Greenfield D, Moldovan M, Pawsey M, Mumford V, Westbrook JI et al. Evaluation of current Australian health service accreditation processes (ACCREDIT-CAP): protocol for a mixed-method research project. BMJ Open. 2012;2(4). doi: 10.1136/bmjopen-2012-001726.
51.
go back to reference Ng K, Leung GK, Johnston JM, Cowling BJ. Factors affecting implementation of accreditation programmes and the impact of the accreditation process on quality improvement in hospitals: a SWOT analysis. Hong Kong Med J. 2013;19(5):434–46.CrossRefPubMed Ng K, Leung GK, Johnston JM, Cowling BJ. Factors affecting implementation of accreditation programmes and the impact of the accreditation process on quality improvement in hospitals: a SWOT analysis. Hong Kong Med J. 2013;19(5):434–46.CrossRefPubMed
Metadata
Title
A systematic review of hospital accreditation: the challenges of measuring complex intervention effects
Authors
Kirsten Brubakk
Gunn E. Vist
Geir Bukholm
Paul Barach
Ole Tjomsland
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2015
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-015-0933-x

Other articles of this Issue 1/2015

BMC Health Services Research 1/2015 Go to the issue