Skip to main content
Top
Published in: BMC Health Services Research 1/2015

Open Access 01-12-2015 | Research article

The impact of hospital accreditation on quality measures: an interrupted time series analysis

Authors: Subashnie Devkaran, Patrick N O’Farrell

Published in: BMC Health Services Research | Issue 1/2015

Login to get access

Abstract

Background

Developing countries frequently use hospital accreditation to guarantee quality and patient safety. However, implementation of accreditation standards is demanding on organisations. Furthermore, the empirical literature on the benefits of accreditation is sparse and this is the first empirical interrupted time series analysis designed to examine the impact of healthcare accreditation on hospital quality measures.

Methods

The study was conducted in a 150-bed multispecialty hospital in Abu Dhabi, United Arab Emirates. The quality performance outcomes were observed over a 48 month period. The quality performance differences were compared across monthly intervals between two time segments, 1 year pre- accreditation (2009) and 3 years post-accreditation (2010, 2011 and 2012) for the twenty-seven quality measures. The principal data source was a random sample of 12,000 patient records drawn from a population of 50,000 during the study period (January 2009 to December 2012). Each month (during the study period), a simple random sample of 24 percent of patient records was selected and audited, resulting in 324,000 observations. The measures (structure, process and outcome) are related to important dimensions of quality and patient safety.

Results

The study findings showed that preparation for the accreditation survey results in significant improvement as 74% of the measures had a significant positive pre-accreditation slope. Accreditation had a larger significant negative effect (48% of measures) than a positive effect (4%) on the post accreditation slope of performance. Similarly, accreditation had a larger significant negative change in level (26%) than a positive change in level (7%) after the accreditation survey. Moreover, accreditation had no significant impact on 11 out of the 27 measures. However, there is residual benefit from accreditation three years later with performance maintained at approximately 90%, which is 20 percentage points higher than the baseline level in 2009.

Conclusions

Although there is a transient drop in performance immediately after the survey, this study shows that the improvement achieved from accreditation is maintained during the three year accreditation cycle.
Literature
1.
go back to reference Kohn L, Corrigan J, Donaldson M. To err is human: Building a safer health system. Washington, DC: Institute of Medicine, National Academies Press; 1999. Kohn L, Corrigan J, Donaldson M. To err is human: Building a safer health system. Washington, DC: Institute of Medicine, National Academies Press; 1999.
2.
go back to reference Baker GR, Norton P. Patient safety and healthcare error in the Canadian healthcare system: a systematic review and analysis of leading practices in Canada with reference to key initiatives elsewhere. Winnipeg: Health Canada; 2003. Baker GR, Norton P. Patient safety and healthcare error in the Canadian healthcare system: a systematic review and analysis of leading practices in Canada with reference to key initiatives elsewhere. Winnipeg: Health Canada; 2003.
3.
go back to reference Berwick D, Calkins D, McCannon C, Hackbarth AD. The 100 000 lives campaign: setting a goal and a deadline for improving health care quality. JAMA. 2006;295:324–7.CrossRefPubMed Berwick D, Calkins D, McCannon C, Hackbarth AD. The 100 000 lives campaign: setting a goal and a deadline for improving health care quality. JAMA. 2006;295:324–7.CrossRefPubMed
4.
go back to reference Braithwaite J, Westbrook M, Travaglia J, Iedema R, Mallock NA, Long D, et al. Are health systems changing in support of patient safety? A multi-methods evaluation of education, attitudes and practice. Int J Health Care Qual Assur. 2007;20:585–601.CrossRefPubMed Braithwaite J, Westbrook M, Travaglia J, Iedema R, Mallock NA, Long D, et al. Are health systems changing in support of patient safety? A multi-methods evaluation of education, attitudes and practice. Int J Health Care Qual Assur. 2007;20:585–601.CrossRefPubMed
6.
go back to reference Greenfield D, Travaglia J, Braithwaite J, Pawsey M. An analysis of the health sector accreditation literature. A report for the Australian Accreditation Research Network: examining future health care accreditation research. Sydney: Centre for Clinical Governance Research, The University of New South Wales; 2007. Greenfield D, Travaglia J, Braithwaite J, Pawsey M. An analysis of the health sector accreditation literature. A report for the Australian Accreditation Research Network: examining future health care accreditation research. Sydney: Centre for Clinical Governance Research, The University of New South Wales; 2007.
7.
go back to reference Griffith JR, Knutzen ST, Alexander JA. Structural versus Outcomes Measures in Hospitals: A Comparison of Joint Commission and Medicare Outcomes Scores in Hospitals. Qual Manag Health Care. 2002;10(2):29–38.CrossRefPubMed Griffith JR, Knutzen ST, Alexander JA. Structural versus Outcomes Measures in Hospitals: A Comparison of Joint Commission and Medicare Outcomes Scores in Hospitals. Qual Manag Health Care. 2002;10(2):29–38.CrossRefPubMed
8.
go back to reference Salmon JW, Heavens J, Lombard C, Tavrow P, Heiby JR, Whittaker S, et al. Quality assurance project ii: a randomized controlled trial of a hospital accreditation programme with commentaries and foreword. S Afr Oper Res Results. 2003;2:17. Salmon JW, Heavens J, Lombard C, Tavrow P, Heiby JR, Whittaker S, et al. Quality assurance project ii: a randomized controlled trial of a hospital accreditation programme with commentaries and foreword. S Afr Oper Res Results. 2003;2:17.
10.
go back to reference Miller MR, Pronovost P, Donithan M, Zeger S, Zhan C, Morlock L, et al. Relationship between Performance Measurement and Accreditation: Implications for Quality of Care and Patient Safety. Am J Med Qual. 2005;20(5):239–52.CrossRefPubMed Miller MR, Pronovost P, Donithan M, Zeger S, Zhan C, Morlock L, et al. Relationship between Performance Measurement and Accreditation: Implications for Quality of Care and Patient Safety. Am J Med Qual. 2005;20(5):239–52.CrossRefPubMed
11.
go back to reference Braithwaite J, Westbrook J, Pawsey M, Greenfield D, Naylor J, Iedema R, et al. Study Protocol: A Prospective, Multi-Method, Multi-Disciplinary, Multi-Level, Collaborative, Social-Organisational Design for Researching Health Sector Accreditation. BMC Health Serv Res. 2006;6:113.CrossRefPubMedPubMedCentral Braithwaite J, Westbrook J, Pawsey M, Greenfield D, Naylor J, Iedema R, et al. Study Protocol: A Prospective, Multi-Method, Multi-Disciplinary, Multi-Level, Collaborative, Social-Organisational Design for Researching Health Sector Accreditation. BMC Health Serv Res. 2006;6:113.CrossRefPubMedPubMedCentral
13.
go back to reference Greenfield D, Braithwaite J. Health Sector Accreditation Research: A Systematic Review. International J Qual Health Care. 2008;20(3):172–83.CrossRef Greenfield D, Braithwaite J. Health Sector Accreditation Research: A Systematic Review. International J Qual Health Care. 2008;20(3):172–83.CrossRef
14.
go back to reference Nicklin W, Dickson S. The Value and Impact of Accreditation in Health Care: A Review of the Literature. Canada: Accreditation Canada; 2009. Nicklin W, Dickson S. The Value and Impact of Accreditation in Health Care: A Review of the Literature. Canada: Accreditation Canada; 2009.
15.
go back to reference Mannion R, Davies H, Marshall M. Impact of star performance ratings in English acute hospital trusts. J Health Serv Res Pol. 2005;10:18–24.CrossRef Mannion R, Davies H, Marshall M. Impact of star performance ratings in English acute hospital trusts. J Health Serv Res Pol. 2005;10:18–24.CrossRef
16.
17.
go back to reference Walshe K. Understanding what works–and why–in quality improvement: the need for theory-driven evaluation. Int J Qual Health Care. 2007;19:57–9.CrossRefPubMed Walshe K. Understanding what works–and why–in quality improvement: the need for theory-driven evaluation. Int J Qual Health Care. 2007;19:57–9.CrossRefPubMed
18.
go back to reference Greenfield D, Braithwaite J. Developing the evidence base for accreditation of healthcare organisations: a call for transparency and innovation. Qual Saf Health Care. 2009;18:162–3.CrossRefPubMed Greenfield D, Braithwaite J. Developing the evidence base for accreditation of healthcare organisations: a call for transparency and innovation. Qual Saf Health Care. 2009;18:162–3.CrossRefPubMed
20.
go back to reference Chandra A, Glickman SW, Ou FS, Peacock WF, McCord JK, Cairns CB, et al. An analysis of the association of society of chest pain centers accreditation to American college of cardiology/American heart association non-st-segment elevation myocardial infarction guideline adherence. Ann Emerg Med. 2009;54:17–25.CrossRefPubMed Chandra A, Glickman SW, Ou FS, Peacock WF, McCord JK, Cairns CB, et al. An analysis of the association of society of chest pain centers accreditation to American college of cardiology/American heart association non-st-segment elevation myocardial infarction guideline adherence. Ann Emerg Med. 2009;54:17–25.CrossRefPubMed
21.
go back to reference El-Jardali F, Jamal D, Dimassi H, Ammar W, Tchaghchaghian V. The Impact of Hospital Accreditation on Quality of Care: Perception of Lebanese Nurses. International J Qual Health Care. 2008;20(5):363–71.CrossRef El-Jardali F, Jamal D, Dimassi H, Ammar W, Tchaghchaghian V. The Impact of Hospital Accreditation on Quality of Care: Perception of Lebanese Nurses. International J Qual Health Care. 2008;20(5):363–71.CrossRef
22.
go back to reference Sack C, Lütkes P, Günther W, Erbel R, Jöckel K, Holtmann G. Challenging the Holy Grail of Hospital Accreditation: A Cross-sectional Study of Inpatient Satisfaction in the Field of Cardiology. BMC Health Serv Res. 2010;10:120.CrossRefPubMedPubMedCentral Sack C, Lütkes P, Günther W, Erbel R, Jöckel K, Holtmann G. Challenging the Holy Grail of Hospital Accreditation: A Cross-sectional Study of Inpatient Satisfaction in the Field of Cardiology. BMC Health Serv Res. 2010;10:120.CrossRefPubMedPubMedCentral
23.
go back to reference Bowling A. Research Methods in Health: Investigating Health and Health Services. 2nd ed. Buckingham: Open University Press; 2002. Bowling A. Research Methods in Health: Investigating Health and Health Services. 2nd ed. Buckingham: Open University Press; 2002.
24.
go back to reference Chen J et al. JCAHO accreditation and quality of care for acute myocardial infarction. Health Aff (Millwood). 2003;22(2):243–54.CrossRef Chen J et al. JCAHO accreditation and quality of care for acute myocardial infarction. Health Aff (Millwood). 2003;22(2):243–54.CrossRef
25.
go back to reference Cook TD, Campbell DT. Quasi-experimentation. Design and analysis issues for field settings. Boston, MA: Houghton Mifflin Company; 1979. Cook TD, Campbell DT. Quasi-experimentation. Design and analysis issues for field settings. Boston, MA: Houghton Mifflin Company; 1979.
26.
go back to reference Gillings D, Makuc D, Siegel E. Analysis of interrupted time series mortality trends: an example to evaluate regionalized perinatal care. Am J Public Health. 1981;71:38–46.CrossRefPubMedPubMedCentral Gillings D, Makuc D, Siegel E. Analysis of interrupted time series mortality trends: an example to evaluate regionalized perinatal care. Am J Public Health. 1981;71:38–46.CrossRefPubMedPubMedCentral
27.
go back to reference Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27:299–309.CrossRefPubMed Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27:299–309.CrossRefPubMed
28.
go back to reference Lagarde M, Palmer N. The impact of user fees on access to health services in low- and middle-income countries. Cochrane Database of Systematic Reviews Issue 4. 2011, Art. No.: CD009094. DOI: 10.1002/14651858.CD009094. Lagarde M, Palmer N. The impact of user fees on access to health services in low- and middle-income countries. Cochrane Database of Systematic Reviews Issue 4. 2011, Art. No.: CD009094. DOI: 10.1002/14651858.CD009094.
29.
go back to reference Chatfield C. The Analysis of Time Series: An Introduction. 4th ed. London: Chapman and Hall; 1989. Chatfield C. The Analysis of Time Series: An Introduction. 4th ed. London: Chapman and Hall; 1989.
30.
go back to reference Dickey D, Fuller WA. Distribution of the estimates for autoregressive time series with a unit root. J Am Stat Assoc. 1979;74:427–31. Dickey D, Fuller WA. Distribution of the estimates for autoregressive time series with a unit root. J Am Stat Assoc. 1979;74:427–31.
31.
go back to reference Yaffee R, McGee M. Introduction to Time Series Analysis and Forecasting with Applications of SAS and SPSS. San Diego, Cal: Academic Press; 2000. Yaffee R, McGee M. Introduction to Time Series Analysis and Forecasting with Applications of SAS and SPSS. San Diego, Cal: Academic Press; 2000.
32.
go back to reference Scrivens E, Klein R, Steiner A. Accreditation: what can we learn from the Anglophone model? Health Policy. 1995;34:193–204.CrossRefPubMed Scrivens E, Klein R, Steiner A. Accreditation: what can we learn from the Anglophone model? Health Policy. 1995;34:193–204.CrossRefPubMed
33.
go back to reference Braithwaite J, Greenfield D, Westbrook J, Pawsey M, Westbrook M, Gibberd R, et al. Health Service Accreditation as a predictor of clinical and organisational performance: a blinded, random, stratified study. Qual Saf Health Care. 2010;19:14–21.CrossRefPubMed Braithwaite J, Greenfield D, Westbrook J, Pawsey M, Westbrook M, Gibberd R, et al. Health Service Accreditation as a predictor of clinical and organisational performance: a blinded, random, stratified study. Qual Saf Health Care. 2010;19:14–21.CrossRefPubMed
34.
go back to reference Chuang S, Howley PP, Hancock S. Using clinical indicators to facilitate quality improvement via the accreditation process: an adaptive study into the control relationship. Int J Qual Health Care. 2013;25(3):1–7.CrossRef Chuang S, Howley PP, Hancock S. Using clinical indicators to facilitate quality improvement via the accreditation process: an adaptive study into the control relationship. Int J Qual Health Care. 2013;25(3):1–7.CrossRef
35.
go back to reference Piotrowski M. Are you ready for unannounced surveys? Biomed Instrum Technol. 2005;39(4):282–3. Piotrowski M. Are you ready for unannounced surveys? Biomed Instrum Technol. 2005;39(4):282–3.
36.
go back to reference Øvretveit J. Quality evaluation and indicator comparison in health care. Int J Health Plann Mgmt. 2001;16:229–41.CrossRef Øvretveit J. Quality evaluation and indicator comparison in health care. Int J Health Plann Mgmt. 2001;16:229–41.CrossRef
37.
go back to reference Devkaran S, O’Farrell PN. The impact of hospital accreditation on clinical documentation compliance: a life cycle explanation using interrupted time series analysis. BMJ Open 2014. 4:8 e005240 doi:10.1136/bmjopen-2014-005240. Devkaran S, O’Farrell PN. The impact of hospital accreditation on clinical documentation compliance: a life cycle explanation using interrupted time series analysis. BMJ Open 2014. 4:8 e005240 doi:10.1136/bmjopen-2014-005240.
Metadata
Title
The impact of hospital accreditation on quality measures: an interrupted time series analysis
Authors
Subashnie Devkaran
Patrick N O’Farrell
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2015
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-015-0784-5

Other articles of this Issue 1/2015

BMC Health Services Research 1/2015 Go to the issue