Skip to main content
Top
Published in: BMC Health Services Research 1/2016

Open Access 01-12-2016 | Research article

Keys to successful implementation of a French national quality indicator in health care organizations: a qualitative study

Authors: Mathias Waelli, Marie-Léandre Gomez, Claude Sicotte, Adrian Zicari, Jean-Yves Bonnefond, Philippe Lorino, Etienne Minvielle

Published in: BMC Health Services Research | Issue 1/2016

Login to get access

Abstract

Background

Several countries have launched public reporting systems based on quality indicators (QIs) to increase transparency and improve quality in health care organizations (HCOs). However, a prerequisite to quality improvement is successful local QI implementation. The aim of this study was to explore the pathway through which a mandatory QI of the French national public reporting system, namely the quality of the anesthesia file (QAF), was put into practice.

Method

Seven ethnographic case studies in French HCOs combining in situ observations and 37 semi-structured interviews.

Results

A significant proportion of potential QAF users, such as anesthetists or other health professionals were often unaware of quality data. They were, however, involved in improvement actions to meet the QAF criteria. In fact, three intertwined factors influenced QAF appropriation by anesthesia teams and impacted practice. The first factor was the action of clinical managers (chief anesthetists and head of department) who helped translate public policy into local practice largely by providing legitimacy by highlighting the scientific evidence underlying QAF, achieving consensus among team members, and pointing out the value of QAF as a means of work recognition. The two other factors related to the socio-material context, namely the coherence of information systems and the quality of interpersonal ties within the department.

Conclusions

Public policy tends to focus on the metrological validity of QIs and on ranking methods and overlooks QI implementation. However, effective QI implementation depends on local managerial activity that is often invisible, in interaction with socio-material factors. When developing national quality improvement programs, health authorities might do well to specifically target these clinical managers who act as invaluable mediators. Their key role should be acknowledged and they ought to be provided with adequate resources.
Literature
1.
go back to reference Epstein A. Performance reports on quality—prototypes, problems and prospects. N Engl J Med. 1995;333:57–61.CrossRefPubMed Epstein A. Performance reports on quality—prototypes, problems and prospects. N Engl J Med. 1995;333:57–61.CrossRefPubMed
2.
go back to reference Epstein A. Rolling down the runway; the challenges ahead for quality report cards. JAMA. 1998;279:1691–6.CrossRefPubMed Epstein A. Rolling down the runway; the challenges ahead for quality report cards. JAMA. 1998;279:1691–6.CrossRefPubMed
3.
go back to reference Marshall MN, Shekelle PG, Davies HTO, Smith PC. Public reporting on quality in the United States and the United Kingdom. Health Aff. 2003;22–3:134–48.CrossRef Marshall MN, Shekelle PG, Davies HTO, Smith PC. Public reporting on quality in the United States and the United Kingdom. Health Aff. 2003;22–3:134–48.CrossRef
4.
go back to reference Chassin MR, Loeb J, Schmaltz SP, Wachter RM. Measures — using measurement to promote quality improvement. N Engl J M. 2010;363–7:683–8.CrossRef Chassin MR, Loeb J, Schmaltz SP, Wachter RM. Measures — using measurement to promote quality improvement. N Engl J M. 2010;363–7:683–8.CrossRef
5.
go back to reference Berwick DM, James B, Coye MJ. Connections between quality measurement and improvement. Med Care. 2003;41(Suppl1):130–8. Berwick DM, James B, Coye MJ. Connections between quality measurement and improvement. Med Care. 2003;41(Suppl1):130–8.
6.
go back to reference Pflueger D. Accounting for quality: on the relationship between accounting and quality improvement in healthcare. BMC Health Serv Res. 2015;15–1:178.CrossRef Pflueger D. Accounting for quality: on the relationship between accounting and quality improvement in healthcare. BMC Health Serv Res. 2015;15–1:178.CrossRef
7.
go back to reference Fourcade A, Blache JL, Grenier C, Bourgain JL, Minvielle E. Barriers to staff adoption of a surgical safety checklist. BMJ Qual Saf. 2012;21–3:191–7.CrossRef Fourcade A, Blache JL, Grenier C, Bourgain JL, Minvielle E. Barriers to staff adoption of a surgical safety checklist. BMJ Qual Saf. 2012;21–3:191–7.CrossRef
8.
go back to reference Bevan G, Hood C. What’s measured is what matters: targets and gaming in the English public health care system. Public Adm. 2006;84–3:517–38.CrossRef Bevan G, Hood C. What’s measured is what matters: targets and gaming in the English public health care system. Public Adm. 2006;84–3:517–38.CrossRef
9.
go back to reference Lester HE, Hannon KL, Campbell SM. Identifying unintended consequences of quality indicators: a qualitative study. BMJ Qual Saf. 2011;20:1057–61.CrossRefPubMed Lester HE, Hannon KL, Campbell SM. Identifying unintended consequences of quality indicators: a qualitative study. BMJ Qual Saf. 2011;20:1057–61.CrossRefPubMed
10.
go back to reference Contandriopoulos D, Champagne F, Denis JL. The multiple causal pathways between performance measures’use and effect. Med Care Res Rev. 2014;71–1:3–20.CrossRef Contandriopoulos D, Champagne F, Denis JL. The multiple causal pathways between performance measures’use and effect. Med Care Res Rev. 2014;71–1:3–20.CrossRef
11.
go back to reference Cacace M, Ettelt S, Brereton L, Pedersen J, Nolte E. How health systems make available information on service providers: experience in seven countries. Santa Monica: RAND Europe and London School of Hygiene and Tropical Medicine; 2011. Cacace M, Ettelt S, Brereton L, Pedersen J, Nolte E. How health systems make available information on service providers: experience in seven countries. Santa Monica: RAND Europe and London School of Hygiene and Tropical Medicine; 2011.
12.
go back to reference Shortell SM, O’Brien JL, Carman JM, Foster RW, Hughes EF, Boerstir H, O’Connor EJ. Assessing the impact of continuous quality improvement/total quality management: concept versus implementation. Health Serv Res. 1995;30–2:377–401. Shortell SM, O’Brien JL, Carman JM, Foster RW, Hughes EF, Boerstir H, O’Connor EJ. Assessing the impact of continuous quality improvement/total quality management: concept versus implementation. Health Serv Res. 1995;30–2:377–401.
13.
go back to reference Kaplan HC, Brady PW, Dritz MC, et al. The influence of context on quality improvement success in health care: a systematic review of the literature. Milbank Q. 2010;88:500–59.CrossRefPubMedPubMedCentral Kaplan HC, Brady PW, Dritz MC, et al. The influence of context on quality improvement success in health care: a systematic review of the literature. Milbank Q. 2010;88:500–59.CrossRefPubMedPubMedCentral
16.
go back to reference Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the consolidated framework for implementation research. Implement Sci. 2016;11–1:72. Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the consolidated framework for implementation research. Implement Sci. 2016;11–1:72.
17.
go back to reference Engeström Y, Miettinen R, Punamäki RL. Perspectives on activity theory. Cambridge: Cambridge University Press; 1999.CrossRef Engeström Y, Miettinen R, Punamäki RL. Perspectives on activity theory. Cambridge: Cambridge University Press; 1999.CrossRef
18.
go back to reference Cabridain M. Managerial procedures and hospital practices: a case study of the development of a new medical discipline. Soc Sci Med. 1985;2–2:167–72.CrossRef Cabridain M. Managerial procedures and hospital practices: a case study of the development of a new medical discipline. Soc Sci Med. 1985;2–2:167–72.CrossRef
19.
go back to reference Wong A. From the front lines: a qualitative study of anesthesiologists’ work and professional values. Can J Anaesth. 2005;58–1:108–17. Wong A. From the front lines: a qualitative study of anesthesiologists’ work and professional values. Can J Anaesth. 2005;58–1:108–17.
20.
go back to reference Hindmarsh J, Pilnick A. The tacit order of teamwork: collaboration and embodied conduct in anesthesia. Sociol Quart. 2002;43–2:139–64.CrossRef Hindmarsh J, Pilnick A. The tacit order of teamwork: collaboration and embodied conduct in anesthesia. Sociol Quart. 2002;43–2:139–64.CrossRef
21.
go back to reference Mort M, Goodwin D, Smith AF, Pope C. Safe asleep? Human–machine relations in medical practice. Soc Sci Med. 2005;2027–2037:61–9. Mort M, Goodwin D, Smith AF, Pope C. Safe asleep? Human–machine relations in medical practice. Soc Sci Med. 2005;2027–2037:61–9.
23.
go back to reference Couralet M, Leleu H, Capuano F, Marcotte L, Nitenberg G, Sicotte C, Minvielle E. Method for developing national quality indicators based on manual data extraction from medical records. BMJ Qual Saf. 2013;22–2:155–62.CrossRef Couralet M, Leleu H, Capuano F, Marcotte L, Nitenberg G, Sicotte C, Minvielle E. Method for developing national quality indicators based on manual data extraction from medical records. BMJ Qual Saf. 2013;22–2:155–62.CrossRef
24.
go back to reference Flyvberg B. Five misunderstandings about case study research. Qualitative Inquiry. 2006;12–2:219–45. Flyvberg B. Five misunderstandings about case study research. Qualitative Inquiry. 2006;12–2:219–45.
25.
go back to reference Østerlund C. Mapping medical work: documenting practices across multiple medical settings. J Cent Inf Stud. 2004;5–3:35–43. Østerlund C. Mapping medical work: documenting practices across multiple medical settings. J Cent Inf Stud. 2004;5–3:35–43.
26.
go back to reference Eisenhardt K. Building theories from case study research. Acad Manag Rev. 1989;14–4:532–50. Eisenhardt K. Building theories from case study research. Acad Manag Rev. 1989;14–4:532–50.
27.
go back to reference Greenhalgh T, Stones R, Swinglehurst D. Choose and book: a sociological analysis of ‘resistance’ to an expert system. Soc Sci Med. 2014;104:210–9.CrossRefPubMed Greenhalgh T, Stones R, Swinglehurst D. Choose and book: a sociological analysis of ‘resistance’ to an expert system. Soc Sci Med. 2014;104:210–9.CrossRefPubMed
29.
go back to reference Hafner JM, Williams SC, Koss RG, Tshurtz BA, Schmaltz SP, Loebe JM. The perceived impact of public reporting hospital performance data: Interviews with hospital staff. International J Qual Health Care. 2011;23:697–704.CrossRef Hafner JM, Williams SC, Koss RG, Tshurtz BA, Schmaltz SP, Loebe JM. The perceived impact of public reporting hospital performance data: Interviews with hospital staff. International J Qual Health Care. 2011;23:697–704.CrossRef
30.
go back to reference Guerrero EG, Padwa H, Fenwick K, Harris LM, Aarons GA. Identifying and ranking implicit leadership strategies to promote evidence-based practice implementation in addiction health services. Implement Sci. 2016;11–1:69. Guerrero EG, Padwa H, Fenwick K, Harris LM, Aarons GA. Identifying and ranking implicit leadership strategies to promote evidence-based practice implementation in addiction health services. Implement Sci. 2016;11–1:69.
31.
go back to reference Nadeem E, Olin SS, Hill LC, Hoagwood KE, Horwitz SM. Understanding the components of quality improvement collaboratives: a systematic literature review. Milbank Q. 2013;91–2:354–94.CrossRef Nadeem E, Olin SS, Hill LC, Hoagwood KE, Horwitz SM. Understanding the components of quality improvement collaboratives: a systematic literature review. Milbank Q. 2013;91–2:354–94.CrossRef
32.
go back to reference Carman JM, Shortell SM, Foster RW, Hughes EFX, Boerstler H, O’brien JL, O’Connor EJ. Keys for successful implementation of total quality management in hospitals. Health Care Man Rev. 2010;35–4:283–93.CrossRef Carman JM, Shortell SM, Foster RW, Hughes EFX, Boerstler H, O’brien JL, O’Connor EJ. Keys for successful implementation of total quality management in hospitals. Health Care Man Rev. 2010;35–4:283–93.CrossRef
33.
go back to reference Bohmer RMJ. Leading clinicians and clinicians leading. N Eng J Med. 2013;368–16:1468–70.CrossRef Bohmer RMJ. Leading clinicians and clinicians leading. N Eng J Med. 2013;368–16:1468–70.CrossRef
34.
go back to reference Mc Fadden KL, Stock GN, Gowen CR. Leadership, safety climate and continuous quality improvement: impact on process quality and patient safety. Health Care Man Rev. 2015;40–1:24–34.CrossRef Mc Fadden KL, Stock GN, Gowen CR. Leadership, safety climate and continuous quality improvement: impact on process quality and patient safety. Health Care Man Rev. 2015;40–1:24–34.CrossRef
35.
go back to reference Kellogg KC, Orlikowski WJ, Yates J. Life in the trading zone: structuring coordination across boundaries in postbureaucratic organizations. Org Sci. 2006;17–1:22–44.CrossRef Kellogg KC, Orlikowski WJ, Yates J. Life in the trading zone: structuring coordination across boundaries in postbureaucratic organizations. Org Sci. 2006;17–1:22–44.CrossRef
36.
go back to reference Boxenbaum E. Lost in translation, the making of Danish diversity management. Am Behav Scient. 2006;49–7:939–48.CrossRef Boxenbaum E. Lost in translation, the making of Danish diversity management. Am Behav Scient. 2006;49–7:939–48.CrossRef
37.
go back to reference Orlikowski W, Scott SV. Sociomateriality: challenging the separation of technology, work and organization. Acad Manag Annals. 2008;2–1:433–74.CrossRef Orlikowski W, Scott SV. Sociomateriality: challenging the separation of technology, work and organization. Acad Manag Annals. 2008;2–1:433–74.CrossRef
38.
go back to reference Leonardi PM, Nardi BA, Kallinikos J, editors. Materiality and organizing: social interaction in a technological world. London: Oxford University Press; 2012. Leonardi PM, Nardi BA, Kallinikos J, editors. Materiality and organizing: social interaction in a technological world. London: Oxford University Press; 2012.
39.
go back to reference Bates DW, Gawande AA. Improving safety with information technology. N Engl J Med. 2003;348:2526–34.CrossRefPubMed Bates DW, Gawande AA. Improving safety with information technology. N Engl J Med. 2003;348:2526–34.CrossRefPubMed
40.
go back to reference Benzer JK, Young G, Stolzmann K, et al. The relationship between organizational climate and quality of chronic disease management. Health Serv Res. 2011;46–3:691–711.CrossRef Benzer JK, Young G, Stolzmann K, et al. The relationship between organizational climate and quality of chronic disease management. Health Serv Res. 2011;46–3:691–711.CrossRef
41.
go back to reference Allen D. From boundary concept to boundary object: the practice and politics of care pathway development. Soc Sci Med. 2009;69–3:354–61.CrossRef Allen D. From boundary concept to boundary object: the practice and politics of care pathway development. Soc Sci Med. 2009;69–3:354–61.CrossRef
42.
go back to reference Tutorials on Quality Measures: Desirable Attributes of a Quality Measure. In: National Quality Measures Clearinghouse (NQMC) [Web site]. Rockville: Agency for Healthcare Research and Quality (AHRQ); [cited 2016 Jun 1]. Available: http://www.qualitymeasures.ahrq.gov. Tutorials on Quality Measures: Desirable Attributes of a Quality Measure. In: National Quality Measures Clearinghouse (NQMC) [Web site]. Rockville: Agency for Healthcare Research and Quality (AHRQ); [cited 2016 Jun 1]. Available: http://​www.​qualitymeasures.​ahrq.​gov.
43.
go back to reference Cohen MM, Duncan PG, Pope WD, Biehl D, Tweed WA§Merchant RN. The canadian four-center study of anaesthetic outcomes: can outcomes be used to assess the quality of aneasthesia care? Canadian Journal of Anaesthesia. 1992;39(5):430–439. Cohen MM, Duncan PG, Pope WD, Biehl D, Tweed WA§Merchant RN. The canadian four-center study of anaesthetic outcomes: can outcomes be used to assess the quality of aneasthesia care? Canadian Journal of Anaesthesia. 1992;39(5):430–439.
44.
go back to reference Haller G, Stoelwinder J, Myles PS, Mc NJ. Quality and safety indicators in anesthesia: a systematic review. Anesthesiology. 2009;110–5:1158–75.CrossRef Haller G, Stoelwinder J, Myles PS, Mc NJ. Quality and safety indicators in anesthesia: a systematic review. Anesthesiology. 2009;110–5:1158–75.CrossRef
45.
go back to reference Durand-Zaleski I, Alberti C, Durieux P, et al. Informed consent in clinical research in France: assessment and factors associated with therapeutic misconception. J Med Ethics. 2008;34(9):e16.CrossRefPubMed Durand-Zaleski I, Alberti C, Durieux P, et al. Informed consent in clinical research in France: assessment and factors associated with therapeutic misconception. J Med Ethics. 2008;34(9):e16.CrossRefPubMed
Metadata
Title
Keys to successful implementation of a French national quality indicator in health care organizations: a qualitative study
Authors
Mathias Waelli
Marie-Léandre Gomez
Claude Sicotte
Adrian Zicari
Jean-Yves Bonnefond
Philippe Lorino
Etienne Minvielle
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2016
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-016-1794-7

Other articles of this Issue 1/2016

BMC Health Services Research 1/2016 Go to the issue