Skip to main content
Top
Published in: BMC Health Services Research 1/2018

Open Access 01-12-2018 | Research article

Assessing the implementation processes of a large-scale, multi-year quality improvement initiative: survey of health care providers

Authors: Donna Goodridge, Masud Rana, Elizabeth L. Harrison, Thomas Rotter, Roy Dobson, Gary Groot, Sonia Udod, Joshua Lloyd

Published in: BMC Health Services Research | Issue 1/2018

Login to get access

Abstract

Background

Beginning in 2012, Lean was introduced to improve health care quality and promote patient-centredness throughout the province of Saskatchewan, Canada with the aim of producing coordinated, system-wide change. Significant investments have been made in training and implementation, although limited evaluation of the outcomes have been reported. In order to better understand the complex influences that make innovations such as Lean “workable” in practice, Normalization Process Theory guided this study. The objectives of the study were to: a) evaluate the implementation processes associated with Lean implementation in the Saskatchewan health care system from the perspectives of health care professionals; and b) identify demographic, training and role variables associated with normalization of Lean.

Methods

Licensed health care professionals were invited through their professional associations to complete a cross-sectional, modified, online version of the NoMAD questionnaire in March, 2016. Analysis was based on 1032 completed surveys. Descriptive and univariate analyses were conducted. Multivariate multinomial regressions were used to quantify the associations between five NoMAD items representing the four Normalization Process Theory constructs (coherence, cognitive participation, collective action and reflexive monitoring).

Results

More than 75% of respondents indicated that neither sufficient training nor resources (collective action) had been made available to them for the implementation of Lean. Compared to other providers, nurses were more likely to report that Lean increased their workload. Significant differences in responses were evident between: leaders vs. direct care providers; nurses vs. other health professionals; and providers who reported increased workload as a result of Lean vs. those who did not. There were no associations between responses to normalization construct proxy items and: completion of introductory Lean training; participation in Lean activities; age group; years of professional experience; or employment status (full-time or part-time). Lean leader training was positively associated with proxy items reflecting coherence, cognitive participation and reflexive monitoring.

Conclusions

From the perspectives of the cross-section of health care professionals responding to this survey, major gaps remain in embedding Lean into healthcare. Strategies that address the challenges faced by nurses and direct care providers, in particular, are needed if intended goals are to be achieved.
Appendix
Available only for authorised users
Literature
2.
go back to reference Black J, Miller D. The Toyota way to healthcare excellence: increase efficiency and improve quality with lean. Chicago: Health Administration Press; 2008. Black J, Miller D. The Toyota way to healthcare excellence: increase efficiency and improve quality with lean. Chicago: Health Administration Press; 2008.
3.
go back to reference Lawal A, Rotter T, Kinsman L, Sari N, Harrison L, Jeffery C, et al. Lean management in health care: definition, concepts, methodology and effects reported (systematic review protocol). System Rev. 2014;3:103. Lawal A, Rotter T, Kinsman L, Sari N, Harrison L, Jeffery C, et al. Lean management in health care: definition, concepts, methodology and effects reported (systematic review protocol). System Rev. 2014;3:103.
4.
go back to reference Best A, Greenhalgh T, Lewis S, Saul JE, Carroll S, Bitz J. Large-system transformation in healthcare a realist review. Milbank Q. 2012;90:421–56.PubMedPubMedCentral Best A, Greenhalgh T, Lewis S, Saul JE, Carroll S, Bitz J. Large-system transformation in healthcare a realist review. Milbank Q. 2012;90:421–56.PubMedPubMedCentral
5.
go back to reference Ferlie EB, Shortell SM. Improving the quality of health care in the United Kingdom and the United States: a framework for change. Milbank Q. 2001;79:281–315.PubMedPubMedCentral Ferlie EB, Shortell SM. Improving the quality of health care in the United Kingdom and the United States: a framework for change. Milbank Q. 2001;79:281–315.PubMedPubMedCentral
6.
go back to reference Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629.PubMedPubMedCentral Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82:581–629.PubMedPubMedCentral
7.
go back to reference Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362:1225–30.PubMed Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. Lancet. 2003;362:1225–30.PubMed
8.
go back to reference Nystrom ME, Strehlenert H, Hansson J, Hasson H. Strategies to facilitate implementation and sustainability of large system transformations: a case study of a national program for improving quality of care for elderly people. BMC Health Serv Res. 2014;14:401.PubMedPubMedCentral Nystrom ME, Strehlenert H, Hansson J, Hasson H. Strategies to facilitate implementation and sustainability of large system transformations: a case study of a national program for improving quality of care for elderly people. BMC Health Serv Res. 2014;14:401.PubMedPubMedCentral
9.
go back to reference Mann D. The missing link: lean leadership. Front Health Serv Manag. 2009;26:15–26. Mann D. The missing link: lean leadership. Front Health Serv Manag. 2009;26:15–26.
10.
go back to reference Mann D. Creating a lean culture: tools to sustain lean conversions. New York: Productivity Press; 2005. Mann D. Creating a lean culture: tools to sustain lean conversions. New York: Productivity Press; 2005.
11.
go back to reference Sari N, Rotter T, Goodridge D, Harrison L, Kinsman L. An economic evaluation of a system wide Lean approach: cost esstimation of the implementation of Lean in the Saskatchewan healthcare system for 2012–2014. BMC Health Serv Res. 2017;17:523.PubMedPubMedCentral Sari N, Rotter T, Goodridge D, Harrison L, Kinsman L. An economic evaluation of a system wide Lean approach: cost esstimation of the implementation of Lean in the Saskatchewan healthcare system for 2012–2014. BMC Health Serv Res. 2017;17:523.PubMedPubMedCentral
12.
go back to reference McIntosh T. Rolling-out lean in the Saskatchewan health care system: politics derailing policy. Health Ref Obs. 2016;4(1):Article 3. dx.doi.org/10.13162/hro-ors.v4i1.2701 McIntosh T. Rolling-out lean in the Saskatchewan health care system: politics derailing policy. Health Ref Obs. 2016;4(1):Article 3. dx.doi.org/10.13162/hro-ors.v4i1.2701
14.
go back to reference Moraros J, Lemstra M, Nwankwo C. Lean interventions in healthcare: do they actually work? A systematic literature review. Int J Qual Health Care. 2016;28:150–65.PubMedPubMedCentral Moraros J, Lemstra M, Nwankwo C. Lean interventions in healthcare: do they actually work? A systematic literature review. Int J Qual Health Care. 2016;28:150–65.PubMedPubMedCentral
17.
go back to reference May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: normalization process theory. Imp Sci. 2009;4:29. May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: normalization process theory. Imp Sci. 2009;4:29.
18.
go back to reference Finch TL, Mair FS, O’Donnell C, Murray E, May CR. From theory to ‘measurement’ in complex interventions: methodological lessons from the development of an e-health normalisation instrument. BMC Med Res Meth. 2012;12:69. Finch TL, Mair FS, O’Donnell C, Murray E, May CR. From theory to ‘measurement’ in complex interventions: methodological lessons from the development of an e-health normalisation instrument. BMC Med Res Meth. 2012;12:69.
19.
go back to reference May CR, Sibley A, Hunt K. The nursing work of hospital-based clinical practice guidelines implementation: an explanatory systematic review using normalisation process theory. Int J Nurs Stud. 2014;51:289–99.PubMed May CR, Sibley A, Hunt K. The nursing work of hospital-based clinical practice guidelines implementation: an explanatory systematic review using normalisation process theory. Int J Nurs Stud. 2014;51:289–99.PubMed
20.
go back to reference Morrison D, Mair FS. Telehealth in practice: using normalisation process theory to bridge the translational gap. Prim Care Respir J. 2012;20:351–2. Morrison D, Mair FS. Telehealth in practice: using normalisation process theory to bridge the translational gap. Prim Care Respir J. 2012;20:351–2.
21.
go back to reference Mair FS, Hiscock J, Beaton SC. Understanding factors that inhibit or promote the utilization of telecare in chronic lung disease. Chronic Illn. 2008;4:110–7.PubMed Mair FS, Hiscock J, Beaton SC. Understanding factors that inhibit or promote the utilization of telecare in chronic lung disease. Chronic Illn. 2008;4:110–7.PubMed
22.
go back to reference Forster D, Newton M, McLachlan H, Willis K. Exploring implementation and sustainability of models of care: can theory help? BMC Pub Health. 2011;11(Suppl 5):S8. Forster D, Newton M, McLachlan H, Willis K. Exploring implementation and sustainability of models of care: can theory help? BMC Pub Health. 2011;11(Suppl 5):S8.
23.
go back to reference Gask L, Rogers A, Campbell S, Sheaff R. Beyond the limits of clinical governance: the case of mental health in primary care. BMC Health Serv Res. 2008;8:63.PubMedPubMedCentral Gask L, Rogers A, Campbell S, Sheaff R. Beyond the limits of clinical governance: the case of mental health in primary care. BMC Health Serv Res. 2008;8:63.PubMedPubMedCentral
24.
go back to reference Gunn J, Palmer V, Dowrick C, Herrman H, Griffiths F, Kokanovic R, Blashki G, et al. Embedding effective depression care: using theory for primary care organisational and systems change. Impl Sci. 2010;5:1–15. Gunn J, Palmer V, Dowrick C, Herrman H, Griffiths F, Kokanovic R, Blashki G, et al. Embedding effective depression care: using theory for primary care organisational and systems change. Impl Sci. 2010;5:1–15.
25.
go back to reference Portela MC, Pronovost PJ, Woodcock T, Carter P, Dixon-Woods M. How to study improvement interventions: a brief overview of possible study types. BMJ Qual Saf. 2015;24:325–36.PubMedPubMedCentral Portela MC, Pronovost PJ, Woodcock T, Carter P, Dixon-Woods M. How to study improvement interventions: a brief overview of possible study types. BMJ Qual Saf. 2015;24:325–36.PubMedPubMedCentral
26.
go back to reference Goodridge D, Westhorp G, Rotter T, Dobson R, Bath B. Lean and leadership practices: development of an initial realist program theory. BMC Health Serv Res. 2015;15:362.PubMedPubMedCentral Goodridge D, Westhorp G, Rotter T, Dobson R, Bath B. Lean and leadership practices: development of an initial realist program theory. BMC Health Serv Res. 2015;15:362.PubMedPubMedCentral
28.
go back to reference Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Royal Stat Soc. 1995;57:289–300. Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J Royal Stat Soc. 1995;57:289–300.
30.
go back to reference Scott T, Mannion R, Davies HTO, Marshall MN. Implementing culture change in health care: theory and practice. Int J Qual Health Care. 2003;13:111–8. Scott T, Mannion R, Davies HTO, Marshall MN. Implementing culture change in health care: theory and practice. Int J Qual Health Care. 2003;13:111–8.
34.
go back to reference Hung D, Gray C, Martinez M, Schmittdiel J, Harrison MI. Acceptance of lean redesigns in primary care: a contextual analysis. Health Care Manag Rev. 2015;42(3) [epub ahead of print] Hung D, Gray C, Martinez M, Schmittdiel J, Harrison MI. Acceptance of lean redesigns in primary care: a contextual analysis. Health Care Manag Rev. 2015;42(3) [epub ahead of print]
35.
go back to reference Bohmer RMJ. The hard work of health care transformation. NEJM. 2016;375:709–11.PubMed Bohmer RMJ. The hard work of health care transformation. NEJM. 2016;375:709–11.PubMed
36.
go back to reference Poksinska B. The current state of lean implementation in health care: literature review. Qual Manag Health Care. 2010;19:319–29.PubMed Poksinska B. The current state of lean implementation in health care: literature review. Qual Manag Health Care. 2010;19:319–29.PubMed
39.
40.
go back to reference Al T. The impact of operational failures on hospital nurses and their patients. J Oper Manag. 2004;22:151–69. Al T. The impact of operational failures on hospital nurses and their patients. J Oper Manag. 2004;22:151–69.
41.
go back to reference Aiken LH, Sermeus W, Van den Heede K, Sloane DM, Busse R, McKee M, et al. Patient safety, satisfaction and quality of hospital care: cross sectional surveys of nurses and patients in 12 countries in Europe and the United States. BMJ. 2013;344:e1717. Aiken LH, Sermeus W, Van den Heede K, Sloane DM, Busse R, McKee M, et al. Patient safety, satisfaction and quality of hospital care: cross sectional surveys of nurses and patients in 12 countries in Europe and the United States. BMJ. 2013;344:e1717.
42.
go back to reference Janssen PPM, De Jonge J, Bakker AB. Specific determinants of intrinsic work motivation, burnout and turnover intentions: a study among nurses. J Adv Nurs. 1999;29:1360–9.PubMed Janssen PPM, De Jonge J, Bakker AB. Specific determinants of intrinsic work motivation, burnout and turnover intentions: a study among nurses. J Adv Nurs. 1999;29:1360–9.PubMed
44.
go back to reference Squires JE, Estabrooks CA, Scott S, Cummings G, Hayduk L, Kang SH, et al. The influence of organizational context on the use of research by nurses in Canadian pediatric hospitals. BMC Health Serv Res. 2013;13:351.PubMedPubMedCentral Squires JE, Estabrooks CA, Scott S, Cummings G, Hayduk L, Kang SH, et al. The influence of organizational context on the use of research by nurses in Canadian pediatric hospitals. BMC Health Serv Res. 2013;13:351.PubMedPubMedCentral
45.
go back to reference May CR, Johnson M, Finch T. Implementation, context and complexity. Implem Sci. 2016;11:141. May CR, Johnson M, Finch T. Implementation, context and complexity. Implem Sci. 2016;11:141.
46.
go back to reference Dixon-Woods M, Martin GP. Does quality improvement improve quality? Future Hosp Board. 2016;3:191–4. Dixon-Woods M, Martin GP. Does quality improvement improve quality? Future Hosp Board. 2016;3:191–4.
47.
go back to reference MacFarlane A, O’Reilly-de BM. Using a theory-driven conceptual framework in qualitative health research. Qual Health Res. 2012;22:607–18.PubMed MacFarlane A, O’Reilly-de BM. Using a theory-driven conceptual framework in qualitative health research. Qual Health Res. 2012;22:607–18.PubMed
48.
go back to reference Montgomery A, Spanu F, Baban A, Panagopoulou E. Job demands, burnout and engagement among nurses: a multi-level analysis of ORCAB data investigating the moderating effect of teamwork. Burnout Res. 2015;2:71–9. Montgomery A, Spanu F, Baban A, Panagopoulou E. Job demands, burnout and engagement among nurses: a multi-level analysis of ORCAB data investigating the moderating effect of teamwork. Burnout Res. 2015;2:71–9.
49.
go back to reference Batalden M, Batalden P, Margolis P, Armstrong G, Opipari-Arrigan L, Hartung H. Coproduction of healthcare service. BMJ Qual Saf. 2016;25:509–17.PubMed Batalden M, Batalden P, Margolis P, Armstrong G, Opipari-Arrigan L, Hartung H. Coproduction of healthcare service. BMJ Qual Saf. 2016;25:509–17.PubMed
50.
go back to reference Lewis EF, Hardy M, Snaith B. Estimating the effect of nonresponse bias in a survey of hospital organizations. Eval Health Prof. 2013;36:330–51.PubMed Lewis EF, Hardy M, Snaith B. Estimating the effect of nonresponse bias in a survey of hospital organizations. Eval Health Prof. 2013;36:330–51.PubMed
52.
go back to reference Dillman DA, Smyth JD, Christian LM. Internet, mail and mixed mode surveys: the tailored design method. 3rd ed. Hoboken: John Wiley & Sons, Inc; 2008. Dillman DA, Smyth JD, Christian LM. Internet, mail and mixed mode surveys: the tailored design method. 3rd ed. Hoboken: John Wiley & Sons, Inc; 2008.
53.
go back to reference Groves RM, Peytcheva E. The impact of nonresponse rates on nonresponse bias. Pub Opin Quar. 2008;72:167–89. Groves RM, Peytcheva E. The impact of nonresponse rates on nonresponse bias. Pub Opin Quar. 2008;72:167–89.
54.
go back to reference Castel E, Ginsburg L, Zaheer S, Tamim H. Understanding nurses’ and physicians’ fear of repercussions for reporting errors: clinician characteristics, organization demographics, or leadership factors? BMC Health Serv Res. 2015;15:326.PubMedPubMedCentral Castel E, Ginsburg L, Zaheer S, Tamim H. Understanding nurses’ and physicians’ fear of repercussions for reporting errors: clinician characteristics, organization demographics, or leadership factors? BMC Health Serv Res. 2015;15:326.PubMedPubMedCentral
56.
go back to reference Cunningham CT, Quan H, Hemmelgarn B, Noseworthy T, Beck CA, Dixon E, et al. Exploring physician response rates to web-based surveys. BMC Med Res Methodol. 2015;5:32. Cunningham CT, Quan H, Hemmelgarn B, Noseworthy T, Beck CA, Dixon E, et al. Exploring physician response rates to web-based surveys. BMC Med Res Methodol. 2015;5:32.
57.
go back to reference O’Reilley PPO, Lee SH, O’Sullivan M, Cullen W, Kennedy C, MacFarlane A. Assessing the facilitators and barriers of interdisciplinary team working in primary care using normalization process theory: an integrative review. PLoS One. 2017;12:e0177026. O’Reilley PPO, Lee SH, O’Sullivan M, Cullen W, Kennedy C, MacFarlane A. Assessing the facilitators and barriers of interdisciplinary team working in primary care using normalization process theory: an integrative review. PLoS One. 2017;12:e0177026.
Metadata
Title
Assessing the implementation processes of a large-scale, multi-year quality improvement initiative: survey of health care providers
Authors
Donna Goodridge
Masud Rana
Elizabeth L. Harrison
Thomas Rotter
Roy Dobson
Gary Groot
Sonia Udod
Joshua Lloyd
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2018
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-018-3045-6

Other articles of this Issue 1/2018

BMC Health Services Research 1/2018 Go to the issue