Skip to main content
Top
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

A questionnaire measuring staff perceptions of Lean adoption in healthcare: development and psychometric testing

Authors: Monica Kaltenbrunner, Lars Bengtsson, Svend Erik Mathiassen, Maria Engström

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

During the past decade, the concept of Lean has spread rapidly within the healthcare sector, but there is a lack of instruments that can measure staff’s perceptions of Lean adoption. Thus, the aim of the present study was to develop a questionnaire measuring Lean in healthcare, based on Liker’s description of Lean, by adapting an existing instrument developed for the service sector.

Methods

A mixed-method design was used. Initially, items from the service sector instrument were categorized according to Liker’s 14 principles describing Lean within four domains: philosophy, processes, people and partners and problem-solving. Items were lacking for three of Liker’s principles and were therefore developed de novo. Think-aloud interviews were conducted with 12 healthcare staff from different professions to contextualize and examine the face validity of the questionnaire prototype. Thereafter, the adjusted questionnaire’s psychometric properties were assessed on the basis of a cross-sectional survey among 386 staff working in primary care.

Results

The think-aloud interviews led to adjustments in the questionnaire to better suit a healthcare context, and the number of items was reduced. Confirmatory factor analysis of the adjusted questionnaire showed a generally acceptable correspondence with Liker’s description of Lean. Internal consistency, measured using Cronbach’s alpha, for the factors in Liker’s description of Lean was 0.60 for the factor people and partners, and over 0.70 for the three other factors. Test-retest reliability measured by the intra-class correlation coefficient ranged from 0.77 to 0.88 for the four factors.

Conclusions

We designed a questionnaire capturing staff’s perceptions of Lean adoption in healthcare on the basis of Liker’s description. This Lean in Healthcare Questionnaire (LiHcQ) showed generally acceptable psychometric properties, which supports its usability for measuring Lean adoption in healthcare. We suggest that further research focus on verifying the usability of LiHcQ in other healthcare settings, and on adjusting the instrument if needed.
Appendix
Available only for authorised users
Literature
1.
go back to reference Brandao de Souza L. Trends and approaches in lean healthcare. Leadersh Health Serv. 2009;22(2):121–39.CrossRef Brandao de Souza L. Trends and approaches in lean healthcare. Leadersh Health Serv. 2009;22(2):121–39.CrossRef
2.
3.
go back to reference Holden RJ. Lean thinking in emergency departments: a critical review. Ann Emerg Med. 2011;57(3):265–78.CrossRefPubMed Holden RJ. Lean thinking in emergency departments: a critical review. Ann Emerg Med. 2011;57(3):265–78.CrossRefPubMed
4.
go back to reference Hasle P. Lean production – an evaluation of the possibilities for an employee supportive lean practice. Hum Factors Ergon Manuf. 2014;24(1):40–53.CrossRef Hasle P. Lean production – an evaluation of the possibilities for an employee supportive lean practice. Hum Factors Ergon Manuf. 2014;24(1):40–53.CrossRef
6.
go back to reference Mazzocato P, Holden RJ, Brommels M, Aronsson H, Backman U, Elg M, Thor J. How does lean work in emergency care? A case study of a lean-inspired intervention at the Astrid Lindgren Children’s Hospital, Stockholm, Sweden”. BMC Health Serv Res. 2011;12(28):1–13. Mazzocato P, Holden RJ, Brommels M, Aronsson H, Backman U, Elg M, Thor J. How does lean work in emergency care? A case study of a lean-inspired intervention at the Astrid Lindgren Children’s Hospital, Stockholm, Sweden”. BMC Health Serv Res. 2011;12(28):1–13.
7.
go back to reference Mazzocato P, Thor J, Bäckman U, Brommels M, Carlsson J, Jonsson F, Hagmar M, Savage C. Complexity complicates lean: lessons from seven emergency services. J Health Organ Manag. 2014;28(2):266–88.CrossRefPubMed Mazzocato P, Thor J, Bäckman U, Brommels M, Carlsson J, Jonsson F, Hagmar M, Savage C. Complexity complicates lean: lessons from seven emergency services. J Health Organ Manag. 2014;28(2):266–88.CrossRefPubMed
8.
go back to reference Grove AL, Meredith JO, Macintyre M, Angelis J, Neailey K. Lean implementation in primary care health visiting services in National Health Service UK. Qual Saf Health Care. 2010;19, e43. doi:10.1136/qshc.2009.039719.PubMed Grove AL, Meredith JO, Macintyre M, Angelis J, Neailey K. Lean implementation in primary care health visiting services in National Health Service UK. Qual Saf Health Care. 2010;19, e43. doi:10.​1136/​qshc.​2009.​039719.PubMed
9.
go back to reference Burgess N, Radnor ZJ. Evaluating Lean in healthcare. International Journal of Health Care Quality Assurance. 2010;26(3):220–35.CrossRef Burgess N, Radnor ZJ. Evaluating Lean in healthcare. International Journal of Health Care Quality Assurance. 2010;26(3):220–35.CrossRef
10.
go back to reference Message Costa LB, Godinho FM. Lean healthcare: review, classification and analysis of literature. Prod Plan Control. 2016;27(10):823–36.CrossRef Message Costa LB, Godinho FM. Lean healthcare: review, classification and analysis of literature. Prod Plan Control. 2016;27(10):823–36.CrossRef
14.
go back to reference Liker JK. The Toyota Way. New York: McGraw-Hill; 2004. Liker JK. The Toyota Way. New York: McGraw-Hill; 2004.
15.
go back to reference Womack JP, Jones DT, Roos D. The Machine That Changed the World: (the story of Lean production). New York: HarperPerennial; 1991. Womack JP, Jones DT, Roos D. The Machine That Changed the World: (the story of Lean production). New York: HarperPerennial; 1991.
16.
go back to reference Hines P, Holweg M, Rich N. Learning to evolve: A review of contemporary Lean thinking. Int J Oper Prod Manage. 2004;24:994–1011.CrossRef Hines P, Holweg M, Rich N. Learning to evolve: A review of contemporary Lean thinking. Int J Oper Prod Manage. 2004;24:994–1011.CrossRef
17.
go back to reference Shah R, Ward PT. Defining and developing measures of lean production. J Oper Manag. 2007;25:785–805.CrossRef Shah R, Ward PT. Defining and developing measures of lean production. J Oper Manag. 2007;25:785–805.CrossRef
18.
go back to reference Spear S, Bowen HK. Decoding the DNA of the Toyota production system. Harv Bus Rev. 1999;77(5):96–106. Spear S, Bowen HK. Decoding the DNA of the Toyota production system. Harv Bus Rev. 1999;77(5):96–106.
19.
go back to reference McCormack B, McCance T. Person-centred Nursing: Theory and Practice. Oxford: Wiley-Blackwell; 2010.CrossRef McCormack B, McCance T. Person-centred Nursing: Theory and Practice. Oxford: Wiley-Blackwell; 2010.CrossRef
22.
go back to reference Karlsson C, Åhlström P. Assessing changes towards lean production. Int J Oper Prod Man. 1996;16(2):24–41.CrossRef Karlsson C, Åhlström P. Assessing changes towards lean production. Int J Oper Prod Man. 1996;16(2):24–41.CrossRef
24.
go back to reference Nightingale DJ, Mize JH. Development of a Lean Enterprise Transformation Maturity Model. Inf Knowl Syst Manage. 2002;3(1):15–30. Nightingale DJ, Mize JH. Development of a Lean Enterprise Transformation Maturity Model. Inf Knowl Syst Manage. 2002;3(1):15–30.
26.
go back to reference Kristensen TB, Israelsen P. Performance effects of multiple control forms in a Lean organization: A quantitative case study in a systems fit approach. Manag Account Res. 2014;25(1):45–62.CrossRef Kristensen TB, Israelsen P. Performance effects of multiple control forms in a Lean organization: A quantitative case study in a systems fit approach. Manag Account Res. 2014;25(1):45–62.CrossRef
27.
go back to reference Ray CD, Zuo X, Michael JH, Wiedenbeck JK. The lean index: operational “Lean” metrics for the wood products industry. Wood Fiber Sci. 2006;38(2):238–55. Ray CD, Zuo X, Michael JH, Wiedenbeck JK. The lean index: operational “Lean” metrics for the wood products industry. Wood Fiber Sci. 2006;38(2):238–55.
28.
go back to reference Malmbrandt M, Åhlström P. An instrument for assessing lean service adoption. Int J Oper Prod Man. 2013;33(9):1131–65.CrossRef Malmbrandt M, Åhlström P. An instrument for assessing lean service adoption. Int J Oper Prod Man. 2013;33(9):1131–65.CrossRef
30.
go back to reference Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: Literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417–32.CrossRefPubMed Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: Literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417–32.CrossRefPubMed
31.
go back to reference Martinez-Mesa J, González-Chica DA, Duquia RP, Bonamigo RR, Bastos JL. Sampling: how to select participants in my research study? An Bras Dermatol. 2016;91(3):326–30.CrossRefPubMedPubMedCentral Martinez-Mesa J, González-Chica DA, Duquia RP, Bonamigo RR, Bastos JL. Sampling: how to select participants in my research study? An Bras Dermatol. 2016;91(3):326–30.CrossRefPubMedPubMedCentral
32.
go back to reference Creswell JW, Plano CV. Designing and conducting mixed methods research. 2nd ed. Los Angeles: Sage; 2011. Creswell JW, Plano CV. Designing and conducting mixed methods research. 2nd ed. Los Angeles: Sage; 2011.
33.
go back to reference Polit DF, Beck CT. Nursing research: Generating and Assessing Evidence for Nursing Practice. 9th ed. Philadelphia: Lippincott Williams & Wilkins; 2012. Polit DF, Beck CT. Nursing research: Generating and Assessing Evidence for Nursing Practice. 9th ed. Philadelphia: Lippincott Williams & Wilkins; 2012.
34.
go back to reference Chapman DW, Carter JF. Translation procedures for the cross cultural use of measurement instruments. Educ Eval Policy An. 1979;1(3):71–6.CrossRef Chapman DW, Carter JF. Translation procedures for the cross cultural use of measurement instruments. Educ Eval Policy An. 1979;1(3):71–6.CrossRef
35.
go back to reference Beatty PC, Willis GB. Research synthesis: The practice of cognitive interviewing. Public Opin Quart. 2007;71(2):287–311.CrossRef Beatty PC, Willis GB. Research synthesis: The practice of cognitive interviewing. Public Opin Quart. 2007;71(2):287–311.CrossRef
36.
go back to reference Collins D. Pretesting survey instruments: An overview of cognitive methods. Qual Life Res. 2003;12:229–38.CrossRefPubMed Collins D. Pretesting survey instruments: An overview of cognitive methods. Qual Life Res. 2003;12:229–38.CrossRefPubMed
37.
go back to reference Tourange R. Cognitive Sciences and Survey Methods. In: Jabine TB, editor. Cognitive aspects of survey methodology: Building a bridge between disciplines. Report of the advanced research seminar on cognitive aspects of survey methodology. Washington: National Academy of Sciences; 1984. p. 73–93. Tourange R. Cognitive Sciences and Survey Methods. In: Jabine TB, editor. Cognitive aspects of survey methodology: Building a bridge between disciplines. Report of the advanced research seminar on cognitive aspects of survey methodology. Washington: National Academy of Sciences; 1984. p. 73–93.
38.
go back to reference Mazzocato P, Savage C, Brommels M, Aronsson HK, Thor J. Lean thinking in healthcare: a realist review of the literature”. Qual Saf Health Care. 2010;19(5):376–82.PubMed Mazzocato P, Savage C, Brommels M, Aronsson HK, Thor J. Lean thinking in healthcare: a realist review of the literature”. Qual Saf Health Care. 2010;19(5):376–82.PubMed
40.
go back to reference Kline R. Principles and Practice of Structural Equation Modeling. 2nd ed. London: The Guilford Press; 2005. Kline R. Principles and Practice of Structural Equation Modeling. 2nd ed. London: The Guilford Press; 2005.
41.
go back to reference Cicchetti DV. Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment instruments in Psychology. Psychol Assessment. 1994;6(4):284–90.CrossRef Cicchetti DV. Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment instruments in Psychology. Psychol Assessment. 1994;6(4):284–90.CrossRef
42.
go back to reference Poksinska B. The current state of Lean implementation in health care: literature review. Qual Manag Health Care. 2010;19(4):319–29.CrossRefPubMed Poksinska B. The current state of Lean implementation in health care: literature review. Qual Manag Health Care. 2010;19(4):319–29.CrossRefPubMed
43.
go back to reference Orlando IJ. The dynamic nurse-patient relationship: Function, process and principles. New York: G. P. Putman’s Sons; 1961. Reprinted 1990, New York: National League for Nursing. Orlando IJ. The dynamic nurse-patient relationship: Function, process and principles. New York: G. P. Putman’s Sons; 1961. Reprinted 1990, New York: National League for Nursing.
45.
go back to reference Hox JJ. From theoretical concepts to survey question. In: Lyberg L, Biemer P, Collins M, DeLeeuw E, Dippo C, Schwarz N, Trewin D, editors. Survey Measurement and Process Quality. New York: John Wiley & Sons, Inc; 1997. p. 47–69. doi:10.1002/9781118490013.ch2. Hox JJ. From theoretical concepts to survey question. In: Lyberg L, Biemer P, Collins M, DeLeeuw E, Dippo C, Schwarz N, Trewin D, editors. Survey Measurement and Process Quality. New York: John Wiley & Sons, Inc; 1997. p. 47–69. doi:10.​1002/​9781118490013.​ch2.
46.
go back to reference Kaner M, Karnia R. A Capability Maturity Model for Knowledge-Based Decision making. Inf Knowl Syst Manage. 2004;4:225–52. Kaner M, Karnia R. A Capability Maturity Model for Knowledge-Based Decision making. Inf Knowl Syst Manage. 2004;4:225–52.
47.
go back to reference Fan W, Yan Z. Factors affecting response rates of the web survey: a systematic review. Comput Human Behav. 2010;26:132–9.CrossRef Fan W, Yan Z. Factors affecting response rates of the web survey: a systematic review. Comput Human Behav. 2010;26:132–9.CrossRef
48.
go back to reference Hagen NA, Stiles C, Nekolaichuk C, Biondo P, Carlson LE, Fisher K, et al. The Alberta Breakthrough Pain Assessment Tool for Cancer Patients: A Validation Study Using a Delphi Process and Patient Think-Aloud Interviews. J Pain Symtom Manag. 2008;35(2):136–52.CrossRef Hagen NA, Stiles C, Nekolaichuk C, Biondo P, Carlson LE, Fisher K, et al. The Alberta Breakthrough Pain Assessment Tool for Cancer Patients: A Validation Study Using a Delphi Process and Patient Think-Aloud Interviews. J Pain Symtom Manag. 2008;35(2):136–52.CrossRef
49.
go back to reference Renberg T, Kettis Lindblad A, Tully MP. Testing the validity of a translated pharmaceutical therapy-related quality of life instrument, using qualitative ‘think aloud’ methodology. J Clin Pharm Ther. 2008;33(3):279–887.CrossRefPubMed Renberg T, Kettis Lindblad A, Tully MP. Testing the validity of a translated pharmaceutical therapy-related quality of life instrument, using qualitative ‘think aloud’ methodology. J Clin Pharm Ther. 2008;33(3):279–887.CrossRefPubMed
51.
go back to reference Conrad F, Blaire J. From Impressions to Data: Increasing the objectivity of cognitive interviews. In: Proceedings of the Section on Survey Research Methods. Washington: American Statistical Association; 1996. Conrad F, Blaire J. From Impressions to Data: Increasing the objectivity of cognitive interviews. In: Proceedings of the Section on Survey Research Methods. Washington: American Statistical Association; 1996.
54.
go back to reference Kazdin AE. Research Design in Clinical Psychology. In: Unites States of America: Pearson Education Limited. 4th ed. 2014. Kazdin AE. Research Design in Clinical Psychology. In: Unites States of America: Pearson Education Limited. 4th ed. 2014.
Metadata
Title
A questionnaire measuring staff perceptions of Lean adoption in healthcare: development and psychometric testing
Authors
Monica Kaltenbrunner
Lars Bengtsson
Svend Erik Mathiassen
Maria Engström
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-017-2163-x

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue