Top

BMC Health Services Research

Published in:

Open Access 01-12-2017 | Research article

Cross-cultural validation and psychometric testing of the Norwegian version of the TeamSTEPPS® teamwork perceptions questionnaire

Authors: Randi Ballangrud, Sissel Eikeland Husebø, Marie Louise Hall-Lord

Published in: BMC Health Services Research | Issue 1/2017

Abstract

Background

Teamwork is an integrated part of today’s specialized and complex healthcare and essential to patient safety, and is considered as a core competency to improve twenty-first century healthcare. Teamwork measurements and evaluations show promising results to promote good team performance, and are recommended for identifying areas for improvement. The validated TeamSTEPPS® Teamwork Perception Questionnaire (T-TPQ) was found suitable for cross-cultural validation and testing in a Norwegian context. T-TPQ is a self-report survey that examines five dimensions of perception of teamwork within healthcare settings. The aim of the study was to translate and cross-validate the T-TPQ into Norwegian, and test the questionnaire for psychometric properties among healthcare personnel.

Methods

The T-TPQ was translated and adapted to a Norwegian context according to a model of a back-translation process. A total of 247 healthcare personnel representing different professionals and hospital settings responded to the questionnaire. A confirmatory factor analysis was carried out to test the factor structure. Cronbach’s alpha was used to establish internal consistency, and an Intraclass Correlation Coefficient was used to assess the test - retest reliability.

Result

A confirmatory factor analysis showed an acceptable fitting model (χ² (df) 969.46 (546), p < 0.001, Root Mean Square Error of Approximation (RMSEA) = 0.056, Tucker-Lewis Index (TLI) = 0.88, Comparative fit index (CFI) = 0.89, which indicates that each set of the items that was supposed to accompany each teamwork dimension clearly represents that specific construct. The Cronbach’s alpha demonstrated acceptable values on the five subscales (0.786–0.844), and test-retest showed a reliability parameter, with Intraclass Correlation Coefficient scores from 0.672 to 0.852.

Conclusion

The Norwegian version of T-TPQ was considered to be acceptable regarding the validity and reliability for measuring Norwegian individual healthcare personnel’s perception of group level teamwork within their unit. However, it needs to be further tested, preferably in a larger sample and in different clinical settings.

Available only for authorised users

Weaver SJ, Feitosa J, Salas E, Seddon R, Vozenilek JA. The theoretical drivers and models of team performance and effectiveness for patient safety. In: Salas E, Frush K, editors. Improving patient safety through teamwork and team training. New York: Oxford University Press; 2013. p. 3–26.

Baker D, Gustafson S, Beaubien J, Salas E, Barach P. Medical teamwork and patient safety: the evidence-based relation. Washington, DC: American Institutes for Research; 2007.

IOM. Health Professions Education: A Bridge to Quality. National Academies Press; 2003.

Jha A, Prasopa-Plaizier N, Larizgoitia I, Bates D. Patient safety research: an overview of the global evidence. Qual Saf Health Care. 2010;19(1):42–7. https://doi.org/10.1136/qshc.2008.029165.CrossRefPubMed

Rafter N, Hickey A, Conroy RM, Condell S, O'Connor P, Vaughan D et al. The Irish National Adverse Events Study (INAES): the frequency and nature of adverse events in Irish hospitals—a retrospective record review study. BMJ Qual Saf. 2016:bmjqs-2015-004828. doi:https://doi.org/10.1136/bmjqs-2015-004828.

de Vries EN, Ramrattan MA, Smorenburg SM, Gouma DJ, Boermeester MA. The incidence and nature of in-hospital adverse events: a systematic review. Qual Saf Health Care. 2008;17(3):216–23. https://doi.org/10.1136/qshc.2007.023622.CrossRefPubMedPubMedCentral

Pham JC, Aswani MS, Rosen M, Lee H, Huddle M, Weeks K, et al. Reducing medical errors and adverse events. Annu Rev Med. 2012;63:447–63. https://doi.org/10.1146/annurev-med-061410-121352.CrossRefPubMed

Manser T. Teamwork and patient safety in dynamic domains of healthcare: a review of the literature. Acta Anaesthesiol Scand. 2009;53(2):143–51. https://doi.org/10.1111/j.1399-6576.2008.01717.x.CrossRefPubMed

Källberg A-S, Göransson KE, Florin J, Östergren J, Brixey JJ, Ehrenberg A. Contributing factors to errors in Swedish emergency departments. Int Emerg Nurs. 2015;23(2):156–61. https://doi.org/10.1016/j.ienj.2014.10.002.CrossRefPubMed

10.

Georgiou A, Lockey DJ. The performance and assessment of hospital trauma teams. Scand J Trauma Resusc Emerg Med. 2010;18(1):1. https://doi.org/10.1186/1757-7241-18-66. CrossRef

11.

Rabøl LI, Andersen ML, Østergaard D, Bjørn B, Lilja B, Mogensen T. Descriptions of verbal communication errors between staff. An analysis of 84 root cause analysis-reports from Danish hospitals. BMJ Qual Saf. 2011;20(3):268–74. https://doi.org/10.1136/pgmj.2010.040238rep. CrossRefPubMed

12.

Bleetman A, Sanusi S, Dale T, Brace S. Human factors and error prevention in emergency medicine. Emerg Med J. 2012;29(5):389–93. https://doi.org/10.1136/emj.2010.107698.CrossRefPubMed

13.

Weaver SJ, Rosen MA, DiazGranados D, Lazzara EH, Lyons R, Salas E, et al. Does teamwork improve performance in the operating room? A multilevel evaluation. Jt Comm J Qual Patient Saf. 2010;36(3):133–42.CrossRefPubMed

14.

Oandasan I, Ross Baker GR, Barker K, Bosco C, D’Amour D. Teamwork in healthcare: promoting effective teamwork in healthcare in Canada, Policy synthesis and recommendations. Canadian Health Services Research Foundation: Ottawa; 2006.

15.

Wisborg T, Castren M, Lippert A, Valsson F, Wallin C. Training trauma teams in the Nordic countries: an overview and present status. Acta Anaesthesiol Scand. 2005;49(7):1004–9. https://doi.org/10.1111/j.1399-6576.2005.00742.x.CrossRefPubMed

16.

Ringen AH, Hjortdahl M, Wisborg T. Norwegian trauma team leaders-training and experience: a national point prevalence study. Scand J Trauma Resusc Emerg Med. 2011;19(1):54. https://doi.org/10.1186/1757-7241-19-54CrossRefPubMedPubMedCentral

17.

Wisborg T, Brattebø G, Brinchmann-Hansen Å, Uggen PE, Hansen KS. Effects of nationwide training of multiprofessional trauma teams in norwegian hospitals. J Trauma. 2008;64(6):1613–8. https://doi.org/10.1097/TA.0b013e31812eed68.CrossRefPubMed

18.

Wisborg T, Brattebø G, Brinchmann-Hansen Å, Hansen KS. Mannequin or standardized patient: participants' assessment of two training modalities in trauma team simulation. Scand J Trauma Resusc Emerg Med. 2009;17(1):59. https://doi.org/10.1186/1757-7241-17-59CrossRefPubMedPubMedCentral

19.

Husebø SE, Olsen ØE. Impact of clinical leadership in teams’ course on quality, efficiency, responsiveness and trust in the emergency department: study protocol of a trailing research study. BMJ Open. 2016;6(8):e011899. https://doi.org/10.1136/bmjopen-2016-011899. CrossRefPubMedPubMedCentral

20.

Husebø SE, Wiig S, V. G, Storm M, Sætre Hansen B. Status of Nordic research on patient safety and quality of care In: Aase K, Schibevaag L, editors. Researching patient safety and quality in healthcare: a Nordic perspective. Boca Raton: CRC Press/Taylor & Francis; 2017.

21.

Baker D, Salas E, Battles J, King H. The relation between teamwork and patient safety. In: Carayon P, editor. Human factors and ergonomics in health care and patient safety. Boca Raton: CRC Press; 2012.

22.

Alonso A, Baker DP, Holtzman A, Day R, King H, Toomey L, et al. Reducing medical error in the military health system: how can team training help? Hum Resour Manag Rev. 2006;16(3):396–415. https://doi.org/10.1016/j.hrmr.2006.05.006.CrossRef

23.

Alonso A, Dunleavy D. Building teamwork skills in healthcare: the case for communication and coordination competencies. In: Frush K, Salas E, editors. Improving patient safety through teamwork and team training. Oxford: Oxford University Press, USA; 2012. p. 41–58.

24.

Salas E, Sims DE, Burke CS. Is there a “big five” in teamwork? Small Group Res. 2005;36(5):555–99. https://doi.org/10.1177/1046496405277134.CrossRef

25.

King HB, Battles J, Baker DP, Alonso A, Salas E, Webster J, et al. TeamSTEPPS™: team strategies and tools to enhance performance and patient safety. In: Henriksen K, Battles JB, Keyes MA, Grady MLB, editors. Advances in patient safety: new directions and alternative approaches. Rockville (MD): Agency for Healthcare Research and Quality; 2008.

26.

Kotter JP, Mueller P, Rathgeber H. Our iceberg is melting: changing and succeeding under any conditions. London: Macmillan; 2006.

27.

Capella J, Smith S, Philp A, Putnam T, Gilbert C, Fry W, et al. Teamwork training improves the clinical care of trauma patients. J Surg Educ. 2010;67(6):439–43. https://doi.org/10.1016/j.jsurg.2010.06.006.CrossRefPubMed

28.

Mayer CM, Cluff L, Lin WT, Willis TS, Stafford RE, Williams C, et al. Evaluating efforts to optimize TeamSTEPPS implementation in surgical and pediatric intensive care units. Jt Comm J Qual Patient Saf. 2011;37(8):365-3AP.

29.

Thomas L, Galla C. Republished: building a culture of safety through team training and engagement. Postgrad Med J. 2013;89(1053):394–401. https://doi.org/10.1136/postgradmedj-2012-001011rep.CrossRefPubMed

30.

Deering S, Rosen MA, Ludi V, Munroe M, Pocrnich A, Laky C, et al. On the front lines of patient safety: implementation and evaluation of team training in Iraq. Jt Comm J Qual Patient Saf. 2011;37(8):350–6.CrossRefPubMed

31.

Forse RA, Bramble J, McQuillan R. Team training can improve operating room performance. Surgery. 2011;150(4):771–8. https://doi.org/10.1016/j.surg.2011.07.076.CrossRef

32.

Rosen MA, Pronovost P. Teamwork in healthcare: from training programs to intergrated system of developement. In: Salas E, Frush K, editors. Improving patient safety through teamwork and team training. New York: Oxford University Press; 2013. p. 239–43.

33.

Reeves S, Lewin S, Espin S, Zwarenstein M. Interprofessional teamwork for health and social care. Chichester: Wiley-Blackwell; 2010.CrossRef

34.

Aase I, Aase K, Dieckmann P. Teaching interprofessional teamwork in medical and nursing education in Norway: a content analysis. J Interprof Care. 2013;27(3):238–45. https://doi.org/10.3109/13561820.2012.745489.CrossRefPubMed

35.

Rosen MA, Dietz AS, Yang T, Priebe CE, Pronovost PJ. An integrative framework for sensor-based measurement of teamwork in healthcare. J of the Am Med Inform Assoc. 2015:amiajnl-2013-002606. doi:https://doi.org/10.1136/amiajnl-2013-002606.

36.

Rosen M, Schiebel N, Salas E. How can team performance be measured, assessed, and dignosed? In: Frush K, Salas E, editors. Improving patient safety through teamwork and team training. Oxford: Oxford University Press, USA; 2012.

37.

Valentine MA, Nembhard IM, Edmondson AC. Measuring teamwork in health care settings: a review of survey instruments. MedCare. 2015;53(4):e16–30. https://doi.org/10.1097/MLR.0b013e31827feef6.

38.

American Institutes for Research. TeamSTEPPS® teamwork perceptions questionnaire (T-TPQ) manual. Washington, DC: American Institutes for Research; 2010.

39.

Keebler JR, Dietz AS, Lazzara EH, Benishek LE, Almeida SA, Toor PA, et al. Validation of a teamwork perceptions measure to increase patient safety. BMJ Qual Saf. 2014;13:1–9. https://doi.org/10.1136/bmjqs-2013-001942.

40.

Brandão CS, Fernandes DC, Collares CF, Fernandes GR, Marin HF. Translation and back-translation of the TeamSTEPPS® teamwork assessment tool for use in simulation teaching in Brazil. Sci Med. 2016;26(4):24622. http://dx.doi.org/10.15448/1980-6108.2016.4.24622. CrossRef

41.

Hwang J-I, Ahn J. Teamwork and clinical error reporting among nurses in Korean hospitals. Asian Nurs Res. 2015;9(1):14–20. https://doi.org/10.1016/j.anr.2014.09.002. CrossRef

42.

Polit DF, Beck CT. Nursing research. Generating and assessing evidence for nursing practice. Philadelphia: Wolters Kluwer; 2017.

43.

Brislin RW. Back-translation for cross-cultural research. J Cross-Cult Psychol. 1970;1(3):185–216. https://doi.org/10.1177/135910457000100301.CrossRef

44.

Solano-Flores W, Hurtado M. CAHPS Guidelines for assessing and selecting translators and reviewers. American Institutes for Research (AIR) Team; 2005.

45.

Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract. 2011;17(2):268–74. https://doi.org/10.1111/j.1365-2753.2010.01434.x.CrossRefPubMed

46.

Blunch NJ. Introduction to structural equation modeling using IBM SPSS statistics and AMOS. 2nd ed. SAGE: Los Angeles, Calif; 2013.CrossRef

47.

Fox-Wasylyshyn SM, El-Masri MM. Handling missing data in self-report measures. Res Nurs Health. 2005;28(6):488–95.CrossRefPubMed

48.

Polit DF, Yang FM. Measurement and the measurement of change: a primer for health professionals. Philadelphia: Wolters Kluwer; 2016.

49.

Byrne BM. Structural equation modeling with AMOS: basic concepts, applications, and programming. 2nd ed. multivariate applications series. New York: Psychology Press; 2010.

50.

Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55. https://doi.org/10.1080/10705519909540118.

51.

Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. Oxford: Oxford University Press; 2008.CrossRef

52.

Brislin RW. The wording and translation of research instruments. In: Lonner WJ, Berry JW, editors. Field methods in cross-cultural research. Beverly Hills: Sage; 1986. p. 137–64.

53.

Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45. https://doi.org/10.1016/j.jclinepi.2010.02.006.CrossRefPubMed

54.

Ballangrud R, Hall-Lord ML, Persenius M, Hedelin B. Intensive care nurses’ perceptions of simulation-based team training for building patient safety in intensive care: a descriptive qualitative study. Intensive Crit Care Nurs. 2014;30(4):179–87. https://doi.org/10.1016/j.iccn.2014.03.002.CrossRefPubMed

55.

Salas E, Rosen MA. Building high reliability teams: progress and some reflections on teamwork training. BMJ Qual Saf. 2013;22(5):369–73. https://doi.org/10.1136/bmjqs-2013-002015.CrossRefPubMed

56.

Polit DF, Beck CT. Nursing research: generating and assessing evidence for nursing practice. Philadelphia: Wolters Kluwer; 2016.

57.

Gustafsson J-E. Strukturella ekvationsmodeller. In: Djurfeldt G, Barmark M, editors. Statistisk verktyglåda - multivariat analys. Lund, Sweden: Studentlittertur; 2009.

58.

MacCallum RC, Austin JT. Applications of structural equation modeling in psychological research. Annu Rev Psychol. 2000;51(1):201–26. https://doi.org/10.1146/annurev.psych.51.1.201 CrossRefPubMed

59.

Hair JF. Multivariate data analysis. 7th., Pearson new international ed. Pearson: Harlow; 2014.

60.

Polit D. Getting serious about test–retest reliability: a critique of retest research and some recommendations. Intl J Qual Life Aspects Treatment Care Rehabil. 2014;23(6):1713–20. https://doi.org/10.1007/s11136-014-0632-9.CrossRef

61.

Asch DA, Jedrziewski MK, Christakis NA. Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997;50(10):1129–36. https://doi.org/10.1016/S0895-4356(97)00126-1 CrossRefPubMed

62.

Cook JV, Dickinson HO, Eccles MP. Response rates in postal surveys of healthcare professionals between 1996 and 2005: an observational study. BMC Health Serv Res. 2009;9(1):160. https://doi.org/10.1186/1472-6963-9-160.CrossRefPubMedPubMedCentral

63.

Muller-Juge V, Cullati S, Blondon KS, Hudelson P, Maître F, NV V, et al. Interprofessional collaboration on an internal medicine ward: role perceptions and expectations among nurses and residents. PLoS One. 2013;8(2):e57570. https://doi.org/10.1371/journal.pone.0057570.CrossRefPubMedPubMedCentral

64.

Aase I, Hansen BS, Aase K. Norwegian nursing and medical students' perception of interprofessional teamwork: a qualitative study. BMC Med Educ. 2014;14:1–8. https://doi.org/10.1186/1472-6920-14-170 CrossRef

65.

World Medical Association, World Medical Association Declaration of Helsinki. Ethical principles for medical research involving human subjects. Bull World Health Organ. 2001;79(4):373–4.PubMedCentral

Title: Cross-cultural validation and psychometric testing of the Norwegian version of the TeamSTEPPS® teamwork perceptions questionnaire
Authors: Randi Ballangrud
Sissel Eikeland Husebø
Marie Louise Hall-Lord
Publication date: 01-12-2017
Publisher: BioMed Central
Published in: BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI: https://doi.org/10.1186/s12913-017-2733-y

At a glance: The STEP trials

Springer Medicine

Cross-cultural validation and psychometric testing of the Norwegian version of the TeamSTEPPS® teamwork perceptions questionnaire

Abstract

Background

Methods

Result

Conclusion

At a glance: The STEP trials

Springer Medicine

Abstract

Background

Methods

Result

Conclusion

Please log in to get access to this content

Other articles of this Issue 1/2017

Measurement of special access to home visit nursing services among Japanese disabled elderly people: using GIS and claim data

Challenges, uncertainties and perceived benefits of providing weekend allied health services—a managers’ perspective

Cancer related fatigue: implementing guidelines for optimal management

The contribution of female community health volunteers (FCHVs) to maternity care in Nepal: a qualitative study

Construction of a simulation model and evaluation of the effect of potential interventions on the incidence of diabetes and initiation of dialysis due to diabetic nephropathy in Japan

Variation in rates of ICU readmissions and post-ICU in-hospital mortality and their association with ICU discharge practices