Skip to main content
Top
Published in: BMC Health Services Research 1/2019

Open Access 01-12-2019 | Research article

A mixed-methods evaluation of the MOREOB program in Ontario hospitals: participant knowledge, organizational culture, and experiences

Authors: Jessica Reszel, Deborah Weiss, Ann E. Sprague, Deshayne B. Fell, Sandra Dunn, Mark C. Walker, Dana Sidney, Monica Taljaard, Wendy E. Peterson

Published in: BMC Health Services Research | Issue 1/2019

Login to get access

Abstract

Background

MOREOB (Managing Obstetrical Risk Efficiently) is a patient safety program for health care providers and administrators in hospital obstetric units. MOREOB has been implemented widely in Canada and gradually spread to the United States. The main goal of MOREOB is to build a patient safety culture and improve clinical outcomes. In 2013, 26 Ontario hospitals voluntarily accepted provincial funding to participate in MOREOB. The purpose of our study was to assess the effect of MOREOB on participant knowledge, organizational culture, and experiences implementing and participating in the program at these 26 Ontario hospitals.

Methods

A convergent parallel mixed-methods study in Ontario, Canada, with MOREOB participants from 26 hospitals. The quantitative component used a descriptive pre-post repeated measures design to assess participant knowledge and perception of culture, administered pre-MOREOB and after each of the three MOREOB modules. Changes in mean scores were assessed using mixed-effects regression. The qualitative component used a qualitative descriptive design with individual semi-structured interviews. We used content analysis to code, categorize, and thematically describe data. A convergent parallel design was used to triangulate findings from data sources.

Results

308 participants completed the knowledge test, and 329 completed the culture assessment at all four time points. Between baseline and post-Module 3, statistically significant increases on both scores were observed, with an increase of 7.9% (95% CI: 7.1 to 8.8) on the knowledge test and an increase of 0.45 (on a scale of 1–5, 95% CI: 0.38 to 0.52) on the culture assessment. Interview participants (n = 15) described improvements in knowledge, interprofessional communication, ability to provide safe care, and confidence in skills. Facilitators and barriers to program implementation and sustainability were identified.

Conclusions

Participants were satisfied with their participation in the MOREOB program and perceived that it increased health care provider knowledge and confidence, improved safety for patients, and improved communication between team members. Additionally, mean scores on knowledge tests for obstetric content and culture assessment improved. The MOREOB program can help organizations and individuals improve care by concentrating on the human and organizational aspects of patient safety. Further work to improve program implementation and sustainability is required.
Appendix
Available only for authorised users
Literature
4.
go back to reference Liu S, Joseph KS, Bartholomew S, Fahey J, Lee L, Allen AC, et al. Temporal trends and regional variations in severe maternal morbidity in Canada, 2003 to 2007. J Obs Gynaecol Can. 2010;32:847–55.CrossRef Liu S, Joseph KS, Bartholomew S, Fahey J, Lee L, Allen AC, et al. Temporal trends and regional variations in severe maternal morbidity in Canada, 2003 to 2007. J Obs Gynaecol Can. 2010;32:847–55.CrossRef
5.
go back to reference Kohn LT, Corrigan JM, Donaldson MS. To err is human: building a safer health system. Washington, DC: National Academy Press; 1999. Kohn LT, Corrigan JM, Donaldson MS. To err is human: building a safer health system. Washington, DC: National Academy Press; 1999.
7.
go back to reference Nielsen PE, Goldman MB, Mann S, Shapiro DE, Marcus RG, Pratt SD, et al. Effects of teamwork training on adverse outcomes and process of care in labor and delivery: a randomized controlled trial. Obstet Gynecol. 2007;109:48–55.CrossRef Nielsen PE, Goldman MB, Mann S, Shapiro DE, Marcus RG, Pratt SD, et al. Effects of teamwork training on adverse outcomes and process of care in labor and delivery: a randomized controlled trial. Obstet Gynecol. 2007;109:48–55.CrossRef
8.
go back to reference Pettker CM, Thung SF, Norwitz ER, Buhimschi CS, Raab CA, Copel JA, et al. Impact of a comprehensive patient safety strategy on obstetric adverse events. Am J Obstet Gynecol. 2009;200:492.e1–8.CrossRef Pettker CM, Thung SF, Norwitz ER, Buhimschi CS, Raab CA, Copel JA, et al. Impact of a comprehensive patient safety strategy on obstetric adverse events. Am J Obstet Gynecol. 2009;200:492.e1–8.CrossRef
9.
go back to reference Pettker CM, Thung SF, Lipkind HS, Illuzzi JL, Buhimschi CS, Raab CA, et al. A comprehensive obstetric patient safety program reduces liability claims and payments. Am J Obstet Gynecol. 2014;211:319–25.CrossRef Pettker CM, Thung SF, Lipkind HS, Illuzzi JL, Buhimschi CS, Raab CA, et al. A comprehensive obstetric patient safety program reduces liability claims and payments. Am J Obstet Gynecol. 2014;211:319–25.CrossRef
14.
go back to reference Salus Global Corporation. The MOREOB program overview 2012–2013. London; 2013. Salus Global Corporation. The MOREOB program overview 2012–2013. London; 2013.
15.
go back to reference Thanh NX, Jacobs P, Wanke MI, Hense A, Sauve R. Outcomes of the introduction of the MOREOB continuing education program in Alberta. J Obstet Gynaecol Can. 2010;32:749–55.CrossRef Thanh NX, Jacobs P, Wanke MI, Hense A, Sauve R. Outcomes of the introduction of the MOREOB continuing education program in Alberta. J Obstet Gynaecol Can. 2010;32:749–55.CrossRef
18.
go back to reference Milne J, Walker D, Vlahaki D, Milne J, Walker D, Vlahaki D. Reflections on the Canadian MORE (OB) obstetrical risk management programme. Best Pr Res Clin Obs Gynaecol. 2013;27:563–9.CrossRef Milne J, Walker D, Vlahaki D, Milne J, Walker D, Vlahaki D. Reflections on the Canadian MORE (OB) obstetrical risk management programme. Best Pr Res Clin Obs Gynaecol. 2013;27:563–9.CrossRef
19.
go back to reference Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs-principles and practices. Health Serv Res. 2013;48:2134–56.CrossRef Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs-principles and practices. Health Serv Res. 2013;48:2134–56.CrossRef
20.
go back to reference Creswell JW. Research design - qualitative, quantitative, and mixed methods approaches. 4th ed. Thousand Oaks, California: SAGE Publications, Inc; 2014. Creswell JW. Research design - qualitative, quantitative, and mixed methods approaches. 4th ed. Thousand Oaks, California: SAGE Publications, Inc; 2014.
21.
go back to reference Milne JK, Bendaly N, Bendaly L, Worsley J, Fitzgerald J, Nisker J. A measurement tool to assess culture change regarding patient safety in hospital obstetrical units. J Obstet Gynaecol Can. 2010;32:590–7.CrossRef Milne JK, Bendaly N, Bendaly L, Worsley J, Fitzgerald J, Nisker J. A measurement tool to assess culture change regarding patient safety in hospital obstetrical units. J Obstet Gynaecol Can. 2010;32:590–7.CrossRef
22.
go back to reference Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23:334–40.CrossRef Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23:334–40.CrossRef
23.
go back to reference Sandelowski M. What’s in a name? Qualitative description revisited. Res Nurs Health. 2010;33:77–84.PubMed Sandelowski M. What’s in a name? Qualitative description revisited. Res Nurs Health. 2010;33:77–84.PubMed
24.
go back to reference Kim H, Sefcik JS, Bradway C. Characteristics of qualitative descriptive studies: a systematic review. Res Nurs Health. 2017;40:23–42.CrossRef Kim H, Sefcik JS, Bradway C. Characteristics of qualitative descriptive studies: a systematic review. Res Nurs Health. 2017;40:23–42.CrossRef
25.
go back to reference Malterud K, Siersma VD, Guassora AD. Sample size in qualitative interview studies. Qual Health Res. 2016;26:1753–60.CrossRef Malterud K, Siersma VD, Guassora AD. Sample size in qualitative interview studies. Qual Health Res. 2016;26:1753–60.CrossRef
26.
go back to reference Thorne S. Interpretive description: qualitative research for applied practice. 2nd ed. New York: Routledge Taylor & Francis Group; 2016.CrossRef Thorne S. Interpretive description: qualitative research for applied practice. 2nd ed. New York: Routledge Taylor & Francis Group; 2016.CrossRef
27.
go back to reference QSR International Pty Ltd. NVivo 11 for Windows. 2015. QSR International Pty Ltd. NVivo 11 for Windows. 2015.
28.
go back to reference Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15:1277–88.CrossRef Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15:1277–88.CrossRef
29.
go back to reference Bradshaw C, Atkinson S, Doody O. Employing a qualitative description approach in health care research. Glob Qual Nurs Res. 2017;4:1–8. Bradshaw C, Atkinson S, Doody O. Employing a qualitative description approach in health care research. Glob Qual Nurs Res. 2017;4:1–8.
30.
go back to reference Graneheim U, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today. 2004;24:105–12.CrossRef Graneheim U, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today. 2004;24:105–12.CrossRef
31.
go back to reference Cornthwaite K, Edwards S, Siassakos D. Reducing risk in maternity by optimising teamwork and leadership: an evidence-based approach to save mothers and babies. Best Pract Res Clin Obstet Gynaecol. 2013;27:571–81.CrossRef Cornthwaite K, Edwards S, Siassakos D. Reducing risk in maternity by optimising teamwork and leadership: an evidence-based approach to save mothers and babies. Best Pract Res Clin Obstet Gynaecol. 2013;27:571–81.CrossRef
32.
go back to reference Guise J-M, Segel S. Teamwork in obstetric critical care. Best Pract Res Clin Obstet Gynaecol. 2008;22:937–51.CrossRef Guise J-M, Segel S. Teamwork in obstetric critical care. Best Pract Res Clin Obstet Gynaecol. 2008;22:937–51.CrossRef
33.
go back to reference Green B, Oeppen RS, Smith DW, Brennan PA. Challenging hierarchy in healthcare teams – ways to flatten gradients to improve teamwork and patient care. Br J Oral Maxillofac Surg. 2017;55:449–53.CrossRef Green B, Oeppen RS, Smith DW, Brennan PA. Challenging hierarchy in healthcare teams – ways to flatten gradients to improve teamwork and patient care. Br J Oral Maxillofac Surg. 2017;55:449–53.CrossRef
35.
go back to reference Kapur N, Parand A, Soukup T, Reader T, Sevdalis N. Aviation and healthcare: a comparative review with implications for patient safety. JRSM Open. 2015;7:1–10. Kapur N, Parand A, Soukup T, Reader T, Sevdalis N. Aviation and healthcare: a comparative review with implications for patient safety. JRSM Open. 2015;7:1–10.
36.
go back to reference Skinner L, Tripp TR, Scouler D, Pechacek JM. Partnerships with aviation: promoting a culture of safety in health care. Creat Nurs. 2015;21:179–85.CrossRef Skinner L, Tripp TR, Scouler D, Pechacek JM. Partnerships with aviation: promoting a culture of safety in health care. Creat Nurs. 2015;21:179–85.CrossRef
37.
go back to reference Raab CA, Will SEB, Richards SL, O’Mara E. The effect of collaboration on obstetric patient safety in three academic facilities. J Obstet Gynecol Neonatal Nurs. 2013;42:606–16.CrossRef Raab CA, Will SEB, Richards SL, O’Mara E. The effect of collaboration on obstetric patient safety in three academic facilities. J Obstet Gynecol Neonatal Nurs. 2013;42:606–16.CrossRef
38.
go back to reference Pratt SD, Mann S, Salisbury M, Greenberg P, Marcus R, Stabile B, et al. Impact of CRM–based team training on obstetric outcomes and clinicians’ patient safety attitudes. Jt Comm J Qual Patient Saf. 2007;33:720–5.CrossRef Pratt SD, Mann S, Salisbury M, Greenberg P, Marcus R, Stabile B, et al. Impact of CRM–based team training on obstetric outcomes and clinicians’ patient safety attitudes. Jt Comm J Qual Patient Saf. 2007;33:720–5.CrossRef
39.
go back to reference Haller G, Morales M, Pfister R, Garnerin P, Chipp P, Guillemot V, et al. Improving interprofessional teamwork in obstetrics: a crew resource management based training programme. J Interprof Care. 2008;22:545–8.CrossRef Haller G, Morales M, Pfister R, Garnerin P, Chipp P, Guillemot V, et al. Improving interprofessional teamwork in obstetrics: a crew resource management based training programme. J Interprof Care. 2008;22:545–8.CrossRef
40.
go back to reference Mancuso MP, Dziadkowiec O, Kleiner C, Halverson-Carpenter K, Link T, Barry J. Crew resource management for obstetric and neonatal teams to improve communication during cesarean births. J Obstet Gynecol Neonatal Nurs. 2016;45:502–14.CrossRef Mancuso MP, Dziadkowiec O, Kleiner C, Halverson-Carpenter K, Link T, Barry J. Crew resource management for obstetric and neonatal teams to improve communication during cesarean births. J Obstet Gynecol Neonatal Nurs. 2016;45:502–14.CrossRef
41.
go back to reference Bradley EH, Brewster AL, McNatt Z, Linnander EL, Cherlin E, Fosburgh H, et al. How guiding coalitions promote positive culture change in hospitals: a longitudinal mixed methods interventional study. BMJ Qual Saf. 2018;27:218–25.CrossRef Bradley EH, Brewster AL, McNatt Z, Linnander EL, Cherlin E, Fosburgh H, et al. How guiding coalitions promote positive culture change in hospitals: a longitudinal mixed methods interventional study. BMJ Qual Saf. 2018;27:218–25.CrossRef
42.
go back to reference Pettker CM, Thung SF, Raab CA, Donohue KP, Copel JA, Lockwood CJ, et al. A comprehensive obstetrics patient safety program improves safety climate and culture. Am J Obstet Gynecol. 2011;204:216.e1–6.CrossRef Pettker CM, Thung SF, Raab CA, Donohue KP, Copel JA, Lockwood CJ, et al. A comprehensive obstetrics patient safety program improves safety climate and culture. Am J Obstet Gynecol. 2011;204:216.e1–6.CrossRef
43.
go back to reference Simpson KR, Knox GE, Martin M, George C, Watson SR. Michigan health & hospital association keystone obstetrics: a statewide collaborative for perinatal patient safety in Michigan. Jt Comm J Qual Patient Saf. 2011;37:544–52.CrossRef Simpson KR, Knox GE, Martin M, George C, Watson SR. Michigan health & hospital association keystone obstetrics: a statewide collaborative for perinatal patient safety in Michigan. Jt Comm J Qual Patient Saf. 2011;37:544–52.CrossRef
44.
go back to reference Braithwaite J, Herkes J, Ludlow K, Testa L, Lamprell G. Association between organisational and workplace cultures, and patient outcomes: systematic review. BMJ Open. 2017;7:e017708.CrossRef Braithwaite J, Herkes J, Ludlow K, Testa L, Lamprell G. Association between organisational and workplace cultures, and patient outcomes: systematic review. BMJ Open. 2017;7:e017708.CrossRef
45.
go back to reference Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7:37.CrossRef Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7:37.CrossRef
46.
go back to reference Sammer CE, Lykens K, Singh KP, Mains DA, Lackan NA. What is patient safety culture? A review of the literature. J Nurs Scholarsh. 2010;42:156–65.CrossRef Sammer CE, Lykens K, Singh KP, Mains DA, Lackan NA. What is patient safety culture? A review of the literature. J Nurs Scholarsh. 2010;42:156–65.CrossRef
47.
go back to reference Graham I, Logan J, Harrison M, Straus S, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Heal Prof. 2006;26:13–24.CrossRef Graham I, Logan J, Harrison M, Straus S, Tetroe J, Caswell W, et al. Lost in knowledge translation: time for a map? J Contin Educ Heal Prof. 2006;26:13–24.CrossRef
49.
go back to reference Okuyama A, Wagner C, Bijnen B. Speaking up for patient safety by hospital-based health care professionals: a literature review. BMC Health Serv Res. 2014;14:61.CrossRef Okuyama A, Wagner C, Bijnen B. Speaking up for patient safety by hospital-based health care professionals: a literature review. BMC Health Serv Res. 2014;14:61.CrossRef
Metadata
Title
A mixed-methods evaluation of the MOREOB program in Ontario hospitals: participant knowledge, organizational culture, and experiences
Authors
Jessica Reszel
Deborah Weiss
Ann E. Sprague
Deshayne B. Fell
Sandra Dunn
Mark C. Walker
Dana Sidney
Monica Taljaard
Wendy E. Peterson
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2019
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-019-4224-9

Other articles of this Issue 1/2019

BMC Health Services Research 1/2019 Go to the issue