Skip to main content
Top
Published in: Journal of General Internal Medicine 8/2018

01-08-2018 | Original Research

Maslach Burnout Inventory and a Self-Defined, Single-Item Burnout Measure Produce Different Clinician and Staff Burnout Estimates

Authors: Margae Knox, MPH, Rachel Willard-Grace, MPH, Beatrice Huang, BA, Kevin Grumbach, MD

Published in: Journal of General Internal Medicine | Issue 8/2018

Login to get access

Abstract

Background

Clinicians and healthcare staff report high levels of burnout. Two common burnout assessments are the Maslach Burnout Inventory (MBI) and a single-item, self-defined burnout measure. Relatively little is known about how the measures compare.

Objective

To identify the sensitivity, specificity, and concurrent validity of the self-defined burnout measure compared to the more established MBI measure.

Design

Cross-sectional survey (November 2016–January 2017).

Participants

Four hundred forty-four primary care clinicians and 606 staff from three San Francisco Aarea healthcare systems.

Main Measures

The MBI measure, calculated from a high score on either the emotional exhaustion or cynicism subscale, and a single-item measure of self-defined burnout. Concurrent validity was assessed using a validated, 7-item team culture scale as reported by Willard-Grace et al. (J Am Board Fam Med 27(2):229–38, 2014) and a standard question about workplace atmosphere as reported by Rassolian et al. (JAMA Intern Med 177(7):1036–8, 2017) and Linzer et al. (Ann Intern Med 151(1):28–36, 2009).

Key Results

Similar to other nationally representative burnout estimates, 52% of clinicians (95% CI: 47–57%) and 46% of staff (95% CI: 42–50%) reported high MBI emotional exhaustion or high MBI cynicism. In contrast, 29% of clinicians (95% CI: 25–33%) and 31% of staff (95% CI: 28–35%) reported “definitely burning out” or more severe symptoms on the self-defined burnout measure. The self-defined measure’s sensitivity to correctly identify MBI-assessed burnout was 50.4% for clinicians and 58.6% for staff; specificity was 94.7% for clinicians and 92.3% for staff. Area under the receiver operator curve was 0.82 for clinicians and 0.81 for staff. Team culture and atmosphere were significantly associated with both self-defined burnout and the MBI, confirming concurrent validity.

Conclusions

Point estimates of burnout notably differ between the self-defined and MBI measures. Compared to the MBI, the self-defined burnout measure misses half of high-burnout clinicians and more than 40% of high-burnout staff. The self-defined burnout measure has a low response burden, is free to administer, and yields similar associations across two burnout predictors from prior studies. However, the self-defined burnout and MBI measures are not interchangeable.
Appendix
Available only for authorised users
Literature
2.
go back to reference Agency for Healthcare Quality and Research. AHRQ Announces Interest in Innovative Primary Care Research. Notice Number: NOT-HS-16-011. 2016. Agency for Healthcare Quality and Research. AHRQ Announces Interest in Innovative Primary Care Research. Notice Number: NOT-HS-16-011. 2016.
4.
6.
go back to reference Society for General Internal Medicine, editor Resilience and Grit: Pursuing Organizational Change and Preventing Burnout in GIM. SGIM Annual Meeting; 2017 April 19–22; Washington, DC. Society for General Internal Medicine, editor Resilience and Grit: Pursuing Organizational Change and Preventing Burnout in GIM. SGIM Annual Meeting; 2017 April 19–22; Washington, DC.
7.
go back to reference Puffer JC, Knight HC, O'neill TR, et al. Prevalence of Burnout in Board Certified Family Physicians. The Journal of the American Board of Family Medicine. 2017;30(2):125–6.CrossRefPubMed Puffer JC, Knight HC, O'neill TR, et al. Prevalence of Burnout in Board Certified Family Physicians. The Journal of the American Board of Family Medicine. 2017;30(2):125–6.CrossRefPubMed
8.
go back to reference Noseworthy J, Madara J, Cosgrove D, et al. Physician burnout is a public health crisis: a message to our fellow health care CEOs. Health Affairs Blog. 2017. Noseworthy J, Madara J, Cosgrove D, et al. Physician burnout is a public health crisis: a message to our fellow health care CEOs. Health Affairs Blog. 2017.
9.
go back to reference Maslach C, Jackson S, Leiter M. MBI: Maslach Burnout Inventory Manual. Third ed: Consulting Psychologists Press; 1996. Maslach C, Jackson S, Leiter M. MBI: Maslach Burnout Inventory Manual. Third ed: Consulting Psychologists Press; 1996.
10.
go back to reference Linzer M, Poplau S, Babbott S, et al. Worklife and wellness in academic general internal medicine: results from a national survey. J Gen Int Med. 2016:1–7. Linzer M, Poplau S, Babbott S, et al. Worklife and wellness in academic general internal medicine: results from a national survey. J Gen Int Med. 2016:1–7.
11.
go back to reference Schmoldt R, Freeborn D, Klevit H. Physician burnout: recommendations for HMO managers. HMO practice. 1994;8(2):58–63.PubMed Schmoldt R, Freeborn D, Klevit H. Physician burnout: recommendations for HMO managers. HMO practice. 1994;8(2):58–63.PubMed
12.
go back to reference Linzer M, Manwell LB, Williams ES, et al. Working conditions in primary care: physician reactions and care quality. Annals of Internal Medicine. 2009;151(1):28–36.CrossRefPubMed Linzer M, Manwell LB, Williams ES, et al. Working conditions in primary care: physician reactions and care quality. Annals of Internal Medicine. 2009;151(1):28–36.CrossRefPubMed
13.
go back to reference Williams ES, Konrad TR, Linzer M, et al. Refining the measurement of physician job satisfaction: results from the physician worklife survey. Med Care. 1999:1140–54. Williams ES, Konrad TR, Linzer M, et al. Refining the measurement of physician job satisfaction: results from the physician worklife survey. Med Care. 1999:1140–54.
14.
go back to reference Lewis SE, Nocon RS, Tang H, et al. Patient-centered medical home characteristics and staff morale in safety net clinics. Archives of Internal Medicine. 2012;172(1):23–31.CrossRefPubMedPubMedCentral Lewis SE, Nocon RS, Tang H, et al. Patient-centered medical home characteristics and staff morale in safety net clinics. Archives of Internal Medicine. 2012;172(1):23–31.CrossRefPubMedPubMedCentral
15.
go back to reference Shanafelt TD, Hasan O, Dyrbye LN, et al., editors. Changes in burnout and satisfaction with work-life balance in physicians and the general US working population between 2011 and 2014. Mayo Clin Proc; 2015: Elsevier. Shanafelt TD, Hasan O, Dyrbye LN, et al., editors. Changes in burnout and satisfaction with work-life balance in physicians and the general US working population between 2011 and 2014. Mayo Clin Proc; 2015: Elsevier.
16.
go back to reference Helfrich CD, Dolan ED, Simonetti J, et al. Elements of Team-Based Care in a Patient-Centered Medical Home Are Associated with Lower Burnout Among VA Primary Care Employees. Journal of General Internal Medicine. 2014;29(2):659–66.CrossRefPubMedCentral Helfrich CD, Dolan ED, Simonetti J, et al. Elements of Team-Based Care in a Patient-Centered Medical Home Are Associated with Lower Burnout Among VA Primary Care Employees. Journal of General Internal Medicine. 2014;29(2):659–66.CrossRefPubMedCentral
17.
go back to reference Dolan ED, Mohr D, Lempa M, et al. Using a single item to measure burnout in primary care staff: a psychometric evaluation. Journal of General Internal Medicine. 2015;30(5):582–7.CrossRefPubMed Dolan ED, Mohr D, Lempa M, et al. Using a single item to measure burnout in primary care staff: a psychometric evaluation. Journal of General Internal Medicine. 2015;30(5):582–7.CrossRefPubMed
18.
go back to reference Rohland BM, Kruse GR, Rohrer JE. Validation of a single-item measure of burnout against the Maslach Burnout Inventory among physicians. Stress and Health. 2004;20(2):75–9.CrossRef Rohland BM, Kruse GR, Rohrer JE. Validation of a single-item measure of burnout against the Maslach Burnout Inventory among physicians. Stress and Health. 2004;20(2):75–9.CrossRef
19.
go back to reference Hansen V, Girgis A. Can a single question effectively screen for burnout in Australian cancer care workers? BMC health services research. 2010;10(1):341.CrossRefPubMedPubMedCentral Hansen V, Girgis A. Can a single question effectively screen for burnout in Australian cancer care workers? BMC health services research. 2010;10(1):341.CrossRefPubMedPubMedCentral
20.
go back to reference Waddimba AC, Scribani M, Nieves MA, et al. Validation of Single-Item Screening Measures for Provider Burnout in a Rural Health Care Network. Evaluation & the Health Professions. 2016;39(2):215–25.CrossRef Waddimba AC, Scribani M, Nieves MA, et al. Validation of Single-Item Screening Measures for Provider Burnout in a Rural Health Care Network. Evaluation & the Health Professions. 2016;39(2):215–25.CrossRef
21.
go back to reference West CP, Dyrbye LN, Sloan JA, et al. Single item measures of emotional exhaustion and depersonalization are useful for assessing burnout in medical professionals. Journal of general internal medicine. 2009;24(12):1318–21.CrossRefPubMedPubMedCentral West CP, Dyrbye LN, Sloan JA, et al. Single item measures of emotional exhaustion and depersonalization are useful for assessing burnout in medical professionals. Journal of general internal medicine. 2009;24(12):1318–21.CrossRefPubMedPubMedCentral
22.
go back to reference Willard-Grace R, Hessler D, Rogers E, et al. Team structure and culture are associated with lower burnout in primary care. The Journal of the American Board of Family Medicine. 2014;27(2):229–38.CrossRefPubMed Willard-Grace R, Hessler D, Rogers E, et al. Team structure and culture are associated with lower burnout in primary care. The Journal of the American Board of Family Medicine. 2014;27(2):229–38.CrossRefPubMed
23.
24.
go back to reference Schaufeli WB, Dierendonck DV. A Cautionary Note about the Cross-National and Clinical Validity of Cut-off Points for the Maslach Burnout Inventory. Psychological Reports. 1995;76(3_suppl):1083–90.CrossRefPubMed Schaufeli WB, Dierendonck DV. A Cautionary Note about the Cross-National and Clinical Validity of Cut-off Points for the Maslach Burnout Inventory. Psychological Reports. 1995;76(3_suppl):1083–90.CrossRefPubMed
25.
go back to reference Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Archives of Internal Medicine. 2012;172(18):1377–85.CrossRefPubMed Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Archives of Internal Medicine. 2012;172(18):1377–85.CrossRefPubMed
26.
go back to reference StataCorp. Stata: Release 13. Statistical Software. College Station, TX: StataCorp LP; 2013. StataCorp. Stata: Release 13. Statistical Software. College Station, TX: StataCorp LP; 2013.
27.
go back to reference West CP, Dyrbye LN, Satele DV, et al. Concurrent validity of single-item measures of emotional exhaustion and depersonalization in burnout assessment. Journal of General Internal Medicine. 2012;27(11):1445–52.CrossRefPubMedPubMedCentral West CP, Dyrbye LN, Satele DV, et al. Concurrent validity of single-item measures of emotional exhaustion and depersonalization in burnout assessment. Journal of General Internal Medicine. 2012;27(11):1445–52.CrossRefPubMedPubMedCentral
28.
go back to reference Simundic A-M. Measures of Diagnostic Accuracy: Basic Definitions. EJIFCC (Journal of the International Federation of Clinical Chemistry and Laboratory Medicine). 2009;19(4):203–11. Simundic A-M. Measures of Diagnostic Accuracy: Basic Definitions. EJIFCC (Journal of the International Federation of Clinical Chemistry and Laboratory Medicine). 2009;19(4):203–11.
30.
go back to reference Rice ME, Harris GT. Comparing effect sizes in follow-up studies: ROC Area, Cohen’s d, and r. Law and human behavior. 2005;29(5):615.CrossRefPubMed Rice ME, Harris GT. Comparing effect sizes in follow-up studies: ROC Area, Cohen’s d, and r. Law and human behavior. 2005;29(5):615.CrossRefPubMed
32.
go back to reference Eckleberry-Hunt J, Kirkpatrick H, Barbera T. The problems with burnout research. Acad Med. 2017. Eckleberry-Hunt J, Kirkpatrick H, Barbera T. The problems with burnout research. Acad Med. 2017.
33.
go back to reference Schaufeli WB, Bakker AB, Hoogduin K, et al. On the clinical validity of the Maslach Burnout Inventory and the Burnout Measure. Psychology & health. 2001;16(5):565–82.CrossRef Schaufeli WB, Bakker AB, Hoogduin K, et al. On the clinical validity of the Maslach Burnout Inventory and the Burnout Measure. Psychology & health. 2001;16(5):565–82.CrossRef
Metadata
Title
Maslach Burnout Inventory and a Self-Defined, Single-Item Burnout Measure Produce Different Clinician and Staff Burnout Estimates
Authors
Margae Knox, MPH
Rachel Willard-Grace, MPH
Beatrice Huang, BA
Kevin Grumbach, MD
Publication date
01-08-2018
Publisher
Springer US
Published in
Journal of General Internal Medicine / Issue 8/2018
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-018-4507-6

Other articles of this Issue 8/2018

Journal of General Internal Medicine 8/2018 Go to the issue