Skip to main content
Top
Published in: Journal of General Internal Medicine 5/2015

01-05-2015 | Original Research

Using a Single Item to Measure Burnout in Primary Care Staff: A Psychometric Evaluation

Authors: Emily D. Dolan, MS PhD, David Mohr, PhD, Michele Lempa, MPH DrPH, Sandra Joos, PhD, Stephan D. Fihn, MD MPH, Karin M. Nelson, MD MSHS, Christian D. Helfrich, MPH PhD

Published in: Journal of General Internal Medicine | Issue 5/2015

Login to get access

Abstract

Background

Burnout affects nearly half of all U.S. nurses and physicians, and has been linked to poor outcomes such as worse patient safety. The most common measure of burnout is the well-validated Maslach Burnout Inventory (MBI). However, the MBI is proprietary and carries licensing fees, posing challenges to routine or repeated assessment.

Objective

To compare a non-proprietary, single-item burnout measure to a single item from the MBI Emotional Exhaustion (MBI:EE) subscale that has been validated as a standalone burnout measure.

Design

Cross-sectional online survey.

Participants

A sample of primary care providers (PCPs), registered nurses, clinical associates (e.g., licensed practical nurses (LPNs), medical technicians), and administrative clerks in the Veterans Health Administration surveyed in 2012.

Main Methods

We compared a validated one-item version of the MBI:EE and a non-proprietary single-item burnout measure used in the Physician Work Life Study. We calculated kappa statistics, sensitivity and specificity, positive predictive (PPV) and negative predictive values (NPV), and area under the receiver operator curve (AUC). We conducted analyses stratified by occupation to determine the stability of the correlation between the two measures.

Key Results

We analyzed responses from 5,404 participants, including 1,769 providers and 1,380 registered nurses. The prevalence of burnout was 36.7 % as measured on the single MBI:EE item and 38.5 % as measured on the non-proprietary single-item measure. Relative to the MBI:EE, the non-proprietary single-item measure had a correlation of 0.79, sensitivity of 83.2 %, specificity of 87.4 %, and AUC of 0.93 (se = 0.004). Results were similar when stratified by respondent occupation.

Conclusions

A non-proprietary single-item measure served as a reliable substitute for the MBI:EE across occupations. Because it is non-proprietary and easy to interpret, it has logistical advantages over the one-item MBI.
Appendix
Available only for authorised users
Literature
1.
go back to reference Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Arch Intern Med. 2012;172(18):1377–85.CrossRefPubMed Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Arch Intern Med. 2012;172(18):1377–85.CrossRefPubMed
2.
go back to reference Aiken LH, Clarke SP, Sloane DM, Sochalski J, Silber JH. Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. JAMA. 2002;288(16):1987–93.CrossRefPubMed Aiken LH, Clarke SP, Sloane DM, Sochalski J, Silber JH. Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. JAMA. 2002;288(16):1987–93.CrossRefPubMed
3.
4.
go back to reference Halbesleben JR, Wakefield BJ, Wakefield DS, Cooper LB. Nurse burnout and patient safety outcomes: nurse safety perception versus reporting behavior. West J Nurs Res. 2008;30(5):560–77.CrossRefPubMed Halbesleben JR, Wakefield BJ, Wakefield DS, Cooper LB. Nurse burnout and patient safety outcomes: nurse safety perception versus reporting behavior. West J Nurs Res. 2008;30(5):560–77.CrossRefPubMed
5.
go back to reference Spence Laschinger HK, Leiter MP. The impact of nursing work environments on patient safety outcomes: the mediating role of burnout/engagement. J Nurs Adm. 2006;36(5):259–67.CrossRefPubMed Spence Laschinger HK, Leiter MP. The impact of nursing work environments on patient safety outcomes: the mediating role of burnout/engagement. J Nurs Adm. 2006;36(5):259–67.CrossRefPubMed
6.
go back to reference West CP, Tan AD, Habermann TM, Sloan JA, Shanafelt TD. Association of resident fatigue and distress with perceived medical errors. JAMA. 2009;302(12):1294–300.CrossRefPubMed West CP, Tan AD, Habermann TM, Sloan JA, Shanafelt TD. Association of resident fatigue and distress with perceived medical errors. JAMA. 2009;302(12):1294–300.CrossRefPubMed
7.
go back to reference Shanafelt TD, Balch CM, Bechamps G, et al. Burnout and medical errors among American surgeons. Ann Surg. 2010;251(6):995–1000.CrossRefPubMed Shanafelt TD, Balch CM, Bechamps G, et al. Burnout and medical errors among American surgeons. Ann Surg. 2010;251(6):995–1000.CrossRefPubMed
8.
go back to reference Haas JS, Cook EF, Puopolo AL, Burstin HR, Cleary PD, Brennan TA. Is the professional satisfaction of general internists associated with patient satisfaction? J Gen Intern Med. 2000;15(2):122–8.CrossRefPubMedCentralPubMed Haas JS, Cook EF, Puopolo AL, Burstin HR, Cleary PD, Brennan TA. Is the professional satisfaction of general internists associated with patient satisfaction? J Gen Intern Med. 2000;15(2):122–8.CrossRefPubMedCentralPubMed
9.
go back to reference Halbesleben JR, Rathert C. Linking physician burnout and patient outcomes: exploring the dyadic relationship between physicians and patients. Health Care Manag Rev. 2008;33(1):29–39.CrossRef Halbesleben JR, Rathert C. Linking physician burnout and patient outcomes: exploring the dyadic relationship between physicians and patients. Health Care Manag Rev. 2008;33(1):29–39.CrossRef
10.
go back to reference Argentero P, Dell’Olivo B, Ferretti MS. Staff burnout and patient satisfaction with the quality of dialysis care. Am J Kidney Dis. 2008;51(1):80–92.CrossRefPubMed Argentero P, Dell’Olivo B, Ferretti MS. Staff burnout and patient satisfaction with the quality of dialysis care. Am J Kidney Dis. 2008;51(1):80–92.CrossRefPubMed
11.
go back to reference Shanafelt T, Sloan J, Satele D, Balch C. Why do surgeons consider leaving practice? J Am Coll Surg. 2011;212(3):421–2.CrossRefPubMed Shanafelt T, Sloan J, Satele D, Balch C. Why do surgeons consider leaving practice? J Am Coll Surg. 2011;212(3):421–2.CrossRefPubMed
12.
go back to reference Van Bogaert P, Clarke S, Roelant E, Meulemans H, Van de Heyning P. Impacts of unit-level nurse practice environment and burnout on nurse-reported outcomes: a multilevel modelling approach. J Clin Nurs. 2010;19(11–12):1664–74.CrossRefPubMed Van Bogaert P, Clarke S, Roelant E, Meulemans H, Van de Heyning P. Impacts of unit-level nurse practice environment and burnout on nurse-reported outcomes: a multilevel modelling approach. J Clin Nurs. 2010;19(11–12):1664–74.CrossRefPubMed
13.
go back to reference Linzer M, Manwell LB, Williams ES, et al. Working conditions in primary care: physician reactions and care quality. Ann Intern Med. 2009;151(1):28–36. W26-29.CrossRefPubMed Linzer M, Manwell LB, Williams ES, et al. Working conditions in primary care: physician reactions and care quality. Ann Intern Med. 2009;151(1):28–36. W26-29.CrossRefPubMed
14.
go back to reference Landon BE, Reschovsky JD, Pham HH, Blumenthal D. Leaving medicine: the consequences of physician dissatisfaction. Med Care. 2006;44(3):234–42.CrossRefPubMed Landon BE, Reschovsky JD, Pham HH, Blumenthal D. Leaving medicine: the consequences of physician dissatisfaction. Med Care. 2006;44(3):234–42.CrossRefPubMed
15.
go back to reference Hinami K, Whelan CT, Wolosin RJ, Miller JA, Wetterneck TB. Worklife and satisfaction of hospitalists: toward flourishing careers. J Gen Intern Med. 2012;27(1):28–36.CrossRefPubMedCentralPubMed Hinami K, Whelan CT, Wolosin RJ, Miller JA, Wetterneck TB. Worklife and satisfaction of hospitalists: toward flourishing careers. J Gen Intern Med. 2012;27(1):28–36.CrossRefPubMedCentralPubMed
16.
go back to reference Shanafelt TD, Bradley KA, Wipf JE, Back AL. Burnout and self-reported patient care in an internal medicine residency program. Ann Intern Med. 2002;136(5):358–67.CrossRefPubMed Shanafelt TD, Bradley KA, Wipf JE, Back AL. Burnout and self-reported patient care in an internal medicine residency program. Ann Intern Med. 2002;136(5):358–67.CrossRefPubMed
17.
go back to reference Parker PA, Kulik JA. Burnout, self- and supervisor-rated job performance, and absenteeism among nurses. J Behav Med. 1995;18(6):581–99.CrossRefPubMed Parker PA, Kulik JA. Burnout, self- and supervisor-rated job performance, and absenteeism among nurses. J Behav Med. 1995;18(6):581–99.CrossRefPubMed
18.
go back to reference Sargent MC, Sotile W, Sotile MO, Rubash H, Barrack RL. Quality of life during orthopaedic training and academic practice. Part 1: orthopaedic surgery residents and faculty. J Bone Joint Surg Am. 2009;91(10):2395–405.CrossRefPubMed Sargent MC, Sotile W, Sotile MO, Rubash H, Barrack RL. Quality of life during orthopaedic training and academic practice. Part 1: orthopaedic surgery residents and faculty. J Bone Joint Surg Am. 2009;91(10):2395–405.CrossRefPubMed
19.
go back to reference Aiken LH, Clarke SP, Sloane DM, et al. Nurses’ reports on hospital care in five countries. Health Aff. 2001;20(3):43–53.CrossRef Aiken LH, Clarke SP, Sloane DM, et al. Nurses’ reports on hospital care in five countries. Health Aff. 2001;20(3):43–53.CrossRef
20.
go back to reference Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work-life balance among us physicians relative to the general us population. Arch Intern Med. 2012:1–9. Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work-life balance among us physicians relative to the general us population. Arch Intern Med. 2012:1–9.
21.
go back to reference Spence Laschinger HK, Leiter M, Day A, Gilin D. Workplace empowerment, incivility, and burnout: impact on staff nurse recruitment and retention outcomes. J Nurs Manag. 2009;17(3):302–11.CrossRefPubMed Spence Laschinger HK, Leiter M, Day A, Gilin D. Workplace empowerment, incivility, and burnout: impact on staff nurse recruitment and retention outcomes. J Nurs Manag. 2009;17(3):302–11.CrossRefPubMed
22.
go back to reference Houkes I, Winants Y, Twellaar M, Verdonk P. Development of burnout over time and the causal order of the three dimensions of burnout among male and female GPs. A three-wave panel study. BMC Public Health. 2011;11(1):240.CrossRefPubMedCentralPubMed Houkes I, Winants Y, Twellaar M, Verdonk P. Development of burnout over time and the causal order of the three dimensions of burnout among male and female GPs. A three-wave panel study. BMC Public Health. 2011;11(1):240.CrossRefPubMedCentralPubMed
23.
go back to reference Friedberg MW. The potential impact of the medical home on job satisfaction in primary care. Arch Intern Med. 2012;172(1):31–2.CrossRefPubMed Friedberg MW. The potential impact of the medical home on job satisfaction in primary care. Arch Intern Med. 2012;172(1):31–2.CrossRefPubMed
24.
go back to reference Dyrbye LN, Varkey P, Boone SL, Satele DV, Sloan JA, Shanafelt TD. Physician satisfaction and burnout at different career stages. Mayo Clin Proc. 2013;88(12):1358–67.CrossRefPubMed Dyrbye LN, Varkey P, Boone SL, Satele DV, Sloan JA, Shanafelt TD. Physician satisfaction and burnout at different career stages. Mayo Clin Proc. 2013;88(12):1358–67.CrossRefPubMed
25.
go back to reference Linzer M, Levine R, Meltzer D, Poplau S, Warde C, West CP. 10 bold steps to prevent burnout in general internal medicine. J Gen Intern Med. 2014;29(1):18–20.CrossRefPubMedCentralPubMed Linzer M, Levine R, Meltzer D, Poplau S, Warde C, West CP. 10 bold steps to prevent burnout in general internal medicine. J Gen Intern Med. 2014;29(1):18–20.CrossRefPubMedCentralPubMed
26.
go back to reference Worley JA, Vassar M, Wheeler DL, Barnes LLB. Factor structure of scores from the maslach burnout inventory: a review and meta-analysis of 45 exploratory and confirmatory factor-analytic studies. Educ Psychol Meas. 2008;68(5):797–823.CrossRef Worley JA, Vassar M, Wheeler DL, Barnes LLB. Factor structure of scores from the maslach burnout inventory: a review and meta-analysis of 45 exploratory and confirmatory factor-analytic studies. Educ Psychol Meas. 2008;68(5):797–823.CrossRef
27.
go back to reference Schaufeli W, Enzmann D, Girault N. Measurement of burnout: A review. Prof Burnout: Recent Dev Theory Res. 1993:199–215. Schaufeli W, Enzmann D, Girault N. Measurement of burnout: A review. Prof Burnout: Recent Dev Theory Res. 1993:199–215.
28.
go back to reference Wheeler DL, Vassar M, Worley JA, Barnes LL. A reliability generalization meta-analysis of coefficient alpha for the Maslach burnout inventory. Educ Psychol Meas. 2011;71(1):231–44.CrossRef Wheeler DL, Vassar M, Worley JA, Barnes LL. A reliability generalization meta-analysis of coefficient alpha for the Maslach burnout inventory. Educ Psychol Meas. 2011;71(1):231–44.CrossRef
29.
go back to reference Cropanzano R, Rupp DE, Byrne ZS. The relationship of emotional exhaustion to work attitudes, job performance, and organizational citizenship behaviors. J Appl Psychol. 2003;88(1):160.CrossRefPubMed Cropanzano R, Rupp DE, Byrne ZS. The relationship of emotional exhaustion to work attitudes, job performance, and organizational citizenship behaviors. J Appl Psychol. 2003;88(1):160.CrossRefPubMed
30.
go back to reference Maslach C, Jackson SE. The measurement of experienced burnout. J Organ Behav. 1981;2(2):99–113.CrossRef Maslach C, Jackson SE. The measurement of experienced burnout. J Organ Behav. 1981;2(2):99–113.CrossRef
31.
go back to reference Rafferty JP, Lemkau JP, Purdy RR, Rudisill JR. Validity of the Maslach burnout inventory for family practice physicians. J Clin Psychol. 1986;42(3):488–92.CrossRefPubMed Rafferty JP, Lemkau JP, Purdy RR, Rudisill JR. Validity of the Maslach burnout inventory for family practice physicians. J Clin Psychol. 1986;42(3):488–92.CrossRefPubMed
32.
go back to reference Poghosyan L, Aiken LH, Sloane DM. Factor structure of the Maslach burnout inventory: An analysis of data from large scale cross-sectional surveys of nurses from eight countries. Int J Nurs Stud. 2009;46(7):894–902.CrossRefPubMedCentralPubMed Poghosyan L, Aiken LH, Sloane DM. Factor structure of the Maslach burnout inventory: An analysis of data from large scale cross-sectional surveys of nurses from eight countries. Int J Nurs Stud. 2009;46(7):894–902.CrossRefPubMedCentralPubMed
33.
go back to reference Schaufeli W, Bakker A, Hoogduin K, Schaap C, Kladler A. On the clinical validity of the Maslach Burnout Inventory and the Burnout Measure. Psychol Health. 2001;16(5):565–82.CrossRefPubMed Schaufeli W, Bakker A, Hoogduin K, Schaap C, Kladler A. On the clinical validity of the Maslach Burnout Inventory and the Burnout Measure. Psychol Health. 2001;16(5):565–82.CrossRefPubMed
34.
go back to reference Maslach C, Jackson SE, Leiter MP. Maslach Burnout Inventory Manual, Third Edition. Third ed: Mind Garden; 1996. Maslach C, Jackson SE, Leiter MP. Maslach Burnout Inventory Manual, Third Edition. Third ed: Mind Garden; 1996.
35.
go back to reference West C, Dyrbye L, Sloan J, Shanafelt T. Single item measures of emotional exhaustion and depersonalization are useful for assessing burnout in medical professionals. J Gen Intern Med. 2009;24(12):1318–21.CrossRefPubMedCentralPubMed West C, Dyrbye L, Sloan J, Shanafelt T. Single item measures of emotional exhaustion and depersonalization are useful for assessing burnout in medical professionals. J Gen Intern Med. 2009;24(12):1318–21.CrossRefPubMedCentralPubMed
36.
go back to reference West CP, Dyrbye LN, Satele DV, Sloan JA, Shanafelt TD. Concurrent validity of single-item measures of emotional exhaustion and depersonalization in burnout assessment. J Gen Intern Med. 2012;27(11):1445–52.CrossRefPubMedCentralPubMed West CP, Dyrbye LN, Satele DV, Sloan JA, Shanafelt TD. Concurrent validity of single-item measures of emotional exhaustion and depersonalization in burnout assessment. J Gen Intern Med. 2012;27(11):1445–52.CrossRefPubMedCentralPubMed
37.
go back to reference West CP, Shanafelt TD, Kolars JC. Quality of life, burnout, educational debt, and medical knowledge among internal medicine residents. JAMA. 2011;306(9):952–60.CrossRefPubMed West CP, Shanafelt TD, Kolars JC. Quality of life, burnout, educational debt, and medical knowledge among internal medicine residents. JAMA. 2011;306(9):952–60.CrossRefPubMed
38.
go back to reference Schmoldt RA, Freeborn DK, Klevit HD. Physician burnout: recommendations for HMO managers. HMO Pract. 1994;8(2):58–63.PubMed Schmoldt RA, Freeborn DK, Klevit HD. Physician burnout: recommendations for HMO managers. HMO Pract. 1994;8(2):58–63.PubMed
39.
go back to reference McMurray JE, Linzer M, Konrad TR, Douglas J, Shugerman R, Nelson K. The work lives of women physicians results from the physician work life study. The SGIM career satisfaction study group. J Gen Intern Med. 2000;15(6):372–80.PubMedCentralPubMed McMurray JE, Linzer M, Konrad TR, Douglas J, Shugerman R, Nelson K. The work lives of women physicians results from the physician work life study. The SGIM career satisfaction study group. J Gen Intern Med. 2000;15(6):372–80.PubMedCentralPubMed
40.
go back to reference Williams ES, Manwell LB, Konrad TR, Linzer M. The relationship of organizational culture, stress, satisfaction, and burnout with physician-reported error and suboptimal patient care: results from the MEMO study. Health Care Manag Rev. 2007;32(3):203–12.CrossRef Williams ES, Manwell LB, Konrad TR, Linzer M. The relationship of organizational culture, stress, satisfaction, and burnout with physician-reported error and suboptimal patient care: results from the MEMO study. Health Care Manag Rev. 2007;32(3):203–12.CrossRef
41.
go back to reference Cossman JS, Street D. Mississippi burnout. Part I: personal characteristics and practice context. J Miss State Med Assoc. 2009;50(9):306–10.PubMed Cossman JS, Street D. Mississippi burnout. Part I: personal characteristics and practice context. J Miss State Med Assoc. 2009;50(9):306–10.PubMed
42.
go back to reference Rohland BM, Kruse GR, Rohrer JE. Validation of a single-item measure of burnout against the Maslach Burnout inventory among physicians. Stress Health. 2004;20(2):75–9.CrossRef Rohland BM, Kruse GR, Rohrer JE. Validation of a single-item measure of burnout against the Maslach Burnout inventory among physicians. Stress Health. 2004;20(2):75–9.CrossRef
43.
44.
go back to reference Helfrich C, Dolan E, Simonetti J, et al. Elements of team-based care in a patient-centered medical home are associated with lower burnout among VA primary care employees. J Gen Intern Med. 2014;29(2):659–66.CrossRef Helfrich C, Dolan E, Simonetti J, et al. Elements of team-based care in a patient-centered medical home are associated with lower burnout among VA primary care employees. J Gen Intern Med. 2014;29(2):659–66.CrossRef
45.
go back to reference Leiter M, Shaughnessy K. The areas of worklife model of burnout: tests of mediation relationships. Ergonomia Int J. 2006;28:327–41. Leiter M, Shaughnessy K. The areas of worklife model of burnout: tests of mediation relationships. Ergonomia Int J. 2006;28:327–41.
Metadata
Title
Using a Single Item to Measure Burnout in Primary Care Staff: A Psychometric Evaluation
Authors
Emily D. Dolan, MS PhD
David Mohr, PhD
Michele Lempa, MPH DrPH
Sandra Joos, PhD
Stephan D. Fihn, MD MPH
Karin M. Nelson, MD MSHS
Christian D. Helfrich, MPH PhD
Publication date
01-05-2015
Publisher
Springer US
Published in
Journal of General Internal Medicine / Issue 5/2015
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-014-3112-6

Other articles of this Issue 5/2015

Journal of General Internal Medicine 5/2015 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.