Skip to main content
Top
Published in: Journal of General Internal Medicine 4/2022

01-03-2022 | Burnout Syndrome | Original Research

Establishing Crosswalks Between Common Measures of Burnout in US Physicians

Authors: Keri J. S. Brady, PhD, MPH, Pengsheng Ni, MD, MPH, Lindsey Carlasare, MBA, Tait D. Shanafelt, MD, Christine A. Sinsky, MD, Mark Linzer, MD, Martin Stillman, MD, JD, Mickey T. Trockel, MD, PhD

Published in: Journal of General Internal Medicine | Issue 4/2022

Login to get access

Abstract

Background

Physician burnout is often assessed by healthcare organizations. Yet, scores from different burnout measures cannot currently be directly compared, limiting the interpretation of results across organizations or studies.

Objective

To link common measures of burnout to a single metric in psychometric analyses such that group-level scores from different assessments can be compared.

Design

Cross-sectional survey.

Setting

US practices.

Participants

A total of 1355 physicians sampled from the American Medical Association Physician Masterfile.

Main Measures

We linked the Stanford Professional Fulfillment Index (PFI) and Mini-Z Single-Item Burnout (MZSIB) scale to the Maslach Burnout Inventory (MBI) in item response theory (IRT) fixed-calibration and equipercentile analyses and created crosswalks mapping PFI and MZSIB scores to corresponding MBI scores. We evaluated the accuracy of the results by comparing physicians’ actual MBI scores to those predicted by linking and described the closest cut-point equivalencies across scales linked to the same MBI subscale using the resulting crosswalks.

Key Results

IRT linking produced the most accurate results and was used to create crosswalks mapping (1) PFI Work Exhaustion (PFI-WE) and MZSIB scores to MBI Emotional Exhaustion (MBI-EE) scores and (2) PFI Interpersonal Disengagement (PFI-ID) scores to MBI Depersonalization (MBI-DP) scores. The commonly used MBI-EE raw score cut-point of ≥27 corresponded most closely with respective PFI-WE and MZSIB raw score cut-points of ≥7 and ≥3. The commonly used MBI-DP raw score cut-point of ≥10 corresponded most closely with a PFI-ID raw score cut-point of ≥9.

Conclusions

Our findings allow healthcare organizations using the PFI or MZSIB to compare group-level scores to historical, regional, or national MBI scores (and vice-versa).
Appendix
Available only for authorised users
Literature
1.
go back to reference Shanafelt TD, West CP, Sinsky C, et al. Changes in burnout and satisfaction with work-life integration in physicians and the general US working population between 2011 and 2017. Mayo Clinic Proceedings 2019;94(9):1681-1694. Shanafelt TD, West CP, Sinsky C, et al. Changes in burnout and satisfaction with work-life integration in physicians and the general US working population between 2011 and 2017. Mayo Clinic Proceedings 2019;94(9):1681-1694.
2.
go back to reference Maslach C, Jackson SE. The measurement of experienced burnout. J Occup Behav 1981;2(2):99-113.CrossRef Maslach C, Jackson SE. The measurement of experienced burnout. J Occup Behav 1981;2(2):99-113.CrossRef
3.
go back to reference Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Arch Intern Med 2012;172(18):1377-1385.CrossRef Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work-life balance among US physicians relative to the general US population. Arch Intern Med 2012;172(18):1377-1385.CrossRef
4.
go back to reference Dyrbye LN, T.D. Shanafelt, C.A. Sinsky, P.F. Cipriano, J. Bhatt, A. Ommaya, C.P. West, and D. Meyers. Burnout among health care professionals: A call to explore and address this underrecognized threat to safe, high-quality care. NAM Perspectives. Discussion Paper, National Academy of Medicine, Washington, DC. 2019; https://doi.org/10.31478/201707b Dyrbye LN, T.D. Shanafelt, C.A. Sinsky, P.F. Cipriano, J. Bhatt, A. Ommaya, C.P. West, and D. Meyers. Burnout among health care professionals: A call to explore and address this underrecognized threat to safe, high-quality care. NAM Perspectives. Discussion Paper, National Academy of Medicine, Washington, DC. 2019; https://​doi.​org/​10.​31478/​201707b
5.
go back to reference Tawfik DS, Scheid A, Profit J, et al. Evidence Relating Health Care Provider Burnout and Quality of Care: A Systematic Review and Meta-analysis. Ann Intern Med 2019;171(8):555-567.CrossRef Tawfik DS, Scheid A, Profit J, et al. Evidence Relating Health Care Provider Burnout and Quality of Care: A Systematic Review and Meta-analysis. Ann Intern Med 2019;171(8):555-567.CrossRef
6.
go back to reference Han S, Shanafelt TD, Sinsky CA, et al. Estimating the Attributable Cost of Physician Burnout in the United States. Ann Intern Med 2019;170(11):784-790.CrossRef Han S, Shanafelt TD, Sinsky CA, et al. Estimating the Attributable Cost of Physician Burnout in the United States. Ann Intern Med 2019;170(11):784-790.CrossRef
7.
go back to reference Jha A, Ilif A, Chaoui A. A crisis in health care: a call to action on physician burnout. In: Massachusetts Medical Society. Available at: http://www.massmed.org/Publications/Research,-Studies,-and-Reports/A-Crisis-in-Health-Care--A-Call-to-Action-on--Physician-Burnout/#.X99sCJNKh_k. Accessed June 19, 2020. Jha A, Ilif A, Chaoui A. A crisis in health care: a call to action on physician burnout. In: Massachusetts Medical Society. Available at: http://​www.​massmed.​org/​Publications/​Research,-Studies,-and-Reports/A-Crisis-in-Health-Care--A-Call-to-Action-on--Physician-Burnout/#.X99sCJNKh_k. Accessed June 19, 2020.
8.
go back to reference Dzau VJ, Kirch DG, Nasca TJ. To Care Is Human — Collectively Confronting the Clinician-Burnout Crisis. N Engl J Med 2018;378(4):312-314.CrossRef Dzau VJ, Kirch DG, Nasca TJ. To Care Is Human — Collectively Confronting the Clinician-Burnout Crisis. N Engl J Med 2018;378(4):312-314.CrossRef
9.
go back to reference Brady KJS, Kazis LE, Sheldrick RC, Ni P, Trockel MT. Selecting Physician Well-Being Measures to Assess Health System Performance and Screen for Distress: Conceptual and Methodological Considerations. Curr Probl Pediatr Adolesc Health Care 2019;49(12):100662.CrossRef Brady KJS, Kazis LE, Sheldrick RC, Ni P, Trockel MT. Selecting Physician Well-Being Measures to Assess Health System Performance and Screen for Distress: Conceptual and Methodological Considerations. Curr Probl Pediatr Adolesc Health Care 2019;49(12):100662.CrossRef
10.
go back to reference Dyrbye LN, Meyers D, Ripp J, Dalal N, Bird SB, Sen S. A Pragmatic Approach for Organizations to Measure Health Care Professional Well-Being. NAM Perspectives. Discussion Paper, National Academy of Medicine, Washington, DC. 2018; https://doi.org/10.31478/201810b Dyrbye LN, Meyers D, Ripp J, Dalal N, Bird SB, Sen S. A Pragmatic Approach for Organizations to Measure Health Care Professional Well-Being. NAM Perspectives. Discussion Paper, National Academy of Medicine, Washington, DC. 2018; https://​doi.​org/​10.​31478/​201810b
11.
go back to reference Shanafelt TD, Noseworthy JH. Executive leadership and physician well-being: nine organizational strategies to promote engagement and reduce burnout. Mayo Clin Proc 2017;92(1):129-146.CrossRef Shanafelt TD, Noseworthy JH. Executive leadership and physician well-being: nine organizational strategies to promote engagement and reduce burnout. Mayo Clin Proc 2017;92(1):129-146.CrossRef
14.
go back to reference National Academies of Sciences, Engineering, and Medicine. Taking Action Against Clinician Burnout: A Systems Approach to Professional Well-Being. The National Academies Press; 2019. National Academies of Sciences, Engineering, and Medicine. Taking Action Against Clinician Burnout: A Systems Approach to Professional Well-Being. The National Academies Press; 2019.
16.
go back to reference Trockel M, Bohman B, Lesure E, et al. A Brief Instrument to Assess Both Burnout and Professional Fulfillment in Physicians: Reliability and Validity, Including Correlation with Self-Reported Medical Errors, in a Sample of Resident and Practicing Physicians. Acad Psychiatry 2017;42(1):11-24.CrossRef Trockel M, Bohman B, Lesure E, et al. A Brief Instrument to Assess Both Burnout and Professional Fulfillment in Physicians: Reliability and Validity, Including Correlation with Self-Reported Medical Errors, in a Sample of Resident and Practicing Physicians. Acad Psychiatry 2017;42(1):11-24.CrossRef
17.
go back to reference Konrad TR, Williams ES, Linzer M, et al. Measuring physician job satisfaction in a changing workplace and a challenging environment. Med Care 1999;37(11):1174-1182.CrossRef Konrad TR, Williams ES, Linzer M, et al. Measuring physician job satisfaction in a changing workplace and a challenging environment. Med Care 1999;37(11):1174-1182.CrossRef
18.
go back to reference Kolen MJ, Brennan RL. Test equating, scaling, and linking: Methods and practices. Springer Science & Business Media; 2014. Kolen MJ, Brennan RL. Test equating, scaling, and linking: Methods and practices. Springer Science & Business Media; 2014.
19.
go back to reference Maslach C, Jackson S, Leiter M. Maslach Burnout Inventory Manual. 3rd ed. Consulting Psychologists Press; 1996. Maslach C, Jackson S, Leiter M. Maslach Burnout Inventory Manual. 3rd ed. Consulting Psychologists Press; 1996.
20.
go back to reference Williams ES, Konrad TR, Linzer M, et al. Refining the measurement of physician job satisfaction: results from the Physician Worklife Survey. SGIM Career Satisfaction Study Group. Society of General Internal Medicine. Med Care 1999;37(11):1140-1154.CrossRef Williams ES, Konrad TR, Linzer M, et al. Refining the measurement of physician job satisfaction: results from the Physician Worklife Survey. SGIM Career Satisfaction Study Group. Society of General Internal Medicine. Med Care 1999;37(11):1140-1154.CrossRef
21.
go back to reference Pilkonis PA, Choi SW, Reise SP, Stover AM, Riley WT, Cella D. Item Banks for Measuring Emotional Distress From the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, Anxiety, and Anger. Assessment. 2011;18(3):263-283.CrossRef Pilkonis PA, Choi SW, Reise SP, Stover AM, Riley WT, Cella D. Item Banks for Measuring Emotional Distress From the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, Anxiety, and Anger. Assessment. 2011;18(3):263-283.CrossRef
22.
go back to reference Dyrbye LN, Szydlo DW, Downing SM, Sloan JA, Shanafelt TD. Development and preliminary psychometric properties of a well-being index for medical students. BMC Med Educ 2010;10(1):8.CrossRef Dyrbye LN, Szydlo DW, Downing SM, Sloan JA, Shanafelt TD. Development and preliminary psychometric properties of a well-being index for medical students. BMC Med Educ 2010;10(1):8.CrossRef
23.
go back to reference Dyrbye LN, Schwartz A, Downing SM, Szydlo DW, Sloan JA, Shanafelt TD. Efficacy of a brief screening tool to identify medical students in distress. Acad Med 2011;86(7):907-914.CrossRef Dyrbye LN, Schwartz A, Downing SM, Szydlo DW, Sloan JA, Shanafelt TD. Efficacy of a brief screening tool to identify medical students in distress. Acad Med 2011;86(7):907-914.CrossRef
24.
go back to reference Dyrbye LN, Satele D, Sloan J, Shanafelt TD. Utility of a brief screening tool to identify physicians in distress. J Gen Intern Med 2013;28(3):421-427.CrossRef Dyrbye LN, Satele D, Sloan J, Shanafelt TD. Utility of a brief screening tool to identify physicians in distress. J Gen Intern Med 2013;28(3):421-427.CrossRef
25.
go back to reference Choi SW, Schalet B, Cook KF, Cella D. Establishing a Common Metric for Depressive Symptoms: Linking the BDI-II, CES-D, and PHQ-9 to PROMIS Depression. Psychol Assess 2014;26(2):513-527.CrossRef Choi SW, Schalet B, Cook KF, Cella D. Establishing a Common Metric for Depressive Symptoms: Linking the BDI-II, CES-D, and PHQ-9 to PROMIS Depression. Psychol Assess 2014;26(2):513-527.CrossRef
27.
go back to reference Rotenstein LS, Torre M, Ramos MA, et al. Prevalence of burnout among physicians: A systematic review. Jama. 2018;320(11):1131-1150.CrossRef Rotenstein LS, Torre M, Ramos MA, et al. Prevalence of burnout among physicians: A systematic review. Jama. 2018;320(11):1131-1150.CrossRef
28.
go back to reference Dorans NJ, Holland PW. Population invariance and the equatability of tests: Basic theory and the linear case. J Educ Meas 2000;37(4):281-306.CrossRef Dorans NJ, Holland PW. Population invariance and the equatability of tests: Basic theory and the linear case. J Educ Meas 2000;37(4):281-306.CrossRef
29.
go back to reference Brady KJS NP, Sheldrick RC, Trockel MT, Shanafelt T, Rowe SG, Schneider JI, Kazis LE. Describing the Emotional Exhaustion, Depersonalization, and Low Personal Accomplishment Symptoms Associated with Maslach Burnout Inventory Subscale Scores in US Physicians. J Patient Rep Outcomes 2020;4(1):1-14.CrossRef Brady KJS NP, Sheldrick RC, Trockel MT, Shanafelt T, Rowe SG, Schneider JI, Kazis LE. Describing the Emotional Exhaustion, Depersonalization, and Low Personal Accomplishment Symptoms Associated with Maslach Burnout Inventory Subscale Scores in US Physicians. J Patient Rep Outcomes 2020;4(1):1-14.CrossRef
30.
go back to reference Shanafelt TD, Hasan O, Dyrbye LN, et al. Changes in Burnout and Satisfaction With Work-Life Balance in Physicians and the General US Working Population Between 2011 and 2014. Mayo Clin Proc 2015;90(12):1600-1613.CrossRef Shanafelt TD, Hasan O, Dyrbye LN, et al. Changes in Burnout and Satisfaction With Work-Life Balance in Physicians and the General US Working Population Between 2011 and 2014. Mayo Clin Proc 2015;90(12):1600-1613.CrossRef
34.
go back to reference Albano AD. equate: An R package for observed-score linking and equating. J Stat Softw 2016;74(8):1-36.CrossRef Albano AD. equate: An R package for observed-score linking and equating. J Stat Softw 2016;74(8):1-36.CrossRef
35.
go back to reference Chalmers P. mirt: A Multidimensional Item Response Theory Package for the R Environment. J Stat Softw 2012;48(6):1-29.CrossRef Chalmers P. mirt: A Multidimensional Item Response Theory Package for the R Environment. J Stat Softw 2012;48(6):1-29.CrossRef
36.
go back to reference Rosseel Y. lavaan: An R Package for Structural Equation Modeling. J Stat Softw 2012;48(2):1-36.CrossRef Rosseel Y. lavaan: An R Package for Structural Equation Modeling. J Stat Softw 2012;48(2):1-36.CrossRef
37.
go back to reference Lai J-S, Cella D, Yanez B, Stone A. Linking fatigue measures on a common reporting metric. J Pain Symptom Manag 2014;48(4):639-648.CrossRef Lai J-S, Cella D, Yanez B, Stone A. Linking fatigue measures on a common reporting metric. J Pain Symptom Manag 2014;48(4):639-648.CrossRef
38.
go back to reference Simonetti JA, Clinton WL, Taylor L, et al. The impact of survey nonresponse on estimates of healthcare employee burnout. Healthcare. 2020;8(3):100451.CrossRef Simonetti JA, Clinton WL, Taylor L, et al. The impact of survey nonresponse on estimates of healthcare employee burnout. Healthcare. 2020;8(3):100451.CrossRef
Metadata
Title
Establishing Crosswalks Between Common Measures of Burnout in US Physicians
Authors
Keri J. S. Brady, PhD, MPH
Pengsheng Ni, MD, MPH
Lindsey Carlasare, MBA
Tait D. Shanafelt, MD
Christine A. Sinsky, MD
Mark Linzer, MD
Martin Stillman, MD, JD
Mickey T. Trockel, MD, PhD
Publication date
01-03-2022
Publisher
Springer International Publishing
Published in
Journal of General Internal Medicine / Issue 4/2022
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-021-06661-4

Other articles of this Issue 4/2022

Journal of General Internal Medicine 4/2022 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine