Skip to main content
Top
Published in: BMC Health Services Research 1/2014

Open Access 01-12-2014 | Research article

Unannounced standardized patients: a promising method of assessing patient-centered care in your health care system

Authors: Sondra Zabar, Kathleen Hanley, David Stevens, Jessica Murphy, Angela Burgess, Adina Kalet, Colleen Gillespie

Published in: BMC Health Services Research | Issue 1/2014

Login to get access

Abstract

Background

While unannounced standardized patients (USPs) have been used to assess physicians’ clinical skills in the ambulatory setting, they can also provide valuable information on patients’ experience of the health care setting beyond the physician encounter. This paper explores the use of USPs as a methodology for evaluating patient-centered care in the health care system.

Methods

USPs were trained to complete a behaviorally-anchored assessment of core dimensions of patient-centered care delivered within the clinical microsystem, including: 1) Medical assistants’ safe practices, quality of care, and responsiveness to patients; 2) ease of clinic navigation; and 3) the patient-centeredness of care provided by the physician. Descriptive data is provided on these three levels of patient-centeredness within the targeted clinical microsystem. Chi-square analyses were used to signal whether variations by teams within the clinical microsystem were likely to be due to chance or might reflect true differences in patient-centeredness of specific teams.

Results

Sixty USP visits to 11 Primary Care teams were performed over an eight-month period (mean 5 visits/team; range 2–8). No medical assistants reported detecting an USP during the study period. USPs found the clinic easy to navigate and that teams were functioning well in 60% of visits. In 30% to 47% of visits, the physicians could have been more patient-centered. Medical assistants’ patient safety measures were poor: patient identity was confirmed in only 5% of visits and no USPs observed medical assistants wash their hands. Quality of care was relatively high for vital signs (e.g. blood pressure, weight and height), but low for depression screening, occurring in only 15% of visits. In most visits, medical assistants greeted the patient in a timely fashion but took time to fully explain matters in less than half of the visits and rarely introduced themselves. Physicians tried to help patients navigate the system in 62% of visits.

Conclusions

USP assessment captured actionable, critical, behaviorally-specific information on team and system performance in an urban community clinic. This methodology provides unique insight into the patient-centeredness and quality of care in medical settings.
Literature
1.
go back to reference Nelson EC, Batalden PB, Huber TP, Mohr JJ, Godfrey MM, Headrick LA, Wasson JH: Microsystems in health care: part 1: learning from high-performing front-line clinical units. Jt Comm J Qual Improv. 2002, 28 (9): 472-493.PubMed Nelson EC, Batalden PB, Huber TP, Mohr JJ, Godfrey MM, Headrick LA, Wasson JH: Microsystems in health care: part 1: learning from high-performing front-line clinical units. Jt Comm J Qual Improv. 2002, 28 (9): 472-493.PubMed
2.
go back to reference Grumbach K, Bodenheimer T: Can health care teams improve primary care practice?. JAMA. 2004, 291 (10): 1246-1251. 10.1001/jama.291.10.1246.CrossRefPubMed Grumbach K, Bodenheimer T: Can health care teams improve primary care practice?. JAMA. 2004, 291 (10): 1246-1251. 10.1001/jama.291.10.1246.CrossRefPubMed
3.
go back to reference Kohn LT, Corrigan JM, Donaldson MS: To err is human: building a safer health system. 1999, Washington, DC: National Academy Press Kohn LT, Corrigan JM, Donaldson MS: To err is human: building a safer health system. 1999, Washington, DC: National Academy Press
4.
go back to reference Baggs JG, Ryan SA, Phelps CE, Richeson JF, Johnson JE: The association between interdisciplinary collaboration and patient outcomes in a medical intensive care unit. Heart Lung. 1992, 21 (1): 18-24.PubMed Baggs JG, Ryan SA, Phelps CE, Richeson JF, Johnson JE: The association between interdisciplinary collaboration and patient outcomes in a medical intensive care unit. Heart Lung. 1992, 21 (1): 18-24.PubMed
5.
go back to reference Young GJ, Charns MP, Desai K, Khuri SF, Forbes MG, Henderson W, Daley J: Patterns of coordination and clinical outcomes: a study of surgical services. Health Serv Res. 1998, 33 (5I): 1211-1236.PubMedPubMedCentral Young GJ, Charns MP, Desai K, Khuri SF, Forbes MG, Henderson W, Daley J: Patterns of coordination and clinical outcomes: a study of surgical services. Health Serv Res. 1998, 33 (5I): 1211-1236.PubMedPubMedCentral
6.
go back to reference Hermida J, Nicholas DD, Blumenfeld SN: Comparative validity of three methods for assessment of the quality of primary health care. Int J Qual Health Care. 1999, 11: 429-433. 10.1093/intqhc/11.5.429.CrossRefPubMed Hermida J, Nicholas DD, Blumenfeld SN: Comparative validity of three methods for assessment of the quality of primary health care. Int J Qual Health Care. 1999, 11: 429-433. 10.1093/intqhc/11.5.429.CrossRefPubMed
7.
go back to reference Madden JM, Quick JD, Ross-Degnan D, Kaffle KK: Undercover careseekers: simulated clients in the study of health provider behavior in developing countries. Soc Sci Med. 1997, 45: 1465-1482. 10.1016/S0277-9536(97)00076-2.CrossRefPubMed Madden JM, Quick JD, Ross-Degnan D, Kaffle KK: Undercover careseekers: simulated clients in the study of health provider behavior in developing countries. Soc Sci Med. 1997, 45: 1465-1482. 10.1016/S0277-9536(97)00076-2.CrossRefPubMed
8.
go back to reference Simmons R, Elias C: The study of client–provider interactions: a review of methodological issues. Stud Fam Plann. 1994, 25: 1-17. 10.2307/2137985.CrossRefPubMed Simmons R, Elias C: The study of client–provider interactions: a review of methodological issues. Stud Fam Plann. 1994, 25: 1-17. 10.2307/2137985.CrossRefPubMed
9.
go back to reference Bessinger RE, Bertrand JT: Monitoring quality of care in family planning programs: a comparison of observations and client exit interviews. Int Fam Plan Perspect. 2001, 27: 63-70. 10.2307/2673816.CrossRef Bessinger RE, Bertrand JT: Monitoring quality of care in family planning programs: a comparison of observations and client exit interviews. Int Fam Plan Perspect. 2001, 27: 63-70. 10.2307/2673816.CrossRef
10.
go back to reference Carr-Hill RA: The measurement of patient satisfaction. J Public Health Med. 1992, 14 (3): 236-249.PubMed Carr-Hill RA: The measurement of patient satisfaction. J Public Health Med. 1992, 14 (3): 236-249.PubMed
11.
go back to reference Like R, Zyzanski SJ: Patient satisfaction with the clinical encounter: social psychological determinants. Soc Sci Med. 1987, 24 (4): 351-357. 10.1016/0277-9536(87)90153-5.CrossRefPubMed Like R, Zyzanski SJ: Patient satisfaction with the clinical encounter: social psychological determinants. Soc Sci Med. 1987, 24 (4): 351-357. 10.1016/0277-9536(87)90153-5.CrossRefPubMed
12.
go back to reference Sitzia J, Wood N: Patient satisfaction: a review of issues and concepts. Soc Sci Med. 1997, 45 (12): 1829-1843. 10.1016/S0277-9536(97)00128-7.CrossRefPubMed Sitzia J, Wood N: Patient satisfaction: a review of issues and concepts. Soc Sci Med. 1997, 45 (12): 1829-1843. 10.1016/S0277-9536(97)00128-7.CrossRefPubMed
13.
go back to reference Avis M, Bond M, Arthur A: Questioning patient satisfaction: an empirical investigation in two outpatient clinics. Soc Sci Med. 1997, 44 (1): 85-92. 10.1016/S0277-9536(96)00140-2.CrossRef Avis M, Bond M, Arthur A: Questioning patient satisfaction: an empirical investigation in two outpatient clinics. Soc Sci Med. 1997, 44 (1): 85-92. 10.1016/S0277-9536(96)00140-2.CrossRef
14.
go back to reference Brody DS, Miller SM, Lerman CE, Smith DG, Lazaro CG, Blum MJ: The relationship between patients’ satisfaction with their physicians and perceptions about interventions they desired and received. Med Care. 1989, 27 (11): 1027-1035. 10.1097/00005650-198911000-00004.CrossRefPubMed Brody DS, Miller SM, Lerman CE, Smith DG, Lazaro CG, Blum MJ: The relationship between patients’ satisfaction with their physicians and perceptions about interventions they desired and received. Med Care. 1989, 27 (11): 1027-1035. 10.1097/00005650-198911000-00004.CrossRefPubMed
15.
go back to reference Krane NK, Anderson D, Lazarus CJ, Termini M, Bowdish B, Chauvin S, Fonseca V: Physician practice behavior and practice guidelines: using unannounced standardized patients to gather data. J Gen Intern Med. 2009, 24 (1): 53-56. 10.1007/s11606-008-0826-3.CrossRefPubMed Krane NK, Anderson D, Lazarus CJ, Termini M, Bowdish B, Chauvin S, Fonseca V: Physician practice behavior and practice guidelines: using unannounced standardized patients to gather data. J Gen Intern Med. 2009, 24 (1): 53-56. 10.1007/s11606-008-0826-3.CrossRefPubMed
16.
go back to reference Kravitz RL, Epstein RM, Feldman MD, Franz CE, Azari R, Wilkes MS, Hinton L, Franks P: Influence of patients’ requests for direct-to-consumer advertised antidepressants: a randomized controlled trial. JAMA. 2005, 293 (16): 1995-2002. 10.1001/jama.293.16.1995.CrossRefPubMedPubMedCentral Kravitz RL, Epstein RM, Feldman MD, Franz CE, Azari R, Wilkes MS, Hinton L, Franks P: Influence of patients’ requests for direct-to-consumer advertised antidepressants: a randomized controlled trial. JAMA. 2005, 293 (16): 1995-2002. 10.1001/jama.293.16.1995.CrossRefPubMedPubMedCentral
17.
go back to reference Zabar S, Ark T, Gillespie C, Hsieh A, Kalet A, Kachur E, Manko J, Regan L: Can unannounced standardized patients assess professionalism and communication skills in the Emergency Department?. Acad Emerg Med. 2009, 16 (9): 915-918. 10.1111/j.1553-2712.2009.00510.x.CrossRefPubMed Zabar S, Ark T, Gillespie C, Hsieh A, Kalet A, Kachur E, Manko J, Regan L: Can unannounced standardized patients assess professionalism and communication skills in the Emergency Department?. Acad Emerg Med. 2009, 16 (9): 915-918. 10.1111/j.1553-2712.2009.00510.x.CrossRefPubMed
18.
go back to reference Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M: Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA. 2000, 283: 1715-1722. 10.1001/jama.283.13.1715.CrossRefPubMed Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M: Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA. 2000, 283: 1715-1722. 10.1001/jama.283.13.1715.CrossRefPubMed
19.
go back to reference Rehans JJ, Gorter S, Bokken L, Morrison L: Unannounced standardized patients in real practice: a systematic literature review. Med Educ. 2007, 41: 537-549. 10.1111/j.1365-2929.2006.02689.x.CrossRef Rehans JJ, Gorter S, Bokken L, Morrison L: Unannounced standardized patients in real practice: a systematic literature review. Med Educ. 2007, 41: 537-549. 10.1111/j.1365-2929.2006.02689.x.CrossRef
20.
go back to reference Luck J: Using standardized patients to measure physicians’ practice: validation study using audio recordings. BMJ. 2002, 325: 679-687. 10.1136/bmj.325.7366.679.CrossRefPubMedPubMedCentral Luck J: Using standardized patients to measure physicians’ practice: validation study using audio recordings. BMJ. 2002, 325: 679-687. 10.1136/bmj.325.7366.679.CrossRefPubMedPubMedCentral
21.
go back to reference Yedidia MJ, Gillespie CC, Kachur E, Schwartz MD, Ockene J, Chepaitis A, Snyder CW, Lipkin M, Lazare A: Communications training improved student performance: findings from a controlled 3-school experiment. JAMA. 2003, 290 (9): 1157-1165. 10.1001/jama.290.9.1157.CrossRefPubMed Yedidia MJ, Gillespie CC, Kachur E, Schwartz MD, Ockene J, Chepaitis A, Snyder CW, Lipkin M, Lazare A: Communications training improved student performance: findings from a controlled 3-school experiment. JAMA. 2003, 290 (9): 1157-1165. 10.1001/jama.290.9.1157.CrossRefPubMed
22.
go back to reference Tewksbury LR, Gillespie C, Paik S, Richter RA, Kalet AL: Quality and quantity of patient contact correlates with performance on a clinical skills exam. 2007, Toronto, ON: COMSEP Tewksbury LR, Gillespie C, Paik S, Richter RA, Kalet AL: Quality and quantity of patient contact correlates with performance on a clinical skills exam. 2007, Toronto, ON: COMSEP
23.
go back to reference Tewksbury LR, Gillespie C, Richter RA, Kalet A: Medical students with lowest performance on a clinical skills exam poorly self-assess ability. 2006, San Francisco, CA: PAS Tewksbury LR, Gillespie C, Richter RA, Kalet A: Medical students with lowest performance on a clinical skills exam poorly self-assess ability. 2006, San Francisco, CA: PAS
24.
go back to reference Tewksbury LR, Gillespie C, Richter RA, Kalet A: The validity of a comprehensive clinical skills exam. 2006, Los Angeles, CA: SGIM National Oral Presentation Tewksbury LR, Gillespie C, Richter RA, Kalet A: The validity of a comprehensive clinical skills exam. 2006, Los Angeles, CA: SGIM National Oral Presentation
25.
go back to reference Tewksbury LR, Richter RA, Gillespie C, Chase J, Kalet A: Communication skills are highly correlated with history content: Findings of a comprehensive clinical skills examination for medical students. 2005, PAS Tewksbury LR, Richter RA, Gillespie C, Chase J, Kalet A: Communication skills are highly correlated with history content: Findings of a comprehensive clinical skills examination for medical students. 2005, PAS
26.
go back to reference Hochberg MS, Kalet A, Zabar S, Kachur E, Gillespie C, Berman RS: Can professionalism be taught? Encouraging evidence. Am J Surg. 2010, 199 (1): 86-93. 10.1016/j.amjsurg.2009.10.002.CrossRefPubMed Hochberg MS, Kalet A, Zabar S, Kachur E, Gillespie C, Berman RS: Can professionalism be taught? Encouraging evidence. Am J Surg. 2010, 199 (1): 86-93. 10.1016/j.amjsurg.2009.10.002.CrossRefPubMed
27.
go back to reference Stevens DL, King D, Laponis R, Laponis R, Hanley K, Zabar S, Kalet A: Medical students retain pain assessment and management skills long after an experiential curriculum: a controlled study. Pain. 2009, 145 (3): 319-324. 10.1016/j.pain.2009.06.030.CrossRefPubMed Stevens DL, King D, Laponis R, Laponis R, Hanley K, Zabar S, Kalet A: Medical students retain pain assessment and management skills long after an experiential curriculum: a controlled study. Pain. 2009, 145 (3): 319-324. 10.1016/j.pain.2009.06.030.CrossRefPubMed
28.
go back to reference Nishisaki A, Keren R, Nadkarni V: Does simulation improve patient safety?: self-efficacy, competence, operational performance, and patient safety. Anesthesiol Clin. 2007, 25 (2): 225-236. 10.1016/j.anclin.2007.03.009.CrossRefPubMed Nishisaki A, Keren R, Nadkarni V: Does simulation improve patient safety?: self-efficacy, competence, operational performance, and patient safety. Anesthesiol Clin. 2007, 25 (2): 225-236. 10.1016/j.anclin.2007.03.009.CrossRefPubMed
29.
go back to reference Battles JB, Wilkinson SL, Lee SJ: Using standardized patients in an objective structured clinical examination as a patient safety tool. Qual Saf Health Care. 2004, 13 (SUPPL. 1): i46-i50.CrossRefPubMedPubMedCentral Battles JB, Wilkinson SL, Lee SJ: Using standardized patients in an objective structured clinical examination as a patient safety tool. Qual Saf Health Care. 2004, 13 (SUPPL. 1): i46-i50.CrossRefPubMedPubMedCentral
30.
go back to reference Berner ES, Houston TK, Ray MN, Allison JJ, Heudebert GR, Chatham WW, Kennedy JI, Glandon GL, Norton PA, Crawford MA, Maisiak RS: Improving ambulatory prescribing safety with a handheld decision support system: a randomized controlled trial. J Am Med Inform Assoc. 2006, 13 (2): 171-179.CrossRefPubMedPubMedCentral Berner ES, Houston TK, Ray MN, Allison JJ, Heudebert GR, Chatham WW, Kennedy JI, Glandon GL, Norton PA, Crawford MA, Maisiak RS: Improving ambulatory prescribing safety with a handheld decision support system: a randomized controlled trial. J Am Med Inform Assoc. 2006, 13 (2): 171-179.CrossRefPubMedPubMedCentral
31.
go back to reference Rogers JC: The patient-centered medical home movement - promise and peril for family medicine. J Am Board Fam Med. 2008, 21 (5): 370-374. 10.3122/jabfm.2008.05.080142.CrossRefPubMed Rogers JC: The patient-centered medical home movement - promise and peril for family medicine. J Am Board Fam Med. 2008, 21 (5): 370-374. 10.3122/jabfm.2008.05.080142.CrossRefPubMed
32.
go back to reference Rosenthal TC: The medical home: growing evidence to support a new approach to primary care. J Am Board Fam Med. 2008, 21 (5): 427-440. 10.3122/jabfm.2008.05.070287.CrossRefPubMed Rosenthal TC: The medical home: growing evidence to support a new approach to primary care. J Am Board Fam Med. 2008, 21 (5): 427-440. 10.3122/jabfm.2008.05.070287.CrossRefPubMed
33.
go back to reference Sia C, Tonniges TF, Osterhus E, Taba S: History of the medical home concept. Pediatrics. 2004, 113 (5 II): 1473-1478.PubMed Sia C, Tonniges TF, Osterhus E, Taba S: History of the medical home concept. Pediatrics. 2004, 113 (5 II): 1473-1478.PubMed
34.
go back to reference Rhodes K: Taking the mystery out of "mystery shopper" studies. N Engl J Med. 2011, 365 (6): 484-486. 10.1056/NEJMp1107779.CrossRefPubMed Rhodes K: Taking the mystery out of "mystery shopper" studies. N Engl J Med. 2011, 365 (6): 484-486. 10.1056/NEJMp1107779.CrossRefPubMed
35.
go back to reference Ward J, Sanson-Fisher R: Accuracy of patient recall of opportunistic smoking cessation advice in general practice. Tob Control. 1996, 5 (2): 110-113. 10.1136/tc.5.2.110.CrossRefPubMedPubMedCentral Ward J, Sanson-Fisher R: Accuracy of patient recall of opportunistic smoking cessation advice in general practice. Tob Control. 1996, 5 (2): 110-113. 10.1136/tc.5.2.110.CrossRefPubMedPubMedCentral
36.
go back to reference Pbert L, Adam A, Quirk M, Herbert JR, Ockene JK, Luippold RS: The patient exit interview as an assessment of physician-delivered smoking intervention: a validation study. Health Psychol. 1999, 18 (2): 183-188.CrossRefPubMed Pbert L, Adam A, Quirk M, Herbert JR, Ockene JK, Luippold RS: The patient exit interview as an assessment of physician-delivered smoking intervention: a validation study. Health Psychol. 1999, 18 (2): 183-188.CrossRefPubMed
37.
go back to reference Clear and convincing evidence: measurement of discrimination in America. Edited by: Fix M, Struyk RJ. 1993, Washington, DC: Urban Institute Press Clear and convincing evidence: measurement of discrimination in America. Edited by: Fix M, Struyk RJ. 1993, Washington, DC: Urban Institute Press
38.
go back to reference Siminoff L, Rogers H, Waller A, Harris-Haywood S, Esptein R, Carrio FB, Gliva-McConvey G, Longo D: The advantages and challenges of unannounced standardized patient methodology to assess healthcare communication. Patient Educ Couns. 2011, 82 (3): 318-324. 10.1016/j.pec.2011.01.021.CrossRefPubMedPubMedCentral Siminoff L, Rogers H, Waller A, Harris-Haywood S, Esptein R, Carrio FB, Gliva-McConvey G, Longo D: The advantages and challenges of unannounced standardized patient methodology to assess healthcare communication. Patient Educ Couns. 2011, 82 (3): 318-324. 10.1016/j.pec.2011.01.021.CrossRefPubMedPubMedCentral
39.
go back to reference Rethans J, Gorter S, Bokken L, Morrison L: Unannounced standardized patients in real practice: a systematic literature review. Med Educ. 2007, 6: 537-549.CrossRef Rethans J, Gorter S, Bokken L, Morrison L: Unannounced standardized patients in real practice: a systematic literature review. Med Educ. 2007, 6: 537-549.CrossRef
Metadata
Title
Unannounced standardized patients: a promising method of assessing patient-centered care in your health care system
Authors
Sondra Zabar
Kathleen Hanley
David Stevens
Jessica Murphy
Angela Burgess
Adina Kalet
Colleen Gillespie
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2014
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-14-157

Other articles of this Issue 1/2014

BMC Health Services Research 1/2014 Go to the issue