Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Research

Peering into the black box: a meta-analysis of how clinicians use decision aids during clinical encounters

Authors: Kirk D Wyatt, Megan E Branda, Ryan T Anderson, Laurie J Pencille, Victor M Montori, Erik P Hess, Henry H Ting, Annie LeBlanc

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Objective

To quantify the extent to which clinicians use clinically-efficacious decision aids as intended during implementation in practice and how fidelity to usage instructions correlates with shared decision making (SDM) outcomes.

Methods

Participant-level meta-analysis including six practice-based randomized controlled trials of SDM in various clinical settings encompassing a range of decisions.

Results

Of 339 encounters in the SDM intervention arm of the trials, 229 were video recorded and available for analysis. The mean proportion of fidelity items observed in each encounter was 58.4% (SD = 23.2). The proportion of fidelity items observed was significantly associated with patient knowledge (p = 0.01) and clinician involvement of the patient in decision making (p <0.0001), while no association was found with patient decisional conflict or satisfaction with the encounter.

Conclusion

Clinicians’ fidelity to usage instructions of point-of-care decision aids in randomized trials was suboptimal during their initial implementation in practice, which may have underestimated the potential efficacy of decision aids when used as intended.
Appendix
Available only for authorised users
Literature
1.
go back to reference Stiggelbout AM, Van der Weijden T, De Wit MP, Frosch D, Legare F, Montori VM, Trevena L, Elwyn G: Shared decision making: really putting patients at the centre of healthcare. BMJ. 2012, 344: e256-10.1136/bmj.e256.CrossRefPubMed Stiggelbout AM, Van der Weijden T, De Wit MP, Frosch D, Legare F, Montori VM, Trevena L, Elwyn G: Shared decision making: really putting patients at the centre of healthcare. BMJ. 2012, 344: e256-10.1136/bmj.e256.CrossRefPubMed
2.
go back to reference Makoul G, Clayman ML: An integrative model of shared decision making in medical encounters. Patient Educ Couns. 2006, 60: 301-312. 10.1016/j.pec.2005.06.010.CrossRefPubMed Makoul G, Clayman ML: An integrative model of shared decision making in medical encounters. Patient Educ Couns. 2006, 60: 301-312. 10.1016/j.pec.2005.06.010.CrossRefPubMed
3.
go back to reference Stacey D, Bennett CL, Barry MJ, Col NF, Eden KB, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Legare F, Thomson R: Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2011, CD001431-10 Stacey D, Bennett CL, Barry MJ, Col NF, Eden KB, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Legare F, Thomson R: Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2011, CD001431-10
4.
go back to reference Coylewright M, Shepel K, Leblanc A, Pencille L, Hess E, Shah N, Montori VM, Ting HH: Shared decision making in patients with stable coronary artery disease: PCI choice. PLoS One. 2012, 7: e49827-10.1371/journal.pone.0049827.CrossRefPubMedPubMedCentral Coylewright M, Shepel K, Leblanc A, Pencille L, Hess E, Shah N, Montori VM, Ting HH: Shared decision making in patients with stable coronary artery disease: PCI choice. PLoS One. 2012, 7: e49827-10.1371/journal.pone.0049827.CrossRefPubMedPubMedCentral
5.
go back to reference Hess EP, Knoedler MA, Shah ND, Kline JA, Breslin M, Branda ME, Pencille LJ, Asplin BR, Nestler DM, Sadosty AT: The chest pain choice decision aid: a randomized trial. Circ Cardiovasc Qual Outcomes. 2012, 5: 251-259. 10.1161/CIRCOUTCOMES.111.964791.CrossRefPubMed Hess EP, Knoedler MA, Shah ND, Kline JA, Breslin M, Branda ME, Pencille LJ, Asplin BR, Nestler DM, Sadosty AT: The chest pain choice decision aid: a randomized trial. Circ Cardiovasc Qual Outcomes. 2012, 5: 251-259. 10.1161/CIRCOUTCOMES.111.964791.CrossRefPubMed
6.
go back to reference Montori VM, Shah ND, Pencille LJ, Branda ME, Van Houten HK, Swiglo BA, Kesman RL, Tulledge-Scheitel SM, Jaeger TM, Johnson RE: Use of a decision aid to improve treatment decisions in osteoporosis: the osteoporosis choice randomized trial. Am J Med. 2011, 124: 549-556. 10.1016/j.amjmed.2011.01.013.CrossRefPubMed Montori VM, Shah ND, Pencille LJ, Branda ME, Van Houten HK, Swiglo BA, Kesman RL, Tulledge-Scheitel SM, Jaeger TM, Johnson RE: Use of a decision aid to improve treatment decisions in osteoporosis: the osteoporosis choice randomized trial. Am J Med. 2011, 124: 549-556. 10.1016/j.amjmed.2011.01.013.CrossRefPubMed
7.
go back to reference Mullan RJ, Montori VM, Shah ND, Christianson TJ, Bryant SC, Guyatt GH, Perestelo-Perez LI, Stroebel RJ, Yawn BP, Yapuncich V: The diabetes mellitus medication choice decision aid: a randomized trial. Arch Intern Med. 2009, 169: 1560-1568.CrossRefPubMed Mullan RJ, Montori VM, Shah ND, Christianson TJ, Bryant SC, Guyatt GH, Perestelo-Perez LI, Stroebel RJ, Yawn BP, Yapuncich V: The diabetes mellitus medication choice decision aid: a randomized trial. Arch Intern Med. 2009, 169: 1560-1568.CrossRefPubMed
8.
go back to reference Nannenga MR, Montori VM, Weymiller AJ, Smith SA, Christianson TJ, Bryant SC, Gafni A, Charles C, Mullan RJ, Jones LA: A treatment decision aid may increase patient trust in the diabetes specialist. The Statin Choice randomized trial. Health Expect. 2009, 12: 38-44. 10.1111/j.1369-7625.2008.00521.x.CrossRefPubMed Nannenga MR, Montori VM, Weymiller AJ, Smith SA, Christianson TJ, Bryant SC, Gafni A, Charles C, Mullan RJ, Jones LA: A treatment decision aid may increase patient trust in the diabetes specialist. The Statin Choice randomized trial. Health Expect. 2009, 12: 38-44. 10.1111/j.1369-7625.2008.00521.x.CrossRefPubMed
9.
go back to reference Montori VM, Breslin M, Maleska M, Weymiller AJ: Creating a conversation: insights from the development of a decision aid. PLoS Med. 2007, 4: e233-10.1371/journal.pmed.0040233.CrossRefPubMedPubMedCentral Montori VM, Breslin M, Maleska M, Weymiller AJ: Creating a conversation: insights from the development of a decision aid. PLoS Med. 2007, 4: e233-10.1371/journal.pmed.0040233.CrossRefPubMedPubMedCentral
10.
go back to reference Breslin M, Mullan RJ, Montori VM: The design of a decision aid about diabetes medications for use during the consultation with patients with type 2 diabetes. Patient Educ Couns. 2008, 73: 465-472. 10.1016/j.pec.2008.07.024.CrossRefPubMed Breslin M, Mullan RJ, Montori VM: The design of a decision aid about diabetes medications for use during the consultation with patients with type 2 diabetes. Patient Educ Couns. 2008, 73: 465-472. 10.1016/j.pec.2008.07.024.CrossRefPubMed
11.
go back to reference Weymiller AJ, Montori VM, Jones LA, Gafni A, Guyatt GH, Bryant SC, Christianson TJ, Mullan RJ, Smith SA: Helping patients with type 2 diabetes mellitus make treatment decisions: statin choice randomized trial. Arch Intern Med. 2007, 167: 1076-1082. 10.1001/archinte.167.10.1076.CrossRefPubMed Weymiller AJ, Montori VM, Jones LA, Gafni A, Guyatt GH, Bryant SC, Christianson TJ, Mullan RJ, Smith SA: Helping patients with type 2 diabetes mellitus make treatment decisions: statin choice randomized trial. Arch Intern Med. 2007, 167: 1076-1082. 10.1001/archinte.167.10.1076.CrossRefPubMed
12.
go back to reference Abadie R, Weymiller AJ, Tilburt J, Shah N, Charles C, Gafni A, Montori V: Clinician’s use of the Statin Choice decision aid in patients with diabetes: a videographic study nested in a randomized trial. J Eval Clin Pract. 2009, In press Abadie R, Weymiller AJ, Tilburt J, Shah N, Charles C, Gafni A, Montori V: Clinician’s use of the Statin Choice decision aid in patients with diabetes: a videographic study nested in a randomized trial. J Eval Clin Pract. 2009, In press
13.
go back to reference Pierce MA, Hess EP, Kline JA, Shah ND, Breslin M, Branda ME, Pencille LJ, Asplin BR, Nestler DM, Sadosty AT: The chest pain choice trial: a pilot randomized trial of a decision aid for patients with chest pain in the emergency department. Trials. 2010, 11: 57-10.1186/1745-6215-11-57.CrossRefPubMedPubMedCentral Pierce MA, Hess EP, Kline JA, Shah ND, Breslin M, Branda ME, Pencille LJ, Asplin BR, Nestler DM, Sadosty AT: The chest pain choice trial: a pilot randomized trial of a decision aid for patients with chest pain in the emergency department. Trials. 2010, 11: 57-10.1186/1745-6215-11-57.CrossRefPubMedPubMedCentral
14.
go back to reference Pencille LJ, Campbell ME, Van Houten HK, Shah ND, Mullan RJ, Swiglo BA, Breslin M, Kesman RL, Tulledge-Scheitel SM, Jaeger TM: Protocol for the osteoporosis choice trial. A pilot randomized trial of a decision aid in primary care practice. Trials. 2009, 10: 113-10.1186/1745-6215-10-113.CrossRefPubMedPubMedCentral Pencille LJ, Campbell ME, Van Houten HK, Shah ND, Mullan RJ, Swiglo BA, Breslin M, Kesman RL, Tulledge-Scheitel SM, Jaeger TM: Protocol for the osteoporosis choice trial. A pilot randomized trial of a decision aid in primary care practice. Trials. 2009, 10: 113-10.1186/1745-6215-10-113.CrossRefPubMedPubMedCentral
15.
go back to reference LeBlanc A, Ruud KL, Branda ME, Tiedje K, Boehmer KR, Pencille LJ, Van Houten H, Matthews M, Shah ND, May CR: The impact of decision aids to enhance shared decision making for diabetes (the DAD study): protocol of a cluster randomized trial. BMC Health Serv Res. 2012, 12: 130-10.1186/1472-6963-12-130.CrossRefPubMedPubMedCentral LeBlanc A, Ruud KL, Branda ME, Tiedje K, Boehmer KR, Pencille LJ, Van Houten H, Matthews M, Shah ND, May CR: The impact of decision aids to enhance shared decision making for diabetes (the DAD study): protocol of a cluster randomized trial. BMC Health Serv Res. 2012, 12: 130-10.1186/1472-6963-12-130.CrossRefPubMedPubMedCentral
16.
go back to reference O’Connor AM: Validation of a decisional conflict scale. Med Decis Making. 1995, 15: 25-30. 10.1177/0272989X9501500105.CrossRefPubMed O’Connor AM: Validation of a decisional conflict scale. Med Decis Making. 1995, 15: 25-30. 10.1177/0272989X9501500105.CrossRefPubMed
17.
go back to reference Elwyn G, Hutchings H, Edwards A, Rapport F, Wensing M, Cheung WY, Grol R: The OPTION scale: measuring the extent that clinicians involve patients in decision-making tasks. Health Expect. 2005, 8: 34-42. 10.1111/j.1369-7625.2004.00311.x.CrossRefPubMed Elwyn G, Hutchings H, Edwards A, Rapport F, Wensing M, Cheung WY, Grol R: The OPTION scale: measuring the extent that clinicians involve patients in decision-making tasks. Health Expect. 2005, 8: 34-42. 10.1111/j.1369-7625.2004.00311.x.CrossRefPubMed
18.
go back to reference Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG: Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009, 42: 377-381. 10.1016/j.jbi.2008.08.010.CrossRefPubMed Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG: Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009, 42: 377-381. 10.1016/j.jbi.2008.08.010.CrossRefPubMed
19.
go back to reference Lin LI: A concordance correlation coefficient to evaluate reproducibility. Biometrics. 1989, 45: 255-268. 10.2307/2532051.CrossRefPubMed Lin LI: A concordance correlation coefficient to evaluate reproducibility. Biometrics. 1989, 45: 255-268. 10.2307/2532051.CrossRefPubMed
20.
go back to reference Godolphin W, Towle A, McKendry R: Challenges in family practice related to informed and shared decision-making: a survey of preceptors of medical students. CMAJ. 2001, 165: 434-435.PubMedPubMedCentral Godolphin W, Towle A, McKendry R: Challenges in family practice related to informed and shared decision-making: a survey of preceptors of medical students. CMAJ. 2001, 165: 434-435.PubMedPubMedCentral
21.
go back to reference Legare F, Ratte S, Gravel K, Graham ID: Barriers and facilitators to implementing shared decision-making in clinical practice: update of a systematic review of health professionals’ perceptions. Patient Educ Couns. 2008, 73 (3): 526-35. 10.1016/j.pec.2008.07.018.CrossRefPubMed Legare F, Ratte S, Gravel K, Graham ID: Barriers and facilitators to implementing shared decision-making in clinical practice: update of a systematic review of health professionals’ perceptions. Patient Educ Couns. 2008, 73 (3): 526-35. 10.1016/j.pec.2008.07.018.CrossRefPubMed
22.
go back to reference Clayman ML, Makoul G, Harper MM, Koby DG, Williams AR: Development of a shared decision making coding system for analysis of patient-healthcare provider encounters. Patient Educ Couns. 2012, 88: 367-372. 10.1016/j.pec.2012.06.011.CrossRefPubMedPubMedCentral Clayman ML, Makoul G, Harper MM, Koby DG, Williams AR: Development of a shared decision making coding system for analysis of patient-healthcare provider encounters. Patient Educ Couns. 2012, 88: 367-372. 10.1016/j.pec.2012.06.011.CrossRefPubMedPubMedCentral
Metadata
Title
Peering into the black box: a meta-analysis of how clinicians use decision aids during clinical encounters
Authors
Kirk D Wyatt
Megan E Branda
Ryan T Anderson
Laurie J Pencille
Victor M Montori
Erik P Hess
Henry H Ting
Annie LeBlanc
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-9-26

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue