Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Medical Informatics and Decision Making
Published in: BMC Medical Informatics and Decision Making 1/2014

Open Access 01-12-2014 | Research article

Launching a virtual decision lab: development and field-testing of a web-based patient decision support research platform

Authors: Aubri S Hoffman, Hilary A Llewellyn-Thomas, Anna N A Tosteson, Annette M O’Connor, Robert J Volk, Ivan M Tomek, Steven B Andrews, Stephen J Bartels

Published in: BMC Medical Informatics and Decision Making | Issue 1/2014

Login to get access

Abstract

Background

Over 100 trials show that patient decision aids effectively improve patients’ information comprehension and values-based decision making. However, gaps remain in our understanding of several fundamental and applied questions, particularly related to the design of interactive, personalized decision aids. This paper describes an interdisciplinary development process for, and early field testing of, a web-based patient decision support research platform, or virtual decision lab, to address these questions.

Methods

An interdisciplinary stakeholder panel designed the web-based research platform with three components: a) an introduction to shared decision making, b) a web-based patient decision aid, and c) interactive data collection items. Iterative focus groups provided feedback on paper drafts and online prototypes. A field test assessed a) feasibility for using the research platform, in terms of recruitment, usage, and acceptability; and b) feasibility of using the web-based decision aid component, compared to performance of a videobooklet decision aid in clinical care.

Results

This interdisciplinary, theory-based, patient-centered design approach produced a prototype for field-testing in six months. Participants (n = 126) reported that: the decision aid component was easy to use (98%), information was clear (90%), the length was appropriate (100%), it was appropriately detailed (90%), and it held their interest (97%). They spent a mean of 36 minutes using the decision aid and 100% preferred using their home/library computer. Participants scored a mean of 75% correct on the Decision Quality, Knowledge Subscale, and 74 out of 100 on the Preparation for Decision Making Scale. Completing the web-based decision aid reduced mean Decisional Conflict scores from 31.1 to 19.5 (p < 0.01).

Conclusions

Combining decision science and health informatics approaches facilitated rapid development of a web-based patient decision support research platform that was feasible for use in research studies in terms of recruitment, acceptability, and usage. Within this platform, the web-based decision aid component performed comparably with the videobooklet decision aid used in clinical practice. Future studies may use this interactive research platform to study patients’ decision making processes in real-time, explore interdisciplinary approaches to designing web-based decision aids, and test strategies for tailoring decision support to meet patients’ needs and preferences.
Appendix
Available only for authorised users
Literature
1.
2.
3.
Llewellyn-Thomas H: The Decision Research ‘lab’. Shared Decision-Making in Health Care. Edited by: Edwards A, Elwyn G. 2009, Oxford University Press, Oxford, 243-247.
4.
Hoffman A, Volk R, Härter M, Li L, Saarimaki A, Stirling C: Delivering decision aids on the internet. BMC Med Inform and Dec Making. 2013, 13 (Suppl 2): S13-10.1186/1472-6947-13-S2-S13.CrossRef
5.
Drake RE, Cimpean D, Torrey WC: Shared decision making in mental heatlh: prospects for personalized medicine. Dialogues Clin Neurosci. 2009, 11 (4): 455-463.PubMedPubMedCentral
6.
Molenaar S, Sprangers M, Oort F, Rutgers E, Luiten E, Mulder J, van Meeteren M, de Haes H: Exploring the black box of a decision aid: What information do patients select from an interactive CD-Rom on treatment options in breast cancer?. Pat Edu Counsel. 2007, 65 (1): 122-130. 10.1016/j.pec.2006.06.022.CrossRef
7.
Tam KY, Ho SK: Understanding the impact of web personalization on user information processing and decision outcomes. Mis Quart. 2006, 30 (4): 865-890.
8.
Keisler DJ, Auerbach SM: Optimal matches of patient preferences for information, decision-making and interpersonal behavior: evidence, models, and interventions. Patient Educ Couns. 2006, 61: 319-341. 10.1016/j.pec.2005.08.002.CrossRef
9.
McCaffery K, Sheridan S, Nutbeam D, Clayman M, Kelly-Blake K, Rovner M, Rovner D, Smith S, Wolf M: Addressing health literacy in patient decision aids. BMC Med Inform and Dec Making. 2013, 13 (Suppl 2): S10-10.1186/1472-6947-13-S2-S10.CrossRef
10.
Volk RJ, Jibaba-Weiss ML, Hawley ST, Kneuper S, Spann SJ, Miles BJ, Hyman DJ: Entertainment education for prostate cancer screening: a randomized trial among primary care patients with low health literacy. Patient Educ Couns. 2008, 73 (3): 482-489. 10.1016/j.pec.2008.07.033.CrossRefPubMedPubMedCentral
11.
Witteman HO, Fuhrel-Forbis A, Wijeysundera HC, Exe N, Dickson M, Holtzman L, Kahn VC, Zikmund-Fisher BJ: Animated randomness, avatars, movement, and personalization in risk graphics.
12.
Miller SM: Monitoring and blunting: validation of a questionnaire to assess styles of information seeking under threat. J Pers Soc Psychol. 1987, 52: 34-53.
13.
Llewellyn-Thomas HA: Patients’ health-care decision making: a framework for descriptive and experimental investigations. Med Decis Making. 1995, 15: 101-106. 10.1177/0272989X9501500201.CrossRefPubMed
14.
Llewellyn-Thomas HA: Decision-Making Needs of Older People: The Role of patients’ Decision Aids. 2005, The National Academies, National Academy of Sciences, Washington, D.C.
15.
Miller DP, Spangler JG, Case LD, Goof DC, Singh S, Pignone MP: Effectiveness of a web-based colorectal cancer screening patient decision aid: a randomized controlled trial in a mixed-literacy population. Amer J Prevent Med. 2011, 40 (6): 608-615. 10.1016/j.amepre.2011.02.019.CrossRef
16.
Thomson MD, Hoffman-Goetz L: Readability and cultural sensitivity of web-based patient decision aids for cancer screening and treatment: a systematic review. Med Inform Internet Med. 2007, 32: 263-286. 10.1080/14639230701780408.CrossRefPubMed
17.
Edwards A, Thomas R, Williams R, Ellner AL, Brown P, Elwyn G: Presenting risk information to people with diabetes: evaluating effects and preference for different formats by a web-based randomized controlled trial. Patient Educ Counsel. 2006, 63 (3): 336-349. 10.1016/j.pec.2005.12.016.CrossRef
18.
Fagerlin A, Zikmund-Fisher BJ, Nair V, Derry HA, McClure JB, Greene S, Stark A, Hensley Alford S, Lantz P, Hayes DF, Wiese C, Claud Zweig S, Pitsch R, Jankovic A, Ubel PA: Women's decisions regarding tamoxifen for breast cancer prevention: responses to a tailored decision aid. Breast Cancer Res Treat. 2010, 119 (3): 613-620. 10.1007/s10549-009-0618-4.CrossRefPubMedPubMedCentral
19.
Banegas MP, McClure JB, Barlow WE, Ubel PA, Smith DM, Zikmund-Fisher BJ, Greene SM, Fagerlin A: Results from a randomized trial of a web-based, tailored decision aid for women at high risk for breast cancer. Patient Educ Couns. 2013, 91 (3): 364-371. 10.1016/j.pec.2012.12.014.CrossRefPubMedPubMedCentral
20.
Li LC, Adam PM, Backman CL, Lineker S, Jones CA, Lacaille D, Townsend AF, Yacyshyn E, Yousefi C, Tugwell P, Leese J, Stacey D: A proof-of-concept study of ANSWER, a web-based methotrexate decision aid for patients with rheumatoid arthritis.Arthritis Care Res 2014, [Epub ahead of print].,
21.
Ozanne EM, Howe R, Omer Z, Esserman LJ: Development of a personalized decision aid for breast cancer risk reduction and management. BMC Med Inform Decis Mak. 2014, 14: 4-10.1186/1472-6947-14-4.CrossRefPubMedPubMedCentral
22.
Simon D, Kriston L, von Wolff A, Buchholz A, Vietor C, Hecke T, Loh A, Zenker M, Weiss M, Härter M: Effectiveness of a web-based, individually tailored decision aid for depression or acute low back pain: a randomized controlled trial. Patient Educ Couns. 2012, 87 (3): 360-368. 10.1016/j.pec.2011.10.009.CrossRefPubMed
23.
Durand MA, Wegwarth O, Boivin J, Elwyn G: Design and usability of heuristic-based deliberation tools for women facing amniocentesis. Health Expect. 2012, 15 (1): 32-48. 10.1111/j.1369-7625.2010.00651.x.CrossRefPubMed
24.
DuBenske LL, Gustafson DH, Shaw BR, Cleary JF: Web-based cancer communication and decision making systems: connecting patients, caregivers, and clinicians for improved health outcomes. Med Decis Making. 2010, 30 (6): 732-744. 10.1177/0272989X10386382.CrossRefPubMedPubMedCentral
25.
Frosch DL, Kaplan RM, Felitti VJ: A randomized controlled trial comparing internet and video to facilitate patient education for men considering the prostate specific antigen test. J Gen Intern Med. 2003, 18: 781-787. 10.1046/j.1525-1497.2003.20911.x.CrossRefPubMedPubMedCentral
26.
Frosch DL, Bhatnagar V, Tally S, Hamori CJ, Kaplan RM: Internet patient decision support: a randomized controlled trial comparing alternative approaches for men considering prostate cancer screening. Arch Intern Med. 2008, 168: 363-369. 10.1001/archinternmed.2007.111.CrossRefPubMed
27.
Sivell S, Edwards A, Manstead AS, Reed MW, Caldon L, Collins K, Clements A, Elwyn G, BresDex Group: Increasing readiness to decide and strengthening behavioral intentions: evaluating the impact of a web-based patient decision aid for breast cancer treatment options (BresDex:). Patient Educ Couns. 2012, 88 (2): 209-217. 10.1016/j.pec.2012.03.012.CrossRefPubMed
28.
Elwyn G, Kreuwel I, Durand MA, Sivell S, Joseph-Williams N, Evans R, Edwards A: How to develop web-based decision support interventions for patients: a process map. Patient Educ Couns. 2011, 82 (2): 260-265. 10.1016/j.pec.2010.04.034.CrossRefPubMed
29.
Evans R, Elwyn G, Edwards A, Watson E, Austoker J, Grol R: Toward a model for field-testing patient decision-support technologies: a qualitative field-testing study. J Med Internet Res. 2007, 9 (3): e21-10.2196/jmir.9.3.e21.CrossRefPubMedPubMedCentral
30.
31.
32.
Jacko JA, Sears A: Human-Computer Interaction Handbook. 2003, Lawrence Erlbaum & Associates, Mahwah
33.
Altman R, Asch E, Bloch D, Bole G, Borenstein D, Brandt K, Christy W, Cooke TD, Greenwald R, Hochberg M, Howell D, Kaplan D, Koopman W, Longley A, Mankin H, McShane DJ, Medsger T, Meenan R, Mikkelsen W, Moskowitz R, Murphy W, Rothschild B, Segal M, Sokoloff L, Wolfe F: Development of criteria for the classification and reporting of osteoarthritis: classification of osteoarthritis of the knee. Diagnostic and therapeutic criteria committee of the American rheumatism association. Arthritis Rheum. 1986, 29: 1039-1049. 10.1002/art.1780290816.CrossRefPubMed
34.
World Health Organization: The Global Burden of Disease: 2004 Update. 2008, World Health Organization, Geneva
35.
Lawrence RC, Felson DT, Helmick CG, Arnold LM, Choi H, Deyo RA, Gabriel S, Hirsch R, Hochberg MC, Hunder GG, Jordan JM, Katz JN, Kremers HM, Wolfe F, National Arthritis Data Workgroup: National arthritis data workgroup estimates of the prevalence of arthritis and other rheumatic conditions in the United States: part II. Arthritis Rheum. 2008, 58: 26-35. 10.1002/art.23176.CrossRefPubMedPubMedCentral
36.
Kurtz S, Mowat F, Ong K, Chan N, Lau E, Halpern M: Prevalence of primary and revision total hip and knee arthroplasty in the United States from 1990 through 2002. J Bone Joint Surg Am. 2005, 87: 1487-1497. 10.2106/JBJS.D.02441.CrossRefPubMed
37.
Hawker GA, Wright JG, Coyote PC, Williams JI, Harvey B, Glazier R, Badley EM: Differences between men and women in the rate of use of hip and knee arthroplasty. N Engl J Med. 2000, 342: 1016-1022. 10.1056/NEJM200004063421405.CrossRefPubMed
38.
39.
O’Connor AM, Graham ID, Visser A: Implementing shared decision making in diverse health care systems: the role of patients’ decision aids. Patient Educ Couns. 2005, 57: 247-249. 10.1016/j.pec.2005.04.010.CrossRefPubMed
40.
O’Connor AM, Wennberg JE, Legare F, Llewellyn-Thomas HA, Moulton BW, Sepucha KR, Sodano AG, King JS: Toward the ‘tipping point’: decision aids and informed patient choice. Health Aff. 2007, 26: 716-725. 10.1377/hlthaff.26.3.716.CrossRef
41.
Dartmouth Atlas Group: A Dartmouth Atlas Project Brief: Preference-Sensitive Care. 2007, The Dartmouth Atlas of Healthcare, Hanover, New Hampshire
42.
Rivero-Santana A, Perestelo-Perez L, Perez-Ramos J, Gonzalez-Lorenzo M, Serrano-Aguilar P: Treatment Preferences in Patients With Knee or hip Osteoarthritis: An Overview. Osteoarthritis – Diagnosis, Treatment and Surgery. Edited by: Qian C. 2012, InTech, Shanghai: China
43.
De Achaval S, Fraenkel L, Volk RJ, Cox V, Suarez-Almazor ME: Impact of educational and patient decision aids on decisional conflict associated with total knee arthroplasty. Arthritis Care Res. 2012, 64: 229-237. 10.1002/acr.20646.CrossRef
44.
45.
Sepucha KR, Stacey D, Clay CF, Chang Y, Cosenza C, Dervin G, Dorrwachter J, Feibelmann S, Katz JN, Kearing SA, Malchau H, Taljaard M, Tomek I, Tugwell P, Levin CA: Decision quality instrument for treatment of hip and knee osteoarthritis: a psychometric evaluation. BMC Musculoskelet Disord. 2011, 5 (12): 149-10.1186/1471-2474-12-149.CrossRef
46.
Bennett C, Graham ID, Kristjansson E, Kearing SA, Clay KF, O'Connor AM: Validation of a preparation for decision making scale. Patient Educ Couns. 2010, 78: 130-133. 10.1016/j.pec.2009.05.012.CrossRefPubMed
47.
O’Connor AM: Validation of a decisional conflict scale. Med Decis Making. 1995, 15: 25-30. 10.1177/0272989X9501500105.CrossRefPubMed
48.
Bellamy N, Buchanan WW, Goldsmith CH, Campbell J, Stitt LW: Validation study of WOMAC: a health status instrument for measuring clinically important patient relevant outcomes to antirheumatic drug therapy in patients with osteoarthritis of the hip or knee. J Rheumatol. 1988, 15: 1833-1840.PubMed
49.
Connor AM: User Manual – Measures of Decision/Choice Predisposition. 1996, Ottawa Hospital Research Institute, Ottawa
50.
Crump T, Llewellyn-Thomas HA: Assessing Medicare beneficiaries' strength-of-preference scores for health care options: how engaging does the elicitation technique need to be?. Health Expect. 2011, 14 (Suppl 1): 33-45. 10.1111/j.1369-7625.2010.00632.x.CrossRefPubMed
51.
52.
Lave J, Wenger E: Situated Learning: Legitimate Peripheral Participation. 1991, University of Cambridge Press, CambridgeCrossRef
53.
Slovic P: The Perception of Risk. 2000, Earthscan, Sterling
54.
Wildavsky A, Dake K: Theories of risk perception: who fears what and why?. Amer Acad of Arts and Sci. 1990, 119: 41-60.
55.
Tversky A, Kahneman D: Judgment under uncertainty: heuristics and biases. Science. 1974, 185: 1124-1131. 10.1126/science.185.4157.1124.CrossRefPubMed
56.
Zermelo E: Beweis, dass jede Menge wohlgeordnet werden kann ["Proof that every set can be well-ordered"]. Math Ann. 1904, 59: 514-516. 10.1007/BF01445300.CrossRef
57.
Luce RD, Tukey JW: Simultaneous conjoint measurement: a new scale type of fundamental measurement. J Math Psych. 1964, 1: 1-27. 10.1016/0022-2496(64)90015-X.CrossRef
58.
Tononi G: Consciousness as integrated information: a provisional manifesto. Biol Bull. 2008, 215: 216-242. 10.2307/25470707.CrossRefPubMed
59.
Bandura A: Human agency in social cognitive theory. Am Psychol. 1989, 44: 1175-84. 10.1037/0003-066X.44.9.1175.CrossRefPubMed
60.
Miller NE, Dollard J: Social learning and imitation. 1941, Yale University Press, New Haven
61.
Kahneman D, Tversky A: Prospect theory: an analysis of decision under risk. Econometrica. 1979, 42 (2): 263-291. 10.2307/1914185.CrossRef
62.
O’Connor AM, Cranney A: Users Manual - Acceptability Scale. 1996
63.
64.
Graham ID, O’Connor AM: User Manual – Preparation for Decision Making Scale [document on the Internet]. 1995, Ottawa Hospital Research Institute, Ottawa
65.
Bunn H, O'Connor A: Validation of client decision-making instruments in the context of psychiatry. Can J Nurs Res. 1996, 28: 13-27.PubMed
66.
Simon D, Loh A, Härter M: Measuring (shared) decision-making–a review of psychometric instruments. Z Arztl Fortbild Qualitatssich. 2007, 101 (4): 259-267.PubMed
67.
Bekker HL, Winterbottom A, Butow P, Dillard A, Feldman-Stewart D, Fowler J, Jibaja-Weiss M, Shaffer V, Volk R: Using Personal Stories. In 2012 update of the International Patient Decision Aids Standards (IPDAS) collaboration’s background document. Edited by Volk R, Llewellyn-Thomas H. [http://​ipdas.​ohri.​ca/​resources.​html]
68.
Shaffer VA, Owens J, Zikmund-Fisher BJ: The effect of patient narratives on information search in a web-based breast cancer decision aid: an eye-tracking study. J Med Internet Res. 2013, 15 (12): e273-10.2196/jmir.2784.CrossRefPubMedPubMedCentral
69.
Hoffman S, Caro FG, Gottlieb AS, Kesternich I, Winter JK: Contributions of second opinions, outcome forecasts, and testimonials to patient decisions about knee replacement. Med Dec Making. 2014, 34 (5): 603-614. 10.1177/0272989X14527796.CrossRef
70.
Ubel PA, Smith DM, Zikmund-Fisher BJ, Derry HA, McClure J, Stark A, Wiese C, Greene S, Jankovic A, Fagerlin A: Testing whether decision aids introduce cognitive biases: results of a randomized trial. Patient Educ Couns. 2010, 80 (2): 158-163. 10.1016/j.pec.2009.10.021.CrossRefPubMed
71.
Zikmund-Fisher BJ, Windschitl PD, Exe N, Ubel PA: 'I'll do what they did": social norm information and cancer treatment decisions. Patient Educ Couns. 2011, 85 (2): 225-229. 10.1016/j.pec.2011.01.031.CrossRefPubMedPubMedCentral
72.
Peters E, Hart PS, Fraenkel L: Informing patients: the influence of numeracy, framing, and format of side effect information on risk perceptions. Med Decis Making. 2011, 31: 432-436. 10.1177/0272989X10391672.CrossRefPubMed
Metadata
Title
Launching a virtual decision lab: development and field-testing of a web-based patient decision support research platform
Authors
Aubri S Hoffman
Hilary A Llewellyn-Thomas
Anna N A Tosteson
Annette M O’Connor
Robert J Volk
Ivan M Tomek
Steven B Andrews
Stephen J Bartels
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2014
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-014-0112-8

Other articles of this Issue 1/2014

BMC Medical Informatics and Decision Making 1/2014 Go to the issue

Research article

Algorithm for analysis of administrative pediatric cancer hospitalization data according to indication for admission

Correspondence

Technical challenges of providing record linkage services for research

Research article

Validating archetypes for the Multiple Sclerosis Functional Composite

Research article

Learning to improve medical decision making from imbalanced data without a priori cost

Research article

Diagnosis-specific readmission risk prediction using electronic health data: a retrospective cohort study

Research article

Development and pilot testing of a decision aid for drivers with dementia