Skip to main content
Top
Published in: Implementation Science 1/2017

Open Access 01-12-2017 | Systematic review

Application of discrete choice experiments to enhance stakeholder engagement as a strategy for advancing implementation: a systematic review

Authors: Ramzi G. Salloum, Elizabeth A. Shenkman, Jordan J. Louviere, David A. Chambers

Published in: Implementation Science | Issue 1/2017

Login to get access

Abstract

Background

One of the key strategies to successful implementation of effective health-related interventions is targeting improvements in stakeholder engagement. The discrete choice experiment (DCE) is a stated preference technique for eliciting individual preferences over hypothetical alternative scenarios that is increasingly being used in health-related applications. DCEs are a dynamic approach to systematically measure health preferences which can be applied in enhancing stakeholder engagement. However, a knowledge gap exists in characterizing the extent to which DCEs are used in implementation science.

Methods

We conducted a systematic literature search (up to December 2016) of the English literature to identify and describe the use of DCEs in engaging stakeholders as an implementation strategy. We searched the following electronic databases: MEDLINE, Econlit, PsychINFO, and the CINAHL using mesh terms. Studies were categorized according to application type, stakeholder(s), healthcare setting, and implementation outcome.

Results

Seventy-five publications were selected for analysis in this systematic review. Studies were categorized by application type: (1) characterizing demand for therapies and treatment technologies (n = 32), (2) comparing implementation strategies (n = 22), (3) incentivizing workforce participation (n = 11), and (4) prioritizing interventions (n = 10). Stakeholders included providers (n = 27), patients (n = 25), caregivers (n = 5), and administrators (n = 2). The remaining studies (n = 16) engaged multiple stakeholders (i.e., combination of patients, caregivers, providers, and/or administrators). The following implementation outcomes were discussed: acceptability (n = 75), appropriateness (n = 34), adoption (n = 19), feasibility (n = 16), and fidelity (n = 3).

Conclusions

The number of DCE studies engaging stakeholders as an implementation strategy has been increasing over the past decade. As DCEs are more widely used as a healthcare assessment tool, there is a wide range of applications for them in stakeholder engagement. The DCE approach could serve as a tool for engaging stakeholders in implementation science.
Appendix
Available only for authorised users
Literature
3.
go back to reference Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Heal Ment Heal Serv Res. 2009;36(1):24–34. doi: 10.1007/s10488-008-0197-4.CrossRef Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Heal Ment Heal Serv Res. 2009;36(1):24–34. doi: 10.​1007/​s10488-008-0197-4.CrossRef
4.
go back to reference Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Heal Ment Heal Serv Res. 2011;38(2):65–76. doi: 10.1007/s10488-010-0319-7.CrossRef Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Heal Ment Heal Serv Res. 2011;38(2):65–76. doi: 10.​1007/​s10488-010-0319-7.CrossRef
7.
go back to reference Powell BJ, Beidas RS, Lewis CC, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res. 2015;44(2):177-94. Powell BJ, Beidas RS, Lewis CC, et al. Methods to improve the selection and tailoring of implementation strategies. J Behav Health Serv Res. 2015;44(2):177-94.
9.
go back to reference Lancaster KJ. A new approach to consumer theory. J Polit Econ. 1966;74(2):132–57.CrossRef Lancaster KJ. A new approach to consumer theory. J Polit Econ. 1966;74(2):132–57.CrossRef
14.
15.
go back to reference Eisingerich AB, Wheelock A, Gomez GB, Garnett GP, Dybul MR, Piot PK. Attitudes and acceptance of oral and parenteral HIV preexposure prophylaxis among potential user groups: a multinational study. PLoS One. 2012;7(1) doi: 10.1371/journal.pone.0028238. Eisingerich AB, Wheelock A, Gomez GB, Garnett GP, Dybul MR, Piot PK. Attitudes and acceptance of oral and parenteral HIV preexposure prophylaxis among potential user groups: a multinational study. PLoS One. 2012;7(1) doi: 10.​1371/​journal.​pone.​0028238.
18.
go back to reference Benning TM, Kimman ML, Dirksen CD, Boersma LJ, Dellaert BGC. Combining individual-level discrete choice experiment estimates and costs to inform health care management decisions about customized care: the case of follow-up strategies after breast cancer treatment. Value Heal. 2012;15(5):680–9. doi: 10.1016/j.jval.2012.04.007.CrossRef Benning TM, Kimman ML, Dirksen CD, Boersma LJ, Dellaert BGC. Combining individual-level discrete choice experiment estimates and costs to inform health care management decisions about customized care: the case of follow-up strategies after breast cancer treatment. Value Heal. 2012;15(5):680–9. doi: 10.​1016/​j.​jval.​2012.​04.​007.CrossRef
21.
go back to reference Wheelock A, Eisingerich AB, Ananworanich J, et al. Are Thai MSM willing to take PrEP for HIV prevention? An analysis of attitudes, preferences and acceptance. PLoS One. 2013;8(1) doi: 10.1371/journal.pone.0054288. Wheelock A, Eisingerich AB, Ananworanich J, et al. Are Thai MSM willing to take PrEP for HIV prevention? An analysis of attitudes, preferences and acceptance. PLoS One. 2013;8(1) doi: 10.​1371/​journal.​pone.​0054288.
23.
go back to reference Baxter J-AB, Roth DE, Al Mahmud A, Ahmed T, Islam M, Zlotkin SH. Tablets are preferred and more acceptable than powdered prenatal calcium supplements among pregnant women in Dhaka, Bangladesh. J Nutr. 2014;144(7):1106–12. doi: 10.3945/jn.113.188524.CrossRefPubMed Baxter J-AB, Roth DE, Al Mahmud A, Ahmed T, Islam M, Zlotkin SH. Tablets are preferred and more acceptable than powdered prenatal calcium supplements among pregnant women in Dhaka, Bangladesh. J Nutr. 2014;144(7):1106–12. doi: 10.​3945/​jn.​113.​188524.CrossRefPubMed
31.
go back to reference Powell G, Holmes EAF, Plumpton CO, et al. Pharmacogenetic testing prior to carbamazepine treatment of epilepsy: patients’ and physicians’ preferences for testing and service delivery. Br J Clin Pharmacol. 2015;80(5):1149–59. doi: 10.1111/bcp.12715.CrossRefPubMedPubMedCentral Powell G, Holmes EAF, Plumpton CO, et al. Pharmacogenetic testing prior to carbamazepine treatment of epilepsy: patients’ and physicians’ preferences for testing and service delivery. Br J Clin Pharmacol. 2015;80(5):1149–59. doi: 10.​1111/​bcp.​12715.CrossRefPubMedPubMedCentral
32.
33.
go back to reference Becker MPE, Christensen BK, Cunningham CE, et al. Preferences for early intervention mental health services: a discrete-choice conjoint experiment. Psychiatr Serv. 2015;67:appips201400306. doi: 10.1176/appi.ps.201400306. Becker MPE, Christensen BK, Cunningham CE, et al. Preferences for early intervention mental health services: a discrete-choice conjoint experiment. Psychiatr Serv. 2015;67:appips201400306. doi: 10.​1176/​appi.​ps.​201400306.
34.
go back to reference Tang EC, Galea JT, Kinsler JJ, et al. Using conjoint analysis to determine the impact of product and user characteristics on acceptability of rectal microbicides for HIV prevention among Peruvian men who have sex with men. Sex Transm Infect. 2016;92(3):200–5. doi: 10.1136/sextrans-2015-052028.CrossRefPubMed Tang EC, Galea JT, Kinsler JJ, et al. Using conjoint analysis to determine the impact of product and user characteristics on acceptability of rectal microbicides for HIV prevention among Peruvian men who have sex with men. Sex Transm Infect. 2016;92(3):200–5. doi: 10.​1136/​sextrans-2015-052028.CrossRefPubMed
35.
go back to reference Hill M, Johnson J-A, Langlois S, et al. Preferences for prenatal tests for down syndrome: an international comparison of the views of pregnant women and health professionals. Eur J Hum Genet. 2015;44:968–75. doi: 10.1038/ejhg.2015.249. Hill M, Johnson J-A, Langlois S, et al. Preferences for prenatal tests for down syndrome: an international comparison of the views of pregnant women and health professionals. Eur J Hum Genet. 2015;44:968–75. doi: 10.​1038/​ejhg.​2015.​249.
36.
go back to reference Lock J, de Bekker-Grob EW, Urhan G, et al. Facilitating the implementation of pharmacokinetic-guided dosing of prophylaxis in haemophilia care by discrete choice experiment. Haemophilia. 2016;22(1):e1–e10. doi: 10.1111/hae.12851. CrossRefPubMed Lock J, de Bekker-Grob EW, Urhan G, et al. Facilitating the implementation of pharmacokinetic-guided dosing of prophylaxis in haemophilia care by discrete choice experiment. Haemophilia. 2016;22(1):e1–e10. doi: 10.​1111/​hae.​12851.​ CrossRefPubMed
37.
go back to reference Herman PM, Ingram M, Cunningham CE, et al. A comparison of methods for capturing patient preferences for delivery of mental health services to low-income Hispanics engaged in primary care. Patient. 2016;9(4):293–301. doi: 10.1007/s40271-015-0155-7.CrossRefPubMed Herman PM, Ingram M, Cunningham CE, et al. A comparison of methods for capturing patient preferences for delivery of mental health services to low-income Hispanics engaged in primary care. Patient. 2016;9(4):293–301. doi: 10.​1007/​s40271-015-0155-7.CrossRefPubMed
41.
go back to reference Determann D, Lambooij MS, Gyrd-Hansen D, et al. Personal health records in the Netherlands: potential user preferences quantified by a discrete choice experiment. J Am Med Inform Assoc. 2016;0(0):ocw158. doi: 10.1093/jamia/ocw158.CrossRef Determann D, Lambooij MS, Gyrd-Hansen D, et al. Personal health records in the Netherlands: potential user preferences quantified by a discrete choice experiment. J Am Med Inform Assoc. 2016;0(0):ocw158. doi: 10.​1093/​jamia/​ocw158.CrossRef
42.
go back to reference Harrison M, Marra CA, Bansback N. Preferences for “new” treatments diminish in the face of ambiguity. Health Econ (United Kingdom). 2016;26(6):743-52. Harrison M, Marra CA, Bansback N. Preferences for “new” treatments diminish in the face of ambiguity. Health Econ (United Kingdom). 2016;26(6):743-52.
44.
go back to reference Huis in’t Veld MHA, van Til JA, Ijzerman MJ, MMR V-H. Preferences of general practitioners regarding an application running on a personal digital assistant in acute stroke care. J Telemed Telecare. 2005;11(Suppl 1):37–9. doi: 10.1258/1357633054461615.CrossRefPubMed Huis in’t Veld MHA, van Til JA, Ijzerman MJ, MMR V-H. Preferences of general practitioners regarding an application running on a personal digital assistant in acute stroke care. J Telemed Telecare. 2005;11(Suppl 1):37–9. doi: 10.​1258/​1357633054461615​.CrossRefPubMed
46.
go back to reference Oudhoff JP, Timmermans DRM, Knol DL, Bijnen AB, Van der Wal G. Prioritising patients on surgical waiting lists: a conjoint analysis study on the priority judgements of patients, surgeons, occupational physicians, and general practitioners. Soc Sci Med. 2007;64(9):1863–75. doi: 10.1016/j.socscimed.2007.01.002.CrossRefPubMed Oudhoff JP, Timmermans DRM, Knol DL, Bijnen AB, Van der Wal G. Prioritising patients on surgical waiting lists: a conjoint analysis study on the priority judgements of patients, surgeons, occupational physicians, and general practitioners. Soc Sci Med. 2007;64(9):1863–75. doi: 10.​1016/​j.​socscimed.​2007.​01.​002.CrossRefPubMed
47.
go back to reference Goossens A, Bossuyt PMM, de Haan RJ. Physicians and nurses focus on different aspects of guidelines when deciding whether to adopt them: an application of conjoint analysis. Med Decis Mak. 2008;28(1):138–45. doi: 10.1177/0272989X07308749.CrossRef Goossens A, Bossuyt PMM, de Haan RJ. Physicians and nurses focus on different aspects of guidelines when deciding whether to adopt them: an application of conjoint analysis. Med Decis Mak. 2008;28(1):138–45. doi: 10.​1177/​0272989X07308749​.CrossRef
48.
go back to reference Van Helvoort-Postulart D, Dellaert BGC, Van Der Weijden T, Von Meyenfeldt MF, Dirksen CD. Discrete choice experiments for complex health-care decisions: does hierarchical information integration offer a solution? Health Econ. 2009;18(8):903–20. doi: 10.1002/hec.1411.CrossRefPubMed Van Helvoort-Postulart D, Dellaert BGC, Van Der Weijden T, Von Meyenfeldt MF, Dirksen CD. Discrete choice experiments for complex health-care decisions: does hierarchical information integration offer a solution? Health Econ. 2009;18(8):903–20. doi: 10.​1002/​hec.​1411.CrossRefPubMed
49.
go back to reference van Helvoort-Postulart D, van der Weijden T, Dellaert BGC, de Kok M, von Meyenfeldt MF, Dirksen CD. Investigating the complementary value of discrete choice experiments for the evaluation of barriers and facilitators in implementation research: a questionnaire survey. Implement Sci. 2009;4(1):10. doi: 10.1186/1748-5908-4-10.CrossRefPubMedPubMedCentral van Helvoort-Postulart D, van der Weijden T, Dellaert BGC, de Kok M, von Meyenfeldt MF, Dirksen CD. Investigating the complementary value of discrete choice experiments for the evaluation of barriers and facilitators in implementation research: a questionnaire survey. Implement Sci. 2009;4(1):10. doi: 10.​1186/​1748-5908-4-10.CrossRefPubMedPubMedCentral
50.
go back to reference Davison SN, Kromm SK, Currie GR. Patient and health professional preferences for organ allocation and procurement, end-of-life care and organization of care for patients with chronic kidney disease using a discrete choice experiment. Nephrol Dial Transplant. 2010;25(7):2334–41. doi: 10.1093/ndt/gfq072.CrossRefPubMed Davison SN, Kromm SK, Currie GR. Patient and health professional preferences for organ allocation and procurement, end-of-life care and organization of care for patients with chronic kidney disease using a discrete choice experiment. Nephrol Dial Transplant. 2010;25(7):2334–41. doi: 10.​1093/​ndt/​gfq072.CrossRefPubMed
51.
52.
go back to reference Grindrod KA, Marra CA, Tsuyuki RT, Lynd LD. Pharmacists ’ preferences for providing patient-centered services: a discrete choice experiment to guide. Health Policy. 2010;44:1554–64. Grindrod KA, Marra CA, Tsuyuki RT, Lynd LD. Pharmacists ’ preferences for providing patient-centered services: a discrete choice experiment to guide. Health Policy. 2010;44:1554–64.
54.
57.
go back to reference Deuchert E, Kauer L, Meisen Zannol F. Would you train me with my mental illness? Evidence from a discrete choice experiment. J Ment Health Policy Econ. 2013;16(2):67–80.PubMed Deuchert E, Kauer L, Meisen Zannol F. Would you train me with my mental illness? Evidence from a discrete choice experiment. J Ment Health Policy Econ. 2013;16(2):67–80.PubMed
59.
go back to reference Struik MHL, Koster F, Schuit AJ, Nugteren R, Veldwijk J, Lambooij MS. The preferences of users of electronic medical records in hospitals: quantifying the relative importance of barriers and facilitators of an innovation. Implement Sci. 2014;9(1):1–11. doi: 10.1186/1748-5908-9-69. CrossRef Struik MHL, Koster F, Schuit AJ, Nugteren R, Veldwijk J, Lambooij MS. The preferences of users of electronic medical records in hospitals: quantifying the relative importance of barriers and facilitators of an innovation. Implement Sci. 2014;9(1):1–11. doi: 10.​1186/​1748-5908-9-69.​ CrossRef
61.
go back to reference Nicaise P, Soto VE, Dubois V, Lorant V. Users’ and health professionals’ values in relation to a psychiatric intervention: the case of psychiatric advance directives. Adm Policy Ment Heal Ment Heal Serv Res. 2014:384–93. doi: 10.1007/s10488-014-0580-2. Nicaise P, Soto VE, Dubois V, Lorant V. Users’ and health professionals’ values in relation to a psychiatric intervention: the case of psychiatric advance directives. Adm Policy Ment Heal Ment Heal Serv Res. 2014:384–93. doi: 10.​1007/​s10488-014-0580-2.
64.
go back to reference Barrett AN, Advani HV, Chitty LS, et al. Evaluation of preferences of women and healthcare professionals in Singapore for implementation of noninvasive prenatal testing for down syndrome. Singap Med J. 2016:1–31. 10.11622/smedj.2016114. Barrett AN, Advani HV, Chitty LS, et al. Evaluation of preferences of women and healthcare professionals in Singapore for implementation of noninvasive prenatal testing for down syndrome. Singap Med J. 2016:1–31. 10.​11622/​smedj.​2016114.
65.
go back to reference Jennifer Anne Whitty C, Whitty BPharm GradDipClinPharm JA, Spinks BPharm MPHJ, Bucknall TR, Tobiano RNGB, Chaboyer WR. Patient and nurse preferences for implementation of bedside handover: do they agree? Findings from a discrete choice experiment. Health Expect. 2016;1(9):1–9. doi: 10.1111/hex.12513. Jennifer Anne Whitty C, Whitty BPharm GradDipClinPharm JA, Spinks BPharm MPHJ, Bucknall TR, Tobiano RNGB, Chaboyer WR. Patient and nurse preferences for implementation of bedside handover: do they agree? Findings from a discrete choice experiment. Health Expect. 2016;1(9):1–9. doi: 10.​1111/​hex.​12513.
67.
68.
74.
go back to reference Kasteng F, Settumba S, Källander K, Vassall A. Valuing the work of unpaid community health workers and exploring the incentives to volunteering in rural Africa. Health Policy Plan. 2016;31(2):205–16. doi: 10.1093/heapol/czv042.CrossRefPubMed Kasteng F, Settumba S, Källander K, Vassall A. Valuing the work of unpaid community health workers and exploring the incentives to volunteering in rural Africa. Health Policy Plan. 2016;31(2):205–16. doi: 10.​1093/​heapol/​czv042.CrossRefPubMed
75.
go back to reference Chen TT, Lai MS, Chung KP. Participating physician preferences regarding a pay-for-performance incentive design: a discrete choice experiment. Int J Qual Heal Care. 2016;28(1):40–6. doi: 10.1093/intqhc/mzv098.CrossRef Chen TT, Lai MS, Chung KP. Participating physician preferences regarding a pay-for-performance incentive design: a discrete choice experiment. Int J Qual Heal Care. 2016;28(1):40–6. doi: 10.​1093/​intqhc/​mzv098.CrossRef
76.
go back to reference Shiratori S, Agyekum EO, Shibanuma A, et al. Motivation and incentive preferences of community health officers in Ghana : an economic behavioral experiment approach. Hum Resour Health. 2016:1–26. doi: 10.1186/s12960-016-0148-1. Shiratori S, Agyekum EO, Shibanuma A, et al. Motivation and incentive preferences of community health officers in Ghana : an economic behavioral experiment approach. Hum Resour Health. 2016:1–26. doi: 10.​1186/​s12960-016-0148-1.​
77.
go back to reference Baltussen R, ten Asbroek AHA, Koolman X, Shrestha N, Bhattarai P, Niessen LW. Priority setting using multiple criteria: should a lung health programme be implemented in Nepal? Heal Policy Plan. 2007;22(3):178–85.CrossRef Baltussen R, ten Asbroek AHA, Koolman X, Shrestha N, Bhattarai P, Niessen LW. Priority setting using multiple criteria: should a lung health programme be implemented in Nepal? Heal Policy Plan. 2007;22(3):178–85.CrossRef
79.
81.
83.
go back to reference Honda A, Ryan M, Van Niekerk R, McIntyre D. Improving the public health sector in South Africa: eliciting public preferences using a discrete choice experiment. Health Policy Plan. 2015;30(5):600–11. doi: 10.1093/heapol/czu038.CrossRefPubMed Honda A, Ryan M, Van Niekerk R, McIntyre D. Improving the public health sector in South Africa: eliciting public preferences using a discrete choice experiment. Health Policy Plan. 2015;30(5):600–11. doi: 10.​1093/​heapol/​czu038.CrossRefPubMed
84.
88.
go back to reference Aarons GA, Covert J, Skriner LC, et al. The eye of the beholder: youths and parents differ on what matters in mental health services. Adm Policy Ment Heal Ment Heal Serv Res. 2010;37(6):459–67. doi: 10.1007/s10488-010-0276-1.CrossRef Aarons GA, Covert J, Skriner LC, et al. The eye of the beholder: youths and parents differ on what matters in mental health services. Adm Policy Ment Heal Ment Heal Serv Res. 2010;37(6):459–67. doi: 10.​1007/​s10488-010-0276-1.CrossRef
90.
go back to reference Chaudoir SR, Dugan AG, Barr CH. Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. Implement Sci. 2013;8(22):20. doi: 10.1186/1748-5908-8-22. Chaudoir SR, Dugan AG, Barr CH. Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures. Implement Sci. 2013;8(22):20. doi: 10.​1186/​1748-5908-8-22.​
94.
go back to reference Salloum RG, Abbyad CW, Kohler RE, Kratka a K, Oh L, Wood K a. Assessing preferences for a university-based smoking cessation program in Lebanon: a discrete choice experiment. Nicotine Tob Res. 2015;17(5):580–5. doi: 10.1093/ntr/ntu188.CrossRefPubMed Salloum RG, Abbyad CW, Kohler RE, Kratka a K, Oh L, Wood K a. Assessing preferences for a university-based smoking cessation program in Lebanon: a discrete choice experiment. Nicotine Tob Res. 2015;17(5):580–5. doi: 10.​1093/​ntr/​ntu188.CrossRefPubMed
96.
go back to reference Schlereth C, Eckert C, Schaaf R, Skiera B. Measurement of preferences with self-explicated approaches: a classification and merge of trade-off- and non-trade-off-based evaluation types. Eur J Oper Res. 2014;238(1):185–98. doi: 10.1016/j.ejor.2014.03.010.CrossRef Schlereth C, Eckert C, Schaaf R, Skiera B. Measurement of preferences with self-explicated approaches: a classification and merge of trade-off- and non-trade-off-based evaluation types. Eur J Oper Res. 2014;238(1):185–98. doi: 10.​1016/​j.​ejor.​2014.​03.​010.CrossRef
97.
go back to reference Tomoaia-Cotisel A, Scammon DL, Waitzman NJ, et al. Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med. 2013;11(SUPPL. 1) doi: 10.1370/afm.1549. Tomoaia-Cotisel A, Scammon DL, Waitzman NJ, et al. Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med. 2013;11(SUPPL. 1) doi: 10.​1370/​afm.​1549.
Metadata
Title
Application of discrete choice experiments to enhance stakeholder engagement as a strategy for advancing implementation: a systematic review
Authors
Ramzi G. Salloum
Elizabeth A. Shenkman
Jordan J. Louviere
David A. Chambers
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2017
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-017-0675-8

Other articles of this Issue 1/2017

Implementation Science 1/2017 Go to the issue