Skip to main content
Top
Published in: BMC Health Services Research 1/2018

Open Access 01-12-2018 | Technical advance

A novel design process for selection of attributes for inclusion in discrete choice experiments: case study exploring variation in clinical decision-making about thrombolysis in the treatment of acute ischaemic stroke

Authors: Aoife De Brún, Darren Flynn, Laura Ternent, Christopher I. Price, Helen Rodgers, Gary A. Ford, Matthew Rudd, Emily Lancsar, Stephen Simpson, John Teah, Richard G. Thomson

Published in: BMC Health Services Research | Issue 1/2018

Login to get access

Abstract

Background

A discrete choice experiment (DCE) is a method used to elicit participants’ preferences and the relative importance of different attributes and levels within a decision-making process. DCEs have become popular in healthcare; however, approaches to identify the attributes/levels influencing a decision of interest and to selection methods for their inclusion in a DCE are under-reported. Our objectives were: to explore the development process used to select/present attributes/levels from the identified range that may be influential; to describe a systematic and rigorous development process for design of a DCE in the context of thrombolytic therapy for acute stroke; and, to discuss the advantages of our five-stage approach to enhance current guidance for developing DCEs.

Methods

A five-stage DCE development process was undertaken. Methods employed included literature review, qualitative analysis of interview and ethnographic data, expert panel discussions, a quantitative structured prioritisation (ranking) exercise and pilot testing of the DCE using a ‘think aloud’ approach.

Results

The five-stage process reported helped to reduce the list of 22 initial patient-related factors to a final set of nine variable factors and six fixed factors for inclusion in a testable DCE using a vignette model of presentation.

Conclusions

In order for the data and conclusions generated by DCEs to be deemed valid, it is crucial that the methods of design and development are documented and reported. This paper has detailed a rigorous and systematic approach to DCE development which may be useful to researchers seeking to establish methods for reducing and prioritising attributes for inclusion in future DCEs.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ryan M, Gerard K. Using discrete choice experiments to value health care programmes: current practice and future research reflections. Appl Health Econ Health Policy. 2003;2(1):55–64.PubMed Ryan M, Gerard K. Using discrete choice experiments to value health care programmes: current practice and future research reflections. Appl Health Econ Health Policy. 2003;2(1):55–64.PubMed
2.
go back to reference Lancsar E, Louviere J. Conducting discrete choice experiments to inform healthcare decision making. Pharmacoecon. 2008;26:661–77.CrossRef Lancsar E, Louviere J. Conducting discrete choice experiments to inform healthcare decision making. Pharmacoecon. 2008;26:661–77.CrossRef
3.
go back to reference Laver K, Rehab M, Ratcliffe J, George S, Lester L, Walker R, Burgess L, Crotty M. Early rehabilitation management after stroke: what do stroke patients prefer? J Rehabil Med. 2011;43(4):354–8.CrossRefPubMed Laver K, Rehab M, Ratcliffe J, George S, Lester L, Walker R, Burgess L, Crotty M. Early rehabilitation management after stroke: what do stroke patients prefer? J Rehabil Med. 2011;43(4):354–8.CrossRefPubMed
4.
go back to reference Coast J, Al-Janabi H, Sutton EJ, Horrocks SA, Vosper AJ, Swancutt DR, Flynn TN. Using qualitative methods for attribute development for discrete choice experiments: issues and recommendations. Health Econ. 2012;21(6):730–41.CrossRefPubMed Coast J, Al-Janabi H, Sutton EJ, Horrocks SA, Vosper AJ, Swancutt DR, Flynn TN. Using qualitative methods for attribute development for discrete choice experiments: issues and recommendations. Health Econ. 2012;21(6):730–41.CrossRefPubMed
5.
go back to reference Reed Johnson F, Lancsar E, Marshall D, Kilambi V, Mühlbacher A, Regier DA, Bresnahan BW, Kanninen B, Bridges JF. Constructing experimental designs for discrete-choice experiments: report of the ISPOR conjoint analysis experimental design good research practices task force. Value Health. 2013;16(1):3–13.CrossRefPubMed Reed Johnson F, Lancsar E, Marshall D, Kilambi V, Mühlbacher A, Regier DA, Bresnahan BW, Kanninen B, Bridges JF. Constructing experimental designs for discrete-choice experiments: report of the ISPOR conjoint analysis experimental design good research practices task force. Value Health. 2013;16(1):3–13.CrossRefPubMed
6.
go back to reference Bridges JF, Hauber AB, Marshall D, Lloyd A, Prosser LA, Regier DA, Johnson FR, Mauskopf J. Conjoint analysis applications in health—a checklist: a report of the ISPOR good research practices for conjoint analysis task force. Value Health. 2011;14(4):403–13.CrossRefPubMed Bridges JF, Hauber AB, Marshall D, Lloyd A, Prosser LA, Regier DA, Johnson FR, Mauskopf J. Conjoint analysis applications in health—a checklist: a report of the ISPOR good research practices for conjoint analysis task force. Value Health. 2011;14(4):403–13.CrossRefPubMed
7.
go back to reference Abiiro G, Leppert G, Mbera G, Robyn P, De Allegri M. Developing attributes and attribute-levels for a discrete choice experiment on micro health insurance in rural Malawi. BMC Health Serv Res. 2014;14(1):235.CrossRefPubMedPubMedCentral Abiiro G, Leppert G, Mbera G, Robyn P, De Allegri M. Developing attributes and attribute-levels for a discrete choice experiment on micro health insurance in rural Malawi. BMC Health Serv Res. 2014;14(1):235.CrossRefPubMedPubMedCentral
8.
go back to reference Hiligsmann M, van Durme C, Geusens P, Dellaert BGC, Dirksen CD, van der Weijden T, Reginster J-Y, Boonen A. Nominal group technique to select attributes for discrete choice experiments: an example for drug treatment choice in osteoporosis. Patient Preference and Adherence. 2013;7:133.CrossRefPubMedPubMedCentral Hiligsmann M, van Durme C, Geusens P, Dellaert BGC, Dirksen CD, van der Weijden T, Reginster J-Y, Boonen A. Nominal group technique to select attributes for discrete choice experiments: an example for drug treatment choice in osteoporosis. Patient Preference and Adherence. 2013;7:133.CrossRefPubMedPubMedCentral
9.
go back to reference Coast J, Horrocks S. Developing attributes and levels for discrete choice experiments using qualitative methods. J Health Serv Res Policy. 2007;12(1):25–30.CrossRefPubMed Coast J, Horrocks S. Developing attributes and levels for discrete choice experiments using qualitative methods. J Health Serv Res Policy. 2007;12(1):25–30.CrossRefPubMed
10.
go back to reference Vass C, Rigby D, Payne K. The role of qualitative research methods in discrete choice experiments: a systematic review and survey of authors. Med Decis Mak. 2017;37(3):298–313.CrossRef Vass C, Rigby D, Payne K. The role of qualitative research methods in discrete choice experiments: a systematic review and survey of authors. Med Decis Mak. 2017;37(3):298–313.CrossRef
11.
go back to reference Sepucha KR, Matlock DD, Wills CE, Ropka M, Joseph-Williams N, Stacey D, Ng C, Levin C, Lally J, Borkhoff CM, Thomson R. “It’s valid and reliable” is not enough: critical appraisal of reporting of measures in trials evaluating patient decision aids. Med Decis Mak. 2014;34(5):560–6. Sepucha KR, Matlock DD, Wills CE, Ropka M, Joseph-Williams N, Stacey D, Ng C, Levin C, Lally J, Borkhoff CM, Thomson R. “It’s valid and reliable” is not enough: critical appraisal of reporting of measures in trials evaluating patient decision aids. Med Decis Mak. 2014;34(5):560–6.
12.
go back to reference Wardlaw JM, Murray V, Berge E, del Zoppo G, Sandercock P, Lindley RL, Cohen G. Recombinant tissue plasminogen activator for acute ischaemic stroke: an updated systematic review and meta-analysis. Lancet. 2012;379(9834):2364–72.CrossRefPubMedPubMedCentral Wardlaw JM, Murray V, Berge E, del Zoppo G, Sandercock P, Lindley RL, Cohen G. Recombinant tissue plasminogen activator for acute ischaemic stroke: an updated systematic review and meta-analysis. Lancet. 2012;379(9834):2364–72.CrossRefPubMedPubMedCentral
13.
go back to reference Sandercock P, Wardlaw JM, Lindley RI, Dennis M, Cohen G, Murray G, Innes K, Venables G, Czlonkowska A, Kobayashi A. The benefits and harms of intravenous thrombolysis with recombinant tissue plasminogen activator within 6 h of acute ischaemic stroke (the third international stroke trial [IST-3]): a randomised controlled trial. Lancet. 2012;379(9834):2352–63.CrossRefPubMed Sandercock P, Wardlaw JM, Lindley RI, Dennis M, Cohen G, Murray G, Innes K, Venables G, Czlonkowska A, Kobayashi A. The benefits and harms of intravenous thrombolysis with recombinant tissue plasminogen activator within 6 h of acute ischaemic stroke (the third international stroke trial [IST-3]): a randomised controlled trial. Lancet. 2012;379(9834):2352–63.CrossRefPubMed
14.
go back to reference Royal College of Physicians Intercollegiate Stroke Working Party. National clinical guideline for stroke (4th EDN) Royal College of Physicians. London: The Royal College of Physicians are the publishers; 2012. Royal College of Physicians Intercollegiate Stroke Working Party. National clinical guideline for stroke (4th EDN) Royal College of Physicians. London: The Royal College of Physicians are the publishers; 2012.
15.
go back to reference Jauch EC, Saver JL, Adams HP, Bruno A, Demaerschalk BM, Khatri P, McMullan PW, Qureshi AI, Rosenfield K, Scott PA. Guidelines for the early management of patients with acute ischemic stroke a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2013;44(3):870–947.CrossRefPubMed Jauch EC, Saver JL, Adams HP, Bruno A, Demaerschalk BM, Khatri P, McMullan PW, Qureshi AI, Rosenfield K, Scott PA. Guidelines for the early management of patients with acute ischemic stroke a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke. 2013;44(3):870–947.CrossRefPubMed
17.
go back to reference Murtagh MJ, Watson DLB, Jenkings KN, Lie MLS, Mackintosh JE, Ford GA, Thomson RG. Situationally-sensitive knowledge translation and relational decision making in Hyperacute stroke: a qualitative study. PLoS One. 2012;7(6):e37066.CrossRefPubMedPubMedCentral Murtagh MJ, Watson DLB, Jenkings KN, Lie MLS, Mackintosh JE, Ford GA, Thomson RG. Situationally-sensitive knowledge translation and relational decision making in Hyperacute stroke: a qualitative study. PLoS One. 2012;7(6):e37066.CrossRefPubMedPubMedCentral
18.
go back to reference Hacke W, Donnan G, Fieschi C, Kaste M, Von Kummer R, Broderick J, Brott T, Frankel M, Grotta J, Haley E Jr. Association of outcome with early stroke treatment: pooled analysis of ATLANTIS, ECASS, and NINDS rt-PA stroke trials. Lancet. 2004;363(9411):768–74.CrossRefPubMed Hacke W, Donnan G, Fieschi C, Kaste M, Von Kummer R, Broderick J, Brott T, Frankel M, Grotta J, Haley E Jr. Association of outcome with early stroke treatment: pooled analysis of ATLANTIS, ECASS, and NINDS rt-PA stroke trials. Lancet. 2004;363(9411):768–74.CrossRefPubMed
19.
go back to reference Ford GA, Rodgers H, Thomson RG, al. e: Development and evaluation of hyperacute services for patients with acute Stroke In.: NIHR Programme Grant; 2007. Ford GA, Rodgers H, Thomson RG, al. e: Development and evaluation of hyperacute services for patients with acute Stroke In.: NIHR Programme Grant; 2007.
20.
go back to reference Flynn D, Nesbitt DJ, Ford GA, McMeekin P, Rodgers H, Price C, Kray C, Thomson RG. Development of a computerised decision aid for thrombolysis in acute stroke care. BMC Med Inform Decis Mak. 2015;15(1):6. Flynn D, Nesbitt DJ, Ford GA, McMeekin P, Rodgers H, Price C, Kray C, Thomson RG. Development of a computerised decision aid for thrombolysis in acute stroke care. BMC Med Inform Decis Mak. 2015;15(1):6.
21.
go back to reference Dirks M, Niessen LW, Koudstaal PJ, Franke CL, van Oostenbrugge RJ, Dippel DW. Intravenous thrombolysis in acute ischaemic stroke: from trial exclusion criteria to clinical contraindications. An international Delphi study. J Neurol Neurosurg Psychiatry. 2007;78(7):685–9.CrossRefPubMedPubMedCentral Dirks M, Niessen LW, Koudstaal PJ, Franke CL, van Oostenbrugge RJ, Dippel DW. Intravenous thrombolysis in acute ischaemic stroke: from trial exclusion criteria to clinical contraindications. An international Delphi study. J Neurol Neurosurg Psychiatry. 2007;78(7):685–9.CrossRefPubMedPubMedCentral
22.
go back to reference Eissa A, Krass I, Bajorek B. Barriers to the utilization of thrombolysis for acute ischaemic stroke. J Clin Pharm Ther. 2012;37(4):399–409.CrossRefPubMed Eissa A, Krass I, Bajorek B. Barriers to the utilization of thrombolysis for acute ischaemic stroke. J Clin Pharm Ther. 2012;37(4):399–409.CrossRefPubMed
23.
go back to reference Flynn D: Non-medical influences upon medical decision-making and referral behavior: an annotated bibliography: greenwood publishing Group; 2003. Flynn D: Non-medical influences upon medical decision-making and referral behavior: an annotated bibliography: greenwood publishing Group; 2003.
24.
go back to reference Meurer WJ, Majersik JJ, Frederiksen SM, Kade AM, Sandretto AM, Scott PA. Provider perceptions of barriers to the emergency use of tPA for acute ischemic stroke: a qualitative study. BMC Emerg Med. 2011;11(1):5.CrossRefPubMedPubMedCentral Meurer WJ, Majersik JJ, Frederiksen SM, Kade AM, Sandretto AM, Scott PA. Provider perceptions of barriers to the emergency use of tPA for acute ischemic stroke: a qualitative study. BMC Emerg Med. 2011;11(1):5.CrossRefPubMedPubMedCentral
25.
go back to reference Kwan J, Hand P, Sandercock P. A systematic review of barriers to delivery of thrombolysis for acute stroke. Age Ageing. 2004;33(2):116–21.CrossRefPubMed Kwan J, Hand P, Sandercock P. A systematic review of barriers to delivery of thrombolysis for acute stroke. Age Ageing. 2004;33(2):116–21.CrossRefPubMed
26.
go back to reference Shamy MC, Jaigobin CS. The complexities of acute stroke decision-making a survey of neurologists. Neurology. 2013;81(13):1130–3.CrossRefPubMed Shamy MC, Jaigobin CS. The complexities of acute stroke decision-making a survey of neurologists. Neurology. 2013;81(13):1130–3.CrossRefPubMed
29.
go back to reference Ryan M, Gerard K, Amaya-Amaya M. Using discrete choice experiments to value health and health care, vol. 11: Springer; 2007. Ryan M, Gerard K, Amaya-Amaya M. Using discrete choice experiments to value health and health care, vol. 11: Springer; 2007.
31.
go back to reference Van Swieten J, Koudstaal P, Visser M, Schouten H, Van Gijn J. Interobserver agreement for the assessment of handicap in stroke patients. Stroke. 1988;19(5):604–7.CrossRefPubMed Van Swieten J, Koudstaal P, Visser M, Schouten H, Van Gijn J. Interobserver agreement for the assessment of handicap in stroke patients. Stroke. 1988;19(5):604–7.CrossRefPubMed
33.
go back to reference Reeves MJ, Wilkins T, Lisabeth LD, Schwamm LH. Thrombolysis treatment for acute stroke: issues of efficacy and utilization in women. Women's Health. 2011;7(3):383–90.CrossRefPubMed Reeves MJ, Wilkins T, Lisabeth LD, Schwamm LH. Thrombolysis treatment for acute stroke: issues of efficacy and utilization in women. Women's Health. 2011;7(3):383–90.CrossRefPubMed
34.
go back to reference de Ridder I, Dirks M, Niessen L, Dippel D. Unequal access to treatment with intravenous Alteplase for women with acute ischemic stroke. Stroke. 2013;44(9):2610–2.CrossRefPubMed de Ridder I, Dirks M, Niessen L, Dippel D. Unequal access to treatment with intravenous Alteplase for women with acute ischemic stroke. Stroke. 2013;44(9):2610–2.CrossRefPubMed
35.
go back to reference Kent DM, Selker HP, Ruthazer R, Bluhmki E, Hacke W. The stroke–thrombolytic predictive instrument a predictive instrument for intravenous thrombolysis in acute ischemic stroke. Stroke. 2006;37(12):2957–62.CrossRefPubMed Kent DM, Selker HP, Ruthazer R, Bluhmki E, Hacke W. The stroke–thrombolytic predictive instrument a predictive instrument for intravenous thrombolysis in acute ischemic stroke. Stroke. 2006;37(12):2957–62.CrossRefPubMed
36.
go back to reference Kent DM, Price LL, Ringleb P, Hill MD, Selker HP. Sex-based differences in response to recombinant tissue plasminogen activator in acute ischemic stroke a pooled analysis of randomized clinical trials. Stroke. 2005;36(1):62–5.CrossRefPubMed Kent DM, Price LL, Ringleb P, Hill MD, Selker HP. Sex-based differences in response to recombinant tissue plasminogen activator in acute ischemic stroke a pooled analysis of randomized clinical trials. Stroke. 2005;36(1):62–5.CrossRefPubMed
37.
go back to reference Willis GB. Cognitive interviewing: a tool for improving questionnaire design. Thousand Oaks, CA: Sage; 2005.CrossRef Willis GB. Cognitive interviewing: a tool for improving questionnaire design. Thousand Oaks, CA: Sage; 2005.CrossRef
38.
go back to reference De Brún A, Flynn D, Joyce K, Ternent L, Price C, Rodgers H, Ford GA, Lancsar E, Rudd M, Thomson RG. Understanding clinicians’ decisions to offer intravenous thrombolytic treatment to patients with acute ischaemic stroke: a protocol for a discrete choice experiment. BMJ Open. 2014;4(7):e005612.CrossRefPubMedPubMedCentral De Brún A, Flynn D, Joyce K, Ternent L, Price C, Rodgers H, Ford GA, Lancsar E, Rudd M, Thomson RG. Understanding clinicians’ decisions to offer intravenous thrombolytic treatment to patients with acute ischaemic stroke: a protocol for a discrete choice experiment. BMJ Open. 2014;4(7):e005612.CrossRefPubMedPubMedCentral
39.
go back to reference Lancsar E, Swait J. Reconceptualising the external validity of discrete choice experiments. Pharmaco Economics. 2014;32(10):951–65.CrossRef Lancsar E, Swait J. Reconceptualising the external validity of discrete choice experiments. Pharmaco Economics. 2014;32(10):951–65.CrossRef
40.
go back to reference McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, Thomas R, Harvey E, Garratt A, Bond J. Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. Core Res. 2001. McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, Thomas R, Harvey E, Garratt A, Bond J. Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. Core Res. 2001.
41.
go back to reference Edwards P, Roberts I, Clarke M, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix L, Pratap S. Methods to increase response to postal and electronic questionnaires (review). Cochrane Database Syst Rev. 2009;3:1–12. Edwards P, Roberts I, Clarke M, Diguiseppi C, Wentz R, Kwan I, Cooper R, Felix L, Pratap S. Methods to increase response to postal and electronic questionnaires (review). Cochrane Database Syst Rev. 2009;3:1–12.
Metadata
Title
A novel design process for selection of attributes for inclusion in discrete choice experiments: case study exploring variation in clinical decision-making about thrombolysis in the treatment of acute ischaemic stroke
Authors
Aoife De Brún
Darren Flynn
Laura Ternent
Christopher I. Price
Helen Rodgers
Gary A. Ford
Matthew Rudd
Emily Lancsar
Stephen Simpson
John Teah
Richard G. Thomson
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2018
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-018-3305-5

Other articles of this Issue 1/2018

BMC Health Services Research 1/2018 Go to the issue