Skip to main content
Top
Published in: Systematic Reviews 1/2021

Open Access 01-12-2021 | Research

Discrete choice experiment to determine preferences of decision-makers in healthcare for different formats of rapid reviews

Authors: Christian Speckemeier, Laura Krabbe, Susanne Schwenke, Jürgen Wasem, Barbara Buchberger, Silke Neusser

Published in: Systematic Reviews | Issue 1/2021

Login to get access

Abstract

Background

Time-saving formats of evidence syntheses have been developed to fulfill healthcare policymakers’ demands for timely evidence-based information. A discrete choice experiment (DCE) with decision-makers and people involved in the preparation of evidence syntheses was undertaken to elicit preferences for methodological shortcuts in the conduct of abbreviated reviews.

Methods

D-efficient scenarios, each containing 14 pairwise comparisons, were designed for the DCE: the development of an evidence synthesis in 20 working days (scenario 1) and 12 months (scenario 2), respectively. Six attributes (number of databases, number of reviewers during screening, publication period, number of reviewers during data extraction, full-text analysis, types of HTA domains) with 2 to 3 levels each were defined. These were presented to the target population in an online survey. The relative importance of the individual attributes was determined using logistic regression models.

Results

Scenario 1 was completed by 36 participants and scenario 2 by 26 participants. The linearity assumption was confirmed by the full model. In both scenarios, the linear difference model showed a preference for higher levels for “number of reviewers during data extraction”, followed by “number of reviewers during screening” and “full-text analysis”. Subgroup analyses showed that preferences were influenced by participation in the preparation of evidence syntheses.

Conclusion

The surveyed persons expressed preferences for quality standards in the process of literature screening and data extraction.
Appendix
Available only for authorised users
Literature
1.
go back to reference Tsertsvadze A, Chen Y, Moher D, Sutcliffe P, McCarthy N. How to conduct systematic reviews more expeditiously? Syst Rev. 2015;4:160.CrossRef Tsertsvadze A, Chen Y, Moher D, Sutcliffe P, McCarthy N. How to conduct systematic reviews more expeditiously? Syst Rev. 2015;4:160.CrossRef
2.
go back to reference Chandler J, Cumpston M, Thomas J, Higgins J, Deeks J, Clarke M. Cochrane Handbook for Systematic Reviews of Interventions, vol. 2. Chichester: Wiley; 2019. Chandler J, Cumpston M, Thomas J, Higgins J, Deeks J, Clarke M. Cochrane Handbook for Systematic Reviews of Interventions, vol. 2. Chichester: Wiley; 2019.
3.
go back to reference Mattivi J, Buchberger B. Rapid Reviews: Sisyphos ‘Erlösung? – Eine Bestandsaufnahme. Gesundheitswesen. 2017;79(5):438–42.CrossRef Mattivi J, Buchberger B. Rapid Reviews: Sisyphos ‘Erlösung? – Eine Bestandsaufnahme. Gesundheitswesen. 2017;79(5):438–42.CrossRef
4.
go back to reference Khangura S, Polisena J, Clifford T, Farrah K, Kamel C. Rapid review: an emerging approach to evidence synthesis in health technology assessment. Int J Technol Assess Health Care. 2014;30(1):20–7.CrossRef Khangura S, Polisena J, Clifford T, Farrah K, Kamel C. Rapid review: an emerging approach to evidence synthesis in health technology assessment. Int J Technol Assess Health Care. 2014;30(1):20–7.CrossRef
6.
go back to reference Hunter J, Arentza S, Goldenberg J, Yanga G, Beardsley J, Soo Lee M, et al. Choose your shortcuts wisely: COVID-19 rapid reviews of traditional, complementary and integrative medicine. Integ Med Res. 2020;9(3):100484.CrossRef Hunter J, Arentza S, Goldenberg J, Yanga G, Beardsley J, Soo Lee M, et al. Choose your shortcuts wisely: COVID-19 rapid reviews of traditional, complementary and integrative medicine. Integ Med Res. 2020;9(3):100484.CrossRef
7.
go back to reference Tricco A, Antony J, Zarin W, Strifler L, Ghassemi M, Ivory J, et al. A scoping review of rapid review methods. BMC Med. 2015;13:224.CrossRef Tricco A, Antony J, Zarin W, Strifler L, Ghassemi M, Ivory J, et al. A scoping review of rapid review methods. BMC Med. 2015;13:224.CrossRef
8.
go back to reference Hartling L, Guise J, Kato E, Anderson J, Belinson S, Berliner E, et al. A taxonomy of rapid reviews links report types and methods to specific decision-making contexts. J Clin Epidemiol. 2015;68(12):1451–62.CrossRef Hartling L, Guise J, Kato E, Anderson J, Belinson S, Berliner E, et al. A taxonomy of rapid reviews links report types and methods to specific decision-making contexts. J Clin Epidemiol. 2015;68(12):1451–62.CrossRef
9.
go back to reference Polisena J, Garritty C, Kamel C, Stevens A, Abou-Setta A. Rapid review programs to support health care and policy decision making: a descriptive analysis of processes and methods. Syst Rev. 2015;4:26.CrossRef Polisena J, Garritty C, Kamel C, Stevens A, Abou-Setta A. Rapid review programs to support health care and policy decision making: a descriptive analysis of processes and methods. Syst Rev. 2015;4:26.CrossRef
10.
go back to reference Abou-Setta A, Jeyaraman M, Attia A, Hesham GA-I, Mauricio F, Mohammed TA, et al. Methods for developing evidence reviews in short periods of time: a scoping review. PLoS One. 2016;11(12):0165903.CrossRef Abou-Setta A, Jeyaraman M, Attia A, Hesham GA-I, Mauricio F, Mohammed TA, et al. Methods for developing evidence reviews in short periods of time: a scoping review. PLoS One. 2016;11(12):0165903.CrossRef
11.
go back to reference Haby M, Chapman E, Clark R, Barreto J, Reveiz L, Lavis J. What are the best methodologies for rapid reviews of the research evidence for evidence-informed decision making in health policy and practice: a rapid review. Health Res Policy Syst. 2016;14(1):83.CrossRef Haby M, Chapman E, Clark R, Barreto J, Reveiz L, Lavis J. What are the best methodologies for rapid reviews of the research evidence for evidence-informed decision making in health policy and practice: a rapid review. Health Res Policy Syst. 2016;14(1):83.CrossRef
12.
go back to reference Ganann R, Ciliska D, Thomas H. Expediting systematic reviews: methods and implications of rapid reviews. Implement Sci. 2010;5:56.CrossRef Ganann R, Ciliska D, Thomas H. Expediting systematic reviews: methods and implications of rapid reviews. Implement Sci. 2010;5:56.CrossRef
13.
go back to reference Watt A, Cameron A, Sturm L, Lathlean T, Babidge W, Blamey S, et al. Rapid versus full systematic reviews: validity in clinical practice? ANZ J Surg. 2008;78(11):1037–40.CrossRef Watt A, Cameron A, Sturm L, Lathlean T, Babidge W, Blamey S, et al. Rapid versus full systematic reviews: validity in clinical practice? ANZ J Surg. 2008;78(11):1037–40.CrossRef
14.
go back to reference Wagner G, Nussbaumer-Streit B, Greimel J, Ciapponi A, Gartlehner G. Trading certainty for speed - how much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: an international survey. BMC Med Res Methodol. 2017;17(1):121.CrossRef Wagner G, Nussbaumer-Streit B, Greimel J, Ciapponi A, Gartlehner G. Trading certainty for speed - how much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: an international survey. BMC Med Res Methodol. 2017;17(1):121.CrossRef
15.
go back to reference Ryan M, Farrar S. Using conjoint analysis to elicit preferences for health care. BMJ. 2000;320(7248):1530–3.CrossRef Ryan M, Farrar S. Using conjoint analysis to elicit preferences for health care. BMJ. 2000;320(7248):1530–3.CrossRef
16.
go back to reference Breidert C. Estimation of willingness-to-pay. Wiesbaden: Gabler Verlag Springer Fachmedien; 2006. Breidert C. Estimation of willingness-to-pay. Wiesbaden: Gabler Verlag Springer Fachmedien; 2006.
17.
go back to reference Crawford CM, Benedetto AD. New products management. 8th ed. Boston: McGraw-Hill Inc.; 2008. Crawford CM, Benedetto AD. New products management. 8th ed. Boston: McGraw-Hill Inc.; 2008.
18.
go back to reference Johnson R, Orme B. Sample size issues for conjoint analysis. In: Orme B (editor). Getting started with conjoint analysis: strategies for product design and pricing research. Madison: Research Publishers; 2010. p. 57–66. Johnson R, Orme B. Sample size issues for conjoint analysis. In: Orme B (editor). Getting started with conjoint analysis: strategies for product design and pricing research. Madison: Research Publishers; 2010. p. 57–66.
19.
20.
go back to reference Helmer D. Do extended searches fill the bill? Evaluating the quality of the literature retrieved. In: ISTAHC 17th Annual Meeting: 2001; Centre for Health Services and Policy Research: BC Office of Health Technology Assessment; 2001. Helmer D. Do extended searches fill the bill? Evaluating the quality of the literature retrieved. In: ISTAHC 17th Annual Meeting: 2001; Centre for Health Services and Policy Research: BC Office of Health Technology Assessment; 2001.
21.
go back to reference Watt A, Cameron A, Sturm L, Lathlean T, Babidge W, Blamey S, et al. Rapid versus full systematic reviews: an inventory of current methods and practice in Health Technology Assessment. Int J Technol Assess Health Care. 2008;24(2):133–9.CrossRef Watt A, Cameron A, Sturm L, Lathlean T, Babidge W, Blamey S, et al. Rapid versus full systematic reviews: an inventory of current methods and practice in Health Technology Assessment. Int J Technol Assess Health Care. 2008;24(2):133–9.CrossRef
22.
go back to reference Reynen E, Robson R, Ivory J, Hwee J, Straus S, Pham B, et al. A retrospective comparison of systematic reviews with same-topic rapid reviews. J Clin Epidemiol. 2018;96:23–34.CrossRef Reynen E, Robson R, Ivory J, Hwee J, Straus S, Pham B, et al. A retrospective comparison of systematic reviews with same-topic rapid reviews. J Clin Epidemiol. 2018;96:23–34.CrossRef
23.
go back to reference Gartlehner G, Affengruber L, Titscher V, Noel-Storr A, Dooley G, Ballarini N, et al. Single-reviewer abstract screening missed 13 percent of relevant studies: a crowd-based, randomized controlled trial. J Clin Epidemol. 2020;121:20–8.CrossRef Gartlehner G, Affengruber L, Titscher V, Noel-Storr A, Dooley G, Ballarini N, et al. Single-reviewer abstract screening missed 13 percent of relevant studies: a crowd-based, randomized controlled trial. J Clin Epidemol. 2020;121:20–8.CrossRef
24.
go back to reference Taylor-Phillips S, Geppert J, Stinton C, Freeman K, Johnson S, Fraser H, et al. Comparison of a full systematic review versus rapid review approaches to assess a newborn screening test for tyrosinemia type 1. Res Synth Methods. 2017;8(4):475–84.CrossRef Taylor-Phillips S, Geppert J, Stinton C, Freeman K, Johnson S, Fraser H, et al. Comparison of a full systematic review versus rapid review approaches to assess a newborn screening test for tyrosinemia type 1. Res Synth Methods. 2017;8(4):475–84.CrossRef
Metadata
Title
Discrete choice experiment to determine preferences of decision-makers in healthcare for different formats of rapid reviews
Authors
Christian Speckemeier
Laura Krabbe
Susanne Schwenke
Jürgen Wasem
Barbara Buchberger
Silke Neusser
Publication date
01-12-2021
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2021
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-021-01647-z

Other articles of this Issue 1/2021

Systematic Reviews 1/2021 Go to the issue