Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research article

The use of rapid review methods in health technology assessments: 3 case studies

Authors: Eva Kaltenthaler, Katy Cooper, Abdullah Pandor, Marrissa Martyn-St. James, Robin Chatters, Ruth Wong

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

Rapid reviews are of increasing importance within health technology assessment due to time and resource constraints. There are many rapid review methods available although there is little guidance as to the most suitable methods. We present three case studies employing differing methods to suit the evidence base for each review and outline some issues to consider when selecting an appropriate method.

Methods

Three recently completed systematic review short reports produced for the UK National Institute for Health Research were examined. Different approaches to rapid review methods were used in the three reports which were undertaken to inform the commissioning of services within the NHS and to inform future trial design. We describe the methods used, the reasoning behind the choice of methods and explore the strengths and weaknesses of each method.

Results

Rapid review methods were chosen to meet the needs of the review and each review had distinctly different challenges such as heterogeneity in terms of populations, interventions, comparators and outcome measures (PICO) and/or large numbers of relevant trials. All reviews included at least 10 randomised controlled trials (RCTs), each with numerous included outcomes. For the first case study (sexual health interventions), very diverse studies in terms of PICO were included. P-values and summary information only were presented due to substantial heterogeneity between studies and outcomes measured. For the second case study (premature ejaculation treatments), there were over 100 RCTs but also several existing systematic reviews. Data for meta-analyses were extracted directly from existing systematic reviews with new RCT data added where available. For the final case study (cannabis cessation therapies), studies included a wide range of interventions and considerable variation in study populations and outcomes. A brief summary of the key findings for each study was presented and narrative synthesis used to summarise results for each pair of interventions compared.

Conclusions

Rapid review methods need to be chosen to meet both the nature of the evidence base of a review and the challenges presented by the included studies. Appropriate methods should be chosen after an assessment of the evidence base.
Literature
2.
go back to reference Harker J, Kleijnen J. What is a rapid review? A methodological exploration of rapid reviews in Health Technology Assessments. Int J Evid Based Healthc. 2012;10:397–410.CrossRefPubMed Harker J, Kleijnen J. What is a rapid review? A methodological exploration of rapid reviews in Health Technology Assessments. Int J Evid Based Healthc. 2012;10:397–410.CrossRefPubMed
3.
4.
go back to reference Watt A, Cameron A, Sturm L, Lathlean T, Blamey S, Facey K, Hailey D, Norderhaug I, Maddern G. Rapid reviews versus full systematic reviews: an inventory of current methods and practice in health technology assessment. Int J Technol Assess Health Care. 2008;24(2):133–9.CrossRefPubMed Watt A, Cameron A, Sturm L, Lathlean T, Blamey S, Facey K, Hailey D, Norderhaug I, Maddern G. Rapid reviews versus full systematic reviews: an inventory of current methods and practice in health technology assessment. Int J Technol Assess Health Care. 2008;24(2):133–9.CrossRefPubMed
5.
go back to reference Abrami PC, Borokhovski E, Bernard RM, Wade CA, Tamim R, Persson T, Bethel EC, Hanz K, Surkes MA. Issues in conducting and disseminating brief reviews of evidence. Evidence & Policy. 2010;6(3):371–89.CrossRef Abrami PC, Borokhovski E, Bernard RM, Wade CA, Tamim R, Persson T, Bethel EC, Hanz K, Surkes MA. Issues in conducting and disseminating brief reviews of evidence. Evidence & Policy. 2010;6(3):371–89.CrossRef
7.
go back to reference Khangura S, Polisena J, Clifford TJ, Farrah K, Kamel C. Rapid review: an emerging approach to evidence synthesis in health technology assessment. Int J Technol Assess Health Care. 2014;30(1):20–7.CrossRefPubMed Khangura S, Polisena J, Clifford TJ, Farrah K, Kamel C. Rapid review: an emerging approach to evidence synthesis in health technology assessment. Int J Technol Assess Health Care. 2014;30(1):20–7.CrossRefPubMed
9.
go back to reference Grant MJ, Booth A. A typology of reviews: and analysis of 14 review types and associated methodologies. Health Info Libr J. 2009;26:91–108.CrossRefPubMed Grant MJ, Booth A. A typology of reviews: and analysis of 14 review types and associated methodologies. Health Info Libr J. 2009;26:91–108.CrossRefPubMed
10.
go back to reference Watt A, Cameron A, Sturm L, Lathlean T, Babidge W, Blamey S, Facey K, Hailey D, Norderhaug I, Maddern G. Rapid versus full systematic reviews: validity in clinical practice? ANZ Surg. 2008;78:1037–40.CrossRef Watt A, Cameron A, Sturm L, Lathlean T, Babidge W, Blamey S, Facey K, Hailey D, Norderhaug I, Maddern G. Rapid versus full systematic reviews: validity in clinical practice? ANZ Surg. 2008;78:1037–40.CrossRef
11.
go back to reference Polisena J, Garritty C, Umsheid CA, Kamel C, Samra K, Smith J, Vosilla A. Rapid review summit: an overview and initiation of a research agenda. Systematic Reviews. 2015;4:111.CrossRefPubMedPubMedCentral Polisena J, Garritty C, Umsheid CA, Kamel C, Samra K, Smith J, Vosilla A. Rapid review summit: an overview and initiation of a research agenda. Systematic Reviews. 2015;4:111.CrossRefPubMedPubMedCentral
12.
go back to reference Kaltenthaler E, Pandor A, Wong R. The effectiveness of sexual health interventions for people with severe mental illness: a systematic review. Health Technology Assessment. 2014;18(1). Kaltenthaler E, Pandor A, Wong R. The effectiveness of sexual health interventions for people with severe mental illness: a systematic review. Health Technology Assessment. 2014;18(1).
13.
go back to reference Cooper K, Martyn-St James M, Kaltenthaler E, Dickinson K, Cantrell A. Interventions to treat premature ejaculation: A systematic review short report. Health Technology Assessment. 2015;19(21). Cooper K, Martyn-St James M, Kaltenthaler E, Dickinson K, Cantrell A. Interventions to treat premature ejaculation: A systematic review short report. Health Technology Assessment. 2015;19(21).
14.
go back to reference Cooper K, Chatters R, Kaltenthaler E, Wong R. Psychological and psychosocial interventions for cannabis cessation in adults: A systematic review short report. Health Technology Assessment. 2015;19(56). Cooper K, Chatters R, Kaltenthaler E, Wong R. Psychological and psychosocial interventions for cannabis cessation in adults: A systematic review short report. Health Technology Assessment. 2015;19(56).
16.
go back to reference Cameron A, et al. Rapid versus full systematic reviews: an inventory of current methods and practice in Health Technology Assessment. ASERNIP-S Report No. 60. ASERNIP-S: Adelaide; 2007. Cameron A, et al. Rapid versus full systematic reviews: an inventory of current methods and practice in Health Technology Assessment. ASERNIP-S Report No. 60. ASERNIP-S: Adelaide; 2007.
18.
go back to reference Varker T, Forbes D, Dell L, Weston A, Merlin T, Hodson S, O’Donnell M. Rapid evidence assessment: increasing the transparency of an emerging methodology. J Eval Clin Pract. 2015;doi: 10.1111/jep12405 Varker T, Forbes D, Dell L, Weston A, Merlin T, Hodson S, O’Donnell M. Rapid evidence assessment: increasing the transparency of an emerging methodology. J Eval Clin Pract. 2015;doi: 10.​1111/​jep12405
19.
go back to reference Hartling L, Guise JM, Kato E, Anderson J, Belinson S, Berliner E, et al. A taxonomy of rapid reviews links report types and methods to specific decision-making contexts. J Clin Epidemiol. 2015;68(12):141–8.CrossRef Hartling L, Guise JM, Kato E, Anderson J, Belinson S, Berliner E, et al. A taxonomy of rapid reviews links report types and methods to specific decision-making contexts. J Clin Epidemiol. 2015;68(12):141–8.CrossRef
20.
go back to reference Martyn-St JamesM, Cooper K, Kaltenthaler E. Methods for a rapid systematic review and meta-analysis in evaluating selective serotonin reuptake inhibitors for premature ejaculation. Evidence and Policy. 2016;(in press). Martyn-St JamesM, Cooper K, Kaltenthaler E. Methods for a rapid systematic review and meta-analysis in evaluating selective serotonin reuptake inhibitors for premature ejaculation. Evidence and Policy. 2016;(in press).
Metadata
Title
The use of rapid review methods in health technology assessments: 3 case studies
Authors
Eva Kaltenthaler
Katy Cooper
Abdullah Pandor
Marrissa Martyn-St. James
Robin Chatters
Ruth Wong
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0216-1

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue