Skip to main content
Top
Published in: PharmacoEconomics - Open 2/2017

Open Access 01-06-2017 | Original Research Article

Issues Related to the Frequency of Exploratory Analyses by Evidence Review Groups in the NICE Single Technology Appraisal Process

Authors: Eva Kaltenthaler, Christopher Carroll, Daniel Hill-McManus, Alison Scope, Michael Holmes, Stephen Rice, Micah Rose, Paul Tappenden, Nerys Woolacott

Published in: PharmacoEconomics - Open | Issue 2/2017

Login to get access

Abstract

Background

Evidence Review Groups (ERGs) critically appraise company submissions as part of the National Institute for Health and Care Excellence (NICE) Single Technology Appraisal (STA) process. As part of their critique of the evidence submitted by companies, the ERGs undertake exploratory analyses to explore uncertainties in the company’s model. The aim of this study was to explore pre-defined factors that might influence or predict the extent of ERG exploratory analyses.

Objective

The aim of this study was to explore predefined factors that might influence or predict the extent of ERG exploratory analyses.

Methods

We undertook content analysis of over 400 documents, including ERG reports and related documentation for the 100 most recent STAs (2009–2014) for which guidance has been published. Relevant data were extracted from the documents and narrative synthesis was used to summarise the extracted data. All data were extracted and checked by two researchers.

Results

Forty different companies submitted documents as part of the NICE STA process. The most common disease area covered by the STAs was cancer (44%), and most ERG reports (n = 93) contained at least one exploratory analysis. The incidence and frequency of ERG exploratory analyses does not appear to be related to any developments in the appraisal process, the disease area covered by the STA, or the company’s base-case incremental cost-effectiveness ratio (ICER). However, there does appear to be a pattern in the mean number of analyses conducted by particular ERGs, but the reasons for this are unclear and potentially complex.

Conclusions

No clear patterns were identified regarding the presence or frequency of exploratory analyses, apart from the mean number conducted by individual ERGs. More research is needed to understand this relationship.
Appendix
Available only for authorised users
Literature
3.
go back to reference Wong R, Paisley S, Carroll C. Assessing searches in NICE single technology appraisals: practice and checklist. Int J Technol Assess Health Care. 2013;29(3):315–22.CrossRefPubMed Wong R, Paisley S, Carroll C. Assessing searches in NICE single technology appraisals: practice and checklist. Int J Technol Assess Health Care. 2013;29(3):315–22.CrossRefPubMed
4.
go back to reference Kaltenthaler E, Boland A, Carroll C, Dickson R, Fitzgerald P, Papaioannou D. Evidence Review Group approaches to the critical appraisal of manufacturer submissions for the NICE STA process: a mapping study and thematic analysis. Health Technol Assess 2011;15(22):1–iv. Kaltenthaler E, Boland A, Carroll C, Dickson R, Fitzgerald P, Papaioannou D. Evidence Review Group approaches to the critical appraisal of manufacturer submissions for the NICE STA process: a mapping study and thematic analysis. Health Technol Assess 2011;15(22):1–iv.
5.
go back to reference Carroll C, Kaltenthaler E, Fitzgerald P, Boland A, Dickson R. A thematic analysis of the strengths and weaknesses of manufacturers’ submissions to the NICE Single Technology Assessment (STA) process. Health Policy. 2011;102(2–3):136–44.CrossRefPubMed Carroll C, Kaltenthaler E, Fitzgerald P, Boland A, Dickson R. A thematic analysis of the strengths and weaknesses of manufacturers’ submissions to the NICE Single Technology Assessment (STA) process. Health Policy. 2011;102(2–3):136–44.CrossRefPubMed
6.
go back to reference Kaltenthaler EC, Dickson R, Boland A, Carroll C, Fitzgerald P, Papaioannou D, Akehurst R. A qualitative study of manufacturers’ submissions to the UK NICE single technology appraisal process. BMJ Open. 2012;2:e000562.CrossRefPubMedPubMedCentral Kaltenthaler EC, Dickson R, Boland A, Carroll C, Fitzgerald P, Papaioannou D, Akehurst R. A qualitative study of manufacturers’ submissions to the UK NICE single technology appraisal process. BMJ Open. 2012;2:e000562.CrossRefPubMedPubMedCentral
7.
go back to reference Kaltenthaler E, Carroll C, Hill-McManus D, Scope A, Holmes M, Rice S, et al. The use of exploratory analyses within the NICE Single Technology Appraisal process. Health Technol Assess. 2016;20(26):1–46.CrossRefPubMedPubMedCentral Kaltenthaler E, Carroll C, Hill-McManus D, Scope A, Holmes M, Rice S, et al. The use of exploratory analyses within the NICE Single Technology Appraisal process. Health Technol Assess. 2016;20(26):1–46.CrossRefPubMedPubMedCentral
9.
go back to reference Barham L. Single technology appraisals by NICE: are they delivering faster guidance to the NHS? Pharmacoeconomics. 2008;26:1037–43.CrossRefPubMed Barham L. Single technology appraisals by NICE: are they delivering faster guidance to the NHS? Pharmacoeconomics. 2008;26:1037–43.CrossRefPubMed
10.
go back to reference McCabe C, Claxton KF, Culyer AJ. The NICE cost-effectiveness threshold: what it is and what that means. Pharmacoeconomics. 2008;26(9):733–44.CrossRefPubMed McCabe C, Claxton KF, Culyer AJ. The NICE cost-effectiveness threshold: what it is and what that means. Pharmacoeconomics. 2008;26(9):733–44.CrossRefPubMed
11.
go back to reference Carroll C, Kaltenthaler E, Tappenden P, Hill-McManus D, Scope A, Holmes M, et al. The type and impact of Evidence Review Group exploratory analyses in the NICE Single Technology (STA) process. Value Health (in press). Carroll C, Kaltenthaler E, Tappenden P, Hill-McManus D, Scope A, Holmes M, et al. The type and impact of Evidence Review Group exploratory analyses in the NICE Single Technology (STA) process. Value Health (in press).
14.
go back to reference Kaltenthaler E, Papaioannou D, Boland A, Dickson R. The National Institute for Health and Clinical Excellence Single Technology Appraisal process: lessons from the first 4 years. Value Health. 2011;14(8):1158–65.CrossRefPubMed Kaltenthaler E, Papaioannou D, Boland A, Dickson R. The National Institute for Health and Clinical Excellence Single Technology Appraisal process: lessons from the first 4 years. Value Health. 2011;14(8):1158–65.CrossRefPubMed
Metadata
Title
Issues Related to the Frequency of Exploratory Analyses by Evidence Review Groups in the NICE Single Technology Appraisal Process
Authors
Eva Kaltenthaler
Christopher Carroll
Daniel Hill-McManus
Alison Scope
Michael Holmes
Stephen Rice
Micah Rose
Paul Tappenden
Nerys Woolacott
Publication date
01-06-2017
Publisher
Springer International Publishing
Published in
PharmacoEconomics - Open / Issue 2/2017
Print ISSN: 2509-4262
Electronic ISSN: 2509-4254
DOI
https://doi.org/10.1007/s41669-016-0001-4

Other articles of this Issue 2/2017

PharmacoEconomics - Open 2/2017 Go to the issue