Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2014

Open Access 01-12-2014 | Debate

Choosing sensitivity analyses for randomised trials: principles

Authors: Tim P Morris, Brennan C Kahan, Ian R White

Published in: BMC Medical Research Methodology | Issue 1/2014

Login to get access

Abstract

Background

Sensitivity analyses are an important tool for understanding the extent to which the results of randomised trials depend upon the assumptions of the analysis. There is currently no guidance governing the choice of sensitivity analyses.

Discussion

We provide a principled approach to choosing sensitivity analyses through the consideration of the following questions: 1) Does the proposed sensitivity analysis address the same question as the primary analysis? 2) Is it possible for the proposed sensitivity analysis to return a different result to the primary analysis? 3) If the results do differ, is there any uncertainty as to which will be believed? Answering all of these questions in the affirmative will help researchers to identify relevant sensitivity analyses. Treating analyses as sensitivity analyses when one or more of the answers are negative can be misleading and confuse the interpretation of studies. The value of these questions is illustrated with several examples.

Summary

By removing unreasonable analyses that might have been performed, these questions will lead to relevant sensitivity analyses, which help to assess the robustness of trial results.
Appendix
Available only for authorised users
Literature
1.
go back to reference Freeman PR: The performance of the two-stage analysis of two-treatment, two-period crossover trials. Stat Med. 1989, 8 (12): 1421-1432. 10.1002/sim.4780081202.CrossRefPubMed Freeman PR: The performance of the two-stage analysis of two-treatment, two-period crossover trials. Stat Med. 1989, 8 (12): 1421-1432. 10.1002/sim.4780081202.CrossRefPubMed
2.
go back to reference Raab GM, Day S, Sales J: How to select covariates to include in the analysis of a clinical trial. Control Clin Trials. 2000, 21: 330-342. 10.1016/S0197-2456(00)00061-1.CrossRefPubMed Raab GM, Day S, Sales J: How to select covariates to include in the analysis of a clinical trial. Control Clin Trials. 2000, 21: 330-342. 10.1016/S0197-2456(00)00061-1.CrossRefPubMed
3.
go back to reference Campbell H, Dean CB: The consequences of proportional hazards based model selection. Stat Med. 2013, Campbell H, Dean CB: The consequences of proportional hazards based model selection. Stat Med. 2013,
4.
go back to reference Kahan BC: Bias in randomised factorial trials. Stat Med. 2013, 32 (26): 4540-4549. 10.1002/sim.5869.CrossRefPubMed Kahan BC: Bias in randomised factorial trials. Stat Med. 2013, 32 (26): 4540-4549. 10.1002/sim.5869.CrossRefPubMed
5.
go back to reference Thabane L, Mbuagbaw L, Zhang S, Samaan Z, Marcucci M, Ye C, Thabane M, Giangregorio L, Dennis B, Kosa D, Debono V, Dillenburg R, Fruci V, Bawor M, Lee J, Wells G, Goldsmith C: A tutorial on sensitivity analyses in clinical trials: the what, why, when and how. BMC Med Res Methodol. 2013, 1 (13): 92-CrossRef Thabane L, Mbuagbaw L, Zhang S, Samaan Z, Marcucci M, Ye C, Thabane M, Giangregorio L, Dennis B, Kosa D, Debono V, Dillenburg R, Fruci V, Bawor M, Lee J, Wells G, Goldsmith C: A tutorial on sensitivity analyses in clinical trials: the what, why, when and how. BMC Med Res Methodol. 2013, 1 (13): 92-CrossRef
6.
go back to reference Ashton HA, Buxton MJ, Day NE, Kim LG, Marteau TM, Scott RA, Thompson SG, Walker NM: Multicentre aneurysm screening study group: the Multicentre Aneurysm Screening Study (MASS) into the effect of abdominal aortic aneurysm screening on mortality in men: a randomised controlled trial. Lancet. 2002, 360 (9345): 1531-1539. 10.1016/S0140-6736(02)11522-4.CrossRefPubMed Ashton HA, Buxton MJ, Day NE, Kim LG, Marteau TM, Scott RA, Thompson SG, Walker NM: Multicentre aneurysm screening study group: the Multicentre Aneurysm Screening Study (MASS) into the effect of abdominal aortic aneurysm screening on mortality in men: a randomised controlled trial. Lancet. 2002, 360 (9345): 1531-1539. 10.1016/S0140-6736(02)11522-4.CrossRefPubMed
7.
go back to reference Imbens GW, Rubin DB: Bayesian inference for causal effects in randomized experiments with noncompliance. Ann Stat. 1997, 25 (1): 305-327.CrossRef Imbens GW, Rubin DB: Bayesian inference for causal effects in randomized experiments with noncompliance. Ann Stat. 1997, 25 (1): 305-327.CrossRef
8.
go back to reference Bendtsen P, McCambridge J, Bendtsen M, Karlsson N, Nilsen P: Effectiveness of a proactive mail-based alcohol internet intervention for university students: dismantling the assessment and feedback components in a randomized controlled trial. J Med Internet Res. 2012, 14 (5): 142-10.2196/jmir.2062.CrossRef Bendtsen P, McCambridge J, Bendtsen M, Karlsson N, Nilsen P: Effectiveness of a proactive mail-based alcohol internet intervention for university students: dismantling the assessment and feedback components in a randomized controlled trial. J Med Internet Res. 2012, 14 (5): 142-10.2196/jmir.2062.CrossRef
9.
go back to reference Ghofrani HA, Galiè N, Grimminger F, Grünig E, Humbert M, Jing ZC, Keogh AM, Langleben D, Kilama MO, Fritsch A, Neuser D, Rubin LJ: Riociguat for the treatment of pulmonary arterial hypertension. N Engl J Med. 2013, 369 (4): 330-340. 10.1056/NEJMoa1209655.CrossRefPubMed Ghofrani HA, Galiè N, Grimminger F, Grünig E, Humbert M, Jing ZC, Keogh AM, Langleben D, Kilama MO, Fritsch A, Neuser D, Rubin LJ: Riociguat for the treatment of pulmonary arterial hypertension. N Engl J Med. 2013, 369 (4): 330-340. 10.1056/NEJMoa1209655.CrossRefPubMed
10.
go back to reference White IR: Uses and limitations of randomization-based efficacy estimators. Stat Methods Med Res. 2005, 14 (4): 327-347. 10.1191/0962280205sm406oa.CrossRefPubMed White IR: Uses and limitations of randomization-based efficacy estimators. Stat Methods Med Res. 2005, 14 (4): 327-347. 10.1191/0962280205sm406oa.CrossRefPubMed
11.
go back to reference Zheng G, Li M, Lan X, Yan X, Lin Q, Chen L, Tao J, Zheng X, Li J, Chen B, Fang Q: The effect of baduanjin exercise for physical and psychological wellbeing of college students: study protocol for a randomized controlled trial. Trials. 2013, 14 (1): 422-10.1186/1745-6215-14-422.CrossRefPubMedPubMedCentral Zheng G, Li M, Lan X, Yan X, Lin Q, Chen L, Tao J, Zheng X, Li J, Chen B, Fang Q: The effect of baduanjin exercise for physical and psychological wellbeing of college students: study protocol for a randomized controlled trial. Trials. 2013, 14 (1): 422-10.1186/1745-6215-14-422.CrossRefPubMedPubMedCentral
12.
go back to reference Schafer JL: Multiple imputation: a primer. Stat Methods Med Res. 1999, 8 (1): 3-15. 10.1191/096228099671525676.CrossRefPubMed Schafer JL: Multiple imputation: a primer. Stat Methods Med Res. 1999, 8 (1): 3-15. 10.1191/096228099671525676.CrossRefPubMed
13.
go back to reference Kahan BC, Morris TP: Assessing potential sources of clustering in individually randomised trials. BMC Med Res Methodol. 2013, 13 (1): 58-10.1186/1471-2288-13-58.CrossRefPubMedPubMedCentral Kahan BC, Morris TP: Assessing potential sources of clustering in individually randomised trials. BMC Med Res Methodol. 2013, 13 (1): 58-10.1186/1471-2288-13-58.CrossRefPubMedPubMedCentral
14.
go back to reference Hu FB, Goldberg J, Hedeker D, Flay BR, Pentz MA: Comparison of population-averaged and subject-specific approaches for analyzing repeated binary outcomes. Am J Epidemiol. 1998, 147 (7): 694-703. 10.1093/oxfordjournals.aje.a009511.CrossRefPubMed Hu FB, Goldberg J, Hedeker D, Flay BR, Pentz MA: Comparison of population-averaged and subject-specific approaches for analyzing repeated binary outcomes. Am J Epidemiol. 1998, 147 (7): 694-703. 10.1093/oxfordjournals.aje.a009511.CrossRefPubMed
15.
go back to reference Perkins GD, Woollard M, Cooke MW, Deakin C, Horton J, Lall R, Lamb SE, McCabe C, Quinn T, Slowther A, Gates S, PARAMEDIC trial collaborators: Prehospital randomised assessment of a mechanical compression device in cardiac arrest (paramedic) trial protocol. Scand J Trauma Resusc Emerg Med. 2010, 18: 58-10.1186/1757-7241-18-58.CrossRefPubMedPubMedCentral Perkins GD, Woollard M, Cooke MW, Deakin C, Horton J, Lall R, Lamb SE, McCabe C, Quinn T, Slowther A, Gates S, PARAMEDIC trial collaborators: Prehospital randomised assessment of a mechanical compression device in cardiac arrest (paramedic) trial protocol. Scand J Trauma Resusc Emerg Med. 2010, 18: 58-10.1186/1757-7241-18-58.CrossRefPubMedPubMedCentral
16.
go back to reference White IR, Horton NJ, Carpenter J, Pocock SJ: Strategy for intention to treat analysis in randomised trials with missing outcome data. BMJ. 2011, 342: 910-912. White IR, Horton NJ, Carpenter J, Pocock SJ: Strategy for intention to treat analysis in randomised trials with missing outcome data. BMJ. 2011, 342: 910-912.
17.
go back to reference de Pauw BE, Sable CA, Walsh TJ, Lupinacci RJ, Bourque MR, Wise BA, Nguyen B-YY, DiNubile MJ, Teppler H: Impact of alternate definitions of fever resolution on the composite endpoint in clinical trials of empirical antifungal therapy for neutropenic patients with persistent fever: analysis of results from the caspofungin empirical therapy study. Transpl Infect Dis: Official J Transpl Soc. 2006, 8 (1): 31-37. 10.1111/j.1399-3062.2006.00127.x.CrossRef de Pauw BE, Sable CA, Walsh TJ, Lupinacci RJ, Bourque MR, Wise BA, Nguyen B-YY, DiNubile MJ, Teppler H: Impact of alternate definitions of fever resolution on the composite endpoint in clinical trials of empirical antifungal therapy for neutropenic patients with persistent fever: analysis of results from the caspofungin empirical therapy study. Transpl Infect Dis: Official J Transpl Soc. 2006, 8 (1): 31-37. 10.1111/j.1399-3062.2006.00127.x.CrossRef
18.
go back to reference Carnes D, Taylor SJC, Homer K, Eldridge S, Bremner S, Pincus T, Rahman A, Underwood M: Effectiveness and cost-effectiveness of a novel, group self-management course for adults with chronic musculoskeletal pain: study protocol for a multicentre, randomised controlled trial (copers). BMJ Open. 2013, 3 (1): 002492-10.1136/bmjopen-2012-002492.CrossRef Carnes D, Taylor SJC, Homer K, Eldridge S, Bremner S, Pincus T, Rahman A, Underwood M: Effectiveness and cost-effectiveness of a novel, group self-management course for adults with chronic musculoskeletal pain: study protocol for a multicentre, randomised controlled trial (copers). BMJ Open. 2013, 3 (1): 002492-10.1136/bmjopen-2012-002492.CrossRef
Metadata
Title
Choosing sensitivity analyses for randomised trials: principles
Authors
Tim P Morris
Brennan C Kahan
Ian R White
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2014
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-14-11

Other articles of this Issue 1/2014

BMC Medical Research Methodology 1/2014 Go to the issue