Skip to main content
Top
Published in: Trials 1/2013

Open Access 01-12-2013 | Methodology

Intermediate outcomes in randomized clinical trials: an introduction

Authors: Armando H Seuc, Alexander Peregoudov, Ana Pilar Betran, Ahmet Metin Gulmezoglu

Published in: Trials | Issue 1/2013

Login to get access

Abstract

Background

Intermediate outcomes are common and typically on the causal pathway to the final outcome. Some examples include noncompliance, missing data, and truncation by death like pregnancy (e.g. when the trial intervention is given to non-pregnant women and the final outcome is preeclampsia, defined only on pregnant women). The intention-to-treat approach does not account properly for them, and more appropriate alternative approaches like principal stratification are not yet widely known. The purposes of this study are to inform researchers that the intention-to-treat approach unfortunately does not fit all problems we face in experimental research, to introduce the principal stratification approach for dealing with intermediate outcomes, and to illustrate its application to a trial of long term calcium supplementation in women at high risk of preeclampsia.

Methods

Principal stratification and related concepts are introduced. Two ways for estimating causal effects are discussed and their application is illustrated using the calcium trial, where noncompliance and pregnancy are considered as intermediate outcomes, and preeclampsia is the main final outcome.

Results

The limitations of traditional approaches and methods for dealing with intermediate outcomes are demonstrated. The steps, assumptions and required calculations involved in the application of the principal stratification approach are discussed in detail in the case of our calcium trial.

Conclusions

The intention-to-treat approach is a very sound one but unfortunately it does not fit all problems we find in randomized clinical trials; this is particularly the case for intermediate outcomes, where alternative approaches like principal stratification should be considered.
Appendix
Available only for authorised users
Literature
1.
go back to reference Rochon J: Issues in adjusting for covariates arising postrandomization in clinical trials. Drug Information Journal. 1999, 33: 1219-1228. 10.1177/009286159903300425. Rochon J: Issues in adjusting for covariates arising postrandomization in clinical trials. Drug Information Journal. 1999, 33: 1219-1228. 10.1177/009286159903300425.
2.
go back to reference Robins J: The control of confounding by intermediate variables. Stat Med. 1989, 8: 679-701. 10.1002/sim.4780080608.CrossRefPubMed Robins J: The control of confounding by intermediate variables. Stat Med. 1989, 8: 679-701. 10.1002/sim.4780080608.CrossRefPubMed
3.
go back to reference Robins J, Greenland S: Identifiability and exchangeability for direct and indirect effects. Epidemiology. 1992, 3: 143-155. 10.1097/00001648-199203000-00013.CrossRefPubMed Robins J, Greenland S: Identifiability and exchangeability for direct and indirect effects. Epidemiology. 1992, 3: 143-155. 10.1097/00001648-199203000-00013.CrossRefPubMed
4.
go back to reference Little R, Rubin D: Causal effects in clinical and epidemiological studies via potential outcomes: Concepts and Analytical Approaches. Annu Rev Public Health. 2000, 21: 121-145. 10.1146/annurev.publhealth.21.1.121.CrossRefPubMed Little R, Rubin D: Causal effects in clinical and epidemiological studies via potential outcomes: Concepts and Analytical Approaches. Annu Rev Public Health. 2000, 21: 121-145. 10.1146/annurev.publhealth.21.1.121.CrossRefPubMed
7.
go back to reference Gunasekara FI, Carter K, Blakely T: Glossary for econometrics and epidemiology. J Epidemiol Community Health. 2008, 62: 858-861. 10.1136/jech.2008.077461.CrossRefPubMed Gunasekara FI, Carter K, Blakely T: Glossary for econometrics and epidemiology. J Epidemiol Community Health. 2008, 62: 858-861. 10.1136/jech.2008.077461.CrossRefPubMed
8.
go back to reference Rothman KJ, Greenland S: Modern Epidemiology. 1998, Philadelphia: Lippincott-Raven, 2 Rothman KJ, Greenland S: Modern Epidemiology. 1998, Philadelphia: Lippincott-Raven, 2
9.
go back to reference Brookhart MA, Rassen JA, Schneeweiss S: Instrumental variable methods in comparative safety and effectiveness research. Effective Health Care Research Report No. 22. (Prepared by Brigham and Women’s Hospital DEcIDE Center Under Contract No. 290-2005-0016I T03). 2010, Rockville, MD: Agency for Healthcare Research and Quality, [http://effectivehealthcare.ahrq.gov/reports/final.cfm] Brookhart MA, Rassen JA, Schneeweiss S: Instrumental variable methods in comparative safety and effectiveness research. Effective Health Care Research Report No. 22. (Prepared by Brigham and Women’s Hospital DEcIDE Center Under Contract No. 290-2005-0016I T03). 2010, Rockville, MD: Agency for Healthcare Research and Quality, [http://​effectivehealthc​are.​ahrq.​gov/​reports/​final.​cfm]
10.
go back to reference Angrist JD, Imbens GW: Two-stage least squares estimation of average causal effects in models with variable treatment intensity. J Am Stat Assoc. 1995, 90: 431-442. 10.1080/01621459.1995.10476535.CrossRef Angrist JD, Imbens GW: Two-stage least squares estimation of average causal effects in models with variable treatment intensity. J Am Stat Assoc. 1995, 90: 431-442. 10.1080/01621459.1995.10476535.CrossRef
11.
go back to reference Greenland S: An introduction to instrumental variables for epidemiologists. Int J Epidemiol. 2000, 29: 722-729. 10.1093/ije/29.4.722.CrossRefPubMed Greenland S: An introduction to instrumental variables for epidemiologists. Int J Epidemiol. 2000, 29: 722-729. 10.1093/ije/29.4.722.CrossRefPubMed
12.
go back to reference Rassena JA, Brookhart MA, Glynna RJ, Mittleman MA, Schneeweiss S: Instrumental variables I: instrumental variables exploit natural variation in nonexperimental data to estimate causal relationships. J Clin Epidemiol. 2009, 62: 1226-1232. 10.1016/j.jclinepi.2008.12.005.CrossRef Rassena JA, Brookhart MA, Glynna RJ, Mittleman MA, Schneeweiss S: Instrumental variables I: instrumental variables exploit natural variation in nonexperimental data to estimate causal relationships. J Clin Epidemiol. 2009, 62: 1226-1232. 10.1016/j.jclinepi.2008.12.005.CrossRef
13.
go back to reference MacPherson H: Pragmatic clinical trials. Complement Ther Med. 2004, 12: 136-140. 10.1016/j.ctim.2004.07.043.CrossRefPubMed MacPherson H: Pragmatic clinical trials. Complement Ther Med. 2004, 12: 136-140. 10.1016/j.ctim.2004.07.043.CrossRefPubMed
14.
go back to reference Hollis S, Campbell F: What is meant by intention to treat analysis? Survey of published randomised controlled trials. BMJ. 1999, 319: 670-10.1136/bmj.319.7211.670.CrossRefPubMedPubMedCentral Hollis S, Campbell F: What is meant by intention to treat analysis? Survey of published randomised controlled trials. BMJ. 1999, 319: 670-10.1136/bmj.319.7211.670.CrossRefPubMedPubMedCentral
15.
go back to reference Stuart EA, Perry DF, Le H-N, Ialongo NS: Estimating intervention effects of prevention programs: Accounting for noncompliance. Prev Sci. 2008, 9: 288-298. 10.1007/s11121-008-0104-y.CrossRefPubMedPubMedCentral Stuart EA, Perry DF, Le H-N, Ialongo NS: Estimating intervention effects of prevention programs: Accounting for noncompliance. Prev Sci. 2008, 9: 288-298. 10.1007/s11121-008-0104-y.CrossRefPubMedPubMedCentral
16.
go back to reference Hofmeyr GJ, Lawrie TA, Atallah AN, Duley L: Calcium supplementation during pregnancy for preventing hypertensive disorders and related problems. Cochrane Database of Systematic Reviews. 2010,   (8): CD001059-10.1002/14651858.CD001059.pub3. Hofmeyr GJ, Lawrie TA, Atallah AN, Duley L: Calcium supplementation during pregnancy for preventing hypertensive disorders and related problems. Cochrane Database of Systematic Reviews. 2010,   (8): CD001059-10.1002/14651858.CD001059.pub3.
17.
go back to reference Belizan JM, Villar J, Gonzalez L, Campodonico L, Bergel E: Calcium supplementation to prevent hypertensive disorders of pregnancy. N Engl J Med. 1991, 325: 1399-1405. 10.1056/NEJM199111143252002.CrossRefPubMed Belizan JM, Villar J, Gonzalez L, Campodonico L, Bergel E: Calcium supplementation to prevent hypertensive disorders of pregnancy. N Engl J Med. 1991, 325: 1399-1405. 10.1056/NEJM199111143252002.CrossRefPubMed
18.
go back to reference Levine RJ, Hauth JC, Curet LB, Sibai BM, Catalano PM, Morris CD, DerSimonian R, Esterlitz JR, Raymond EG, Bild DE, Clemens JD, Cutler JA: Trial of calcium to prevent preeclampsia. N Engl J Med. 1997, 337: 69-76. 10.1056/NEJM199707103370201.CrossRefPubMed Levine RJ, Hauth JC, Curet LB, Sibai BM, Catalano PM, Morris CD, DerSimonian R, Esterlitz JR, Raymond EG, Bild DE, Clemens JD, Cutler JA: Trial of calcium to prevent preeclampsia. N Engl J Med. 1997, 337: 69-76. 10.1056/NEJM199707103370201.CrossRefPubMed
19.
go back to reference Villar J, Abdel-Aleem H, Merialdi M, Mathai M, Ali M, Zavaleta N, Purwar M, Hofmeyr J, Nguyen TN, Campódonico L, Landoulsi S, Carroli G, Lindheimer M, World Health Organization Calcium Supplementation for the Prevention of Preeclampsia Trial Group: World Health Organization randomized trial of calcium supplementation among low calcium intake pregnant women. Am J Obstet Gynecol. 2006, 194: 639-649. 10.1016/j.ajog.2006.01.068.CrossRefPubMed Villar J, Abdel-Aleem H, Merialdi M, Mathai M, Ali M, Zavaleta N, Purwar M, Hofmeyr J, Nguyen TN, Campódonico L, Landoulsi S, Carroli G, Lindheimer M, World Health Organization Calcium Supplementation for the Prevention of Preeclampsia Trial Group: World Health Organization randomized trial of calcium supplementation among low calcium intake pregnant women. Am J Obstet Gynecol. 2006, 194: 639-649. 10.1016/j.ajog.2006.01.068.CrossRefPubMed
20.
go back to reference Sanchez-Ramos L, Briones DK, Kaunitz AM, Delvalle GO, Gaudier FL, Walker KD: Prevention of pregnancy-induced hypertension by calcium supplementation in angiotensin II sensitive patients. Obstet Gynecol. 1994, 84: 349-353.PubMed Sanchez-Ramos L, Briones DK, Kaunitz AM, Delvalle GO, Gaudier FL, Walker KD: Prevention of pregnancy-induced hypertension by calcium supplementation in angiotensin II sensitive patients. Obstet Gynecol. 1994, 84: 349-353.PubMed
22.
go back to reference Barnard J, Frangakis CE, Hill JL, Rubin DB: Principal stratification approach to broken randomized experiments: a case study of school choice vouchers in New York City. J Am Stat Assoc. 2003, 98: 462-CrossRef Barnard J, Frangakis CE, Hill JL, Rubin DB: Principal stratification approach to broken randomized experiments: a case study of school choice vouchers in New York City. J Am Stat Assoc. 2003, 98: 462-CrossRef
23.
go back to reference Yau LHY, Little RJ: Inference for the complier-average causal effect from longitudinal data subject to noncompliance and missing data, with application to a job training assessment for the unemployed. J Am Stat Assoc. 2001, 96: 456-CrossRef Yau LHY, Little RJ: Inference for the complier-average causal effect from longitudinal data subject to noncompliance and missing data, with application to a job training assessment for the unemployed. J Am Stat Assoc. 2001, 96: 456-CrossRef
24.
go back to reference Rubin D: Causal inference using potential outcomes: design, modeling, decisions. J Am Stat Assoc. 2005, 100: 469-CrossRef Rubin D: Causal inference using potential outcomes: design, modeling, decisions. J Am Stat Assoc. 2005, 100: 469-CrossRef
25.
go back to reference Rubin D: Causal inference through potential outcomes and principal stratification: application to studies with “censoring” due to death. Stat Sci. 2006, 21: 299-309. 10.1214/088342306000000114.CrossRef Rubin D: Causal inference through potential outcomes and principal stratification: application to studies with “censoring” due to death. Stat Sci. 2006, 21: 299-309. 10.1214/088342306000000114.CrossRef
26.
go back to reference Angrist JD, Imbens GW, Rubin DB: Identification of causal effects using instrumental variables. J Am Statist Ass. 1996, 91: 444-455. 10.1080/01621459.1996.10476902.CrossRef Angrist JD, Imbens GW, Rubin DB: Identification of causal effects using instrumental variables. J Am Statist Ass. 1996, 91: 444-455. 10.1080/01621459.1996.10476902.CrossRef
27.
go back to reference Dunn G, Maracy M, Tomenson B: Estimating treatment effects from randomized clinical trials with noncompliance and loss to follow-up: the role of instrumental variable methods. Stat Methods Med Res. 2005, 14: 369-395. 10.1191/0962280205sm403oa.CrossRefPubMed Dunn G, Maracy M, Tomenson B: Estimating treatment effects from randomized clinical trials with noncompliance and loss to follow-up: the role of instrumental variable methods. Stat Methods Med Res. 2005, 14: 369-395. 10.1191/0962280205sm403oa.CrossRefPubMed
28.
go back to reference Imbens GW, Rubin DB: Bayesian Inference for Causal Effects in Randomized Experiments with Noncompliance. Ann Stat. 25: 305-327. Imbens GW, Rubin DB: Bayesian Inference for Causal Effects in Randomized Experiments with Noncompliance. Ann Stat. 25: 305-327.
29.
go back to reference Frangakis CE, Varadhan R: Systematizing the evaluation of partially controlled studies using principal stratification: from theory to practice. Stat Sin. 2004, 14: 945-947. Frangakis CE, Varadhan R: Systematizing the evaluation of partially controlled studies using principal stratification: from theory to practice. Stat Sin. 2004, 14: 945-947.
30.
go back to reference Altman DG: Missing outcomes in randomized trials: addressing the dilemma. Open Medicine. 2009, 3: 2- Altman DG: Missing outcomes in randomized trials: addressing the dilemma. Open Medicine. 2009, 3: 2-
31.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral
32.
go back to reference Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, Lam M, Seguin R: Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol. 2003, 3: 28-10.1186/1471-2288-3-28.CrossRefPubMedPubMedCentral Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, Birtwhistle R, Lam M, Seguin R: Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol. 2003, 3: 28-10.1186/1471-2288-3-28.CrossRefPubMedPubMedCentral
33.
go back to reference Rubin DB: Bayesian inference for causal effects: the role of randomization. Ann Statist. 1978, 6: 34-58. 10.1214/aos/1176344064.CrossRef Rubin DB: Bayesian inference for causal effects: the role of randomization. Ann Statist. 1978, 6: 34-58. 10.1214/aos/1176344064.CrossRef
Metadata
Title
Intermediate outcomes in randomized clinical trials: an introduction
Authors
Armando H Seuc
Alexander Peregoudov
Ana Pilar Betran
Ahmet Metin Gulmezoglu
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Trials / Issue 1/2013
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-14-78

Other articles of this Issue 1/2013

Trials 1/2013 Go to the issue