Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2016

Open Access 01-12-2016 | Research Article

Testing for carryover effects after cessation of treatments: a design approach

Authors: S. Gwynn Sturdevant, Thomas Lumley

Published in: BMC Medical Research Methodology | Issue 1/2016

Login to get access

Abstract

Background

Recently, trials addressing noisy measurements with diagnosis occurring by exceeding thresholds (such as diabetes and hypertension) have been published which attempt to measure carryover - the impact that treatment has on an outcome after cessation. The design of these trials has been criticised and simulations have been conducted which suggest that the parallel-designs used are not adequate to test this hypothesis; two solutions are that either a differing parallel-design or a cross-over design could allow for diagnosis of carryover.

Methods

We undertook a systematic simulation study to determine the ability of a cross-over or a parallel-group trial design to detect carryover effects on incident hypertension in a population with prehypertension. We simulated blood pressure and focused on varying criteria to diagnose systolic hypertension.

Results

Using the difference in cumulative incidence hypertension to analyse parallel-group or cross-over trials resulted in none of the designs having acceptable Type I error rate. Under the null hypothesis of no carryover the difference is well above the nominal 5 % error rate.

Conclusions

When a treatment is effective during the intervention period, reliable testing for a carryover effect is difficult. Neither parallel-group nor cross-over designs using the difference in cumulative incidence appear to be a feasible approach. Future trials should ensure their design and analysis is validated by simulation.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lawes CMM, Hoorn SV, Law MR, Elliot P, MacMahon S, Rodgers A.High Blood Pressure In: Ezzati M, Lopez AD, Rodgers A, Murray CJ, editors. Comparative Quantification of Health Risks: Global and Regional Burden of Disease Attributable to Selected Major Risk Factors. World Health Organization. Geneva: 2004. p. 281–389. Lawes CMM, Hoorn SV, Law MR, Elliot P, MacMahon S, Rodgers A.High Blood Pressure In: Ezzati M, Lopez AD, Rodgers A, Murray CJ, editors. Comparative Quantification of Health Risks: Global and Regional Burden of Disease Attributable to Selected Major Risk Factors. World Health Organization. Geneva: 2004. p. 281–389.
2.
go back to reference Senn S. Cross-over trials in statistics in medicine: The first ’25’ years. Stat Med. 2006; 25:3430–42.CrossRefPubMed Senn S. Cross-over trials in statistics in medicine: The first ’25’ years. Stat Med. 2006; 25:3430–42.CrossRefPubMed
3.
go back to reference Julius S, Nesbitt SD, Egan BM, Weber MA, Michelson EL, Kaciroti N, Black HR, Grimm RH, Messerli FH, Oparil S. Feasibility of treating prehypertension with an angiotensin-receptor blocker. New England J Med. 2006; 354(16):1685–97.CrossRef Julius S, Nesbitt SD, Egan BM, Weber MA, Michelson EL, Kaciroti N, Black HR, Grimm RH, Messerli FH, Oparil S. Feasibility of treating prehypertension with an angiotensin-receptor blocker. New England J Med. 2006; 354(16):1685–97.CrossRef
4.
go back to reference Lumley T, Rice KM, Psaty BM. Carryover effects after cessation of drug treatment: trophies or dreams?Am J Hypertens. 2008; 21:14–16.CrossRefPubMed Lumley T, Rice KM, Psaty BM. Carryover effects after cessation of drug treatment: trophies or dreams?Am J Hypertens. 2008; 21:14–16.CrossRefPubMed
5.
go back to reference Goodman PJ, Thompson IM, Tangen CM, Crowley JJ, Ford LG, Coltman CA. The prostate cancer prevention trial: design, biases and interpretation of study results. J Urol. 2006; 175(6):2234–42.CrossRefPubMed Goodman PJ, Thompson IM, Tangen CM, Crowley JJ, Ford LG, Coltman CA. The prostate cancer prevention trial: design, biases and interpretation of study results. J Urol. 2006; 175(6):2234–42.CrossRefPubMed
6.
go back to reference Pickering TG, Hall JE, Appel LJ, Falkner BE, Graves J, Hill MN, Jones DW, Kurtz T, Sheps SG, Roccella EJ. Recommendations for blood pressure measurement in humans and experimental animals part 1: blood pressure measurement in humans: a statement for professionals from the subcommittee of professional and public education of the American Heart Association Council on high blood pressure research. Hypertension. 2005; 45:142–61.CrossRefPubMed Pickering TG, Hall JE, Appel LJ, Falkner BE, Graves J, Hill MN, Jones DW, Kurtz T, Sheps SG, Roccella EJ. Recommendations for blood pressure measurement in humans and experimental animals part 1: blood pressure measurement in humans: a statement for professionals from the subcommittee of professional and public education of the American Heart Association Council on high blood pressure research. Hypertension. 2005; 45:142–61.CrossRefPubMed
7.
go back to reference Nason M, Follman D. Design and analysis of crossover trials for absorbing binary endpoints. Biometrics. 2010; 66:958–65.CrossRefPubMed Nason M, Follman D. Design and analysis of crossover trials for absorbing binary endpoints. Biometrics. 2010; 66:958–65.CrossRefPubMed
8.
go back to reference Makubate B, Senn S. Planning and analysis of cross-over trials in infertility. Stat Med. 2010; 29:3203–10.CrossRefPubMed Makubate B, Senn S. Planning and analysis of cross-over trials in infertility. Stat Med. 2010; 29:3203–10.CrossRefPubMed
10.
go back to reference Senn S. Statistical issues in drug development, Second edition. West Sussex: John Wiley & Sons, /Ltd; 2007, pp. 273–85.CrossRef Senn S. Statistical issues in drug development, Second edition. West Sussex: John Wiley & Sons, /Ltd; 2007, pp. 273–85.CrossRef
11.
go back to reference Fleiss JL. A critique of recent research on the two-treatment crossover design. Control Clin Trials. 1989; 10:237–43.CrossRefPubMed Fleiss JL. A critique of recent research on the two-treatment crossover design. Control Clin Trials. 1989; 10:237–43.CrossRefPubMed
12.
go back to reference Freeman PR. The performance of the two-stage analysis of two-treatment, two-period crossover trials. Stat Med. 1989; 8:1421–32.CrossRefPubMed Freeman PR. The performance of the two-stage analysis of two-treatment, two-period crossover trials. Stat Med. 1989; 8:1421–32.CrossRefPubMed
13.
go back to reference Byron Wm, Brown J. The crossover experiment for clinical trial. Biometrics. 1980; 36:69–79.CrossRef Byron Wm, Brown J. The crossover experiment for clinical trial. Biometrics. 1980; 36:69–79.CrossRef
14.
go back to reference Millar-Craig MW, Bishop CN, Raferty EB. Circadian variation of blood-pressure. The Lancet. 1978; 311(8068):795–7.CrossRef Millar-Craig MW, Bishop CN, Raferty EB. Circadian variation of blood-pressure. The Lancet. 1978; 311(8068):795–7.CrossRef
15.
go back to reference Woodhouse PR, Khaw KT, Plummer M. Seasonal variation of blood pressure and its relationship to ambient temperature in an elderly population. J Hypertens. 1993; 11(11):1267–74.CrossRefPubMed Woodhouse PR, Khaw KT, Plummer M. Seasonal variation of blood pressure and its relationship to ambient temperature in an elderly population. J Hypertens. 1993; 11(11):1267–74.CrossRefPubMed
16.
go back to reference James GD, Yee LS, Pickering TG. Winter-summer difference in the effects of emotion, posture and place of measurement on blood pressure. Soc Sci Med. 1990; 31(11):1213–7.CrossRefPubMed James GD, Yee LS, Pickering TG. Winter-summer difference in the effects of emotion, posture and place of measurement on blood pressure. Soc Sci Med. 1990; 31(11):1213–7.CrossRefPubMed
17.
go back to reference Clark LA, Denby L, Pregibon D, Harshfield GA, Pickering TG, Blank S, Laragh JH. A quantitative analysis of the effects of activity and time of day on the diurnal variations of blood pressure. J Chron Dis. 1987; 40(7):671–81.CrossRefPubMed Clark LA, Denby L, Pregibon D, Harshfield GA, Pickering TG, Blank S, Laragh JH. A quantitative analysis of the effects of activity and time of day on the diurnal variations of blood pressure. J Chron Dis. 1987; 40(7):671–81.CrossRefPubMed
18.
go back to reference Lusardi P, Zoppi A, Preti P, Pesce RM, Piazza E, Fogari R. Effects of insufficient sleep on blood pressure in hypertensive patients A 24-h study. Am J Hypertens. 1999; 12:63–8.CrossRefPubMed Lusardi P, Zoppi A, Preti P, Pesce RM, Piazza E, Fogari R. Effects of insufficient sleep on blood pressure in hypertensive patients A 24-h study. Am J Hypertens. 1999; 12:63–8.CrossRefPubMed
19.
go back to reference Neufeld PD, Johnson DL. Observer error in blood pressure measurement. Can Med Assoc J. 1986; 135(6):633–7. Neufeld PD, Johnson DL. Observer error in blood pressure measurement. Can Med Assoc J. 1986; 135(6):633–7.
20.
go back to reference Jones B, Kenward MG. Design and Analysis of Cross-Over Trials, Second edition. Boca Raton, Florida: Chapman & Hall/CRC; 2003, pp. 1–1. Jones B, Kenward MG. Design and Analysis of Cross-Over Trials, Second edition. Boca Raton, Florida: Chapman & Hall/CRC; 2003, pp. 1–1.
21.
go back to reference Hajjar I, Kotchen TA. Trends in prevalence, awareness, treatment, and control of hypertension in the United States. JAMA. 2003; 290:199–206.CrossRefPubMed Hajjar I, Kotchen TA. Trends in prevalence, awareness, treatment, and control of hypertension in the United States. JAMA. 2003; 290:199–206.CrossRefPubMed
22.
go back to reference Wolf-Maier K, Cooper RS, Banegas JR, Giampaoli S, Hense HW, Joffres M, Kastarinen M, Poulter N, Primatesta P, Rodríguez-Artalejo F, Stegmayr B, Thamm M, Tuomilehto J, Vanuzzo D, Vescio F. Hypertension prevalence and blood pressure levels in 6 European countries, Canada, and the United States. JAMA. 2003; 289:2363–69.CrossRefPubMed Wolf-Maier K, Cooper RS, Banegas JR, Giampaoli S, Hense HW, Joffres M, Kastarinen M, Poulter N, Primatesta P, Rodríguez-Artalejo F, Stegmayr B, Thamm M, Tuomilehto J, Vanuzzo D, Vescio F. Hypertension prevalence and blood pressure levels in 6 European countries, Canada, and the United States. JAMA. 2003; 289:2363–69.CrossRefPubMed
23.
go back to reference Persell SD, Baker DW. Studying interventions to prevent the progression from prehypertension to hypertension: does TROPHY win the prize?Am J Hypertens. 2006; 19(11):1095–7.CrossRefPubMed Persell SD, Baker DW. Studying interventions to prevent the progression from prehypertension to hypertension: does TROPHY win the prize?Am J Hypertens. 2006; 19(11):1095–7.CrossRefPubMed
24.
go back to reference Dalgaard P. Introductory Statistics with R, Second edition. New York: Springer; 2008, pp. 155–62.CrossRef Dalgaard P. Introductory Statistics with R, Second edition. New York: Springer; 2008, pp. 155–62.CrossRef
25.
go back to reference Meltzer JI. A Specialist in clinical hypertension critiques the trophy trial. Am J Hypertens. 2006; 19(11):1098–100.CrossRefPubMed Meltzer JI. A Specialist in clinical hypertension critiques the trophy trial. Am J Hypertens. 2006; 19(11):1098–100.CrossRefPubMed
26.
go back to reference Schunkert H. Pharmacotherapy for prehypertension-mission accomplished?N Engl J Med. 2006; 354:1742–4.CrossRefPubMed Schunkert H. Pharmacotherapy for prehypertension-mission accomplished?N Engl J Med. 2006; 354:1742–4.CrossRefPubMed
Metadata
Title
Testing for carryover effects after cessation of treatments: a design approach
Authors
S. Gwynn Sturdevant
Thomas Lumley
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2016
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-016-0191-6

Other articles of this Issue 1/2016

BMC Medical Research Methodology 1/2016 Go to the issue