Skip to main content
Top
Published in: EJNMMI Research 1/2017

Open Access 01-12-2017 | Short communication

Group-sequential analysis may allow for early trial termination: illustration by an intra-observer repeatability study

Authors: Oke Gerke, Mie H. Vilstrup, Ulrich Halekoh, Malene Grubbe Hildebrandt, Poul Flemming Høilund-Carlsen

Published in: EJNMMI Research | Issue 1/2017

Login to get access

Abstract

Background

Group-sequential testing is widely used in pivotal therapeutic, but rarely in diagnostic research, although it may save studies, time, and costs. The purpose of this paper was to demonstrate a group-sequential analysis strategy in an intra-observer study on quantitative FDG-PET/CT measurements, illuminating the possibility of early trial termination which implicates significant potential time and resource savings.

Methods

Primary lesion maximum standardised uptake value (SUVmax) was determined twice from preoperative FDG-PET/CTs in 45 ovarian cancer patients. Differences in SUVmax were assumed to be normally distributed, and sequential one-sided hypothesis tests on the population standard deviation of the differences against a hypothesised value of 1.5 were performed, employing an alpha spending function. The fixed-sample analysis (N = 45) was compared with the group-sequential analysis strategies comprising one (at N = 23), two (at N = 15, 30), or three interim analyses (at N = 11, 23, 34), respectively, which were defined post hoc.

Results

When performing interim analyses with one third and two thirds of patients, sufficient agreement could be concluded after the first interim analysis and the final analysis. Other partitions did not suggest early stopping after adjustment for multiple testing due to one influential outlier and our small sample size.

Conclusions

Group-sequential testing may enable early stopping of a trial, allowing for potential time and resource savings. The testing strategy must, though, be defined at the planning stage, and sample sizes must be reasonably large at interim analysis to ensure robustness against single outliers. Group-sequential testing may have a place in accuracy and agreement studies.
Appendix
Available only for authorised users
Literature
1.
go back to reference Whitehead J. The design and analysis of sequential clinical trials. 2nd ed. Chichester: Wiley; 1997. Whitehead J. The design and analysis of sequential clinical trials. 2nd ed. Chichester: Wiley; 1997.
2.
go back to reference Moyé LA. Statistical monitoring of clinical trials: fundamentals for investigators. New York: Springer; 2006. Moyé LA. Statistical monitoring of clinical trials: fundamentals for investigators. New York: Springer; 2006.
3.
go back to reference Kottner J, Audigé L, Brorson S, Donner A, Gajewski BJ, Hróbjartsson A, et al. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64:96–106.CrossRefPubMed Kottner J, Audigé L, Brorson S, Donner A, Gajewski BJ, Hróbjartsson A, et al. Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. J Clin Epidemiol. 2011;64:96–106.CrossRefPubMed
4.
go back to reference Zaki R, Bulgiba A, Ismail R, Ismail NA. Statistical methods used to test for agreement of medical instruments measuring continuous variables in method comparison studies: a systematic review. PLoS One. 2012;7(5):e37908.CrossRefPubMedPubMedCentral Zaki R, Bulgiba A, Ismail R, Ismail NA. Statistical methods used to test for agreement of medical instruments measuring continuous variables in method comparison studies: a systematic review. PLoS One. 2012;7(5):e37908.CrossRefPubMedPubMedCentral
5.
go back to reference Altman DG, Bland JM. Measurement in medicine: the analysis of method comparison studies. J Roy Stat Soc D-Sta. 1983;32:307–17. Altman DG, Bland JM. Measurement in medicine: the analysis of method comparison studies. J Roy Stat Soc D-Sta. 1983;32:307–17.
6.
go back to reference Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.CrossRefPubMed Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1(8476):307–10.CrossRefPubMed
7.
go back to reference Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8(2):135–60.CrossRefPubMed Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8(2):135–60.CrossRefPubMed
8.
go back to reference Bowerman BL, O’Connell RT, Murphree ES. Business statistics in practice. 8th ed. New York: McGraw-Hill; 2016. Bowerman BL, O’Connell RT, Murphree ES. Business statistics in practice. 8th ed. New York: McGraw-Hill; 2016.
9.
go back to reference Rosner B. Fundamentals of biostatistics. 8th ed. Boston: Cengage Learning; 2015. Rosner B. Fundamentals of biostatistics. 8th ed. Boston: Cengage Learning; 2015.
10.
go back to reference Kim K, DeMets DL. Design and analysis of group sequential tests based on the type I error spending function. Biometrika. 1987;74:149–54.CrossRef Kim K, DeMets DL. Design and analysis of group sequential tests based on the type I error spending function. Biometrika. 1987;74:149–54.CrossRef
11.
go back to reference Gerke O, Vilstrup MH, Segtnan EA, Halekoh U, Høilund-Carlsen PF. How to assess intra- and inter-observer agreement with quantitative PET using variance component analysis: a proposal for standardisation. BMC Med Imaging. 2016;16:54.CrossRefPubMedPubMedCentral Gerke O, Vilstrup MH, Segtnan EA, Halekoh U, Høilund-Carlsen PF. How to assess intra- and inter-observer agreement with quantitative PET using variance component analysis: a proposal for standardisation. BMC Med Imaging. 2016;16:54.CrossRefPubMedPubMedCentral
12.
go back to reference O'Brien PC, Fleming TR. A multiple testing procedure for clinical trials. Biometrics. 1979;35:549–56.CrossRefPubMed O'Brien PC, Fleming TR. A multiple testing procedure for clinical trials. Biometrics. 1979;35:549–56.CrossRefPubMed
13.
go back to reference Lan GKK, DeMets DL. Discrete sequential boundaries for clinical trials. Biometrika. 1983;70:659–63.CrossRef Lan GKK, DeMets DL. Discrete sequential boundaries for clinical trials. Biometrika. 1983;70:659–63.CrossRef
14.
go back to reference Chow SC, Chang M. Adaptive design methods in clinical trials. 2nd ed. Boca Raton: Chapman & Hall/CRC Press; 2012. Chow SC, Chang M. Adaptive design methods in clinical trials. 2nd ed. Boca Raton: Chapman & Hall/CRC Press; 2012.
15.
go back to reference Wassmer G, Brannath W. Group sequential and confirmatory adaptive designs in clinical trials. New York: Springer; 2016.CrossRef Wassmer G, Brannath W. Group sequential and confirmatory adaptive designs in clinical trials. New York: Springer; 2016.CrossRef
16.
go back to reference Dmitrienko A, Tamhane AC, Bretz F, editors. Multiple testing problems in pharmaceutical statistics. Boca Raton: Chapman & Hall/CRC Press; 2010. Dmitrienko A, Tamhane AC, Bretz F, editors. Multiple testing problems in pharmaceutical statistics. Boca Raton: Chapman & Hall/CRC Press; 2010.
17.
go back to reference Hildebrandt MG, Gerke O, Baun C, Falch K, Hansen JA, Farahani ZA, et al. [18F] Fluorodeoxyglucose (FDG)-positron emission tomography (PET)/computed tomography (CT) in suspected recurrent breast cancer: a prospective comparative study of dual-time-point FDG-PET/CT, contrast-enhanced CT, and bone scintigraphy. J Clin Oncol. 2016;34(16):1889–97.CrossRefPubMed Hildebrandt MG, Gerke O, Baun C, Falch K, Hansen JA, Farahani ZA, et al. [18F] Fluorodeoxyglucose (FDG)-positron emission tomography (PET)/computed tomography (CT) in suspected recurrent breast cancer: a prospective comparative study of dual-time-point FDG-PET/CT, contrast-enhanced CT, and bone scintigraphy. J Clin Oncol. 2016;34(16):1889–97.CrossRefPubMed
Metadata
Title
Group-sequential analysis may allow for early trial termination: illustration by an intra-observer repeatability study
Authors
Oke Gerke
Mie H. Vilstrup
Ulrich Halekoh
Malene Grubbe Hildebrandt
Poul Flemming Høilund-Carlsen
Publication date
01-12-2017
Publisher
Springer Berlin Heidelberg
Published in
EJNMMI Research / Issue 1/2017
Electronic ISSN: 2191-219X
DOI
https://doi.org/10.1186/s13550-017-0328-6

Other articles of this Issue 1/2017

EJNMMI Research 1/2017 Go to the issue