Skip to main content
Top
Published in: Trials 1/2016

Open Access 01-12-2016 | Methodology

Simple steps to develop trial follow-up procedures

Authors: Ona McCarthy, Rebecca S. French, Ian Roberts, Caroline Free

Published in: Trials | Issue 1/2016

Login to get access

Abstract

Background

Loss to follow-up in randomised controlled trials reduces statistical power and increases the potential for bias. Almost half of all trials fail to achieve their follow-up target. Statistical methods have been described for handling losses to follow-up and systematic reviews have identified interventions that increase follow-up. However, there is little guidance on how to develop practical follow-up procedures. This paper describes the development of follow-up procedures in a pilot randomised controlled trial of a sexual health intervention that required participants to provide and return questionnaires and chlamydia test samples in the post. We identified effective methods to increase follow-up from systematic reviews. We developed and tested prototype procedures to identify barriers to follow-up completion. We asked trial participants about their views on our follow-up procedures and revised the methods accordingly.

Results

We identified 17 strategies to increase follow-up and employed all but five. We found that some postal test kits do not fit through letterboxes and that that the test instructions were complicated. After identifying the appropriate sized test kit and simplifying the instructions, we obtained user opinions. Users wanted kits to be sent in coloured envelopes (so that they could identify them easily), with simple instructions and questionnaires and wanted to be notified before we sent the kits. We achieved 92 % (183/200) overall follow-up for the postal questionnaire at 1 month and 82 % (163/200) at 12 months. We achieved 86 % (171/200) overall follow-up for the postal chlamydia test at 3 months and 80 % (160/200) at 12 months.

Conclusions

By using established methods to increase follow-up, testing prototype procedures and seeking user opinions, we achieved higher follow-up than previous sexual health trials. However, it is not possible to determine if the increase in response was due to our follow-up procedures.

Trial registration

Current Controlled Trials ISRCTN02304709 Date of registration: 27 March 2013.
Appendix
Available only for authorised users
Literature
1.
go back to reference Akl EA, Briel M, You JJ, Sun X, Johnston BC, Busse JW, et al. Potential impact on estimated treatment effects of information lost to follow-up in randomised controlled trials (LOST-IT): systematic review. BMJ (Clinical research ed ). 2012;344:e2809. Akl EA, Briel M, You JJ, Sun X, Johnston BC, Busse JW, et al. Potential impact on estimated treatment effects of information lost to follow-up in randomised controlled trials (LOST-IT): systematic review. BMJ (Clinical research ed ). 2012;344:e2809.
2.
go back to reference Toerien M, Brookes ST, Metcalfe C, de Salis I, Tomlin Z, Peters TJ, et al. A review of reporting of participant recruitment and retention in RCTs in six major journals. Trials. 2009;10:52.CrossRefPubMedPubMedCentral Toerien M, Brookes ST, Metcalfe C, de Salis I, Tomlin Z, Peters TJ, et al. A review of reporting of participant recruitment and retention in RCTs in six major journals. Trials. 2009;10:52.CrossRefPubMedPubMedCentral
3.
go back to reference Erens B, Phelps A, Clifton S, et al. The third National Survey of Sexual Attitudes and Lifestyles (Natsal-3): technical report. 2013. Erens B, Phelps A, Clifton S, et al. The third National Survey of Sexual Attitudes and Lifestyles (Natsal-3): technical report. 2013.
4.
go back to reference Macleod J, Salisbury C, Low N, McCarthy A, Sterne JA, Holloway A, et al. Coverage and uptake of systematic postal screening for genital Chlamydia trachomatis and prevalence of infection in the United Kingdom general population: cross sectional study. BMJ. 2005;330(7497):940.CrossRefPubMedPubMedCentral Macleod J, Salisbury C, Low N, McCarthy A, Sterne JA, Holloway A, et al. Coverage and uptake of systematic postal screening for genital Chlamydia trachomatis and prevalence of infection in the United Kingdom general population: cross sectional study. BMJ. 2005;330(7497):940.CrossRefPubMedPubMedCentral
5.
go back to reference Low N, McCarthy A, Macleod J, Salisbury C, Horner PJ, Roberts TE, et al. The chlamydia screening studies: rationale and design. Sex Transm Infect. 2004;80(5):342–8.CrossRefPubMedPubMedCentral Low N, McCarthy A, Macleod J, Salisbury C, Horner PJ, Roberts TE, et al. The chlamydia screening studies: rationale and design. Sex Transm Infect. 2004;80(5):342–8.CrossRefPubMedPubMedCentral
6.
go back to reference Bailey JV, Pavlou M, Copas A, McCarthy O, Carswell K, Rait G, et al. The Sexunzipped trial: optimizing the design of online randomized controlled trials. J Med Internet Res. 2013;15(12):e278.CrossRefPubMedPubMedCentral Bailey JV, Pavlou M, Copas A, McCarthy O, Carswell K, Rait G, et al. The Sexunzipped trial: optimizing the design of online randomized controlled trials. J Med Internet Res. 2013;15(12):e278.CrossRefPubMedPubMedCentral
7.
go back to reference Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, et al. Methods to increase response rates to postal questionnaires. Cochrane Database Syst Rev. 2009;2:MR000008. Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, et al. Methods to increase response rates to postal questionnaires. Cochrane Database Syst Rev. 2009;2:MR000008.
8.
go back to reference Brueton VC, Tierney J, Stenning S, Harding S, Meredith S, Nazareth I, et al. Strategies to improve retention in randomised trials. Cochrane Database Syst Rev. 2013;12:Mr000032.PubMed Brueton VC, Tierney J, Stenning S, Harding S, Meredith S, Nazareth I, et al. Strategies to improve retention in randomised trials. Cochrane Database Syst Rev. 2013;12:Mr000032.PubMed
9.
go back to reference Nakash RA, Hutton JL, Jorstad-Stein EC, Gates S, Lamb SE. Maximising response to postal questionnaires – a systematic review of randomised trials in health research. BMC Med Res Methodol. 2006;6:5.CrossRefPubMedPubMedCentral Nakash RA, Hutton JL, Jorstad-Stein EC, Gates S, Lamb SE. Maximising response to postal questionnaires – a systematic review of randomised trials in health research. BMC Med Res Methodol. 2006;6:5.CrossRefPubMedPubMedCentral
11.
go back to reference Edwards P, Roberts I, Sandercock P, Frost C. Follow-up by mail in clinical trials: does questionnaire length matter? Control Clin Trials. 2004;25(1):31–52.CrossRefPubMed Edwards P, Roberts I, Sandercock P, Frost C. Follow-up by mail in clinical trials: does questionnaire length matter? Control Clin Trials. 2004;25(1):31–52.CrossRefPubMed
12.
go back to reference Edwards P, Cooper R, Roberts I, Frost C. Meta-analysis of randomised trials of monetary incentives and response to mailed questionnaires. J Epidemiol Community Health. 2005;59(11):987–99.CrossRefPubMedPubMedCentral Edwards P, Cooper R, Roberts I, Frost C. Meta-analysis of randomised trials of monetary incentives and response to mailed questionnaires. J Epidemiol Community Health. 2005;59(11):987–99.CrossRefPubMedPubMedCentral
13.
go back to reference Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.CrossRefPubMed Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.CrossRefPubMed
14.
go back to reference Free C, McCarthy O, French R, Wellings K, Michie S, Rathod S, et al. Can text messages increase safer sex behaviours in young people: intervention development and pilot randomised controlled trial. Health Technology Assessment 2015 (in press). Free C, McCarthy O, French R, Wellings K, Michie S, Rathod S, et al. Can text messages increase safer sex behaviours in young people: intervention development and pilot randomised controlled trial. Health Technology Assessment 2015 (in press).
15.
go back to reference French R, McCarthy O, Bataitser P, Wellings K, Bailey J, Free C. Young people’s views and experiences of a mobile phone texting intervention to promote safer sex behaviour. Journal of Medical Internet Research (in press). French R, McCarthy O, Bataitser P, Wellings K, Bailey J, Free C. Young people’s views and experiences of a mobile phone texting intervention to promote safer sex behaviour. Journal of Medical Internet Research (in press).
16.
go back to reference Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, et al. Increasing response rates to postal questionnaires: systematic review. BMJ. 2002;324(7347):1183.CrossRefPubMedPubMedCentral Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, et al. Increasing response rates to postal questionnaires: systematic review. BMJ. 2002;324(7347):1183.CrossRefPubMedPubMedCentral
17.
go back to reference Free C, Knight R, Robertson S, Whittaker R, Edwards P, Zhou W, et al. Smoking cessation support delivered via mobile phone text messaging (txt2stop): a single-blind, randomised trial. Lancet. 2011;378(9785):49–55.CrossRefPubMedPubMedCentral Free C, Knight R, Robertson S, Whittaker R, Edwards P, Zhou W, et al. Smoking cessation support delivered via mobile phone text messaging (txt2stop): a single-blind, randomised trial. Lancet. 2011;378(9785):49–55.CrossRefPubMedPubMedCentral
18.
go back to reference Low N, McCarthy A, Macleod J, Salisbury C, Campbell R, Roberts TE, et al. Epidemiological, social, diagnostic and economic evaluation of population screening for genital chlamydial infection. Health technology assessment (Winchester, England). 2007;11(8):iii–iv–x–xii. 1–165. Low N, McCarthy A, Macleod J, Salisbury C, Campbell R, Roberts TE, et al. Epidemiological, social, diagnostic and economic evaluation of population screening for genital chlamydial infection. Health technology assessment (Winchester, England). 2007;11(8):iii–iv–x–xii. 1–165.
19.
go back to reference Free C, Whittaker R, Knight R, Abramsky T, Rodgers A, Roberts IG. Txt2stop: a pilot randomised controlled trial of mobile phone-based smoking cessation support. Tob Control. 2009;18(2):88–91.CrossRefPubMed Free C, Whittaker R, Knight R, Abramsky T, Rodgers A, Roberts IG. Txt2stop: a pilot randomised controlled trial of mobile phone-based smoking cessation support. Tob Control. 2009;18(2):88–91.CrossRefPubMed
20.
go back to reference Rodgers A, Corbett T, Bramley D, Riddell T, Wills M, Lin RB, et al. Do u smoke after txt? Results of a randomised trial of smoking cessation using mobile phone text messaging. Tob Control. 2005;14(4):255–61.CrossRefPubMedPubMedCentral Rodgers A, Corbett T, Bramley D, Riddell T, Wills M, Lin RB, et al. Do u smoke after txt? Results of a randomised trial of smoking cessation using mobile phone text messaging. Tob Control. 2005;14(4):255–61.CrossRefPubMedPubMedCentral
21.
go back to reference Akl EA, Carrasco-Labra A, Brignardello-Petersen R, Neumann I, Johnston BC, Sun X, et al. Reporting, handling and assessing the risk of bias associated with missing participant data in systematic reviews: a methodological survey. BMJ open. 2015;5(9):e009368.CrossRefPubMedPubMedCentral Akl EA, Carrasco-Labra A, Brignardello-Petersen R, Neumann I, Johnston BC, Sun X, et al. Reporting, handling and assessing the risk of bias associated with missing participant data in systematic reviews: a methodological survey. BMJ open. 2015;5(9):e009368.CrossRefPubMedPubMedCentral
Metadata
Title
Simple steps to develop trial follow-up procedures
Authors
Ona McCarthy
Rebecca S. French
Ian Roberts
Caroline Free
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Trials / Issue 1/2016
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-016-1155-1

Other articles of this Issue 1/2016

Trials 1/2016 Go to the issue