Skip to main content
Top
Published in: Trials 1/2016

Open Access 01-12-2016 | Research

Increasing follow-up questionnaire response rates in a randomized controlled trial of telehealth for depression: three embedded controlled studies

Authors: Louisa Edwards, Chris Salisbury, Kimberley Horspool, Alexis Foster, Katy Garner, Alan A. Montgomery

Published in: Trials | Issue 1/2016

Login to get access

Abstract

Background

Attrition is problematic in trials, and may be exacerbated in longer studies, telehealth trials and participants with depression – three features of The Healthlines Study. Advance notification, including a photograph and using action-oriented email subject lines might increase response rates, but require further investigation. We examined the effectiveness of these interventions in three embedded Healthlines studies.

Methods

Based in different trial sites, participants with depression were alternately allocated to be pre-called or not ahead of the 8-month follow-up questionnaire (Study 1), randomized to receive a research team photograph or not with their 12-month questionnaire (Study 2), and randomized to receive an action-oriented (‘ACTION REQUIRED’) or standard (‘Questionnaire reminder’) 12-month email reminder (Study 3). Participants could complete online or postal questionnaires, and received up to five questionnaire reminders. The primary outcome was completion of the Patient Health Questionnaire (PHQ-9). Secondary outcome measures were the number of reminders and time to questionnaire completion.

Results

Of a total of 609 Healthlines depression participants, 190, 251 and 231 participants were included in Studies 1–3 (intervention: 95, 126 and 115), respectively. Outcome completion was ≥90 % across studies, with no differences between trial arms (Study 1: OR 0.38, 95 % CI 0.07–2.10; Study 2: OR 0.84, 95 % CI 0.26–2.66; Study 3: OR 0.53 95 % CI 0.19–1.49). Pre-called participants were less likely to require a reminder (48.4 % vs 62.1 %, OR 0.41, 95 % CI 0.21–0.78), required fewer reminders (adjusted difference in means −0.67, 95 % CI −1.13 to −0.20), and completed follow-up quicker (median 8 vs 15 days, HR 1.35, 95 % CI 1.00–1.82) than control subjects. There were no significant between-group differences in Studies 2 or 3.

Conclusions

Eventual response rates in this trial were high, with no further improvement from these interventions. While the photograph and email interventions were ineffective, pre-calling participants reduced time to completion. This strategy might be helpful when the timing of study completion is important. Researchers perceived a substantial benefit from the reduction in reminders with pre-calling, despite no overall decrease in net effort after accounting for pre-notification.

Trial registration

Current Clinical Trials ISRCTN14172341
Appendix
Available only for authorised users
Literature
1.
go back to reference Thomas C, Man M, O’Cathain A, Hollinghurst S, Large S, Edwards L, et al. Effectiveness and cost-effectiveness of a telehealth intervention to support the management of long-term conditions: study protocol for two linked randomized controlled trials. Trials. 2014;15:36. doi:10.1186/1745-6215-15-36.PubMedCentralCrossRefPubMed Thomas C, Man M, O’Cathain A, Hollinghurst S, Large S, Edwards L, et al. Effectiveness and cost-effectiveness of a telehealth intervention to support the management of long-term conditions: study protocol for two linked randomized controlled trials. Trials. 2014;15:36. doi:10.​1186/​1745-6215-15-36.PubMedCentralCrossRefPubMed
6.
go back to reference Proudfoot J, Clarke J, Birch M, Whitton A, Parker G, Manicavasagar V, et al. Impact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial. BMC Psychiatry. 2013;13:312. doi:10.1186/1471-244X-13-312.PubMedCentralCrossRefPubMed Proudfoot J, Clarke J, Birch M, Whitton A, Parker G, Manicavasagar V, et al. Impact of a mobile phone and web program on symptom and functional outcomes for people with mild-to-moderate depression, anxiety and stress: a randomised controlled trial. BMC Psychiatry. 2013;13:312. doi:10.​1186/​1471-244X-13-312.PubMedCentralCrossRefPubMed
8.
go back to reference Schulz K, Grimes D. Sample size slippages in randomised trials: exclusions and the lost and wayward. Lancet. 2002;359(9308):781–5.CrossRefPubMed Schulz K, Grimes D. Sample size slippages in randomised trials: exclusions and the lost and wayward. Lancet. 2002;359(9308):781–5.CrossRefPubMed
13.
go back to reference Gueguen N, Legoherel P, Jacob C. Sollicitation de participation à une enquête par courriel: effet de la présence sociale et de l’attrait physique du demandeur sur le taux de réponse. Can J Behav Sci. 2003;35(2):84–96. doi:10.1037/h0087191.CrossRef Gueguen N, Legoherel P, Jacob C. Sollicitation de participation à une enquête par courriel: effet de la présence sociale et de l’attrait physique du demandeur sur le taux de réponse. Can J Behav Sci. 2003;35(2):84–96. doi:10.​1037/​h0087191.CrossRef
15.
go back to reference Gendall P. The effect of questionnaire cover design in mail surveys. Mark Bull. 1996;7:30–8. Gendall P. The effect of questionnaire cover design in mail surveys. Mark Bull. 1996;7:30–8.
16.
17.
go back to reference Dommeyer C, Ruggiero L. The effects of a photograph on mail survey response. Mark Bull. 1996;7:51–7. Dommeyer C, Ruggiero L. The effects of a photograph on mail survey response. Mark Bull. 1996;7:51–7.
19.
go back to reference Tuten T. Getting a foot in the electronic door: understanding why people read or delete electronic mail. ZUMA-Arbeitsbericht Nr. 97/08. Mannheim: ZUMA; 1997. Tuten T. Getting a foot in the electronic door: understanding why people read or delete electronic mail. ZUMA-Arbeitsbericht Nr. 97/08. Mannheim: ZUMA; 1997.
20.
go back to reference Porter S, Whitcomb M. E-mail subject lines and their effect on web survey viewing and response. Soc Sci Comput Rev. 2005;23:280–7.CrossRef Porter S, Whitcomb M. E-mail subject lines and their effect on web survey viewing and response. Soc Sci Comput Rev. 2005;23:280–7.CrossRef
21.
go back to reference Lewis G, Pelosi AJ, Araya R, Dunn G. Measuring psychiatric disorder in the community: a standardized assessment for use by lay interviewers. Psychol Med. 1992;22(2):465–86.CrossRefPubMed Lewis G, Pelosi AJ, Araya R, Dunn G. Measuring psychiatric disorder in the community: a standardized assessment for use by lay interviewers. Psychol Med. 1992;22(2):465–86.CrossRefPubMed
22.
go back to reference Sutherland H, Beaton M, Mazer R, Kriukov V, Boyd N. A randomized trial of the total design method for the postal follow-up of women in a cancer prevention trial. Eur J Cancer Prev. 1996;5(3):165–8.CrossRefPubMed Sutherland H, Beaton M, Mazer R, Kriukov V, Boyd N. A randomized trial of the total design method for the postal follow-up of women in a cancer prevention trial. Eur J Cancer Prev. 1996;5(3):165–8.CrossRefPubMed
24.
go back to reference Hindmarch P, Hawkins A, McColl E, Hayes M, Majsak-Newman G, Ablewhite J, et al. Recruitment and retention strategies and the examination of attrition bias in a randomised controlled trial in children’s centres serving families in disadvantaged areas of England. Trials. 2015;16:79. doi:10.1186/s13063-015-0578-4.PubMedCentralCrossRefPubMed Hindmarch P, Hawkins A, McColl E, Hayes M, Majsak-Newman G, Ablewhite J, et al. Recruitment and retention strategies and the examination of attrition bias in a randomised controlled trial in children’s centres serving families in disadvantaged areas of England. Trials. 2015;16:79. doi:10.​1186/​s13063-015-0578-4.PubMedCentralCrossRefPubMed
25.
go back to reference MacLennan G, McDonald A, McPherson G, Treweek S, Avenell A, RECORD Trial Group. Advance telephone calls ahead of reminder questionnaires increase response rate in non-responders compared to questionnaire reminders only: the RECORD phone trial. Trials. 2014;15:13. doi:10.1186/1745-6215-15-13.PubMedCentralCrossRefPubMed MacLennan G, McDonald A, McPherson G, Treweek S, Avenell A, RECORD Trial Group. Advance telephone calls ahead of reminder questionnaires increase response rate in non-responders compared to questionnaire reminders only: the RECORD phone trial. Trials. 2014;15:13. doi:10.​1186/​1745-6215-15-13.PubMedCentralCrossRefPubMed
Metadata
Title
Increasing follow-up questionnaire response rates in a randomized controlled trial of telehealth for depression: three embedded controlled studies
Authors
Louisa Edwards
Chris Salisbury
Kimberley Horspool
Alexis Foster
Katy Garner
Alan A. Montgomery
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Trials / Issue 1/2016
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-016-1234-3

Other articles of this Issue 1/2016

Trials 1/2016 Go to the issue