Skip to main content
Top
Published in: Trials 1/2019

Open Access 01-12-2019 | Review

Designing and using incentives to support recruitment and retention in clinical trials: a scoping review and a checklist for design

Authors: Beth Parkinson, Rachel Meacock, Matt Sutton, Eleonora Fichera, Nicola Mills, Gillian W. Shorter, Shaun Treweek, Nicola L Harman, Rebecca C. H. Brown, Katie Gillies, Peter Bower

Published in: Trials | Issue 1/2019

Login to get access

Abstract

Background

Recruitment and retention of participants are both critical for the success of trials, yet both remain significant problems. The use of incentives to target participants and trial staff has been proposed as one solution. The effects of incentives are complex and depend upon how they are designed, but these complexities are often overlooked. In this paper, we used a scoping review to ‘map’ the literature, with two aims: to develop a checklist on the design and use of incentives to support recruitment and retention in trials; and to identify key research topics for the future.

Methods

The scoping review drew on the existing economic theory of incentives and a structured review of the literature on the use of incentives in three healthcare settings: trials, pay for performance, and health behaviour change. We identified the design issues that need to be considered when introducing an incentive scheme to improve recruitment and retention in trials. We then reviewed both the theoretical and empirical evidence relating to each of these design issues. We synthesised the findings into a checklist to guide the design of interventions using incentives.

Results

The issues to consider when designing an incentive system were summarised into an eight-question checklist. The checklist covers: the current incentives and barriers operating in the system; who the incentive should be directed towards; what the incentive should be linked to; the form of incentive; the incentive size; the structure of the incentive system; the timing and frequency of incentive payouts; and the potential unintended consequences. We concluded the section on each design aspect by highlighting the gaps in the current evidence base.

Conclusions

Our findings highlight how complex the design of incentive systems can be, and how crucial each design choice is to overall effectiveness. The most appropriate design choice will differ according to context, and we have aimed to provide context-specific advice. Whilst all design issues warrant further research, evidence is most needed on incentives directed at recruiters, optimal incentive size, and testing of different incentive structures, particularly exploring repeat arrangements with recruiters.
Appendix
Available only for authorised users
Literature
1.
go back to reference Sully BGO, Julious SA, Nicholl J. A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agencies. Trials. 2013;14:166.PubMedPubMedCentralCrossRef Sully BGO, Julious SA, Nicholl J. A reinvestigation of recruitment to randomised, controlled, multicenter trials: a review of trials funded by two UK funding agencies. Trials. 2013;14:166.PubMedPubMedCentralCrossRef
2.
go back to reference Walters SJ, dos Henriques-Cadby IB A, Bortolami O, Flight L, Hind D, Jacques RM, et al. Recruitment and retention of participants in randomised controlled trials: a review of trials funded and published by the United Kingdom Health Technology Assessment Programme. BMJ Open. 2017;7(3):e015276.PubMedPubMedCentralCrossRef Walters SJ, dos Henriques-Cadby IB A, Bortolami O, Flight L, Hind D, Jacques RM, et al. Recruitment and retention of participants in randomised controlled trials: a review of trials funded and published by the United Kingdom Health Technology Assessment Programme. BMJ Open. 2017;7(3):e015276.PubMedPubMedCentralCrossRef
3.
go back to reference McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7:9.PubMedPubMedCentralCrossRef McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7:9.PubMedPubMedCentralCrossRef
4.
go back to reference Brueton V, Tierney J, Stenning S, Meredith S, Harding S, Nazareth I, et al. Strategies to improve retention in randomised trials: a Cochrane systematic review and meta-analysis. BMJ Open. 2014;4:e003821.PubMedPubMedCentralCrossRef Brueton V, Tierney J, Stenning S, Meredith S, Harding S, Nazareth I, et al. Strategies to improve retention in randomised trials: a Cochrane systematic review and meta-analysis. BMJ Open. 2014;4:e003821.PubMedPubMedCentralCrossRef
6.
go back to reference Bower P, Brueton V, Gamble C, Treweek S, Smith CT, Young B, et al. Interventions to improve recruitment and retention in clinical trials: a survey and workshop to assess current practice and future priorities. Trials. 2014;15:399.PubMedPubMedCentralCrossRef Bower P, Brueton V, Gamble C, Treweek S, Smith CT, Young B, et al. Interventions to improve recruitment and retention in clinical trials: a survey and workshop to assess current practice and future priorities. Trials. 2014;15:399.PubMedPubMedCentralCrossRef
8.
go back to reference Gneezy U, Meier S, Rey-Biel P. When and why incentives (don’t) work to modify behavior. J Econ Perspect. 2011;25(4):191–210.CrossRef Gneezy U, Meier S, Rey-Biel P. When and why incentives (don’t) work to modify behavior. J Econ Perspect. 2011;25(4):191–210.CrossRef
10.
go back to reference Davis K, Drey N, Gould D. What are scoping studies? A review of the nursing literature. Int J Nurs Stud. 2009;46(10):1386–400.PubMedCrossRef Davis K, Drey N, Gould D. What are scoping studies? A review of the nursing literature. Int J Nurs Stud. 2009;46(10):1386–400.PubMedCrossRef
13.
go back to reference NHS Health Research Authority. HRA ethics guidance: payments and incentives in research. London: Health Research Authority; 2014. NHS Health Research Authority. HRA ethics guidance: payments and incentives in research. London: Health Research Authority; 2014.
14.
go back to reference Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review — a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10(1_suppl):21–34.PubMedCrossRef Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review — a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10(1_suppl):21–34.PubMedCrossRef
15.
go back to reference Grossman SJ, Hart OD. An analysis of the principal–agent problem. Econometrica. 1983;51(1):7–45.CrossRef Grossman SJ, Hart OD. An analysis of the principal–agent problem. Econometrica. 1983;51(1):7–45.CrossRef
16.
go back to reference Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R. Barriers to participation in randomised controlled trials: a systematic review. J Clin Epidemiol. 1999;52(12):1143–56.PubMedCrossRef Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R. Barriers to participation in randomised controlled trials: a systematic review. J Clin Epidemiol. 1999;52(12):1143–56.PubMedCrossRef
17.
go back to reference Loewenstein G, Brennan T, Volpp KG. Asymmetric paternalism to improve health behaviors. JAMA. 2007;298(20):2415–7.PubMedCrossRef Loewenstein G, Brennan T, Volpp KG. Asymmetric paternalism to improve health behaviors. JAMA. 2007;298(20):2415–7.PubMedCrossRef
18.
go back to reference Giuffrida A, Gravelle H. Paying patients to comply: an economic analysis. Health Econ. 1998;7(7):569–79.PubMedCrossRef Giuffrida A, Gravelle H. Paying patients to comply: an economic analysis. Health Econ. 1998;7(7):569–79.PubMedCrossRef
19.
21.
go back to reference Landon BE, Normand S-LT, Blumenthal D, Daley J. Physician clinical performance assessment: prospects and barriers. JAMA. 2003;290(9):1183–9.PubMedCrossRef Landon BE, Normand S-LT, Blumenthal D, Daley J. Physician clinical performance assessment: prospects and barriers. JAMA. 2003;290(9):1183–9.PubMedCrossRef
22.
go back to reference Fichera E, Nikolova S, Sutton M. Comparative performance evaluation: quality. In: Encyclopedia of health economics. San Diego: Elsevier; 2014. Fichera E, Nikolova S, Sutton M. Comparative performance evaluation: quality. In: Encyclopedia of health economics. San Diego: Elsevier; 2014.
23.
go back to reference Burgess S, Ratto M. The role of incentives in the public sector: issues and evidence. Oxf Rev Econ Policy. 2003;19(2):285–300.CrossRef Burgess S, Ratto M. The role of incentives in the public sector: issues and evidence. Oxf Rev Econ Policy. 2003;19(2):285–300.CrossRef
26.
go back to reference Conrad D, Perry L. Quality-based financial incentives in health care: can we improve quality by paying for it? Annu Rev Public Health. 2009;30:357–71.PubMedCrossRef Conrad D, Perry L. Quality-based financial incentives in health care: can we improve quality by paying for it? Annu Rev Public Health. 2009;30:357–71.PubMedCrossRef
27.
go back to reference Van Herck P, De Smedt D, Annemans L, Remmen R, Rosenthal MB, Sermeus W. Systematic review: Effects, design choices, and context of pay-for-performance in health care. BMC Health Serv Res. 2010;10:247.PubMedPubMedCentralCrossRef Van Herck P, De Smedt D, Annemans L, Remmen R, Rosenthal MB, Sermeus W. Systematic review: Effects, design choices, and context of pay-for-performance in health care. BMC Health Serv Res. 2010;10:247.PubMedPubMedCentralCrossRef
28.
29.
go back to reference Young GJ, Conrad DA. Practical issues in the design and implementation of pay-for-quality programs. J Healthc Manag Am Coll Healthc Exec. 2007;52(1):10–8 discussion 18-19. Young GJ, Conrad DA. Practical issues in the design and implementation of pay-for-quality programs. J Healthc Manag Am Coll Healthc Exec. 2007;52(1):10–8 discussion 18-19.
30.
go back to reference Holmstrom B, Milgrom P. Multitask principal–agent analyses: incentive contracts, asset ownership, and job design. J Law Econ Organ. 1991;7:24.CrossRef Holmstrom B, Milgrom P. Multitask principal–agent analyses: incentive contracts, asset ownership, and job design. J Law Econ Organ. 1991;7:24.CrossRef
31.
go back to reference Kaarboe O, Siciliani L. Multi-tasking, quality and pay for performance. Health Econ. 2011;20(2):225–38.PubMedCrossRef Kaarboe O, Siciliani L. Multi-tasking, quality and pay for performance. Health Econ. 2011;20(2):225–38.PubMedCrossRef
32.
go back to reference Mehrotra A, Sorbero MES, Damberg CL. Using the lessons of behavioral economics to design more effective pay-for-performance programs. Am J Manag Care. 2010;16(7):497–503.PubMedPubMedCentral Mehrotra A, Sorbero MES, Damberg CL. Using the lessons of behavioral economics to design more effective pay-for-performance programs. Am J Manag Care. 2010;16(7):497–503.PubMedPubMedCentral
33.
go back to reference Ogundeji YK, Bland JM, Sheldon TA. The effectiveness of payment for performance in health care: a meta-analysis and exploration of variation in outcomes. Health Policy. 2016;120(10):1141–50.PubMedCrossRef Ogundeji YK, Bland JM, Sheldon TA. The effectiveness of payment for performance in health care: a meta-analysis and exploration of variation in outcomes. Health Policy. 2016;120(10):1141–50.PubMedCrossRef
34.
go back to reference Cahill K, Hartmann-Boyce J, Perera R. Incentives for smoking cessation. Cochrane Database Syst Rev. 2015;5:CD004307. Cahill K, Hartmann-Boyce J, Perera R. Incentives for smoking cessation. Cochrane Database Syst Rev. 2015;5:CD004307.
35.
go back to reference Paul-Ebhohimhen V, Avenell A. Systematic review of the use of financial incentives in treatments for obesity and overweight. Obes Rev Off J Int Assoc Study Obes. 2008;9(4):355–67.CrossRef Paul-Ebhohimhen V, Avenell A. Systematic review of the use of financial incentives in treatments for obesity and overweight. Obes Rev Off J Int Assoc Study Obes. 2008;9(4):355–67.CrossRef
36.
go back to reference Gneezy U, Rustichini A. Pay enough or don’t pay at all. Q J Econ. 2000;115(3):791–810.CrossRef Gneezy U, Rustichini A. Pay enough or don’t pay at all. Q J Econ. 2000;115(3):791–810.CrossRef
37.
go back to reference Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009;3:MR000008. Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009;3:MR000008.
38.
go back to reference David MC, Ware RS. Meta-analysis of randomized controlled trials supports the use of incentives for inducing response to electronic health surveys. J Clin Epidemiol. 2014;67(11):1210–21.PubMedCrossRef David MC, Ware RS. Meta-analysis of randomized controlled trials supports the use of incentives for inducing response to electronic health surveys. J Clin Epidemiol. 2014;67(11):1210–21.PubMedCrossRef
39.
go back to reference Eijkenaar F, Emmert M, Scheppach M, Schöffski O. Effects of pay for performance in health care: a systematic review of systematic reviews. Health Policy. 2013;110(2–3):115–30.PubMedCrossRef Eijkenaar F, Emmert M, Scheppach M, Schöffski O. Effects of pay for performance in health care: a systematic review of systematic reviews. Health Policy. 2013;110(2–3):115–30.PubMedCrossRef
42.
go back to reference Jennings CG, MacDonald TM, Wei L, Brown MJ, McConnachie L, Mackenzie IS. Does offering an incentive payment improve recruitment to clinical trials and increase the proportion of socially deprived and elderly participants? Trials. 2015;16:80.PubMedPubMedCentralCrossRef Jennings CG, MacDonald TM, Wei L, Brown MJ, McConnachie L, Mackenzie IS. Does offering an incentive payment improve recruitment to clinical trials and increase the proportion of socially deprived and elderly participants? Trials. 2015;16:80.PubMedPubMedCentralCrossRef
43.
go back to reference Giles EL, Robalino S, McColl E, Sniehotta FF, Adams J. The effectiveness of financial incentives for health behaviour change: systematic review and meta-analysis. PLoS One. 2014;9(3):e90347.PubMedPubMedCentralCrossRef Giles EL, Robalino S, McColl E, Sniehotta FF, Adams J. The effectiveness of financial incentives for health behaviour change: systematic review and meta-analysis. PLoS One. 2014;9(3):e90347.PubMedPubMedCentralCrossRef
44.
go back to reference Mantzari E, Vogt F, Shemilt I, Wei Y, Higgins JPT, Marteau TM. Personal financial incentives for changing habitual health-related behaviors: a systematic review and meta-analysis. Prev Med. 2015;75:75–85.PubMedPubMedCentralCrossRef Mantzari E, Vogt F, Shemilt I, Wei Y, Higgins JPT, Marteau TM. Personal financial incentives for changing habitual health-related behaviors: a systematic review and meta-analysis. Prev Med. 2015;75:75–85.PubMedPubMedCentralCrossRef
46.
go back to reference Prendergast C. The provision of incentives in firms. J Econ Lit. 1999;37(1):7–63.CrossRef Prendergast C. The provision of incentives in firms. J Econ Lit. 1999;37(1):7–63.CrossRef
47.
49.
go back to reference Meacock R, Kristensen S, Sutton M. Paying for improvements in quality: recent experience in the NHS in England. Nord J Health Econ. 2014;2(1):239–55. Meacock R, Kristensen S, Sutton M. Paying for improvements in quality: recent experience in the NHS in England. Nord J Health Econ. 2014;2(1):239–55.
50.
go back to reference Thaler R. Mental Accounting and Consumer Choice. Mark Sci. 1985;4(3):199–214.CrossRef Thaler R. Mental Accounting and Consumer Choice. Mark Sci. 1985;4(3):199–214.CrossRef
51.
go back to reference Pit SW, Vo T, Pyakurel S. The effectiveness of recruitment strategies on general practitioner’s survey response rates — a systematic review. BMC Med Res Methodol. 2014;14:76.PubMedPubMedCentralCrossRef Pit SW, Vo T, Pyakurel S. The effectiveness of recruitment strategies on general practitioner’s survey response rates — a systematic review. BMC Med Res Methodol. 2014;14:76.PubMedPubMedCentralCrossRef
52.
go back to reference Lutge EE, Wiysonge CS, Knight SE, Sinclair D, Volmink J. Incentives and enablers to improve adherence in tuberculosis. Cochrane Database Syst Rev. 2015;9:CD007952. Lutge EE, Wiysonge CS, Knight SE, Sinclair D, Volmink J. Incentives and enablers to improve adherence in tuberculosis. Cochrane Database Syst Rev. 2015;9:CD007952.
53.
go back to reference Emmert M, Eijkenaar F, Kemter H, Esslinger AS, Schöffski O. Economic evaluation of pay-for-performance in health care: a systematic review. Eur J Health Econ HEPAC Health Econ Prev Care. 2012;13(6):755–67.PubMedCrossRef Emmert M, Eijkenaar F, Kemter H, Esslinger AS, Schöffski O. Economic evaluation of pay-for-performance in health care: a systematic review. Eur J Health Econ HEPAC Health Econ Prev Care. 2012;13(6):755–67.PubMedCrossRef
54.
go back to reference Halpern SD, Karlawish JHT, Casarett D, Berlin JA, Asch DA. Empirical assessment of whether moderate payments are undue or unjust inducements for participation in clinical trials. Arch Intern Med. 2004;164(7):801–3.PubMedCrossRef Halpern SD, Karlawish JHT, Casarett D, Berlin JA, Asch DA. Empirical assessment of whether moderate payments are undue or unjust inducements for participation in clinical trials. Arch Intern Med. 2004;164(7):801–3.PubMedCrossRef
55.
go back to reference Macklin R. “Due” and “undue” inducements: on paying money to research subjects. IRB Ethics Hum Res. 1981;3(5):1–6.CrossRef Macklin R. “Due” and “undue” inducements: on paying money to research subjects. IRB Ethics Hum Res. 1981;3(5):1–6.CrossRef
56.
go back to reference Bentley JP, Thacker PG. The influence of risk and monetary payment on the research participation decision making process. J Med Ethics. 2004;30(3):293–8.PubMedPubMedCentralCrossRef Bentley JP, Thacker PG. The influence of risk and monetary payment on the research participation decision making process. J Med Ethics. 2004;30(3):293–8.PubMedPubMedCentralCrossRef
58.
go back to reference Zuckerman RB, Sheingold SH, Orav EJ, Ruhter J, Epstein AM. Readmissions, observation, and the Hospital Readmissions Reduction Program. N Engl J Med. 2016;374(16):1543–51.PubMedCrossRef Zuckerman RB, Sheingold SH, Orav EJ, Ruhter J, Epstein AM. Readmissions, observation, and the Hospital Readmissions Reduction Program. N Engl J Med. 2016;374(16):1543–51.PubMedCrossRef
59.
go back to reference Smith PC, York N. Quality incentives: the case of U.K. general practitioners. Health Aff Proj Hope. 2004;23(3):112–8.CrossRef Smith PC, York N. Quality incentives: the case of U.K. general practitioners. Health Aff Proj Hope. 2004;23(3):112–8.CrossRef
61.
go back to reference Grant S, Huby G, Watkins F, Checkland K, McDonald R, Davies H, et al. The impact of pay-for-performance on professional boundaries in UK general practice: an ethnographic study. Sociol Health Illn. 2009;31(2):229–45.PubMedCrossRef Grant S, Huby G, Watkins F, Checkland K, McDonald R, Davies H, et al. The impact of pay-for-performance on professional boundaries in UK general practice: an ethnographic study. Sociol Health Illn. 2009;31(2):229–45.PubMedCrossRef
Metadata
Title
Designing and using incentives to support recruitment and retention in clinical trials: a scoping review and a checklist for design
Authors
Beth Parkinson
Rachel Meacock
Matt Sutton
Eleonora Fichera
Nicola Mills
Gillian W. Shorter
Shaun Treweek
Nicola L Harman
Rebecca C. H. Brown
Katie Gillies
Peter Bower
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Trials / Issue 1/2019
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-019-3710-z

Other articles of this Issue 1/2019

Trials 1/2019 Go to the issue