Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

Selection bias and subject refusal in a cluster-randomized controlled trial

Authors: Rochelle Yang, Barry L. Carter, Tyler H. Gums, Brian M. Gryzlak, Yinghui Xu, Barcey T. Levy

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

Selection bias and non-participation bias are major methodological concerns which impact external validity. Cluster-randomized controlled trials are especially prone to selection bias as it is impractical to blind clusters to their allocation into intervention or control. This study assessed the impact of selection bias in a large cluster-randomized controlled trial.

Methods

The Improved Cardiovascular Risk Reduction to Enhance Rural Primary Care (ICARE) study examined the impact of a remote pharmacist-led intervention in twelve medical offices. To assess eligibility, a standardized form containing patient demographics and medical information was completed for each screened patient. Eligible patients were approached by the study coordinator for recruitment. Both the study coordinator and the patient were aware of the site’s allocation prior to consent. Patients who consented or declined to participate were compared across control and intervention arms for differing characteristics. Statistical significance was determined using a two-tailed, equal variance t-test and a chi-square test with adjusted Bonferroni p-values. Results were adjusted for random cluster variation.

Results

There were 2749 completed screening forms returned to research staff with 461 subjects who had either consented or declined participation. Patients with poorly controlled diabetes were found to be significantly more likely to decline participation in intervention sites compared to those in control sites. A higher mean diastolic blood pressure was seen in patients with uncontrolled hypertension who declined in the control sites compared to those who declined in the intervention sites. However, these findings were no longer significant after adjustment for random variation among the sites. After this adjustment, females were now found to be significantly more likely to consent than males (odds ratio = 1.41; 95% confidence interval = 1.03, 1.92).

Conclusions

Though there appeared to be a higher consent rate for females than for males, the overall impact of potential selection bias and refusal to participate was minimal. Without rigorous methodology, selection bias may be a threat to external validity in cluster-randomized trials.

Trial registration

NCT01983813. Date of registration: Oct. 28, 2013.
Appendix
Available only for authorised users
Literature
1.
go back to reference Tripepi G, Jager KJ, Dekker FW, Zoccali C. Selection bias and information bias in clinical research. Nephron Clin Pract. 2010;115(2):c94–9.CrossRefPubMed Tripepi G, Jager KJ, Dekker FW, Zoccali C. Selection bias and information bias in clinical research. Nephron Clin Pract. 2010;115(2):c94–9.CrossRefPubMed
2.
go back to reference Hill AM, McPhail SM, Waldron N, Etherton-Beer C, Ingram K, Flicker L, et al. Fall rates in hospital rehabilitation units after individualized patient and staff education programs: a pragmatic, stepped-wedge, cluster-randomized controlled trial. Lancet. 2015;385(9987):2592–9.CrossRefPubMed Hill AM, McPhail SM, Waldron N, Etherton-Beer C, Ingram K, Flicker L, et al. Fall rates in hospital rehabilitation units after individualized patient and staff education programs: a pragmatic, stepped-wedge, cluster-randomized controlled trial. Lancet. 2015;385(9987):2592–9.CrossRefPubMed
3.
go back to reference LaBresh KA, Lazorick S, Ariza AJ, Furberg RD, Whetstone L, Hobbs C, et al. Implementation of the NHLBI integrated guidelines for cardiovascular health and risk reduction in children and adolescents: rationale and study design for young hearts, strong starts, a cluster-randomized trial targeting body mass index, blood pressure, and tobacco. Contemp Clin Trials. 2014;37(1):98–105.CrossRefPubMed LaBresh KA, Lazorick S, Ariza AJ, Furberg RD, Whetstone L, Hobbs C, et al. Implementation of the NHLBI integrated guidelines for cardiovascular health and risk reduction in children and adolescents: rationale and study design for young hearts, strong starts, a cluster-randomized trial targeting body mass index, blood pressure, and tobacco. Contemp Clin Trials. 2014;37(1):98–105.CrossRefPubMed
4.
go back to reference Eldridge S, Ashby D, Bennett C, Wakelin M, Feder G. Internal and external validity of cluster-randomized trials: systematic review of recent trials. BMJ. 2008;336(7649):876–80.CrossRefPubMedPubMedCentral Eldridge S, Ashby D, Bennett C, Wakelin M, Feder G. Internal and external validity of cluster-randomized trials: systematic review of recent trials. BMJ. 2008;336(7649):876–80.CrossRefPubMedPubMedCentral
6.
go back to reference Gums T, Carter B, Foster E. Cluster randomized trials for pharmacy practice research. Int J Clin Pharm. 2016;38(3):607–14.PubMed Gums T, Carter B, Foster E. Cluster randomized trials for pharmacy practice research. Int J Clin Pharm. 2016;38(3):607–14.PubMed
7.
go back to reference Eldridge S, Kerry S, Torgerson D. Bias in identifying and recruiting participants in cluster randomized trials: what can be done? BMJ. 2009;339:b4006.CrossRefPubMed Eldridge S, Kerry S, Torgerson D. Bias in identifying and recruiting participants in cluster randomized trials: what can be done? BMJ. 2009;339:b4006.CrossRefPubMed
8.
go back to reference Brierley G, Brabyn S, Torgerson D, Watson J. Bias in recruitment to cluster randomized trials: a review of recent publications. J Eval Clin Pract. 2012;18(4):878–86.CrossRefPubMed Brierley G, Brabyn S, Torgerson D, Watson J. Bias in recruitment to cluster randomized trials: a review of recent publications. J Eval Clin Pract. 2012;18(4):878–86.CrossRefPubMed
10.
11.
go back to reference Puffer S, Torgerson D, Watson J. Evidence for risk of bias in cluster randomized trials: review of recent trials published in three general medical journals. BMJ. 2003;327(7418):785–9.CrossRefPubMedPubMedCentral Puffer S, Torgerson D, Watson J. Evidence for risk of bias in cluster randomized trials: review of recent trials published in three general medical journals. BMJ. 2003;327(7418):785–9.CrossRefPubMedPubMedCentral
12.
go back to reference Tol WA, Komproe IH, Susanty D, Jordans MJ, Macy RD, De Jong JT. School-based mental health intervention for children affected by political violence in Indonesia: a cluster randomized trial. JAMA. 2008;300(6):655–62.CrossRefPubMed Tol WA, Komproe IH, Susanty D, Jordans MJ, Macy RD, De Jong JT. School-based mental health intervention for children affected by political violence in Indonesia: a cluster randomized trial. JAMA. 2008;300(6):655–62.CrossRefPubMed
13.
go back to reference Campbell R, Starkey F, Holliday J, Audrey S, Bloor M, Parry-Langdon N, et al. An informal school-based peer-led intervention for smoking prevention in adolescence (ASSIST): a cluster randomized trial. Lancet. 2008;371(9624):1595–602.CrossRefPubMedPubMedCentral Campbell R, Starkey F, Holliday J, Audrey S, Bloor M, Parry-Langdon N, et al. An informal school-based peer-led intervention for smoking prevention in adolescence (ASSIST): a cluster randomized trial. Lancet. 2008;371(9624):1595–602.CrossRefPubMedPubMedCentral
14.
go back to reference Jewkes R, Nduna M, Levin J, Jama N, Dunkle K, Puren A, et al. Impact of Stepping Stones on incidence of HIV and HSV-2 and sexual behavior in rural South Africa: cluster randomized controlled trial. BMJ. 2008;337:a506.CrossRefPubMedPubMedCentral Jewkes R, Nduna M, Levin J, Jama N, Dunkle K, Puren A, et al. Impact of Stepping Stones on incidence of HIV and HSV-2 and sexual behavior in rural South Africa: cluster randomized controlled trial. BMJ. 2008;337:a506.CrossRefPubMedPubMedCentral
15.
go back to reference Davies MJ, Heller S, Skinner TC, Campbell MJ, Carey ME, Cradock S, et al. Effectiveness of the diabetes education and self management for ongoing and newly diagnosed (DESMOND) program for people with newly diagnosed type 2 diabetes: cluster randomized controlled trial. BMJ. 2008;336(7649):491–5.CrossRefPubMedPubMedCentral Davies MJ, Heller S, Skinner TC, Campbell MJ, Carey ME, Cradock S, et al. Effectiveness of the diabetes education and self management for ongoing and newly diagnosed (DESMOND) program for people with newly diagnosed type 2 diabetes: cluster randomized controlled trial. BMJ. 2008;336(7649):491–5.CrossRefPubMedPubMedCentral
16.
go back to reference Carter BL, Levy BT, Gryzlak B, Chrischilles EA, Vander Weg MW, Christensen AJ, et al. A centralized cardiovascular risk service to improve guideline adherence in private primary care offices. Contemp Clin Trials. 2015;43:25–32.CrossRefPubMedPubMedCentral Carter BL, Levy BT, Gryzlak B, Chrischilles EA, Vander Weg MW, Christensen AJ, et al. A centralized cardiovascular risk service to improve guideline adherence in private primary care offices. Contemp Clin Trials. 2015;43:25–32.CrossRefPubMedPubMedCentral
17.
go back to reference Chobonian AV, Bakris GL, Black HR, Cushman WC, Green LA, Izzo JL, et al. The seventh report of the Joint National Committee on prevention, detection, evaluation, and treatment of high blood pressure: the JNC 7 report. JAMA. 2003;289(19):2560–72.CrossRef Chobonian AV, Bakris GL, Black HR, Cushman WC, Green LA, Izzo JL, et al. The seventh report of the Joint National Committee on prevention, detection, evaluation, and treatment of high blood pressure: the JNC 7 report. JAMA. 2003;289(19):2560–72.CrossRef
18.
go back to reference Grundy SM, Becker D, Clark LT, Cooper RS, Denke MA, Howard WJ, et al. Third report of the National Cholesterol Education Program (NCEP) expert panel on detection, evaluation, and treatment of high blood cholesterol in adults (Adult Treatment Panel III) final report. Circulation. 2002;106(25):3144–421. Grundy SM, Becker D, Clark LT, Cooper RS, Denke MA, Howard WJ, et al. Third report of the National Cholesterol Education Program (NCEP) expert panel on detection, evaluation, and treatment of high blood cholesterol in adults (Adult Treatment Panel III) final report. Circulation. 2002;106(25):3144–421.
19.
go back to reference American Diabetes Association. Standards of medical care in diabetes care—2012. Diabetes Care. 2012;35(Suppl 1):S11–63. American Diabetes Association. Standards of medical care in diabetes care—2012. Diabetes Care. 2012;35(Suppl 1):S11–63.
20.
go back to reference Klosky JL, Tyc VL, Lawford J, Ashford J, Lensing S, Buscemi J. Predictors of non-participation in a randomized intervention trial to reduce environmental tobacco smoke (ETS) exposure in pediatric cancer patients. Pediatr Blood Cancer. 2009;52(5):644–9.CrossRefPubMedPubMedCentral Klosky JL, Tyc VL, Lawford J, Ashford J, Lensing S, Buscemi J. Predictors of non-participation in a randomized intervention trial to reduce environmental tobacco smoke (ETS) exposure in pediatric cancer patients. Pediatr Blood Cancer. 2009;52(5):644–9.CrossRefPubMedPubMedCentral
21.
go back to reference Chinn DJ, White M, Howel D, Harland JO, Drinkwater CK. Factors associated with non-participation in a physical activity promotion trial. Public Health. 2006;120(4):309–19.CrossRefPubMed Chinn DJ, White M, Howel D, Harland JO, Drinkwater CK. Factors associated with non-participation in a physical activity promotion trial. Public Health. 2006;120(4):309–19.CrossRefPubMed
22.
go back to reference Karbalaeifar R, Kazempour-Ardebili S, Amiri P, Ghannadi S, Tahmasebinejad Z, Amouzegar A. Evaluating the effect of knowledge, attitude and practice on self-management in patients with type 2 diabetes. Acta Diabetol. 2016;53(6):1015–23.CrossRefPubMed Karbalaeifar R, Kazempour-Ardebili S, Amiri P, Ghannadi S, Tahmasebinejad Z, Amouzegar A. Evaluating the effect of knowledge, attitude and practice on self-management in patients with type 2 diabetes. Acta Diabetol. 2016;53(6):1015–23.CrossRefPubMed
23.
go back to reference Weijman I, Ros WJ, Rutten GE, Schaufeli WB, Schabracg MJ, Winnubst JA. Frequency and perceived burden of diabetes self-management activities in employees with insulin-treated diabetes: relationships with health outcomes. Diabetes Res Clinl Pract. 2005;68(1):56–64.CrossRef Weijman I, Ros WJ, Rutten GE, Schaufeli WB, Schabracg MJ, Winnubst JA. Frequency and perceived burden of diabetes self-management activities in employees with insulin-treated diabetes: relationships with health outcomes. Diabetes Res Clinl Pract. 2005;68(1):56–64.CrossRef
24.
go back to reference Martinez L, Consoli SM, Monnier L, Simon D, Wong O, Yomtov B, et al. Studying the hurdles of insulin prescription (SHIP): development, scoring and initial validation of a new self-administered questionnaire. Health Qual Life Outcomes. 2007;5:53.CrossRefPubMedPubMedCentral Martinez L, Consoli SM, Monnier L, Simon D, Wong O, Yomtov B, et al. Studying the hurdles of insulin prescription (SHIP): development, scoring and initial validation of a new self-administered questionnaire. Health Qual Life Outcomes. 2007;5:53.CrossRefPubMedPubMedCentral
25.
go back to reference Groeneveld IR, Proper KI, Van der Beek AJ, Hildebrandt VH, van Mechelen W. Factors associated with non-participation and drop-out in a lifestyle intervention for workers with an elevated risk of cardiovascular disease. Int J Behav Nutr Phys Act. 2009;6:80.CrossRefPubMedPubMedCentral Groeneveld IR, Proper KI, Van der Beek AJ, Hildebrandt VH, van Mechelen W. Factors associated with non-participation and drop-out in a lifestyle intervention for workers with an elevated risk of cardiovascular disease. Int J Behav Nutr Phys Act. 2009;6:80.CrossRefPubMedPubMedCentral
26.
go back to reference Artama M, Heiavaara S, Sarkeala T, Prattala R, Pukkala E, Malila N. Determinants of non-participation in a mass screening program for colorectal cancer in Finaland. Acta Oncol. 2016;55(7):870–4.CrossRefPubMed Artama M, Heiavaara S, Sarkeala T, Prattala R, Pukkala E, Malila N. Determinants of non-participation in a mass screening program for colorectal cancer in Finaland. Acta Oncol. 2016;55(7):870–4.CrossRefPubMed
27.
go back to reference Rivers D, August EM, Sehovic I, Lee Green B, Quinn GP. A systematic review of the factors influencing African Americans’ participation in cancer clinical trials. Contemp Clin Trials. 2013;35(2):13–32.CrossRefPubMed Rivers D, August EM, Sehovic I, Lee Green B, Quinn GP. A systematic review of the factors influencing African Americans’ participation in cancer clinical trials. Contemp Clin Trials. 2013;35(2):13–32.CrossRefPubMed
28.
go back to reference Baquet CR, Commiskey P, Daniel Mullins C, Mishra SI. Recruitment and participation in clinical trials: socio-demographic, rural/urban, and health care access predictors. Cancer Detect Prev. 2006;30(1):24–33.CrossRefPubMedPubMedCentral Baquet CR, Commiskey P, Daniel Mullins C, Mishra SI. Recruitment and participation in clinical trials: socio-demographic, rural/urban, and health care access predictors. Cancer Detect Prev. 2006;30(1):24–33.CrossRefPubMedPubMedCentral
30.
go back to reference Arfken CL, Balon R. Declining participation in research studies. Psychother Psychosom. 2011;80:325–8.CrossRefPubMed Arfken CL, Balon R. Declining participation in research studies. Psychother Psychosom. 2011;80:325–8.CrossRefPubMed
31.
go back to reference O’Toole BI, Battistutta D, Long A, Crouch K. A comparison of costs and data quality of three health survey methods: mail, telephone, and personal home interview. Am J Epidemiol. 1986;124(2):317–28.CrossRefPubMed O’Toole BI, Battistutta D, Long A, Crouch K. A comparison of costs and data quality of three health survey methods: mail, telephone, and personal home interview. Am J Epidemiol. 1986;124(2):317–28.CrossRefPubMed
32.
go back to reference Siemiatychi J. A comparison of mail, telephone, and home interview strategies for household health surveys. Am J Public Health. 1979;69(3):238–45.CrossRef Siemiatychi J. A comparison of mail, telephone, and home interview strategies for household health surveys. Am J Public Health. 1979;69(3):238–45.CrossRef
33.
go back to reference Barnes M, Wiles N, Morrison J, Kessler D, Williams C, Kuyken W, et al. Exploring patients’ reasons for declining contact in a cognitive behavioral therapy randomized controlled trial in primary care. Br J Gen Pract. 2012;62(598):e371–7.CrossRefPubMedPubMedCentral Barnes M, Wiles N, Morrison J, Kessler D, Williams C, Kuyken W, et al. Exploring patients’ reasons for declining contact in a cognitive behavioral therapy randomized controlled trial in primary care. Br J Gen Pract. 2012;62(598):e371–7.CrossRefPubMedPubMedCentral
34.
go back to reference Sharp L, Cotton SC, Alexander L, Williams E, Gray NM, Reid JM; TOMBOLA Group. Reasons for participation and non-participation in a randomized controlled trial: postal questionnaire surveys of women eligible for TOMBOLA (Trial of Management of Borderline Other Low-Grade Abnormal smears). Clin Trials 2006;3(5):431-42. Sharp L, Cotton SC, Alexander L, Williams E, Gray NM, Reid JM; TOMBOLA Group. Reasons for participation and non-participation in a randomized controlled trial: postal questionnaire surveys of women eligible for TOMBOLA (Trial of Management of Borderline Other Low-Grade Abnormal smears). Clin Trials 2006;3(5):431-42.
Metadata
Title
Selection bias and subject refusal in a cluster-randomized controlled trial
Authors
Rochelle Yang
Barry L. Carter
Tyler H. Gums
Brian M. Gryzlak
Yinghui Xu
Barcey T. Levy
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0368-7

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue