Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Care | Research article

High-performing physicians are more likely to participate in a research study: findings from a quality improvement study

Authors: Simone Dahrouge, Catherine Deri Armstrong, William Hogg, Jatinderpreet Singh, Clare Liddy

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

Participants in voluntary research present a different demographic profile than those who choose not to participate, affecting the generalizability of many studies. Efforts to evaluate these differences have faced challenges, as little information is available from non-participants. Leveraging data from a recent randomized controlled trial that used health administrative databases in a jurisdiction with universal medical coverage, we sought to compare the quality of care provided by participating and non-participating physicians prior to the program’s implementation in order to assess whether participating physicians provided a higher baseline quality of care.

Methods

We conducted clustered regression analyses of baseline data from provincial health administrative databases. Participants included all family physicians who were eligible to participate in the Improved Delivery of Cardiovascular Care (IDOCC) project, a quality improvement project rolled out in a geographically defined region in Ontario (Canada) between 2008 and 2011. We assessed 14 performance indicators representing measures of access, continuity, and recommended care for cancer screening and chronic disease management.

Results

In unadjusted and patient-adjusted models, patients of IDOCC-participating physicians had higher continuity scores at the provider (Odds Ratio (OR) [95% confidence interval]: 1.06 [1.03–1.09]) and practice (1.06 [1.04–1.08]) level, lower risk of emergency room visits (Rate Ratio (RR): 0.93 [0.88–0.97]) and hospitalizations (RR:0.87 [0.77–0.99]), and were more likely to have received recommended diabetes tests (OR: 1.25 [1.06–1.49]) and cancer screening for cervical cancer (OR: 1.32 [1.08–1.61] and breast cancer (OR: 1.32 [1.19–1.46]) than patients of non-participating physicians. Some indicators remained statistically significant in the model after adjusting for provider factors.

Conclusions

Our study demonstrated a participation bias for several quality indicators. Physician characteristics can explain some of these differences. Other underlying physician or practice attributes also influence interest in participating in quality improvement initiatives and existing quality levels. The standard for addressing participation bias by controlling for basic physician and practice level variables is inadequate for ensuring that results are generalizable to primary care providers and practices.
Appendix
Available only for authorised users
Literature
1.
go back to reference Wall TC, Mian MA, Ray MN, Casebeer L, Collins BC, Kiefe CI, et al. Improving physician performance through internet-based interventions: who will participate? J Med Internet Res. 2005;7:e48.CrossRef Wall TC, Mian MA, Ray MN, Casebeer L, Collins BC, Kiefe CI, et al. Improving physician performance through internet-based interventions: who will participate? J Med Internet Res. 2005;7:e48.CrossRef
2.
go back to reference van Heuvelen MJG, Hochstenbach JBM, Brouwer WH, de Greef MHG, Zijlstra GAR, van Jaarsveld E, et al. Differences between participants and non-participants in an RCT on physical activity and psychological interventions for older persons. Aging Clin Exp Res. 2005;17:236–45.CrossRef van Heuvelen MJG, Hochstenbach JBM, Brouwer WH, de Greef MHG, Zijlstra GAR, van Jaarsveld E, et al. Differences between participants and non-participants in an RCT on physical activity and psychological interventions for older persons. Aging Clin Exp Res. 2005;17:236–45.CrossRef
3.
go back to reference Borgiel AE, Williams JI, Davis DA, Dunn EV, Hobbs N, Hutchison B, et al. Evaluating the effectiveness of 2 educational interventions in family practice. CMAJ. 1999;161:965–70.PubMedPubMedCentral Borgiel AE, Williams JI, Davis DA, Dunn EV, Hobbs N, Hutchison B, et al. Evaluating the effectiveness of 2 educational interventions in family practice. CMAJ. 1999;161:965–70.PubMedPubMedCentral
4.
go back to reference Shelton BJ, Wofford JL, Gosselink CA, McClatchey MW, Brekke K, Conry C, et al. Recruitment and retention of physicians for primary care research. J Community Health. 2002;27:79–89.CrossRef Shelton BJ, Wofford JL, Gosselink CA, McClatchey MW, Brekke K, Conry C, et al. Recruitment and retention of physicians for primary care research. J Community Health. 2002;27:79–89.CrossRef
5.
go back to reference Audet AM, Doty MM, Shamasdin J, Schoenbaum SC. Measure, learn, and improve: physicians' involvement in quality improvement. Health Aff (Millwood ). 2005;24:843–53.CrossRef Audet AM, Doty MM, Shamasdin J, Schoenbaum SC. Measure, learn, and improve: physicians' involvement in quality improvement. Health Aff (Millwood ). 2005;24:843–53.CrossRef
6.
go back to reference Dahrouge S, Hogg W, Younger J, Muggah E, Russell G, Glazier RH. Primary care physician panel size and quality of care: a population-based study in Ontario, Canada. Ann Fam Med. 2016;14:26–33.CrossRef Dahrouge S, Hogg W, Younger J, Muggah E, Russell G, Glazier RH. Primary care physician panel size and quality of care: a population-based study in Ontario, Canada. Ann Fam Med. 2016;14:26–33.CrossRef
7.
go back to reference Jaakkimainen L, Klein-Geltink JE, Guttmann A, Barnsley J, Zagorski BM, Kopp A et al.: Indicators of primary care based on administrative data. In In Primary Care in Ontario. Institute for Clinical Evaluative Sciences; 2006:227. Jaakkimainen L, Klein-Geltink JE, Guttmann A, Barnsley J, Zagorski BM, Kopp A et al.: Indicators of primary care based on administrative data. In In Primary Care in Ontario. Institute for Clinical Evaluative Sciences; 2006:227.
8.
go back to reference Liddy C, Hogg W, Russell G, Wells G, Armstrong C, Akbari A et al.: The improved delivery of cardiovascular care (IDOCC) through outreach facilitation: study protocol and implementation details of a cluster randomized controlled trial in primary care. BMC Implementation Science 2011, in print. Liddy C, Hogg W, Russell G, Wells G, Armstrong C, Akbari A et al.: The improved delivery of cardiovascular care (IDOCC) through outreach facilitation: study protocol and implementation details of a cluster randomized controlled trial in primary care. BMC Implementation Science 2011, in print.
9.
go back to reference Liddy C: A real-world stepped wedge cluster randomized trial of practice facilitation to improve cardiovascular care. Implement Sci 10:150, 2015 2015, 150. Liddy C: A real-world stepped wedge cluster randomized trial of practice facilitation to improve cardiovascular care. Implement Sci 10:150, 2015 2015, 150.
10.
go back to reference Dillman DA. Mail and telephone surveys: the total design method. New York: Wiley; 1978. Dillman DA. Mail and telephone surveys: the total design method. New York: Wiley; 1978.
11.
go back to reference Reid R, Bogdanovic B, Roos NP, Black C, MacWilliam L, Menec V. Do some physician groups see sicker patients than others? Implications for primary care policy in Manitoba. 2001. Manitoba Centre for Health Policy and Evaluation: University of Manitoba. Reid R, Bogdanovic B, Roos NP, Black C, MacWilliam L, Menec V. Do some physician groups see sicker patients than others? Implications for primary care policy in Manitoba. 2001. Manitoba Centre for Health Policy and Evaluation: University of Manitoba.
12.
go back to reference Wranik DW, Durier-Copp M. Physician remuneration methods for family physicians in Canada: expected outcomes and lessons learned. Health Care Anal. 2010;18:35–59.CrossRef Wranik DW, Durier-Copp M. Physician remuneration methods for family physicians in Canada: expected outcomes and lessons learned. Health Care Anal. 2010;18:35–59.CrossRef
13.
go back to reference Hossain MM, Laditka JN. The influence of rurality on the volume of non-urgent emergency department visits. Spat Spatiotemporal Epidemiol. 2011;2.CrossRef Hossain MM, Laditka JN. The influence of rurality on the volume of non-urgent emergency department visits. Spat Spatiotemporal Epidemiol. 2011;2.CrossRef
14.
go back to reference Borgiel AE, Dunn EV, Lamont CT, MacDonald PJ, Evensen MK, Bass MJ, et al. Recruiting family physicians as participants in research. Fam Pract. 1989;6:168–72.CrossRef Borgiel AE, Dunn EV, Lamont CT, MacDonald PJ, Evensen MK, Bass MJ, et al. Recruiting family physicians as participants in research. Fam Pract. 1989;6:168–72.CrossRef
15.
go back to reference Eisinger F, Pivot X, Coscas Y, Viguier J, Calazel-Benque A, Blay JY, et al. Impact of general practitioners’ sex and age on systematic recommendation for cancer screening. European Journal of Cancer Prevention. 2011;20:Suppl–41. Eisinger F, Pivot X, Coscas Y, Viguier J, Calazel-Benque A, Blay JY, et al. Impact of general practitioners’ sex and age on systematic recommendation for cancer screening. European Journal of Cancer Prevention. 2011;20:Suppl–41.
16.
go back to reference Ince-Cushman D, Correa JA, Shuldiner J, Segouin J. Association of primary care physician sex with cervical cancer and mammography screening. Can Fam Physician. 2013;59:e11–8.PubMedPubMedCentral Ince-Cushman D, Correa JA, Shuldiner J, Segouin J. Association of primary care physician sex with cervical cancer and mammography screening. Can Fam Physician. 2013;59:e11–8.PubMedPubMedCentral
17.
go back to reference Lurie N, Slater J, McGovern P, Ekstrum J, Quam L, Margolis K. Preventive care for women--does the sex of the physician matter? N Engl J Med. 1993;329:478–82.CrossRef Lurie N, Slater J, McGovern P, Ekstrum J, Quam L, Margolis K. Preventive care for women--does the sex of the physician matter? N Engl J Med. 1993;329:478–82.CrossRef
18.
go back to reference Baumhakel M, Muller U, Bohm M. Influence of gender of physicians and patients on guideline-recommended treatment of chronic heart failure in a cross-sectional study. Eur J Heart Fail. 2009;11:299–303.CrossRef Baumhakel M, Muller U, Bohm M. Influence of gender of physicians and patients on guideline-recommended treatment of chronic heart failure in a cross-sectional study. Eur J Heart Fail. 2009;11:299–303.CrossRef
19.
go back to reference Dahrouge S, Seale E, Hogg W, Russell G, Younger J, Muggah E et al. (Eds):a comprehensive assessment of family physician gender and quality of care: a cross-sectional analysis in Ontario, Canada. In Med Care 2016. Dahrouge S, Seale E, Hogg W, Russell G, Younger J, Muggah E et al. (Eds):a comprehensive assessment of family physician gender and quality of care: a cross-sectional analysis in Ontario, Canada. In Med Care 2016.
20.
go back to reference Beaulieu MD, Haggerty J, Tousignant P, Barnsley J, Hogg W, Geneau R, et al. Characteristics of primary care practices associated with high quality of care. Can Med Assoc J. 2013;185:E590–6.CrossRef Beaulieu MD, Haggerty J, Tousignant P, Barnsley J, Hogg W, Geneau R, et al. Characteristics of primary care practices associated with high quality of care. Can Med Assoc J. 2013;185:E590–6.CrossRef
21.
go back to reference Kiran T, Kopp A, Moineddin R, Glazier RH. Longitudinal evaluation of physician payment reform and team-based care for chronic disease management and prevention. CMAJ. 2015;187:E494–502.CrossRef Kiran T, Kopp A, Moineddin R, Glazier RH. Longitudinal evaluation of physician payment reform and team-based care for chronic disease management and prevention. CMAJ. 2015;187:E494–502.CrossRef
22.
go back to reference Nodora JN, Martz WD, Ashbeck EL, Jacobs ET, Thompson PA, Martinez ME. Primary care physician compliance with colorectal cancer screening guidelines. Cancer Causes Control. 2011;22:1277–87.CrossRef Nodora JN, Martz WD, Ashbeck EL, Jacobs ET, Thompson PA, Martinez ME. Primary care physician compliance with colorectal cancer screening guidelines. Cancer Causes Control. 2011;22:1277–87.CrossRef
23.
go back to reference Elovainio M, Steen N, Presseau J, Francis J, Hrisos S, Hawthorne G, et al. Is organizational justice associated with clinical performance in the care for patients with diabetes in primary care? Evidence from the improving quality of care in diabetes study. Fam Pract. 2013;30:31–9.CrossRef Elovainio M, Steen N, Presseau J, Francis J, Hrisos S, Hawthorne G, et al. Is organizational justice associated with clinical performance in the care for patients with diabetes in primary care? Evidence from the improving quality of care in diabetes study. Fam Pract. 2013;30:31–9.CrossRef
24.
go back to reference Hung DY, Glasgow RE, Dickinson LM, Froshaug DB, Fernald DH, Balasubramanian BA, et al. The chronic care model and relationships to patient health status and health-related quality of life. Am J Prev Med. 2008;35:Suppl–406.CrossRef Hung DY, Glasgow RE, Dickinson LM, Froshaug DB, Fernald DH, Balasubramanian BA, et al. The chronic care model and relationships to patient health status and health-related quality of life. Am J Prev Med. 2008;35:Suppl–406.CrossRef
25.
go back to reference Luxford K, Safran DG, Delbanco T. Promoting patient-centered care: a qualitative study of facilitators and barriers in healthcare organizations with a reputation for improving the patient experience. Int J Qual Health Care. 2011;23.CrossRef Luxford K, Safran DG, Delbanco T. Promoting patient-centered care: a qualitative study of facilitators and barriers in healthcare organizations with a reputation for improving the patient experience. Int J Qual Health Care. 2011;23.CrossRef
26.
go back to reference Quinn MA, Wilcox A, Orav EJ, Bates DW, Simon SR. The relationship between perceived practice quality and quality improvement activities and physician practice dissatisfaction, professional isolation, and work-life stress. Med Care. 2009;47:924–8.CrossRef Quinn MA, Wilcox A, Orav EJ, Bates DW, Simon SR. The relationship between perceived practice quality and quality improvement activities and physician practice dissatisfaction, professional isolation, and work-life stress. Med Care. 2009;47:924–8.CrossRef
27.
go back to reference Rushmer R, Kelly D, Lough M, Wilkinson JE, Davies HT. Introducing the learning practice--I. the characteristics of learning organizations in primary care. J Eval Clin Pract. 2004;10:375–86.CrossRef Rushmer R, Kelly D, Lough M, Wilkinson JE, Davies HT. Introducing the learning practice--I. the characteristics of learning organizations in primary care. J Eval Clin Pract. 2004;10:375–86.CrossRef
28.
go back to reference Siriwardena AN. Engaging clinicians in quality improvement initiatives: art or science? Qual Prim Care. 2009;17:303–5.PubMed Siriwardena AN. Engaging clinicians in quality improvement initiatives: art or science? Qual Prim Care. 2009;17:303–5.PubMed
29.
go back to reference Holmboe ES, Cassel CK. The role of physicians and certification boards to improve quality. Am J Med Qual. 2007;22:18–25.CrossRef Holmboe ES, Cassel CK. The role of physicians and certification boards to improve quality. Am J Med Qual. 2007;22:18–25.CrossRef
30.
go back to reference Schouten LM, Hulscher ME, van Everdingen JJ, Huijsman R, Grol RP. Evidence for the impact of quality improvement collaboratives: systematic review. [review] [15 refs]. BMJ. 2008;336:1491–4.CrossRef Schouten LM, Hulscher ME, van Everdingen JJ, Huijsman R, Grol RP. Evidence for the impact of quality improvement collaboratives: systematic review. [review] [15 refs]. BMJ. 2008;336:1491–4.CrossRef
31.
go back to reference Tricco AC, Ivers NM, Grimshaw JM, Moher D, Turner L, Galipeau J, et al. Effectiveness of quality improvement strategies on the management of diabetes: a systematic review and meta-analysis. [review]. Lancet. 2012;379:2252–61.CrossRef Tricco AC, Ivers NM, Grimshaw JM, Moher D, Turner L, Galipeau J, et al. Effectiveness of quality improvement strategies on the management of diabetes: a systematic review and meta-analysis. [review]. Lancet. 2012;379:2252–61.CrossRef
32.
go back to reference Hogg W, Baskerville N, Nykiforuk C, Mallen D. Improved preventive care in family practices with outreach facilitation: understanding success and failure. J Health Serv Res Policy. 2002;7:195–201.CrossRef Hogg W, Baskerville N, Nykiforuk C, Mallen D. Improved preventive care in family practices with outreach facilitation: understanding success and failure. J Health Serv Res Policy. 2002;7:195–201.CrossRef
Metadata
Title
High-performing physicians are more likely to participate in a research study: findings from a quality improvement study
Authors
Simone Dahrouge
Catherine Deri Armstrong
William Hogg
Jatinderpreet Singh
Clare Liddy
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Care
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-019-0809-6

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue