Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2012

Open Access 01-12-2012 | Research

Factors associated with non-response in routine use of patient reported outcome measures after elective surgery in England

Authors: Andrew Hutchings, Jenny Neuburger, Kirstin Grosse Frie, Nick Black, Jan van der Meulen

Published in: Health and Quality of Life Outcomes | Issue 1/2012

Login to get access

Abstract

Background

Patient-reported outcome measures are increasingly being used to compare providers. We studied whether non-response rates to post-operative questionnaires are associated with patients' characteristics and organisational features of providers.

Methods

131 447 patients who underwent a hip or knee replacement, hernia repair or varicose vein surgery in 2009-10 in England. Multivariable logistic regression to calculate adjusted odds ratios of non-response for characteristics of the patients and organisational characteristics of providers. Multiple imputation was used for missing patient characteristics. Providers were included as random effects.

Results

Response rates to the post-operative questionnaire were 85.1% for hip replacement (n = 37 961), 85.3% for knee replacements (n = 44 422), 72.9% for hernia repair (n = 34 964), and 64.8% for varicose vein surgery (n = 14 100). Across the four procedures, there were higher levels of non-response in men (odds ratios 1.03 [95% CI 0.95-1.11] - 1.35 [1.25-1.46]), younger patients (those under 55 years 3.01 [2.72-3.32] - 6.05 [5.49-6.67]), non-white patients (1.24 [1.11-1.38] - 2.08 [1.89-2.31]), patients in the most deprived quintile of socio-economic status (1.47 [1.34-1,62] - 1.86 [1.71-2.03]), those who lived alone (1.11 [0.99-1.23] - 1.27 [1.18-1.36]) and those who had been assisted when completing their pre-operative questionnaire (1.26 [1.10-1.46] -1.67 [1.56-1.79]). Non-response rates were also higher in patients who had poorer pre-operative health (three or more comorbidities: 1.14 [0.96-1.35] - 1.45 [1.30-1.63]). Providers' patient recruitment rates before surgery and the timing of pre-operative questionnaire administration did not affect the rates of response to post-operative questionnaires.

Conclusion

If non-response can be shown to be associated with outcome, then rates of non-response to post-operative questionnaires would need to be taken into account when these measures are being used to compare the performance of providers or to evaluate surgical procedures.
Literature
2.
go back to reference Rolfson O, Kärrholm J, Dahlberg LE, Garellick G: Patient-reported outcomes in the Swedish Hip Arthroplasty Register: results of a nationwide prospective observational study. J Bone Joint Surg Br 2011, 93: 867–875. 10.1302/0301-620X.93B7.25737CrossRefPubMed Rolfson O, Kärrholm J, Dahlberg LE, Garellick G: Patient-reported outcomes in the Swedish Hip Arthroplasty Register: results of a nationwide prospective observational study. J Bone Joint Surg Br 2011, 93: 867–875. 10.1302/0301-620X.93B7.25737CrossRefPubMed
4.
go back to reference Chard J, Kuczawski M, Black N, van der Meulen J: Outcomes of elective surgery undertaken in Independent Sector Treatment Centres and NHS providers in England: the Patient Outcomes in Surgery Audit. BMJ 2011, 343: d6404. doi:10.1136/bmj.d6404 10.1136/bmj.d6404PubMedCentralCrossRefPubMed Chard J, Kuczawski M, Black N, van der Meulen J: Outcomes of elective surgery undertaken in Independent Sector Treatment Centres and NHS providers in England: the Patient Outcomes in Surgery Audit. BMJ 2011, 343: d6404. doi:10.1136/bmj.d6404 10.1136/bmj.d6404PubMedCentralCrossRefPubMed
6.
go back to reference Groves RM, Dillman DA, Eltinge JL, Little RJA (Eds): Survey non-response. New York: Wiley; 2002. Groves RM, Dillman DA, Eltinge JL, Little RJA (Eds): Survey non-response. New York: Wiley; 2002.
7.
go back to reference Durrant GB, Steele F: Multilevel modelling of refusal and non-contact in household surveys evidence from six UK Government surveys. J Roy Statist Soc A 2009, 172: 361–381. 10.1111/j.1467-985X.2008.00565.xCrossRef Durrant GB, Steele F: Multilevel modelling of refusal and non-contact in household surveys evidence from six UK Government surveys. J Roy Statist Soc A 2009, 172: 361–381. 10.1111/j.1467-985X.2008.00565.xCrossRef
8.
go back to reference Durrant GB, Goldstein H: Analysing the probability of attrition in a longitudinal survey. Southampton: University of Southampton; 2010. Durrant GB, Goldstein H: Analysing the probability of attrition in a longitudinal survey. Southampton: University of Southampton; 2010.
9.
go back to reference Garratt E: The key findings report for the 2008 inpatient survey. Oxford: Picker Institute Europe; 2009. Garratt E: The key findings report for the 2008 inpatient survey. Oxford: Picker Institute Europe; 2009.
10.
go back to reference Emberton M, Black N: Impact of non-response and of late-response by patients in a multi centre surgical outcome audit. Int J Qual Health Care 1995, 7: 47–55.PubMed Emberton M, Black N: Impact of non-response and of late-response by patients in a multi centre surgical outcome audit. Int J Qual Health Care 1995, 7: 47–55.PubMed
11.
go back to reference Sales AE, Plomondon ME, Magid DJ, Spertus JA, Rumsfeld JS: Assessing response bias from missing quality of life data: the Heckman method. Health Qual Life Outcomes 2004, 2: 49. doi:doi:10.1186/1477–7525–2-49 10.1186/1477-7525-2-49PubMedCentralCrossRefPubMed Sales AE, Plomondon ME, Magid DJ, Spertus JA, Rumsfeld JS: Assessing response bias from missing quality of life data: the Heckman method. Health Qual Life Outcomes 2004, 2: 49. doi:doi:10.1186/1477–7525–2-49 10.1186/1477-7525-2-49PubMedCentralCrossRefPubMed
12.
go back to reference Solberg TK, Sorlie A, Sjaaavik K, Nygard OP, Ingebrigtsen T: Would loss to follow-up bias the outcome evaluation of patients operated for degenerative disorders of the lumbar spine? A study of responding and non-responding cohort participants from a clinical spine surgery registry. Acta Orthopaedica 2011, 82: 56–63. 10.3109/17453674.2010.548024PubMedCentralCrossRefPubMed Solberg TK, Sorlie A, Sjaaavik K, Nygard OP, Ingebrigtsen T: Would loss to follow-up bias the outcome evaluation of patients operated for degenerative disorders of the lumbar spine? A study of responding and non-responding cohort participants from a clinical spine surgery registry. Acta Orthopaedica 2011, 82: 56–63. 10.3109/17453674.2010.548024PubMedCentralCrossRefPubMed
13.
go back to reference Pernegger TV, Chamot E, Bovier PA: Nonresponse bias in a survey of patients' perceptions of hospital care. Med Care 2005, 43: 374–380. 10.1097/01.mlr.0000156856.36901.40CrossRef Pernegger TV, Chamot E, Bovier PA: Nonresponse bias in a survey of patients' perceptions of hospital care. Med Care 2005, 43: 374–380. 10.1097/01.mlr.0000156856.36901.40CrossRef
14.
go back to reference Kim J, Lonner JH, Nelson CL, Lotke PA: Response bias: effect on outcomes evaluation by mail surveys after total knee arthroplasty. J Bone Joint Surg Br 2004, 86A: 15–21. Kim J, Lonner JH, Nelson CL, Lotke PA: Response bias: effect on outcomes evaluation by mail surveys after total knee arthroplasty. J Bone Joint Surg Br 2004, 86A: 15–21.
15.
go back to reference Norquist BM, Goldberg BA, Matsen FA: Challenges in evaluating patients lost to follow-up in clinical studies of rotator cuff tears. J Bone Joint Surg Br 2000, 82A: 838–842. Norquist BM, Goldberg BA, Matsen FA: Challenges in evaluating patients lost to follow-up in clinical studies of rotator cuff tears. J Bone Joint Surg Br 2000, 82A: 838–842.
16.
go back to reference Kahn KL, Liu H, Adams JL, Chen W-P, Tisnado TM, Carlisle DM, Hays RD, Mangione CM, Damberg CL: Methodological challenges associated with patient responses to follow-up longitudinal surveys regarding quality of care. Health Serv Res 2003, 38: 1579–1598. 10.1111/j.1475-6773.2003.00194.xPubMedCentralCrossRefPubMed Kahn KL, Liu H, Adams JL, Chen W-P, Tisnado TM, Carlisle DM, Hays RD, Mangione CM, Damberg CL: Methodological challenges associated with patient responses to follow-up longitudinal surveys regarding quality of care. Health Serv Res 2003, 38: 1579–1598. 10.1111/j.1475-6773.2003.00194.xPubMedCentralCrossRefPubMed
17.
go back to reference Kwon SK, Kang YG, Chang CB, Sung SC, Kim TK: Interpretations of the clinical outcomes of the nonresponders to mail surveys in patients after total knee arthroplasty. J Arthroplast 2010, 25: 133–137. 10.1016/j.arth.2008.11.004CrossRef Kwon SK, Kang YG, Chang CB, Sung SC, Kim TK: Interpretations of the clinical outcomes of the nonresponders to mail surveys in patients after total knee arthroplasty. J Arthroplast 2010, 25: 133–137. 10.1016/j.arth.2008.11.004CrossRef
18.
go back to reference Murray DW, Britton AR, Bulstrode CJK: Loss to follow-up matters. J Bone Joint Surg Br 1997, 79B: 254–257.CrossRef Murray DW, Britton AR, Bulstrode CJK: Loss to follow-up matters. J Bone Joint Surg Br 1997, 79B: 254–257.CrossRef
19.
go back to reference Robertson O, Dunbar MJ: Patient satisfaction compared with general health and disease-specific questionnaires in knee arthroplasty patients. J Arthroplast 2001, 16: 476–482. 10.1054/arth.2001.22395aCrossRef Robertson O, Dunbar MJ: Patient satisfaction compared with general health and disease-specific questionnaires in knee arthroplasty patients. J Arthroplast 2001, 16: 476–482. 10.1054/arth.2001.22395aCrossRef
20.
go back to reference Ludemann R, Watson DI, Jamieson GG: Influence of follow-up methodology and completeness on apparent clinical outcome of fundoplication. Am J Surg 2003, 186: 143–147. 10.1016/S0002-9610(03)00175-2CrossRefPubMed Ludemann R, Watson DI, Jamieson GG: Influence of follow-up methodology and completeness on apparent clinical outcome of fundoplication. Am J Surg 2003, 186: 143–147. 10.1016/S0002-9610(03)00175-2CrossRefPubMed
21.
go back to reference Communities and Local Government: The English Indices of Deprivation 2007. Communities and Local Government Publications; 2007. Communities and Local Government: The English Indices of Deprivation 2007. Communities and Local Government Publications; 2007.
22.
go back to reference The EuroQol Group: EuroQol - a new facility for the measurement of health-related quality of life. Health Policy 1990, 16: 199–208.CrossRef The EuroQol Group: EuroQol - a new facility for the measurement of health-related quality of life. Health Policy 1990, 16: 199–208.CrossRef
23.
go back to reference Dawson J, Fitzpatrick R, Carr A, Murray D: Questionnaire on the perceptions of patients about total hip replacement. J Bone Joint Surg 1996, 78: 185–190. Dawson J, Fitzpatrick R, Carr A, Murray D: Questionnaire on the perceptions of patients about total hip replacement. J Bone Joint Surg 1996, 78: 185–190.
24.
go back to reference Dawson J, Fitzpatrick R, Murray D, Carr A: Questionnaire on the perceptions of patients about total knee replacement. J Bone Joint Surg 1998, 80: 63–69. 10.1302/0301-620X.80B1.7859CrossRef Dawson J, Fitzpatrick R, Murray D, Carr A: Questionnaire on the perceptions of patients about total knee replacement. J Bone Joint Surg 1998, 80: 63–69. 10.1302/0301-620X.80B1.7859CrossRef
25.
go back to reference Garratt AM, MacDonald LM, Ruta DA, et al.: Towards measurement of outcome for patients with varicose veins. Qual Health Care 1993, 2: 5–10. 10.1136/qshc.2.1.5PubMedCentralCrossRefPubMed Garratt AM, MacDonald LM, Ruta DA, et al.: Towards measurement of outcome for patients with varicose veins. Qual Health Care 1993, 2: 5–10. 10.1136/qshc.2.1.5PubMedCentralCrossRefPubMed
26.
go back to reference Royston P: Multiple imputation of missing values: update. Stata J 2005, 5: 1–14. Royston P: Multiple imputation of missing values: update. Stata J 2005, 5: 1–14.
27.
go back to reference Sterne JAC, White IR, Carlin JB, et al.: Multiple imputation for missing data in epidemiological and clinical research; potentials and pitfalls. BMJ 2009, 338: b2393. 10.1136/bmj.b2393PubMedCentralCrossRefPubMed Sterne JAC, White IR, Carlin JB, et al.: Multiple imputation for missing data in epidemiological and clinical research; potentials and pitfalls. BMJ 2009, 338: b2393. 10.1136/bmj.b2393PubMedCentralCrossRefPubMed
Metadata
Title
Factors associated with non-response in routine use of patient reported outcome measures after elective surgery in England
Authors
Andrew Hutchings
Jenny Neuburger
Kirstin Grosse Frie
Nick Black
Jan van der Meulen
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2012
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-10-34

Other articles of this Issue 1/2012

Health and Quality of Life Outcomes 1/2012 Go to the issue