Skip to main content
Top
Published in: Clinical Orthopaedics and Related Research® 10/2013

01-10-2013 | Clinical Research

Factors Associated With Survey Response in Hand Surgery Research

Authors: Arjan G. J. Bot, MD, Jade A. Anderson, BS, Valentin Neuhaus, MD, David Ring, MD, PhD

Published in: Clinical Orthopaedics and Related Research® | Issue 10/2013

Login to get access

Abstract

Background

A low response rate is believed to decrease the validity of survey studies. Factors associated with nonresponse to surveys are poorly characterized in orthopaedic research.

Questions/purposes

This study addressed whether (1) psychologic factors; (2) demographics; (3) illness-related factors; and (4) pain are predictors of a lower likelihood of a patient returning a mailed survey.

Methods

One hundred four adult, new or return patients completed questionnaires including the Pain Catastrophizing Scale, Patient Health Questionnaire-9 depression scale, Short Health Anxiety Index, demographics, and a pain scale (0–10) during a routine visit to a hand and upper extremity surgeon. Of these patients, 38% had undergone surgery and the remainder was seen for various other conditions. Six months after their visit, patients were mailed the DASH questionnaire and a scale to rate their satisfaction with the visit (0–10). Bivariate analysis and logistic regression were used to determine risk factors for being a nonresponder to the followup of this study. The cohort consisted of 57 women and 47 men with a mean age of 51 years with various diagnoses. Thirty-five patients (34%) returned the questionnaire. Responders were satisfied with their visit (mean satisfaction, 8.7) and had a DASH score of 9.6.

Results

Compared with patients who returned the questionnaires, nonresponders had higher pain catastrophizing scores, were younger, more frequently male, and had more pain at enrollment. In logistic regression, male sex (odds ratio [OR], 2.6), pain (OR, 1.3), and younger age (OR, 1.03) were associated with not returning the questionnaire.

Conclusions

Survey studies should be interpreted in light of the fact that patients who do not return questionnaires in a hand surgery practice differ from patients who do return them. Hand surgery studies that rely on questionnaire evaluation remote from study enrollment should include tactics to improve the response of younger, male patients with more pain.

Level of Evidence

Level II, prognostic study. See Guidelines for Authors for a complete description of levels of evidence.
Literature
1.
go back to reference Asch DA, Jedrziewski MK, Christakis NA. Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997;50:1129–1136.PubMedCrossRef Asch DA, Jedrziewski MK, Christakis NA. Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997;50:1129–1136.PubMedCrossRef
2.
go back to reference Baker PN, Khaw FM, Kirk LM, Esler CN, Gregg PJ. A randomised controlled trial of cemented versus cementless press-fit condylar total knee replacement: 15-year survival analysis. J Bone Joint Surg Br. 2007;89:1608–1614.PubMed Baker PN, Khaw FM, Kirk LM, Esler CN, Gregg PJ. A randomised controlled trial of cemented versus cementless press-fit condylar total knee replacement: 15-year survival analysis. J Bone Joint Surg Br. 2007;89:1608–1614.PubMed
3.
go back to reference Bilbao A, Quintana JM, Escobar A, Las Hayas C, Orive M. Validation of a proposed WOMAC short form for patients with hip osteoarthritis. Health Qual Life Outcomes. 2011;9:75.PubMedCrossRef Bilbao A, Quintana JM, Escobar A, Las Hayas C, Orive M. Validation of a proposed WOMAC short form for patients with hip osteoarthritis. Health Qual Life Outcomes. 2011;9:75.PubMedCrossRef
4.
go back to reference Brown AP, Lawrie HE, Kennedy AD, Webb JA, Torgerson DJ, Grant AM. Cost effectiveness of a prize draw on response to a postal questionnaire: results of a randomised trial among orthopaedic outpatients in Edinburgh. J Epidemiol Community Health. 1997;51:463–464.PubMedCrossRef Brown AP, Lawrie HE, Kennedy AD, Webb JA, Torgerson DJ, Grant AM. Cost effectiveness of a prize draw on response to a postal questionnaire: results of a randomised trial among orthopaedic outpatients in Edinburgh. J Epidemiol Community Health. 1997;51:463–464.PubMedCrossRef
5.
go back to reference Cartwright-Terry M, Snow M, Nalwad H. The severity and prediction of anterior knee pain post tibial nail insertion. J Orthop Trauma. 2007;21:381–385.PubMedCrossRef Cartwright-Terry M, Snow M, Nalwad H. The severity and prediction of anterior knee pain post tibial nail insertion. J Orthop Trauma. 2007;21:381–385.PubMedCrossRef
6.
go back to reference Curtin R, Presser S, Singer E. The effects of response rate changes on the index of consumer sentiment. Public Opin Q. 2000;64:413–428.PubMedCrossRef Curtin R, Presser S, Singer E. The effects of response rate changes on the index of consumer sentiment. Public Opin Q. 2000;64:413–428.PubMedCrossRef
7.
go back to reference Dallosso HM, Matthews RJ, McGrother CW, Clarke M, Perry SI, Shaw C, Jagger C; Leicestershire MRC Incontinence Study Team. An investigation into nonresponse bias in a postal survey on urinary symptoms. BJU Int. 2003;91:631–636.PubMedCrossRef Dallosso HM, Matthews RJ, McGrother CW, Clarke M, Perry SI, Shaw C, Jagger C; Leicestershire MRC Incontinence Study Team. An investigation into nonresponse bias in a postal survey on urinary symptoms. BJU Int. 2003;91:631–636.PubMedCrossRef
8.
go back to reference Gustafsson M, Hagberg L, Holmefur M. Ten years follow-up of health and disability in people with acute traumatic hand injury: pain and cold sensitivity are long-standing problems. J Hand Surg Eur Vol. 2011;36:590–598.PubMedCrossRef Gustafsson M, Hagberg L, Holmefur M. Ten years follow-up of health and disability in people with acute traumatic hand injury: pain and cold sensitivity are long-standing problems. J Hand Surg Eur Vol. 2011;36:590–598.PubMedCrossRef
9.
go back to reference Hardie JA, Bakke PS, Morkve O. Non-response bias in a postal questionnaire survey on respiratory health in the old and very old. Scand J Public Health. 2003;31:411–417.PubMedCrossRef Hardie JA, Bakke PS, Morkve O. Non-response bias in a postal questionnaire survey on respiratory health in the old and very old. Scand J Public Health. 2003;31:411–417.PubMedCrossRef
10.
go back to reference Hellum C, Johnsen LG, Storheim K, Nygaard OP, Brox JI, Rossvoll I, Ro M, Sandvik L, Grundnes O; Norwegian Spine Study Group. Surgery with disc prosthesis versus rehabilitation in patients with low back pain and degenerative disc: two year follow-up of randomised study. BMJ. 2011;342:d2786.PubMedCrossRef Hellum C, Johnsen LG, Storheim K, Nygaard OP, Brox JI, Rossvoll I, Ro M, Sandvik L, Grundnes O; Norwegian Spine Study Group. Surgery with disc prosthesis versus rehabilitation in patients with low back pain and degenerative disc: two year follow-up of randomised study. BMJ. 2011;342:d2786.PubMedCrossRef
11.
go back to reference Hudak PL, Amadio PC, Bombardier C. Development of an upper extremity outcome measure: the DASH (disabilities of the arm, shoulder and hand) [corrected]. The Upper Extremity Collaborative Group (UECG). Am J Ind Med. 1996;29:602–608.PubMedCrossRef Hudak PL, Amadio PC, Bombardier C. Development of an upper extremity outcome measure: the DASH (disabilities of the arm, shoulder and hand) [corrected]. The Upper Extremity Collaborative Group (UECG). Am J Ind Med. 1996;29:602–608.PubMedCrossRef
12.
go back to reference Hwang RW, Ring D. Pain and disability related to osteoarthrosis of the trapeziometacarpal joint. J Hand Microsurg. 2011;3:63–65.PubMedCrossRef Hwang RW, Ring D. Pain and disability related to osteoarthrosis of the trapeziometacarpal joint. J Hand Microsurg. 2011;3:63–65.PubMedCrossRef
13.
go back to reference Jacobsen BK, Thelle DS. The Tromso Heart Study: responders and non-responders to a health questionnaire, do they differ? Scand J Soc Med. 1988;16:101–104.PubMed Jacobsen BK, Thelle DS. The Tromso Heart Study: responders and non-responders to a health questionnaire, do they differ? Scand J Soc Med. 1988;16:101–104.PubMed
14.
go back to reference Keeter S, Kennedy C, Dimock M, Best J, Craighill P. Gauging the impact of growing nonresponse on estimates from a national RDD telephone survey. Public Opin Q. 2006;70:759–779.CrossRef Keeter S, Kennedy C, Dimock M, Best J, Craighill P. Gauging the impact of growing nonresponse on estimates from a national RDD telephone survey. Public Opin Q. 2006;70:759–779.CrossRef
15.
go back to reference Kim J, Lonner JH, Nelson CL, Lotke PA. Response bias: effect on outcomes evaluation by mail surveys after total knee arthroplasty. J Bone Joint Surg Am. 2004;86:15–21.PubMedCrossRef Kim J, Lonner JH, Nelson CL, Lotke PA. Response bias: effect on outcomes evaluation by mail surveys after total knee arthroplasty. J Bone Joint Surg Am. 2004;86:15–21.PubMedCrossRef
16.
go back to reference Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–613.PubMedCrossRef Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–613.PubMedCrossRef
17.
go back to reference Kwon SK, Kang YG, Chang CB, Sung SC, Kim TK. Interpretations of the clinical outcomes of the nonresponders to mail surveys in patients after total knee arthroplasty. J Arthroplasty. 2010;25:133–137.PubMedCrossRef Kwon SK, Kang YG, Chang CB, Sung SC, Kim TK. Interpretations of the clinical outcomes of the nonresponders to mail surveys in patients after total knee arthroplasty. J Arthroplasty. 2010;25:133–137.PubMedCrossRef
18.
go back to reference Kypri K, Samaranayaka A, Connor J, Langley JD, Maclennan B. Non-response bias in a web-based health behaviour survey of New Zealand tertiary students. Prev Med. 2011;53:274–277.PubMedCrossRef Kypri K, Samaranayaka A, Connor J, Langley JD, Maclennan B. Non-response bias in a web-based health behaviour survey of New Zealand tertiary students. Prev Med. 2011;53:274–277.PubMedCrossRef
19.
go back to reference Lozano Calderon SA, Paiva A, Ring D. Patient satisfaction after open carpal tunnel release correlates with depression. J Hand Surg Am. 2008;33:303–307. Lozano Calderon SA, Paiva A, Ring D. Patient satisfaction after open carpal tunnel release correlates with depression. J Hand Surg Am. 2008;33:303–307.
20.
go back to reference Lozano-Calderon SA, Souer JS, Jupiter JB, Ring D. Psychological differences between patients that elect operative or nonoperative treatment for trapeziometacarpal joint arthrosis. Hand. 2008;3:271–275.PubMedCrossRef Lozano-Calderon SA, Souer JS, Jupiter JB, Ring D. Psychological differences between patients that elect operative or nonoperative treatment for trapeziometacarpal joint arthrosis. Hand. 2008;3:271–275.PubMedCrossRef
21.
go back to reference Macera CA, Jackson KL, Davis DR, Kronenfeld JJ, Blair SN. Patterns of non-response to a mail survey. J Clin Epidemiol. 1990;43:1427–1430.PubMedCrossRef Macera CA, Jackson KL, Davis DR, Kronenfeld JJ, Blair SN. Patterns of non-response to a mail survey. J Clin Epidemiol. 1990;43:1427–1430.PubMedCrossRef
22.
go back to reference McGrath RE, Mitchell M, Kim BH, Hough L. Evidence for response bias as a source of error variance in applied assessment. Psychol Bull. 2010;136:450–470.PubMedCrossRef McGrath RE, Mitchell M, Kim BH, Hough L. Evidence for response bias as a source of error variance in applied assessment. Psychol Bull. 2010;136:450–470.PubMedCrossRef
23.
go back to reference Rowden NJ, Harrison JA, Graves SE, Miller LN, de Steiger RN, Davidson DC. Loss to follow-up after arthroplasty: a new use for registry data. J Bone Joint Surg Br. 2012;94:493–496.PubMed Rowden NJ, Harrison JA, Graves SE, Miller LN, de Steiger RN, Davidson DC. Loss to follow-up after arthroplasty: a new use for registry data. J Bone Joint Surg Br. 2012;94:493–496.PubMed
24.
go back to reference Salkovskis PM, Rimes KA, Warwick HM, Clark DM. The Health Anxiety Inventory: development and validation of scales for the measurement of health anxiety and hypochondriasis. Psychol Med. 2002;32:843–853.PubMedCrossRef Salkovskis PM, Rimes KA, Warwick HM, Clark DM. The Health Anxiety Inventory: development and validation of scales for the measurement of health anxiety and hypochondriasis. Psychol Med. 2002;32:843–853.PubMedCrossRef
25.
go back to reference Schweitzer M, Asch DA. Timing payments to subjects of mail surveys: cost-effectiveness and bias. J Clin Epidemiol. 1995;48:1325–1329.PubMedCrossRef Schweitzer M, Asch DA. Timing payments to subjects of mail surveys: cost-effectiveness and bias. J Clin Epidemiol. 1995;48:1325–1329.PubMedCrossRef
26.
go back to reference Solberg TK, Sorlie A, Sjaavik K, Nygaard OP, Ingebrigtsen T. Would loss to follow-up bias the outcome evaluation of patients operated for degenerative disorders of the lumbar spine? Acta Orthop. 2011;82:56–63.PubMedCrossRef Solberg TK, Sorlie A, Sjaavik K, Nygaard OP, Ingebrigtsen T. Would loss to follow-up bias the outcome evaluation of patients operated for degenerative disorders of the lumbar spine? Acta Orthop. 2011;82:56–63.PubMedCrossRef
27.
go back to reference Sprague S, Leece P, Bhandari M, Tornetta P 3rd, Schemitsch E, Swiontkowski MF, S.P.R.I.N.T. Investigators. Limiting loss to follow-up in a multicenter randomized trial in orthopedic surgery. Control Clin Trials. 2003;24:719–725.PubMed Sprague S, Leece P, Bhandari M, Tornetta P 3rd, Schemitsch E, Swiontkowski MF, S.P.R.I.N.T. Investigators. Limiting loss to follow-up in a multicenter randomized trial in orthopedic surgery. Control Clin Trials. 2003;24:719–725.PubMed
28.
go back to reference Sullivan MJ, Bishop SR, Scott R, Pivik J. The Pain Catastrophizing Scale: development and validation. Psychol Assess. 1995;7:525–532.CrossRef Sullivan MJ, Bishop SR, Scott R, Pivik J. The Pain Catastrophizing Scale: development and validation. Psychol Assess. 1995;7:525–532.CrossRef
29.
go back to reference Thwaites J, Mann F, Gilchrist N, McKie J, Sainsbury R. Older patients with hip fractures: evaluation of a long-term specialist orthopaedic medicine service in their outcomes. N Z Med J. 2007;120:U2535.PubMed Thwaites J, Mann F, Gilchrist N, McKie J, Sainsbury R. Older patients with hip fractures: evaluation of a long-term specialist orthopaedic medicine service in their outcomes. N Z Med J. 2007;120:U2535.PubMed
30.
go back to reference Ultee J, van Neck JW, Jaquet JB, Hovius SE. Difficulties in conducting a prospective outcome study. Hand Clin. 2003;19:457–462.PubMedCrossRef Ultee J, van Neck JW, Jaquet JB, Hovius SE. Difficulties in conducting a prospective outcome study. Hand Clin. 2003;19:457–462.PubMedCrossRef
31.
go back to reference Verlato G, Melotti R, Olivieri M, Corsico A, Bugiani M, Accordini S, Villani S, Migliore E, Marinoni A, Pirina P, Carrozzi L, Bortolami O, Rava M, de Marco R; ISAYA study group. Asthmatics and ex-smokers respond early, heavy smokers respond late to mailed surveys in Italy. Respir Med. 2010;104:172–179.PubMedCrossRef Verlato G, Melotti R, Olivieri M, Corsico A, Bugiani M, Accordini S, Villani S, Migliore E, Marinoni A, Pirina P, Carrozzi L, Bortolami O, Rava M, de Marco R; ISAYA study group. Asthmatics and ex-smokers respond early, heavy smokers respond late to mailed surveys in Italy. Respir Med. 2010;104:172–179.PubMedCrossRef
32.
go back to reference Visser PS, Krosnick JA, Marquette J, Curtin M. Mail surveys for election forecasting? An evaluation of the Colombus Dispatch poll. Public Opin Q. 1996;60:181–227.CrossRef Visser PS, Krosnick JA, Marquette J, Curtin M. Mail surveys for election forecasting? An evaluation of the Colombus Dispatch poll. Public Opin Q. 1996;60:181–227.CrossRef
33.
go back to reference Wylde V, Blom AW, Whitehouse SL, Taylor AH, Pattison GT, Bannister GC. Patient-reported outcomes after total hip and knee arthroplasty: comparison of midterm results. J Arthroplasty. 2009;24:210–216.PubMedCrossRef Wylde V, Blom AW, Whitehouse SL, Taylor AH, Pattison GT, Bannister GC. Patient-reported outcomes after total hip and knee arthroplasty: comparison of midterm results. J Arthroplasty. 2009;24:210–216.PubMedCrossRef
Metadata
Title
Factors Associated With Survey Response in Hand Surgery Research
Authors
Arjan G. J. Bot, MD
Jade A. Anderson, BS
Valentin Neuhaus, MD
David Ring, MD, PhD
Publication date
01-10-2013
Publisher
Springer US
Published in
Clinical Orthopaedics and Related Research® / Issue 10/2013
Print ISSN: 0009-921X
Electronic ISSN: 1528-1132
DOI
https://doi.org/10.1007/s11999-013-3126-0

Other articles of this Issue 10/2013

Clinical Orthopaedics and Related Research® 10/2013 Go to the issue

Symposium: 2012 Musculoskeletal Infection Society

Editorial Comment: Symposium: 2012 Musculoskeletal Infection Society