Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2014

Open Access 01-12-2014 | Research article

Using mixed methods to select optimal mode of administration for a patient-reported outcome instrument for people with pressure ulcers

Authors: Claudia Rutherford, Jane Nixon, Julia M Brown, Donna L Lamping, Stefan J Cano

Published in: BMC Medical Research Methodology | Issue 1/2014

Login to get access

Abstract

Background

When developing new measuring instruments or deciding upon one for research, consideration of the ‘best’ method of administration for the target population should be made. Current evidence is inconsistent in differentiating superiority of any one method in terms of quantity and quality of response. We trialed a novel mixed methods approach in early scale development to determine the best administration method for a new patient-reported outcome instrument for people with pressure ulcers (the PU-QOL).

Methods

Cognitive interviews were undertaken with 35 people with pressure ulcers to determine appropriateness of a self-completed version of the PU-QOL instrument. Quantitative analysis, including Rasch analysis, was carried out on PU-QOL data from 70 patients with pressure ulcers, randomised to self-completed or interview-administered groups, to examine data quality and differential item functioning (DIF).

Results

Cognitive interviews identified issues with PU-QOL self-completion. Quantitative analysis supported these findings with a large proportion of self-completed PU-QOLs returned with missing data. DIF analysis indicated administration methods did not impact the way patients from community care settings responded, supporting the equivalence of both administration versions.

Conclusions

Obtaining the best possible health outcomes data requires use of appropriate methods to ensure high quality data with minimal bias. Mixed methods, with the inclusion of Rasch, provided valuable evidence to support selection of the ‘best’ administration method for people with PUs during early PRO instrument development. We consider our approach to be generic and widely applicable to other elderly or chronically ill populations or suitable for use in limited samples where recruitment to large field tests is often difficult.
Appendix
Available only for authorised users
Literature
1.
go back to reference Greenfield S, Nelson E: Recent developments and future issues in the use of health status assessment measures in clinical settings. Med Care. 1992, 20: S23-41. Greenfield S, Nelson E: Recent developments and future issues in the use of health status assessment measures in clinical settings. Med Care. 1992, 20: S23-41.
2.
go back to reference Hobart J, Cano S, Zajicek J, Thompson A: Rating scales as outcome measures for clinical trials in neurology: problems, solutions, and recommendations. Lancet Neurol. 2007, 6: 1094-95. 10.1016/S1474-4422(07)70290-9.CrossRefPubMed Hobart J, Cano S, Zajicek J, Thompson A: Rating scales as outcome measures for clinical trials in neurology: problems, solutions, and recommendations. Lancet Neurol. 2007, 6: 1094-95. 10.1016/S1474-4422(07)70290-9.CrossRefPubMed
4.
go back to reference Scientific Advisory Committee of the Medical Outcomes Trust: Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002, 11: 193-205. 10.1023/A:1015291021312.CrossRef Scientific Advisory Committee of the Medical Outcomes Trust: Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002, 11: 193-205. 10.1023/A:1015291021312.CrossRef
5.
go back to reference McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, et al: Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. Health Technol Assess. 2001, 5: 1-256.CrossRefPubMed McColl E, Jacoby A, Thomas L, Soutter J, Bamford C, Steen N, et al: Design and use of questionnaires: a review of best practice applicable to surveys of health service staff and patients. Health Technol Assess. 2001, 5: 1-256.CrossRefPubMed
6.
go back to reference Puhan M, Ahuja A, Van Natta M, Ackatz L, Meinert C: Interviewer versus self-administered health-related quality of life questionnaires-Does it matter?. Health Qual Life Outcomes. 2011, doi:10.1186/1477-7525-9-30 Puhan M, Ahuja A, Van Natta M, Ackatz L, Meinert C: Interviewer versus self-administered health-related quality of life questionnaires-Does it matter?. Health Qual Life Outcomes. 2011, doi:10.1186/1477-7525-9-30
7.
go back to reference Bowling A: Mode of questionnaire administration can have serious effects on data quality. J Public Health. 2005, 27: 281-291. 10.1093/pubmed/fdi031.CrossRef Bowling A: Mode of questionnaire administration can have serious effects on data quality. J Public Health. 2005, 27: 281-291. 10.1093/pubmed/fdi031.CrossRef
8.
go back to reference Newton R, Prensky D, Schuessler K: Form effect in the measurement of feeling states. Soc Sci Res. 1982, 11: 301-17. 10.1016/0049-089X(82)90001-1.CrossRef Newton R, Prensky D, Schuessler K: Form effect in the measurement of feeling states. Soc Sci Res. 1982, 11: 301-17. 10.1016/0049-089X(82)90001-1.CrossRef
9.
go back to reference Haywood KL, Garratt AM, Fitzpatrick R: Quality of life in older people: a structured review of generic self-assessed health instruments. Qual Life Res. 2005, 14: 1651-1668. 10.1007/s11136-005-1743-0.CrossRefPubMed Haywood KL, Garratt AM, Fitzpatrick R: Quality of life in older people: a structured review of generic self-assessed health instruments. Qual Life Res. 2005, 14: 1651-1668. 10.1007/s11136-005-1743-0.CrossRefPubMed
10.
go back to reference McHorney CA: Measuring and monitoring general health status in elderly persons: Practical and methodological issues in using the SF-36 health survey. Gerontologist. 1996, 36: 571-583. 10.1093/geront/36.5.571.CrossRefPubMed McHorney CA: Measuring and monitoring general health status in elderly persons: Practical and methodological issues in using the SF-36 health survey. Gerontologist. 1996, 36: 571-583. 10.1093/geront/36.5.571.CrossRefPubMed
11.
go back to reference McHorney C, Kosinski M, Ware J: Comparisons of the cost and quality of norms for the SF-36 health survey collected by mail versus telephone interview: results from a national survey. Med Care. 1994, 32: 551-67. 10.1097/00005650-199406000-00002.CrossRefPubMed McHorney C, Kosinski M, Ware J: Comparisons of the cost and quality of norms for the SF-36 health survey collected by mail versus telephone interview: results from a national survey. Med Care. 1994, 32: 551-67. 10.1097/00005650-199406000-00002.CrossRefPubMed
12.
go back to reference Sikorski A, Given C, Given B, Jeon A, You M: Differential symptom reporting by mode of administration of the assessment: automated voice response system versus a live telephone interview. Med Care. 2009, 47: 866-874. 10.1097/MLR.0b013e3181a31d00.CrossRef Sikorski A, Given C, Given B, Jeon A, You M: Differential symptom reporting by mode of administration of the assessment: automated voice response system versus a live telephone interview. Med Care. 2009, 47: 866-874. 10.1097/MLR.0b013e3181a31d00.CrossRef
13.
go back to reference Weinberger M, Oddone E, Samsa G, Landsman P: Are health-related quality of life measures affected by the mode of administration?. J Clin Epidemiol. 1996, 49: 135-140. 10.1016/0895-4356(95)00556-0.CrossRefPubMed Weinberger M, Oddone E, Samsa G, Landsman P: Are health-related quality of life measures affected by the mode of administration?. J Clin Epidemiol. 1996, 49: 135-140. 10.1016/0895-4356(95)00556-0.CrossRefPubMed
14.
go back to reference Rasch G: Probabilistic models for some intelligence and attainment tests. 1960, Chicago: University of Chicago Rasch G: Probabilistic models for some intelligence and attainment tests. 1960, Chicago: University of Chicago
15.
go back to reference Linacre J: Sample size and item calibration stability. Rasch Meas Trans. 1994, 7: 328- Linacre J: Sample size and item calibration stability. Rasch Meas Trans. 1994, 7: 328-
17.
go back to reference NICE: CG7 Pressure ulcer prevention. web . 2003. from the NICE, UK website NICE: CG7 Pressure ulcer prevention. web . 2003. from the NICE, UK website
18.
go back to reference Gorecki C, Brown J, Nelson E, Briggs M, Schoonhoven L, Dealey C, et al: Impact of pressure ulcers on quality of life in older patients: a systematic review. J Am Geriatr Soc. 2009, 57: 1175-1183. 10.1111/j.1532-5415.2009.02307.x.CrossRefPubMed Gorecki C, Brown J, Nelson E, Briggs M, Schoonhoven L, Dealey C, et al: Impact of pressure ulcers on quality of life in older patients: a systematic review. J Am Geriatr Soc. 2009, 57: 1175-1183. 10.1111/j.1532-5415.2009.02307.x.CrossRefPubMed
19.
go back to reference Gorecki C, Nixon J, Lamping DL, Alavi Y, Brown JM: Patient-reported outcome measures for chronic wounds with particular reference to pressure ulcer research: A systematic review. Int J Nurs Stud. 2013, 51: 157-65.CrossRefPubMed Gorecki C, Nixon J, Lamping DL, Alavi Y, Brown JM: Patient-reported outcome measures for chronic wounds with particular reference to pressure ulcer research: A systematic review. Int J Nurs Stud. 2013, 51: 157-65.CrossRefPubMed
20.
go back to reference Gorecki C, Lamping D, Nixon J, Brown J, Cano S: Applying mixed methods to pretest the Pressure Ulcer Quality of Life (PU-QOL) instrument. Qual Life Res. 2012, 21: 441-451. 10.1007/s11136-011-9980-x.CrossRefPubMed Gorecki C, Lamping D, Nixon J, Brown J, Cano S: Applying mixed methods to pretest the Pressure Ulcer Quality of Life (PU-QOL) instrument. Qual Life Res. 2012, 21: 441-451. 10.1007/s11136-011-9980-x.CrossRefPubMed
21.
go back to reference Gorecki C, Lamping DL, Brown JM, Madill A, Firth J, Nixon J: Development of a conceptual framework of health-related quality of life in pressure ulcers: a patient-focused approach. Int J Nurs Stud. 2010, 47: 1525-1534. 10.1016/j.ijnurstu.2010.05.014.CrossRefPubMed Gorecki C, Lamping DL, Brown JM, Madill A, Firth J, Nixon J: Development of a conceptual framework of health-related quality of life in pressure ulcers: a patient-focused approach. Int J Nurs Stud. 2010, 47: 1525-1534. 10.1016/j.ijnurstu.2010.05.014.CrossRefPubMed
22.
go back to reference Andrich D: Rasch models for measurement. 1988, Beverly Hills: Sage PublicationsCrossRef Andrich D: Rasch models for measurement. 1988, Beverly Hills: Sage PublicationsCrossRef
23.
go back to reference Hagquist C, Andrich D: Is the Sense of Coherence-instrument applicable on adolescents? A latent trait analysis using Rasch modelling. Pers Individ Differ. 2004, 36: 955-968. 10.1016/S0191-8869(03)00164-8.CrossRef Hagquist C, Andrich D: Is the Sense of Coherence-instrument applicable on adolescents? A latent trait analysis using Rasch modelling. Pers Individ Differ. 2004, 36: 955-968. 10.1016/S0191-8869(03)00164-8.CrossRef
25.
go back to reference Vileikyte L, Peyrot M, Bundy C, Rubin RR, Leventhal H, Mora P, et al: The development and validation of a neuropathy- and foot ulcer-specific quality of life instrument. Diabetes Care. 2003, 26 (9): 2549-2555. 10.2337/diacare.26.9.2549. (26 ref) 2003, 2549-2555CrossRefPubMed Vileikyte L, Peyrot M, Bundy C, Rubin RR, Leventhal H, Mora P, et al: The development and validation of a neuropathy- and foot ulcer-specific quality of life instrument. Diabetes Care. 2003, 26 (9): 2549-2555. 10.2337/diacare.26.9.2549. (26 ref) 2003, 2549-2555CrossRefPubMed
26.
go back to reference Andrich D: Distinctions between assumptions and requirements in measurements in the social sciences. Mathematical and Theoretical Systems: Vol 4. Edited by: Keats JA, Taft R, Heath RA, Lovibond SH. 1989, North Holland: Elsevier Science Publishers, 7-16. Andrich D: Distinctions between assumptions and requirements in measurements in the social sciences. Mathematical and Theoretical Systems: Vol 4. Edited by: Keats JA, Taft R, Heath RA, Lovibond SH. 1989, North Holland: Elsevier Science Publishers, 7-16.
27.
go back to reference Cano S, Barrett L, Zajicek J, Hobart J: Beyond the reach of traditional analyses: using Rasch to evaluate the DASH in people with multiple sclerosis. Mult Scler J. 2011, 17: 214-222. 10.1177/1352458510385269.CrossRef Cano S, Barrett L, Zajicek J, Hobart J: Beyond the reach of traditional analyses: using Rasch to evaluate the DASH in people with multiple sclerosis. Mult Scler J. 2011, 17: 214-222. 10.1177/1352458510385269.CrossRef
28.
go back to reference Andrich D: An elaboration of Guttman scaling with Rasch models for measurement. Sociological Methodology. Edited by: Brandon-Tuma N. 1985, San Francisco: Jossey-Bass, 33-80. Andrich D: An elaboration of Guttman scaling with Rasch models for measurement. Sociological Methodology. Edited by: Brandon-Tuma N. 1985, San Francisco: Jossey-Bass, 33-80.
29.
go back to reference Zumbo BD: A handbook on the theory and methods of Differential Item Functioning (DIF): logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores. 1999, Ottawa, ON: Directorate of Human Resources Research and Evaluation, Department of National Defense Zumbo BD: A handbook on the theory and methods of Differential Item Functioning (DIF): logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores. 1999, Ottawa, ON: Directorate of Human Resources Research and Evaluation, Department of National Defense
30.
go back to reference Teresi J, Ramirez M, Lai J, Silver S: Occurrences and sources of Differential Item Functioning (DIF) in patient-reported outcome measures: description of DIF methods, and review of measures of depression, quality of life and general health. Psychol Sci Q. 2008, 50: 538-PubMedPubMedCentral Teresi J, Ramirez M, Lai J, Silver S: Occurrences and sources of Differential Item Functioning (DIF) in patient-reported outcome measures: description of DIF methods, and review of measures of depression, quality of life and general health. Psychol Sci Q. 2008, 50: 538-PubMedPubMedCentral
31.
go back to reference Andrich D, Sheridan B, Luo G: RUMM 2030. 4.0 for windows (upgrade 4600.0109. 2010, Perth, WA: RUMM Laboratory, PTY LTD Andrich D, Sheridan B, Luo G: RUMM 2030. 4.0 for windows (upgrade 4600.0109. 2010, Perth, WA: RUMM Laboratory, PTY LTD
33.
go back to reference Bonferroni C: Teoria statistica delle classi e calcolo delle probabilit’a. Pubblicazionidel R Istituto Superiore di Scienze Economichee Commerciali di Firenze.  . 2011, 8: 3-62. Bonferroni C: Teoria statistica delle classi e calcolo delle probabilit’a. Pubblicazionidel R Istituto Superiore di Scienze Economichee Commerciali di Firenze.  . 2011, 8: 3-62.
34.
35.
go back to reference Fletcher A, Bulpitt C: Quality of life and hypertensive drugs in the elderly. Ageing Clin Exp Res. 1992, 4: 115-123. 10.1007/BF03324077.CrossRef Fletcher A, Bulpitt C: Quality of life and hypertensive drugs in the elderly. Ageing Clin Exp Res. 1992, 4: 115-123. 10.1007/BF03324077.CrossRef
36.
go back to reference Hayes V, Morris J, Wolfe C, Morgan M: The SF-36 health survey questionnaire: is it suitable for use with older adults?. Age Ageing. 1995, 24: 120-125. 10.1093/ageing/24.2.120.CrossRefPubMed Hayes V, Morris J, Wolfe C, Morgan M: The SF-36 health survey questionnaire: is it suitable for use with older adults?. Age Ageing. 1995, 24: 120-125. 10.1093/ageing/24.2.120.CrossRefPubMed
37.
go back to reference Hobart J, Cano S: Improving the evaluation of therapeutic interventions in multiple sclerosis: the role of new psychometric methods. Health Techno Assess. 2009, 13: 1-177. Hobart J, Cano S: Improving the evaluation of therapeutic interventions in multiple sclerosis: the role of new psychometric methods. Health Techno Assess. 2009, 13: 1-177.
Metadata
Title
Using mixed methods to select optimal mode of administration for a patient-reported outcome instrument for people with pressure ulcers
Authors
Claudia Rutherford
Jane Nixon
Julia M Brown
Donna L Lamping
Stefan J Cano
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2014
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-14-22

Other articles of this Issue 1/2014

BMC Medical Research Methodology 1/2014 Go to the issue