Skip to main content
Top
Published in: BMC Musculoskeletal Disorders 1/2010

Open Access 01-12-2010 | Research article

Listening to patients: using verbal data in the validation of the Aberdeen Measures of Impairment, Activity Limitation and Participation Restriction (Ab-IAP)

Authors: Jeremy Horwood, Beth Pollard, Salma Ayis, Teresa McIlvenna, Marie Johnston

Published in: BMC Musculoskeletal Disorders | Issue 1/2010

Login to get access

Abstract

Background

The purpose of the study was to evaluate the validity of the self-administered Aberdeen Measures of Impairment, Activity Limitation and Participation Restriction (Ab-IAP): by investigating how participants interpret and respond to questions using the cognitive interviewing technique.

Methods

Twenty patients with osteoarthritis of the knee or hip participated in a cognitive interview whilst completing the Ab-IAP. Interviews were conducted using the concurrent 'think aloud' design. All interviews were audio recorded and transcribed verbatim and analysed (i) using a standardised classification scheme to identify four types of response problems and (ii) thematically using the constant comparative technique.

Results

Participants used various response strategies when answering questions about impairment, activity limitations and participation restriction. Problems were judged to be present in 3.1% of participants' responses for the item Ab-IAP. Thematic analysis provided insight into the type and nature of problems people experienced when completing the Ab-IAP measures. The problems identified were mainly comprehension and response problems.

Conclusions

Participants had minimal difficulties completing the Ab-IAP; however those difficulties identified have prompted suggestions for improving the measures. The cognitive interviews produced results that were compatible with statistical analysis of the measures.. Cognitive interviewing was beneficial for testing the validity and acceptability of new Ab-IAP measures. The results demonstrates that the Ab-IAP, in addition to being theoretically-based and having good psychometric properties, elicits appropriate responses.
Literature
1.
go back to reference Pollard B, Dixon D, Dieppe P, Johnston M: Measuring the ICF components of Impairment, Activity Limitation and Participation Restriction: an item analysis using classical test theory and item response theory. Health and Quality of Life Outcomes. 2009, 7: 41-10.1186/1477-7525-7-41.CrossRefPubMedPubMedCentral Pollard B, Dixon D, Dieppe P, Johnston M: Measuring the ICF components of Impairment, Activity Limitation and Participation Restriction: an item analysis using classical test theory and item response theory. Health and Quality of Life Outcomes. 2009, 7: 41-10.1186/1477-7525-7-41.CrossRefPubMedPubMedCentral
2.
go back to reference World Health Organization: WHO international classification of functioning, disability and health. 2001, Geneva, World Health Organization World Health Organization: WHO international classification of functioning, disability and health. 2001, Geneva, World Health Organization
3.
go back to reference Pollard B, Johnston M, Dieppe P: What Do Osteoarthritis Health Outcome Instruments Measure? Impairment, Activity Limitation, or Participation Restriction?. Journal of Rheumatology. 2006, 33: 757-763.PubMed Pollard B, Johnston M, Dieppe P: What Do Osteoarthritis Health Outcome Instruments Measure? Impairment, Activity Limitation, or Participation Restriction?. Journal of Rheumatology. 2006, 33: 757-763.PubMed
4.
go back to reference Willis G, Reeve B, Barofsky I: The use of cognitive interviewing techniques in quality-of-life and patient-reported outcomes assessment. Outcomes Assessment in Cancer: Measures, Methods and Applications. Edited by: Lipscomb J, Gotay C, Snyder C. 2005, Cambridge University Press, 610-622. Willis G, Reeve B, Barofsky I: The use of cognitive interviewing techniques in quality-of-life and patient-reported outcomes assessment. Outcomes Assessment in Cancer: Measures, Methods and Applications. Edited by: Lipscomb J, Gotay C, Snyder C. 2005, Cambridge University Press, 610-622.
5.
go back to reference Mandal A, Eaden J, Mayberry M, Mayberry J: Questionnaire surveys in medical research. Journal of Evaluation in Clinical practice. 2000, 6: 395-403. 10.1046/j.1365-2753.2000.00263.x.CrossRefPubMed Mandal A, Eaden J, Mayberry M, Mayberry J: Questionnaire surveys in medical research. Journal of Evaluation in Clinical practice. 2000, 6: 395-403. 10.1046/j.1365-2753.2000.00263.x.CrossRefPubMed
6.
go back to reference Rosal M, Carbone E, Goins K: Use of cognitive interviewing to adapt measurement instruments for low-literate Hispanics. Diabetes Educ. 2003, 29: 1006-1017. 10.1177/014572170302900611.CrossRefPubMed Rosal M, Carbone E, Goins K: Use of cognitive interviewing to adapt measurement instruments for low-literate Hispanics. Diabetes Educ. 2003, 29: 1006-1017. 10.1177/014572170302900611.CrossRefPubMed
7.
go back to reference Ericsson K, Simon H: Protocol analysis: verbal reports as data. 1993, Cambridge, Massachusetts: MIT Press Ericsson K, Simon H: Protocol analysis: verbal reports as data. 1993, Cambridge, Massachusetts: MIT Press
8.
go back to reference Willis GB: Cognitive Interviewing. A Tool for Improving Questionnaire Design. 2005, Thousand Oaks: Sage PublicationsCrossRef Willis GB: Cognitive Interviewing. A Tool for Improving Questionnaire Design. 2005, Thousand Oaks: Sage PublicationsCrossRef
9.
go back to reference Mallinson S: Listening to respondents: a qualitative assessment of the Short-Form 36 Health Status Questionnaire. Social Science & Medicine. 2002, 54: 11-21.CrossRef Mallinson S: Listening to respondents: a qualitative assessment of the Short-Form 36 Health Status Questionnaire. Social Science & Medicine. 2002, 54: 11-21.CrossRef
10.
go back to reference Drennan J: Cognitive interviewing: verbal data in the design and pre-testing of questionnaires. Journal of Advanced Nursing. 2003, 42: 57-63. 10.1046/j.1365-2648.2003.02579.x.CrossRefPubMed Drennan J: Cognitive interviewing: verbal data in the design and pre-testing of questionnaires. Journal of Advanced Nursing. 2003, 42: 57-63. 10.1046/j.1365-2648.2003.02579.x.CrossRefPubMed
11.
go back to reference Bowden A, Fox-Rushby J, Nyandieka L, Wanjau J: Methods for pre-testing and piloting survey questions: illustrations from the KENQOL survey of health-related quality of life. Health Policy Plan. 2002, 17: 322-330. 10.1093/heapol/17.3.322.CrossRefPubMed Bowden A, Fox-Rushby J, Nyandieka L, Wanjau J: Methods for pre-testing and piloting survey questions: illustrations from the KENQOL survey of health-related quality of life. Health Policy Plan. 2002, 17: 322-330. 10.1093/heapol/17.3.322.CrossRefPubMed
12.
go back to reference French D, Cooke R, McLean N, Williams M, Sutton S: What do people think about when they answer theory of planned behaviour questionnaires? A 'think aloud' study. Journal of Health Psychology. 2007, 12: 672-687. 10.1177/1359105307078174.CrossRefPubMed French D, Cooke R, McLean N, Williams M, Sutton S: What do people think about when they answer theory of planned behaviour questionnaires? A 'think aloud' study. Journal of Health Psychology. 2007, 12: 672-687. 10.1177/1359105307078174.CrossRefPubMed
13.
go back to reference Greenhalgh J, Ford H, Long A, Hurst K: The MS Symptom and Impact Diary (MSSID): psychometric evaluation of a new instrument to measure the day to day impact of multiple sclerosis. Journal of Neurology, Neurosurgery and Psychiatry. 2004, 75: 577-582. 10.1136/jnnp.2003.020529.CrossRefPubMedPubMedCentral Greenhalgh J, Ford H, Long A, Hurst K: The MS Symptom and Impact Diary (MSSID): psychometric evaluation of a new instrument to measure the day to day impact of multiple sclerosis. Journal of Neurology, Neurosurgery and Psychiatry. 2004, 75: 577-582. 10.1136/jnnp.2003.020529.CrossRefPubMedPubMedCentral
14.
go back to reference Murtagh F, Addington-Hall J, igginson I: The value of cognitive interviewing techniques in palliative care research. Palliative Medicine. 2007, 21: 87-93. 10.1177/0269216306075367.CrossRefPubMed Murtagh F, Addington-Hall J, igginson I: The value of cognitive interviewing techniques in palliative care research. Palliative Medicine. 2007, 21: 87-93. 10.1177/0269216306075367.CrossRefPubMed
15.
go back to reference Tourangeau R: Cognitive Sciences and survey methods. Cognitive aspects of survey methodology: building a bridge between disciplines. Edited by: Jabine T, Straf M, Tanur J, Tourangeau R. 1984, Washington DC: National Academy Press Tourangeau R: Cognitive Sciences and survey methods. Cognitive aspects of survey methodology: building a bridge between disciplines. Edited by: Jabine T, Straf M, Tanur J, Tourangeau R. 1984, Washington DC: National Academy Press
16.
go back to reference Atlas ti: Computer software. 2005, Berlin: ATLAS.ti Scientific Software Development GmbH Atlas ti: Computer software. 2005, Berlin: ATLAS.ti Scientific Software Development GmbH
17.
go back to reference Glaser B, Strauss A: The Constant Comparative Method of Qualitative Analysis. The Discovery of Grounded Theory: Strategies for Qualitative Research. Edited by: Glaser B, Strauss A. 1967, Chicago: ALDINE Publishing Company, 101-158. Glaser B, Strauss A: The Constant Comparative Method of Qualitative Analysis. The Discovery of Grounded Theory: Strategies for Qualitative Research. Edited by: Glaser B, Strauss A. 1967, Chicago: ALDINE Publishing Company, 101-158.
18.
go back to reference Office for National Statistics: Standard Occupational Classification. 2000, London: The Stationary Office Office for National Statistics: Standard Occupational Classification. 2000, London: The Stationary Office
19.
go back to reference Landis J, Koch G: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed Landis J, Koch G: The measurement of observer agreement for categorical data. Biometrics. 1977, 33: 159-174. 10.2307/2529310.CrossRefPubMed
20.
go back to reference Conrad F, Blair J: Interpreting Verbal Reports in Cognitive Interviews: Probes Matter. Proceedings of the Annual Meeting of the American Statistical Association. 2001, , August 5-9 Conrad F, Blair J: Interpreting Verbal Reports in Cognitive Interviews: Probes Matter. Proceedings of the Annual Meeting of the American Statistical Association. 2001, , August 5-9
21.
go back to reference Martin E: Survey questionnaire construction. 2006, Washington, D.C: U.S. Census Bureau Martin E: Survey questionnaire construction. 2006, Washington, D.C: U.S. Census Bureau
22.
go back to reference McColl E, Meadows K, Barofsky I: Cognitive aspects of survey methodology and quality of life assessment. Quality of Life Research. 2003, 12: 217-218. 10.1023/A:1023233432721.CrossRefPubMed McColl E, Meadows K, Barofsky I: Cognitive aspects of survey methodology and quality of life assessment. Quality of Life Research. 2003, 12: 217-218. 10.1023/A:1023233432721.CrossRefPubMed
23.
go back to reference Sprangers MAG, Schwartz CE: Integrating response shift into health-related quality of life research: a theoretical model. Social Science & Medicine. 1999, 48: 1507-1515.CrossRef Sprangers MAG, Schwartz CE: Integrating response shift into health-related quality of life research: a theoretical model. Social Science & Medicine. 1999, 48: 1507-1515.CrossRef
24.
go back to reference Williams A, Davies H, Chadury Y: Simple pain rating scales hide complex idiosyncratic meanings. Pain. 2000, 85: 463-10.1016/S0304-3959(99)00299-7.CrossRef Williams A, Davies H, Chadury Y: Simple pain rating scales hide complex idiosyncratic meanings. Pain. 2000, 85: 463-10.1016/S0304-3959(99)00299-7.CrossRef
25.
go back to reference Morley S, Pallin V: Scaling the affective domain of pain: a study of the dimensionality of verbal descriptors. Pain. 1995, 62: 39-49. 10.1016/0304-3959(94)00226-5.CrossRefPubMed Morley S, Pallin V: Scaling the affective domain of pain: a study of the dimensionality of verbal descriptors. Pain. 1995, 62: 39-49. 10.1016/0304-3959(94)00226-5.CrossRefPubMed
26.
go back to reference Horn S, Munafo M: Pain: Theory, Research, and Intervention. 1997, Buckingham: Open University PressCrossRef Horn S, Munafo M: Pain: Theory, Research, and Intervention. 1997, Buckingham: Open University PressCrossRef
27.
go back to reference Barcley-Goddard R, Epstein J: Response shift: a brief overview and proposed research priorities. Quality of Life Research. 2009, 18: 335-346. 10.1007/s11136-009-9450-x.CrossRef Barcley-Goddard R, Epstein J: Response shift: a brief overview and proposed research priorities. Quality of Life Research. 2009, 18: 335-346. 10.1007/s11136-009-9450-x.CrossRef
28.
go back to reference Schwartz C, Bode R, Repucci N, Becker J, Sprangers M, Fayers P: The clinical significance of adaptation to changing health: a meta-analysis of response shift. Quality of Life Research. 2006, 15: 1533-1550. 10.1007/s11136-006-0025-9.CrossRefPubMed Schwartz C, Bode R, Repucci N, Becker J, Sprangers M, Fayers P: The clinical significance of adaptation to changing health: a meta-analysis of response shift. Quality of Life Research. 2006, 15: 1533-1550. 10.1007/s11136-006-0025-9.CrossRefPubMed
29.
go back to reference Adamson J, Gooberman-Hill R, Woolhead G, Donovan J: 'Questerviews': using questionnaires in qualitative interviews as a method of integrating qualitative and quantitative health services research. Journal of Health Service Research Policy. 2004, 9: 139-145. 10.1258/1355819041403268.CrossRef Adamson J, Gooberman-Hill R, Woolhead G, Donovan J: 'Questerviews': using questionnaires in qualitative interviews as a method of integrating qualitative and quantitative health services research. Journal of Health Service Research Policy. 2004, 9: 139-145. 10.1258/1355819041403268.CrossRef
30.
go back to reference Rothgeb J, Willis G, Forsyth B: Questionnaire Pretesting Methods: Do Different Techniques and Different Organizations Produce Similar Results?. 2005, Washington, DC: U.S. Census Bureau Rothgeb J, Willis G, Forsyth B: Questionnaire Pretesting Methods: Do Different Techniques and Different Organizations Produce Similar Results?. 2005, Washington, DC: U.S. Census Bureau
31.
go back to reference Collins D: Pretesting survey instruments: an overview of cognitive methods. Quality of Life Research. 2003, 12: 229-238. 10.1023/A:1023254226592.CrossRefPubMed Collins D: Pretesting survey instruments: an overview of cognitive methods. Quality of Life Research. 2003, 12: 229-238. 10.1023/A:1023254226592.CrossRefPubMed
Metadata
Title
Listening to patients: using verbal data in the validation of the Aberdeen Measures of Impairment, Activity Limitation and Participation Restriction (Ab-IAP)
Authors
Jeremy Horwood
Beth Pollard
Salma Ayis
Teresa McIlvenna
Marie Johnston
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Musculoskeletal Disorders / Issue 1/2010
Electronic ISSN: 1471-2474
DOI
https://doi.org/10.1186/1471-2474-11-182

Other articles of this Issue 1/2010

BMC Musculoskeletal Disorders 1/2010 Go to the issue