Skip to main content
Top
Published in: BMC Health Services Research 1/2015

Open Access 01-12-2015 | Research article

Exploration of the content validity and feasibility of the EQ-5D-3L, ICECAP-O and ASCOT in older adults

Authors: Karen M van Leeuwen, Aaltje P D Jansen, Maaike E Muntinga, Judith E Bosmans, Marjan J Westerman, Maurits W van Tulder, Henriette E van der Horst

Published in: BMC Health Services Research | Issue 1/2015

Login to get access

Abstract

Background

In economic evaluations of care services for older adults health-related quality of life (QoL) measures such as the EQ-5D are increasingly replaced by the ICECAP-O and ASCOT, which cover a broader scope of QoL than health alone. Little is known about the content validity and feasibility of these measures. The purpose of this study was to explore the content validity and feasibility of the EQ-5D-3L, ICECAP-O and ASCOT in older adults.

Methods

Ten older adults were purposively sampled using a maximum variation principle. Think-aloud and verbal probing techniques were used to identify response issues encountered during the interpretation of items and the selection of response options. We used constant comparative methods to analyse the data.

Results

Two types of response issues were identified for various items in all three measures: interpretation issues and positive responses. Issues with the mapping of a response on one of the response options were least often encountered for the EQ-5D-3L items. Older adults considered the items of the ICECAP-O and ASCOT valuable though more abstract than the EQ-5D-3L.

Conclusions

Researchers who intend to use the EQ-5D, ICECAP-O or ASCOT in economic evaluations of care services for older adults, should be aware of the response issues that occur during the administration of these measures. Older adults perceived none of the measures as providing a comprehensive picture of their QoL. A preference from older adults for one of the measures depends on the extent to which the items reflect current personal concerns in life.
Literature
1.
2.
go back to reference Milte CM, Walker R, Luszcz MA, Lancsar E, Kaambwa B, Ratcliffe J. How important is health status in defining quality of life for older people? an exploratory study of the views of older South Australians. Appl Health Econ Health Policy. 2013;12:73–84.CrossRef Milte CM, Walker R, Luszcz MA, Lancsar E, Kaambwa B, Ratcliffe J. How important is health status in defining quality of life for older people? an exploratory study of the views of older South Australians. Appl Health Econ Health Policy. 2013;12:73–84.CrossRef
3.
go back to reference Grewal I, Lewis J, Flynn T, Brown J, Bond J, Coast J. Developing attributes for a generic quality of life measure for older people: preferences or capabilities? Soc Sci Med. 2006;62:1891–901.CrossRefPubMed Grewal I, Lewis J, Flynn T, Brown J, Bond J, Coast J. Developing attributes for a generic quality of life measure for older people: preferences or capabilities? Soc Sci Med. 2006;62:1891–901.CrossRefPubMed
4.
go back to reference Harwood RH. Economic evaluations of complex services for older people. Age Ageing. 2008;37:491–3.CrossRefPubMed Harwood RH. Economic evaluations of complex services for older people. Age Ageing. 2008;37:491–3.CrossRefPubMed
5.
go back to reference Makai P, Brouwer WB, Koopmanschap MA, Stolk EA, Nieboer AP. Quality of life instruments for economic evaluations in health and social care for older people: a systematic review. Soc Sci Med. 2014;102:83–93.CrossRefPubMed Makai P, Brouwer WB, Koopmanschap MA, Stolk EA, Nieboer AP. Quality of life instruments for economic evaluations in health and social care for older people: a systematic review. Soc Sci Med. 2014;102:83–93.CrossRefPubMed
6.
go back to reference Coast J, Flynn TN, Natarajan L, Sproston K, Lewis J, Louviere JJ, et al. Valuing the ICECAP capability index for older people. Soc Sci Med. 2008;67:874–82.CrossRefPubMed Coast J, Flynn TN, Natarajan L, Sproston K, Lewis J, Louviere JJ, et al. Valuing the ICECAP capability index for older people. Soc Sci Med. 2008;67:874–82.CrossRefPubMed
7.
go back to reference Netten A, Burge P, Malley J, Potoglou D, Towers AM, Brazier J, et al. Outcomes of social care for adults: developing a preference-weighted measure. Health Technol Assess. 2012;16:1–166.CrossRefPubMed Netten A, Burge P, Malley J, Potoglou D, Towers AM, Brazier J, et al. Outcomes of social care for adults: developing a preference-weighted measure. Health Technol Assess. 2012;16:1–166.CrossRefPubMed
8.
go back to reference Stevens K, Palfreyman S. The use of qualitative methods in developing the descriptive systems of preference-based measures of health-related quality of life for use in economic evaluation. Value Health. 2012;15:991–8.CrossRefPubMed Stevens K, Palfreyman S. The use of qualitative methods in developing the descriptive systems of preference-based measures of health-related quality of life for use in economic evaluation. Value Health. 2012;15:991–8.CrossRefPubMed
9.
go back to reference Brod M, Tesler LE, Christensen TL. Qualitative research and content validity: developing best practices based on science and experience. Qual Life Res. 2009;18:1263–78.CrossRefPubMed Brod M, Tesler LE, Christensen TL. Qualitative research and content validity: developing best practices based on science and experience. Qual Life Res. 2009;18:1263–78.CrossRefPubMed
10.
go back to reference Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10:22.CrossRefPubMedPubMedCentral Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10:22.CrossRefPubMedPubMedCentral
11.
go back to reference Terwee CB, Mokkink LB, van Poppel MN, Chinapaw MJ, van Mechelen W, de Vet HC. Qualitative attributes and measurement properties of physical activity questionnaires: a checklist. Sports Med. 2010;40:525–37.CrossRefPubMed Terwee CB, Mokkink LB, van Poppel MN, Chinapaw MJ, van Mechelen W, de Vet HC. Qualitative attributes and measurement properties of physical activity questionnaires: a checklist. Sports Med. 2010;40:525–37.CrossRefPubMed
12.
go back to reference Mallinson S. Listening to respondents: a qualitative assessment of the short-form 36 health status questionnaire. Soc Sci Med. 2002;54:11–21.CrossRefPubMed Mallinson S. Listening to respondents: a qualitative assessment of the short-form 36 health status questionnaire. Soc Sci Med. 2002;54:11–21.CrossRefPubMed
13.
go back to reference de Vet HC, Terwee CB, Mokkink LB, Knol DL. Measurement in medicine: a practical guide. Cambridge: Cambridge University Press; 2011.CrossRef de Vet HC, Terwee CB, Mokkink LB, Knol DL. Measurement in medicine: a practical guide. Cambridge: Cambridge University Press; 2011.CrossRef
14.
go back to reference Willis GB, Royston P, Bercini D. The use of verbal report methods in the development and testing of survey questionnaires. Appl Cogn Psychol. 1991;5:251–67.CrossRef Willis GB, Royston P, Bercini D. The use of verbal report methods in the development and testing of survey questionnaires. Appl Cogn Psychol. 1991;5:251–67.CrossRef
15.
go back to reference Schaeffer NC, Presser S. The science of asking questions. Annu Rev Sociol. 2003;65–88. Schaeffer NC, Presser S. The science of asking questions. Annu Rev Sociol. 2003;65–88.
16.
go back to reference Jobe JB, Mingay DJ. Cognition and survey measurement: history and overview. Appl Cogn Psychol. 1991;5:175–92.CrossRef Jobe JB, Mingay DJ. Cognition and survey measurement: history and overview. Appl Cogn Psychol. 1991;5:175–92.CrossRef
17.
go back to reference Tourangeau R, Rips LJ, Rasinki K. The psychology of survey response. Cambridge: Cambridge University Press; 2000.CrossRef Tourangeau R, Rips LJ, Rasinki K. The psychology of survey response. Cambridge: Cambridge University Press; 2000.CrossRef
18.
go back to reference Renberg T, Kettis LA, Tully MP. Testing the validity of a translated pharmaceutical therapy-related quality of life instrument, using qualitative 'think aloud' methodology. J Clin Pharm Ther. 2008;33:279–87.CrossRefPubMed Renberg T, Kettis LA, Tully MP. Testing the validity of a translated pharmaceutical therapy-related quality of life instrument, using qualitative 'think aloud' methodology. J Clin Pharm Ther. 2008;33:279–87.CrossRefPubMed
19.
go back to reference Westerman MJ, Hak T, Sprangers MA, Groen HJ, van der Wal G. Listen to their answers! response behaviour in the measurement of physical and role functioning. Qual Life Res. 2008;17:549–58.CrossRefPubMedPubMedCentral Westerman MJ, Hak T, Sprangers MA, Groen HJ, van der Wal G. Listen to their answers! response behaviour in the measurement of physical and role functioning. Qual Life Res. 2008;17:549–58.CrossRefPubMedPubMedCentral
20.
go back to reference Krosnick JA. Response strategies for coping with the cognitive demands of attitude measures in surveys. Appl Cogn Psychol. 1991;5:213–36.CrossRef Krosnick JA. Response strategies for coping with the cognitive demands of attitude measures in surveys. Appl Cogn Psychol. 1991;5:213–36.CrossRef
21.
go back to reference Knafl K, Deatrick J, Gallo A, Holcombe G, Bakitas M, Dixon J, et al. The analysis and interpretation of cognitive interviews for instrument development. Res Nurs Health. 2007;30:224–34.CrossRefPubMed Knafl K, Deatrick J, Gallo A, Holcombe G, Bakitas M, Dixon J, et al. The analysis and interpretation of cognitive interviews for instrument development. Res Nurs Health. 2007;30:224–34.CrossRefPubMed
22.
go back to reference Hak AT, Veer K, Jansen HAM. The Three-Step Test-Interview (TSTI): An observational instrument for pretesting self-completion questionnaires. Rotterdam: Erasmus Research Institute of Management (ERIM); 2004. Hak AT, Veer K, Jansen HAM. The Three-Step Test-Interview (TSTI): An observational instrument for pretesting self-completion questionnaires. Rotterdam: Erasmus Research Institute of Management (ERIM); 2004.
23.
go back to reference Collins D. Pretesting survey instruments: an overview of cognitive methods. Qual Life Res. 2003;12:229–38.CrossRefPubMed Collins D. Pretesting survey instruments: an overview of cognitive methods. Qual Life Res. 2003;12:229–38.CrossRefPubMed
24.
go back to reference Diener E, Suh EM, Lucas RE, Smith HL. Subjective well-being: three decades of progress. Psychol Bull. 1999;125:276–302.CrossRef Diener E, Suh EM, Lucas RE, Smith HL. Subjective well-being: three decades of progress. Psychol Bull. 1999;125:276–302.CrossRef
25.
go back to reference Heckhausen J, Brim OG. Perceived problems for self and others: self-protection by social downgrading throughout adulthood. Psychol Aging. 1997;12:610.CrossRefPubMed Heckhausen J, Brim OG. Perceived problems for self and others: self-protection by social downgrading throughout adulthood. Psychol Aging. 1997;12:610.CrossRefPubMed
26.
go back to reference Carp FM. Maximizing data quality in community studies of older people. In: Lawton MP, Herzog AR, editors. Special research methods for gerontology. Amityville NY: Baywood Publishing Company; 1989. p. 93–122. Carp FM. Maximizing data quality in community studies of older people. In: Lawton MP, Herzog AR, editors. Special research methods for gerontology. Amityville NY: Baywood Publishing Company; 1989. p. 93–122.
27.
go back to reference Jobe JB, Mingay DJ. Cognitive laboratory approach to designing questionnaires for surveys of the elderly. Public Health Rep. 1990;105:518.PubMedPubMedCentral Jobe JB, Mingay DJ. Cognitive laboratory approach to designing questionnaires for surveys of the elderly. Public Health Rep. 1990;105:518.PubMedPubMedCentral
28.
go back to reference Moser DK, Heo S, Lee KS, Hammash M, Riegel B, Lennie TA, et al. It could be worse … lot's worse! Why health-related quality of life is better in older compared with younger individuals with heart failure. Age ageing. 2013;42:626–32.CrossRefPubMedPubMedCentral Moser DK, Heo S, Lee KS, Hammash M, Riegel B, Lennie TA, et al. It could be worse … lot's worse! Why health-related quality of life is better in older compared with younger individuals with heart failure. Age ageing. 2013;42:626–32.CrossRefPubMedPubMedCentral
29.
go back to reference Drennan J. Cognitive interviewing: verbal data in the design and pretesting of questionnaires. J Adv Nurs. 2003;42:57–63.CrossRefPubMed Drennan J. Cognitive interviewing: verbal data in the design and pretesting of questionnaires. J Adv Nurs. 2003;42:57–63.CrossRefPubMed
30.
go back to reference Leidy NK, Vernon M. Perspectives on patient-reported outcomes : content validity and qualitative research in a changing clinical trial environment. Pharmacoeconomics. 2008;26:363–70.CrossRefPubMed Leidy NK, Vernon M. Perspectives on patient-reported outcomes : content validity and qualitative research in a changing clinical trial environment. Pharmacoeconomics. 2008;26:363–70.CrossRefPubMed
31.
go back to reference Pool JJ, Hiralal SR, Ostelo RW, van der Veer K, de Vet HC. Added value of qualitative studies in the development of health related patient reported outcomes such as the pain coping and cognition list in patients with sub-acute neck pain. Man Ther. 2010;15:43–7.CrossRefPubMed Pool JJ, Hiralal SR, Ostelo RW, van der Veer K, de Vet HC. Added value of qualitative studies in the development of health related patient reported outcomes such as the pain coping and cognition list in patients with sub-acute neck pain. Man Ther. 2010;15:43–7.CrossRefPubMed
33.
go back to reference Keeley T, Al-Janabi H, Lorgelly P, Coast J. A qualitative assessment of the content validity of the ICECAP-A and EQ-5D-5 L and their appropriateness for use in health research. PLoS One. 2013;8, e85287.CrossRefPubMedPubMedCentral Keeley T, Al-Janabi H, Lorgelly P, Coast J. A qualitative assessment of the content validity of the ICECAP-A and EQ-5D-5 L and their appropriateness for use in health research. PLoS One. 2013;8, e85287.CrossRefPubMedPubMedCentral
34.
go back to reference Muntinga ME, Hoogendijk EO, van Leeuwen KM, van Hout HP, Twisk JW, van der Horst HE, et al. Implementing the chronic care model for frail older adults in the Netherlands: study protocol of ACT (frail older adults: care in transition). BMC Geriatr. 2012;12:19.CrossRefPubMedPubMedCentral Muntinga ME, Hoogendijk EO, van Leeuwen KM, van Hout HP, Twisk JW, van der Horst HE, et al. Implementing the chronic care model for frail older adults in the Netherlands: study protocol of ACT (frail older adults: care in transition). BMC Geriatr. 2012;12:19.CrossRefPubMedPubMedCentral
35.
go back to reference Pialoux T, Goyard J, Lesourd B. Screening tools for frailty in primary health care: a systematic review. Geriatr Gerontol Int. 2012;12:189–97.CrossRefPubMed Pialoux T, Goyard J, Lesourd B. Screening tools for frailty in primary health care: a systematic review. Geriatr Gerontol Int. 2012;12:189–97.CrossRefPubMed
36.
go back to reference Hoogendijk EO, van der Horst HE, Deeg DJ, Frijters DH, Prins BA, Jansen AP, et al. The identification of frail older adults in primary care: comparing the accuracy of five simple instruments. Age Ageing. 2013;42:262–5.CrossRefPubMed Hoogendijk EO, van der Horst HE, Deeg DJ, Frijters DH, Prins BA, Jansen AP, et al. The identification of frail older adults in primary care: comparing the accuracy of five simple instruments. Age Ageing. 2013;42:262–5.CrossRefPubMed
37.
go back to reference Raiche M, Hebert R, Dubois MF. PRISMA-7: a case-finding tool to identify older adults with moderate to severe disabilities. Arch Gerontol Geriatr. 2008;47:9–18.CrossRefPubMed Raiche M, Hebert R, Dubois MF. PRISMA-7: a case-finding tool to identify older adults with moderate to severe disabilities. Arch Gerontol Geriatr. 2008;47:9–18.CrossRefPubMed
38.
go back to reference Lamers LM, Stalmeier PF, McDonnell J, Krabbe PF, van Busschbach JJ. [Measuring the quality of life in economic evaluations: the dutch EQ-5D tariff]. Ned Tijdschr Geneeskd. 2005;149:1574–8.PubMed Lamers LM, Stalmeier PF, McDonnell J, Krabbe PF, van Busschbach JJ. [Measuring the quality of life in economic evaluations: the dutch EQ-5D tariff]. Ned Tijdschr Geneeskd. 2005;149:1574–8.PubMed
40.
go back to reference Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186–91.CrossRef Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186–91.CrossRef
41.
go back to reference The EuroQol Group. EuroQol–a new facility for the measurement of health-related quality of life. Health Policy. 1990;16:199–208.CrossRef The EuroQol Group. EuroQol–a new facility for the measurement of health-related quality of life. Health Policy. 1990;16:199–208.CrossRef
43.
go back to reference Flynn TN, Chan P, Coast J, Peters TJ. Assessing quality of life among British older people using the ICEPOP CAPability (ICECAP-O) measure. Appl Health Econ Health Policy. 2011;9:317–29.CrossRefPubMed Flynn TN, Chan P, Coast J, Peters TJ. Assessing quality of life among British older people using the ICEPOP CAPability (ICECAP-O) measure. Appl Health Econ Health Policy. 2011;9:317–29.CrossRefPubMed
44.
go back to reference Sen A. Commodities and capabilities. Amsterdam: North-Holland; 1985. Sen A. Commodities and capabilities. Amsterdam: North-Holland; 1985.
45.
go back to reference Forder J, Netten A, Caiels J, Smith J, Malley J. Measuring outcomes in social care: conceptual development and empirical design. 2007. Forder J, Netten A, Caiels J, Smith J, Malley J. Measuring outcomes in social care: conceptual development and empirical design. 2007.
46.
go back to reference Herdman M, Gudex C, Lloyd A, Janssen MF, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5 L). Qual Life Res. 2011;20:1727–36.CrossRefPubMedPubMedCentral Herdman M, Gudex C, Lloyd A, Janssen MF, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5 L). Qual Life Res. 2011;20:1727–36.CrossRefPubMedPubMedCentral
47.
go back to reference McClimans L, Bickenbach J, Westerman M, Carlson L, Wasserman D, Schwartz C. Philosophical perspectives on response shift. Qual Life Res. 2013;22:1871–8.CrossRefPubMed McClimans L, Bickenbach J, Westerman M, Carlson L, Wasserman D, Schwartz C. Philosophical perspectives on response shift. Qual Life Res. 2013;22:1871–8.CrossRefPubMed
48.
go back to reference Cook DJ, Guyatt GH, Juniper E, Griffith L, McIlroy W, Willan A, et al. Interviewer versus self-administered questionnaires in developing a disease-specific, health-related quality of life instrument for asthma. J Clin Epidemiol. 1993;46:529–34.CrossRefPubMed Cook DJ, Guyatt GH, Juniper E, Griffith L, McIlroy W, Willan A, et al. Interviewer versus self-administered questionnaires in developing a disease-specific, health-related quality of life instrument for asthma. J Clin Epidemiol. 1993;46:529–34.CrossRefPubMed
49.
go back to reference McHorney CA, Kosinski M, Ware Jr JE. Comparisons of the costs and quality of norms for the SF-36 health survey collected by mail versus telephone interview: results from a national survey. Med Care. 1994;32:551–67.CrossRefPubMed McHorney CA, Kosinski M, Ware Jr JE. Comparisons of the costs and quality of norms for the SF-36 health survey collected by mail versus telephone interview: results from a national survey. Med Care. 1994;32:551–67.CrossRefPubMed
50.
go back to reference Smeeth L, Fletcher AE, Stirling S, Nunes M, Breeze E, Ng E, et al. Randomised comparison of three methods of administering a screening questionnaire to elderly people: findings from the MRC trial of the assessment and management of older people in the community. BMJ. 2001;323:1403–7.CrossRefPubMedPubMedCentral Smeeth L, Fletcher AE, Stirling S, Nunes M, Breeze E, Ng E, et al. Randomised comparison of three methods of administering a screening questionnaire to elderly people: findings from the MRC trial of the assessment and management of older people in the community. BMJ. 2001;323:1403–7.CrossRefPubMedPubMedCentral
Metadata
Title
Exploration of the content validity and feasibility of the EQ-5D-3L, ICECAP-O and ASCOT in older adults
Authors
Karen M van Leeuwen
Aaltje P D Jansen
Maaike E Muntinga
Judith E Bosmans
Marjan J Westerman
Maurits W van Tulder
Henriette E van der Horst
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2015
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-015-0862-8

Other articles of this Issue 1/2015

BMC Health Services Research 1/2015 Go to the issue