Skip to main content
Top
Published in: PharmacoEconomics 5/2008

01-05-2008 | Leading Article

Perspectives on Patient-Reported Outcomes

Content Validity and Qualitative Research in a Changing Clinical Trial Environment

Authors: Dr Nancy Kline Leidy, Margaret Vernon

Published in: PharmacoEconomics | Issue 5/2008

Login to get access

Abstract

Patient-reported outcomes (PROs) represent the voice of the patient in drug and device evaluation. As such, the outcomes selected for evaluation must be relevant to the patient, and the instruments used to capture them must have sound measurement properties. This paper discusses the role of qualitative research methods in assuring PRO clarity and content validity in a clinical trial environment characterized by evolving regulatory policy, new advances in technology and increasingly diverse samples within global clinical trials. Three important PRO measurement issues influenced by these changes are addressed: (i) endpoint selection and instrument development; (ii) the adaptation of instruments for electronic administration; and (iii) conceptual equivalence of measures across diverse samples. These are viewed as interrelated issues of content validity that can be addressed through the appropriate and rigorous application of qualitative research methods. Focus groups, cognitive debriefing, user acceptance testing and translation methodologies are discussed as ways to address and document the content validity of PRO instruments and ensure the empirical data representing the voice of the patient is sound.
Literature
1.
4.
go back to reference Hays RD, Anderson R, Revicki D. Psychometric considerations in evaluating health-related quality of life measures. Qual Life Res 1993 Dec; 2 (6): 441–449PubMedCrossRef Hays RD, Anderson R, Revicki D. Psychometric considerations in evaluating health-related quality of life measures. Qual Life Res 1993 Dec; 2 (6): 441–449PubMedCrossRef
5.
go back to reference Nunnally JC, Bernstein I. Psychometric theory. 3rd ed. New York: McGraw-Hill, 1994 Nunnally JC, Bernstein I. Psychometric theory. 3rd ed. New York: McGraw-Hill, 1994
6.
go back to reference Revicki DA. EDA draft guidance and health-outcomes research. Lancet 2007 Feb 17; 369 (9561): 540–542PubMedCrossRef Revicki DA. EDA draft guidance and health-outcomes research. Lancet 2007 Feb 17; 369 (9561): 540–542PubMedCrossRef
8.
go back to reference Dicicco-Bloom B, Crabtree BF. The qualitative research interview. Med Educ 2006 Apr; 40 (4): 314–321PubMedCrossRef Dicicco-Bloom B, Crabtree BF. The qualitative research interview. Med Educ 2006 Apr; 40 (4): 314–321PubMedCrossRef
9.
go back to reference Draper AK. The principles and application of qualitative research. Proc Nutr Soc 2004 Nov; 63 (4): 641–646PubMedCrossRef Draper AK. The principles and application of qualitative research. Proc Nutr Soc 2004 Nov; 63 (4): 641–646PubMedCrossRef
10.
go back to reference Tobin GA, Begley CM. Methodological rigour within a qualitative framework. J Adv Nurs 2004 Nov; 48 (4): 388–396PubMedCrossRef Tobin GA, Begley CM. Methodological rigour within a qualitative framework. J Adv Nurs 2004 Nov; 48 (4): 388–396PubMedCrossRef
11.
go back to reference Krueger RA, Casey MA. Focus groups: a practical guide for applied research. 3rd ed. Thousand Oaks (CA): Sage Publications, Inc., 2000 Krueger RA, Casey MA. Focus groups: a practical guide for applied research. 3rd ed. Thousand Oaks (CA): Sage Publications, Inc., 2000
12.
go back to reference Morgan DL. Focus groups as qualitative research. 2nd ed. Thousand Oaks (CA): Sage Publications, Inc., 1997 Morgan DL. Focus groups as qualitative research. 2nd ed. Thousand Oaks (CA): Sage Publications, Inc., 1997
13.
go back to reference Stewart DW, Shamdasani PN, Rook DW. Focus groups: theory and practice. 2nd ed. Thousand Oaks (CA): Sage Publications, Inc., 2006 Stewart DW, Shamdasani PN, Rook DW. Focus groups: theory and practice. 2nd ed. Thousand Oaks (CA): Sage Publications, Inc., 2006
14.
go back to reference Creswell JW. Qualitative inquiry and research design: choosing among five methods. Thousand Oaks (CA): Sage Publications, Inc., 1998 Creswell JW. Qualitative inquiry and research design: choosing among five methods. Thousand Oaks (CA): Sage Publications, Inc., 1998
15.
go back to reference Graneheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today 2004 Feb; 24 (2): 105–112PubMedCrossRef Graneheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today 2004 Feb; 24 (2): 105–112PubMedCrossRef
16.
go back to reference Willis G. Cognitive interviewing. Thousand Oaks (CA): Sage Publications, Inc., 2005 Willis G. Cognitive interviewing. Thousand Oaks (CA): Sage Publications, Inc., 2005
17.
go back to reference Aquilino WS. Interview mode effects in surveys of drug and alcohol use: a field experiment. Public Opin Q 1994; 58 (2): 210–240CrossRef Aquilino WS. Interview mode effects in surveys of drug and alcohol use: a field experiment. Public Opin Q 1994; 58 (2): 210–240CrossRef
18.
go back to reference Dillman D. Mail and internet surveys. 2nd ed. New York: Wiley, 2000 Dillman D. Mail and internet surveys. 2nd ed. New York: Wiley, 2000
19.
go back to reference McCabe SE, Boyd CJ, Couper MP, et al. Mode effects for collecting alcohol and other drug use data: web and US mail. J Stud Alcohol 2002 Nov; 63 (6): 755–761PubMed McCabe SE, Boyd CJ, Couper MP, et al. Mode effects for collecting alcohol and other drug use data: web and US mail. J Stud Alcohol 2002 Nov; 63 (6): 755–761PubMed
20.
go back to reference Newman JC, Des Jarlais DC, Turner CF, et al. The differential effects of face-to-face and computer interview modes. Am J Public Health 2002 Feb; 92 (2): 294–297PubMedCrossRef Newman JC, Des Jarlais DC, Turner CF, et al. The differential effects of face-to-face and computer interview modes. Am J Public Health 2002 Feb; 92 (2): 294–297PubMedCrossRef
21.
go back to reference Tourangeau R, Smith W. Asking sensitive questions: the impact of data collection mode, question format, and question context. Public Opin Q 1996; 60 (2): 275–304CrossRef Tourangeau R, Smith W. Asking sensitive questions: the impact of data collection mode, question format, and question context. Public Opin Q 1996; 60 (2): 275–304CrossRef
23.
go back to reference Fayers PM. Applying item response theory and computer adaptive testing: the challenges for health outcomes assessment. Qual Life Res 2007; 16 Suppl. 1: 187–194PubMedCrossRef Fayers PM. Applying item response theory and computer adaptive testing: the challenges for health outcomes assessment. Qual Life Res 2007; 16 Suppl. 1: 187–194PubMedCrossRef
24.
go back to reference Holland PW, Wainer H. Differential item functioning. London: Lawrence Erlbaum, 1993 Holland PW, Wainer H. Differential item functioning. London: Lawrence Erlbaum, 1993
25.
go back to reference Rogers HJ, Swaminathan H, Hambleton RK. Fundamentals of item response theory. Thousand Oaks (CA): Sage Publications, Inc., 1991 Rogers HJ, Swaminathan H, Hambleton RK. Fundamentals of item response theory. Thousand Oaks (CA): Sage Publications, Inc., 1991
26.
go back to reference Cella D, Lloyd S, Wright B. Cross-cultural instrument equating: current research and future directions. In: Spilker B, editor. Quality of life and pharmacoeconomics in clinical trials. 2nd ed. Philadelphia (PA): Lippincott-Raven, 1996: 707–715 Cella D, Lloyd S, Wright B. Cross-cultural instrument equating: current research and future directions. In: Spilker B, editor. Quality of life and pharmacoeconomics in clinical trials. 2nd ed. Philadelphia (PA): Lippincott-Raven, 1996: 707–715
27.
go back to reference Flaherty JA, Gaviria FM, Pathak D, et al. Developing instruments for cross-cultural psychiatric research. J Nerv Ment Dis 1988 May; 176 (5): 257–263PubMedCrossRef Flaherty JA, Gaviria FM, Pathak D, et al. Developing instruments for cross-cultural psychiatric research. J Nerv Ment Dis 1988 May; 176 (5): 257–263PubMedCrossRef
28.
go back to reference Herdman M, Fox-Rushby J, Badia X. ‘Equivalence’ and the translation and adaptation of health-related quality of life questionnaires. Qual Life Res 1997 Apr; 6 (3): 237–247PubMedCrossRef Herdman M, Fox-Rushby J, Badia X. ‘Equivalence’ and the translation and adaptation of health-related quality of life questionnaires. Qual Life Res 1997 Apr; 6 (3): 237–247PubMedCrossRef
29.
go back to reference Van de Vijver F. Towards a theory of bias and equivalence. ZUMA Nachrichten Spezial 1998; 42: 41–65 Van de Vijver F. Towards a theory of bias and equivalence. ZUMA Nachrichten Spezial 1998; 42: 41–65
30.
go back to reference Zheng YP, Wei LA, GoaL G, et al. Applicability of the Chinese beck depression inventory. Compr Psychiatry 1988 Sep–Oct; 29 (5): 484–489PubMedCrossRef Zheng YP, Wei LA, GoaL G, et al. Applicability of the Chinese beck depression inventory. Compr Psychiatry 1988 Sep–Oct; 29 (5): 484–489PubMedCrossRef
31.
go back to reference Willgerodt MA. Using focus groups to develop culturally relevant instruments. West J Nurs Res 2003 Nov; 25 (7): 798–814PubMedCrossRef Willgerodt MA. Using focus groups to develop culturally relevant instruments. West J Nurs Res 2003 Nov; 25 (7): 798–814PubMedCrossRef
32.
go back to reference Cull A, Sprangers M, Bjordal K, et al. EORTC Quality of Life Group translation procedure. 2nd ed. Brussels: EORTC Quality of Life Group, 2002 Cull A, Sprangers M, Bjordal K, et al. EORTC Quality of Life Group translation procedure. 2nd ed. Brussels: EORTC Quality of Life Group, 2002
33.
go back to reference Eremenco SL, Cella D, Arnold BJ. A comprehensive method for the translation and cross-cultural validation of health status questionnaires. Eval Health Prof 2005 Jun; 28 (2): 212–232PubMedCrossRef Eremenco SL, Cella D, Arnold BJ. A comprehensive method for the translation and cross-cultural validation of health status questionnaires. Eval Health Prof 2005 Jun; 28 (2): 212–232PubMedCrossRef
34.
go back to reference Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol 1994; 47 (12): 1465–1466CrossRef Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol 1994; 47 (12): 1465–1466CrossRef
35.
go back to reference Sartorius N, Kuyken W. Translation of health status instruments. In: Orley J, Kuyken W, editors. Quality of life assessment: international perspectives. Berlin Heidelberg: Springer Verlag, 1994: 3–18 Sartorius N, Kuyken W. Translation of health status instruments. In: Orley J, Kuyken W, editors. Quality of life assessment: international perspectives. Berlin Heidelberg: Springer Verlag, 1994: 3–18
36.
go back to reference Wild D, Grove A, Martin M, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of thelSPOR Task Force for Translation and Cultural Adaptation. Value Health 2005 Mar-Apr; 8 (2): 94–104PubMedCrossRef Wild D, Grove A, Martin M, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of thelSPOR Task Force for Translation and Cultural Adaptation. Value Health 2005 Mar-Apr; 8 (2): 94–104PubMedCrossRef
37.
go back to reference Hunt S. Cross-cultural issues in the use of quality of life measures in randomized controlled trials. In: Staquet M, Hays R, Fayers P, editors. Quality of life assessment in clinical trials. Oxford: Oxford University Press, 1998: 51–68 Hunt S. Cross-cultural issues in the use of quality of life measures in randomized controlled trials. In: Staquet M, Hays R, Fayers P, editors. Quality of life assessment in clinical trials. Oxford: Oxford University Press, 1998: 51–68
38.
go back to reference Lenderking WR. Comments on the ISPOR Task Force report on translation and adaptation of outcomes measures: guidelines and the need for more research. Value Health 2005 Mar-Apr; 8 (2): 92–93PubMedCrossRef Lenderking WR. Comments on the ISPOR Task Force report on translation and adaptation of outcomes measures: guidelines and the need for more research. Value Health 2005 Mar-Apr; 8 (2): 92–93PubMedCrossRef
39.
go back to reference Swaine-Verdier A, Doward LC, Hagell P, et al. Adapting quality of life instruments. Value Health 2004 Sep–Oct; 7 Suppl. 1: S27–S30PubMedCrossRef Swaine-Verdier A, Doward LC, Hagell P, et al. Adapting quality of life instruments. Value Health 2004 Sep–Oct; 7 Suppl. 1: S27–S30PubMedCrossRef
Metadata
Title
Perspectives on Patient-Reported Outcomes
Content Validity and Qualitative Research in a Changing Clinical Trial Environment
Authors
Dr Nancy Kline Leidy
Margaret Vernon
Publication date
01-05-2008
Publisher
Springer International Publishing
Published in
PharmacoEconomics / Issue 5/2008
Print ISSN: 1170-7690
Electronic ISSN: 1179-2027
DOI
https://doi.org/10.2165/00019053-200826050-00002

Other articles of this Issue 5/2008

PharmacoEconomics 5/2008 Go to the issue