Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2009

Open Access 01-12-2009 | Research

Cognitive interviewing methodology in the development of a pediatric item bank: a patient reported outcomes measurement information system (PROMIS) study

Authors: Debra E Irwin, James W Varni, Karin Yeatts, Darren A DeWalt

Published in: Health and Quality of Life Outcomes | Issue 1/2009

Login to get access

Abstract

Background

The evaluation of patient-reported outcomes (PROs) in health care has seen greater use in recent years, and methods to improve the reliability and validity of PRO instruments are advancing. This paper discusses the cognitive interviewing procedures employed by the Patient Reported Outcomes Measurement Information System (PROMIS) pediatrics group for the purpose of developing a dynamic, electronic item bank for field testing with children and adolescents using novel computer technology. The primary objective of this study was to conduct cognitive interviews with children and adolescents to gain feedback on items measuring physical functioning, emotional health, social health, fatigue, pain, and asthma-specific symptoms.

Methods

A total of 88 cognitive interviews were conducted with 77 children and adolescents across two sites on 318 items. From this initial item bank, 25 items were deleted and 35 were revised and underwent a second round of cognitive interviews. A total of 293 items were retained for field testing.

Results

Children as young as 8 years of age were able to comprehend the majority of items, response options, directions, recall period, and identify problems with language that was difficult for them to understand. Cognitive interviews indicated issues with item comprehension on several items which led to alternative wording for these items.

Conclusion

Children ages 8–17 years were able to comprehend most item stems and response options in the present study. Field testing with the resulting items and response options is presently being conducted as part of the PROMIS Pediatric Item Bank development process.
Literature
1.
go back to reference Ader DN: Developing the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care 2007,45(Suppl 1):S1-S2. 10.1097/01.mlr.0000260537.45076.74CrossRef Ader DN: Developing the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care 2007,45(Suppl 1):S1-S2. 10.1097/01.mlr.0000260537.45076.74CrossRef
2.
go back to reference Cella D, Yount S, Rothrock N, Gershon R, Cook K, Reeve B, Ader DN, Fries JF, Bruce B, Rose M: The Patient-Reported Outcomes Measurement Information System (PROMIS): Progress of an NIH Roadmap Cooperative Group during its first two years. Medical Care 2007,45(Suppl 1):S3-S11. 10.1097/01.mlr.0000258615.42478.55PubMedCentralCrossRef Cella D, Yount S, Rothrock N, Gershon R, Cook K, Reeve B, Ader DN, Fries JF, Bruce B, Rose M: The Patient-Reported Outcomes Measurement Information System (PROMIS): Progress of an NIH Roadmap Cooperative Group during its first two years. Medical Care 2007,45(Suppl 1):S3-S11. 10.1097/01.mlr.0000258615.42478.55PubMedCentralCrossRef
3.
go back to reference DeWalt D, Rothrock N, Yount S, Stone AA, PROMIS Cooperative Group: Evaluation of Item Candidates: The PROMIS qualitative item review. Medical Care 2007,45(Suppl 1):S12-S21. 10.1097/01.mlr.0000254567.79743.e2PubMedCentralCrossRef DeWalt D, Rothrock N, Yount S, Stone AA, PROMIS Cooperative Group: Evaluation of Item Candidates: The PROMIS qualitative item review. Medical Care 2007,45(Suppl 1):S12-S21. 10.1097/01.mlr.0000254567.79743.e2PubMedCentralCrossRef
4.
go back to reference Walsh TR, Irwin DE, Meier A, Varni JW, DeWalt D: The use of focus groups in the development of the PROMIS Pediatric Item Bank. Qual Life Res 2008, 17: T725–735. 10.1007/s11136-008-9338-1CrossRef Walsh TR, Irwin DE, Meier A, Varni JW, DeWalt D: The use of focus groups in the development of the PROMIS Pediatric Item Bank. Qual Life Res 2008, 17: T725–735. 10.1007/s11136-008-9338-1CrossRef
5.
go back to reference Varni JW, Seid M, Rode CA: The PedsQL™: Measurement model for the Pediatric Quality of Life Inventory. Medical Care 1999, 37: 126–139. 10.1097/00005650-199902000-00003CrossRef Varni JW, Seid M, Rode CA: The PedsQL™: Measurement model for the Pediatric Quality of Life Inventory. Medical Care 1999, 37: 126–139. 10.1097/00005650-199902000-00003CrossRef
6.
go back to reference Rebok G, Riley A, Forrest CB, Starfield B, Green BF, Robertson J, Tambor E: Elementary school-aged children's reports of their health: A cognitive interviewing study. Quality of Life Research 2001, 10: 59–70. 10.1023/A:1016693417166CrossRef Rebok G, Riley A, Forrest CB, Starfield B, Green BF, Robertson J, Tambor E: Elementary school-aged children's reports of their health: A cognitive interviewing study. Quality of Life Research 2001, 10: 59–70. 10.1023/A:1016693417166CrossRef
7.
go back to reference Woolley ME, Bowen GL, Bowen NK: The development and evaluation of procedures to assess child self-report item validity. Educational and Psychological Measurement 2006, 66: 687–700. 10.1177/0013164405282467PubMedCentralCrossRef Woolley ME, Bowen GL, Bowen NK: The development and evaluation of procedures to assess child self-report item validity. Educational and Psychological Measurement 2006, 66: 687–700. 10.1177/0013164405282467PubMedCentralCrossRef
8.
go back to reference Varni JW, Seid M, Kurtin PS: PedsQL 4.0: reliability and validity of the Pediatric Quality of Life Inventory version 4.0 Generic Core Scales in healthy and patient populations. Med Care 2001,39(8):800–812. 10.1097/00005650-200108000-00006CrossRef Varni JW, Seid M, Kurtin PS: PedsQL 4.0: reliability and validity of the Pediatric Quality of Life Inventory version 4.0 Generic Core Scales in healthy and patient populations. Med Care 2001,39(8):800–812. 10.1097/00005650-200108000-00006CrossRef
9.
go back to reference Willis GB: Cognitive Interviewing: A Tool for Improving Questionnaire Design. Thousand Oaks, CA: Sage Publications; 2005. Willis GB: Cognitive Interviewing: A Tool for Improving Questionnaire Design. Thousand Oaks, CA: Sage Publications; 2005.
10.
go back to reference Jobe JB: Cognitive psychology and self-reports: Models and methods. Quality of Life Research 2003, 12: 219–227. 10.1023/A:1023279029852CrossRef Jobe JB: Cognitive psychology and self-reports: Models and methods. Quality of Life Research 2003, 12: 219–227. 10.1023/A:1023279029852CrossRef
11.
go back to reference Tourangeau R, Rips LJ, Rasinski K: The Psychology of Survey Response. Cambridge: Cambridge University Press; 2000.CrossRef Tourangeau R, Rips LJ, Rasinski K: The Psychology of Survey Response. Cambridge: Cambridge University Press; 2000.CrossRef
12.
go back to reference Sudman S, Bradburn NM, Schwarz N: Thinking about answers: The application of cognitive processes to survey methodology. San Francisco: Jossey-Bass; 1996. Sudman S, Bradburn NM, Schwarz N: Thinking about answers: The application of cognitive processes to survey methodology. San Francisco: Jossey-Bass; 1996.
13.
go back to reference Schwarz N, Sudman N, (eds): Answering questions: Methodology for determining cognitive and communicative processes in survey research. San Francisco: Jossey-Bass; 1996. Schwarz N, Sudman N, (eds): Answering questions: Methodology for determining cognitive and communicative processes in survey research. San Francisco: Jossey-Bass; 1996.
14.
go back to reference Chan KS, Mangione-Smith R, Burwinkle TM, Rosen M, Varni JW: The PedsQLTM: Reliability and validity of the short-form generic core scales and asthma module. Med Care 2005, 43: 256–265. 10.1097/00005650-200503000-00008CrossRef Chan KS, Mangione-Smith R, Burwinkle TM, Rosen M, Varni JW: The PedsQLTM: Reliability and validity of the short-form generic core scales and asthma module. Med Care 2005, 43: 256–265. 10.1097/00005650-200503000-00008CrossRef
15.
go back to reference Guyatt GH, Juniper EF, Griffith LE, Feeny DH, Ferrie PJ: Children and adult perceptions of childhood asthma. Pediatrics 1997,99(2):165–168. 10.1542/peds.99.2.165CrossRef Guyatt GH, Juniper EF, Griffith LE, Feeny DH, Ferrie PJ: Children and adult perceptions of childhood asthma. Pediatrics 1997,99(2):165–168. 10.1542/peds.99.2.165CrossRef
16.
go back to reference Juniper EF, Guyatt GH, Feeny DH, Ferrie PJ, Griffith LE, Townsend M: Measuring quality of life in children with asthma. Qual of Life Res 1996,5(1):35–46. 10.1007/BF00435967CrossRef Juniper EF, Guyatt GH, Feeny DH, Ferrie PJ, Griffith LE, Townsend M: Measuring quality of life in children with asthma. Qual of Life Res 1996,5(1):35–46. 10.1007/BF00435967CrossRef
17.
go back to reference Wilkinson GS: WRAT3 Wide Range Achievement Test Administration Manual. Wilmington: Wide Range, Inc; 1993. Wilkinson GS: WRAT3 Wide Range Achievement Test Administration Manual. Wilmington: Wide Range, Inc; 1993.
18.
go back to reference Woolley MF, Bowen GL, Bowen NK: Cognitive Pretesting and the Developmental Validity of Child Self-Report Instruments: Theory and Applications. Research on Social Work Practice 2004, 14: 191–200. 10.1177/1049731503257882PubMedCentralCrossRef Woolley MF, Bowen GL, Bowen NK: Cognitive Pretesting and the Developmental Validity of Child Self-Report Instruments: Theory and Applications. Research on Social Work Practice 2004, 14: 191–200. 10.1177/1049731503257882PubMedCentralCrossRef
19.
go back to reference Ravens-Sieberer U, Gosch A, Rajmil L, Erhart M, Bruil J, Duer W, Auquier P, KIDSCREEN Group: KIDSCREEN-52 Quality of Life Measure for Children And Adolescents. Expert Review of Pharmacoeconomics and Outcomes Research 2005, 5: 353–364. 10.1586/14737167.5.3.353CrossRef Ravens-Sieberer U, Gosch A, Rajmil L, Erhart M, Bruil J, Duer W, Auquier P, KIDSCREEN Group: KIDSCREEN-52 Quality of Life Measure for Children And Adolescents. Expert Review of Pharmacoeconomics and Outcomes Research 2005, 5: 353–364. 10.1586/14737167.5.3.353CrossRef
Metadata
Title
Cognitive interviewing methodology in the development of a pediatric item bank: a patient reported outcomes measurement information system (PROMIS) study
Authors
Debra E Irwin
James W Varni
Karin Yeatts
Darren A DeWalt
Publication date
01-12-2009
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2009
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/1477-7525-7-3

Other articles of this Issue 1/2009

Health and Quality of Life Outcomes 1/2009 Go to the issue