Skip to main content
Top

Open Access 05-03-2025 | Premature Rupture of Membranes

Young children (6–7 years) can meaningfully participate in cognitive interviews assessing comprehensibility in health-related quality of life domains: a qualitative study

Authors: Victoria Gale, Philip A. Powell, Jill Carlton

Published in: Quality of Life Research

Login to get access

Abstract

Purpose

Establishing the comprehensibility of patient reported outcome measures (PROMs) in quality of life research is essential. Cognitive interviews are recommended as a ‘gold standard’ for evaluating comprehensibility among adult populations but are not routinely used with young children (≤ 7 years). The current study therefore aimed to evaluate the feasibility of cognitive interviewing using traditional and adapted methods with children aged 6–7 years to evaluate PROM item comprehensibility.

Methods

Fourteen children (6–7 years) with a range of diagnosed health conditions participated in individual cognitive interviews. Each child answered six mock PROM items (physical, psychological, and social health-related quality of life domains) and concurrent verbal probes were used to evaluate item comprehensibility. Interviews were audio recorded and transcribed verbatim. Transcripts were analysed using a novel Comprehensibility Continuum which coded the extent of alignment between children’s explanations of items and intended meanings.

Results

Cognitive interviews were successful; extent of comprehensibility could be determined for 83/84 (99%) item discussions. Most items were comprehensible, with children describing the intended item meaning for 74/84 (88%) items evidenced by contextual examples and/or de-contextual definitions in children’s responses to verbal probes. Three items (‘walk’, ‘sad’, and ‘made fun of’) were identified as requiring further testing and/or refinement, where a lower percentage of discussions contained evidence of intended item meaning.

Conclusion

Despite previous uncertainty, this study demonstrates how methodological challenges can be addressed to enable young children’s participation in cognitive interviews evaluating item comprehensibility, ultimately contributing to the accurate measurement of young children’s health outcomes in healthcare and research.
Appendix
Available only for authorised users
Footnotes
1
Feasibility was not dependent on developing a set of PROM items that were all comprehensible; rather it would be demonstrated by it being possible to evaluate extent of item comprehensibility.
 
Literature
2.
go back to reference Matza, L., Patrick, D., Riley, A., Alexander, J., Rajmil, L., Pleil, A., & Bullinger, M. (2013). Pediatric patient-reported outcome instruments for research to support medical product labeling: Report of the ISPOR PRO good research practices for the assessment of children and adolescents task force. Value in Health, 16(4), 461–479. https://doi.org/10.1016/j.jval.2013.04.004CrossRefPubMed Matza, L., Patrick, D., Riley, A., Alexander, J., Rajmil, L., Pleil, A., & Bullinger, M. (2013). Pediatric patient-reported outcome instruments for research to support medical product labeling: Report of the ISPOR PRO good research practices for the assessment of children and adolescents task force. Value in Health, 16(4), 461–479. https://​doi.​org/​10.​1016/​j.​jval.​2013.​04.​004CrossRefPubMed
4.
go back to reference Ravens-Sieberer, U., Gosch, A., Abel, T., Auquier, P., Bellach, B., Bruil, J., Dür, W., Power, M., Rajmil, L., the European KIDSCREEN Group. (2001). Quality of life in children and adolescents: A European public health perspective. Sozial und Praventivmedizin, 46(5), 294–302.CrossRefPubMed Ravens-Sieberer, U., Gosch, A., Abel, T., Auquier, P., Bellach, B., Bruil, J., Dür, W., Power, M., Rajmil, L., the European KIDSCREEN Group. (2001). Quality of life in children and adolescents: A European public health perspective. Sozial und Praventivmedizin, 46(5), 294–302.CrossRefPubMed
5.
go back to reference Food and Drug Administration. (2009). Guidance for industry-patient-reported outcome measures: Use in Medical product development to support labeling claims. Food and Drug Administration. Food and Drug Administration. (2009). Guidance for industry-patient-reported outcome measures: Use in Medical product development to support labeling claims. Food and Drug Administration.
8.
go back to reference Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., & Ring, L. (2011). Content validity—Establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 1—Eliciting concepts for a new pro instrument. Value in Health, 14(8), 967–977. https://doi.org/10.1016/j.jval.2011.06.014CrossRefPubMed Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., & Ring, L. (2011). Content validity—Establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 1—Eliciting concepts for a new pro instrument. Value in Health, 14(8), 967–977. https://​doi.​org/​10.​1016/​j.​jval.​2011.​06.​014CrossRefPubMed
14.
go back to reference Karabenick, S. A., Woolley, M., Friedel, J., Ammon, B., Blazevski, J., Bonney, C., Groot, E., Gilbert, M., Musu, L., Kempler, T., & Kelly, K. (2007). Cognitive processing of self-report items in educational research: Do they think what we mean? Educational Psychologist, 42(3), 139–151. https://doi.org/10.1080/00461520701416231CrossRef Karabenick, S. A., Woolley, M., Friedel, J., Ammon, B., Blazevski, J., Bonney, C., Groot, E., Gilbert, M., Musu, L., Kempler, T., & Kelly, K. (2007). Cognitive processing of self-report items in educational research: Do they think what we mean? Educational Psychologist, 42(3), 139–151. https://​doi.​org/​10.​1080/​0046152070141623​1CrossRef
16.
go back to reference Terwee, C. B., Prinsen, C. A. C., Chiarotto, A., de Vet, H. C. W., Bouter, L. M., Alonso, J., Westerman, M. J., Patrick, D. L., & Mokkink, L. B. (2018). COSMIN methodology for assessing the content validity of PROMs–user manual. VU University Medical Center. Terwee, C. B., Prinsen, C. A. C., Chiarotto, A., de Vet, H. C. W., Bouter, L. M., Alonso, J., Westerman, M. J., Patrick, D. L., & Mokkink, L. B. (2018). COSMIN methodology for assessing the content validity of PROMs–user manual. VU University Medical Center.
17.
go back to reference Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., & Ring, L. (2011). Content validity—Establishing and Reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 2—Assessing respondent understanding. Value in Health, 14(8), 978–988. https://doi.org/10.1016/j.jval.2011.06.013CrossRefPubMed Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., & Ring, L. (2011). Content validity—Establishing and Reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO good research practices task force report: Part 2—Assessing respondent understanding. Value in Health, 14(8), 978–988. https://​doi.​org/​10.​1016/​j.​jval.​2011.​06.​013CrossRefPubMed
21.
go back to reference Willis, G. B. (2005). Cognitive interviewing [electronic resource]: A tool for improving questionnaire design. SAGE.CrossRef Willis, G. B. (2005). Cognitive interviewing [electronic resource]: A tool for improving questionnaire design. SAGE.CrossRef
31.
go back to reference Donaldson, M. (1987). Children’s minds. Fontana Press. Donaldson, M. (1987). Children’s minds. Fontana Press.
34.
go back to reference De Leeuw, E. D. (2011). Improving data quality when surveying children and adolescents: Cognitive and social development and its role in questionnaire construction and pretesting. In Report prepared for the Annual Meeting of the Academy of Finland: Research programs public health challenges and health and welfare of children and young people. De Leeuw, E. D. (2011). Improving data quality when surveying children and adolescents: Cognitive and social development and its role in questionnaire construction and pretesting. In Report prepared for the Annual Meeting of the Academy of Finland: Research programs public health challenges and health and welfare of children and young people.
38.
go back to reference Palmer, S. (2016). Upstart: The case for raising the school starting age and providing what the under-sevens really need. Floris Books. Palmer, S. (2016). Upstart: The case for raising the school starting age and providing what the under-sevens really need. Floris Books.
Metadata
Title
Young children (6–7 years) can meaningfully participate in cognitive interviews assessing comprehensibility in health-related quality of life domains: a qualitative study
Authors
Victoria Gale
Philip A. Powell
Jill Carlton
Publication date
05-03-2025
Publisher
Springer New York
Published in
Quality of Life Research
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-025-03940-z