Skip to main content
Top
Published in: BMC Palliative Care 1/2024

Open Access 01-12-2024 | Research

Development of the Parental Experience with Care for Children with Serious Illnesses (PRECIOUS) quality of care measure

Authors: Felicia Jia Ler Ang, Mihir Gandhi, Truls Ostbye, Chetna Malhotra, Rahul Malhotra, Poh Heng Chong, Zubair Amin, Cristelle Chu-Tian Chow, Teresa Shu Zhen Tan, Komal Tewani, Eric Andrew Finkelstein

Published in: BMC Palliative Care | Issue 1/2024

Login to get access

Abstract

Background

Parent-reported experience measures are part of pediatric Quality of Care (QoC) assessments. However, existing measures were not developed for use across multiple healthcare settings or throughout the illness trajectory of seriously ill children. Formative work involving in-depth interviews with parents of children with serious illnesses generated 66 draft items describing key QoC processes. Our present aim is to develop a comprehensive parent-reported experience measure of QoC for children with serious illnesses and evaluate its content validity and feasibility.

Methods

For evaluating content validity, we conducted a three-round Delphi expert panel review with 24 multi-disciplinary experts. Next, we pre-tested the items and instructions with 12 parents via cognitive interviews to refine clarity and understandability. Finally, we pilot-tested the full measure with 30 parents using self-administered online surveys to finalize the structure and content.

Results

The Delphi expert panel review reached consensus on 68 items. Pre-testing with parents of seriously ill children led to consolidation of some items. Pilot-testing supported feasibility of the measure, resulting in a comprehensive measure comprising 56 process assessment items, categorized under ten subthemes and four themes: (1) Professional qualities of healthcare workers, (2) Supporting parent-caregivers, (3) Collaborative and holistic care, and (4) Efficient healthcare structures and standards. We named this measure the PaRental Experience with care for Children with serIOUS illnesses (PRECIOUS).

Conclusions

PRECIOUS is the first comprehensive measure and has the potential to standardize assessment of QoC for seriously ill children from parental perspectives. PRECIOUS allows for QoC process evaluation across contexts (such as geographic location or care setting), different healthcare workers, and over the illness trajectory for children suffering from a range of serious illnesses.
Appendix
Available only for authorised users
Literature
1.
go back to reference Wood F, Simpson S, Barnes E, Hain R. Disease trajectories and ACT/RCPCH categories in paediatric palliative care. Palliat Med. 2010;24(8):796–806.PubMedCrossRef Wood F, Simpson S, Barnes E, Hain R. Disease trajectories and ACT/RCPCH categories in paediatric palliative care. Palliat Med. 2010;24(8):796–806.PubMedCrossRef
2.
go back to reference Chambers L. A guide to children’s palliative care. 4th ed. Bristol: Together for Short Lives; 2018. Chambers L. A guide to children’s palliative care. 4th ed. Bristol: Together for Short Lives; 2018.
3.
go back to reference King SM, Rosenbaum PL, King GA. Parents’ perceptions of caregiving: development and validation of a measure of processes. Dev Med Child Neurol. 1996;38(9):757–72.PubMedCrossRef King SM, Rosenbaum PL, King GA. Parents’ perceptions of caregiving: development and validation of a measure of processes. Dev Med Child Neurol. 1996;38(9):757–72.PubMedCrossRef
4.
go back to reference Berman L, Raval MV, Ottosen M, Mackow AK, Cho M, Goldin AB. Parent perspectives on readiness for discharge home after neonatal intensive care unit admission. J Pediatr. 2019;205(98–104): e4. Berman L, Raval MV, Ottosen M, Mackow AK, Cho M, Goldin AB. Parent perspectives on readiness for discharge home after neonatal intensive care unit admission. J Pediatr. 2019;205(98–104): e4.
5.
go back to reference Newland LA. Family well-being, parenting, and child well-being: pathways to healthy adjustment. Clin Psychol. 2015;19(1):3–14.CrossRef Newland LA. Family well-being, parenting, and child well-being: pathways to healthy adjustment. Clin Psychol. 2015;19(1):3–14.CrossRef
6.
go back to reference Raina P, O’Donnell M, Rosenbaum P, Brehaut J, Walter SD, Russell D, et al. The health and well-being of caregivers of children with cerebral palsy. Pediatrics. 2005;115(6):e626–36.PubMedCrossRef Raina P, O’Donnell M, Rosenbaum P, Brehaut J, Walter SD, Russell D, et al. The health and well-being of caregivers of children with cerebral palsy. Pediatrics. 2005;115(6):e626–36.PubMedCrossRef
7.
go back to reference Grange A, Bekker H, Noyes J, Langley P. Adequacy of health-related quality of life measures in children under 5 years old: systematic review. J Adv Nurs. 2007;59(3):197–220.PubMedCrossRef Grange A, Bekker H, Noyes J, Langley P. Adequacy of health-related quality of life measures in children under 5 years old: systematic review. J Adv Nurs. 2007;59(3):197–220.PubMedCrossRef
8.
go back to reference Care IfP-aF-C. What is patient‐and family‐centered care? Bethesda: Institute for Patient-and Family-Centered Care; 2010. Care IfP-aF-C. What is patient‐and family‐centered care? Bethesda: Institute for Patient-and Family-Centered Care; 2010.
9.
go back to reference Curtis K, Foster K, Mitchell R, Van C. Models of care delivery for families of critically ill children: an integrative review of international literature. J Pediatr Nurs. 2016;31(3):330–41.PubMedCrossRef Curtis K, Foster K, Mitchell R, Van C. Models of care delivery for families of critically ill children: an integrative review of international literature. J Pediatr Nurs. 2016;31(3):330–41.PubMedCrossRef
11.
go back to reference Verma R. Overview: what are PROMs and PREMs. St Leonards, Australia: Agency for Clinical Innovation (ACI); 2016. Verma R. Overview: what are PROMs and PREMs. St Leonards, Australia: Agency for Clinical Innovation (ACI); 2016.
12.
go back to reference Weldring T, Smith SMS. Article Commentary: Patient-Reported Outcomes (PROs) and Patient-Reported Outcome Measures (PROMs). Health Serv Insights. 2013;6:HSI.S11093.CrossRef Weldring T, Smith SMS. Article Commentary: Patient-Reported Outcomes (PROs) and Patient-Reported Outcome Measures (PROMs). Health Serv Insights. 2013;6:HSI.S11093.CrossRef
13.
go back to reference Tremblay D, Roberge D, Berbiche D. Determinants of patient-reported experience of cancer services responsiveness. BMC Health Serv Res. 2015;15(1):1–10.CrossRef Tremblay D, Roberge D, Berbiche D. Determinants of patient-reported experience of cancer services responsiveness. BMC Health Serv Res. 2015;15(1):1–10.CrossRef
14.
go back to reference Schembri S. Experiencing health care service quality: through patients’ eyes. Aust Health Rev. 2015;39(1):109–16.PubMedCrossRef Schembri S. Experiencing health care service quality: through patients’ eyes. Aust Health Rev. 2015;39(1):109–16.PubMedCrossRef
15.
go back to reference Ahmed F, Burt J, Roland M. Measuring patient experience: concepts and methods. Patient. 2014;7(3):235–41.PubMedCrossRef Ahmed F, Burt J, Roland M. Measuring patient experience: concepts and methods. Patient. 2014;7(3):235–41.PubMedCrossRef
16.
go back to reference Organization WH. Quality of care: a process for making strategic choices in health systems. Geneva: World Health Organization; 2006. Organization WH. Quality of care: a process for making strategic choices in health systems. Geneva: World Health Organization; 2006.
18.
go back to reference Bombard Y, Baker GR, Orlando E, Fancott C, Bhatia P, Casalino S, et al. Engaging patients to improve quality of care: a systematic review. Implement Sci. 2018;13(1):98.PubMedPubMedCentralCrossRef Bombard Y, Baker GR, Orlando E, Fancott C, Bhatia P, Casalino S, et al. Engaging patients to improve quality of care: a systematic review. Implement Sci. 2018;13(1):98.PubMedPubMedCentralCrossRef
19.
go back to reference Ang FJL, Finkelstein EA, Gandhi M. Parent-reported experience measures of care for children with serious illnesses: a scoping review. Pediatr Crit Care Med. 2022;23:1e416.CrossRef Ang FJL, Finkelstein EA, Gandhi M. Parent-reported experience measures of care for children with serious illnesses: a scoping review. Pediatr Crit Care Med. 2022;23:1e416.CrossRef
20.
go back to reference Ziniel SI, Rosenberg HN, Bach AM, Singer SJ, Antonelli RC. Validation of a parent-reported experience measure of integrated care. Pediatrics. 2016;138(6):e20160676.PubMedCrossRef Ziniel SI, Rosenberg HN, Bach AM, Singer SJ, Antonelli RC. Validation of a parent-reported experience measure of integrated care. Pediatrics. 2016;138(6):e20160676.PubMedCrossRef
21.
go back to reference Ang FJL, Chow CTC, Chong P-H, Tan TSZ, Amin Z, Buang SNH, et al. A qualitative exploration of parental perspectives on quality of care for children with serious illnesses. Front Pediatr. 2023;11:1167757.PubMedPubMedCentralCrossRef Ang FJL, Chow CTC, Chong P-H, Tan TSZ, Amin Z, Buang SNH, et al. A qualitative exploration of parental perspectives on quality of care for children with serious illnesses. Front Pediatr. 2023;11:1167757.PubMedPubMedCentralCrossRef
22.
go back to reference Haseltine WA. Affordable excellence: the Singapore health system. Washington, D.C.: Brookings Institution Press; 2013. Haseltine WA. Affordable excellence: the Singapore health system. Washington, D.C.: Brookings Institution Press; 2013.
24.
go back to reference Jorm AF. Using the Delphi expert consensus method in mental health research. Aust N Z J Psychiatry. 2015;49(10):887–97.PubMedCrossRef Jorm AF. Using the Delphi expert consensus method in mental health research. Aust N Z J Psychiatry. 2015;49(10):887–97.PubMedCrossRef
25.
go back to reference Jünger S, Payne SA, Brine J, Radbruch L, Brearley SG. Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: recommendations based on a methodological systematic review. Palliat Med. 2017;31(8):684–706.PubMedCrossRef Jünger S, Payne SA, Brine J, Radbruch L, Brearley SG. Guidance on Conducting and REporting DElphi Studies (CREDES) in palliative care: recommendations based on a methodological systematic review. Palliat Med. 2017;31(8):684–706.PubMedCrossRef
27.
go back to reference Biondo PD, Nekolaichuk CL, Stiles C, Fainsinger R, Hagen NA. Applying the Delphi process to palliative care tool development: lessons learned. Support Care Cancer. 2008;16:935–42.PubMedCrossRef Biondo PD, Nekolaichuk CL, Stiles C, Fainsinger R, Hagen NA. Applying the Delphi process to palliative care tool development: lessons learned. Support Care Cancer. 2008;16:935–42.PubMedCrossRef
28.
go back to reference Falzarano M, Pinto ZG. Seeking consensus through the use of the Delphi technique in health sciences research. J Allied Health. 2013;42(2):99–105.PubMed Falzarano M, Pinto ZG. Seeking consensus through the use of the Delphi technique in health sciences research. J Allied Health. 2013;42(2):99–105.PubMed
29.
go back to reference Bull C, Crilly J, Latimer S, Gillespie BM. Establishing the content validity of a new emergency department patient-reported experience measure (ED PREM): a Delphi study. BMC Emerg Med. 2022;22(1):65.PubMedPubMedCentralCrossRef Bull C, Crilly J, Latimer S, Gillespie BM. Establishing the content validity of a new emergency department patient-reported experience measure (ED PREM): a Delphi study. BMC Emerg Med. 2022;22(1):65.PubMedPubMedCentralCrossRef
30.
go back to reference Hong QN, Pluye P, Fàbregues S, Bartlett G, Boardman F, Cargo M, et al. Improving the content validity of the mixed methods appraisal tool: a modified e-Delphi study. J Clin Epidemiol. 2019;111:49-59.e1.PubMedCrossRef Hong QN, Pluye P, Fàbregues S, Bartlett G, Boardman F, Cargo M, et al. Improving the content validity of the mixed methods appraisal tool: a modified e-Delphi study. J Clin Epidemiol. 2019;111:49-59.e1.PubMedCrossRef
31.
go back to reference Fernández-Domínguez JC, Sesé-Abad A, Morales-Asencio JM, Sastre-Fullana P, Pol-Castañeda S, de Pedro-Gómez JE. Content validity of a health science evidence-based practice questionnaire (HS-EBP) with a web-based modified Delphi approach. Int J Qual Health Care. 2017;28(6):764–73. Fernández-Domínguez JC, Sesé-Abad A, Morales-Asencio JM, Sastre-Fullana P, Pol-Castañeda S, de Pedro-Gómez JE. Content validity of a health science evidence-based practice questionnaire (HS-EBP) with a web-based modified Delphi approach. Int J Qual Health Care. 2017;28(6):764–73.
32.
go back to reference Akins RB, Tolson H, Cole BR. Stability of response characteristics of a Delphi panel: application of bootstrap data expansion. BMC Med Res Methodol. 2005;5(1):1–12.CrossRef Akins RB, Tolson H, Cole BR. Stability of response characteristics of a Delphi panel: application of bootstrap data expansion. BMC Med Res Methodol. 2005;5(1):1–12.CrossRef
33.
go back to reference Erffmeyer RC, Erffmeyer ES, Lane IM. The Delphi technique: an empirical evaluation of the optimal number of rounds. Group & Organization Studies. 1986;11(1–2):120–8.CrossRef Erffmeyer RC, Erffmeyer ES, Lane IM. The Delphi technique: an empirical evaluation of the optimal number of rounds. Group & Organization Studies. 1986;11(1–2):120–8.CrossRef
34.
go back to reference Iqbal S, Pipon-Young L. The Delphi method. Psychologist. 2009;22:598–601. Iqbal S, Pipon-Young L. The Delphi method. Psychologist. 2009;22:598–601.
35.
go back to reference Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67(4):401–9.PubMedCrossRef Diamond IR, Grant RC, Feldman BM, Pencharz PB, Ling SC, Moore AM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67(4):401–9.PubMedCrossRef
36.
go back to reference Denzin NK, Lincoln YS, editors. The SAGE handbook of qualitative research. 4th ed. Thousand Oaks: SAGE; 2011. Denzin NK, Lincoln YS, editors. The SAGE handbook of qualitative research. 4th ed. Thousand Oaks: SAGE; 2011.
38.
go back to reference Rényi A. Probability theory: Courier Corporation. 2007. Rényi A. Probability theory: Courier Corporation. 2007.
39.
go back to reference Parish S, Pomeranz A, Hemp R, Rizzolo M, Braddock D. Family support for families of persons with developmental disabilities in the US: Status and trends. Policy Research Brief 1–12. Minneapolis: Research and Training Center on Community Living, Institute …; 2001. Parish S, Pomeranz A, Hemp R, Rizzolo M, Braddock D. Family support for families of persons with developmental disabilities in the US: Status and trends. Policy Research Brief 1–12. Minneapolis: Research and Training Center on Community Living, Institute …; 2001.
41.
go back to reference Willis GB, Artino AR Jr. What do our respondents think we’re asking? Using cognitive interviewing to improve medical education surveys. J Grad Med Educ. 2013;5(3):353–6.PubMedPubMedCentralCrossRef Willis GB, Artino AR Jr. What do our respondents think we’re asking? Using cognitive interviewing to improve medical education surveys. J Grad Med Educ. 2013;5(3):353–6.PubMedPubMedCentralCrossRef
42.
go back to reference Tourangeau R. Cognitive sciences and survey methods. Cognitive aspects of survey methodology: building a bridge between disciplines. Washington: National Academy Press; 1984. Tourangeau R. Cognitive sciences and survey methods. Cognitive aspects of survey methodology: building a bridge between disciplines. Washington: National Academy Press; 1984.
43.
go back to reference Johanson GA, Brooks GP. Initial scale development: sample size for pilot studies. Educ Psychol Measur. 2010;70(3):394–400.CrossRef Johanson GA, Brooks GP. Initial scale development: sample size for pilot studies. Educ Psychol Measur. 2010;70(3):394–400.CrossRef
44.
go back to reference King S, King G, Rosenbaum P. Evaluating health service delivery to children with chronic conditions and their families: development of a refined Measure of Processes of Care (MPOC−20). Child Health Care. 2004;33(1):35–57.CrossRef King S, King G, Rosenbaum P. Evaluating health service delivery to children with chronic conditions and their families: development of a refined Measure of Processes of Care (MPOC−20). Child Health Care. 2004;33(1):35–57.CrossRef
45.
go back to reference Widger K, Brennenstuhl S, Duc J, Tourangeau A, Rapoport A. Factor structure of the Quality of Children’s Palliative Care Instrument (QCPCI) when completed by parents of children with cancer. BMC Palliat Care. 2019;18(1):1–9.CrossRef Widger K, Brennenstuhl S, Duc J, Tourangeau A, Rapoport A. Factor structure of the Quality of Children’s Palliative Care Instrument (QCPCI) when completed by parents of children with cancer. BMC Palliat Care. 2019;18(1):1–9.CrossRef
46.
go back to reference Manfreda KL, Vehovar V, editors. Survey design features influencing response rates in web surveys. The international conference on improving surveys (ICIS). Copenhagen: ICIS 2002 International Conference on Improving Surveys; 2002. Manfreda KL, Vehovar V, editors. Survey design features influencing response rates in web surveys. The international conference on improving surveys (ICIS). Copenhagen: ICIS 2002 International Conference on Improving Surveys; 2002.
47.
go back to reference Dillman DA, Eltinge JL, Groves R, Little RJ. Survey nonresponse. New York: Wiley; 2002. Dillman DA, Eltinge JL, Groves R, Little RJ. Survey nonresponse. New York: Wiley; 2002.
48.
go back to reference Bosnjak M, Tuten TL. Prepaid and promised incentives in web surveys: an experiment. Soc Sci Comput Rev. 2003;21(2):208–17.CrossRef Bosnjak M, Tuten TL. Prepaid and promised incentives in web surveys: an experiment. Soc Sci Comput Rev. 2003;21(2):208–17.CrossRef
49.
go back to reference McLorie EV, Hackett J, Fraser LK. Understanding parents’ experiences of care for children with medical complexity in England: a qualitative study. BMJ Paediatrics Open. 2023;7(1):e002057.PubMedPubMedCentralCrossRef McLorie EV, Hackett J, Fraser LK. Understanding parents’ experiences of care for children with medical complexity in England: a qualitative study. BMJ Paediatrics Open. 2023;7(1):e002057.PubMedPubMedCentralCrossRef
50.
go back to reference Chandran A, Sikka K, Thakar A, Lodha R, Irugu D, Kumar R, et al. The impact of pediatric tracheostomy on the quality of life of caregivers. Int J Pediatr Otorhinolaryngol. 2021;149:110854.PubMedCrossRef Chandran A, Sikka K, Thakar A, Lodha R, Irugu D, Kumar R, et al. The impact of pediatric tracheostomy on the quality of life of caregivers. Int J Pediatr Otorhinolaryngol. 2021;149:110854.PubMedCrossRef
51.
go back to reference Johnson RF, Brown A, Brooks R. The family impact of having a child with a tracheostomy. Laryngoscope. 2021;131(4):911–5.PubMedCrossRef Johnson RF, Brown A, Brooks R. The family impact of having a child with a tracheostomy. Laryngoscope. 2021;131(4):911–5.PubMedCrossRef
52.
go back to reference Cohen E, Lacombe-Duncan A, Spalding K, MacInnis J, Nicholas D, Narayanan UG, et al. Integrated complex care coordination for children with medical complexity: a mixed-methods evaluation of tertiary care-community collaboration. BMC Health Serv Res. 2012;12(1):366.PubMedPubMedCentralCrossRef Cohen E, Lacombe-Duncan A, Spalding K, MacInnis J, Nicholas D, Narayanan UG, et al. Integrated complex care coordination for children with medical complexity: a mixed-methods evaluation of tertiary care-community collaboration. BMC Health Serv Res. 2012;12(1):366.PubMedPubMedCentralCrossRef
53.
go back to reference Newham JJ, Forman J, Heys M, Cousens S, Lemer C, Elsherbiny M, et al. Children and Young People’s Health Partnership (CYPHP) Evelina London model of care: protocol for an opportunistic cluster randomised controlled trial (cRCT) to assess child health outcomes, healthcare quality and health service use. BMJ Open. 2019;9(8):e027301.PubMedPubMedCentralCrossRef Newham JJ, Forman J, Heys M, Cousens S, Lemer C, Elsherbiny M, et al. Children and Young People’s Health Partnership (CYPHP) Evelina London model of care: protocol for an opportunistic cluster randomised controlled trial (cRCT) to assess child health outcomes, healthcare quality and health service use. BMJ Open. 2019;9(8):e027301.PubMedPubMedCentralCrossRef
54.
go back to reference Turchi RM, Antonelli RC, Norwood KWJ, Adams RC, Brei TJ, Burke RT, et al. Patient- and family-centered care coordination: a framework for integrating care for children and youth across multiple systems. Pediatrics. 2014;133(5):e1451–60.CrossRef Turchi RM, Antonelli RC, Norwood KWJ, Adams RC, Brei TJ, Burke RT, et al. Patient- and family-centered care coordination: a framework for integrating care for children and youth across multiple systems. Pediatrics. 2014;133(5):e1451–60.CrossRef
55.
go back to reference Latif AS. The importance of understanding social and cultural norms in delivering quality health care-a personal experience commentary. Trop Med Infect Dis. 2020;5(1):22.PubMedPubMedCentralCrossRef Latif AS. The importance of understanding social and cultural norms in delivering quality health care-a personal experience commentary. Trop Med Infect Dis. 2020;5(1):22.PubMedPubMedCentralCrossRef
56.
go back to reference Napier AD, Ancarno C, Butler B, Calabrese J, Chater A, Chatterjee H, et al. Culture and health. Lancet. 2014;384(9954):1607–39.PubMedCrossRef Napier AD, Ancarno C, Butler B, Calabrese J, Chater A, Chatterjee H, et al. Culture and health. Lancet. 2014;384(9954):1607–39.PubMedCrossRef
57.
go back to reference Wiener L, McConnell DG, Latella L, Ludi E. Cultural and religious considerations in pediatric palliative care. Palliat Support Care. 2013;11(1):47–67.PubMedCrossRef Wiener L, McConnell DG, Latella L, Ludi E. Cultural and religious considerations in pediatric palliative care. Palliat Support Care. 2013;11(1):47–67.PubMedCrossRef
Metadata
Title
Development of the Parental Experience with Care for Children with Serious Illnesses (PRECIOUS) quality of care measure
Authors
Felicia Jia Ler Ang
Mihir Gandhi
Truls Ostbye
Chetna Malhotra
Rahul Malhotra
Poh Heng Chong
Zubair Amin
Cristelle Chu-Tian Chow
Teresa Shu Zhen Tan
Komal Tewani
Eric Andrew Finkelstein
Publication date
01-12-2024
Publisher
BioMed Central
Published in
BMC Palliative Care / Issue 1/2024
Electronic ISSN: 1472-684X
DOI
https://doi.org/10.1186/s12904-024-01401-x

Other articles of this Issue 1/2024

BMC Palliative Care 1/2024 Go to the issue