Skip to main content
Top
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

Quality of care in the intensive care unit from the perspective of patient’s relatives: development and psychometric evaluation of the consumer quality index ‘R-ICU’

Authors: Ans Rensen, Margo M. van Mol, Ilse Menheere, Marjan D. Nijkamp, Ellen Verhoogt, Bea Maris, Willeke Manders, Lilian Vloet, Lisbeth Verharen

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

The quality standards of the Dutch Society of Intensive Care require monitoring of the satisfaction of patient’s relatives with respect to care. Currently, no suitable instrument is available in the Netherlands to measure this. This study describes the development and psychometric evaluation of the questionnaire-based Consumer Quality Index ‘Relatives in Intensive Care Unit’ (CQI ‘R-ICU’). The CQI ‘R-ICU’ measures the perceived quality of care from the perspective of patients’ relatives, and identifies aspects of care that need improvement.

Methods

The CQI ‘R-ICU’ was developed using a mixed method design. Items were based on quality of care aspects from earlier studies and from focus group interviews with patients’ relatives. The time period for the data collection of the psychometric evaluation was from October 2011 until July 2012. Relatives of adult intensive care patients in one university hospital and five general hospitals in the Netherlands were approached to participate. Psychometric evaluation included item analysis, inter-item analysis, and factor analysis.

Results

Twelve aspects were noted as being indicators of quality of care, and were subsequently selected for the questionnaire’s vocabulary. The response rate of patients’ relatives was 81% (n = 455). Quality of care was represented by two clusters, each showing a high reliability: ‘Communication’ (α = .80) and ‘Participation’ (α = .84). Relatives ranked the following aspects for quality of care as most important: no conflicting information, information from doctors and nurses is comprehensive, and health professionals take patients’ relatives seriously. The least important care aspects were: need for contact with peers, nuisance, and contact with a spiritual counsellor. Aspects that needed the most urgent improvement (highest quality improvement scores) were: information about how relatives can contribute to the care of the patient, information about the use of meal-facilities in the hospital, and involvement in decision-making on the medical treatment of the patient.

Conclusions

The CQI ‘R-ICU’ evaluates quality of care from the perspective of relatives of intensive care patients and provides practical information for quality assurance and improvement programs. The development and psychometric evaluation of the CQI ‘R-ICU’ led to a draft questionnaire, sufficient to justify further research into the reliability, validity, and the discriminative power of the questionnaire.
Appendix
Available only for authorised users
Literature
1.
go back to reference Davidson JE, Powers K, Hedayat KM, Tieszen M, Kon AA, Shepard E, et al. Clinical practice guidelines for support of the family in the patient-centered intensive care unit: American College of Critical Care Medicine Task Force 2004–2005. Crit Care Med. 2007;35(2):605–22.CrossRefPubMed Davidson JE, Powers K, Hedayat KM, Tieszen M, Kon AA, Shepard E, et al. Clinical practice guidelines for support of the family in the patient-centered intensive care unit: American College of Critical Care Medicine Task Force 2004–2005. Crit Care Med. 2007;35(2):605–22.CrossRefPubMed
2.
go back to reference Kaljouw M. Behoeften van familieleden van intensive care patiënten (Needs of family members of patients in the ICU), Thesis. Maastricht: proefschrift; 1998. Kaljouw M. Behoeften van familieleden van intensive care patiënten (Needs of family members of patients in the ICU), Thesis. Maastricht: proefschrift; 1998.
3.
go back to reference Verharen L, Mintjes J, Kaljouw M, Melief W, Schilder L, van der Laan G. Psychosocial needs of relatives of trauma patients, health & social work. 2015. doi:10.1093/hsw/hlv039. Verharen L, Mintjes J, Kaljouw M, Melief W, Schilder L, van der Laan G. Psychosocial needs of relatives of trauma patients, health & social work. 2015. doi:10.​1093/​hsw/​hlv039.
4.
go back to reference Söderstrom IK, Saveman B, Hagberg MS, Benzein E. Family adaptation in relation to a family member’s stay in ICU. Intensive Crit Care Nurs. 2009;25:250–7.CrossRefPubMed Söderstrom IK, Saveman B, Hagberg MS, Benzein E. Family adaptation in relation to a family member’s stay in ICU. Intensive Crit Care Nurs. 2009;25:250–7.CrossRefPubMed
5.
go back to reference Needham DM, Davidson J, Cohen H, Hopkins RO, Weinert C, Wunsch H, et al. Improving long-term outcomes after discharge from intensive care unit: report from a stakeholders’ conference. Crit Care Med. 2012;40(2):502–9.CrossRefPubMed Needham DM, Davidson J, Cohen H, Hopkins RO, Weinert C, Wunsch H, et al. Improving long-term outcomes after discharge from intensive care unit: report from a stakeholders’ conference. Crit Care Med. 2012;40(2):502–9.CrossRefPubMed
6.
go back to reference Elliott D, Davidson JE, Harvey MA, Bemis-Dougherty A, Hopkins RO, Iwashyna TJ, et al. Exploring the scope of post–intensive care syndrome therapy and care: engagement of Non–critical care providers and survivors in a second stakeholders meeting. Crit Care Med. 2014;42(12):2518–26.CrossRefPubMed Elliott D, Davidson JE, Harvey MA, Bemis-Dougherty A, Hopkins RO, Iwashyna TJ, et al. Exploring the scope of post–intensive care syndrome therapy and care: engagement of Non–critical care providers and survivors in a second stakeholders meeting. Crit Care Med. 2014;42(12):2518–26.CrossRefPubMed
7.
go back to reference Nederlandse Vereniging voor Anesthesiologie. Richtlijn. Organisatie en werkwijze op intensive care-afdelingen voor volwassenen in Nederland (Dutch Society of Anaesthesiology. Guideline. Organization and method in intensive care units for adults in the Netherlands). Alphen aan den Rijn: Van Zuiden Communications B.V; 2006. Nederlandse Vereniging voor Anesthesiologie. Richtlijn. Organisatie en werkwijze op intensive care-afdelingen voor volwassenen in Nederland (Dutch Society of Anaesthesiology. Guideline. Organization and method in intensive care units for adults in the Netherlands). Alphen aan den Rijn: Van Zuiden Communications B.V; 2006.
8.
go back to reference de Vos M, Graafmans W, Keesman E, Westert G, Van Der Voort PHJ. Quality measurement at intensive care units: which indicators should we use? J Crit Care. 2007;22:267–74.CrossRefPubMed de Vos M, Graafmans W, Keesman E, Westert G, Van Der Voort PHJ. Quality measurement at intensive care units: which indicators should we use? J Crit Care. 2007;22:267–74.CrossRefPubMed
9.
go back to reference Molter NC. Needs of relatives of critically ill patients: a descriptive study. Heart & Lung. 1979;8(2):332–9. Molter NC. Needs of relatives of critically ill patients: a descriptive study. Heart & Lung. 1979;8(2):332–9.
10.
go back to reference Rose U, Zimmermann L, Pfeifer R, Unterbrink T, Bauer J. Intention as an indicator for subjective need: a new pathway in need assessment. J Occup Med Toxicol. 2010;5(20):2–10. Rose U, Zimmermann L, Pfeifer R, Unterbrink T, Bauer J. Intention as an indicator for subjective need: a new pathway in need assessment. J Occup Med Toxicol. 2010;5(20):2–10.
11.
go back to reference Heyland K, Rocker GM, Dodek PM, Kutsogiannis DJ, Konopad E, Cook DJ, et al. Family satisfaction with care in the intensive care unit: results of a multiple center study. Crit Care Med. 2002;28:3044–9. Heyland K, Rocker GM, Dodek PM, Kutsogiannis DJ, Konopad E, Cook DJ, et al. Family satisfaction with care in the intensive care unit: results of a multiple center study. Crit Care Med. 2002;28:3044–9.
12.
go back to reference Wall RJ, Engelberg RA, Downey L, Heyland DK, Curtis JR. Refinement, scoring and validation of the Family Satisfaction in the Intensive Care Unit (FS-ICU) survey. Crit Care Med. 2007;35(1):271–8.CrossRefPubMed Wall RJ, Engelberg RA, Downey L, Heyland DK, Curtis JR. Refinement, scoring and validation of the Family Satisfaction in the Intensive Care Unit (FS-ICU) survey. Crit Care Med. 2007;35(1):271–8.CrossRefPubMed
13.
go back to reference van Mol MMC, Bakker EC, Kompanje EJO, Nijkamp MD. In response to: families’ experiences of ICU quality of care: development and validation of a european questionnaire (euroQ2). J Crit Care. 2015;30(6):1408–9.CrossRefPubMed van Mol MMC, Bakker EC, Kompanje EJO, Nijkamp MD. In response to: families’ experiences of ICU quality of care: development and validation of a european questionnaire (euroQ2). J Crit Care. 2015;30(6):1408–9.CrossRefPubMed
14.
go back to reference Cleary PD, Edgman-Levitan S. Health care quality. Incorporating consumer perspectives. JAMA. 1997;278:1608–12.CrossRefPubMed Cleary PD, Edgman-Levitan S. Health care quality. Incorporating consumer perspectives. JAMA. 1997;278:1608–12.CrossRefPubMed
15.
go back to reference van Mol MMC, Bakker EC, Nijkamp MD, Kompanje EJ, Bakker J, Verharen L. Relatives’ perspectives on the quality of care in an intensive care unit: the theoretical concept of a new tool. Patient Educ Couns. 2014;95(3):406–13.CrossRefPubMed van Mol MMC, Bakker EC, Nijkamp MD, Kompanje EJ, Bakker J, Verharen L. Relatives’ perspectives on the quality of care in an intensive care unit: the theoretical concept of a new tool. Patient Educ Couns. 2014;95(3):406–13.CrossRefPubMed
16.
go back to reference Hickman RL, Daly BJ, Douglas SL, Burant CJ. Evaluating the critical care family satisfaction survey for chronic critical illness. West J Nurs Res. 2012;34(3):377–95.CrossRefPubMed Hickman RL, Daly BJ, Douglas SL, Burant CJ. Evaluating the critical care family satisfaction survey for chronic critical illness. West J Nurs Res. 2012;34(3):377–95.CrossRefPubMed
17.
go back to reference Groenewegen PP, Kerssens JJ, Sixma HJ, van der Eijk I, Boerma WGW. What is important in evaluating health care quality? An international comparison of user views. BMC Health Serv Res. 2005;5(16):1–9. Groenewegen PP, Kerssens JJ, Sixma HJ, van der Eijk I, Boerma WGW. What is important in evaluating health care quality? An international comparison of user views. BMC Health Serv Res. 2005;5(16):1–9.
18.
go back to reference Sixma H, Hendriks M, de Boer D, Delnoij D. Handboek CQI Ontwikkeling: richtlijnen en voorschriften voor de ontwikkeling van een CQI meetinstrument (Manual CQI instruments. An instruction for the development and use of Consumer Quality Index (CQI) questionnaires). Utrecht: NIVEL (Netherlands Institute for Health Services Research); 2011. Sixma H, Hendriks M, de Boer D, Delnoij D. Handboek CQI Ontwikkeling: richtlijnen en voorschriften voor de ontwikkeling van een CQI meetinstrument (Manual CQI instruments. An instruction for the development and use of Consumer Quality Index (CQI) questionnaires). Utrecht: NIVEL (Netherlands Institute for Health Services Research); 2011.
19.
go back to reference Zuiddijk M. Measuring and improving the quality of care from the healthcare user perspective: the Consumer Quality Index. Tilburg: Tilburg University; 2011. Zuiddijk M. Measuring and improving the quality of care from the healthcare user perspective: the Consumer Quality Index. Tilburg: Tilburg University; 2011.
20.
go back to reference Wollersheim H, Bakker PJM, Bijnen AB, Gouma DJ, Wagner C, van der Weijden T. Kwaliteit en veiligheid in patiëntenzorg (Quality and safety in patientcare). Houten: Bohn Stafleu van Loghum; 2011.CrossRef Wollersheim H, Bakker PJM, Bijnen AB, Gouma DJ, Wagner C, van der Weijden T. Kwaliteit en veiligheid in patiëntenzorg (Quality and safety in patientcare). Houten: Bohn Stafleu van Loghum; 2011.CrossRef
21.
go back to reference Harteloh PPM, Casparie AF. Kwaliteit van zorg. Van een zorginhoudelijke benadering naar een bedrijfskundige aanpak (Quality of care. From a care-related approach to a managerial approach). Maarssen: Elsevier gezondheidszorg; 2011. Harteloh PPM, Casparie AF. Kwaliteit van zorg. Van een zorginhoudelijke benadering naar een bedrijfskundige aanpak (Quality of care. From a care-related approach to a managerial approach). Maarssen: Elsevier gezondheidszorg; 2011.
22.
go back to reference Rademakers J, Delnoij D, en Boer de D. Structure, process or outcome: which contributes most to patients’ overall assessment of healthcare quality? BMJ Qual Saf. 2011;20(4):326–31.CrossRefPubMed Rademakers J, Delnoij D, en Boer de D. Structure, process or outcome: which contributes most to patients’ overall assessment of healthcare quality? BMJ Qual Saf. 2011;20(4):326–31.CrossRefPubMed
23.
go back to reference Von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP, et al. The Strengthening the Reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. PLoS Med. 2007;4(10), e296. doi:10.1371/journal.pmed.0040296.CrossRef Von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP, et al. The Strengthening the Reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. PLoS Med. 2007;4(10), e296. doi:10.​1371/​journal.​pmed.​0040296.CrossRef
25.
go back to reference Sixma HJ, Kerssens JJ, Campen CV, Peters L. Quality of care from the patients’ perspective: from theoretical concept to a new measuring instrument. Health Expect. 1998;1(2):82–95.CrossRefPubMedPubMedCentral Sixma HJ, Kerssens JJ, Campen CV, Peters L. Quality of care from the patients’ perspective: from theoretical concept to a new measuring instrument. Health Expect. 1998;1(2):82–95.CrossRefPubMedPubMedCentral
26.
go back to reference Dillman DA, Smyth JD, Christian LM. Internet, mail and mixed-mode surveys: the tailored design method. 3rd ed. Hoboken New Jersey: Wiley; 2009. Dillman DA, Smyth JD, Christian LM. Internet, mail and mixed-mode surveys: the tailored design method. 3rd ed. Hoboken New Jersey: Wiley; 2009.
27.
go back to reference Leske JS. Needs of relatives of critically ill patients: a follow-up. Heart & Lung. 1986;15(2):189–93. Leske JS. Needs of relatives of critically ill patients: a follow-up. Heart & Lung. 1986;15(2):189–93.
28.
go back to reference Latour JM, van Goudoever JB, Schuurman BE, Albers MJIJ, van Dam NAM, Hazelzet JA. A qualitative study exploring the experiences of parents of children admitted to seven Dutch pediatric intensive care units. Intensive Care Med. 2011;37(2):319–25.CrossRefPubMed Latour JM, van Goudoever JB, Schuurman BE, Albers MJIJ, van Dam NAM, Hazelzet JA. A qualitative study exploring the experiences of parents of children admitted to seven Dutch pediatric intensive care units. Intensive Care Med. 2011;37(2):319–25.CrossRefPubMed
29.
go back to reference Claessen S, Francke A, Putten van der M, Deliens L. CQ-Index Palliatieve Zorg meet de kwaliteit van zorg vanuit gebruikersperspectief (CQ-index Palliative Care measures the quality of care from a user perspective). Pallium. 2010;12(2):23–5.CrossRef Claessen S, Francke A, Putten van der M, Deliens L. CQ-Index Palliatieve Zorg meet de kwaliteit van zorg vanuit gebruikersperspectief (CQ-index Palliative Care measures the quality of care from a user perspective). Pallium. 2010;12(2):23–5.CrossRef
30.
go back to reference Karlsson C, Tisell A, Engström A, Andershed B. Family members’ satisfaction with critical care: a pilot study. Nurs Crit Care. 2011;16(1):11–8.CrossRefPubMed Karlsson C, Tisell A, Engström A, Andershed B. Family members’ satisfaction with critical care: a pilot study. Nurs Crit Care. 2011;16(1):11–8.CrossRefPubMed
31.
go back to reference Schwarzkopf D, Behrend S, Skupin H, Westermann I, Riedemann NC, Pfeifer R, et al. Family satisfaction in the intensive care unit: a quantitative and qualitative analysis. Intensive Care Med. 2013. doi:10.1007/s00134-013-2862-7.PubMed Schwarzkopf D, Behrend S, Skupin H, Westermann I, Riedemann NC, Pfeifer R, et al. Family satisfaction in the intensive care unit: a quantitative and qualitative analysis. Intensive Care Med. 2013. doi:10.​1007/​s00134-013-2862-7.PubMed
32.
go back to reference Wall RJ, Curtis RJ, Cooke CR, Engelberg RA. Family satisfaction in the ICU: differences between families of survivors and nonsurvivors. Chest. 2007;132:1425–33.CrossRefPubMed Wall RJ, Curtis RJ, Cooke CR, Engelberg RA. Family satisfaction in the ICU: differences between families of survivors and nonsurvivors. Chest. 2007;132:1425–33.CrossRefPubMed
33.
go back to reference Heyland K, Tranmer JE. Measuring family satisfaction with care in the intensive care unit: the development of a questionnaire and preliminary results. J Crit Care. 2001;16(4):142–9.CrossRefPubMed Heyland K, Tranmer JE. Measuring family satisfaction with care in the intensive care unit: the development of a questionnaire and preliminary results. J Crit Care. 2001;16(4):142–9.CrossRefPubMed
34.
go back to reference Nelson JE, Angus DC, Weissfeld LA, Puntillo KA, Danis M, Deal D, et al. End-of-life care for the critically ill: a national intensive care unit survey. Crit Care Med. 2006;34(10):2547–53.CrossRefPubMed Nelson JE, Angus DC, Weissfeld LA, Puntillo KA, Danis M, Deal D, et al. End-of-life care for the critically ill: a national intensive care unit survey. Crit Care Med. 2006;34(10):2547–53.CrossRefPubMed
35.
go back to reference Lewis-Newby M, Randall Curtis J, Martin DP, Engelberg RA. Measuring family satisfaction with care and quality of dying in the intensive care unit: does patient Age matter? J Palliat Med. 2011;14(12):1284–90.CrossRefPubMedPubMedCentral Lewis-Newby M, Randall Curtis J, Martin DP, Engelberg RA. Measuring family satisfaction with care and quality of dying in the intensive care unit: does patient Age matter? J Palliat Med. 2011;14(12):1284–90.CrossRefPubMedPubMedCentral
36.
go back to reference Oliveira LM, Medeiros M, Barbosa MA, Siqueira KM, Oliveira PM, Munari DB. Support group as embracement strategy for relatives of patients in intensive care unit. Rev Esc Enferm USP. 2010;44(2):425–32. Oliveira LM, Medeiros M, Barbosa MA, Siqueira KM, Oliveira PM, Munari DB. Support group as embracement strategy for relatives of patients in intensive care unit. Rev Esc Enferm USP. 2010;44(2):425–32.
37.
38.
go back to reference van Mol MMC, Brackel M, Kompanje EJO, Gijsbers L, Nijkamp MD, Girbes ARJ, et al. Joined forces in person-centered care in the intensive care unit: a case report from the Netherlands. J Compassionate Healthc. 2016;3:5. doi:10.1186/s40639-016-0022-Y.CrossRef van Mol MMC, Brackel M, Kompanje EJO, Gijsbers L, Nijkamp MD, Girbes ARJ, et al. Joined forces in person-centered care in the intensive care unit: a case report from the Netherlands. J Compassionate Healthc. 2016;3:5. doi:10.​1186/​s40639-016-0022-Y.CrossRef
Metadata
Title
Quality of care in the intensive care unit from the perspective of patient’s relatives: development and psychometric evaluation of the consumer quality index ‘R-ICU’
Authors
Ans Rensen
Margo M. van Mol
Ilse Menheere
Marjan D. Nijkamp
Ellen Verhoogt
Bea Maris
Willeke Manders
Lilian Vloet
Lisbeth Verharen
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-016-1975-4

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue