Skip to main content
Top
Published in: BMC Palliative Care 1/2016

Open Access 01-12-2016 | Research article

Validity, reliability and responsiveness to change of the Italian palliative care outcome scale: a multicenter study of advanced cancer patients

Authors: Massimo Costantini, Elisa Rabitti, Monica Beccaro, Flavio Fusco, Carlo Peruselli, Pietro La Ciura, Alessandro Valle, Cinzia Suriani, Maria Alejandra Berardi, Danila Valenti, Felicita Mosso, Piero Morino, Giovanni Zaninetta, Giorgio Tubere, Massimo Piazza, Michele Sofia, Silvia Di Leo, Irene J. Higginson

Published in: BMC Palliative Care | Issue 1/2016

Login to get access

Abstract

Background

There is an increasing requirement to assess outcomes, but few measures have been tested for advanced medical illness. We aimed to test the validity, reliability and responsiveness of the Palliative care Outcome Scale (POS), and to analyse predictors of change after the transition to palliative care.

Methods

Phase 1: multicentre, mixed method study comprising cognitive and qualitative interviews with patients and staff, cultural refinement and adaption. Phase 2: consecutive cancer patients on admission to 8 inpatient hospices and 7 home-based teams were asked to complete the POS, the EORTC QLQ-C15-PAL and the FACIT-Sp (T0), to assess internal consistency, convergent and divergent validity. After 6 days (T1) patients and staff completed the POS to assess responsiveness to change (T1-T0), and agreement between self-assessed POS and POS completed by the staff. Finally, we asked hospices an assessment 24–48 h after T1 to assess its reliability (test re-test analysis).

Results

Phase I: 209 completed POS questionnaires and 29 cognitive interviews were assessed, revisions made and one item substituted. Phase II: 295 consecutive patients admitted to 15 PCTs were approached, 175 (59.3 %) were eligible, and 150 (85.7 %) consented. Consent was limited by the severity of illness in 40 % patients. We found good convergent validity, with strong and moderate correlations (r ranged 0.5–0.8) between similar items from the POS, the QLQ-C15-PAL and the FACIT-Sp. As hypothesised, the physical function subscale of QLQ-C15-PAL was not correlated with any POS item (r ranged -0.16–0.02). We found acceptable to good test re-test reliability in both versions for 6 items. We found significant clinical improvements during the first week of palliative care in 7/10 items assessed-pain, other symptoms, patient and family anxiety, information, feeling at peace and wasted time.

Conclusions

Both the patient self-assessed and professional POS versions are valid and with an acceptable internal consistency. POS detected significant clinical improvements during palliative care, at a time when patients are usually expected to deteriorate. These results suggest that there is room for substantial improvement in the management of patients with advanced disease, across all key domains-symptoms, psychological, information, social and spiritual.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kamal AH, Currow DC, Ritchie C, Bull J, Wheeler JL, Abernethy AP. The value of data collection within a palliative care program. Curr Oncol Rep. 2011;13:308–15.CrossRefPubMed Kamal AH, Currow DC, Ritchie C, Bull J, Wheeler JL, Abernethy AP. The value of data collection within a palliative care program. Curr Oncol Rep. 2011;13:308–15.CrossRefPubMed
2.
go back to reference Bausewein C, Le Grice C, Simon S, Higginson I, PRISMA. The use of two common palliative outcome measures in clinical care and research: a systematic review of POS and STAS. Palliat Med. 2011;25(4):304–13.CrossRefPubMed Bausewein C, Le Grice C, Simon S, Higginson I, PRISMA. The use of two common palliative outcome measures in clinical care and research: a systematic review of POS and STAS. Palliat Med. 2011;25(4):304–13.CrossRefPubMed
4.
go back to reference Lipscomb J, Gotay CC, Snyder CF. Patient-reported outcomes in cancer: a review of recent research and policy initiatives. CA Cancer J Clin. 2007;57:278–300.CrossRefPubMed Lipscomb J, Gotay CC, Snyder CF. Patient-reported outcomes in cancer: a review of recent research and policy initiatives. CA Cancer J Clin. 2007;57:278–300.CrossRefPubMed
5.
go back to reference Gomes B, Higginson IJ. Where people die (1974--2030): past trends, future projections and implications for care. Palliat Med. 2008;22(1):33–41.CrossRefPubMed Gomes B, Higginson IJ. Where people die (1974--2030): past trends, future projections and implications for care. Palliat Med. 2008;22(1):33–41.CrossRefPubMed
6.
go back to reference McPherson CJ, Addington-Hall JM. Judging the quality of care at the end of life: can proxies provide reliable information? Soc Sci Med. 2003;56:95–109.CrossRefPubMed McPherson CJ, Addington-Hall JM. Judging the quality of care at the end of life: can proxies provide reliable information? Soc Sci Med. 2003;56:95–109.CrossRefPubMed
7.
go back to reference Harding R, Simon ST, Benalia H, Downing J, Daveson BA, Higginson IJ, et al. The PRISMA Symposium 1: outcome tool use. Disharmony in European outcomes research for palliative and advanced disease care: too many tools in practice. J Pain Symptom Manage. 2011;42(4):493–500.CrossRefPubMed Harding R, Simon ST, Benalia H, Downing J, Daveson BA, Higginson IJ, et al. The PRISMA Symposium 1: outcome tool use. Disharmony in European outcomes research for palliative and advanced disease care: too many tools in practice. J Pain Symptom Manage. 2011;42(4):493–500.CrossRefPubMed
8.
go back to reference Bausewein C, Simon ST, Benalia H, Downing J, Mwangi-Powell FN, Daveson BA, et al. Implementing patient reported outcome measures (PROMs) in palliative care--users’ cry for help. Health Qual Life Outcomes. 2011;9:27.CrossRefPubMedPubMedCentral Bausewein C, Simon ST, Benalia H, Downing J, Mwangi-Powell FN, Daveson BA, et al. Implementing patient reported outcome measures (PROMs) in palliative care--users’ cry for help. Health Qual Life Outcomes. 2011;9:27.CrossRefPubMedPubMedCentral
9.
go back to reference Dewolf L, Koller M, Velikova G, Johnson C, Scott N, Bottomley A. EORTC quality of life group translation procedure. 3rd ed. Brussels: European Organisation for Research and Treatment of Cancer; 2009. Dewolf L, Koller M, Velikova G, Johnson C, Scott N, Bottomley A. EORTC quality of life group translation procedure. 3rd ed. Brussels: European Organisation for Research and Treatment of Cancer; 2009.
10.
go back to reference Aspinal F, Hughes R, Higginson I, et al. A user’s guide to the palliative care outcome scale. London: Kings College; 2002. Aspinal F, Hughes R, Higginson I, et al. A user’s guide to the palliative care outcome scale. London: Kings College; 2002.
11.
go back to reference Hearn J, Higginson IJ, on behalf of the Palliative Care Audit Project Advisory Group. Development and validation of a core outcome measure for palliative care: the palliative care outcome scale. Qual Health Care. 1999;8(4):219–27.CrossRefPubMedPubMedCentral Hearn J, Higginson IJ, on behalf of the Palliative Care Audit Project Advisory Group. Development and validation of a core outcome measure for palliative care: the palliative care outcome scale. Qual Health Care. 1999;8(4):219–27.CrossRefPubMedPubMedCentral
12.
go back to reference Bausewein C, Fegg M, Radbruch L, Nauck F, von Mackensen S, Borasio GD, et al. Validation and clinical application of the German version of the palliative care outcome scale. J Pain Symptom Manage. 2005;30(1):51–62.CrossRefPubMed Bausewein C, Fegg M, Radbruch L, Nauck F, von Mackensen S, Borasio GD, et al. Validation and clinical application of the German version of the palliative care outcome scale. J Pain Symptom Manage. 2005;30(1):51–62.CrossRefPubMed
13.
go back to reference Higginson IJ, Simon ST, Benalia H, Downing J, Daveson BA, Harding R, et al. Which questions of two commonly used multidimensional palliative care patient reported outcome measures are most useful? Results from the European and African PRISMA survey. Postgrad Med J. 2012;88:451–7.CrossRefPubMed Higginson IJ, Simon ST, Benalia H, Downing J, Daveson BA, Harding R, et al. Which questions of two commonly used multidimensional palliative care patient reported outcome measures are most useful? Results from the European and African PRISMA survey. Postgrad Med J. 2012;88:451–7.CrossRefPubMed
15.
go back to reference Groenvold M, Petersen MA, Aaronson NK, Arraras JI, Blazeby JM, Bottomley A, et al. The development of the EORTC QLQ-C15-PAL: a shortened questionnaire for cancer patients in palliative care. Eur J Cancer. 2006;42(1):55–64.CrossRefPubMed Groenvold M, Petersen MA, Aaronson NK, Arraras JI, Blazeby JM, Bottomley A, et al. The development of the EORTC QLQ-C15-PAL: a shortened questionnaire for cancer patients in palliative care. Eur J Cancer. 2006;42(1):55–64.CrossRefPubMed
16.
go back to reference Nunes NA. The quality of life of Brazilian patients in palliative care: validation of the european organization for research and treatment of cancer quality of life questionnaire core 15 PAL (EORTC QLQ-C15-PAL). Support Care Cancer. 2014;22(6):1595–600.CrossRefPubMed Nunes NA. The quality of life of Brazilian patients in palliative care: validation of the european organization for research and treatment of cancer quality of life questionnaire core 15 PAL (EORTC QLQ-C15-PAL). Support Care Cancer. 2014;22(6):1595–600.CrossRefPubMed
17.
go back to reference Lien K, Zeng L, Nguyen J, Cramarossa G, Culleton S, Caissie A, et al. Comparison of the EORTC QLQ-C15-PAL and the FACIT-Pal for assessment of quality of life in patients with advanced cancer. Expert Rev Pharmacoecon Outcomes Res. 2011;11(5):541–7.CrossRefPubMed Lien K, Zeng L, Nguyen J, Cramarossa G, Culleton S, Caissie A, et al. Comparison of the EORTC QLQ-C15-PAL and the FACIT-Pal for assessment of quality of life in patients with advanced cancer. Expert Rev Pharmacoecon Outcomes Res. 2011;11(5):541–7.CrossRefPubMed
18.
go back to reference Peterman AH, Fitchett G, Brady MJ, Hernandez L, Cella D. Measuring spiritual well-being in people with cancer: the functional assessment of chronic illness therapy-Spiritual Well-being Scale (FACIT-Sp). Ann Behav Med. 2002;24(1):49–58.CrossRefPubMed Peterman AH, Fitchett G, Brady MJ, Hernandez L, Cella D. Measuring spiritual well-being in people with cancer: the functional assessment of chronic illness therapy-Spiritual Well-being Scale (FACIT-Sp). Ann Behav Med. 2002;24(1):49–58.CrossRefPubMed
19.
go back to reference Webster K, Cella D, Yost K. The Functional Assessment of Chronic Illness Therapy (FACIT) Measurement System: properties, applications, and interpretation. Health Qual Life Outcomes. 2003;1:79.CrossRefPubMedPubMedCentral Webster K, Cella D, Yost K. The Functional Assessment of Chronic Illness Therapy (FACIT) Measurement System: properties, applications, and interpretation. Health Qual Life Outcomes. 2003;1:79.CrossRefPubMedPubMedCentral
20.
go back to reference Munoz AR, Salsman JM, Stein KD, Cella D. Reference values of the Functional Assessment of Chronic Illness Therapy-Spiritual Well-Being: A report from the American Cancer Society’s studies of cancer survivors. Cancer. 2015. doi:10.1002/cncr.29286. Munoz AR, Salsman JM, Stein KD, Cella D. Reference values of the Functional Assessment of Chronic Illness Therapy-Spiritual Well-Being: A report from the American Cancer Society’s studies of cancer survivors. Cancer. 2015. doi:10.​1002/​cncr.​29286.
21.
go back to reference Regnard CFB, Tempest S, Toscani F. Manuale di Medicina Palliativa. Roma: CIC Editore; 2002. p. 190–3. Regnard CFB, Tempest S, Toscani F. Manuale di Medicina Palliativa. Roma: CIC Editore; 2002. p. 190–3.
22.
go back to reference Paiva CE, Barroso EM, Carnesca EC, et al. A critical analysis of test-retest reliability instrument validation studies of cancer patients under palliative care: a systematic review. BMC Med Res Methodol. 2014;14:8.CrossRefPubMedPubMedCentral Paiva CE, Barroso EM, Carnesca EC, et al. A critical analysis of test-retest reliability instrument validation studies of cancer patients under palliative care: a systematic review. BMC Med Res Methodol. 2014;14:8.CrossRefPubMedPubMedCentral
23.
go back to reference Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.CrossRefPubMed Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.CrossRefPubMed
24.
go back to reference Landers R. Computing Intraclass Correlations (ICC) as Estimates of Interrater Reliability in SPSS. Winnower. 2015;2, e143518.81744. Landers R. Computing Intraclass Correlations (ICC) as Estimates of Interrater Reliability in SPSS. Winnower. 2015;2, e143518.81744.
25.
go back to reference Steinhauser KE. “Are you at peace”. One item to probe spiritual concerns at the end of life. Arch Int Med. 2006;166:101–5.CrossRef Steinhauser KE. “Are you at peace”. One item to probe spiritual concerns at the end of life. Arch Int Med. 2006;166:101–5.CrossRef
26.
go back to reference Harding R, Selman L, Agupio G, Dinat N, Downing J, Gwyther L, et al. Validation of a core outcome measure for palliative care in Africa: the APCA African Palliative Outcome Scale. Health Qual Life Outcomes. 2010;8:10.CrossRefPubMedPubMedCentral Harding R, Selman L, Agupio G, Dinat N, Downing J, Gwyther L, et al. Validation of a core outcome measure for palliative care in Africa: the APCA African Palliative Outcome Scale. Health Qual Life Outcomes. 2010;8:10.CrossRefPubMedPubMedCentral
27.
go back to reference Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: Lawrence Erlbaum; 1988. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale: Lawrence Erlbaum; 1988.
28.
go back to reference Temel JS, Greer JA, Muzikansky A, et al. Early palliative care for patients with metastatic Non–small-cell lung cancer. New Engl J Med. 2010;363(8):733–42.CrossRefPubMed Temel JS, Greer JA, Muzikansky A, et al. Early palliative care for patients with metastatic Non–small-cell lung cancer. New Engl J Med. 2010;363(8):733–42.CrossRefPubMed
29.
go back to reference Zimmermann C, Swami N, Krzyzanowska M, et al. Early palliative care for patients with advanced cancer: a cluster-randomised controlled trial. Lancet. 2014;383(9930):1721–30.CrossRefPubMed Zimmermann C, Swami N, Krzyzanowska M, et al. Early palliative care for patients with advanced cancer: a cluster-randomised controlled trial. Lancet. 2014;383(9930):1721–30.CrossRefPubMed
30.
go back to reference Higginson IJ, Bausewein C, Reilly CC, et al. An integrated palliative and respiratory care service for patients with advanced disease and refractory breathlessness: a randomised controlled trial. Lancet Respir Med. 2014;2(12):979–87.CrossRefPubMed Higginson IJ, Bausewein C, Reilly CC, et al. An integrated palliative and respiratory care service for patients with advanced disease and refractory breathlessness: a randomised controlled trial. Lancet Respir Med. 2014;2(12):979–87.CrossRefPubMed
31.
go back to reference Editorial. A call for equity in the delivery of UK palliative care. Lancet 2015; 385:1478. Editorial. A call for equity in the delivery of UK palliative care. Lancet 2015; 385:1478.
32.
go back to reference Sleeman KE, Davies JM, Verne J, Gao W, Higginson IJ. The changing demographics of inpatient hospice death: Population-based cross-sectional study in England, 1993–2012. Palliat Med. 2016;30(1):45–53.CrossRefPubMedPubMedCentral Sleeman KE, Davies JM, Verne J, Gao W, Higginson IJ. The changing demographics of inpatient hospice death: Population-based cross-sectional study in England, 1993–2012. Palliat Med. 2016;30(1):45–53.CrossRefPubMedPubMedCentral
33.
go back to reference Selman L, Speck P, Gysels M, Agupio G, Dinat N, Downing J, et al. ‘Peace’ and ‘life worthwhile’ as measures of spiritual well-being in African palliative care: a mixed-methods study. Health Qual Life Outcomes. 2013;11:94.CrossRefPubMedPubMedCentral Selman L, Speck P, Gysels M, Agupio G, Dinat N, Downing J, et al. ‘Peace’ and ‘life worthwhile’ as measures of spiritual well-being in African palliative care: a mixed-methods study. Health Qual Life Outcomes. 2013;11:94.CrossRefPubMedPubMedCentral
34.
go back to reference Antunes B, Murtagh F, Bausewein C, Harding R, Higginson IJ, EURO IMPACT. Screening for depression in advanced disease: psychometric properties, sensitivity, and specificity of two items of the Palliative Care Outcome Scale (POS). J Pain Symptom Manage. 2015;49:277–88.CrossRefPubMed Antunes B, Murtagh F, Bausewein C, Harding R, Higginson IJ, EURO IMPACT. Screening for depression in advanced disease: psychometric properties, sensitivity, and specificity of two items of the Palliative Care Outcome Scale (POS). J Pain Symptom Manage. 2015;49:277–88.CrossRefPubMed
Metadata
Title
Validity, reliability and responsiveness to change of the Italian palliative care outcome scale: a multicenter study of advanced cancer patients
Authors
Massimo Costantini
Elisa Rabitti
Monica Beccaro
Flavio Fusco
Carlo Peruselli
Pietro La Ciura
Alessandro Valle
Cinzia Suriani
Maria Alejandra Berardi
Danila Valenti
Felicita Mosso
Piero Morino
Giovanni Zaninetta
Giorgio Tubere
Massimo Piazza
Michele Sofia
Silvia Di Leo
Irene J. Higginson
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Palliative Care / Issue 1/2016
Electronic ISSN: 1472-684X
DOI
https://doi.org/10.1186/s12904-016-0095-6

Other articles of this Issue 1/2016

BMC Palliative Care 1/2016 Go to the issue