Skip to main content
Top
Published in: Quality of Life Research 4/2012

Open Access 01-05-2012

Psychometric properties of instruments to measure the quality of end-of-life care and dying for long-term care residents with dementia

Published in: Quality of Life Research | Issue 4/2012

Login to get access

Abstract

Purpose

Quality of care for long-term care (LTC) residents with dementia at the end-of-life is often evaluated using standardized instruments that were not developed for or thoroughly tested in this population. Given the importance of using appropriate instruments to evaluate the quality of care (QOC) and quality of dying (QOD) in LTC, we compared the validity and reliability of ten available instruments commonly used for these purposes.

Methods

We performed prospective observations and retrospective interviews and surveys of family (n = 70) and professionals (n = 103) of LTC decedents with dementia in the Netherlands.

Results

Instruments within the constructs QOC and QOD were highly correlated, and showed moderate to high correlation with overall assessments of QOC and QOD. Prospective and retrospective ratings using the same instruments differed little. Concordance between family and professional scores was low. Cronbach’s alpha was mostly adequate. The EOLD–CAD showed good fit with pre-assumed factor structures. The EOLD–SWC and FPCS appear most valid and reliable for measuring QOC, and the EOLD–CAD and MSSE for measuring QOD. The POS performed worst in this population.

Conclusions

Our comparative study of psychometric properties of instruments allows for informed selection of QOC and QOD measures for LTC residents with dementia.
Literature
1.
go back to reference Mitchell, S. L., Teno, J. M., Miller, S. C., & Mor, V. (2005). A national study of the location of death for older persons with dementia. Journal of the American Geriatrics Society, 53, 299–305.PubMedCrossRef Mitchell, S. L., Teno, J. M., Miller, S. C., & Mor, V. (2005). A national study of the location of death for older persons with dementia. Journal of the American Geriatrics Society, 53, 299–305.PubMedCrossRef
2.
go back to reference Houttekier, D., Cohen, J., Bilsen, J., Addington-Hall, J., Onwuteaka-Philipsen, B. D., & Deliens, L. (2010). Place of death of older persons with dementia. A study of five European countries. Journal of the American Geriatrics Society, 58, 751–756.PubMedCrossRef Houttekier, D., Cohen, J., Bilsen, J., Addington-Hall, J., Onwuteaka-Philipsen, B. D., & Deliens, L. (2010). Place of death of older persons with dementia. A study of five European countries. Journal of the American Geriatrics Society, 58, 751–756.PubMedCrossRef
3.
go back to reference Birch, D., & Draper, J. (2008). A critical literature review exploring the challenges of delivering effective palliative care to older people with dementia. Journal of Clinical Nursing, 17, 1144–1163.PubMedCrossRef Birch, D., & Draper, J. (2008). A critical literature review exploring the challenges of delivering effective palliative care to older people with dementia. Journal of Clinical Nursing, 17, 1144–1163.PubMedCrossRef
4.
go back to reference van der Steen, J. T. (2010). Dying with dementia: What we know after a decade with research. Journal of Alzheimer’s Disease, 22, 37–55.PubMed van der Steen, J. T. (2010). Dying with dementia: What we know after a decade with research. Journal of Alzheimer’s Disease, 22, 37–55.PubMed
5.
go back to reference Ferri, C. P., Prince, M., Brayne, H., et al. (2005). Global prevalence of dementia: A Delphi consensus study. Lancet, 366, 2112–2117.PubMedCrossRef Ferri, C. P., Prince, M., Brayne, H., et al. (2005). Global prevalence of dementia: A Delphi consensus study. Lancet, 366, 2112–2117.PubMedCrossRef
6.
go back to reference Health Council of the Netherlands. (2002). Dementie. The Hague: Health Council of the Netherlands. Health Council of the Netherlands. (2002). Dementie. The Hague: Health Council of the Netherlands.
7.
go back to reference van Soest-Poortvliet, M. C., van der Steen, J. T., Zimmerman, S., Cohen, L. W., Munn, J., Achterberg, W. P., et al. (2011). Measuring the quality of dying and quality of care when dying in long-term care settings: A qualitative content analysis of available instruments. Journal of Pain and Symptom Management. doi:10.1016/j.jpainsymman.2011.02.018. van Soest-Poortvliet, M. C., van der Steen, J. T., Zimmerman, S., Cohen, L. W., Munn, J., Achterberg, W. P., et al. (2011). Measuring the quality of dying and quality of care when dying in long-term care settings: A qualitative content analysis of available instruments. Journal of Pain and Symptom Management. doi:10.​1016/​j.​jpainsymman.​2011.​02.​018.
8.
go back to reference Volicer, L., Hurley, A. C., & Blasi, Z. V. (2001). Scales for evaluation of end-of-life care in dementia. Alzheimer Disease and Associated Disorders, 15(4), 194–200.PubMedCrossRef Volicer, L., Hurley, A. C., & Blasi, Z. V. (2001). Scales for evaluation of end-of-life care in dementia. Alzheimer Disease and Associated Disorders, 15(4), 194–200.PubMedCrossRef
9.
go back to reference Volicer, L., Hurley, A. C., & Blasi, Z. V. (2003). Characteristics of dementia end-of-life care across care settings. The American Journal of Hospice and Palliative Care, 20(3), 191–200.CrossRef Volicer, L., Hurley, A. C., & Blasi, Z. V. (2003). Characteristics of dementia end-of-life care across care settings. The American Journal of Hospice and Palliative Care, 20(3), 191–200.CrossRef
10.
go back to reference Kiely, D. K., Volicer, L., Teno, J., Jones, R. N., Prigerson, H. G., & Mitchell, S. L. (2006). The validity and reliability of scales for the evaluation of end-of-life care in advanced dementia. Alzheimer Disease and Associated Disorders, 20(3), 176–181.PubMedCrossRef Kiely, D. K., Volicer, L., Teno, J., Jones, R. N., Prigerson, H. G., & Mitchell, S. L. (2006). The validity and reliability of scales for the evaluation of end-of-life care in advanced dementia. Alzheimer Disease and Associated Disorders, 20(3), 176–181.PubMedCrossRef
11.
go back to reference Casarett, D. J., Pickerd, A., Bailey, A., et al. (2008). A nationwide VA palliative care quality measure: The family assessment of treatment at the end of life. Journal of Palliative Medicine, 11(1), 68–75.PubMedCrossRef Casarett, D. J., Pickerd, A., Bailey, A., et al. (2008). A nationwide VA palliative care quality measure: The family assessment of treatment at the end of life. Journal of Palliative Medicine, 11(1), 68–75.PubMedCrossRef
13.
go back to reference Vohra, J. U., Brazil, K., Hanna, S., & Abelson, J. (2004). Family perceptions of end-of-life care in long-term care facilities. Journal of Palliative Medicine, 20(4), 297–302. Vohra, J. U., Brazil, K., Hanna, S., & Abelson, J. (2004). Family perceptions of end-of-life care in long-term care facilities. Journal of Palliative Medicine, 20(4), 297–302.
14.
go back to reference Biola, H., Sloane, P. D., Williams, C. S., Daaleman, T. P., Williams, S. W., & Zimmerman, S. (2007). Physician communication with family caregivers of long-term care residents at the end of life. Journal of the American Geriatrics Society, 55, 846–856.PubMedCrossRef Biola, H., Sloane, P. D., Williams, C. S., Daaleman, T. P., Williams, S. W., & Zimmerman, S. (2007). Physician communication with family caregivers of long-term care residents at the end of life. Journal of the American Geriatrics Society, 55, 846–856.PubMedCrossRef
16.
go back to reference Teno, J. M., Clarrigdge, B., Casey, V., Edgman-Levitan, S., & Fowler, J. (2001). Validation of toolkit after-death bereaved family member interview. Journal of Pain and Symptom Management, 22(3), 752–758.PubMedCrossRef Teno, J. M., Clarrigdge, B., Casey, V., Edgman-Levitan, S., & Fowler, J. (2001). Validation of toolkit after-death bereaved family member interview. Journal of Pain and Symptom Management, 22(3), 752–758.PubMedCrossRef
17.
go back to reference Aminoff, B. Z., Purits, E., Noy, S., & Adunsky, A. (2004). Measuring the suffering of end-stage dementia: Reliability and validity of the mini-suffering state examination. Archives of Gerontology and Geriatrics, 38, 123–130.PubMedCrossRef Aminoff, B. Z., Purits, E., Noy, S., & Adunsky, A. (2004). Measuring the suffering of end-stage dementia: Reliability and validity of the mini-suffering state examination. Archives of Gerontology and Geriatrics, 38, 123–130.PubMedCrossRef
18.
go back to reference Hearn, J., & Higginson, I. J. (1999). Development and validation of a core outcome measure for palliative care: Palliative care outcome scale. Qual Health Care, 8, 219–227.PubMedCrossRef Hearn, J., & Higginson, I. J. (1999). Development and validation of a core outcome measure for palliative care: Palliative care outcome scale. Qual Health Care, 8, 219–227.PubMedCrossRef
19.
go back to reference Brandt, H. E., Deliens, L., van der Steen, J. T., Ooms, M. E., Ribbe, M. W., & van der Wal, G. (2005). The last days of life of patients with and without dementia assessed with the palliative care outcome scale. Palliative Medicine, 19, 334–342.PubMedCrossRef Brandt, H. E., Deliens, L., van der Steen, J. T., Ooms, M. E., Ribbe, M. W., & van der Wal, G. (2005). The last days of life of patients with and without dementia assessed with the palliative care outcome scale. Palliative Medicine, 19, 334–342.PubMedCrossRef
20.
go back to reference Siegert, R. J., Gao, W., Walkey, F. H., & Higginson, I. J. (2010). Psychological well-being and quality of care: A factor-analytic examination of the palliative care outcome scale. Journal of Pain and Symptom Management, 40(1), 67–74. Siegert, R. J., Gao, W., Walkey, F. H., & Higginson, I. J. (2010). Psychological well-being and quality of care: A factor-analytic examination of the palliative care outcome scale. Journal of Pain and Symptom Management, 40(1), 67–74.
21.
go back to reference Munn, J. C., Zimmerman, S., Hanson, L. C., et al. (2007). Measuring the quality of dying in long-term care. Journal of the American Geriatrics Society, 55, 1371–1379.PubMedCrossRef Munn, J. C., Zimmerman, S., Hanson, L. C., et al. (2007). Measuring the quality of dying in long-term care. Journal of the American Geriatrics Society, 55, 1371–1379.PubMedCrossRef
22.
go back to reference Gijsberts, M. J., van der Steen, J. T., Muller, M. T., & Deliens, L. (2008). [End-of-life with dementia in Dutch antroposofic and traditional nursing homes] Tijdschr Gerontol Geriatr, 39(6), 256–264. Dutch. Gijsberts, M. J., van der Steen, J. T., Muller, M. T., & Deliens, L. (2008). [End-of-life with dementia in Dutch antroposofic and traditional nursing homes] Tijdschr Gerontol Geriatr, 39(6), 256–264. Dutch.
23.
go back to reference Schols, R., Schipper, R.-J., Brabers, A., & Schols, J. (2003). [The Mini-Suffering State Exam (MSSE) has been studied in a Dutch nursing home]. Tijdschrift voor Verpleeghuisgeneeskunde, 27,14–18. Dutch. Schols, R., Schipper, R.-J., Brabers, A., & Schols, J. (2003). [The Mini-Suffering State Exam (MSSE) has been studied in a Dutch nursing home]. Tijdschrift voor Verpleeghuisgeneeskunde, 27,14–18. Dutch.
24.
go back to reference Mitchell, S. L, Kiely, D. K., Jones, R. N., et al. (2006). Advanced dementia research in the nursing home: The CASCADE study. Alzheimer Disease and Associated Disorders, 20, 166–175). Mitchell, S. L, Kiely, D. K., Jones, R. N., et al. (2006). Advanced dementia research in the nursing home: The CASCADE study. Alzheimer Disease and Associated Disorders, 20, 166–175).
25.
go back to reference Volicer, L., Hurley, A. C., Lathi, D. C., & Kowall, N. W. (1994). Measurement of severity in advanced Alzheimer’s disease. Journal of Gerontology, 49(5), M223–M226.PubMed Volicer, L., Hurley, A. C., Lathi, D. C., & Kowall, N. W. (1994). Measurement of severity in advanced Alzheimer’s disease. Journal of Gerontology, 49(5), M223–M226.PubMed
26.
go back to reference van der Steen, J. T., Volicer, L., Gerritsen, D. L., Kruse, R. L., Ribbe, M. W., & Mehr, D. R. (2006). Defining severe dementia with the Minimum Data Set. International Journal of Geriatric Psycology, 21, 1099–1106.CrossRef van der Steen, J. T., Volicer, L., Gerritsen, D. L., Kruse, R. L., Ribbe, M. W., & Mehr, D. R. (2006). Defining severe dementia with the Minimum Data Set. International Journal of Geriatric Psycology, 21, 1099–1106.CrossRef
27.
go back to reference Conroy, S., van der Cammen, T., Schols, J., van Balen, R., Peteroff, P., & Luxton, T. (2009). Medical services for older people in nursing homes—comparing services in England and the Netherlands. Journal of Nutrition, Health and Aging, 13(6), 559–563.CrossRef Conroy, S., van der Cammen, T., Schols, J., van Balen, R., Peteroff, P., & Luxton, T. (2009). Medical services for older people in nursing homes—comparing services in England and the Netherlands. Journal of Nutrition, Health and Aging, 13(6), 559–563.CrossRef
28.
go back to reference Hurley, A. C., Volicer, B. J., Hanrahan, P. A., Houde, S., & Volicer, L. (1992). Assessment of discomfort in advanced alzheimer patients. Research in Nursing and Health, 15, 369–377.PubMedCrossRef Hurley, A. C., Volicer, B. J., Hanrahan, P. A., Houde, S., & Volicer, L. (1992). Assessment of discomfort in advanced alzheimer patients. Research in Nursing and Health, 15, 369–377.PubMedCrossRef
29.
go back to reference Warden, V., Hurley, A. C., & Volicer, L. (2003). Development and psychometric evaluation of the pain assessment in advanced dementia (PAINAD) scale. Journal of American Medical Directors Association, 4, 9–15.CrossRef Warden, V., Hurley, A. C., & Volicer, L. (2003). Development and psychometric evaluation of the pain assessment in advanced dementia (PAINAD) scale. Journal of American Medical Directors Association, 4, 9–15.CrossRef
30.
go back to reference Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). New Jersey: Lawrence Erlbaum. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). New Jersey: Lawrence Erlbaum.
31.
go back to reference Lin, L. I. (1989). A concordance correlation coefficient to evaluate reproducibility. Biometrics, 45, 255–268.PubMedCrossRef Lin, L. I. (1989). A concordance correlation coefficient to evaluate reproducibility. Biometrics, 45, 255–268.PubMedCrossRef
32.
go back to reference Crawford, S. B., Kosinski, A. S., Lin, H. M., Williamson, J. M., & Barnhart, H. X. (2007). Computer programs for the concordance correlation coefficient. Computer Methods and Programs in Biomedicine, 88, 62–74.PubMedCrossRef Crawford, S. B., Kosinski, A. S., Lin, H. M., Williamson, J. M., & Barnhart, H. X. (2007). Computer programs for the concordance correlation coefficient. Computer Methods and Programs in Biomedicine, 88, 62–74.PubMedCrossRef
33.
go back to reference Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174.PubMedCrossRef Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174.PubMedCrossRef
34.
go back to reference Fayers, P. M., Hand, D. J., Bjordal, K., & Groenvold, M. (1997). Causal indicators in quality of life research. Quality of Life Research, 6, 393–406.PubMedCrossRef Fayers, P. M., Hand, D. J., Bjordal, K., & Groenvold, M. (1997). Causal indicators in quality of life research. Quality of Life Research, 6, 393–406.PubMedCrossRef
35.
go back to reference Edwards, J. R., & Bagozzi, R. P. (2000). On the nature and direction of relationships between constructs and measures. Psychological Methods, 5, 155–174.PubMedCrossRef Edwards, J. R., & Bagozzi, R. P. (2000). On the nature and direction of relationships between constructs and measures. Psychological Methods, 5, 155–174.PubMedCrossRef
36.
go back to reference Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55.CrossRef Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55.CrossRef
37.
go back to reference Terwee, C. B., Bot, S. D. M., de Boer, M. R., et al. (2007). Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology, 60(12), 34–42.PubMedCrossRef Terwee, C. B., Bot, S. D. M., de Boer, M. R., et al. (2007). Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology, 60(12), 34–42.PubMedCrossRef
38.
go back to reference Muthén, L. K., & Muthén, B. O. (1998–2010). Mplus user’s guide (6th ed.). Los Angeles, CA: Muthén & Muthén. Muthén, L. K., & Muthén, B. O. (1998–2010). Mplus user’s guide (6th ed.). Los Angeles, CA: Muthén & Muthén.
39.
go back to reference Teno, J. M., Landrum, J. M., & Lynn, J. (1997). Defining and measuring outcomes in end-stage dementia. Alzheimer Disease and Associated Disorders, 11(Suppl 6), 25–29.PubMed Teno, J. M., Landrum, J. M., & Lynn, J. (1997). Defining and measuring outcomes in end-stage dementia. Alzheimer Disease and Associated Disorders, 11(Suppl 6), 25–29.PubMed
40.
go back to reference van der Steen, J. T., Gijsberts, M. J. H. E., Knol, D. L., Deliens, L., & Muller, M. (2009). Ratings of symptoms and comfort in dementia patients at the end of life: Comparison of nurses and families. Palliative Medicine, 23, 317–324.PubMedCrossRef van der Steen, J. T., Gijsberts, M. J. H. E., Knol, D. L., Deliens, L., & Muller, M. (2009). Ratings of symptoms and comfort in dementia patients at the end of life: Comparison of nurses and families. Palliative Medicine, 23, 317–324.PubMedCrossRef
41.
go back to reference Shega, J. W., Houghham, G. W., Stocking, C. B., Cox-Hayley, D., & Sachs, G. A. (2008). Patients dying with dementia experience at the end of life and impact of hospice care. Journal of Pain and Symptom Management, 35, 499–507.PubMedCrossRef Shega, J. W., Houghham, G. W., Stocking, C. B., Cox-Hayley, D., & Sachs, G. A. (2008). Patients dying with dementia experience at the end of life and impact of hospice care. Journal of Pain and Symptom Management, 35, 499–507.PubMedCrossRef
42.
go back to reference Schalkwijk, D., Verlare, L. R., Muller, M. T., Knol, D. L., & van der Steen, J. T. (2009). Het meten van kwaliteit van leven bij ernstig demente verpleeghuisbewoners: psychometrische eigenschappen van de QUALID-schaal. Tijdschrift voor Gerontologie en Geriatrie, 40(5), 184–192.PubMedCrossRef Schalkwijk, D., Verlare, L. R., Muller, M. T., Knol, D. L., & van der Steen, J. T. (2009). Het meten van kwaliteit van leven bij ernstig demente verpleeghuisbewoners: psychometrische eigenschappen van de QUALID-schaal. Tijdschrift voor Gerontologie en Geriatrie, 40(5), 184–192.PubMedCrossRef
43.
go back to reference Parker, D., & Hodgkinson, B. (2011). A comparison of palliative care outcome measures used to assess the quality of palliative care provided in long-term care facilities: A systematic review. Palliative Medicine, 25(1), 5–20. Parker, D., & Hodgkinson, B. (2011). A comparison of palliative care outcome measures used to assess the quality of palliative care provided in long-term care facilities: A systematic review. Palliative Medicine, 25(1), 5–20.
44.
go back to reference Cohen, L. W., van Soest-Poortvliet, M. C., van der Steen, J. T., de Vet, H. C. W., Reed, D., & Zimmerman, S. (2009). Differences in the end-of-life experience in the United States and Netherlands. Gerontologist, 49(suppl 2), 58. Cohen, L. W., van Soest-Poortvliet, M. C., van der Steen, J. T., de Vet, H. C. W., Reed, D., & Zimmerman, S. (2009). Differences in the end-of-life experience in the United States and Netherlands. Gerontologist, 49(suppl 2), 58.
Metadata
Title
Psychometric properties of instruments to measure the quality of end-of-life care and dying for long-term care residents with dementia
Publication date
01-05-2012
Published in
Quality of Life Research / Issue 4/2012
Print ISSN: 0962-9343
Electronic ISSN: 1573-2649
DOI
https://doi.org/10.1007/s11136-011-9978-4

Other articles of this Issue 4/2012

Quality of Life Research 4/2012 Go to the issue