Skip to main content
Top
Published in: BMC Geriatrics 1/2016

Open Access 01-12-2016 | Research article

Item distribution, internal consistency and inter-rater reliability of the German version of the QUALIDEM for people with mild to severe and very severe dementia

Authors: Martin Nikolaus Dichter, Christian G. G. Schwab, Gabriele Meyer, Sabine Bartholomeyczik, Margareta Halek

Published in: BMC Geriatrics | Issue 1/2016

Login to get access

Abstract

Background

The QUALIDEM is a dementia-specific Quality of life (Qol) instrument that is recommended for longitudinal studies and advanced stages of dementia. Our study aimed to develop a user guide for the German version of the QUALIDEM and to determine the item distribution, internal consistency and inter-rater reliability (IRR) of the German QUALIDEM.

Methods

A user guide was developed based on cognitive interviews with ten professional caregivers and a focus group with six professional caregivers. The item distribution, internal consistency and IRR were evaluated through a field test including n = 55 (mild to severe dementia) and n = 36 (very severe dementia) residents from nine nursing homes. Individuals with dementia were assessed four times by blinded proxy raters.

Results

A user guide with instructions for the application of the QUALIDEM and definitions and examples for each item was created. Based on the single-measure intra-class correlation coefficient (ICC for absolute agreement), we observed strong IRR for nearly all of the QUALIDEM subscales, with ICCs of at least 0.79. A lower ICC (ICC = 0.64) was only obtained for people with very severe dementia on the ‘negative affect’ subscale.

Conclusions

The IRR improved based on the application of the QUALIDEM user guide developed in this study. We demonstrated a sufficient IRR for all subscales of the German version of the QUALIDEM, with the exception of the ‘negative affect’ subscale in the subsample of people with very severe dementia. The item distribution and internal consistency results highlight the need to develop new informative items for some subscales.
Appendix
Available only for authorised users
Literature
1.
go back to reference Federal Ministry of Education and Research. Age has future. Research Agenda of the Federal Goverment for demographic change [Das Alter hat Zukunft. Forschungsagenda der Bundesregierung für den demographischen Wandel]. Bonn: Federal Ministry of Education and Research; 2011. Federal Ministry of Education and Research. Age has future. Research Agenda of the Federal Goverment for demographic change [Das Alter hat Zukunft. Forschungsagenda der Bundesregierung für den demographischen Wandel]. Bonn: Federal Ministry of Education and Research; 2011.
2.
go back to reference Institute P-COR - Patient-Centered Outcomes Research Institute. National Priorities for Research and Research Agenda: Patient-Centered Outcomes Research Institute. 2015. Institute P-COR - Patient-Centered Outcomes Research Institute. National Priorities for Research and Research Agenda: Patient-Centered Outcomes Research Institute. 2015.
3.
go back to reference Gibson MC, Carter MW, Helmes E, Edberg AK. Principles of good care for long-term care facilities. Int Psychogeriatr. 2010;22(7):1072–83.CrossRefPubMed Gibson MC, Carter MW, Helmes E, Edberg AK. Principles of good care for long-term care facilities. Int Psychogeriatr. 2010;22(7):1072–83.CrossRefPubMed
4.
go back to reference Moniz-Cook E, Vernooij-Dassen M, Woods R, Verhey F, Chattat R, De Vugt M, Mountain G, O'Connell M, Harrison J, Vasse E, et al. A European consensus on outcome measures for psychosocial intervention research in dementia care. Aging Ment Health. 2008;12(1):14–29. Moniz-Cook E, Vernooij-Dassen M, Woods R, Verhey F, Chattat R, De Vugt M, Mountain G, O'Connell M, Harrison J, Vasse E, et al. A European consensus on outcome measures for psychosocial intervention research in dementia care. Aging Ment Health. 2008;12(1):14–29.
5.
go back to reference WHO. The World Health Organization Quality of Life assessment (WHOQOL): position paper from the World Health Organization. Soc Sci Med. 1995;41(10):1403–9.CrossRef WHO. The World Health Organization Quality of Life assessment (WHOQOL): position paper from the World Health Organization. Soc Sci Med. 1995;41(10):1403–9.CrossRef
6.
go back to reference Ettema TP, Dröes RM, de Lange J, Ooms ME, Mellenbergh GJ, Ribbe MW. The concept of quality of life in dementia in the different stages of the disease. Int Psychogeriatr. 2005;17(3):353–70.CrossRefPubMed Ettema TP, Dröes RM, de Lange J, Ooms ME, Mellenbergh GJ, Ribbe MW. The concept of quality of life in dementia in the different stages of the disease. Int Psychogeriatr. 2005;17(3):353–70.CrossRefPubMed
7.
go back to reference Bowling A, Rowe G, Adams S, Sands P, Samsi K, Crane M, Joly L, Manthorpe J. Quality of life in dementia: a systematically conducted narrative review of dementia-specific measurement scales. Aging Ment Health. 2015;19(1):13–31.CrossRefPubMed Bowling A, Rowe G, Adams S, Sands P, Samsi K, Crane M, Joly L, Manthorpe J. Quality of life in dementia: a systematically conducted narrative review of dementia-specific measurement scales. Aging Ment Health. 2015;19(1):13–31.CrossRefPubMed
8.
go back to reference Rabins PV, Black BS. Measuring quality of life in dementia: purposes, goals, challenges and progress. Int Psychogeriatr. 2007;19(3):401–7.CrossRefPubMed Rabins PV, Black BS. Measuring quality of life in dementia: purposes, goals, challenges and progress. Int Psychogeriatr. 2007;19(3):401–7.CrossRefPubMed
9.
go back to reference Gräske J, Fischer T, Kuhlmey A, Wolf-Ostermann K. Quality of life in dementia care - differences in quality of life measurements performed by residents with dementia and by nursing staff. Aging Ment Health. 2012;16(7):819–27.CrossRefPubMed Gräske J, Fischer T, Kuhlmey A, Wolf-Ostermann K. Quality of life in dementia care - differences in quality of life measurements performed by residents with dementia and by nursing staff. Aging Ment Health. 2012;16(7):819–27.CrossRefPubMed
10.
go back to reference Sands LP, Ferreira P, Stewart AL, Brod M, Yaffe K. What explains differences between dementia patients’ and their caregivers’ ratings of patients’ quality of life? Am J Geriatr Psychiatry. 2004;12(3):272–80.CrossRefPubMed Sands LP, Ferreira P, Stewart AL, Brod M, Yaffe K. What explains differences between dementia patients’ and their caregivers’ ratings of patients’ quality of life? Am J Geriatr Psychiatry. 2004;12(3):272–80.CrossRefPubMed
11.
go back to reference Huang HL, Chang MY, Tang JS, Chiu YC, Weng LC. Determinants of the discrepancy in patient- and caregiver-rated quality of life for persons with dementia. J Clin Nurs. 2009;18(22):3107–18.CrossRefPubMed Huang HL, Chang MY, Tang JS, Chiu YC, Weng LC. Determinants of the discrepancy in patient- and caregiver-rated quality of life for persons with dementia. J Clin Nurs. 2009;18(22):3107–18.CrossRefPubMed
12.
go back to reference Gräske J, Meyer S, Wolf-Ostermann K. Quality of life ratings in dementia care - a cross-sectional study to identify factors associated with proxy-ratings. Health Qual Life Outcomes. 2014;12(1):177.CrossRefPubMed Gräske J, Meyer S, Wolf-Ostermann K. Quality of life ratings in dementia care - a cross-sectional study to identify factors associated with proxy-ratings. Health Qual Life Outcomes. 2014;12(1):177.CrossRefPubMed
13.
go back to reference Cooper C, Mukadam N, Katona C, Lyketsos CG, Ames D, Rabins P, Engedal K, de Mendonca Lima C, Blazer D, Teri L, et al. Systematic review of the effectiveness of non-pharmacological interventions to improve quality of life of people with dementia. Int Psychogeriatr. 2012;24(6):856–70.CrossRefPubMed Cooper C, Mukadam N, Katona C, Lyketsos CG, Ames D, Rabins P, Engedal K, de Mendonca Lima C, Blazer D, Teri L, et al. Systematic review of the effectiveness of non-pharmacological interventions to improve quality of life of people with dementia. Int Psychogeriatr. 2012;24(6):856–70.CrossRefPubMed
14.
go back to reference Ettema TP, Dröes RM, de Lange J, Mellenbergh GJ, Ribbe MW. QUALIDEM: development and evaluation of a dementia specific quality of life instrument. Scalability, reliability and internal structure. Int J Geriatr Psychiatry. 2007;22(6):549–56.CrossRefPubMed Ettema TP, Dröes RM, de Lange J, Mellenbergh GJ, Ribbe MW. QUALIDEM: development and evaluation of a dementia specific quality of life instrument. Scalability, reliability and internal structure. Int J Geriatr Psychiatry. 2007;22(6):549–56.CrossRefPubMed
15.
go back to reference Dichter MN, Schwab CG, Meyer G, Bartholomeyczik S, Halek M. Linguistic validation and reliability properties are weak investigated of most dementia-specific quality of life measurements-a systematic review. J Clin Epidemiol. 2015;70:233–45.CrossRefPubMed Dichter MN, Schwab CG, Meyer G, Bartholomeyczik S, Halek M. Linguistic validation and reliability properties are weak investigated of most dementia-specific quality of life measurements-a systematic review. J Clin Epidemiol. 2015;70:233–45.CrossRefPubMed
16.
go back to reference Dichter M, Bartholomeyczik S, Nordheim J, Achterberg W, Halek M. Validity, reliability, and feasibility of a quality of life questionnaire for people with dementia. Z Gerontol Geriatr. 2011;44(6):405–10.CrossRefPubMed Dichter M, Bartholomeyczik S, Nordheim J, Achterberg W, Halek M. Validity, reliability, and feasibility of a quality of life questionnaire for people with dementia. Z Gerontol Geriatr. 2011;44(6):405–10.CrossRefPubMed
17.
go back to reference Ettema TP, Dröes RM, de Lange J, Mellenbergh GJ, Ribbe MW. QUALIDEM: development and evaluation of a dementia specific quality of life instrument - validation. Int J Geriatr Psychiatry. 2007;22(5):424–30.CrossRefPubMed Ettema TP, Dröes RM, de Lange J, Mellenbergh GJ, Ribbe MW. QUALIDEM: development and evaluation of a dementia specific quality of life instrument - validation. Int J Geriatr Psychiatry. 2007;22(5):424–30.CrossRefPubMed
18.
go back to reference Bouman AI, Ettema TP, Wetzels RB, van Beek AP, de Lange J, Dröes RM. Evaluation of QUALIDEM: a dementia-specific quality of life instrument for persons with dementia in residential settings; scalability and reliability of subscales in four Dutch field surveys. Int J Geriatr Psychiatry. 2011;26(7):711–22.CrossRefPubMed Bouman AI, Ettema TP, Wetzels RB, van Beek AP, de Lange J, Dröes RM. Evaluation of QUALIDEM: a dementia-specific quality of life instrument for persons with dementia in residential settings; scalability and reliability of subscales in four Dutch field surveys. Int J Geriatr Psychiatry. 2011;26(7):711–22.CrossRefPubMed
19.
go back to reference Dichter M, Schwab C, Meyer G, Bartholomeyczik S, Dortmann O, Halek M. Measuring the quality of life in mild to very severe dementia: testing the inter-rater and intra-rater reliability of the German version of the QUALIDEM. Int Psychogeriatr. 2014;26(5):825–36.CrossRefPubMed Dichter M, Schwab C, Meyer G, Bartholomeyczik S, Dortmann O, Halek M. Measuring the quality of life in mild to very severe dementia: testing the inter-rater and intra-rater reliability of the German version of the QUALIDEM. Int Psychogeriatr. 2014;26(5):825–36.CrossRefPubMed
20.
go back to reference Dichter MN, Dortmann O, Halek M, Meyer G, Holle D, Nordheim J, Bartholomeyczik S. Scalability and internal consistency of the German version of the dementia-specific quality of life instrument QUALIDEM in nursing homes - a secondary data analysis. Health Qual Life Outcomes. 2013;11:91.CrossRefPubMedPubMedCentral Dichter MN, Dortmann O, Halek M, Meyer G, Holle D, Nordheim J, Bartholomeyczik S. Scalability and internal consistency of the German version of the dementia-specific quality of life instrument QUALIDEM in nursing homes - a secondary data analysis. Health Qual Life Outcomes. 2013;11:91.CrossRefPubMedPubMedCentral
21.
go back to reference Bonett DG. Sample size requirements for estimating intraclass correlations with desired precision. Stat Med. 2002;21(9):1331–5.CrossRefPubMed Bonett DG. Sample size requirements for estimating intraclass correlations with desired precision. Stat Med. 2002;21(9):1331–5.CrossRefPubMed
22.
go back to reference Reisberg B. Global measures: utility in defining and measuring treatment response in dementia. Int Psychogeriatr. 2007;19(3):421–56.CrossRefPubMed Reisberg B. Global measures: utility in defining and measuring treatment response in dementia. Int Psychogeriatr. 2007;19(3):421–56.CrossRefPubMed
23.
go back to reference Willis G. Cognitive interviewing: a tool for improving questionnaire design. London: Thousand Oaks Sage; 2005.CrossRef Willis G. Cognitive interviewing: a tool for improving questionnaire design. London: Thousand Oaks Sage; 2005.CrossRef
24.
go back to reference Hoben M, Bar M, Mahler C, Berger S, Squires JE, Estabrooks CA, Kruse A, Behrens J. Linguistic validation of the Alberta Context Tool and two measures of research use, for German residential long term care. BMC Res Notes. 2014;7:67.CrossRefPubMedPubMedCentral Hoben M, Bar M, Mahler C, Berger S, Squires JE, Estabrooks CA, Kruse A, Behrens J. Linguistic validation of the Alberta Context Tool and two measures of research use, for German residential long term care. BMC Res Notes. 2014;7:67.CrossRefPubMedPubMedCentral
25.
go back to reference Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969;9(3):179–86.CrossRefPubMed Lawton MP, Brody EM. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969;9(3):179–86.CrossRefPubMed
26.
go back to reference Mayring P. Qualitative content analysis: fundamentals and techniques [Qualitative Inhaltsanalyse: Grundlagen und Techniken]. 11th ed. Weinheim: Beltz; 2010. Mayring P. Qualitative content analysis: fundamentals and techniques [Qualitative Inhaltsanalyse: Grundlagen und Techniken]. 11th ed. Weinheim: Beltz; 2010.
27.
go back to reference Conger AJ. Integration and generalization of kappas for multiple raters. Psychol Bull. 1980;88:322–8.CrossRef Conger AJ. Integration and generalization of kappas for multiple raters. Psychol Bull. 1980;88:322–8.CrossRef
28.
go back to reference Mayer H, Nonn C, Osterbrink J, Evers GC. Quality criteria of assessment scales - Cohen’s kappa as measure of interrator reliability (1). Pflege. 2004;17(1):36–46.CrossRefPubMed Mayer H, Nonn C, Osterbrink J, Evers GC. Quality criteria of assessment scales - Cohen’s kappa as measure of interrator reliability (1). Pflege. 2004;17(1):36–46.CrossRefPubMed
29.
go back to reference Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.CrossRefPubMed Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.CrossRefPubMed
30.
go back to reference Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.CrossRefPubMed Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.CrossRefPubMed
31.
go back to reference Efron B, Tibshirani R. An introduction to the bootstrap. London: Chapmann and Hall; 1993.CrossRef Efron B, Tibshirani R. An introduction to the bootstrap. London: Chapmann and Hall; 1993.CrossRef
32.
go back to reference Carpenter J, Bithell J. Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. Stat Med. 2000;19(9):1141–64.CrossRefPubMed Carpenter J, Bithell J. Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. Stat Med. 2000;19(9):1141–64.CrossRefPubMed
34.
go back to reference Davison AC, Hinkley DV. Bootstrap methods and their applications. Cambridge: Cambridge University Press; 1997.CrossRef Davison AC, Hinkley DV. Bootstrap methods and their applications. Cambridge: Cambridge University Press; 1997.CrossRef
36.
go back to reference R Core Team. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2014. R Core Team. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2014.
37.
go back to reference Sloane PD, Zimmerman S, Williams CS, Reed PS, Gill KS, Preisser JS. Evaluating the quality of life of long-term care residents with dementia. Gerontologist. 2005;45 Spec No 1(1):37–49.CrossRefPubMed Sloane PD, Zimmerman S, Williams CS, Reed PS, Gill KS, Preisser JS. Evaluating the quality of life of long-term care residents with dementia. Gerontologist. 2005;45 Spec No 1(1):37–49.CrossRefPubMed
38.
go back to reference Menzi-Kuhn C. [Quality of life of people with dementia in institutional care] Lebensqualität von Menschen mit Demenz in stationären Langzeitpflegeeinrichtungen, Unpublished Masterthesis. Maastricht: Maastricht University; 2006. Menzi-Kuhn C. [Quality of life of people with dementia in institutional care] Lebensqualität von Menschen mit Demenz in stationären Langzeitpflegeeinrichtungen, Unpublished Masterthesis. Maastricht: Maastricht University; 2006.
39.
go back to reference Weiner MF, Martin-Cook K, Svetlik DA, Saine K, Foster B, Fontaine CS. The quality of life in late-stage dementia (QUALID) scale. J Am Med Dir Assoc. 2000;1(3):114–6.PubMed Weiner MF, Martin-Cook K, Svetlik DA, Saine K, Foster B, Fontaine CS. The quality of life in late-stage dementia (QUALID) scale. J Am Med Dir Assoc. 2000;1(3):114–6.PubMed
40.
go back to reference Garre-Olmo J, Planas-Pujol X, Lopez-Pousa S, Weiner MF, Turon-Estrada A, Juvinya D, Ballester D, Vilalta-Franch J. Cross-cultural adaptation and psychometric validation of a Spanish version of the Quality of Life in Late-Stage Dementia Scale. Qual Life Res. 2010;19(3):445–53.CrossRefPubMed Garre-Olmo J, Planas-Pujol X, Lopez-Pousa S, Weiner MF, Turon-Estrada A, Juvinya D, Ballester D, Vilalta-Franch J. Cross-cultural adaptation and psychometric validation of a Spanish version of the Quality of Life in Late-Stage Dementia Scale. Qual Life Res. 2010;19(3):445–53.CrossRefPubMed
41.
go back to reference Falk H, Persson LO, Wijk H. A psychometric evaluation of a Swedish version of the Quality of Life in Late-Stage Dementia (QUALID) scale. Int Psychogeriatr. 2007;19(6):1040–50.CrossRefPubMed Falk H, Persson LO, Wijk H. A psychometric evaluation of a Swedish version of the Quality of Life in Late-Stage Dementia (QUALID) scale. Int Psychogeriatr. 2007;19(6):1040–50.CrossRefPubMed
42.
go back to reference Ettema T. The development of a dementia specific Quality of Life scale: the first phase of construction. In: Ettema T, editor. The Construction of a dementia-specific Quality of Life instrument rated by professional caregivers: The QUALIDEM. Enschede: Gildeprint Drukkerijen; 2007. Ettema T. The development of a dementia specific Quality of Life scale: the first phase of construction. In: Ettema T, editor. The Construction of a dementia-specific Quality of Life instrument rated by professional caregivers: The QUALIDEM. Enschede: Gildeprint Drukkerijen; 2007.
43.
go back to reference Dichter M, Schwab CGG, Dortmann O, Meyer G, Bartholomeyczik S, Halek M. Interrater and Intrarater Reliability of a quality of life questionnaire in German nursing homes - results of the Qol-Dem project. Cairns: IPA International Meeting; 2012. Dichter M, Schwab CGG, Dortmann O, Meyer G, Bartholomeyczik S, Halek M. Interrater and Intrarater Reliability of a quality of life questionnaire in German nursing homes - results of the Qol-Dem project. Cairns: IPA International Meeting; 2012.
Metadata
Title
Item distribution, internal consistency and inter-rater reliability of the German version of the QUALIDEM for people with mild to severe and very severe dementia
Authors
Martin Nikolaus Dichter
Christian G. G. Schwab
Gabriele Meyer
Sabine Bartholomeyczik
Margareta Halek
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Geriatrics / Issue 1/2016
Electronic ISSN: 1471-2318
DOI
https://doi.org/10.1186/s12877-016-0296-0

Other articles of this Issue 1/2016

BMC Geriatrics 1/2016 Go to the issue