Skip to main content
Top
Published in: Health and Quality of Life Outcomes 1/2017

Open Access 01-01-2017 | Research

Validation of the Dutch version of the Swallowing Quality-of-Life Questionnaire (DSWAL-QoL) and the adjusted DSWAL-QoL (aDSWAL-QoL) using item analysis with the Rasch model: a pilot study

Authors: Ingeborg S. Simpelaere, Gwen Van Nuffelen, Marc De Bodt, Jan Vanderwegen, Tina Hansen

Published in: Health and Quality of Life Outcomes | Issue 1/2017

Login to get access

Abstract

Background

The Swallowing Quality-of-Life Questionnaire (SWAL-QoL) is considered the gold standard for assessing health-related QoL in oropharyngeal dysphagia. The Dutch translation (DSWAL-QoL) and its adjusted version (aDSWAL-QoL) have been validated using classical test theory (CTT). However, these scales have not been tested against the Rasch measurement model, which is required to establish the structural validity and objectivity of the total scale and subscale scores. Thus, the purpose of this study was to examine the psychometric properties of these scales using item analysis according to the Rasch model.

Methods

Item analysis with the Rasch model was performed using RUMM2030 software with previously collected data from a validation study of 108 patients. The assessment included evaluations of overall model fit, reliability, unidimensionality, threshold ordering, individual item and person fits, differential item functioning (DIF), local item dependency (LID) and targeting.

Results

The analysis could not establish the psychometric properties of either of the scales or their subscales because they did not fit the Rasch model, and multidimensionality, disordered thresholds, DIF, and/or LID were found. The reliability and power of fit were high for the total scales (PSI = 0.93) but low for most of the subscales (PSI < 0.70). The targeting of persons and items was suboptimal. The main source of misfit was disordered thresholds for both the total scales and subscales. Based on the results of the analysis, adjustments to improve the scales were implemented as follows: disordered thresholds were rescaled, misfit items were removed and items were split for DIF. However, the multidimensionality and LID could not be resolved. The reliability and power of fit remained low for most of the subscales.

Conclusions

This study represents the first analyses of the DSWAL-QoL and aDSWAL-QoL with the Rasch model. Relying on the DSWAL-QoL and aDSWAL-QoL total and subscale scores to make conclusions regarding dysphagia-related HRQoL should be treated with caution before the structural validity and objectivity of both scales have been established. A larger and well-targeted sample is recommended to derive definitive conclusions about the items and scales. Solutions for the psychometric weaknesses suggested by the model and practical implications are discussed.
Appendix
Available only for authorised users
Literature
1.
go back to reference Timmerman AA, Speyer R, Heijnen B, Klijn-Zwijnenberg IR. Psychometric characteristics of health-related quality-of-life questionnaires in oropharyngeal dysphagia. Dysphagia. 2014;29(2):183–98.CrossRefPubMed Timmerman AA, Speyer R, Heijnen B, Klijn-Zwijnenberg IR. Psychometric characteristics of health-related quality-of-life questionnaires in oropharyngeal dysphagia. Dysphagia. 2014;29(2):183–98.CrossRefPubMed
2.
go back to reference Sneeuw KC, Sprangers MA, Aaronson NK. The role of health care providers and significant others in evaluating the quality of life of patients with chronic disease. J Clin Epidemiol. 2002;55(11):1130–43.CrossRefPubMed Sneeuw KC, Sprangers MA, Aaronson NK. The role of health care providers and significant others in evaluating the quality of life of patients with chronic disease. J Clin Epidemiol. 2002;55(11):1130–43.CrossRefPubMed
4.
go back to reference Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.CrossRefPubMedPubMedCentral Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.CrossRefPubMedPubMedCentral
7.
go back to reference Vanderwegen J, Van Nuffelen G, De Bodt M. The validation and psychometric properties of the Dutch version of the swallowing quality-of-life questionnaire (SWAL-QoL). Dysphagia. 2013;28(1):11–23.CrossRefPubMed Vanderwegen J, Van Nuffelen G, De Bodt M. The validation and psychometric properties of the Dutch version of the swallowing quality-of-life questionnaire (SWAL-QoL). Dysphagia. 2013;28(1):11–23.CrossRefPubMed
8.
go back to reference Finizia C, Rudberg I, Bergqvist H, Rydén A. A cross-sectional validation study of the Swedish version of SWAL-QoL. Dysphagia. 2012;27(3):325–35.CrossRefPubMed Finizia C, Rudberg I, Bergqvist H, Rydén A. A cross-sectional validation study of the Swedish version of SWAL-QoL. Dysphagia. 2012;27(3):325–35.CrossRefPubMed
9.
go back to reference Zraick RI, Atherson SR, Ham BK. Readability of patient-reported outcome questionnaires for use with persons with swallowing disorders. Dysphagia. 2012;27(3):346–52.CrossRefPubMed Zraick RI, Atherson SR, Ham BK. Readability of patient-reported outcome questionnaires for use with persons with swallowing disorders. Dysphagia. 2012;27(3):346–52.CrossRefPubMed
10.
go back to reference de Vet HCW, Terwee CB, Mokkink LB, Knol DL. Measurements in medicine. A practical guide. 1st ed. Cambridge: Cambridge University Press; 2011.CrossRef de Vet HCW, Terwee CB, Mokkink LB, Knol DL. Measurements in medicine. A practical guide. 1st ed. Cambridge: Cambridge University Press; 2011.CrossRef
11.
go back to reference McHorney CA, Robbins J, Lomax K, Rosenbek JC, Chignell K, Kramer AE, et al. The SWAL-QOL and SWAL-CARE outcomes tool for oropharyngeal dysphagia in adults: III. Documentation of reliability and validity. Dysphagia. 2002;17(2):97–114.CrossRefPubMed McHorney CA, Robbins J, Lomax K, Rosenbek JC, Chignell K, Kramer AE, et al. The SWAL-QOL and SWAL-CARE outcomes tool for oropharyngeal dysphagia in adults: III. Documentation of reliability and validity. Dysphagia. 2002;17(2):97–114.CrossRefPubMed
12.
go back to reference Speyer R, Heijnen BJ, Baijens LW, Vrijenhoef FH, Otters EF, Roodenburg N, et al. Quality of life in oncological patients with oropharyngeal dysphagia: validity and reliability of the Dutch verison of the MD Anderson dysphagia inventory and the deglutition handicap index. Dysphagia. 2011;26(4):407–14.CrossRefPubMedPubMedCentral Speyer R, Heijnen BJ, Baijens LW, Vrijenhoef FH, Otters EF, Roodenburg N, et al. Quality of life in oncological patients with oropharyngeal dysphagia: validity and reliability of the Dutch verison of the MD Anderson dysphagia inventory and the deglutition handicap index. Dysphagia. 2011;26(4):407–14.CrossRefPubMedPubMedCentral
13.
go back to reference Simpelaere IS, Vanderwegen J, Wouters K, De Bodt M, Van Nuffelen G. Feasibility and Psychometric properties of the Adjusted DSWAL-QoL Questionnaire for Dysphagic Patients with Additional Language and/or Cognitive Impairment: Part I. Dysphagia. 2017. doi:10.1007/s00455-016-9770-2 Simpelaere IS, Vanderwegen J, Wouters K, De Bodt M, Van Nuffelen G. Feasibility and Psychometric properties of the Adjusted DSWAL-QoL Questionnaire for Dysphagic Patients with Additional Language and/or Cognitive Impairment: Part I. Dysphagia. 2017. doi:10.​1007/​s00455-016-9770-2
15.
go back to reference Petrillo J, Cano SJ, McLeod LD, Coon CD. Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examples. Value Health. 2015;18(1):25–34. doi:10.1016/j.jval.2014.10.005.CrossRefPubMed Petrillo J, Cano SJ, McLeod LD, Coon CD. Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examples. Value Health. 2015;18(1):25–34. doi:10.​1016/​j.​jval.​2014.​10.​005.CrossRefPubMed
17.
go back to reference Kreiner S. Validity and objectivity: reflections on the role and nature of Rasch models. Nordic Psychol. 2007;59(3):268–98.CrossRef Kreiner S. Validity and objectivity: reflections on the role and nature of Rasch models. Nordic Psychol. 2007;59(3):268–98.CrossRef
18.
go back to reference Tennant A, Conaghan PG. The Rasch measurement model in rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis Rheum. 2007;57(8):1358–62.CrossRefPubMed Tennant A, Conaghan PG. The Rasch measurement model in rheumatology: What is it and why use it? When should it be applied, and what should one look for in a Rasch paper? Arthritis Rheum. 2007;57(8):1358–62.CrossRefPubMed
19.
go back to reference Hagell P. Testing rating scale unidimensionality using the principal component analysis (PCA)/t-test protocol with the Rasch model: the primacy of theory over statistics. Open J Stat. 2014;4:456–65. doi:10.4236/ojs.2014.46044.CrossRef Hagell P. Testing rating scale unidimensionality using the principal component analysis (PCA)/t-test protocol with the Rasch model: the primacy of theory over statistics. Open J Stat. 2014;4:456–65. doi:10.​4236/​ojs.​2014.​46044.CrossRef
20.
go back to reference Portney LG, Watkins MP. Foundations of clinical research. Applications to practice. New Jersey: Prentice-Hall; 2000. Portney LG, Watkins MP. Foundations of clinical research. Applications to practice. New Jersey: Prentice-Hall; 2000.
21.
go back to reference Hagquist C, Bruce M, Gustavsson JP. Using the Rasch model in nursing research: an introduction and illustrative sample. Int J Nurs Stud. 2009;46(3):380–93.CrossRefPubMed Hagquist C, Bruce M, Gustavsson JP. Using the Rasch model in nursing research: an introduction and illustrative sample. Int J Nurs Stud. 2009;46(3):380–93.CrossRefPubMed
25.
go back to reference Mann G. The Mann assessment of swallowing ability. Clifton Park: Thomson Delmar Learning; 2002. Mann G. The Mann assessment of swallowing ability. Clifton Park: Thomson Delmar Learning; 2002.
26.
27.
go back to reference Graetz P, De Bleser R, Willmes K. Akense Afasie test. Nederlandse versie. Lisse: Swets & Zeitlinger; 1992. Graetz P, De Bleser R, Willmes K. Akense Afasie test. Nederlandse versie. Lisse: Swets & Zeitlinger; 1992.
30.
go back to reference Kukull WA, Larson EB, Teri L, Bowen J, McCormick W, Pfanschmidt ML. The mini-mental state examination score and the clinical diagnosis of dementia. J Clin Epidemiol. 1994;47(9):1061–7.CrossRefPubMed Kukull WA, Larson EB, Teri L, Bowen J, McCormick W, Pfanschmidt ML. The mini-mental state examination score and the clinical diagnosis of dementia. J Clin Epidemiol. 1994;47(9):1061–7.CrossRefPubMed
31.
go back to reference McHorney CA, Bricker DE, Robbins J, Kramer AE, Rosenbek JC, Chignell KA. The SWAL-QoL outcomes tool for oropharyngeal dysphagia in adults: II. Item reduction and preliminary scaling. Dysphagia. 2000;15(3):122–33.CrossRefPubMed McHorney CA, Bricker DE, Robbins J, Kramer AE, Rosenbek JC, Chignell KA. The SWAL-QoL outcomes tool for oropharyngeal dysphagia in adults: II. Item reduction and preliminary scaling. Dysphagia. 2000;15(3):122–33.CrossRefPubMed
32.
go back to reference Hansen T, Lambert H, Faber J. Validation of the Danish version of the McGill ingestive skills assessment using classical test theory and the Rasch model. Dis Rehabil. 2012;34(10):859–68.CrossRef Hansen T, Lambert H, Faber J. Validation of the Danish version of the McGill ingestive skills assessment using classical test theory and the Rasch model. Dis Rehabil. 2012;34(10):859–68.CrossRef
35.
go back to reference Pallant JF, Tennant A. An introduction to the Rasch measurement model: an example using the hospital anxiety and depression scale (HADS). Br J Clin Psychol. 2007;46(pt1):1–18.CrossRefPubMed Pallant JF, Tennant A. An introduction to the Rasch measurement model: an example using the hospital anxiety and depression scale (HADS). Br J Clin Psychol. 2007;46(pt1):1–18.CrossRefPubMed
36.
go back to reference Chen WH, Lenderking W, Jin Y, Wyrwich W, Gelhorn H, Revicki DA. Is Rasch model analysis applicable in small sample size pilot studies for assessing item characteristics? An example using PROMIS pain behavior item bank data. Qual Life Res. 2014;23:485–93.CrossRefPubMed Chen WH, Lenderking W, Jin Y, Wyrwich W, Gelhorn H, Revicki DA. Is Rasch model analysis applicable in small sample size pilot studies for assessing item characteristics? An example using PROMIS pain behavior item bank data. Qual Life Res. 2014;23:485–93.CrossRefPubMed
37.
go back to reference Kutlay Ş, Küçükdeveci AA, Elhan AH, Öztuna D, Koç N, Tennant A. Validation of the World Health Organization disability assessment schedule II (WHODAS-II) in patients with osteoarthritis. Rheumatol Int. 2011;31(3):339–46.CrossRefPubMed Kutlay Ş, Küçükdeveci AA, Elhan AH, Öztuna D, Koç N, Tennant A. Validation of the World Health Organization disability assessment schedule II (WHODAS-II) in patients with osteoarthritis. Rheumatol Int. 2011;31(3):339–46.CrossRefPubMed
38.
go back to reference Zucca A, Lambert SD, Boyes AW, Pallant JF. Rasch analysis of the mini-mental adjustment to cancer scale (Mini-MAC) among a heterogeneous sample of long-term cancer survivors: a cross-sectional study. Health Qual Life Outcomes. 2012;10(1):55.CrossRefPubMedPubMedCentral Zucca A, Lambert SD, Boyes AW, Pallant JF. Rasch analysis of the mini-mental adjustment to cancer scale (Mini-MAC) among a heterogeneous sample of long-term cancer survivors: a cross-sectional study. Health Qual Life Outcomes. 2012;10(1):55.CrossRefPubMedPubMedCentral
39.
go back to reference Marais I, Andrich D. Formalizing dimension and response violations of local independence in the unidimensional Rasch model. J Appl Meas. 2008;9(3):200–15. file:///C:/Users/Notebook/Downloads/ARC-Report11DistinguishingMDandRD%20(2).pdf. Accessed Feb 2017.PubMed Marais I, Andrich D. Formalizing dimension and response violations of local independence in the unidimensional Rasch model. J Appl Meas. 2008;9(3):200–15. file:///C:/Users/Notebook/Downloads/ARC-Report11DistinguishingMDandRD%20(2).pdf. Accessed Feb 2017.PubMed
42.
go back to reference McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack CR, Kawas CH, et al. The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement. 2011;7(3):263–9.CrossRefPubMedPubMedCentral McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack CR, Kawas CH, et al. The diagnosis of dementia due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement. 2011;7(3):263–9.CrossRefPubMedPubMedCentral
44.
go back to reference Whitley BE, Kyte ME. Principles of research in behavioural science. 3rd ed. NY: Taylor & Francis; 2013. Whitley BE, Kyte ME. Principles of research in behavioural science. 3rd ed. NY: Taylor & Francis; 2013.
45.
go back to reference Bogaerdt HC, Speyer R, Baijens LW, Fokkens WJ. Cross-cultural adaptation and validation of the Dutch version of SWAL-QoL. Dysphagia. 2009;24(1):66–70.CrossRef Bogaerdt HC, Speyer R, Baijens LW, Fokkens WJ. Cross-cultural adaptation and validation of the Dutch version of SWAL-QoL. Dysphagia. 2009;24(1):66–70.CrossRef
47.
go back to reference Holgado-Tello FP, Chacón-Moscoso S, Barbero-García I, Vila-Abad E. Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variables. Qual Quant. 2010;44(1):153–66. doi:10.1007/s11135-008-9190-y.CrossRef Holgado-Tello FP, Chacón-Moscoso S, Barbero-García I, Vila-Abad E. Polychoric versus Pearson correlations in exploratory and confirmatory factor analysis of ordinal variables. Qual Quant. 2010;44(1):153–66. doi:10.​1007/​s11135-008-9190-y.CrossRef
48.
go back to reference Cordier R, Joosten A, Clavé P, Schindler A, Bülow M, Demier N, et al. Evaluating the Psychometric Properties of the Eating Assessment Tool (EAT-10) Using Rasch Analysis. Dysphagia. 2016. doi:10.1007/s00455-016-9754-2. Cordier R, Joosten A, Clavé P, Schindler A, Bülow M, Demier N, et al. Evaluating the Psychometric Properties of the Eating Assessment Tool (EAT-10) Using Rasch Analysis. Dysphagia. 2016. doi:10.​1007/​s00455-016-9754-2.
50.
go back to reference Peeters JB, Daudey L, Heijdra YF, Molema J, Dekhuijzen PN, Vercoulen JH. Development of a battery of instruments for detailed measurement of health status in patients with COPD in routine care: the Nijmegen Clinical Screening Instrument. Qual Life Res. 2009;18(7):901–12.CrossRef Peeters JB, Daudey L, Heijdra YF, Molema J, Dekhuijzen PN, Vercoulen JH. Development of a battery of instruments for detailed measurement of health status in patients with COPD in routine care: the Nijmegen Clinical Screening Instrument. Qual Life Res. 2009;18(7):901–12.CrossRef
51.
go back to reference Fayers PM, Machin D. Quality of life: the assessment, analysis and reporting of patient-reported outcomes. 3rd ed. UK: Wiley; 2015.CrossRef Fayers PM, Machin D. Quality of life: the assessment, analysis and reporting of patient-reported outcomes. 3rd ed. UK: Wiley; 2015.CrossRef
Metadata
Title
Validation of the Dutch version of the Swallowing Quality-of-Life Questionnaire (DSWAL-QoL) and the adjusted DSWAL-QoL (aDSWAL-QoL) using item analysis with the Rasch model: a pilot study
Authors
Ingeborg S. Simpelaere
Gwen Van Nuffelen
Marc De Bodt
Jan Vanderwegen
Tina Hansen
Publication date
01-01-2017
Publisher
BioMed Central
Published in
Health and Quality of Life Outcomes / Issue 1/2017
Electronic ISSN: 1477-7525
DOI
https://doi.org/10.1186/s12955-017-0639-3

Other articles of this Issue 1/2017

Health and Quality of Life Outcomes 1/2017 Go to the issue