Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Research article

Using the random forest method to detect a response shift in the quality of life of multiple sclerosis patients: a cohort study

Authors: Mohamed Boucekine, Anderson Loundou, Karine Baumstarck, Patricia Minaya-Flores, Jean Pelletier, Badih Ghattas, Pascal Auquier

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

Multiple sclerosis (MS), a common neurodegenerative disease, has well-described associations with quality of life (QoL) impairment. QoL changes found in longitudinal studies are difficult to interpret due to the potential response shift (RS) corresponding to respondents’ changing standards, values, and conceptualization of QoL. This study proposes to test the capacity of Random Forest (RF) for detecting RS reprioritization as the relative importance of QoL domains’ changes over time.

Methods

This was a longitudinal observational study. The main inclusion criteria were patients 18 years old or more with relapsing-remitting multiple sclerosis. Every 6 months up to month 24, QoL was recorded using generic and MS-specific questionnaires (MusiQoL and SF-36). At 24 months, individuals were divided into two ‘disability change’ groups: worsened and not-worsened patients. The RF method was performed based on Breiman’s description. Analyses were performed to determine which QoL scores of SF-36 predicted the MusiQoL index. The average variable importance (AVI) was estimated.

Results

A total of 417 (79.6%) patients were defined as not-worsened and 107 (20.4%) as worsened. A clear RS was identified in worsened patients. While the mental score AVI was almost one third higher than the physical score AVI at 12 months, it was 1.5 times lower at 24 months.

Conclusion

This work confirms that the RF method offers a useful statistical approach for RS detection. How to integrate the RS in the interpretation of QoL scores remains a challenge for future research.

Trial registration

ClinicalTrials.gov identifier: NCT00702065
Appendix
Available only for authorised users
Literature
1.
go back to reference Mitchell AJ, Benito-Leon J, Gonzalez JM, Rivera-Navarro J: Quality of life and its assessment in multiple sclerosis: integrating physical and psychological components of wellbeing. Lancet Neurol. 2005, 4 (9): 556-566. 10.1016/S1474-4422(05)70166-6.CrossRefPubMed Mitchell AJ, Benito-Leon J, Gonzalez JM, Rivera-Navarro J: Quality of life and its assessment in multiple sclerosis: integrating physical and psychological components of wellbeing. Lancet Neurol. 2005, 4 (9): 556-566. 10.1016/S1474-4422(05)70166-6.CrossRefPubMed
2.
go back to reference Solari A: Role of health-related quality of life measures in the routine care of people with multiple sclerosis. Health Qual Life Outcomes. 2005, 3: 16-10.1186/1477-7525-3-16.CrossRefPubMedPubMedCentral Solari A: Role of health-related quality of life measures in the routine care of people with multiple sclerosis. Health Qual Life Outcomes. 2005, 3: 16-10.1186/1477-7525-3-16.CrossRefPubMedPubMedCentral
3.
go back to reference Miller DM, Allen R: Quality of life in multiple sclerosis: determinants, measurement, and use in clinical practice. Curr Neurol Neurosci Rep. 2010, 10 (5): 397-406. 10.1007/s11910-010-0132-4.CrossRefPubMed Miller DM, Allen R: Quality of life in multiple sclerosis: determinants, measurement, and use in clinical practice. Curr Neurol Neurosci Rep. 2010, 10 (5): 397-406. 10.1007/s11910-010-0132-4.CrossRefPubMed
4.
go back to reference Rudick RA, Miller DM: Health-related quality of life in multiple sclerosis: current evidence, measurement and effects of disease severity and treatment. CNS Drugs. 2008, 22 (10): 827-839. 10.2165/00023210-200822100-00004.CrossRefPubMed Rudick RA, Miller DM: Health-related quality of life in multiple sclerosis: current evidence, measurement and effects of disease severity and treatment. CNS Drugs. 2008, 22 (10): 827-839. 10.2165/00023210-200822100-00004.CrossRefPubMed
5.
go back to reference Sprangers MA, Schwartz CE: Integrating response shift into health-related quality of life research: a theoretical model. Soc Sci Med. 1999, 48 (11): 1507-1515. 10.1016/S0277-9536(99)00045-3.CrossRefPubMed Sprangers MA, Schwartz CE: Integrating response shift into health-related quality of life research: a theoretical model. Soc Sci Med. 1999, 48 (11): 1507-1515. 10.1016/S0277-9536(99)00045-3.CrossRefPubMed
6.
go back to reference Schwartz CE, Sprangers MA: Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Soc Sci Med. 1999, 48 (11): 1531-1548. 10.1016/S0277-9536(99)00047-7.CrossRefPubMed Schwartz CE, Sprangers MA: Methodological approaches for assessing response shift in longitudinal health-related quality-of-life research. Soc Sci Med. 1999, 48 (11): 1531-1548. 10.1016/S0277-9536(99)00047-7.CrossRefPubMed
7.
go back to reference King-Kallimanis BL, Oort FJ, Nolte S, Schwartz CE, Sprangers MA: Using structural equation modeling to detect response shift in performance and health-related quality of life scores of multiple sclerosis patients. Qual Life Res. 2011, 20 (10): 1527-1540. 10.1007/s11136-010-9844-9.CrossRefPubMedPubMedCentral King-Kallimanis BL, Oort FJ, Nolte S, Schwartz CE, Sprangers MA: Using structural equation modeling to detect response shift in performance and health-related quality of life scores of multiple sclerosis patients. Qual Life Res. 2011, 20 (10): 1527-1540. 10.1007/s11136-010-9844-9.CrossRefPubMedPubMedCentral
8.
go back to reference Ahmed S, Mayo N, Scott S, Kuspinar A, Schwartz C: Using latent trajectory analysis of residuals to detect response shift in general health among patients with multiple sclerosis. Qual Life Res. 2011, 20 (10): 1555-1560. 10.1007/s11136-011-0005-6.CrossRefPubMed Ahmed S, Mayo N, Scott S, Kuspinar A, Schwartz C: Using latent trajectory analysis of residuals to detect response shift in general health among patients with multiple sclerosis. Qual Life Res. 2011, 20 (10): 1555-1560. 10.1007/s11136-011-0005-6.CrossRefPubMed
9.
go back to reference Li Y, Schwartz CE: Data mining for response shift patterns in multiple sclerosis patients using recursive partitioning tree analysis. Qual Life Res. 2011, 20 (10): 1543-1553. 10.1007/s11136-011-0004-7.CrossRefPubMed Li Y, Schwartz CE: Data mining for response shift patterns in multiple sclerosis patients using recursive partitioning tree analysis. Qual Life Res. 2011, 20 (10): 1543-1553. 10.1007/s11136-011-0004-7.CrossRefPubMed
10.
go back to reference Schwartz CE, Sprangers MA, Oort F, Ahmed S, Bode R, Li Y, Vollmer T: Response shift in patients with multiple sclerosis: an application of three statistical techniques. Qual Life Res. 2011, 20 (10): 1561-1572. 10.1007/s11136-011-0056-8.CrossRefPubMed Schwartz CE, Sprangers MA, Oort F, Ahmed S, Bode R, Li Y, Vollmer T: Response shift in patients with multiple sclerosis: an application of three statistical techniques. Qual Life Res. 2011, 20 (10): 1561-1572. 10.1007/s11136-011-0056-8.CrossRefPubMed
11.
go back to reference Breiman L: Random Forests. Mach Learn. 2001, 45: 5-32. 10.1023/A:1010933404324.CrossRef Breiman L: Random Forests. Mach Learn. 2001, 45: 5-32. 10.1023/A:1010933404324.CrossRef
13.
go back to reference Verikas A, Gelzinis A, Bacauskiene M: Mining data with random forests: a survey and results of new tests. Pattern Recognition. 2011, 44 (2): 330-349. 10.1016/j.patcog.2010.08.011.CrossRef Verikas A, Gelzinis A, Bacauskiene M: Mining data with random forests: a survey and results of new tests. Pattern Recognition. 2011, 44 (2): 330-349. 10.1016/j.patcog.2010.08.011.CrossRef
14.
go back to reference Touw WG, Bayjanov JR, Overmars L, Backus L, Boekhorst J, Wels M, van Hijum SA: Data mining in the Life Sciences with Random Forest: a walk in the park or lost in the jungle?. Brief Bioinform. 2012, 10.1093/bib/bbs034. Touw WG, Bayjanov JR, Overmars L, Backus L, Boekhorst J, Wels M, van Hijum SA: Data mining in the Life Sciences with Random Forest: a walk in the park or lost in the jungle?. Brief Bioinform. 2012, 10.1093/bib/bbs034.
16.
go back to reference Goldstein BA, Polley EC, Briggs FBS: Random forests for genetic association studies. Stat Appl Genet Mol Biol. 2011, 10: 1-34. Goldstein BA, Polley EC, Briggs FBS: Random forests for genetic association studies. Stat Appl Genet Mol Biol. 2011, 10: 1-34.
17.
go back to reference Flachenecker P, Baumstarck-Barrau K, Butzkueven H, Fernández O, Idiman E, Pelletier J, Stecchi S, Verdun di Cantogno E, Milner A, Auquier P: and the MusiQoL Responsiveness study group. MusiQoL responsiveness exploratory analyses. 5th Joint Triennial Congress of the European and Americas Committees for Treatment and Research in Multiple Sclerosis (ECTRIMS/ACTRIMS). 2011, Amsterdam, The Netherlands. Flachenecker P, Baumstarck-Barrau K, Butzkueven H, Fernández O, Idiman E, Pelletier J, Stecchi S, Verdun di Cantogno E, Milner A, Auquier P: and the MusiQoL Responsiveness study group. MusiQoL responsiveness exploratory analyses. 5th Joint Triennial Congress of the European and Americas Committees for Treatment and Research in Multiple Sclerosis (ECTRIMS/ACTRIMS). 2011, Amsterdam, The Netherlands.
18.
go back to reference McDonald WI, Compston A, Edan G, Goodkin D, Hartung HP, Lublin FD, McFarland HF, Paty DW, Polman CH, Reingold SC: Recommended diagnostic criteria for multiple sclerosis: guidelines from the International Panel on the diagnosis of multiple sclerosis. Ann Neurol. 2001, 50 (1): 121-127. 10.1002/ana.1032.CrossRefPubMed McDonald WI, Compston A, Edan G, Goodkin D, Hartung HP, Lublin FD, McFarland HF, Paty DW, Polman CH, Reingold SC: Recommended diagnostic criteria for multiple sclerosis: guidelines from the International Panel on the diagnosis of multiple sclerosis. Ann Neurol. 2001, 50 (1): 121-127. 10.1002/ana.1032.CrossRefPubMed
19.
go back to reference Polman CH, Wolinsky JS, Reingold SC: Multiple sclerosis diagnostic criteria: three years later. Mult Scler. 2005, 11 (1): 5-12. 10.1191/1352458505ms1135oa.CrossRefPubMed Polman CH, Wolinsky JS, Reingold SC: Multiple sclerosis diagnostic criteria: three years later. Mult Scler. 2005, 11 (1): 5-12. 10.1191/1352458505ms1135oa.CrossRefPubMed
20.
go back to reference Kurtzke JF: Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology. 1983, 33 (11): 1444-1452. 10.1212/WNL.33.11.1444.CrossRefPubMed Kurtzke JF: Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology. 1983, 33 (11): 1444-1452. 10.1212/WNL.33.11.1444.CrossRefPubMed
21.
go back to reference Simeoni M, Auquier P, Fernandez O, Flachenecker P, Stecchi S, Constantinescu C, Idiman E, Boyko A, Beiske A, Vollmer T: Validation of the Multiple Sclerosis International Quality of Life questionnaire. Mult Scler. 2008, 14 (2): 219-230.CrossRefPubMed Simeoni M, Auquier P, Fernandez O, Flachenecker P, Stecchi S, Constantinescu C, Idiman E, Boyko A, Beiske A, Vollmer T: Validation of the Multiple Sclerosis International Quality of Life questionnaire. Mult Scler. 2008, 14 (2): 219-230.CrossRefPubMed
22.
go back to reference Ware JE, Sherbourne CD: The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992, 30 (6): 473-483. 10.1097/00005650-199206000-00002.CrossRefPubMed Ware JE, Sherbourne CD: The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection. Med Care. 1992, 30 (6): 473-483. 10.1097/00005650-199206000-00002.CrossRefPubMed
23.
go back to reference Amato MP, Grimaud J, Achiti I, Bartolozzi ML, Adeleine P, Hartung HP, Kappos L, Thompson A, Trojano M, Vukusic S: European validation of a standardized clinical description of multiple sclerosis. J Neurol. 2004, 251 (12): 1472-1480. 10.1007/s00415-004-0567-0.CrossRefPubMed Amato MP, Grimaud J, Achiti I, Bartolozzi ML, Adeleine P, Hartung HP, Kappos L, Thompson A, Trojano M, Vukusic S: European validation of a standardized clinical description of multiple sclerosis. J Neurol. 2004, 251 (12): 1472-1480. 10.1007/s00415-004-0567-0.CrossRefPubMed
25.
go back to reference Breiman L, Friedman JH, Olshen RA, Stone CJ: Classification and regression trees. 1984, Monterey,USA: Wadsworth, Inc Breiman L, Friedman JH, Olshen RA, Stone CJ: Classification and regression trees. 1984, Monterey,USA: Wadsworth, Inc
26.
go back to reference Dempster M, Carney R, McClements R: Response shift in the assessment of quality of life among people attending cardiac rehabilitation. Br J Health Psychol. 2010, 15 (Pt 2): 307-319.CrossRefPubMed Dempster M, Carney R, McClements R: Response shift in the assessment of quality of life among people attending cardiac rehabilitation. Br J Health Psychol. 2010, 15 (Pt 2): 307-319.CrossRefPubMed
27.
go back to reference Ring L, Hofer S, Heuston F, Harris D, O'Boyle CA: Response shift masks the treatment impact on patient reported outcomes (PROs): the example of individual quality of life in edentulous patients. Health Qual Life Outcomes. 2005, 3: 55-10.1186/1477-7525-3-55.CrossRefPubMedPubMedCentral Ring L, Hofer S, Heuston F, Harris D, O'Boyle CA: Response shift masks the treatment impact on patient reported outcomes (PROs): the example of individual quality of life in edentulous patients. Health Qual Life Outcomes. 2005, 3: 55-10.1186/1477-7525-3-55.CrossRefPubMedPubMedCentral
28.
go back to reference Fernandez O, Baumstarck-Barrau K, Simeoni MC, Auquier P: Patient characteristics and determinants of quality of life in an international population with multiple sclerosis: Assessment using the MusiQoL and SF-36 questionnaires. Mult Scler. 2011, 17 (10): 1238-1249. 10.1177/1352458511407951.CrossRefPubMed Fernandez O, Baumstarck-Barrau K, Simeoni MC, Auquier P: Patient characteristics and determinants of quality of life in an international population with multiple sclerosis: Assessment using the MusiQoL and SF-36 questionnaires. Mult Scler. 2011, 17 (10): 1238-1249. 10.1177/1352458511407951.CrossRefPubMed
29.
go back to reference Norman G: Hi! How are you? Response shift, implicit theories and differing epistemologies. Qual Life Res. 2003, 12 (3): 239-249. 10.1023/A:1023211129926.CrossRefPubMed Norman G: Hi! How are you? Response shift, implicit theories and differing epistemologies. Qual Life Res. 2003, 12 (3): 239-249. 10.1023/A:1023211129926.CrossRefPubMed
30.
go back to reference Oort FJ: Using structural equation modeling to detect response shifts and true change. Qual Life Res. 2005, 14 (3): 587-598. 10.1007/s11136-004-0830-y.CrossRefPubMed Oort FJ: Using structural equation modeling to detect response shifts and true change. Qual Life Res. 2005, 14 (3): 587-598. 10.1007/s11136-004-0830-y.CrossRefPubMed
31.
go back to reference Oort FJ, Visser MR, Sprangers MA: An application of structural equation modeling to detect response shifts and true change in quality of life data from cancer patients undergoing invasive surgery. Qual Life Res. 2005, 14 (3): 599-609. 10.1007/s11136-004-0831-x.CrossRefPubMed Oort FJ, Visser MR, Sprangers MA: An application of structural equation modeling to detect response shifts and true change in quality of life data from cancer patients undergoing invasive surgery. Qual Life Res. 2005, 14 (3): 599-609. 10.1007/s11136-004-0831-x.CrossRefPubMed
32.
go back to reference Li Y, Rapkin B: Classification and regression tree uncovered hierarchy of psychosocial determinants underlying quality-of-life response shift in HIV/AIDS. J Clin Epidemiol. 2009, 62 (11): 1138-1147. 10.1016/j.jclinepi.2009.03.021.CrossRefPubMedPubMedCentral Li Y, Rapkin B: Classification and regression tree uncovered hierarchy of psychosocial determinants underlying quality-of-life response shift in HIV/AIDS. J Clin Epidemiol. 2009, 62 (11): 1138-1147. 10.1016/j.jclinepi.2009.03.021.CrossRefPubMedPubMedCentral
33.
go back to reference Mayo NE, Scott SC, Dendukuri N, Ahmed S, Wood-Dauphinee S: Identifying response shift statistically at the individual level. Qual Life Res. 2008, 17 (4): 627-639. 10.1007/s11136-008-9329-2.CrossRefPubMed Mayo NE, Scott SC, Dendukuri N, Ahmed S, Wood-Dauphinee S: Identifying response shift statistically at the individual level. Qual Life Res. 2008, 17 (4): 627-639. 10.1007/s11136-008-9329-2.CrossRefPubMed
34.
go back to reference Lunetta KL, Hayward LB, Segal J, Van Eerdewegh P: Screening large-scale association study data: exploiting interactions using random forests. BMC Genet. 2004, 5 (1): 32-10.1186/1471-2156-5-32.CrossRefPubMedPubMedCentral Lunetta KL, Hayward LB, Segal J, Van Eerdewegh P: Screening large-scale association study data: exploiting interactions using random forests. BMC Genet. 2004, 5 (1): 32-10.1186/1471-2156-5-32.CrossRefPubMedPubMedCentral
36.
go back to reference Liaw A, Wiener M: Classification and regression by random Forest. R News. 2002, 2: 18-22. Liaw A, Wiener M: Classification and regression by random Forest. R News. 2002, 2: 18-22.
37.
go back to reference Boyer L, Auquier P: The lack of impact of quality-of-life measures in schizophrenia: a shared responsibility?. PharmacoEconomics. 2012, 30 (6): 531-532. 10.2165/11633640-000000000-00000. author reply 532–533CrossRefPubMed Boyer L, Auquier P: The lack of impact of quality-of-life measures in schizophrenia: a shared responsibility?. PharmacoEconomics. 2012, 30 (6): 531-532. 10.2165/11633640-000000000-00000. author reply 532–533CrossRefPubMed
38.
go back to reference Awad AG: Quality-of-life assessment in schizophrenia: the unfulfilled promise. Expert Rev Pharmacoecon Outcomes Res. 2011, 11 (5): 491-493. 10.1586/erp.11.61.CrossRefPubMed Awad AG: Quality-of-life assessment in schizophrenia: the unfulfilled promise. Expert Rev Pharmacoecon Outcomes Res. 2011, 11 (5): 491-493. 10.1586/erp.11.61.CrossRefPubMed
39.
go back to reference Schwartz CE, Rapkin BD: Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal. Health Qual Life Outcomes. 2004, 2: 16-10.1186/1477-7525-2-16.CrossRefPubMedPubMedCentral Schwartz CE, Rapkin BD: Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal. Health Qual Life Outcomes. 2004, 2: 16-10.1186/1477-7525-2-16.CrossRefPubMedPubMedCentral
40.
go back to reference Rapkin BD, Schwartz CE: Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health Qual Life Outcomes. 2004, 15 (2): 14-CrossRef Rapkin BD, Schwartz CE: Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health Qual Life Outcomes. 2004, 15 (2): 14-CrossRef
Metadata
Title
Using the random forest method to detect a response shift in the quality of life of multiple sclerosis patients: a cohort study
Authors
Mohamed Boucekine
Anderson Loundou
Karine Baumstarck
Patricia Minaya-Flores
Jean Pelletier
Badih Ghattas
Pascal Auquier
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-20

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue