Skip to main content
Top
Published in: Trials 1/2020

Open Access 01-12-2020 | Affective Disorder | Research

Identifying treatment effects of an informal caregiver education intervention to increase days in the community and decrease caregiver distress: a machine-learning secondary analysis of subgroup effects in the HI-FIVES randomized clinical trial

Authors: Megan Shepherd-Banigan, Valerie A. Smith, Jennifer H. Lindquist, Michael Paul Cary Jr., Katherine E. M. Miller, Jennifer G. Chapman, Courtney H. Van Houtven

Published in: Trials | Issue 1/2020

Login to get access

Abstract

Background

Informal caregivers report substantial burden and depressive symptoms which predict higher rates of patient institutionalization. While caregiver education interventions may reduce caregiver distress and decrease the use of long-term institutional care, evidence is mixed. Inconsistent findings across studies may be the result of reporting average treatment effects which do not account for how effects differ by participant characteristics. We apply a machine-learning approach to randomized clinical trial (RCT) data of the Helping Invested Family Members Improve Veteran’s Experiences Study (HI-FIVES) intervention to explore how intervention effects vary by caregiver and patient characteristics.

Methods

We used model-based recursive partitioning models. Caregivers of community-residing older adult US veterans with functional or cognitive impairment at a single VA Medical Center site were randomized to receive HI-FIVES (n = 118) vs. usual care (n = 123). The outcomes included cumulative days not in the community and caregiver depressive symptoms assessed at 12 months post intervention. Potential moderating characteristics were: veteran age, caregiver age, caregiver ethnicity and race, relationship satisfaction, caregiver burden, perceived financial strain, caregiver depressive symptoms, and patient risk score.

Results

The effect of HI-FIVES on days not at home was moderated by caregiver burden (p < 0.001); treatment effects were higher for caregivers with a Zarit Burden Scale score ≤ 28. Caregivers with lower baseline Center for Epidemiologic Studies Depression Scale (CESD-10) scores (≤ 8) had slightly lower CESD-10 scores at follow-up (p < 0.001).

Conclusions

Family caregiver education interventions may be less beneficial for highly burdened and distressed caregivers; these caregivers may require a more tailored approach that involves assessing caregiver needs and developing personalized approaches.

Trial registration

ClinicalTrials.gov, ID:NCT01777490. Registered on 28 January 2013.
Literature
1.
2.
go back to reference Van Houtven CH, Norton EC. Informal care and health care use of older adults. J Health Econ. 2004;23(6):1159–80.PubMedCrossRef Van Houtven CH, Norton EC. Informal care and health care use of older adults. J Health Econ. 2004;23(6):1159–80.PubMedCrossRef
3.
go back to reference Van Houtven CH, Norton EC. Informal care and Medicare expenditures: testing for heterogeneous treatment effects. J Health Econ. 2008;27(1):134–56.PubMedCrossRef Van Houtven CH, Norton EC. Informal care and Medicare expenditures: testing for heterogeneous treatment effects. J Health Econ. 2008;27(1):134–56.PubMedCrossRef
4.
go back to reference Epstein-Lubow G, Davis JD, Miller IW, Tremont G. Persisting burden predicts depressive symptoms in dementia caregivers. J Geriatr Psychiatry Neurol. 2008;21(3):198–203.PubMedCrossRef Epstein-Lubow G, Davis JD, Miller IW, Tremont G. Persisting burden predicts depressive symptoms in dementia caregivers. J Geriatr Psychiatry Neurol. 2008;21(3):198–203.PubMedCrossRef
5.
go back to reference Toot S, Swinson T, Devine M, Challis D, Orrell M. Causes of nursing home placement for older people with dementia: a systematic review and meta-analysis. Int Psychogeriatr. 2017;29(2):195–208.PubMedCrossRef Toot S, Swinson T, Devine M, Challis D, Orrell M. Causes of nursing home placement for older people with dementia: a systematic review and meta-analysis. Int Psychogeriatr. 2017;29(2):195–208.PubMedCrossRef
6.
go back to reference Gitlin LN, Belle SH, Burgio LD, Czaja SJ, Mahoney D, Gallagher-Thompson D, et al. Effect of multicomponent interventions on caregiver burden and depression: the REACH multisite initiative at 6-month follow-up. Psychol Aging. 2003;18(3):361–74.PubMedPubMedCentralCrossRef Gitlin LN, Belle SH, Burgio LD, Czaja SJ, Mahoney D, Gallagher-Thompson D, et al. Effect of multicomponent interventions on caregiver burden and depression: the REACH multisite initiative at 6-month follow-up. Psychol Aging. 2003;18(3):361–74.PubMedPubMedCentralCrossRef
7.
go back to reference Adelman RD, Tmanova LL, Delgado D, Dion S, Lachs MS. Caregiver burden: a clinical review. JAMA. 2014;311(10):1052–60.PubMedCrossRef Adelman RD, Tmanova LL, Delgado D, Dion S, Lachs MS. Caregiver burden: a clinical review. JAMA. 2014;311(10):1052–60.PubMedCrossRef
8.
go back to reference Belle SH, Burgio L, Burns R, Coon D, Czaja SJ, Gallagher-Thompson D, et al. Enhancing the quality of life of dementia caregivers from different ethnic or racial groups: a randomized, controlled trial. Ann Intern Med. 2006;145(10):727–38.PubMedPubMedCentralCrossRef Belle SH, Burgio L, Burns R, Coon D, Czaja SJ, Gallagher-Thompson D, et al. Enhancing the quality of life of dementia caregivers from different ethnic or racial groups: a randomized, controlled trial. Ann Intern Med. 2006;145(10):727–38.PubMedPubMedCentralCrossRef
9.
go back to reference Gerdner LA, Buckwalter KC, Reed D. Impact of a psychoeducational intervention on caregiver response to behavioral problems. Nurs Res. 2002;51(6):363–74.PubMedCrossRef Gerdner LA, Buckwalter KC, Reed D. Impact of a psychoeducational intervention on caregiver response to behavioral problems. Nurs Res. 2002;51(6):363–74.PubMedCrossRef
10.
go back to reference Gitlin LN, Winter L, Corcoran M, Dennis MP, Schinfeld S, Hauck WW. Effects of the home environmental skill-building program on the caregiver-care recipient dyad: 6-month outcomes from the Philadelphia REACH Initiative. Gerontologist. 2003;43(4):532–46.PubMedCrossRef Gitlin LN, Winter L, Corcoran M, Dennis MP, Schinfeld S, Hauck WW. Effects of the home environmental skill-building program on the caregiver-care recipient dyad: 6-month outcomes from the Philadelphia REACH Initiative. Gerontologist. 2003;43(4):532–46.PubMedCrossRef
11.
go back to reference Hepburn K, Lewis M, Tornatore J, Sherman CW, Bremer KL. The Savvy Caregiver Program: the demonstrated effectiveness of a transportable dementia caregiver psychoeducation program. J Gerontol Nurs. 2007;33(3):30–6.PubMedCrossRef Hepburn K, Lewis M, Tornatore J, Sherman CW, Bremer KL. The Savvy Caregiver Program: the demonstrated effectiveness of a transportable dementia caregiver psychoeducation program. J Gerontol Nurs. 2007;33(3):30–6.PubMedCrossRef
13.
go back to reference Thompson CA, Spilsbury K, Hall J, Birks Y, Barnes C, Adamson J. Systematic review of information and support interventions for caregivers of people with dementia. BMC Geriatr. 2007;7:18.PubMedPubMedCentralCrossRef Thompson CA, Spilsbury K, Hall J, Birks Y, Barnes C, Adamson J. Systematic review of information and support interventions for caregivers of people with dementia. BMC Geriatr. 2007;7:18.PubMedPubMedCentralCrossRef
14.
go back to reference Goy E, Kansagar D, Freeman M. A systematic evidence review of interventions for non-professional caregivers of individuals with dementia. Washington, DC: Department of Veteran Affairs; 2010. Goy E, Kansagar D, Freeman M. A systematic evidence review of interventions for non-professional caregivers of individuals with dementia. Washington, DC: Department of Veteran Affairs; 2010.
15.
go back to reference McGriffin JA, Meis L, Carlyle M, Greer N, Jensen A, Macdonald R, et al. Effectiveness of family and caregiver interventions on patient outcomes among adults with cancer or memory-related disorders: a systematic review. Washington, DC: Department of Veteran Affairs; 2013. McGriffin JA, Meis L, Carlyle M, Greer N, Jensen A, Macdonald R, et al. Effectiveness of family and caregiver interventions on patient outcomes among adults with cancer or memory-related disorders: a systematic review. Washington, DC: Department of Veteran Affairs; 2013.
16.
go back to reference Shepherd-Banigan M, McDuffie JR, Shapiro A, Brancu M, Sperber N, Mehta NN, et al. Interventions to support caregivers or families of patients with TBI, PTSD, or polytrauma: a systematic review. Washington, DC: Department of Veteran Affairs, Veterans Health Administration; 2017. Report No.: 09–001 Shepherd-Banigan M, McDuffie JR, Shapiro A, Brancu M, Sperber N, Mehta NN, et al. Interventions to support caregivers or families of patients with TBI, PTSD, or polytrauma: a systematic review. Washington, DC: Department of Veteran Affairs, Veterans Health Administration; 2017. Report No.: 09–001
17.
go back to reference Greenfield S, Kravitz R, Duan N, Kaplan SH. Heterogeneity of treatment effects: implications for guidelines, payment, and quality assessment. Am J Med. 2007;120(4 Suppl 1):S3–9.PubMedCrossRef Greenfield S, Kravitz R, Duan N, Kaplan SH. Heterogeneity of treatment effects: implications for guidelines, payment, and quality assessment. Am J Med. 2007;120(4 Suppl 1):S3–9.PubMedCrossRef
18.
go back to reference Van Houtven CH, Smith VA, Lindquist J, Chapman JG, Hendrix C, Hastings SN, et al. Family caregiver skills training to improve experiences of care: a randomized clinical trial. J Gen Intern Med. 2019; In press. Van Houtven CH, Smith VA, Lindquist J, Chapman JG, Hendrix C, Hastings SN, et al. Family caregiver skills training to improve experiences of care: a randomized clinical trial. J Gen Intern Med. 2019; In press.
20.
go back to reference Kraemer HC, Frank E, Kupfer DJ. Moderators of treatment outcomes: clinical, research, and policy importance. JAMA. 2006;296(10):1286–9.PubMedCrossRef Kraemer HC, Frank E, Kupfer DJ. Moderators of treatment outcomes: clinical, research, and policy importance. JAMA. 2006;296(10):1286–9.PubMedCrossRef
21.
go back to reference VanderWeele TJ, Knol MJ. Interpretation of subgroup analyses in randomized trials: heterogeneity versus secondary interventions. Ann Intern Med. 2011;154(10):680–3.PubMedCrossRef VanderWeele TJ, Knol MJ. Interpretation of subgroup analyses in randomized trials: heterogeneity versus secondary interventions. Ann Intern Med. 2011;154(10):680–3.PubMedCrossRef
23.
go back to reference Baum A, Scarpa J, Bruzelius E, Tamler R, Basu S, Faghmous J. Targeting weight loss interventions to reduce cardiovascular complications of type 2 diabetes: a machine learning-based post-hoc analysis of heterogeneous treatment effects in the Look AHEAD trial. Lancet Diabetes Endocrinol. 2017;5(10):808–15.PubMedPubMedCentralCrossRef Baum A, Scarpa J, Bruzelius E, Tamler R, Basu S, Faghmous J. Targeting weight loss interventions to reduce cardiovascular complications of type 2 diabetes: a machine learning-based post-hoc analysis of heterogeneous treatment effects in the Look AHEAD trial. Lancet Diabetes Endocrinol. 2017;5(10):808–15.PubMedPubMedCentralCrossRef
24.
go back to reference Van Houtven CH, Oddone EZ, Hastings SN, Hendrix C, Olsen M, Neelon B, et al. Helping Invested Families Improve Veterans’ Experiences Study (HI-FIVES): study design and methodology. Contemp Clin Trials. 2014;38(2):260–9.PubMedPubMedCentralCrossRef Van Houtven CH, Oddone EZ, Hastings SN, Hendrix C, Olsen M, Neelon B, et al. Helping Invested Families Improve Veterans’ Experiences Study (HI-FIVES): study design and methodology. Contemp Clin Trials. 2014;38(2):260–9.PubMedPubMedCentralCrossRef
25.
go back to reference Ariti CA, Cleland JG, Pocock SJ, Pfeffer MA, Swedberg K, Granger CB, et al. Days alive and out of hospital and the patient journey in patients with heart failure: Insights from the Candesartan in Heart failure: Assessment of Reduction in Mortality and morbidity (CHARM) program. Am Heart J. 2011;162(5):900–6.PubMedCrossRef Ariti CA, Cleland JG, Pocock SJ, Pfeffer MA, Swedberg K, Granger CB, et al. Days alive and out of hospital and the patient journey in patients with heart failure: Insights from the Candesartan in Heart failure: Assessment of Reduction in Mortality and morbidity (CHARM) program. Am Heart J. 2011;162(5):900–6.PubMedCrossRef
26.
go back to reference Andreson E, Malmgren J, Carter W, Patrick D. Screening for depression in well older adults: evaluation of a short form of the CES D. Am J Prev Med. 1994;4:77–84.CrossRef Andreson E, Malmgren J, Carter W, Patrick D. Screening for depression in well older adults: evaluation of a short form of the CES D. Am J Prev Med. 1994;4:77–84.CrossRef
27.
go back to reference Gallagher D, Ni Mhaolain A, Crosby L, Ryan D, Lacey L, Coen RF, et al. Determinants of the desire to institutionalize in Alzheimer’s caregivers. Am J Alzheimers Dis Other Dement. 2011;26(3):205–11.CrossRef Gallagher D, Ni Mhaolain A, Crosby L, Ryan D, Lacey L, Coen RF, et al. Determinants of the desire to institutionalize in Alzheimer’s caregivers. Am J Alzheimers Dis Other Dement. 2011;26(3):205–11.CrossRef
28.
go back to reference Wolff JL, Mulcahy J, Roth DL, Cenzer IS, Kasper JD, Huang J, et al. Long-term nursing home entry: a prognostic model for older adults with a family or unpaid caregiver. J Am Geriatr Soc. 2018;66(10):1887–94.PubMedPubMedCentralCrossRef Wolff JL, Mulcahy J, Roth DL, Cenzer IS, Kasper JD, Huang J, et al. Long-term nursing home entry: a prognostic model for older adults with a family or unpaid caregiver. J Am Geriatr Soc. 2018;66(10):1887–94.PubMedPubMedCentralCrossRef
29.
go back to reference Spitznagel MB, Tremont G, Davis JD, Foster SM. Psychosocial predictors of dementia caregiver desire to institutionalize: caregiver, care recipient, and family relationship factors. J Geriatr Psychiatry Neurol. 2006;19(1):16–20.PubMedPubMedCentralCrossRef Spitznagel MB, Tremont G, Davis JD, Foster SM. Psychosocial predictors of dementia caregiver desire to institutionalize: caregiver, care recipient, and family relationship factors. J Geriatr Psychiatry Neurol. 2006;19(1):16–20.PubMedPubMedCentralCrossRef
30.
go back to reference Vandepitte S, Putman K, Van Den Noortgate N, Verhaeghe S, Mormont E, Van Wilder L, et al. Factors associated with the caregivers’ desire to Institutionalize persons with dementia: a cross-sectional study. Dement Geriatr Cogn Disord. 2018;46(5–6):298–309.PubMedCrossRef Vandepitte S, Putman K, Van Den Noortgate N, Verhaeghe S, Mormont E, Van Wilder L, et al. Factors associated with the caregivers’ desire to Institutionalize persons with dementia: a cross-sectional study. Dement Geriatr Cogn Disord. 2018;46(5–6):298–309.PubMedCrossRef
31.
go back to reference Pruchno RA, Michaels JE, Potashnik SL. Predictors of institutionalization among Alzheimer disease victims with caregiving spouses. J Gerontol. 1990;45(6):S259–66.PubMedCrossRef Pruchno RA, Michaels JE, Potashnik SL. Predictors of institutionalization among Alzheimer disease victims with caregiving spouses. J Gerontol. 1990;45(6):S259–66.PubMedCrossRef
32.
go back to reference Schulz R, Williamson GM. A 2-year longitudinal study of depression among Alzheimer’s caregivers. Psychol Aging. 1991;6(4):569–78.PubMedCrossRef Schulz R, Williamson GM. A 2-year longitudinal study of depression among Alzheimer’s caregivers. Psychol Aging. 1991;6(4):569–78.PubMedCrossRef
33.
go back to reference Covinsky KE, Newcomer R, Fox P, Wood J, Sands L, Dane K, et al. Patient and caregiver characteristics associated with depression in caregivers of patients with dementia. J Gen Intern Med. 2003;18(12):1006–14.PubMedPubMedCentralCrossRef Covinsky KE, Newcomer R, Fox P, Wood J, Sands L, Dane K, et al. Patient and caregiver characteristics associated with depression in caregivers of patients with dementia. J Gen Intern Med. 2003;18(12):1006–14.PubMedPubMedCentralCrossRef
34.
go back to reference Zarit SH, Reever KE, Bach-Peterson J. Relatives of the impaired elderly: correlates of feelings of burden. Gerontologist. 1980;20(6):649–55.PubMedCrossRef Zarit SH, Reever KE, Bach-Peterson J. Relatives of the impaired elderly: correlates of feelings of burden. Gerontologist. 1980;20(6):649–55.PubMedCrossRef
35.
go back to reference Lawton MP, Kleban MH, Moss M, Rovine M, Glicksman A. Measuring caregiving appraisal. J Gerontol. 1989;44(3):P61–71.PubMedCrossRef Lawton MP, Kleban MH, Moss M, Rovine M, Glicksman A. Measuring caregiving appraisal. J Gerontol. 1989;44(3):P61–71.PubMedCrossRef
36.
go back to reference Struchen MA, Atchison TB, Roebuck TM, Caroselli JS, Sander AM. A multidimensional measure of caregiving appraisal: validation of the Caregiver Appraisal Scale in traumatic brain injury. J Head Trauma Rehabil. 2002;17(2):132–54.PubMedCrossRef Struchen MA, Atchison TB, Roebuck TM, Caroselli JS, Sander AM. A multidimensional measure of caregiving appraisal: validation of the Caregiver Appraisal Scale in traumatic brain injury. J Head Trauma Rehabil. 2002;17(2):132–54.PubMedCrossRef
37.
go back to reference Wagner T, Upadhyay A, Cowgill E, Sterfos T, Moran E, Asch S, et al. Risk adjustment tools for learning health systems: a comparison of DxCG and CMS-HCC V21. Health Serv Res. 2016;51(5):2002–19. In press.PubMedPubMedCentralCrossRef Wagner T, Upadhyay A, Cowgill E, Sterfos T, Moran E, Asch S, et al. Risk adjustment tools for learning health systems: a comparison of DxCG and CMS-HCC V21. Health Serv Res. 2016;51(5):2002–19. In press.PubMedPubMedCentralCrossRef
38.
go back to reference Zeileis A, Hothorn T, Hornik K. Model-based recursive partitioning. J Comput Graphical Stat. 2008;17(2):492–514.CrossRef Zeileis A, Hothorn T, Hornik K. Model-based recursive partitioning. J Comput Graphical Stat. 2008;17(2):492–514.CrossRef
39.
go back to reference Yang D, Dalton J, editors. A unified approach to measuring the effect size between two groups using SAS. SAS Global Forum 2012:335–2012. SAS. Yang D, Dalton J, editors. A unified approach to measuring the effect size between two groups using SAS. SAS Global Forum 2012:335–2012. SAS.
40.
go back to reference Austin PC. Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples. Stat Med. 2009;28(25):3083–107.PubMedPubMedCentralCrossRef Austin PC. Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples. Stat Med. 2009;28(25):3083–107.PubMedPubMedCentralCrossRef
41.
44.
go back to reference Ishwaran H, Lu M. Standard errors and confidence intervals for variable importance in random forest regression, classification, and survival. Stat Med. 2019;38(4):558–82.PubMedCrossRef Ishwaran H, Lu M. Standard errors and confidence intervals for variable importance in random forest regression, classification, and survival. Stat Med. 2019;38(4):558–82.PubMedCrossRef
45.
go back to reference Zarit SH, Orr NK, Zarit JM. The hidden victims of Alzheimer’s disease: families under stress. New York: New York University Press; 1985. Zarit SH, Orr NK, Zarit JM. The hidden victims of Alzheimer’s disease: families under stress. New York: New York University Press; 1985.
46.
go back to reference Basu S, Raghavan S, Wexler DJ, Berkowitz SA. Characteristics associated with decreased or increased mortality risk from glycemic therapy among patients with type 2 diabetes and high cardiovascular risk: machine learning analysis of the ACCORD Trial. Diabetes Care. 2018;41(3):604–12.PubMedCrossRef Basu S, Raghavan S, Wexler DJ, Berkowitz SA. Characteristics associated with decreased or increased mortality risk from glycemic therapy among patients with type 2 diabetes and high cardiovascular risk: machine learning analysis of the ACCORD Trial. Diabetes Care. 2018;41(3):604–12.PubMedCrossRef
47.
go back to reference Dusseldorp E, Van Mechelen I. Qualitative interaction trees: a tool to identify qualitative treatment-subgroup interactions. Stat Med. 2014;33(2):219–37.PubMedCrossRef Dusseldorp E, Van Mechelen I. Qualitative interaction trees: a tool to identify qualitative treatment-subgroup interactions. Stat Med. 2014;33(2):219–37.PubMedCrossRef
48.
go back to reference Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and regression trees. Monterey: Wadsworth & Brooks/Cole Advanced Books; 1984. Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and regression trees. Monterey: Wadsworth & Brooks/Cole Advanced Books; 1984.
49.
go back to reference Foster JC, Taylor JM, Ruberg SJ. Subgroup identification from randomized clinical trial data. Stat Med. 2011;30(24):2867–80.PubMedCrossRef Foster JC, Taylor JM, Ruberg SJ. Subgroup identification from randomized clinical trial data. Stat Med. 2011;30(24):2867–80.PubMedCrossRef
Metadata
Title
Identifying treatment effects of an informal caregiver education intervention to increase days in the community and decrease caregiver distress: a machine-learning secondary analysis of subgroup effects in the HI-FIVES randomized clinical trial
Authors
Megan Shepherd-Banigan
Valerie A. Smith
Jennifer H. Lindquist
Michael Paul Cary Jr.
Katherine E. M. Miller
Jennifer G. Chapman
Courtney H. Van Houtven
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Trials / Issue 1/2020
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-020-4113-x

Other articles of this Issue 1/2020

Trials 1/2020 Go to the issue