Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2021

Open Access 01-12-2021 | Atrial Fibrillation | Research article

Growth mixture models: a case example of the longitudinal analysis of patient‐reported outcomes data captured by a clinical registry

Authors: Jae-Yung Kwon, Richard Sawatzky, Jennifer Baumbusch, Sandra Lauck, Pamela A. Ratner

Published in: BMC Medical Research Methodology | Issue 1/2021

Login to get access

Abstract

Background

An assumption in many analyses of longitudinal patient-reported outcome (PRO) data is that there is a single population following a single health trajectory. One approach that may help researchers move beyond this traditional assumption, with its inherent limitations, is growth mixture modelling (GMM), which can identify and assess multiple unobserved trajectories of patients’ health outcomes. We describe the process that was undertaken for a GMM analysis of longitudinal PRO data captured by a clinical registry for outpatients with atrial fibrillation (AF).

Methods

This expository paper describes the modelling approach and some methodological issues that require particular attention, including (a) determining the metric of time, (b) specifying the GMMs, and (c) including predictors of membership in the identified latent classes (groups or subtypes of patients with distinct trajectories). An example is provided of a longitudinal analysis of PRO data (patients’ responses to the Atrial Fibrillation Effect on QualiTy-of-Life (AFEQT) Questionnaire) collected between 2008 and 2016 for a population-based cardiac registry and deterministically linked with administrative health data.

Results

In determining the metric of time, multiple processes were required to ensure that “time” accounted for both the frequency and timing of the measurement occurrences in light of the variability in both the number of measures taken and the intervals between those measures. In specifying the GMM, convergence issues, a common problem that results in unreliable model estimates, required constrained parameter exploration techniques. For the identification of predictors of the latent classes, the 3-step (stepwise) approach was selected such that the addition of predictor variables did not change class membership itself.

Conclusions

GMM can be a valuable tool for classifying multiple unique PRO trajectories that have previously been unobserved in real-world applications; however, their use requires substantial transparency regarding the processes underlying model building as they can directly affect the results and therefore their interpretation.
Literature
1.
go back to reference Laursen BP, Hoff E. Person-centered and variable-centered approaches to longitudinal data. Merrill-Palmer Q. 2006;52:377–89.CrossRef Laursen BP, Hoff E. Person-centered and variable-centered approaches to longitudinal data. Merrill-Palmer Q. 2006;52:377–89.CrossRef
2.
go back to reference Owen J, Adelson J, Budge S, Wampold B, Kopta M, Minami T, et al. Trajectories of change in psychotherapy. J Clin Psychol. 2015;71:817–27.CrossRef Owen J, Adelson J, Budge S, Wampold B, Kopta M, Minami T, et al. Trajectories of change in psychotherapy. J Clin Psychol. 2015;71:817–27.CrossRef
3.
go back to reference Berlin KS, Parra GR, Williams NA. An introduction to latent variable mixture modeling (part 2): Longitudinal latent class growth analysis and growth mixture models. J Pediatr Psychol. 2014;39:188–203.CrossRef Berlin KS, Parra GR, Williams NA. An introduction to latent variable mixture modeling (part 2): Longitudinal latent class growth analysis and growth mixture models. J Pediatr Psychol. 2014;39:188–203.CrossRef
4.
go back to reference Lubke GH, Luningham J. Fitting latent variable mixture models. Behav Res Ther. 2017;98:91–102.CrossRef Lubke GH, Luningham J. Fitting latent variable mixture models. Behav Res Ther. 2017;98:91–102.CrossRef
5.
12.
go back to reference Spertus J, Dorian P, Bubien R, Lewis S, Godejohn D, Reynolds MR, et al. Development and validation of the Atrial Fibrillation Effect on Quality-of-Life (AFEQT) Questionnaire in patients with atrial fibrillation. Circ Arrhythm Electrophysiol. 2011;4:15–25.CrossRef Spertus J, Dorian P, Bubien R, Lewis S, Godejohn D, Reynolds MR, et al. Development and validation of the Atrial Fibrillation Effect on Quality-of-Life (AFEQT) Questionnaire in patients with atrial fibrillation. Circ Arrhythm Electrophysiol. 2011;4:15–25.CrossRef
13.
go back to reference Gilthorpe MS, Dahly DL, Tu Y-K, Kubzansky LD, Goodman E. Challenges in modelling the random structure correctly in growth mixture models and the impact this has on model mixtures. J Dev Orig Health Dis. 2014;5:197–205.CrossRef Gilthorpe MS, Dahly DL, Tu Y-K, Kubzansky LD, Goodman E. Challenges in modelling the random structure correctly in growth mixture models and the impact this has on model mixtures. J Dev Orig Health Dis. 2014;5:197–205.CrossRef
14.
go back to reference Lo Y, Mendell NR, Rubin DB. Testing the number of components in a normal mixture. Biometrika. 2001;88:767–78.CrossRef Lo Y, Mendell NR, Rubin DB. Testing the number of components in a normal mixture. Biometrika. 2001;88:767–78.CrossRef
15.
16.
go back to reference Chen Q, Luo W, Palardy GJ, Glaman R, McEnturff A. The efficacy of common fit indices for enumerating classes in growth mixture models when nested data structure is ignored: A Monte Carlo study. SAGE Open. 2017;7:2158244017700459. Chen Q, Luo W, Palardy GJ, Glaman R, McEnturff A. The efficacy of common fit indices for enumerating classes in growth mixture models when nested data structure is ignored: A Monte Carlo study. SAGE Open. 2017;7:2158244017700459.
17.
go back to reference Vargha A, Bergman L, Takács S. Performing cluster analysis within a person-oriented context: Some methods for evaluating the quality of cluster solutions. J Pers-Oriented Res. 2016;2:78–86.CrossRef Vargha A, Bergman L, Takács S. Performing cluster analysis within a person-oriented context: Some methods for evaluating the quality of cluster solutions. J Pers-Oriented Res. 2016;2:78–86.CrossRef
18.
go back to reference Muthén LK, Muthén BO. How to use a Monte Carlo study to decide on sample size and determine power. Struct Equ Model. 2002;9:599–620.CrossRef Muthén LK, Muthén BO. How to use a Monte Carlo study to decide on sample size and determine power. Struct Equ Model. 2002;9:599–620.CrossRef
19.
go back to reference Meyer JP, Morin AJS. A person-centered approach to commitment research: Theory, research, and methodology. J Organ Behav. 2016;4:584–612.CrossRef Meyer JP, Morin AJS. A person-centered approach to commitment research: Theory, research, and methodology. J Organ Behav. 2016;4:584–612.CrossRef
20.
go back to reference Bell ML, Kenward MG, Fairclough DL, Horton NJ. Differential dropout and bias in randomised controlled trials: when it matters and when it may not. The BMJ. 2013;346:e8668.CrossRef Bell ML, Kenward MG, Fairclough DL, Horton NJ. Differential dropout and bias in randomised controlled trials: when it matters and when it may not. The BMJ. 2013;346:e8668.CrossRef
21.
go back to reference Sijbrandij JJ, Hoekstra T, Almansa J, Peeters M, Bültmann U, Reijneveld SA. Variance constraints strongly influenced model performance in growth mixture modeling: a simulation and empirical study. BMC Med Res Methodol. 2020;20:276.CrossRef Sijbrandij JJ, Hoekstra T, Almansa J, Peeters M, Bültmann U, Reijneveld SA. Variance constraints strongly influenced model performance in growth mixture modeling: a simulation and empirical study. BMC Med Res Methodol. 2020;20:276.CrossRef
22.
go back to reference Asparouhov T, Muthén B. Auxiliary variables in mixture modeling: Three-step approaches using Mplus. Struct Equ Model. 2014;21:329–41.CrossRef Asparouhov T, Muthén B. Auxiliary variables in mixture modeling: Three-step approaches using Mplus. Struct Equ Model. 2014;21:329–41.CrossRef
23.
go back to reference Vermunt JK. Latent class modeling with covariates: Two improved three-step approaches. Polit Anal. 2010;18:450–69.CrossRef Vermunt JK. Latent class modeling with covariates: Two improved three-step approaches. Polit Anal. 2010;18:450–69.CrossRef
24.
go back to reference Muthén LK, Muthén BO. Mplus user’s guide. 8th. 2017. Muthén LK, Muthén BO. Mplus user’s guide. 8th. 2017.
25.
26.
go back to reference van de Schoot R, Sijbrandij M, Winter SD, Depaoli S, Vermunt JK. The GRoLTS-Checklist: Guidelines for reporting on latent trajectory studies. Struct Equ Model. 2017;24:451–67.CrossRef van de Schoot R, Sijbrandij M, Winter SD, Depaoli S, Vermunt JK. The GRoLTS-Checklist: Guidelines for reporting on latent trajectory studies. Struct Equ Model. 2017;24:451–67.CrossRef
27.
go back to reference Aydin B, Leite WL, Algina J. The consequences of ignoring variability in measurement occasions within data collection waves in latent growth models. Multivar Behav Res. 2014;49:149–60.CrossRef Aydin B, Leite WL, Algina J. The consequences of ignoring variability in measurement occasions within data collection waves in latent growth models. Multivar Behav Res. 2014;49:149–60.CrossRef
28.
go back to reference Coulombe P, Selig JP, Delaney HD. Ignoring individual differences in times of assessment in growth curve modeling. Int J Behav Dev. 2016;40:76–86.CrossRef Coulombe P, Selig JP, Delaney HD. Ignoring individual differences in times of assessment in growth curve modeling. Int J Behav Dev. 2016;40:76–86.CrossRef
29.
go back to reference Eggleston EP, Laub JH, Sampson RJ. Methodological sensitivities to latent class analysis of long-term criminal trajectories. J Quant Criminol. 2004;20:1–26.CrossRef Eggleston EP, Laub JH, Sampson RJ. Methodological sensitivities to latent class analysis of long-term criminal trajectories. J Quant Criminol. 2004;20:1–26.CrossRef
30.
go back to reference Piquero AR. Taking stock of developmental trajectories of criminal activity over the life course. In: Liberman AM, editor. The long view of crime: A synthesis of longitudinal research. New York: Springer; 2008. pp. 23–78.CrossRef Piquero AR. Taking stock of developmental trajectories of criminal activity over the life course. In: Liberman AM, editor. The long view of crime: A synthesis of longitudinal research. New York: Springer; 2008. pp. 23–78.CrossRef
31.
go back to reference Huang D, Brecht M-L, Hara M, Hser Y-I. Influences of a covariate on growth mixture modeling. J Drug Issues. 2010;40:173–94.CrossRef Huang D, Brecht M-L, Hara M, Hser Y-I. Influences of a covariate on growth mixture modeling. J Drug Issues. 2010;40:173–94.CrossRef
32.
go back to reference Li L, Hser Y-I. On inclusion of covariates for class enumeration of growth mixture models. Multivar Behav Res. 2011;46:266–302.CrossRef Li L, Hser Y-I. On inclusion of covariates for class enumeration of growth mixture models. Multivar Behav Res. 2011;46:266–302.CrossRef
33.
go back to reference Lubke G, Muthén BO. Performance of factor mixture models as a function of model size, covariate effects, and class-specific parameters. Struct Equ Model. 2007;14:26–47.CrossRef Lubke G, Muthén BO. Performance of factor mixture models as a function of model size, covariate effects, and class-specific parameters. Struct Equ Model. 2007;14:26–47.CrossRef
34.
go back to reference Muthén B. Statistical and substantive checking in growth mixture modeling: Comment on Bauer and Curran (2003). Psychol Methods. 2003;8:369–77. Muthén B. Statistical and substantive checking in growth mixture modeling: Comment on Bauer and Curran (2003). Psychol Methods. 2003;8:369–77.
35.
go back to reference Bauer DJ. Observations on the use of growth mixture models in psychological research. Multivar Behav Res. 2007;42:757–86.CrossRef Bauer DJ. Observations on the use of growth mixture models in psychological research. Multivar Behav Res. 2007;42:757–86.CrossRef
36.
go back to reference Nylund-Gibson K, Masyn KE. Covariates and mixture modeling: results of a simulation study exploring the impact of misspecified effects on class enumeration. Struct Equ Model. 2016;23:782–97.CrossRef Nylund-Gibson K, Masyn KE. Covariates and mixture modeling: results of a simulation study exploring the impact of misspecified effects on class enumeration. Struct Equ Model. 2016;23:782–97.CrossRef
37.
go back to reference Bakk Z, Tekle FB, Vermunt JK. Estimating the association between latent class membership and external variables using bias-adjusted three-step approaches. Sociol Methodol. 2013;43:272–311.CrossRef Bakk Z, Tekle FB, Vermunt JK. Estimating the association between latent class membership and external variables using bias-adjusted three-step approaches. Sociol Methodol. 2013;43:272–311.CrossRef
39.
go back to reference Bolck A, Croon M, Hagenaars J. Estimating latent structure models with categorical variables: one-step versus three-step estimators. Polit Anal. 2004;12:3–27.CrossRef Bolck A, Croon M, Hagenaars J. Estimating latent structure models with categorical variables: one-step versus three-step estimators. Polit Anal. 2004;12:3–27.CrossRef
Metadata
Title
Growth mixture models: a case example of the longitudinal analysis of patient‐reported outcomes data captured by a clinical registry
Authors
Jae-Yung Kwon
Richard Sawatzky
Jennifer Baumbusch
Sandra Lauck
Pamela A. Ratner
Publication date
01-12-2021
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2021
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-021-01276-z

Other articles of this Issue 1/2021

BMC Medical Research Methodology 1/2021 Go to the issue