Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

Longitudinal studies that use data collected as part of usual care risk reporting biased results: a systematic review

Authors: Delaram Farzanfar, Asmaa Abumuamar, Jayoon Kim, Emily Sirotich, Yue Wang, Eleanor Pullenayegum

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

Longitudinal studies using data collected as part of usual care risk providing biased results if visit times are related to the outcome of interest. Statistical methods for mitigating this bias are available but rarely used. This lack of use could be attributed to a lack of need or to a lack of awareness of the issue.

Methods

We performed a systematic review of longitudinal studies that used data collected as part of patients’ usual care and were published in MEDLINE or EMBASE databases between January 2005 through May 13th 2015. We asked whether the extent of and reasons for variability in visit times were reported on, and in cases where there was a need to account for informativeness of visit times, whether an appropriate method was used.

Results

Of 44 eligible articles, 57% (n = 25) reported on the total follow-up time, 7% (n = 3) on the gaps between visits, and 57% (n = 25) on the number of visits per patient; 78% (n = 34) reported on at least one of these. Two studies assessed predictors of visit times, and 86% of studies did not report enough information to assess whether there was a need to account for informative follow-up. Only one study used a method designed to account for informative visit times.

Conclusions

The low proportion of studies reporting on whether there were important predictors of visit times suggests that researchers are unaware of the potential for bias when data is collected as part of usual care and visit times are irregular. Guidance on the potential for bias and on the reporting of longitudinal studies subject to irregular follow-up is needed.
Appendix
Available only for authorised users
Literature
1.
go back to reference Worster A, Haines T. Advanced statistics: understanding medical record review (MRR) studies. Acad Emerg Med. 2004;11:187–92.CrossRefPubMed Worster A, Haines T. Advanced statistics: understanding medical record review (MRR) studies. Acad Emerg Med. 2004;11:187–92.CrossRefPubMed
2.
go back to reference Lin HQ, Scharfstein DO, Rosenheck RA. Analysis of longitudinal data with irregular, outcome-dependent follow-up. J Roy Stat Soc B. 2004;66:791–813.CrossRef Lin HQ, Scharfstein DO, Rosenheck RA. Analysis of longitudinal data with irregular, outcome-dependent follow-up. J Roy Stat Soc B. 2004;66:791–813.CrossRef
3.
go back to reference Zeger SL, Liang KY. Longitudinal data analysis for discrete and continuous outcomes. Biometrics. 1986;42:121–30.CrossRefPubMed Zeger SL, Liang KY. Longitudinal data analysis for discrete and continuous outcomes. Biometrics. 1986;42:121–30.CrossRefPubMed
4.
go back to reference Lipsitz SR, Fitzmaurice GM, Ibrahim JG, Gelber R, Lipshultz S. Parameter estimation in longitudinal studies with outcome-dependent follow-up. Biometrics. 2002;58:621–30.CrossRefPubMed Lipsitz SR, Fitzmaurice GM, Ibrahim JG, Gelber R, Lipshultz S. Parameter estimation in longitudinal studies with outcome-dependent follow-up. Biometrics. 2002;58:621–30.CrossRefPubMed
6.
go back to reference Lin D, Ying Z. Semiparametric regression analysis of longitudinal data with informative drop-outs. Biostatistics. 2003;4:385–98.CrossRefPubMed Lin D, Ying Z. Semiparametric regression analysis of longitudinal data with informative drop-outs. Biostatistics. 2003;4:385–98.CrossRefPubMed
7.
go back to reference Lin D, Ying Z. Semiparametric and nonparametric regression analysis of longitudinal data. J Am Stat Assoc. 2001;96:103–26.CrossRef Lin D, Ying Z. Semiparametric and nonparametric regression analysis of longitudinal data. J Am Stat Assoc. 2001;96:103–26.CrossRef
8.
go back to reference Buzkova P, Brown ER, John-Stewart GC. Longitudinal data analysis for generalized linear models under participant-driven informative follow-up: an application in maternal health epidemiology. Am J Epidemiol. 2010;171:189–97.CrossRefPubMed Buzkova P, Brown ER, John-Stewart GC. Longitudinal data analysis for generalized linear models under participant-driven informative follow-up: an application in maternal health epidemiology. Am J Epidemiol. 2010;171:189–97.CrossRefPubMed
9.
go back to reference Buzkova P, Lumley T. Semiparametric modeling of repeated measurements under outcome-dependent follow-up. Stat Med. 2009;28:987–1003.CrossRefPubMed Buzkova P, Lumley T. Semiparametric modeling of repeated measurements under outcome-dependent follow-up. Stat Med. 2009;28:987–1003.CrossRefPubMed
10.
go back to reference BU̇rŽKOVÁ P, Lumley T. Longitudinal data analysis for generalized linear models with follow-up dependent on outcome-related variables. Canadian Journal of Statistics. 2007;35:485–500.CrossRef BU̇rŽKOVÁ P, Lumley T. Longitudinal data analysis for generalized linear models with follow-up dependent on outcome-related variables. Canadian Journal of Statistics. 2007;35:485–500.CrossRef
11.
go back to reference Sun J, Sun L, Liu D. Regression analysis of longitudinal data in the presence of informative observation and censoring times. J Am Stat Assoc. 2007;102:1397–406.CrossRef Sun J, Sun L, Liu D. Regression analysis of longitudinal data in the presence of informative observation and censoring times. J Am Stat Assoc. 2007;102:1397–406.CrossRef
12.
go back to reference Sun L, Song X, Zhou J. Regression analysis of longitudinal data with time-dependent covariates in the presence of informative observation and censoring times. Journal of Statistical Planning and Inference. 2011;141:2902–19.CrossRef Sun L, Song X, Zhou J. Regression analysis of longitudinal data with time-dependent covariates in the presence of informative observation and censoring times. Journal of Statistical Planning and Inference. 2011;141:2902–19.CrossRef
13.
14.
go back to reference Song X, Mu X, Sun L. Regression analysis of longitudinal data with time-dependent covariates and informative observation times. Scand J Stat. 2012;39:248–58.CrossRef Song X, Mu X, Sun L. Regression analysis of longitudinal data with time-dependent covariates and informative observation times. Scand J Stat. 2012;39:248–58.CrossRef
15.
go back to reference Arterburn DE, et al. A multisite study of long-term remission and relapse of type 2 diabetes mellitus following gastric bypass. Obes Surg. 2013;23:93–102.CrossRefPubMedPubMedCentral Arterburn DE, et al. A multisite study of long-term remission and relapse of type 2 diabetes mellitus following gastric bypass. Obes Surg. 2013;23:93–102.CrossRefPubMedPubMedCentral
17.
go back to reference Miller RR, et al. Association between Interleukin-6 and lower extremity function after hip fracture—the role of muscle mass and strength. J Am Geriatr Soc. 2008;56:1050–6.CrossRefPubMedPubMedCentral Miller RR, et al. Association between Interleukin-6 and lower extremity function after hip fracture—the role of muscle mass and strength. J Am Geriatr Soc. 2008;56:1050–6.CrossRefPubMedPubMedCentral
19.
go back to reference Booth A, et al. An international registry of systematic-review protocols. Lancet. 2011;377:108–9.CrossRefPubMed Booth A, et al. An international registry of systematic-review protocols. Lancet. 2011;377:108–9.CrossRefPubMed
20.
go back to reference Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.CrossRef Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20:37–46.CrossRef
22.
go back to reference Wong ES, et al. BMI trajectories among the severely obese: results from an electronic medical record population. Obesity. 2012;20:2107–12.CrossRefPubMed Wong ES, et al. BMI trajectories among the severely obese: results from an electronic medical record population. Obesity. 2012;20:2107–12.CrossRefPubMed
23.
go back to reference Ullrich PM, et al. Pain, depression, and health care utilization over time after spinal cord injury. Rehabil Psychol. 2013;58:158–65.CrossRefPubMed Ullrich PM, et al. Pain, depression, and health care utilization over time after spinal cord injury. Rehabil Psychol. 2013;58:158–65.CrossRefPubMed
25.
go back to reference Gao S, et al. Redefined blood pressure variability measure and its association with mortality in elderly primary care patients. Hypertension. 2014;64:45–52.CrossRefPubMedPubMedCentral Gao S, et al. Redefined blood pressure variability measure and its association with mortality in elderly primary care patients. Hypertension. 2014;64:45–52.CrossRefPubMedPubMedCentral
26.
go back to reference Mancevski B, et al. Lifelong course of positive and negative symptoms in chronically institutionalized patients with schizophrenia. Psychopathology. 2007;40:83–92.CrossRefPubMed Mancevski B, et al. Lifelong course of positive and negative symptoms in chronically institutionalized patients with schizophrenia. Psychopathology. 2007;40:83–92.CrossRefPubMed
27.
go back to reference Haas WC, Moore JB, Kaplan M, Lazorick S. Outcomes from a medical weight loss program: primary care clinics versus weight loss clinics. Am J Med. 2012;125(603):e607–11. Haas WC, Moore JB, Kaplan M, Lazorick S. Outcomes from a medical weight loss program: primary care clinics versus weight loss clinics. Am J Med. 2012;125(603):e607–11.
28.
go back to reference Von Elm E, et al. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Prev Med. 2007;45:247–51.CrossRef Von Elm E, et al. The strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. Prev Med. 2007;45:247–51.CrossRef
29.
go back to reference Burton A, Altman DG. Missing covariate data within cancer prognostic studies: a review of current reporting and proposed guidelines. Br J Cancer. 2004;91:4–8.CrossRefPubMedPubMedCentral Burton A, Altman DG. Missing covariate data within cancer prognostic studies: a review of current reporting and proposed guidelines. Br J Cancer. 2004;91:4–8.CrossRefPubMedPubMedCentral
30.
go back to reference Hemkens LG, et al. The reporting of studies using routinely collected health data was often insufficient. J Clin Epidemiol. 2016; Hemkens LG, et al. The reporting of studies using routinely collected health data was often insufficient. J Clin Epidemiol. 2016;
31.
go back to reference Lim LS, et al. Systematic review of the quality of prognosis studies in systemic lupus erythematosus. Arthritis care & research. 2014;66:1536–41.CrossRef Lim LS, et al. Systematic review of the quality of prognosis studies in systemic lupus erythematosus. Arthritis care & research. 2014;66:1536–41.CrossRef
32.
go back to reference Karahalios A, Baglietto L, Carlin JB, English DR, Simpson JA. A review of the reporting and handling of missing data in cohort studies with repeated assessment of exposure measures. BMC Med Res Methodol. 2012;12:1.CrossRef Karahalios A, Baglietto L, Carlin JB, English DR, Simpson JA. A review of the reporting and handling of missing data in cohort studies with repeated assessment of exposure measures. BMC Med Res Methodol. 2012;12:1.CrossRef
33.
go back to reference Powney M, Williamson P, Kirkham J, Kolamunnage-Dona R. A review of the handling of missing longitudinal outcome data in clinical trials. Trials. 2014;15:1.CrossRef Powney M, Williamson P, Kirkham J, Kolamunnage-Dona R. A review of the handling of missing longitudinal outcome data in clinical trials. Trials. 2014;15:1.CrossRef
34.
go back to reference Hogan JW, Roy J, Korkontzelou C. Handling drop-out in longitudinal studies. Stat Med. 2004;23:1455–97.CrossRefPubMed Hogan JW, Roy J, Korkontzelou C. Handling drop-out in longitudinal studies. Stat Med. 2004;23:1455–97.CrossRefPubMed
35.
go back to reference Lin Y, Ovaert TC. The stress and displacement fields produced in a semi-infinite solid by a uniform heat source over a rectangular area on the surface. J Tribol-T Asme. 2003;125:709–12.CrossRef Lin Y, Ovaert TC. The stress and displacement fields produced in a semi-infinite solid by a uniform heat source over a rectangular area on the surface. J Tribol-T Asme. 2003;125:709–12.CrossRef
36.
go back to reference Nietert PJ, Wahlquist AE, Herbert TL. Characteristics of recent biostatistical methods adopted by researchers publishing in general/internal medicine journals. Stat Med. 2013;32:1.CrossRefPubMed Nietert PJ, Wahlquist AE, Herbert TL. Characteristics of recent biostatistical methods adopted by researchers publishing in general/internal medicine journals. Stat Med. 2013;32:1.CrossRefPubMed
Metadata
Title
Longitudinal studies that use data collected as part of usual care risk reporting biased results: a systematic review
Authors
Delaram Farzanfar
Asmaa Abumuamar
Jayoon Kim
Emily Sirotich
Yue Wang
Eleanor Pullenayegum
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0418-1

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue