Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

Methodologic considerations in the design and analysis of nested case-control studies: association between cytokines and postoperative delirium

Authors: Long H. Ngo, Sharon K. Inouye, Richard N. Jones, Thomas G. Travison, Towia A. Libermann, Simon T. Dillon, George A. Kuchel, Sarinnapha M. Vasunilashorn, David C. Alsop, Edward R. Marcantonio

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

The nested case-control study (NCC) design within a prospective cohort study is used when outcome data are available for all subjects, but the exposure of interest has not been collected, and is difficult or prohibitively expensive to obtain for all subjects. A NCC analysis with good matching procedures yields estimates that are as efficient and unbiased as estimates from the full cohort study. We present methodological considerations in a matched NCC design and analysis, which include the choice of match algorithms, analysis methods to evaluate the association of exposures of interest with outcomes, and consideration of overmatching.

Methods

Matched, NCC design within a longitudinal observational prospective cohort study in the setting of two academic hospitals. Study participants are patients aged over 70 years who underwent scheduled major non-cardiac surgery. The primary outcome was postoperative delirium from in-hospital interviews and medical record review. The main exposure was IL-6 concentration (pg/ml) from blood sampled at three time points before delirium occurred. We used nonparametric signed ranked test to test for the median of the paired differences. We used conditional logistic regression to model the risk of IL-6 on delirium incidence. Simulation was used to generate a sample of cohort data on which unconditional multivariable logistic regression was used, and the results were compared to those of the conditional logistic regression. Partial R-square was used to assess the level of overmatching.

Results

We found that the optimal match algorithm yielded more matched pairs than the greedy algorithm. The choice of analytic strategy—whether to consider measured cytokine levels as the predictor or outcome-- yielded inferences that have different clinical interpretations but similar levels of statistical significance. Estimation results from NCC design using conditional logistic regression, and from simulated cohort design using unconditional logistic regression, were similar. We found minimal evidence for overmatching.

Conclusions

Using a matched NCC approach introduces methodological challenges into the study design and data analysis. Nonetheless, with careful selection of the match algorithm, match factors, and analysis methods, this design is cost effective and, for our study, yields estimates that are similar to those from a prospective cohort study design.
Literature
1.
go back to reference Breslow N. Design and analysis of case-control studies. Annual Rev Pub Health. 1982;3:29–54.CrossRef Breslow N. Design and analysis of case-control studies. Annual Rev Pub Health. 1982;3:29–54.CrossRef
2.
3.
go back to reference Langholz B. Case–control study, nested. Encyclopedia of Biostatistics. 2005;1:646-655. Langholz B. Case–control study, nested. Encyclopedia of Biostatistics. 2005;1:646-655.
4.
5.
go back to reference Goldstein L, Langholz B. Asymptotic theory for nested case-control sampling in the Cox regression model. Ann Stat. 1992;20:1903–28.CrossRef Goldstein L, Langholz B. Asymptotic theory for nested case-control sampling in the Cox regression model. Ann Stat. 1992;20:1903–28.CrossRef
6.
go back to reference Martin LJ, Melnichouk O, Huszti E, Connolly PW, Greenberg CV, Minkin S, et al. Serum lipids, lipoproteins, and risk of breast cancer: a nested case-control study using multiple time points. J Natl Cancer Inst. 2015;107:5. Martin LJ, Melnichouk O, Huszti E, Connolly PW, Greenberg CV, Minkin S, et al. Serum lipids, lipoproteins, and risk of breast cancer: a nested case-control study using multiple time points. J Natl Cancer Inst. 2015;107:5.
7.
go back to reference Viazzi F, Ramesh G, Jayakumar C, Leoncini G, Garneri D, Pontremoli R. Increased urine semaphorin-3A is associated with renal damage in hypertensive patients with chronic kidney disease: a nested case–control study. J Nephrology. 2015;28:315–20.CrossRef Viazzi F, Ramesh G, Jayakumar C, Leoncini G, Garneri D, Pontremoli R. Increased urine semaphorin-3A is associated with renal damage in hypertensive patients with chronic kidney disease: a nested case–control study. J Nephrology. 2015;28:315–20.CrossRef
8.
go back to reference Chambers JC, Loh M, Lehne B, Drong A, Kriebel J, Motta V, et al. Epigenome-wide association of DNA methylation markers in peripheral blood from Indian Asians and Europeans with incident type 2 diabetes: a nested case-control study. Lancet Diabetes Endocrinol. 2015;2:526–34.CrossRef Chambers JC, Loh M, Lehne B, Drong A, Kriebel J, Motta V, et al. Epigenome-wide association of DNA methylation markers in peripheral blood from Indian Asians and Europeans with incident type 2 diabetes: a nested case-control study. Lancet Diabetes Endocrinol. 2015;2:526–34.CrossRef
9.
go back to reference Kahle EM, Bolton M, Hughes JP, Donnell D, Celum C, Lingappa JR, et al. Plasma cytokine levels and risk of HIV type 1 (HIV-1) transmission and acquisition: a nested case-control study among HIV-1-serodiscordant couples. J Infect Dis. 2015;211:1451–60.CrossRefPubMed Kahle EM, Bolton M, Hughes JP, Donnell D, Celum C, Lingappa JR, et al. Plasma cytokine levels and risk of HIV type 1 (HIV-1) transmission and acquisition: a nested case-control study among HIV-1-serodiscordant couples. J Infect Dis. 2015;211:1451–60.CrossRefPubMed
10.
go back to reference Wacholder S, SIlverman DT, McLaughlin JK. Mandel JSl. Selection of controls in case-control studies: III. Design options. Am J Epidemiol. 1992;135:1042–50.CrossRefPubMed Wacholder S, SIlverman DT, McLaughlin JK. Mandel JSl. Selection of controls in case-control studies: III. Design options. Am J Epidemiol. 1992;135:1042–50.CrossRefPubMed
11.
go back to reference Rosenbaum PR. Optimal matching for observational studies. J Am Stat Assoc. 1989;84:1024–32.CrossRef Rosenbaum PR. Optimal matching for observational studies. J Am Stat Assoc. 1989;84:1024–32.CrossRef
12.
go back to reference Cornfield J. A method of estimating comparative rates from clinical data; applications to cancer of the lung, breast, and cervix. J Natl Cancer Inst. 1951;11:1269–75.PubMed Cornfield J. A method of estimating comparative rates from clinical data; applications to cancer of the lung, breast, and cervix. J Natl Cancer Inst. 1951;11:1269–75.PubMed
13.
go back to reference Mantel N, Haenszel W. Statistical aspects of the analysis of data from retrospective studies of disease. J Natl Cancer Inst. 1959;22:719–48.PubMed Mantel N, Haenszel W. Statistical aspects of the analysis of data from retrospective studies of disease. J Natl Cancer Inst. 1959;22:719–48.PubMed
14.
go back to reference Rubin DB. Matched sampling for causal effects. New York, NY: Cambridge University Press; 2006. Rubin DB. Matched sampling for causal effects. New York, NY: Cambridge University Press; 2006.
15.
go back to reference Rothman KJ, Greenland S, Lash TL. Modern Epidemiology. Philadelphia, PA: Lippincott Williams & Wilkins; 2008. Rothman KJ, Greenland S, Lash TL. Modern Epidemiology. Philadelphia, PA: Lippincott Williams & Wilkins; 2008.
16.
go back to reference Marcantonio ER, Rudolph JL, Culley D, Crosby G, Alsop D, Inouye SK. Serum biomarkers for delirium. J Gerontol A Biol Sci Med Sci. 2006;61:1281–6.CrossRefPubMed Marcantonio ER, Rudolph JL, Culley D, Crosby G, Alsop D, Inouye SK. Serum biomarkers for delirium. J Gerontol A Biol Sci Med Sci. 2006;61:1281–6.CrossRefPubMed
17.
go back to reference de Rooij SE, van Munster BC, Korevaar JC, Levi M. Cytokines and acute phase response in delirium. J Psychosom Res. 2007;62:521–5.CrossRefPubMed de Rooij SE, van Munster BC, Korevaar JC, Levi M. Cytokines and acute phase response in delirium. J Psychosom Res. 2007;62:521–5.CrossRefPubMed
18.
go back to reference Rudolph JL, Ramlawi B, Kuchel GA, McElhaney JE, Xie D, Sellke FW, et al. Chemokines are associated with delirium after cardiac surgery. J Gerontol A Biol Sci Med Sci. 2008;63:184–9.CrossRefPubMedPubMedCentral Rudolph JL, Ramlawi B, Kuchel GA, McElhaney JE, Xie D, Sellke FW, et al. Chemokines are associated with delirium after cardiac surgery. J Gerontol A Biol Sci Med Sci. 2008;63:184–9.CrossRefPubMedPubMedCentral
19.
go back to reference Girard TD, Ware LB, Bernard GR, Pandharipande PP, Thompson JL, Shintani AK, et al. Associations of markers of inflammation and coagulation with delirium during critical illness. Intensive Care Med. 2012;28:1965–73.CrossRef Girard TD, Ware LB, Bernard GR, Pandharipande PP, Thompson JL, Shintani AK, et al. Associations of markers of inflammation and coagulation with delirium during critical illness. Intensive Care Med. 2012;28:1965–73.CrossRef
20.
go back to reference Schmitt EM, Marcantonio ER, Alsop DC, Jones RN, Rogers Jr SO, Fong TG, et al. Novel risk markers and long-term outcomes of delirium: the successful aging after elective surgery (SAGES) study design and methods. J Am Med Dir Assoc. 2012;13:818.CrossRefPubMedPubMedCentral Schmitt EM, Marcantonio ER, Alsop DC, Jones RN, Rogers Jr SO, Fong TG, et al. Novel risk markers and long-term outcomes of delirium: the successful aging after elective surgery (SAGES) study design and methods. J Am Med Dir Assoc. 2012;13:818.CrossRefPubMedPubMedCentral
21.
go back to reference Schmitt EM, Saczynski JS, Kosar CM, Jones RN, Alsop DC, Fong TG, et al. The successful aging after elective surgery study: cohort description and data quality procedures. J Am Geriatr Soc. 2015;63:2463–71.CrossRefPubMedPubMedCentral Schmitt EM, Saczynski JS, Kosar CM, Jones RN, Alsop DC, Fong TG, et al. The successful aging after elective surgery study: cohort description and data quality procedures. J Am Geriatr Soc. 2015;63:2463–71.CrossRefPubMedPubMedCentral
22.
go back to reference Vasunilashorn SM, Ngo L, Inouye SK, Libermann TA, Jones RN, Alsop DC, et al. Cytokines and postoperative delirium in older patients undergoing major elective surgery. J Gerontol A Biol Sci Med Sci. 2015;70:1289–95.CrossRefPubMedPubMedCentral Vasunilashorn SM, Ngo L, Inouye SK, Libermann TA, Jones RN, Alsop DC, et al. Cytokines and postoperative delirium in older patients undergoing major elective surgery. J Gerontol A Biol Sci Med Sci. 2015;70:1289–95.CrossRefPubMedPubMedCentral
23.
go back to reference Jones RN, Rudolph JL, Inouye SK, Yang FM, Fong TG, Milberg WP, et al. Development of a unidimensional composite measure of neuropsychological functioning in older cardiac surgery patients with good measurement precision. J Clin Exp Neuropsychol. 2010;32:1041–9.CrossRefPubMedPubMedCentral Jones RN, Rudolph JL, Inouye SK, Yang FM, Fong TG, Milberg WP, et al. Development of a unidimensional composite measure of neuropsychological functioning in older cardiac surgery patients with good measurement precision. J Clin Exp Neuropsychol. 2010;32:1041–9.CrossRefPubMedPubMedCentral
24.
go back to reference Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika. 1983;70:41–55.CrossRef Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika. 1983;70:41–55.CrossRef
25.
go back to reference Avis D, Burgess D, Steele JM. Probabilistic analysis of a greedy heuristic for Euclidean matching. Probability Eng Info Sci. 1988;2:143–56.CrossRef Avis D, Burgess D, Steele JM. Probabilistic analysis of a greedy heuristic for Euclidean matching. Probability Eng Info Sci. 1988;2:143–56.CrossRef
26.
27.
go back to reference Stokes ME, Davis CS, Koch GG. Categorical data analysis using SAS, Third Edition. Cary, NC:SAS Institute Inc.; 2012. Stokes ME, Davis CS, Koch GG. Categorical data analysis using SAS, Third Edition. Cary, NC:SAS Institute Inc.; 2012.
28.
go back to reference Wilcoxon F. Individual comparisons by ranking methods. Biom Bull. 1945;1:80–3.CrossRef Wilcoxon F. Individual comparisons by ranking methods. Biom Bull. 1945;1:80–3.CrossRef
29.
go back to reference SAS Institute. SAS/STAT 12.1 User’s Guide: Procedure SURVEYSELECT. SAS Institute Inc.; 2012;95:8020-8092. SAS Institute. SAS/STAT 12.1 User’s Guide: Procedure SURVEYSELECT. SAS Institute Inc.; 2012;95:8020-8092.
Metadata
Title
Methodologic considerations in the design and analysis of nested case-control studies: association between cytokines and postoperative delirium
Authors
Long H. Ngo
Sharon K. Inouye
Richard N. Jones
Thomas G. Travison
Towia A. Libermann
Simon T. Dillon
George A. Kuchel
Sarinnapha M. Vasunilashorn
David C. Alsop
Edward R. Marcantonio
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0359-8

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue