Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Hyperglycemia | Research article

Using marginal standardisation to estimate relative risk without dichotomising continuous outcomes

Authors: Ying Chen, Yilin Ning, Shih Ling Kao, Nathalie C. Støer, Falk Müller-Riemenschneider, Kavita Venkataraman, Eric Yin Hao Khoo, E-Shyong Tai, Chuen Seng Tan

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

Although criticisms regarding the dichotomisation of continuous variables are well known, applying logit model to dichotomised outcomes is the convention because the odds ratios are easily obtained and they approximate the relative risks (RRs) for rare events.

Methods

To avoid dichotomisation when estimating RR, the marginal standardisation method that transforms estimates from logit or probit model to RR estimate is extended to include estimates from linear model in the transformation. We conducted a simulation study to compare the statistical properties of the estimates from: (i) marginal standardisation method between models for continuous (i.e., linear model) and dichotomised outcomes (i.e., logit or probit model), and (ii) marginal standardisation method and distributional approach (i.e., marginal mean method) applied to linear model. We also compared the diagnostic test for probit, logit and linear models. For the real dataset analysis, we applied these analytical approaches to assess the management of inpatient hyperglycaemia in a pilot intervention study.

Results

Although the RR estimates from the marginal standardisation method were generally unbiased for all models in the simulation study, the marginal standardisation method for linear model provided estimates with higher precision and power than logit or probit model, especially when the baseline risks were at the extremes. When comparing approaches that avoid dichotomisation, RR estimates from these approaches had comparable performance. Assessing the assumption of error distribution was less powerful for logit or probit model via link test when compared with diagnostic test for linear model. After accounting for multiple thresholds representing varying levels of severity in hyperglycaemia, marginal standardisation method for linear model provided stronger evidence of reduced hyperglycaemia risk after intervention in the real dataset analysis although the RR estimates were similar across various approaches.

Conclusions

When compared with approaches that do not avoid dichotomisation, the RR estimated from linear model is more precise and powerful, and the diagnostic test from linear model is more powerful in detecting mis-specified error distributional assumption than the diagnostic test from logit or probit model. Our work describes and assesses the methods available to analyse data involving studies of continuous outcomes with binary representations.
Appendix
Available only for authorised users
Literature
1.
go back to reference Christian MJ, Andersen B. Inpatient glycemic management. J South Calif Clin. 2014;8(1):41–4. Christian MJ, Andersen B. Inpatient glycemic management. J South Calif Clin. 2014;8(1):41–4.
2.
go back to reference Umpierrez GE, Hellman R, Korytkowski MT, Kosiborod M, Maynard GA, Montori VM, Seley JJ, Van den Berghe G. Management of hyperglycemia in hospitalized patients in non-critical care setting: an Endocrine Society clinical practice guideline. J Clin Endocrinol Metab. 2012;97(1):16–38.CrossRef Umpierrez GE, Hellman R, Korytkowski MT, Kosiborod M, Maynard GA, Montori VM, Seley JJ, Van den Berghe G. Management of hyperglycemia in hospitalized patients in non-critical care setting: an Endocrine Society clinical practice guideline. J Clin Endocrinol Metab. 2012;97(1):16–38.CrossRef
3.
go back to reference Choi JWJ, Ford ES, Gao X, Choi HK. Sugar-sweetened soft drinks, diet soft drinks, and serum uric acid level: the third national health and nutrition examination survey. Arthritis Care Res. 2008;59(1):109–16.CrossRef Choi JWJ, Ford ES, Gao X, Choi HK. Sugar-sweetened soft drinks, diet soft drinks, and serum uric acid level: the third national health and nutrition examination survey. Arthritis Care Res. 2008;59(1):109–16.CrossRef
4.
go back to reference Choi HK, Curhan G. Coffee, tea, and caffeine consumption and serum uric acid level: the third national health and nutrition examination survey. Arthritis Care Res. 2007;57(5):816–21.CrossRef Choi HK, Curhan G. Coffee, tea, and caffeine consumption and serum uric acid level: the third national health and nutrition examination survey. Arthritis Care Res. 2007;57(5):816–21.CrossRef
5.
go back to reference Teng GG, Tan CS, Santosa A, Saag KG, Yuan JM, Koh WP. Serum urate levels and consumption of common beverages and alcohol among Chinese in Singapore. Arthritis Care Res. 2013;65(9):1432–40.CrossRef Teng GG, Tan CS, Santosa A, Saag KG, Yuan JM, Koh WP. Serum urate levels and consumption of common beverages and alcohol among Chinese in Singapore. Arthritis Care Res. 2013;65(9):1432–40.CrossRef
6.
go back to reference Cohen J. The cost of dichotomization. Appl Psychol Meas. 1983;7(3):249–53.CrossRef Cohen J. The cost of dichotomization. Appl Psychol Meas. 1983;7(3):249–53.CrossRef
7.
go back to reference Fedorov V, Mannino F, Zhang R. Consequences of dichotomization. Pharm Stat. 2009;8(1):50–61.CrossRef Fedorov V, Mannino F, Zhang R. Consequences of dichotomization. Pharm Stat. 2009;8(1):50–61.CrossRef
8.
go back to reference Dawson NV, Weiss R. Dichotomizing continuous variables in statistical analysis a practice to avoid. Med Decis Mak. 2012;32(2):225–6.CrossRef Dawson NV, Weiss R. Dichotomizing continuous variables in statistical analysis a practice to avoid. Med Decis Mak. 2012;32(2):225–6.CrossRef
9.
go back to reference Ragland DR. Dichotomizing continuous outcome variables: dependence of the magnitude of association and statistical power on the cutpoint. Epidemiology. 1992:434–40.CrossRef Ragland DR. Dichotomizing continuous outcome variables: dependence of the magnitude of association and statistical power on the cutpoint. Epidemiology. 1992:434–40.CrossRef
10.
go back to reference MacCallum RC, Zhang S, Preacher KJ, Rucker DD. On the practice of dichotomization of quantitative variables. Psychol Methods. 2002;7(1):19.CrossRef MacCallum RC, Zhang S, Preacher KJ, Rucker DD. On the practice of dichotomization of quantitative variables. Psychol Methods. 2002;7(1):19.CrossRef
11.
go back to reference Moser BK, Coombs LP. Odds ratios for a continuous outcome variable without dichotomizing. Stat Med. 2004;23(12):1843–60.CrossRef Moser BK, Coombs LP. Odds ratios for a continuous outcome variable without dichotomizing. Stat Med. 2004;23(12):1843–60.CrossRef
12.
go back to reference Peacock J, Sauzet O, Ewings S, Kerry S. Dichotomising continuous data while retaining statistical power using a distributional approach. Stat Med. 2012;31(26):3089–103.CrossRef Peacock J, Sauzet O, Ewings S, Kerry S. Dichotomising continuous data while retaining statistical power using a distributional approach. Stat Med. 2012;31(26):3089–103.CrossRef
13.
go back to reference Sauzet O, Peacock J. Estimating dichotomised outcomes in two groups with unequal variances: a distributional approach. Stat Med. 2014;33(26):4547–59.CrossRef Sauzet O, Peacock J. Estimating dichotomised outcomes in two groups with unequal variances: a distributional approach. Stat Med. 2014;33(26):4547–59.CrossRef
14.
go back to reference Sauzet O, Ofuya M, Peacock JL. Dichotomisation using a distributional approach when the outcome is skewed. BMC Med Res Methodol. 2015;15(1):40.CrossRef Sauzet O, Ofuya M, Peacock JL. Dichotomisation using a distributional approach when the outcome is skewed. BMC Med Res Methodol. 2015;15(1):40.CrossRef
15.
go back to reference Suissa S. Binary methods for continuous outcomes: a parametric alternative. J Clin Epidemiol. 1991;44(3):241–8.CrossRef Suissa S. Binary methods for continuous outcomes: a parametric alternative. J Clin Epidemiol. 1991;44(3):241–8.CrossRef
16.
go back to reference Sauzet O, Breckenkamp J, Borde T, Brenne S, David M, Razum O, Peacock JL. A distributional approach to obtain adjusted comparisons of proportions of a population at risk. Emerg Themes Epidemiol. 2016;13(1):8.CrossRef Sauzet O, Breckenkamp J, Borde T, Brenne S, David M, Razum O, Peacock JL. A distributional approach to obtain adjusted comparisons of proportions of a population at risk. Emerg Themes Epidemiol. 2016;13(1):8.CrossRef
17.
go back to reference Jiang W, Mayo MS, Gajewski BJ. Dichotomizing continuous data which retains statistical precision using a bayesian distributional approach that reflects the true uncertainty. Stat Biopharm Res. 2016;8(1):77–87.CrossRef Jiang W, Mayo MS, Gajewski BJ. Dichotomizing continuous data which retains statistical precision using a bayesian distributional approach that reflects the true uncertainty. Stat Biopharm Res. 2016;8(1):77–87.CrossRef
18.
go back to reference Schörgendorfer A, Branscum AJ, Hanson TE. A Bayesian goodness of fit test and semiparametric generalization of logistic regression with measurement data. Biometrics. 2013;69(2):508–19.CrossRef Schörgendorfer A, Branscum AJ, Hanson TE. A Bayesian goodness of fit test and semiparametric generalization of logistic regression with measurement data. Biometrics. 2013;69(2):508–19.CrossRef
19.
go back to reference Muller CJ, MacLehose RF. Estimating predicted probabilities from logistic regression: different methods correspond to different target populations. Int J Epidemiol. 2014;43(3):962–70.CrossRef Muller CJ, MacLehose RF. Estimating predicted probabilities from logistic regression: different methods correspond to different target populations. Int J Epidemiol. 2014;43(3):962–70.CrossRef
20.
go back to reference McFadden D. Econometric models for probabilistic choice among products. J Bus. 1980; 53(3):S13–29.CrossRef McFadden D. Econometric models for probabilistic choice among products. J Bus. 1980; 53(3):S13–29.CrossRef
21.
go back to reference Cramer JS. Logit models from economics and other fields. Cambridge: Cambridge University Press; 2003. Cramer JS. Logit models from economics and other fields. Cambridge: Cambridge University Press; 2003.
22.
go back to reference Ben-Akiva ME, Lerman SR. Discrete choice analysis: theory and application to travel demand, vol. 9. Cambridge: MIT press; 1985. Ben-Akiva ME, Lerman SR. Discrete choice analysis: theory and application to travel demand, vol. 9. Cambridge: MIT press; 1985.
23.
go back to reference Lee J, Tan CS, Chia KS. A practical guide for multivariate analysis of dichotomous outcomes. Ann Acad Med Singap. 2009;38(8):714–9.PubMed Lee J, Tan CS, Chia KS. A practical guide for multivariate analysis of dichotomous outcomes. Ann Acad Med Singap. 2009;38(8):714–9.PubMed
24.
go back to reference Flanders WD, Rhodes PH. Large sample confidence intervals for regression standardized risks, risk ratios, and risk differences. J Chronic Dis. 1987;40(7):697–704.CrossRef Flanders WD, Rhodes PH. Large sample confidence intervals for regression standardized risks, risk ratios, and risk differences. J Chronic Dis. 1987;40(7):697–704.CrossRef
25.
go back to reference Localio AR, Margolis DJ, Berlin JA. Relative risks and confidence intervals were easily computed indirectly from multivariable logistic regression. J Clin Epidemiol. 2007;60(9):874–82.CrossRef Localio AR, Margolis DJ, Berlin JA. Relative risks and confidence intervals were easily computed indirectly from multivariable logistic regression. J Clin Epidemiol. 2007;60(9):874–82.CrossRef
26.
go back to reference Greenland S. Model-based estimation of relative risks and other epidemiologic measures in studies of common outcomes and in case-control studies. Am J Epidemiol. 2004;160(4):301–5.CrossRef Greenland S. Model-based estimation of relative risks and other epidemiologic measures in studies of common outcomes and in case-control studies. Am J Epidemiol. 2004;160(4):301–5.CrossRef
27.
go back to reference Knol MJ, Le Cessie S, Algra A, Vandenbroucke JP, Groenwold RH. Overestimation of risk ratios by odds ratios in trials and cohort studies: alternatives to logistic regression. Can Med Assoc J. 2012;184(8):895–9.CrossRef Knol MJ, Le Cessie S, Algra A, Vandenbroucke JP, Groenwold RH. Overestimation of risk ratios by odds ratios in trials and cohort studies: alternatives to logistic regression. Can Med Assoc J. 2012;184(8):895–9.CrossRef
28.
go back to reference R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2017. R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2017.
29.
go back to reference Pregibon D. Goodness of link tests for generalized linear models. Appl Stat. 1980; 29(1):15–24.CrossRef Pregibon D. Goodness of link tests for generalized linear models. Appl Stat. 1980; 29(1):15–24.CrossRef
30.
go back to reference Lilliefors HW. On the Kolmogorov-Smirnov test for normality with mean and variance unknown. J Am Stat Assoc. 1967;62(318):399–402.CrossRef Lilliefors HW. On the Kolmogorov-Smirnov test for normality with mean and variance unknown. J Am Stat Assoc. 1967;62(318):399–402.CrossRef
31.
go back to reference Munoz M, Pronovost P, Dintzis J, Kemmerer T, Wang N-Y, Chang Y-T, Efird L, Berenholtz SM, Golden SH. Implementing and evaluating a multicomponent inpatient diabetes management program: putting research into practice. Jt Comm J Qual Patient Saf. 2012;38(5):195–AP194.CrossRef Munoz M, Pronovost P, Dintzis J, Kemmerer T, Wang N-Y, Chang Y-T, Efird L, Berenholtz SM, Golden SH. Implementing and evaluating a multicomponent inpatient diabetes management program: putting research into practice. Jt Comm J Qual Patient Saf. 2012;38(5):195–AP194.CrossRef
32.
go back to reference Gschwend S, Ryan C, Atchison J, Arslanian S, Becker D. Effects of acute hyperglycemia on mental efficiency and counterregulatory hormones in adolescents with insulin-dependent diabetes mellitus. J Pediatr. 1995;126(2):178–84.CrossRef Gschwend S, Ryan C, Atchison J, Arslanian S, Becker D. Effects of acute hyperglycemia on mental efficiency and counterregulatory hormones in adolescents with insulin-dependent diabetes mellitus. J Pediatr. 1995;126(2):178–84.CrossRef
33.
go back to reference Maynard G, Kulasa K, Ramos P, Childers D, Clay B, Sebasky M, Fink E, Field A, Renvall M, Juang PS. Impact of a hypoglycemia reduction bundle and a systems approach to inpatient glycemic management. Endocr Pract. 2014;21(4):355–67.CrossRef Maynard G, Kulasa K, Ramos P, Childers D, Clay B, Sebasky M, Fink E, Field A, Renvall M, Juang PS. Impact of a hypoglycemia reduction bundle and a systems approach to inpatient glycemic management. Endocr Pract. 2014;21(4):355–67.CrossRef
34.
go back to reference Stasinopoulos DM, Rigby RA. Generalized additive models for location scale and shape (GAMLSS) in R. J Stat Softw. 2007;23(7):1–46.CrossRef Stasinopoulos DM, Rigby RA. Generalized additive models for location scale and shape (GAMLSS) in R. J Stat Softw. 2007;23(7):1–46.CrossRef
35.
go back to reference Miller RG. Simultaneous statistical inference. Springer-Verlag New York: Springer; 1981.CrossRef Miller RG. Simultaneous statistical inference. Springer-Verlag New York: Springer; 1981.CrossRef
36.
go back to reference Jiang Y, Scott A, Wild CJ. Case–control analysis with a continuous outcome variable. Stat Med. 2009;28(2):194–204.CrossRef Jiang Y, Scott A, Wild CJ. Case–control analysis with a continuous outcome variable. Stat Med. 2009;28(2):194–204.CrossRef
37.
go back to reference Cordeiro GM, McCullagh P. Bias correction in generalized linear models. J R Stat Soc Ser B Methodol. 1991;53(3):629–43. Cordeiro GM, McCullagh P. Bias correction in generalized linear models. J R Stat Soc Ser B Methodol. 1991;53(3):629–43.
38.
go back to reference Belsley DA, Kuh E, Welsch RE. Regression diagnostics: identifying influential data and sources of collinearity, vol. 571. New York: Wiley; 2005. Belsley DA, Kuh E, Welsch RE. Regression diagnostics: identifying influential data and sources of collinearity, vol. 571. New York: Wiley; 2005.
39.
go back to reference Hosmer DW, Hjort NL. Goodness-of-fit processes for logistic regression: simulation results. Stat Med. 2002;21(18):2723–38.CrossRef Hosmer DW, Hjort NL. Goodness-of-fit processes for logistic regression: simulation results. Stat Med. 2002;21(18):2723–38.CrossRef
40.
go back to reference Aldrich JH, Nelson FD. Linear probability, logit, and probit models, vol. 45. Newbury Park: Sage; 1984.CrossRef Aldrich JH, Nelson FD. Linear probability, logit, and probit models, vol. 45. Newbury Park: Sage; 1984.CrossRef
41.
go back to reference Firth D. Multiplicative errors: log-normal or gamma? J R Stat Soc Ser B Methodol. 1988;50(2):266–8. Firth D. Multiplicative errors: log-normal or gamma? J R Stat Soc Ser B Methodol. 1988;50(2):266–8.
42.
go back to reference Shoukri M, Mian I, Tracy D. Sampling properties of estimators of the log-logistic distribution with application to Canadian precipitation data. Can J Stat. 1988;16(3):223–36.CrossRef Shoukri M, Mian I, Tracy D. Sampling properties of estimators of the log-logistic distribution with application to Canadian precipitation data. Can J Stat. 1988;16(3):223–36.CrossRef
43.
go back to reference Needham T. A visual explanation of Jensen’s inequality. Am Math Mon. 1993;100(8):768–71.CrossRef Needham T. A visual explanation of Jensen’s inequality. Am Math Mon. 1993;100(8):768–71.CrossRef
44.
go back to reference Austin PC. Absolute risk reductions, relative risks, relative risk reductions, and numbers needed to treat can be obtained from a logistic regression model. J Clin Epidemiol. 2010;63(1):2–6.CrossRef Austin PC. Absolute risk reductions, relative risks, relative risk reductions, and numbers needed to treat can be obtained from a logistic regression model. J Clin Epidemiol. 2010;63(1):2–6.CrossRef
45.
go back to reference Sciandra M, Muggeo VM, Lovison G. Subject-specific odds ratios in binomial GLMMs with continuous response. Stat Methods Appl. 2008;17(3):309–20.CrossRef Sciandra M, Muggeo VM, Lovison G. Subject-specific odds ratios in binomial GLMMs with continuous response. Stat Methods Appl. 2008;17(3):309–20.CrossRef
46.
go back to reference Austin PC. Absolute risk reductions and numbers needed to treat can be obtained from adjusted survival models for time-to-event outcomes. J Clin Epidemiol. 2010;63(1):46–55.CrossRef Austin PC. Absolute risk reductions and numbers needed to treat can be obtained from adjusted survival models for time-to-event outcomes. J Clin Epidemiol. 2010;63(1):46–55.CrossRef
Metadata
Title
Using marginal standardisation to estimate relative risk without dichotomising continuous outcomes
Authors
Ying Chen
Yilin Ning
Shih Ling Kao
Nathalie C. Støer
Falk Müller-Riemenschneider
Kavita Venkataraman
Eric Yin Hao Khoo
E-Shyong Tai
Chuen Seng Tan
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Hyperglycemia
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-019-0778-9

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue