Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2011

Open Access 01-12-2011 | Research article

Parametric methods outperformed non-parametric methods in comparisons of discrete numerical variables

Authors: Morten W Fagerland, Leiv Sandvik, Petter Mowinckel

Published in: BMC Medical Research Methodology | Issue 1/2011

Login to get access

Abstract

Background

The number of events per individual is a widely reported variable in medical research papers. Such variables are the most common representation of the general variable type called discrete numerical. There is currently no consensus on how to compare and present such variables, and recommendations are lacking. The objective of this paper is to present recommendations for analysis and presentation of results for discrete numerical variables.

Methods

Two simulation studies were used to investigate the performance of hypothesis tests and confidence interval methods for variables with outcomes {0, 1, 2}, {0, 1, 2, 3}, {0, 1, 2, 3, 4}, and {0, 1, 2, 3, 4, 5}, using the difference between the means as an effect measure.

Results

The Welch U test (the T test with adjustment for unequal variances) and its associated confidence interval performed well for almost all situations considered. The Brunner-Munzel test also performed well, except for small sample sizes (10 in each group). The ordinary T test, the Wilcoxon-Mann-Whitney test, the percentile bootstrap interval, and the bootstrap-t interval did not perform satisfactorily.

Conclusions

The difference between the means is an appropriate effect measure for comparing two independent discrete numerical variables that has both lower and upper bounds. To analyze this problem, we encourage more frequent use of parametric hypothesis tests and confidence intervals.
Appendix
Available only for authorised users
Literature
1.
go back to reference Altman DG: Practical Statistics For Medical Research. 1991, Boca Raton, FL: Chapman & Hall/CRC Altman DG: Practical Statistics For Medical Research. 1991, Boca Raton, FL: Chapman & Hall/CRC
2.
go back to reference Strömberg U: Collapsing ordered outcome categories: a note of concern. Am J Epidemiol. 1996, 144: 421-424.CrossRefPubMed Strömberg U: Collapsing ordered outcome categories: a note of concern. Am J Epidemiol. 1996, 144: 421-424.CrossRefPubMed
3.
go back to reference Sankey SS, Weissfeld LA: A study of the effect of dichotomizing ordinal data upon modeling. Commun Stat--Simul C. 1998, 27: 871-887. 10.1080/03610919808813515.CrossRef Sankey SS, Weissfeld LA: A study of the effect of dichotomizing ordinal data upon modeling. Commun Stat--Simul C. 1998, 27: 871-887. 10.1080/03610919808813515.CrossRef
4.
go back to reference Skovlund E, Fenstad GU: Should we always choose a nonparametric test when comparing two apparently nonnormal distributions?. J Clin Epidemiol. 2001, 54: 86-92. 10.1016/S0895-4356(00)00264-X.CrossRefPubMed Skovlund E, Fenstad GU: Should we always choose a nonparametric test when comparing two apparently nonnormal distributions?. J Clin Epidemiol. 2001, 54: 86-92. 10.1016/S0895-4356(00)00264-X.CrossRefPubMed
5.
go back to reference Zhou XH, Dinh P: Nonparametric confidence intervals for the one- and two-sample problems. Biostatistics. 2005, 6: 187-200. 10.1093/biostatistics/kxi002.CrossRefPubMed Zhou XH, Dinh P: Nonparametric confidence intervals for the one- and two-sample problems. Biostatistics. 2005, 6: 187-200. 10.1093/biostatistics/kxi002.CrossRefPubMed
6.
go back to reference Newcombe RG: Confidence intervals for the mean of a variable taking the values 0, 1 and 2. Stat Med. 2003, 22: 2737-2750. 10.1002/sim.1479.CrossRefPubMed Newcombe RG: Confidence intervals for the mean of a variable taking the values 0, 1 and 2. Stat Med. 2003, 22: 2737-2750. 10.1002/sim.1479.CrossRefPubMed
7.
go back to reference Fagerland MW, Sandvik L: Performance of five two-sample location tests for skewed distributions with unequal variances. Contemp Clin Trials. 2009, 30: 490-496. 10.1016/j.cct.2009.06.007.CrossRefPubMed Fagerland MW, Sandvik L: Performance of five two-sample location tests for skewed distributions with unequal variances. Contemp Clin Trials. 2009, 30: 490-496. 10.1016/j.cct.2009.06.007.CrossRefPubMed
8.
go back to reference Wilcox RR: Introduction To Robust Estimation And Hypothesis Testing. 2005, San Diego, CA: Academic Press, 2 Wilcox RR: Introduction To Robust Estimation And Hypothesis Testing. 2005, San Diego, CA: Academic Press, 2
9.
go back to reference Ryu E, Agresti A: Modeling and inference for an ordinal effect size measure. Stat Med. 2008, 27: 1703-1717. 10.1002/sim.3079.CrossRefPubMed Ryu E, Agresti A: Modeling and inference for an ordinal effect size measure. Stat Med. 2008, 27: 1703-1717. 10.1002/sim.3079.CrossRefPubMed
10.
go back to reference Matlab 7. 2005, The MathWorks, Inc., Natick, MA Matlab 7. 2005, The MathWorks, Inc., Natick, MA
11.
go back to reference Neubert K, Brunner E: A studentized permutation test for the non-parametric Behrens-Fisher problem. Comput Stat Data An. 2007, 51: 5192-5204. 10.1016/j.csda.2006.05.024.CrossRef Neubert K, Brunner E: A studentized permutation test for the non-parametric Behrens-Fisher problem. Comput Stat Data An. 2007, 51: 5192-5204. 10.1016/j.csda.2006.05.024.CrossRef
12.
go back to reference Davison AC, Hinkley DV: Bootstrap Methods And Their Application. 1997, Cambridge, UK: Cambridge University PressCrossRef Davison AC, Hinkley DV: Bootstrap Methods And Their Application. 1997, Cambridge, UK: Cambridge University PressCrossRef
13.
go back to reference Fagerland MW, Sandvik L: The Wilcoxon-Mann-Whitney test under scrutiny. Stat Med. 2009, 28: 1487-1497. 10.1002/sim.3561.CrossRefPubMed Fagerland MW, Sandvik L: The Wilcoxon-Mann-Whitney test under scrutiny. Stat Med. 2009, 28: 1487-1497. 10.1002/sim.3561.CrossRefPubMed
14.
15.
go back to reference Altman DG, Schulz KF, Moher D, et al: The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001, 134: 663-694.CrossRefPubMed Altman DG, Schulz KF, Moher D, et al: The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001, 134: 663-694.CrossRefPubMed
16.
go back to reference Vandenbroucke JP, von Elm E, Altman DG, et al: Strengthening the reporting of observational studies in epidemiology (STROBE): explanation and elaboration. PLoS Med. 2007, 4: 1628-1654. 10.1371/journal.pmed.0040297.CrossRef Vandenbroucke JP, von Elm E, Altman DG, et al: Strengthening the reporting of observational studies in epidemiology (STROBE): explanation and elaboration. PLoS Med. 2007, 4: 1628-1654. 10.1371/journal.pmed.0040297.CrossRef
17.
go back to reference Carter GL, Clover K, Whyte IM, Dawson AH, D'Este C: Postcards from the EDge project: randomised controlled trial of an intervention using postcards to reduce repetition of hospital treated deliberate self poisoning. BMJ. 2005, 331: 805-10.1136/bmj.38579.455266.E0.CrossRefPubMedPubMedCentral Carter GL, Clover K, Whyte IM, Dawson AH, D'Este C: Postcards from the EDge project: randomised controlled trial of an intervention using postcards to reduce repetition of hospital treated deliberate self poisoning. BMJ. 2005, 331: 805-10.1136/bmj.38579.455266.E0.CrossRefPubMedPubMedCentral
18.
go back to reference Ng DKK, Chow PY, Lai WP, Chan KC, Chang BL, So HY: Effect of a structured asthma education program on hospitalized asthmatic children: a randomized controlled trial. Pediatr Int. 2006, 48: 158-162. 10.1111/j.1442-200X.2006.02185.x.CrossRefPubMed Ng DKK, Chow PY, Lai WP, Chan KC, Chang BL, So HY: Effect of a structured asthma education program on hospitalized asthmatic children: a randomized controlled trial. Pediatr Int. 2006, 48: 158-162. 10.1111/j.1442-200X.2006.02185.x.CrossRefPubMed
19.
go back to reference Lehmann EL: Nonparametrics. Statistical Methods Based On Ranks. 1975, Upper Saddle River, NJ: Prentice-Hall, Inc Lehmann EL: Nonparametrics. Statistical Methods Based On Ranks. 1975, Upper Saddle River, NJ: Prentice-Hall, Inc
20.
go back to reference Neuhäuser M: A note on the exact test based on the Baumgartner-Weiß-Schindler statistic in the presence of ties. Comput Stat Data An. 2003, 42: 561-568. 10.1016/S0167-9473(02)00121-4.CrossRef Neuhäuser M: A note on the exact test based on the Baumgartner-Weiß-Schindler statistic in the presence of ties. Comput Stat Data An. 2003, 42: 561-568. 10.1016/S0167-9473(02)00121-4.CrossRef
Metadata
Title
Parametric methods outperformed non-parametric methods in comparisons of discrete numerical variables
Authors
Morten W Fagerland
Leiv Sandvik
Petter Mowinckel
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2011
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-11-44

Other articles of this Issue 1/2011

BMC Medical Research Methodology 1/2011 Go to the issue