Skip to main content
Top
Published in: Reproductive Medicine and Biology 1/2012

01-01-2012 | Review Article

Usefulness of statistics for establishing evidence-based reproductive medicine

Authors: Yasunori Sato, Masahiko Gosho, Kiyotaka Toshimori

Published in: Reproductive Medicine and Biology | Issue 1/2012

Login to get access

Abstract

During the last decade, evidence-based medicine has been described as a paradigm shift in clinical practice, and as “the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients”. Appropriate statistical methods for analyzing data are critical for the correct interpretation of the results in proof of the evidence. However, in the medical literature, these statistical methods are often incorrectly interpreted or misinterpreted, leading to serious methodological errors and misinterpretations. This review highlights several important aspects related to the design and statistical analysis for evidence-based reproductive medicine. First, we clarify the distinction between ratios, proportions, and rates, and then provide a definition of pregnancy rate. Second, we focus on a special type of bias called ‘confounding bias’, which occurs when a factor is associated with both the exposure and the disease but is not part of the causal pathway. Finally, we present concerns regarding misuse of statistical software or application of inappropriate statistical methods, especially in medical research.
Literature
1.
2.
go back to reference Van Noord-Zaadstra BM, Looman CW, Alsbach H, Habbema JD, te Velde ER, Karbaat J. Delaying childbearing: effect of age on fecundity and outcome of pregnancy. BMJ. 1991;302:1361–5.PubMedCrossRef Van Noord-Zaadstra BM, Looman CW, Alsbach H, Habbema JD, te Velde ER, Karbaat J. Delaying childbearing: effect of age on fecundity and outcome of pregnancy. BMJ. 1991;302:1361–5.PubMedCrossRef
3.
go back to reference Gnoth C, Godehardt D, Godehardt E, Frank-Herrmann P, Freundl G. Time to pregnancy: results of the German prospective study and impact on the management of infertility. Hum Reprod. 2003;18:1959–66.PubMedCrossRef Gnoth C, Godehardt D, Godehardt E, Frank-Herrmann P, Freundl G. Time to pregnancy: results of the German prospective study and impact on the management of infertility. Hum Reprod. 2003;18:1959–66.PubMedCrossRef
4.
go back to reference Hamilton BE, Ventura SJ. Fertility and abortion rates in the United States, 1960–2002. Int J Androl. 2006;29:34–45.PubMedCrossRef Hamilton BE, Ventura SJ. Fertility and abortion rates in the United States, 1960–2002. Int J Androl. 2006;29:34–45.PubMedCrossRef
5.
go back to reference Schoen R, Canudas-Romo V. Timing effects on first marriage: twentieth-century experience in England and Wales and the USA. Popul Stud (Camb). 2005;59:135–46.CrossRef Schoen R, Canudas-Romo V. Timing effects on first marriage: twentieth-century experience in England and Wales and the USA. Popul Stud (Camb). 2005;59:135–46.CrossRef
6.
go back to reference van Tetering EA, van Dessel HJHM, Mol BWJ. Evidence-based reproductive medicine in clinical practice: the case of clomiphene-resistant PCOS. Eur Clinics Obstet Gynecol. 2005;1(2):89–94.CrossRef van Tetering EA, van Dessel HJHM, Mol BWJ. Evidence-based reproductive medicine in clinical practice: the case of clomiphene-resistant PCOS. Eur Clinics Obstet Gynecol. 2005;1(2):89–94.CrossRef
7.
go back to reference Evidence-based Medicine Working Group. Evidence-based medicine: a new approach to teaching the practice of medicine. JAMA. 1992;268:2420–5.CrossRef Evidence-based Medicine Working Group. Evidence-based medicine: a new approach to teaching the practice of medicine. JAMA. 1992;268:2420–5.CrossRef
8.
go back to reference Davidoff F, Haynes B, Sackett D, Smith R. Evidence based medicine: a new journal to help doctors identify the information they need. BMJ. 1995;310:1085–6.PubMedCrossRef Davidoff F, Haynes B, Sackett D, Smith R. Evidence based medicine: a new journal to help doctors identify the information they need. BMJ. 1995;310:1085–6.PubMedCrossRef
9.
go back to reference Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. BMJ. 1996;312:71–2.PubMedCrossRef Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. BMJ. 1996;312:71–2.PubMedCrossRef
10.
go back to reference Coomarasamy A, Khan KS. What is the evidence that postgraduate teaching in EBM changes anything? A systematic review. BMJ. 2004;329:1017.PubMedCrossRef Coomarasamy A, Khan KS. What is the evidence that postgraduate teaching in EBM changes anything? A systematic review. BMJ. 2004;329:1017.PubMedCrossRef
11.
go back to reference Keus F, Wetterslev J, Gluud C, van Laarhoven CJ. Evidence at a glance: error matrix approach for overviewing available evidence. BMC Med Res Methodol. 2010;10:90.PubMedCrossRef Keus F, Wetterslev J, Gluud C, van Laarhoven CJ. Evidence at a glance: error matrix approach for overviewing available evidence. BMC Med Res Methodol. 2010;10:90.PubMedCrossRef
12.
go back to reference Higgins JPT, Green S. Cochrane handbook for systematic reviews of interventions. The Cochrane Collaboration. 2008. Higgins JPT, Green S. Cochrane handbook for systematic reviews of interventions. The Cochrane Collaboration. 2008.
13.
go back to reference Pocock SJ, Hughes MD, Lee RJ. Statistical problems in the reporting of clinical trials—a survey of three medical journals. N Engl J Med. 1987;317:426–32.PubMedCrossRef Pocock SJ, Hughes MD, Lee RJ. Statistical problems in the reporting of clinical trials—a survey of three medical journals. N Engl J Med. 1987;317:426–32.PubMedCrossRef
14.
go back to reference Porter AM. Misuse of correlation and regression in three medical journals. J Roy Soc Med. 1999;92:123–8.PubMed Porter AM. Misuse of correlation and regression in three medical journals. J Roy Soc Med. 1999;92:123–8.PubMed
15.
go back to reference Strasak AM, Zaman Q, Pfeiffer KP, Göbel G, Ulmer H. Statistical errors in medical research—a review of common pitfalls. Swiss Med Wkly. 2007;137:44–9.PubMed Strasak AM, Zaman Q, Pfeiffer KP, Göbel G, Ulmer H. Statistical errors in medical research—a review of common pitfalls. Swiss Med Wkly. 2007;137:44–9.PubMed
16.
go back to reference Cox DR, Reid N. The theory of the design of experiments. London: Chapman & Hall/CRC; 2000. Cox DR, Reid N. The theory of the design of experiments. London: Chapman & Hall/CRC; 2000.
17.
go back to reference Rothman KJ, Greenland S, Lash TL. Modern epidemiology. 3rd ed. New York: Lippincott Williams & Wilkins; 2008. Rothman KJ, Greenland S, Lash TL. Modern epidemiology. 3rd ed. New York: Lippincott Williams & Wilkins; 2008.
18.
go back to reference ICH E9 Expert Working Group. Statistical principles for clinical trials. Stat Med 1999;18:1905–42. ICH E9 Expert Working Group. Statistical principles for clinical trials. Stat Med 1999;18:1905–42.
19.
go back to reference Altman DG. Statistics and ethics in medical research: misuse of statistics is unethical. BMJ. 1980;281:1267–9.PubMedCrossRef Altman DG. Statistics and ethics in medical research: misuse of statistics is unethical. BMJ. 1980;281:1267–9.PubMedCrossRef
20.
go back to reference Gardenier JS, Resnik DB. The misuse of statistics: concepts, tools, and a research agenda. Acc Res. 2002;9:65–74. Gardenier JS, Resnik DB. The misuse of statistics: concepts, tools, and a research agenda. Acc Res. 2002;9:65–74.
21.
go back to reference Elandt-Johnson RC. Definition of rates: some remarks on their use and misuse. Am J Epidemiol. 1975;102(4):267–71.PubMed Elandt-Johnson RC. Definition of rates: some remarks on their use and misuse. Am J Epidemiol. 1975;102(4):267–71.PubMed
22.
23.
go back to reference Aschengrau A, Seage G. Essentials of epidemiology in public health. 2nd ed. Sudbury: Jones and Bartlett Publishers, Inc; 2008. Aschengrau A, Seage G. Essentials of epidemiology in public health. 2nd ed. Sudbury: Jones and Bartlett Publishers, Inc; 2008.
24.
go back to reference Tur-Kaspa I, Yuval Y, Bider D, Levron J, Shulman A, Dor J. Difficult or repeated sequential embryo transfers do not adversely affect in-vitro fertilization pregnancy rates or outcome. Hum Reprod. 1998;13:2452–5.PubMedCrossRef Tur-Kaspa I, Yuval Y, Bider D, Levron J, Shulman A, Dor J. Difficult or repeated sequential embryo transfers do not adversely affect in-vitro fertilization pregnancy rates or outcome. Hum Reprod. 1998;13:2452–5.PubMedCrossRef
25.
go back to reference Hearns-Stokes RM, Miller BT, Scott L, Creuss D, Chakraborty PK, Segars JH. Pregnancy rates after embryo transfer depend on the provider at embryo transfer. Fertil Steril. 2000;74(1):80–6.PubMedCrossRef Hearns-Stokes RM, Miller BT, Scott L, Creuss D, Chakraborty PK, Segars JH. Pregnancy rates after embryo transfer depend on the provider at embryo transfer. Fertil Steril. 2000;74(1):80–6.PubMedCrossRef
26.
go back to reference Yule GU. Notes on the theory of association of attributes in statistics. Biometrika. 1903;2(2):121–34.CrossRef Yule GU. Notes on the theory of association of attributes in statistics. Biometrika. 1903;2(2):121–34.CrossRef
27.
go back to reference Simpson EH. The interpretation of interaction in contingency tables. J Roy Stat Soc B. 1951;13:238–41. Simpson EH. The interpretation of interaction in contingency tables. J Roy Stat Soc B. 1951;13:238–41.
28.
go back to reference Appleton DR, French JM, Vanderpump MPJ. Ignoring a covariate: an example of Simpson’s paradox. Am Stat. 1996;50(44):340–1.CrossRef Appleton DR, French JM, Vanderpump MPJ. Ignoring a covariate: an example of Simpson’s paradox. Am Stat. 1996;50(44):340–1.CrossRef
29.
30.
31.
go back to reference Reintjes R, de Boer A, van Pelt W, Mintjes-de Groot J. Simpson’s paradox: an example from hospital epidemiology. Epidemiology. 2000;11(1):81–3.PubMedCrossRef Reintjes R, de Boer A, van Pelt W, Mintjes-de Groot J. Simpson’s paradox: an example from hospital epidemiology. Epidemiology. 2000;11(1):81–3.PubMedCrossRef
32.
go back to reference Neutel CI. The potential for Simpson’s paradox in drug utilization studies. Ann Epidemiol. 1997;7:517–21.PubMedCrossRef Neutel CI. The potential for Simpson’s paradox in drug utilization studies. Ann Epidemiol. 1997;7:517–21.PubMedCrossRef
34.
35.
go back to reference Finer LB, Henshaw SK, Finer LB, Henshaw SK. Disparities in rates of unintended pregnancy in the United States, 1994 and 2001. Perspect Sex Repro H. 2006;38(2):90–6.CrossRef Finer LB, Henshaw SK, Finer LB, Henshaw SK. Disparities in rates of unintended pregnancy in the United States, 1994 and 2001. Perspect Sex Repro H. 2006;38(2):90–6.CrossRef
36.
go back to reference Bateman BT, Simpson LL. Higher rate of stillbirth at the extremes of reproductive age: a large nationwide sample of deliveries in the United States. Am J Obstet Gynecol. 2006;194(3):840–5.PubMedCrossRef Bateman BT, Simpson LL. Higher rate of stillbirth at the extremes of reproductive age: a large nationwide sample of deliveries in the United States. Am J Obstet Gynecol. 2006;194(3):840–5.PubMedCrossRef
37.
go back to reference Altman DG, Deeks JJ. Meta-analysis, Simpson’s paradox, and the number needed to treat. BMC Med Res Methodol. 2002;2:3.PubMedCrossRef Altman DG, Deeks JJ. Meta-analysis, Simpson’s paradox, and the number needed to treat. BMC Med Res Methodol. 2002;2:3.PubMedCrossRef
38.
go back to reference Cates CJ. Simpson’s paradox and calculation of number needed to treat from meta-analysis. BMC Med Res Methodol. 2002;2:1. Cates CJ. Simpson’s paradox and calculation of number needed to treat from meta-analysis. BMC Med Res Methodol. 2002;2:1.
39.
go back to reference Rücker G, Schumacher M. Simpson’s paradox visualized: the example of the rosiglitazone meta-analysis. BMC Med Res Methodol. 2008;8:34.PubMedCrossRef Rücker G, Schumacher M. Simpson’s paradox visualized: the example of the rosiglitazone meta-analysis. BMC Med Res Methodol. 2008;8:34.PubMedCrossRef
40.
go back to reference Howell DC. Fundamental statistics for the behavioral sciences. 6th ed. Belmont: Wadsworth; 2008. Howell DC. Fundamental statistics for the behavioral sciences. 6th ed. Belmont: Wadsworth; 2008.
41.
go back to reference Ercan I, Yazici B, Yang Y. Misusage of statistics in medical research. Eur J Gen Med. 2007;4:128–34. Ercan I, Yazici B, Yang Y. Misusage of statistics in medical research. Eur J Gen Med. 2007;4:128–34.
42.
43.
go back to reference Rao CR. Linear statistical inference and its applications. 2nd ed. New York: Wiley; 1973.CrossRef Rao CR. Linear statistical inference and its applications. 2nd ed. New York: Wiley; 1973.CrossRef
44.
go back to reference Quinn GP, Keough MJ. Experimental design and data analysis for biologists. Cambridge: Cambridge University Press; 2002. Quinn GP, Keough MJ. Experimental design and data analysis for biologists. Cambridge: Cambridge University Press; 2002.
45.
go back to reference Tukey JW. Exploratory data analysis. MA: Addison-Wesley; 1977. Tukey JW. Exploratory data analysis. MA: Addison-Wesley; 1977.
46.
go back to reference Theus M, Urbanek S. Interactive graphics for data analysis: principles and examples. Boca Raton: CRC Press; 2008. Theus M, Urbanek S. Interactive graphics for data analysis: principles and examples. Boca Raton: CRC Press; 2008.
47.
go back to reference Barnett V, Lewis T. Outliers in statistical data. 3rd ed. NY: Wiley; 1994. Barnett V, Lewis T. Outliers in statistical data. 3rd ed. NY: Wiley; 1994.
48.
go back to reference Rousseeuw PJ, Leroy AM. Robust regression and outlier detection. NY: Wiley; 1987.CrossRef Rousseeuw PJ, Leroy AM. Robust regression and outlier detection. NY: Wiley; 1987.CrossRef
49.
go back to reference Grubbs FE. Procedures for detecting outlying observations in samples. Technometrics. 1969;11:1–21.CrossRef Grubbs FE. Procedures for detecting outlying observations in samples. Technometrics. 1969;11:1–21.CrossRef
50.
go back to reference Iglewicz B, Hoaglin DC. How to detect and handle outliers. Milwaukee: American Society for Quality Control; 1993. Iglewicz B, Hoaglin DC. How to detect and handle outliers. Milwaukee: American Society for Quality Control; 1993.
51.
go back to reference Dean RB, Dixon WJ. Simplified statistics for small numbers of observations. Anal Chem. 1951;23(4):636–8.CrossRef Dean RB, Dixon WJ. Simplified statistics for small numbers of observations. Anal Chem. 1951;23(4):636–8.CrossRef
52.
go back to reference Altman DG. Practical statistics for medical research. London: Chapman and Hall; 1991. Altman DG. Practical statistics for medical research. London: Chapman and Hall; 1991.
53.
go back to reference Conover WJ. Practical nonparametric statistics. 2nd ed. NY: Wiley; 1971. Conover WJ. Practical nonparametric statistics. 2nd ed. NY: Wiley; 1971.
54.
go back to reference Armitage P, Berry G. Statistical methods in medical research. 3rd ed. NY: Blackwell Science; 1994. Armitage P, Berry G. Statistical methods in medical research. 3rd ed. NY: Blackwell Science; 1994.
55.
go back to reference Hollander M, Wolfe DA. Nonparametric statistical methods. 2nd ed. NY: Wiley-Interscience; 1999. Hollander M, Wolfe DA. Nonparametric statistical methods. 2nd ed. NY: Wiley-Interscience; 1999.
56.
57.
go back to reference Altman DG, Bland JM. Improving doctors’ understanding of statistics. J Roy Stat Soc A. 1991;154:223–67.CrossRef Altman DG, Bland JM. Improving doctors’ understanding of statistics. J Roy Stat Soc A. 1991;154:223–67.CrossRef
58.
go back to reference Emerson JD, Colditz GA. Use of statistical analysis in New England Journal of Medicine. N Engl J Med. 1983;309:709–13.PubMedCrossRef Emerson JD, Colditz GA. Use of statistical analysis in New England Journal of Medicine. N Engl J Med. 1983;309:709–13.PubMedCrossRef
59.
go back to reference Emerson JD, Colditz GA. Use of statistical analysis in the New England Journal of Medicine. In: Bailar JC, MosteUer F, editors. Medical uses of statistics. 3rd ed. Boston: NEJM Books; 1992. p. 45–57. Emerson JD, Colditz GA. Use of statistical analysis in the New England Journal of Medicine. In: Bailar JC, MosteUer F, editors. Medical uses of statistics. 3rd ed. Boston: NEJM Books; 1992. p. 45–57.
60.
go back to reference Schwartz SJ, Sturr M, Goldberg G. Statistical methods in rehabilitation literature: a survey of recent publications. Arch Phys Med Rehabil. 1996;77:497–500.PubMedCrossRef Schwartz SJ, Sturr M, Goldberg G. Statistical methods in rehabilitation literature: a survey of recent publications. Arch Phys Med Rehabil. 1996;77:497–500.PubMedCrossRef
61.
go back to reference Wainapel SF, Kayne HL. Statistical methods in rehabilitation research. Arch Phys Med Rehabil. 1985;66:322–4.PubMedCrossRef Wainapel SF, Kayne HL. Statistical methods in rehabilitation research. Arch Phys Med Rehabil. 1985;66:322–4.PubMedCrossRef
62.
go back to reference Kurichi JE, Sonnad SS. Statistical methods in the surgical literature. J Am Coll Surg. 2006;202(3):476–84.PubMedCrossRef Kurichi JE, Sonnad SS. Statistical methods in the surgical literature. J Am Coll Surg. 2006;202(3):476–84.PubMedCrossRef
63.
go back to reference Avram MJ, Shanks CA, Dykes MH, et al. Statistical methods in anesthesia articles: an evaluation of two American journals during two six-month periods. Anesth Analg. 1985;64:607–11.PubMedCrossRef Avram MJ, Shanks CA, Dykes MH, et al. Statistical methods in anesthesia articles: an evaluation of two American journals during two six-month periods. Anesth Analg. 1985;64:607–11.PubMedCrossRef
64.
go back to reference Hokanson JA, Luttman DJ, Weiss GB. Frequency and diversity of use of statistical techniques in oncology journals. Cancer Treat Rep. 1986;7:589–94. Hokanson JA, Luttman DJ, Weiss GB. Frequency and diversity of use of statistical techniques in oncology journals. Cancer Treat Rep. 1986;7:589–94.
65.
go back to reference Goldin J, Zhu W, Sayre JW. A review of the statistical analysis used in papers published in Clinical Radiology and British Journal of Radiology. Clin Radiol. 1996;51:47–50.PubMedCrossRef Goldin J, Zhu W, Sayre JW. A review of the statistical analysis used in papers published in Clinical Radiology and British Journal of Radiology. Clin Radiol. 1996;51:47–50.PubMedCrossRef
66.
go back to reference Elster AD. Use of statistical analysis in the AJR and Radiology: frequency methods and subspecialty differences. Am J Roentgenol. 1994;163:711–5. Elster AD. Use of statistical analysis in the AJR and Radiology: frequency methods and subspecialty differences. Am J Roentgenol. 1994;163:711–5.
67.
go back to reference Huang W, LaBerge JM, Lu Y, Glidden DV. Research publications in vascular and interventional radiology: research topics, study designs, and statistical methods. J Vasc Interv Radiol. 2002;13:247–55.PubMedCrossRef Huang W, LaBerge JM, Lu Y, Glidden DV. Research publications in vascular and interventional radiology: research topics, study designs, and statistical methods. J Vasc Interv Radiol. 2002;13:247–55.PubMedCrossRef
68.
go back to reference Hayden GF. Biostatistical trends in pediatrics: implications for the future. Pediatrics. 1983;72:84–7.PubMed Hayden GF. Biostatistical trends in pediatrics: implications for the future. Pediatrics. 1983;72:84–7.PubMed
69.
go back to reference Cardiel MH, Goldsmith CH. Type of statistical techniques in rheumatology and internal medicine journals. Rev Invest Clin. 1995;47:197–201.PubMed Cardiel MH, Goldsmith CH. Type of statistical techniques in rheumatology and internal medicine journals. Rev Invest Clin. 1995;47:197–201.PubMed
70.
go back to reference Thomas T, Fahey T, Somerset M. The content and methodology of research papers published in three United Kingdom primary care journals. Br J Gen Pract. 1998;48:1229–32.PubMed Thomas T, Fahey T, Somerset M. The content and methodology of research papers published in three United Kingdom primary care journals. Br J Gen Pract. 1998;48:1229–32.PubMed
71.
go back to reference Rigby AS, Armstrong GK, Campbell MJ, Summerton N. A survey of statistics in three UK general practice journal. BMC Med Res Methodol. 2004;4(1):28.PubMedCrossRef Rigby AS, Armstrong GK, Campbell MJ, Summerton N. A survey of statistics in three UK general practice journal. BMC Med Res Methodol. 2004;4(1):28.PubMedCrossRef
72.
go back to reference Altman DG, Goodman SN. Transfer technology from statistical journals to the biomedical literature. Past trends and future predictions. JAMA. 1994;272:129–32.PubMedCrossRef Altman DG, Goodman SN. Transfer technology from statistical journals to the biomedical literature. Past trends and future predictions. JAMA. 1994;272:129–32.PubMedCrossRef
73.
Metadata
Title
Usefulness of statistics for establishing evidence-based reproductive medicine
Authors
Yasunori Sato
Masahiko Gosho
Kiyotaka Toshimori
Publication date
01-01-2012
Publisher
Springer Japan
Published in
Reproductive Medicine and Biology / Issue 1/2012
Print ISSN: 1445-5781
Electronic ISSN: 1447-0578
DOI
https://doi.org/10.1007/s12522-011-0106-5

Other articles of this Issue 1/2012

Reproductive Medicine and Biology 1/2012 Go to the issue