Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2006

Open Access 01-12-2006 | Correspondence

Country development and manuscript selection bias: a review of published studies

Authors: Reza Yousefi-Nooraie, Behnam Shakiba, Soroush Mortaz-Hejri

Published in: BMC Medical Research Methodology | Issue 1/2006

Login to get access

Abstract

Background

Manuscript selection bias is the selective publication of manuscripts based on study characteristics other than quality indicators. One reason may be a perceived editorial bias against the researches from less-developed world. We aimed to compare the methodological quality and statistical appeal of trials from countries with different development status and to determine their association with the journal impact factors and language of publication.

Methods

Selection criteria: Based on the World Bank income criteria countries were divided into four groups. All records of clinical trials conducted in each income group during 1993 and 2003 were included if they contained abstract and study sample size. Data sources: Cochrane Controlled Trials Register was searched and 50 articles selected from each income group using a systematic random sampling method in years 1993 and 2003 separately. Data extraction: Data were extracted by two reviewers on the language of publication, use of randomization, blinding, intention to treat analysis, study sample size and statistical significance. Disagreement was dealt with by consensus. Journal impact factors were obtained from the institute for scientific information.

Results

Four hundred records were explored. Country income had an inverse linear association with the presence of randomization (chi2 for trend = 5.6, p = 0.02) and a direct association with the use of blinding (chi2 for trend = 6.9, p = 0.008); although in low income countries the probability of blinding was increased from 36% in 1993 to 46% in 2003. In 1993 the results of 68% of high income trials and 64.7% of other groups were statistically significant; but in 2003 they were 66% and 82% respectively. Study sample size and income were the only significant predictors of journal impact factor.

Conclusion

The impact of country development on manuscript selection bias is considerable and may be increasing over time. It seems that one reason may be more stringent implementation of the guidelines for improving the reporting quality of trials on developing world researchers. Another reason may be the presumptions of the researchers from developing world about the editorial bias against their nationality.
Literature
1.
go back to reference Dickersin K, Olson CM, Rennie D, Cook D, Flanagin A, Zhu Q, Reiling J, Pace B: Association between time interval to publication and statistical significance. JAMA. 2002, 287: 2829-2831. 10.1001/jama.287.21.2829.CrossRefPubMed Dickersin K, Olson CM, Rennie D, Cook D, Flanagin A, Zhu Q, Reiling J, Pace B: Association between time interval to publication and statistical significance. JAMA. 2002, 287: 2829-2831. 10.1001/jama.287.21.2829.CrossRefPubMed
2.
go back to reference Dickersin K, Chan S, Chalmers TC, Sacks HS, Smith HJ: Publication bias and clinical trials. Control Clin Trials. 1987, 8: 343-353. 10.1016/0197-2456(87)90155-3.CrossRefPubMed Dickersin K, Chan S, Chalmers TC, Sacks HS, Smith HJ: Publication bias and clinical trials. Control Clin Trials. 1987, 8: 343-353. 10.1016/0197-2456(87)90155-3.CrossRefPubMed
3.
go back to reference Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR: Publication bias in clinical research. Lancet. 1991, 337: 867-872. 10.1016/0140-6736(91)90201-Y.CrossRefPubMed Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR: Publication bias in clinical research. Lancet. 1991, 337: 867-872. 10.1016/0140-6736(91)90201-Y.CrossRefPubMed
4.
go back to reference Patel V, Sumathipala A: International representation in psychiatric literature: survey of six leading journals. Br J Psychiatry. 2001, 178: 409-10.1192/bjp.178.5.406.CrossRef Patel V, Sumathipala A: International representation in psychiatric literature: survey of six leading journals. Br J Psychiatry. 2001, 178: 409-10.1192/bjp.178.5.406.CrossRef
5.
go back to reference Mendis S, Yach D, Bengoa R, Narvaez D, Zhang X: Research gap in cardiovascular disease in developing countries. Lancet. 2003, 361: 2246-2247. 10.1016/S0140-6736(03)13753-1.CrossRefPubMed Mendis S, Yach D, Bengoa R, Narvaez D, Zhang X: Research gap in cardiovascular disease in developing countries. Lancet. 2003, 361: 2246-2247. 10.1016/S0140-6736(03)13753-1.CrossRefPubMed
6.
go back to reference Yach D, Kenya P: Assessment of epidemiological and HIV/AIDS publications in Africa. Int J Epidemiol. 1992, 21: 557-60.CrossRefPubMed Yach D, Kenya P: Assessment of epidemiological and HIV/AIDS publications in Africa. Int J Epidemiol. 1992, 21: 557-60.CrossRefPubMed
7.
go back to reference Horton R: North and South: bridging the information gap. Lancet. 2000, 355: 2231-2236. 10.1016/S0140-6736(00)02414-4.CrossRefPubMed Horton R: North and South: bridging the information gap. Lancet. 2000, 355: 2231-2236. 10.1016/S0140-6736(00)02414-4.CrossRefPubMed
10.
go back to reference Thornton A, Lee P: Publication bias in meta-analysis: its causes and consequences. Journal of Clinical Epidemiology. 2000, 53: 207-216. 10.1016/S0895-4356(99)00161-4.CrossRefPubMed Thornton A, Lee P: Publication bias in meta-analysis: its causes and consequences. Journal of Clinical Epidemiology. 2000, 53: 207-216. 10.1016/S0895-4356(99)00161-4.CrossRefPubMed
11.
go back to reference Horton R: Medical journals: evidence of bias against the diseases of poverty. Lancet. 2003, 361: 713-713. 10.1016/S0140-6736(03)12666-9.CrossRef Horton R: Medical journals: evidence of bias against the diseases of poverty. Lancet. 2003, 361: 713-713. 10.1016/S0140-6736(03)12666-9.CrossRef
12.
go back to reference Keiser J, Utzinger J, Tanner M, Singer BH: Representation of authors and editors from countries with different human development indexes in the leading literature on tropical medicine: survey of current evidence. BMJ. 2004, 328: 1229-1232. 10.1136/bmj.38069.518137.F6.CrossRefPubMedPubMedCentral Keiser J, Utzinger J, Tanner M, Singer BH: Representation of authors and editors from countries with different human development indexes in the leading literature on tropical medicine: survey of current evidence. BMJ. 2004, 328: 1229-1232. 10.1136/bmj.38069.518137.F6.CrossRefPubMedPubMedCentral
13.
14.
go back to reference Olson CM, Rennie D, Cook D, Dickersin K, Flanagin A, Hogan JW, Zhu Q, Reiling J, Pace B: Publication bias in editorial decision making. JAMA. 2002, 287: 2825-2828. 10.1001/jama.287.21.2825.CrossRefPubMed Olson CM, Rennie D, Cook D, Dickersin K, Flanagin A, Hogan JW, Zhu Q, Reiling J, Pace B: Publication bias in editorial decision making. JAMA. 2002, 287: 2825-2828. 10.1001/jama.287.21.2825.CrossRefPubMed
16.
go back to reference Lee KP, Schotland M, Bacchetti P, Bero LA: Association of journal quality indicators with methodological quality of clinical research articles. JAMA. 2002, 287: 2805-2808. 10.1001/jama.287.21.2805.CrossRefPubMed Lee KP, Schotland M, Bacchetti P, Bero LA: Association of journal quality indicators with methodological quality of clinical research articles. JAMA. 2002, 287: 2805-2808. 10.1001/jama.287.21.2805.CrossRefPubMed
17.
go back to reference Shields PG: Publication bias is a scientific problem with adverse ethical outcomes: the case for a section for null results. Cancer Epidemiol Biomarkers Prev. 2000, 9: 771-772.PubMed Shields PG: Publication bias is a scientific problem with adverse ethical outcomes: the case for a section for null results. Cancer Epidemiol Biomarkers Prev. 2000, 9: 771-772.PubMed
18.
go back to reference Mills E, Wu P, Gagnier J, Heels-Ansdell D, Montori VM: An analysis of general medical and specialist journals that endorse CONSORT found that reporting was not enforced consistently. j clin epidemiol. 2005, 58: 662-667. 10.1016/j.jclinepi.2005.01.004.CrossRefPubMed Mills E, Wu P, Gagnier J, Heels-Ansdell D, Montori VM: An analysis of general medical and specialist journals that endorse CONSORT found that reporting was not enforced consistently. j clin epidemiol. 2005, 58: 662-667. 10.1016/j.jclinepi.2005.01.004.CrossRefPubMed
19.
go back to reference Dickersin K, Manheimer E, Wieland S, Robinson KA, Lefebvre C, McDonald S, the CENTRAL Development Group: Development of the Cochrane Collaboration's CENTRAL Register of Controlled Clinical Trials. Evaluation and the Health Professions. 2002, 25: 38-64. 10.1177/0163278702025001004.CrossRefPubMed Dickersin K, Manheimer E, Wieland S, Robinson KA, Lefebvre C, McDonald S, the CENTRAL Development Group: Development of the Cochrane Collaboration's CENTRAL Register of Controlled Clinical Trials. Evaluation and the Health Professions. 2002, 25: 38-64. 10.1177/0163278702025001004.CrossRefPubMed
20.
go back to reference Nieminen P, Isohanni M: Bias against European journals in medical publication Databases. Lancet. 1999, 353: 1592-10.1016/S0140-6736(99)00415-8.CrossRefPubMed Nieminen P, Isohanni M: Bias against European journals in medical publication Databases. Lancet. 1999, 353: 1592-10.1016/S0140-6736(99)00415-8.CrossRefPubMed
Metadata
Title
Country development and manuscript selection bias: a review of published studies
Authors
Reza Yousefi-Nooraie
Behnam Shakiba
Soroush Mortaz-Hejri
Publication date
01-12-2006
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2006
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-6-37

Other articles of this Issue 1/2006

BMC Medical Research Methodology 1/2006 Go to the issue