Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2020

Open Access 01-12-2020 | Public Health | Research article

Quality of evidence in a post-Soviet country: evaluation of methodological quality of controlled clinical trials published in national journals from Uzbekistan

Authors: Timur Aripov, Dilfuza Aniyozova, Irina Gorbunova

Published in: BMC Medical Research Methodology | Issue 1/2020

Login to get access

Abstract

Background

Most researchers in Uzbekistan prefer to publish their reports in journals of their home country. Moreover, the proportion of healthcare practitioners who prefer to use these national sources of information also remains high. However, the quality of publications from national journals, in post-Soviet countries, has not been systematically evaluated until now. The primary objective of this study was to evaluate the quality of randomized controlled trials’ (RCTs) reports published in medical journals from Uzbekistan. We supposed that reports had at least minimal quality to contribute to the higher quality of healthcare.

Methods

To evaluate the quality of RCTs, we selected two journals from the list of national medical journals for which background information was provided. We decided to select articles from journals that had the highest subscription rate and were likely to have the highest impact on clinical decisions. The journals were Medical Journal of Uzbekistan and Paediatrics. Only issues published in 2007–2017 were considered for evaluation. Two evaluators independently scored RCTs and controlled clinical trials (CCTs) reported in the journals. The 5-point scale developed by Jadad et al. was used to evaluate the quality of reports. Consensus-based decision was made about the final score of each report.

Results

We reviewed 1311 studies in the two journals and found 380 clinical trials reports for the final evaluation. Our main finding was that none of the reports received a final score of more than 1, with an absolute agreement between evaluators. A median score of the studied reports was equal to 0, predicting a very low quality of controlled trials reported in the national journals (Wilcoxon signed-rank test p = 1.0; 95% CI = 0–0).

Conclusions

We believe that quality of reports about controlled trials, in Uzbekistan, can be considered insufficient to contribute to the higher quality of care and patients’ safety. In the worst case, such condition can cause serious damage to the public health and lead to ineffective use of resources in the country. Therefore, the better reporting and organization of RCTs and CCTs should become a main goal of all stakeholders interested in the effective and safe healthcare in the country.
Appendix
Available only for authorised users
Literature
1.
go back to reference Vlassov VV, Danishevskiy KD. Biomedical journals and databases in Russia and Russian language in the former Soviet Union and beyond. Emerg Themes Epidemiol. 2008;5:15.PubMedPubMedCentralCrossRef Vlassov VV, Danishevskiy KD. Biomedical journals and databases in Russia and Russian language in the former Soviet Union and beyond. Emerg Themes Epidemiol. 2008;5:15.PubMedPubMedCentralCrossRef
2.
go back to reference Adambekov S, Kaiyrlykyzy A, Igissinov N, et al. Health challenges in Kazakhstan and Central Asia. J Epidemiol Community Health. 2016;70(1):104–8.PubMedCrossRef Adambekov S, Kaiyrlykyzy A, Igissinov N, et al. Health challenges in Kazakhstan and Central Asia. J Epidemiol Community Health. 2016;70(1):104–8.PubMedCrossRef
3.
go back to reference Jargin SV. The state of medical libraries in the former Soviet Union. Health Inf Libr J. 2010;27(3):244–8.CrossRef Jargin SV. The state of medical libraries in the former Soviet Union. Health Inf Libr J. 2010;27(3):244–8.CrossRef
4.
go back to reference Asadov DA, Aripov TY. The quality of care in post-soviet Uzbekistan: are health reforms and international efforts succeeding? Public Health. 2009;123(11):725–8.PubMedCrossRef Asadov DA, Aripov TY. The quality of care in post-soviet Uzbekistan: are health reforms and international efforts succeeding? Public Health. 2009;123(11):725–8.PubMedCrossRef
5.
go back to reference Telen MJ. Teaching evidence-based medicine in the former Soviet Union: lessons learned. Trans Am Clin Climatol Assoc. 2014;125:88–102.PubMedPubMedCentral Telen MJ. Teaching evidence-based medicine in the former Soviet Union: lessons learned. Trans Am Clin Climatol Assoc. 2014;125:88–102.PubMedPubMedCentral
6.
go back to reference Verbitskaya EV. Meta-analysis: problems with Russian Publications. Int J Risk Saf Med. 2015;27(Suppl 1):S89–90.PubMedCrossRef Verbitskaya EV. Meta-analysis: problems with Russian Publications. Int J Risk Saf Med. 2015;27(Suppl 1):S89–90.PubMedCrossRef
7.
go back to reference Lewin S, Glenton C. Are we entering a new era for qualitative research? Using qualitative evidence to support guidance and guideline development by the World Health Organization. Int J Equity Health. 2018;17(1):126.PubMedPubMedCentralCrossRef Lewin S, Glenton C. Are we entering a new era for qualitative research? Using qualitative evidence to support guidance and guideline development by the World Health Organization. Int J Equity Health. 2018;17(1):126.PubMedPubMedCentralCrossRef
8.
go back to reference Adambekov S, Askarova S, Welburn SC, et al. Publication productivity in Central Asia and countries of the former Soviet Union. Cent Asian J Glob Health. 2016;5(1):261.PubMedPubMedCentral Adambekov S, Askarova S, Welburn SC, et al. Publication productivity in Central Asia and countries of the former Soviet Union. Cent Asian J Glob Health. 2016;5(1):261.PubMedPubMedCentral
9.
go back to reference Ahmedov M, Green J, Azimov R, et al. Addressing the challenges of improving primary care quality in Uzbekistan: a qualitative study of chronic heart failure management. Health Policy Plan. 2013;28(5):458–66.PubMedCrossRef Ahmedov M, Green J, Azimov R, et al. Addressing the challenges of improving primary care quality in Uzbekistan: a qualitative study of chronic heart failure management. Health Policy Plan. 2013;28(5):458–66.PubMedCrossRef
14.
go back to reference Jadad AR, Moore RA, Carroll D, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17(1):1–12.PubMedCrossRef Jadad AR, Moore RA, Carroll D, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17(1):1–12.PubMedCrossRef
15.
go back to reference Graham N, Haines T, Goldsmith CH, et al. Reliability of 3 assessment tools used to evaluate randomized controlled trials for treatment of neck pain. Spine. 2012;37(6):515–22.PubMedCrossRef Graham N, Haines T, Goldsmith CH, et al. Reliability of 3 assessment tools used to evaluate randomized controlled trials for treatment of neck pain. Spine. 2012;37(6):515–22.PubMedCrossRef
19.
go back to reference St-Louis E, Oosenbrug M, Landry T, et al. Enrollment and reporting practices in pediatric general surgical randomized clinical trials: a systematic review and observational analysis. J Pediatr Surg. 2018;53(5):879–84.PubMedCrossRef St-Louis E, Oosenbrug M, Landry T, et al. Enrollment and reporting practices in pediatric general surgical randomized clinical trials: a systematic review and observational analysis. J Pediatr Surg. 2018;53(5):879–84.PubMedCrossRef
20.
go back to reference Kim KS, Chung JH, Jo JK, et al. Quality of randomized controlled trials published in the international Urogynecology journal 2007-2016. Int Urogynecol J. 2018;29(7):1011–7.PubMedCrossRef Kim KS, Chung JH, Jo JK, et al. Quality of randomized controlled trials published in the international Urogynecology journal 2007-2016. Int Urogynecol J. 2018;29(7):1011–7.PubMedCrossRef
22.
go back to reference Gisev N, Bell JS, Chen TF. Interrater agreement and interrater reliability: key concepts, approaches, and applications. Res Soc Adm Pharm. 2013;9(3):330–8.CrossRef Gisev N, Bell JS, Chen TF. Interrater agreement and interrater reliability: key concepts, approaches, and applications. Res Soc Adm Pharm. 2013;9(3):330–8.CrossRef
23.
go back to reference McHugh ML. Interrater reliability: the kappa statistic. Biochem Med. 2012;22(3):276–82.CrossRef McHugh ML. Interrater reliability: the kappa statistic. Biochem Med. 2012;22(3):276–82.CrossRef
24.
go back to reference Flight L, Julious SA. The disagreeable behaviour of the kappa statistic. Pharm Stat. 2015;14(1):74–8.PubMedCrossRef Flight L, Julious SA. The disagreeable behaviour of the kappa statistic. Pharm Stat. 2015;14(1):74–8.PubMedCrossRef
25.
go back to reference Dechartres A, Trinquart L, Atal I, et al. Evolution of poor reporting and inadequate methods over time in 20 920 randomised controlled trials included in Cochrane reviews: research on research study. BMJ. 2017. https://doi.org/10.1136/bmj.j2490. Dechartres A, Trinquart L, Atal I, et al. Evolution of poor reporting and inadequate methods over time in 20 920 randomised controlled trials included in Cochrane reviews: research on research study. BMJ. 2017. https://​doi.​org/​10.​1136/​bmj.​j2490.
26.
go back to reference Reveiz L, Chapman E, Asial S, et al. Risk of bias of randomized trials over time. J Clin Epidemiol. 2015;68(9):1036–45.PubMedCrossRef Reveiz L, Chapman E, Asial S, et al. Risk of bias of randomized trials over time. J Clin Epidemiol. 2015;68(9):1036–45.PubMedCrossRef
27.
go back to reference Propadalo I, Tranfic M, Vuka I, et al. In Cochrane reviews, risk of bias assessments for allocation concealment were frequently not in line with Cochrane’s handbook guidance. J Clin Epidemiol. 2019;106:10–7.PubMedCrossRef Propadalo I, Tranfic M, Vuka I, et al. In Cochrane reviews, risk of bias assessments for allocation concealment were frequently not in line with Cochrane’s handbook guidance. J Clin Epidemiol. 2019;106:10–7.PubMedCrossRef
29.
go back to reference Dechartres A, Ravaud P, Atal I, et al. Association between trial registration and treatment effect estimates: a meta-epidemiological study. BMC Med. 2016;14(1):100.PubMedPubMedCentralCrossRef Dechartres A, Ravaud P, Atal I, et al. Association between trial registration and treatment effect estimates: a meta-epidemiological study. BMC Med. 2016;14(1):100.PubMedPubMedCentralCrossRef
34.
go back to reference Shamseer L, Hopewell S, Altman DG, et al. Update on the endorsement of CONSORT by high impact factor journals: a survey of journal “instructions to authors” in 2014. Trials. 2016;17(1):301.PubMedPubMedCentralCrossRef Shamseer L, Hopewell S, Altman DG, et al. Update on the endorsement of CONSORT by high impact factor journals: a survey of journal “instructions to authors” in 2014. Trials. 2016;17(1):301.PubMedPubMedCentralCrossRef
35.
36.
go back to reference Latronico N, Botteri M, Minelli C, et al. Quality of reporting of randomised controlled trials in the intensive care literature. A systematic analysis of papers published in intensive care medicine over 26 years. Intensive Care Med. 2002;28(9):1316–23.PubMedCrossRef Latronico N, Botteri M, Minelli C, et al. Quality of reporting of randomised controlled trials in the intensive care literature. A systematic analysis of papers published in intensive care medicine over 26 years. Intensive Care Med. 2002;28(9):1316–23.PubMedCrossRef
37.
go back to reference Clark HD, Wells GA, Huët C, et al. Assessing the quality of randomized trials: reliability of the Jadad scale. Control Clin Trials. 1999;20(5):448–52.PubMedCrossRef Clark HD, Wells GA, Huët C, et al. Assessing the quality of randomized trials: reliability of the Jadad scale. Control Clin Trials. 1999;20(5):448–52.PubMedCrossRef
Metadata
Title
Quality of evidence in a post-Soviet country: evaluation of methodological quality of controlled clinical trials published in national journals from Uzbekistan
Authors
Timur Aripov
Dilfuza Aniyozova
Irina Gorbunova
Publication date
01-12-2020
Publisher
BioMed Central
Keyword
Public Health
Published in
BMC Medical Research Methodology / Issue 1/2020
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-020-01076-x

Other articles of this Issue 1/2020

BMC Medical Research Methodology 1/2020 Go to the issue