Skip to main content
Top
Published in: Trials 1/2017

Open Access 01-12-2017 | Review

Avoidable waste related to inadequate methods and incomplete reporting of interventions: a systematic review of randomized trials performed in Sub-Saharan Africa

Authors: Lee Aymar Ndounga Diakou, Francine Ntoumi, Philippe Ravaud, Isabelle Boutron

Published in: Trials | Issue 1/2017

Login to get access

Abstract

Background

Randomized controlled trials (RCTs) are needed to improve health care in Sub-Saharan Africa (SSA). However, inadequate methods and incomplete reporting of interventions can prevent the transposition of research in practice which leads waste of research. The aim of this systematic review was to assess the avoidable waste in research related to inadequate methods and incomplete reporting of interventions in RCTs performed in SSA.

Methods

We performed a methodological systematic review of RCTs performed in SSA and published between 1 January 2014 and 31 March 2015. We searched PubMed, the Cochrane library and the African Index Medicus to identify reports. We assessed the risk of bias using the Cochrane Risk of Bias tool, and for each risk of bias item, determined whether easy adjustments with no or minor cost could change the domain to low risk of bias. The reporting of interventions was assessed by using standardized checklists based on the Consolidated Standards for Reporting Trials, and core items of the Template for Intervention Description and Replication. Corresponding authors of reports with incomplete reporting of interventions were contacted to obtain additional information. Data were descriptively analyzed.

Results

Among 121 RCTs selected, 74 (61%) evaluated pharmacological treatments (PTs), including drugs and nutritional supplements; and 47 (39%) nonpharmacological treatments (NPTs) (40 participative interventions, 1 surgical procedure, 3 medical devices and 3 therapeutic strategies). Overall, the randomization sequence was adequately generated in 76 reports (62%) and the intervention allocation concealed in 48 (39%). The primary outcome was described as blinded in 46 reports (38%), and incomplete outcome data were adequately addressed in 78 (64%). Applying easy methodological adjustments with no or minor additional cost to trials with at least one domain at high risk of bias could have reduced the number of domains at high risk for 24 RCTs (19%). Interventions were completely reported for 73/121 (60%) RCTs: 51/74 (68%) of PTs and 22/47 (46%) of NPTs. Additional information was obtained from corresponding authors for 11/48 reports (22%).

Conclusion

Inadequate methods and incomplete reporting of published SSA RCTs could be improved by easy and inexpensive methodological adjustments and adherence to reporting guidelines.
Appendix
Available only for authorised users
Literature
1.
go back to reference Naghavi M, Wang H, Lozano R, et al. Global, regional, and national age-sex specific all-cause and cause-specific mortality for 240 causes of death, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2015;385(9963):117–71.CrossRef Naghavi M, Wang H, Lozano R, et al. Global, regional, and national age-sex specific all-cause and cause-specific mortality for 240 causes of death, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2015;385(9963):117–71.CrossRef
2.
go back to reference Mensah GA, Roth GA, Sampson UK, Moran AE, Feigin VL, Forouzanfar MH, Naghavi M, Murray CJ, GBD 2013 Mortality and Causes of Death collaborators. Mortality from cardiovascular diseases in sub-Saharan Africa, 1990–2013: a systematic analysis of data from the Global Burden of Disease Study 2013. Cardiovasc J Afr. 2015;26(2 Suppl 1):S6–10.CrossRefPubMedPubMedCentral Mensah GA, Roth GA, Sampson UK, Moran AE, Feigin VL, Forouzanfar MH, Naghavi M, Murray CJ, GBD 2013 Mortality and Causes of Death collaborators. Mortality from cardiovascular diseases in sub-Saharan Africa, 1990–2013: a systematic analysis of data from the Global Burden of Disease Study 2013. Cardiovasc J Afr. 2015;26(2 Suppl 1):S6–10.CrossRefPubMedPubMedCentral
3.
go back to reference Rothwell PM. External validity of randomised controlled trials: “to whom do the results of this trial apply?”. Lancet. 2005;365(9453):82–93.CrossRefPubMed Rothwell PM. External validity of randomised controlled trials: “to whom do the results of this trial apply?”. Lancet. 2005;365(9453):82–93.CrossRefPubMed
4.
go back to reference Burchett HE, Dobrow MJ, Lavis JN, Mayhew SH. The applicability and transferability of public health research from one setting to another: a survey of maternal health researchers. Glob Health Promot. 2013;20(1):16–24. doi:10.1177/1757975913476904.CrossRefPubMed Burchett HE, Dobrow MJ, Lavis JN, Mayhew SH. The applicability and transferability of public health research from one setting to another: a survey of maternal health researchers. Glob Health Promot. 2013;20(1):16–24. doi:10.​1177/​1757975913476904​.CrossRefPubMed
5.
go back to reference Garner P, Kale R, Dickson R, Dans T, Salinas R. Getting research findings into practice: implementing research findings in developing countries. BMJ. 1998;317(7157):531–5.CrossRefPubMedPubMedCentral Garner P, Kale R, Dickson R, Dans T, Salinas R. Getting research findings into practice: implementing research findings in developing countries. BMJ. 1998;317(7157):531–5.CrossRefPubMedPubMedCentral
6.
go back to reference Anglaret X, Scott CA, Walensky RP, Ouattara E, Losina E, Moh R, Becker JE, Uhler L, Danel C, Messou E, Eholié S, Freedberg KA. Could early antiretroviral therapy entail more risks than benefits in sub-Saharan African HIV-infected adults? A model-based analysis. Antivir Ther. 2013;18(1):45–55. doi:10.3851/IMP2231. Epub 2012 Jul 18.CrossRefPubMed Anglaret X, Scott CA, Walensky RP, Ouattara E, Losina E, Moh R, Becker JE, Uhler L, Danel C, Messou E, Eholié S, Freedberg KA. Could early antiretroviral therapy entail more risks than benefits in sub-Saharan African HIV-infected adults? A model-based analysis. Antivir Ther. 2013;18(1):45–55. doi:10.​3851/​IMP2231. Epub 2012 Jul 18.CrossRefPubMed
7.
go back to reference Seyler C, Adjé-Touré C, Messou E, Dakoury-Dogbo N, Rouet F, Gabillard D, Nolan M, Toure S, Anglaret X. Impact of genotypic drug resistance mutations on clinical and immunological outcomes in HIV-infected adults on HAART in West Africa. AIDS. 2007;21(9):1157–64.CrossRefPubMedPubMedCentral Seyler C, Adjé-Touré C, Messou E, Dakoury-Dogbo N, Rouet F, Gabillard D, Nolan M, Toure S, Anglaret X. Impact of genotypic drug resistance mutations on clinical and immunological outcomes in HIV-infected adults on HAART in West Africa. AIDS. 2007;21(9):1157–64.CrossRefPubMedPubMedCentral
9.
go back to reference Yordanov Y, Dechartres A, Porcher R, Boutron I, Altman DG, Ravaud P. Avoidable waste of research related to inadequate methods in clinical trials. BMJ. 2015;350:h809.CrossRefPubMedPubMedCentral Yordanov Y, Dechartres A, Porcher R, Boutron I, Altman DG, Ravaud P. Avoidable waste of research related to inadequate methods in clinical trials. BMJ. 2015;350:h809.CrossRefPubMedPubMedCentral
10.
11.
go back to reference Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, Michie S, Moher D, Wager E. Reducing waste from incomplete or unusable reports of biomedical research. Lancet. 2014;383(9913):267–76.CrossRefPubMed Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, Michie S, Moher D, Wager E. Reducing waste from incomplete or unusable reports of biomedical research. Lancet. 2014;383(9913):267–76.CrossRefPubMed
12.
go back to reference Ndounga Diakou LA, Francine Ntoumi, Philippe Ravaud, Isabelle Boutron. Published randomized trials performed in Sub-Saharan Africa focus on high burden diseases but are frequently funded and led by high income countries. J Clin Epidemiol. 2016. doi:10.1016/j.jclinepi.2016.10.008. Ndounga Diakou LA, Francine Ntoumi, Philippe Ravaud, Isabelle Boutron. Published randomized trials performed in Sub-Saharan Africa focus on high burden diseases but are frequently funded and led by high income countries. J Clin Epidemiol. 2016. doi:10.​1016/​j.​jclinepi.​2016.​10.​008.
14.
go back to reference Glanville JM, Lefebvre C, Miles JN, Camosso-Stefinovic J. How to identify randomized controlled trials in MEDLINE: ten years on. J Med Libr Assoc. 2006;94(2):130–6.PubMedPubMedCentral Glanville JM, Lefebvre C, Miles JN, Camosso-Stefinovic J. How to identify randomized controlled trials in MEDLINE: ten years on. J Med Libr Assoc. 2006;94(2):130–6.PubMedPubMedCentral
15.
go back to reference Pienaar E, Grobler L, Busgeeth K, Eisinga A, Siegfried N. Developing a geographic search filter to identify randomized controlled trials in Africa: finding the optimal balance between sensitivity and precision. Health Info Libr J. 2011;28(3):210–5.CrossRefPubMed Pienaar E, Grobler L, Busgeeth K, Eisinga A, Siegfried N. Developing a geographic search filter to identify randomized controlled trials in Africa: finding the optimal balance between sensitivity and precision. Health Info Libr J. 2011;28(3):210–5.CrossRefPubMed
16.
go back to reference Atani M, Kabore MP. African Index Medicus: improving access to African health information. SA Fam Pract. 2007;49(2):4–7. Atani M, Kabore MP. African Index Medicus: improving access to African health information. SA Fam Pract. 2007;49(2):4–7.
17.
go back to reference Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savovic J, Schulz KF, Weeks L, Sterne JA, Cochrane Bias Methods Group, Cochrane Statistical Methods Group. The Cochrane Collaboration’s tool for assessing risk of bias in randomized trials. BMJ. 2011;343:d5928.CrossRefPubMedPubMedCentral Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savovic J, Schulz KF, Weeks L, Sterne JA, Cochrane Bias Methods Group, Cochrane Statistical Methods Group. The Cochrane Collaboration’s tool for assessing risk of bias in randomized trials. BMJ. 2011;343:d5928.CrossRefPubMedPubMedCentral
18.
go back to reference Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.0 [updated February 2008]. The Cochrane Collaboration; 2008. Available from www.cochrane-handbook.org. Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.0 [updated February 2008]. The Cochrane Collaboration; 2008. Available from www.​cochrane-handbook.​org.
19.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.CrossRefPubMedPubMedCentral Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.CrossRefPubMedPubMedCentral
20.
go back to reference Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P, CONSORT Group. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008;148(4):295–309.CrossRefPubMed Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P, CONSORT Group. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008;148(4):295–309.CrossRefPubMed
21.
go back to reference Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, Altman DG, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.CrossRefPubMed Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, Altman DG, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687.CrossRefPubMed
22.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, Medical Research Council Guidance. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.CrossRefPubMedPubMedCentral Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, Medical Research Council Guidance. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.CrossRefPubMedPubMedCentral
23.
go back to reference Isaakidis P, Ioannidis JPA. Evaluation of cluster randomized controlled trials in Sub-Saharan Africa. Am J Epidemiol. 2003;158:921–6.CrossRefPubMed Isaakidis P, Ioannidis JPA. Evaluation of cluster randomized controlled trials in Sub-Saharan Africa. Am J Epidemiol. 2003;158:921–6.CrossRefPubMed
24.
go back to reference Siegfried N, Clarke M, Volmink J, Van der Merwe L. African HIV/AIDS trials are more likely to report adequate allocation concealment and random generation than North American trials. PLoS One. 2008;3(10):e3491.CrossRefPubMedPubMedCentral Siegfried N, Clarke M, Volmink J, Van der Merwe L. African HIV/AIDS trials are more likely to report adequate allocation concealment and random generation than North American trials. PLoS One. 2008;3(10):e3491.CrossRefPubMedPubMedCentral
26.
go back to reference Lutje V, Gerritsen A, Siegfried N. Randomized controlled trials of malaria intervention trials in Africa, 1948 to 2007: a descriptive analysis. Malar J. 2011;10:61.CrossRefPubMedPubMedCentral Lutje V, Gerritsen A, Siegfried N. Randomized controlled trials of malaria intervention trials in Africa, 1948 to 2007: a descriptive analysis. Malar J. 2011;10:61.CrossRefPubMedPubMedCentral
27.
go back to reference Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG. The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010;340:c723.CrossRefPubMedPubMedCentral Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG. The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010;340:c723.CrossRefPubMedPubMedCentral
28.
go back to reference Dechartres A, Charles P, Hopewell S, Ravaud P, Altman DG. Reviews assessing the quality or the reporting of randomized controlled trials are increasing over time but raised questions about how quality is assessed. J Clin Epidemiol. 2011;64(2):136–44. doi:10.1016/j.jclinepi.2010.04.015.CrossRefPubMed Dechartres A, Charles P, Hopewell S, Ravaud P, Altman DG. Reviews assessing the quality or the reporting of randomized controlled trials are increasing over time but raised questions about how quality is assessed. J Clin Epidemiol. 2011;64(2):136–44. doi:10.​1016/​j.​jclinepi.​2010.​04.​015.CrossRefPubMed
29.
go back to reference Hoffmann TC, Erueti C, Glasziou PP. Poor description of non-pharmacological interventions: analysis of consecutive sample of randomized trials. BMJ. 2013;347:f3755.CrossRefPubMedPubMedCentral Hoffmann TC, Erueti C, Glasziou PP. Poor description of non-pharmacological interventions: analysis of consecutive sample of randomized trials. BMJ. 2013;347:f3755.CrossRefPubMedPubMedCentral
30.
go back to reference Schroter S, Glasziou P, Heneghan C. Quality of descriptions of treatments: a review of published randomised controlled trials. BMJ Open. 2012;2:6.CrossRef Schroter S, Glasziou P, Heneghan C. Quality of descriptions of treatments: a review of published randomised controlled trials. BMJ Open. 2012;2:6.CrossRef
31.
go back to reference Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I. Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006;185(5):263–7.PubMed Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I. Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006;185(5):263–7.PubMed
32.
go back to reference Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, Dias S, Schulz KF, Plint AC, Moher D. Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database Syst Rev. 2012;11:MR000030.PubMed Turner L, Shamseer L, Altman DG, Weeks L, Peters J, Kober T, Dias S, Schulz KF, Plint AC, Moher D. Consolidated standards of reporting trials (CONSORT) and the completeness of reporting of randomised controlled trials (RCTs) published in medical journals. Cochrane Database Syst Rev. 2012;11:MR000030.PubMed
33.
go back to reference To MJ, Jones J, Emara M, Jadad AR. Are reports of randomized controlled trials improving over time? A systematic review of 284 articles published in high-impact general and specialized medical journals. PLoS One. 2013;8(12):e84779.CrossRefPubMedPubMedCentral To MJ, Jones J, Emara M, Jadad AR. Are reports of randomized controlled trials improving over time? A systematic review of 284 articles published in high-impact general and specialized medical journals. PLoS One. 2013;8(12):e84779.CrossRefPubMedPubMedCentral
34.
go back to reference Hopewell S, Altman DG, Moher D, Schulz KF. Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal “Instructions to Authors.”. Trials. 2008;9:20.CrossRefPubMedPubMedCentral Hopewell S, Altman DG, Moher D, Schulz KF. Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal “Instructions to Authors.”. Trials. 2008;9:20.CrossRefPubMedPubMedCentral
35.
36.
go back to reference Nagendran M, Harding D, Teo W, Camm C, Maruthappu M, McCulloch P, Hopewell S. Poor adherence of randomised trials in surgery to CONSORT guidelines for non-pharmacological treatments (NPT): a cross-sectional study. BMJ Open. 2013;3(12):e003898.CrossRefPubMedPubMedCentral Nagendran M, Harding D, Teo W, Camm C, Maruthappu M, McCulloch P, Hopewell S. Poor adherence of randomised trials in surgery to CONSORT guidelines for non-pharmacological treatments (NPT): a cross-sectional study. BMJ Open. 2013;3(12):e003898.CrossRefPubMedPubMedCentral
37.
go back to reference Barnes C, Boutron I, Giraudeau B, Porcher R, Altman DG, Ravaud P. Impact of an online writing aid tool for writing a randomized trial report: the COBWEB (Consort-based WEB tool) randomized controlled trial. BMC Med. 2015;13:221.CrossRefPubMedPubMedCentral Barnes C, Boutron I, Giraudeau B, Porcher R, Altman DG, Ravaud P. Impact of an online writing aid tool for writing a randomized trial report: the COBWEB (Consort-based WEB tool) randomized controlled trial. BMC Med. 2015;13:221.CrossRefPubMedPubMedCentral
39.
go back to reference Ioannidis JP, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, Schulz KF, Tibshirani R. Increasing value and reducing waste in research design, conduct, and analysis. Lancet. 2014;383(9912):166–75.CrossRefPubMedPubMedCentral Ioannidis JP, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, Schulz KF, Tibshirani R. Increasing value and reducing waste in research design, conduct, and analysis. Lancet. 2014;383(9912):166–75.CrossRefPubMedPubMedCentral
Metadata
Title
Avoidable waste related to inadequate methods and incomplete reporting of interventions: a systematic review of randomized trials performed in Sub-Saharan Africa
Authors
Lee Aymar Ndounga Diakou
Francine Ntoumi
Philippe Ravaud
Isabelle Boutron
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Trials / Issue 1/2017
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-017-2034-0

Other articles of this Issue 1/2017

Trials 1/2017 Go to the issue