Skip to main content
Top
Published in: Trials 1/2012

Open Access 01-12-2012 | Research

Quality of reporting of clinical non-inferiority and equivalence randomised trials - update and extension

Authors: Petra Schiller, Nicole Burchardi, Michael Niestroj, Meinhard Kieser

Published in: Trials | Issue 1/2012

Login to get access

Abstract

Background

Non-inferiority and equivalence trials require tailored methodology and therefore adequate conduct and reporting is an ambitious task. The aim of our review was to assess whether the criteria recommended by the CONSORT extension were followed.

Methods

We searched the Medline database and the Cochrane Central Register for reports of randomised non-inferiority and equivalence trials published in English language. We excluded reports on bioequivalence studies, reports targeting on other than the main results of a trial, and articles of which the full-text version was not available. In total, we identified 209 reports (167 non-inferiority, 42 equivalence trials) and assessed the reporting and methodological quality using abstracted items of the CONSORT extension.

Results

Half of the articles did not report on the method of randomisation and only a third of the trials were reported to use blinding. The non-inferiority or equivalence margin was defined in most reports (94%), but was justified only for a quarter of the trials. Sample size calculation was reported for a proportion of 90%, but the margin was taken into account in only 78% of the trials reported. Both intention-to-treat and per-protocol analysis were presented in less than half of the reports. When reporting the results, a confidence interval was given for 85% trials. A proportion of 21% of the reports presented a conclusion that was wrong or incomprehensible. Overall, we found a substantial lack of quality in reporting and conduct. The need to improve also applied to aspects generally recommended for randomised trials. The quality was partly better in high-impact journals as compared to others.

Conclusions

There are still important deficiencies in the reporting on the methodological approach as well as on results and interpretation even in high-impact journals. It seems to take more than guidelines to improve conduct and reporting of non-inferiority and equivalence trials.
Appendix
Available only for authorised users
Literature
1.
go back to reference Fleming TR: Current issues in non-inferiority trials. Stat Med. 2008, 27: 317-322. 10.1002/sim.2855.CrossRefPubMed Fleming TR: Current issues in non-inferiority trials. Stat Med. 2008, 27: 317-322. 10.1002/sim.2855.CrossRefPubMed
2.
go back to reference D’Agostinio RB: Non-inferiority trials: advances in concepts and methodology. Stat Med. 2003, 22: 165-167. D’Agostinio RB: Non-inferiority trials: advances in concepts and methodology. Stat Med. 2003, 22: 165-167.
3.
go back to reference Jones B, Jarvis P, Lewis JA, Ebbutt AF: Trials to assess equivalence: the importance of rigorous methods. BMJ. 1996, 313: 36-39. 10.1136/bmj.313.7048.36.CrossRefPubMedPubMedCentral Jones B, Jarvis P, Lewis JA, Ebbutt AF: Trials to assess equivalence: the importance of rigorous methods. BMJ. 1996, 313: 36-39. 10.1136/bmj.313.7048.36.CrossRefPubMedPubMedCentral
6.
go back to reference Moher D, Schulz KF, Altman DG, The CONSORT Group: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001, 357: 1191-1194. 10.1016/S0140-6736(00)04337-3.CrossRefPubMed Moher D, Schulz KF, Altman DG, The CONSORT Group: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001, 357: 1191-1194. 10.1016/S0140-6736(00)04337-3.CrossRefPubMed
7.
go back to reference Schulz KF, Altman DG, Moher D, CONSORT Group: CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. Trials. 2010, 24: 11-32. Schulz KF, Altman DG, Moher D, CONSORT Group: CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. Trials. 2010, 24: 11-32.
8.
go back to reference Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006, 185: 263-267.PubMed Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006, 185: 263-267.PubMed
9.
go back to reference Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG: The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010, 340: c723-10.1136/bmj.c723.CrossRefPubMedPubMedCentral Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG: The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010, 340: c723-10.1136/bmj.c723.CrossRefPubMedPubMedCentral
10.
go back to reference Le Henanff A, Giraudeau B, Baron G, Ravaud P: Quality of reporting non-inferiority and equivalence randomised trials. JAMA. 2006, 295: 1147-1151. 10.1001/jama.295.10.1147.CrossRefPubMed Le Henanff A, Giraudeau B, Baron G, Ravaud P: Quality of reporting non-inferiority and equivalence randomised trials. JAMA. 2006, 295: 1147-1151. 10.1001/jama.295.10.1147.CrossRefPubMed
11.
go back to reference Ivers NM, Taljaard M, Dixon S, Bennett C, McRae A, Taleban J, Skea Z, Brehaut JC, Boruch RF, Eccles MP, Grimshaw JM, Weijer C, Zwarenstein M, Donner A: Impact of CONSORT extension for cluster randomised trials on quality of reporting and study methodology: review of random sample of 300 trials, 2000–8. BMJ. 2011, 343: d5886-10.1136/bmj.d5886.CrossRefPubMedPubMedCentral Ivers NM, Taljaard M, Dixon S, Bennett C, McRae A, Taleban J, Skea Z, Brehaut JC, Boruch RF, Eccles MP, Grimshaw JM, Weijer C, Zwarenstein M, Donner A: Impact of CONSORT extension for cluster randomised trials on quality of reporting and study methodology: review of random sample of 300 trials, 2000–8. BMJ. 2011, 343: d5886-10.1136/bmj.d5886.CrossRefPubMedPubMedCentral
12.
go back to reference Piaggio G, Elbourne DR, Altman DG, Pocock SJ, Evans SJ, CONSORT Group: Reporting of non-inferiority and equivalence randomised trials: an extension of the CONSORT statement. JAMA. 2006, 295: 1152-1160. 10.1001/jama.295.10.1152.CrossRefPubMed Piaggio G, Elbourne DR, Altman DG, Pocock SJ, Evans SJ, CONSORT Group: Reporting of non-inferiority and equivalence randomised trials: an extension of the CONSORT statement. JAMA. 2006, 295: 1152-1160. 10.1001/jama.295.10.1152.CrossRefPubMed
13.
go back to reference Eyawo O, Lee CW, Rachlis B, Mills EJ: Reporting of noninferiority and equivalence randomized trials for major prostaglandins: a systematic survey of the ophthalmology literature. Trials. 2008, 3 (9): 69-CrossRef Eyawo O, Lee CW, Rachlis B, Mills EJ: Reporting of noninferiority and equivalence randomized trials for major prostaglandins: a systematic survey of the ophthalmology literature. Trials. 2008, 3 (9): 69-CrossRef
14.
go back to reference Wangge G, Klungel OH, Roes KC, de Boer A, Hoes AW, Knol MJ: Room for improvement in conducting and reporting non-inferiority randomized controlled trials on drugs: a systematic review. PLoS One. 2010, 5 (10): e13550-10.1371/journal.pone.0013550.CrossRefPubMedPubMedCentral Wangge G, Klungel OH, Roes KC, de Boer A, Hoes AW, Knol MJ: Room for improvement in conducting and reporting non-inferiority randomized controlled trials on drugs: a systematic review. PLoS One. 2010, 5 (10): e13550-10.1371/journal.pone.0013550.CrossRefPubMedPubMedCentral
16.
go back to reference Ghimire S, Kyung E, Kang W, Kim E: Assessment of adherence to the CONSORT statement for quality of reports on randomized controlled trial abstracts from four high-impact general medical journals. Trials. 2012, 10.1186/1745-6215-13-77. Ghimire S, Kyung E, Kang W, Kim E: Assessment of adherence to the CONSORT statement for quality of reports on randomized controlled trial abstracts from four high-impact general medical journals. Trials. 2012, 10.1186/1745-6215-13-77.
17.
go back to reference Fleiss JL: Measuring nominal scale agreement among many raters. Psychol Bull. 1971, 76: 378-382.CrossRef Fleiss JL: Measuring nominal scale agreement among many raters. Psychol Bull. 1971, 76: 378-382.CrossRef
18.
go back to reference Hopewell S, Altman DG, Moher D, Schulz KF: Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal ‘Instructions to Authors’. Trials. 2008, 18: 20-CrossRef Hopewell S, Altman DG, Moher D, Schulz KF: Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal ‘Instructions to Authors’. Trials. 2008, 18: 20-CrossRef
19.
go back to reference Partsinevelou A, Zintzaras E: Quality of reporting of randomized controlled trials in polycystic ovary syndrome. Trials. 2009, 20: 106-CrossRef Partsinevelou A, Zintzaras E: Quality of reporting of randomized controlled trials in polycystic ovary syndrome. Trials. 2009, 20: 106-CrossRef
20.
go back to reference Balasubramanian SP, Wiener M, Alshameeri Z, Tiruvoipati R, Elbourne D, Reed MW: Standards of reporting of randomized controlled trials in general surgery: can we do better?. Ann Surg. 2006, 244: 663-667. 10.1097/01.sla.0000217640.11224.05.CrossRefPubMedPubMedCentral Balasubramanian SP, Wiener M, Alshameeri Z, Tiruvoipati R, Elbourne D, Reed MW: Standards of reporting of randomized controlled trials in general surgery: can we do better?. Ann Surg. 2006, 244: 663-667. 10.1097/01.sla.0000217640.11224.05.CrossRefPubMedPubMedCentral
21.
go back to reference Wang JL, Sun TT, Lin YW, Lu R, Fang JY: Methodological reporting of randomized controlled trials in major hepato-gastroenterology journals in 2008 and 1998: a comparative study. BMC Med Res Methodol. 2011, 11: 110-10.1186/1471-2288-11-110.CrossRefPubMedPubMedCentral Wang JL, Sun TT, Lin YW, Lu R, Fang JY: Methodological reporting of randomized controlled trials in major hepato-gastroenterology journals in 2008 and 1998: a comparative study. BMC Med Res Methodol. 2011, 11: 110-10.1186/1471-2288-11-110.CrossRefPubMedPubMedCentral
22.
go back to reference Parsons N, Hiskens R, Price CL, Costa ML: A systematic survey of the quality of research reporting in general orthopaedic journals. J Bone Joint Surg Br. 2011, 93: 1154-1159. 10.1302/0301-620X.93B9.27193.CrossRefPubMed Parsons N, Hiskens R, Price CL, Costa ML: A systematic survey of the quality of research reporting in general orthopaedic journals. J Bone Joint Surg Br. 2011, 93: 1154-1159. 10.1302/0301-620X.93B9.27193.CrossRefPubMed
23.
go back to reference Hirst A, Altman DG: Are peer reviewers encouraged to use reporting guidelines? A survey of 116 health research journals. PLoS One. 2012, 7: e35621-10.1371/journal.pone.0035621.CrossRefPubMedPubMedCentral Hirst A, Altman DG: Are peer reviewers encouraged to use reporting guidelines? A survey of 116 health research journals. PLoS One. 2012, 7: e35621-10.1371/journal.pone.0035621.CrossRefPubMedPubMedCentral
24.
go back to reference Simera I, Moher D, Hirst A, Hoey J, Schulz KF, Altman DG: Transparent and accurate reporting increases reliability, utility, and impact of your research: reporting guidelines and the EQUATOR Network. BMC Medicine. 2010, 8: 24-10.1186/1741-7015-8-24.CrossRefPubMedPubMedCentral Simera I, Moher D, Hirst A, Hoey J, Schulz KF, Altman DG: Transparent and accurate reporting increases reliability, utility, and impact of your research: reporting guidelines and the EQUATOR Network. BMC Medicine. 2010, 8: 24-10.1186/1741-7015-8-24.CrossRefPubMedPubMedCentral
Metadata
Title
Quality of reporting of clinical non-inferiority and equivalence randomised trials - update and extension
Authors
Petra Schiller
Nicole Burchardi
Michael Niestroj
Meinhard Kieser
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Trials / Issue 1/2012
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-13-214

Other articles of this Issue 1/2012

Trials 1/2012 Go to the issue