Skip to main content
Top
Published in: BMC Clinical Pharmacology 1/2010

Open Access 01-12-2010 | Research article

Reporting randomised clinical trials of analgesics after traumatic or orthopaedic surgery is inadequate: a systematic review

Authors: Eva Montané, Antoni Vallano, Xavier Vidal, Cristina Aguilera, Joan-Ramon Laporte

Published in: BMC Clinical Pharmacology | Issue 1/2010

Login to get access

Abstract

Background

Several randomised clinical trials (RCTs) of analgesics in postoperative pain after traumatic or orthopaedic surgery (TOS) have been published, but no studies have assessed the quality of these reports. We aimed to examine the quality of reporting RCTs on analgesics for postoperative pain after TOS.

Methods

Reports of RCTs assessing analgesics in postoperative pain after TOS were systematically searched from electronic databases. The quality of reports was assessed using the CONSORT checklist (scoring range from 0 to 22). The quality was considered poor when scoring was 12 or lesser. The publication year and the impact factor of journals were recorded.

Results

A total of 92 reports of RCTs were identified and 69 (75%) scored 12 or lesser in CONSORT checklist (range 5-17). The mean (SD) CONSORT score of all reports was 10.6 (2.7). Missing CONSORT items included primary and secondary outcome measures (11%), the specific objectives and hypothesis definition (12%), the sample size calculation (12%), the dates defining the periods of recruitment (12%), the discussion of external validity of findings (14%), the allocation sequence generation (24%), and the interpretation of potential bias or imprecision of results (25%). There was a little improvement in CONSORT scores over time (r = 0.62; p < 0.001) and with impact factor of journals (r = 0.30; p < 0.001).

Conclusion

Quality of reporting RCTs on analgesics after TOS is poor. Reporting of those RCTs should be improved according to methodological standard checklists in the next years.
Literature
1.
go back to reference Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, Tugwell P, Klassen TP: Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses?. Lancet. 1998, 352: 609-613. 10.1016/S0140-6736(98)01085-X.CrossRefPubMed Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, Tugwell P, Klassen TP: Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses?. Lancet. 1998, 352: 609-613. 10.1016/S0140-6736(98)01085-X.CrossRefPubMed
2.
go back to reference Kiter E, Karatosum V, Günal I: Do orthopaedic journals provide high-quality evidence for clinical practice?. Arch Orthop Trauma Surg. 2003, 123: 82-85.PubMed Kiter E, Karatosum V, Günal I: Do orthopaedic journals provide high-quality evidence for clinical practice?. Arch Orthop Trauma Surg. 2003, 123: 82-85.PubMed
3.
go back to reference Bhandari M, Morrow F, Kulkarni AV, Tornetta P: Meta-analyses in orthopaedic surgery. A systematic review of their methodologies. J Bone Joint Surg. 2001, 83: 15-24. 10.1302/0301-620X.83B1.10986.CrossRefPubMed Bhandari M, Morrow F, Kulkarni AV, Tornetta P: Meta-analyses in orthopaedic surgery. A systematic review of their methodologies. J Bone Joint Surg. 2001, 83: 15-24. 10.1302/0301-620X.83B1.10986.CrossRefPubMed
4.
go back to reference Jadad AR, McQuay HJ: Meta-analyses to evaluate analgesic interventions: a systematic qualitative review of their methodology. J Clin Epidemiol. 1996, 49: 235-243. 10.1016/0895-4356(95)00062-3.CrossRefPubMed Jadad AR, McQuay HJ: Meta-analyses to evaluate analgesic interventions: a systematic qualitative review of their methodology. J Clin Epidemiol. 1996, 49: 235-243. 10.1016/0895-4356(95)00062-3.CrossRefPubMed
5.
go back to reference Montané E, Vallano A, Aguilera C, Vidal X, Laporte J: Analgesics for pain after traumatic or orthopaedic surgery: what is the evidence-a systematic review. Eur J Clin Pharmacol. 2006, 62: 971-988. 10.1007/s00228-006-0185-0.CrossRefPubMed Montané E, Vallano A, Aguilera C, Vidal X, Laporte J: Analgesics for pain after traumatic or orthopaedic surgery: what is the evidence-a systematic review. Eur J Clin Pharmacol. 2006, 62: 971-988. 10.1007/s00228-006-0185-0.CrossRefPubMed
6.
go back to reference Moher D, Schulz KF, Altman DG, for the CONSORT Group: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001, 357: 1191-1194. 10.1016/S0140-6736(00)04337-3.CrossRefPubMed Moher D, Schulz KF, Altman DG, for the CONSORT Group: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001, 357: 1191-1194. 10.1016/S0140-6736(00)04337-3.CrossRefPubMed
7.
go back to reference Oxman AD, Guyatt GH, Singer J, Goldsmith CH, Hutchison BG, Milner RA, Streiner DL: Agreement among reviewers of review articles. J Clin Epidemiol. 1991, 44: 91-98. 10.1016/0895-4356(91)90205-N.CrossRefPubMed Oxman AD, Guyatt GH, Singer J, Goldsmith CH, Hutchison BG, Milner RA, Streiner DL: Agreement among reviewers of review articles. J Clin Epidemiol. 1991, 44: 91-98. 10.1016/0895-4356(91)90205-N.CrossRefPubMed
9.
go back to reference Hill CL, La Valley MP, Felson DT: Secular changes in the quality of published randomized clinical trials in rheumatology. Arthritis Rheum. 2002, 46: 779-784. 10.1002/art.512.CrossRefPubMed Hill CL, La Valley MP, Felson DT: Secular changes in the quality of published randomized clinical trials in rheumatology. Arthritis Rheum. 2002, 46: 779-784. 10.1002/art.512.CrossRefPubMed
10.
go back to reference Bath FJ, Owen VE, Bath PMW: Quality of full and final publications reporting acute stroke trials. A systematic review. Stroke. 1998, 29: 2203-2210.CrossRefPubMed Bath FJ, Owen VE, Bath PMW: Quality of full and final publications reporting acute stroke trials. A systematic review. Stroke. 1998, 29: 2203-2210.CrossRefPubMed
11.
go back to reference Sánchez-Thorin JC, Cortés MC, Montenegro M, Villate N: The quality of reporting of randomised clinical trials published in ophthalmology. Ophtalmology. 2001, 108: 410-415. 10.1016/S0161-6420(00)00500-5.CrossRef Sánchez-Thorin JC, Cortés MC, Montenegro M, Villate N: The quality of reporting of randomised clinical trials published in ophthalmology. Ophtalmology. 2001, 108: 410-415. 10.1016/S0161-6420(00)00500-5.CrossRef
12.
go back to reference Latronico N, Botteri M, Minelli C, Zanotti C, Bertolini G, Candiani A: Quality of reporting of randomised controlled trials in the intensive care literature. A systematic analysis of papers published in Intensive Care Medicine over 26 years. Intensive Care Med. 2002, 28: 1316-1323. 10.1007/s00134-002-1339-x.CrossRefPubMed Latronico N, Botteri M, Minelli C, Zanotti C, Bertolini G, Candiani A: Quality of reporting of randomised controlled trials in the intensive care literature. A systematic analysis of papers published in Intensive Care Medicine over 26 years. Intensive Care Med. 2002, 28: 1316-1323. 10.1007/s00134-002-1339-x.CrossRefPubMed
13.
go back to reference Ko CY, Sack J, Chang JT, Fink A: Reporting randomized, controlled trials. Where quality of reporting may be improved. Dis Colon Rectum. 2002, 45: 443-447. 10.1007/s10350-004-6217-x.CrossRefPubMed Ko CY, Sack J, Chang JT, Fink A: Reporting randomized, controlled trials. Where quality of reporting may be improved. Dis Colon Rectum. 2002, 45: 443-447. 10.1007/s10350-004-6217-x.CrossRefPubMed
14.
go back to reference Moher D, Jadad AR, Tugwell P: Assessing the quality of randomized controlled trials. Current issues and future directions. Int J Technol Assess Health Care. 1996, 12: 195-208. 10.1017/S0266462300009570.CrossRefPubMed Moher D, Jadad AR, Tugwell P: Assessing the quality of randomized controlled trials. Current issues and future directions. Int J Technol Assess Health Care. 1996, 12: 195-208. 10.1017/S0266462300009570.CrossRefPubMed
16.
go back to reference Lee KP, Schotland M, Bacchetti P, Bero LA: Association of journal quality indicators with methodological quality of clinical research articles. JAMA. 2002, 287: 2805-2808. 10.1001/jama.287.21.2805.CrossRefPubMed Lee KP, Schotland M, Bacchetti P, Bero LA: Association of journal quality indicators with methodological quality of clinical research articles. JAMA. 2002, 287: 2805-2808. 10.1001/jama.287.21.2805.CrossRefPubMed
17.
go back to reference Moher D, Jones A, LePage L, for the CONSORT Group: Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA. 2001, 285: 1992-1995. 10.1001/jama.285.15.1992.CrossRefPubMed Moher D, Jones A, LePage L, for the CONSORT Group: Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA. 2001, 285: 1992-1995. 10.1001/jama.285.15.1992.CrossRefPubMed
18.
go back to reference Edwards JE, McQuay HJ, Moore RA, Collins SL: Reporting of adverse effects in clinical trials should be improved: lessons from acute postoperative pain. J Pain Symptom Manage. 1999, 18: 427-437. 10.1016/S0885-3924(99)00093-7.CrossRefPubMed Edwards JE, McQuay HJ, Moore RA, Collins SL: Reporting of adverse effects in clinical trials should be improved: lessons from acute postoperative pain. J Pain Symptom Manage. 1999, 18: 427-437. 10.1016/S0885-3924(99)00093-7.CrossRefPubMed
19.
go back to reference Altman DG, for the CONSORT Group: Endorsement of the CONSORT statement by high impact medical journals: survey of instructions for authors. BMJ. 2005, 330: 1056-1057. 10.1136/bmj.330.7499.1056.CrossRefPubMedPubMedCentral Altman DG, for the CONSORT Group: Endorsement of the CONSORT statement by high impact medical journals: survey of instructions for authors. BMJ. 2005, 330: 1056-1057. 10.1136/bmj.330.7499.1056.CrossRefPubMedPubMedCentral
20.
go back to reference Schulz KF, Chalmers I, Grimes DA, Altman DG: Assessing the quality of randomization from reports of controlled trials published in obstetrics and gynecology journals. JAMA. 1994, 272: 125-128. 10.1001/jama.272.2.125.CrossRefPubMed Schulz KF, Chalmers I, Grimes DA, Altman DG: Assessing the quality of randomization from reports of controlled trials published in obstetrics and gynecology journals. JAMA. 1994, 272: 125-128. 10.1001/jama.272.2.125.CrossRefPubMed
21.
go back to reference Ah-See KW, Molony NC: A qualitative assessment of randomized controlled trials in otolaryngology. J Laryngol Otol. 1998, 112: 460-463.PubMed Ah-See KW, Molony NC: A qualitative assessment of randomized controlled trials in otolaryngology. J Laryngol Otol. 1998, 112: 460-463.PubMed
22.
go back to reference Huwiler-Müntener K, Jüni P, Junker C, Egger M: Quality of reporting of randomized trials as a measure of methodologic quality. JAMA. 2002, 287: 2801-2804. 10.1001/jama.287.21.2801.CrossRefPubMed Huwiler-Müntener K, Jüni P, Junker C, Egger M: Quality of reporting of randomized trials as a measure of methodologic quality. JAMA. 2002, 287: 2801-2804. 10.1001/jama.287.21.2801.CrossRefPubMed
23.
go back to reference Montenegro R, Needleman I, Moles D, Tonetti M: Quality of RCTs in periodontology. A systematic review. J Dent Res. 2002, 81: 866-870. 10.1177/154405910208101214.CrossRefPubMed Montenegro R, Needleman I, Moles D, Tonetti M: Quality of RCTs in periodontology. A systematic review. J Dent Res. 2002, 81: 866-870. 10.1177/154405910208101214.CrossRefPubMed
24.
go back to reference Montori VM, Bhandari M, Devereaux PJ, Manns BJ, Ghali WA, Guyatt GH: In the dark. The reporting of blinding status in randomised controlled trials. J Clin Epidemiol. 2002, 55: 787-790. 10.1016/S0895-4356(02)00446-8.CrossRefPubMed Montori VM, Bhandari M, Devereaux PJ, Manns BJ, Ghali WA, Guyatt GH: In the dark. The reporting of blinding status in randomised controlled trials. J Clin Epidemiol. 2002, 55: 787-790. 10.1016/S0895-4356(02)00446-8.CrossRefPubMed
25.
go back to reference Bhandari M, Guyatt GH, Lochner H, Sprague S, Tornetta P: Application of the consolidated standards of reporting trials (CONSORT) in the fracture care literature. J Bone Joint Surg. 2002, 84: 485-489. 10.1302/0301-620X.84B7.12532.CrossRefPubMed Bhandari M, Guyatt GH, Lochner H, Sprague S, Tornetta P: Application of the consolidated standards of reporting trials (CONSORT) in the fracture care literature. J Bone Joint Surg. 2002, 84: 485-489. 10.1302/0301-620X.84B7.12532.CrossRefPubMed
26.
go back to reference Bhandari M, Richards RR, Sprague S, Schemitsch EH: The quality of reporting of randomised trials in the Journal of Bone and Joint Surgery from 1988 through 2000. J Bone Joint Surg. 2002, 84: 388-396. 10.1302/0301-620X.84B7.12532.CrossRefPubMed Bhandari M, Richards RR, Sprague S, Schemitsch EH: The quality of reporting of randomised trials in the Journal of Bone and Joint Surgery from 1988 through 2000. J Bone Joint Surg. 2002, 84: 388-396. 10.1302/0301-620X.84B7.12532.CrossRefPubMed
27.
go back to reference Boutron I, Tubach F, Giraudeau B, Ravaud P: Methodological differences in clinical trials evaluating nonpharmacological and pharmacological treatments of hip and knee osteoarthritis. JAMA. 2003, 290: 1062-1070. 10.1001/jama.290.8.1062.CrossRefPubMed Boutron I, Tubach F, Giraudeau B, Ravaud P: Methodological differences in clinical trials evaluating nonpharmacological and pharmacological treatments of hip and knee osteoarthritis. JAMA. 2003, 290: 1062-1070. 10.1001/jama.290.8.1062.CrossRefPubMed
28.
go back to reference Mills E, Loke YK, Wu P, Montori VM, Perri D, Moher D, Guyatt G: Determining the reporting quality of RCTs in clinical pharmacology. Br J Clin Pharmacol. 2004, 58: 61-65. 10.1111/j.1365-2125.2004.2092.x.CrossRefPubMedPubMedCentral Mills E, Loke YK, Wu P, Montori VM, Perri D, Moher D, Guyatt G: Determining the reporting quality of RCTs in clinical pharmacology. Br J Clin Pharmacol. 2004, 58: 61-65. 10.1111/j.1365-2125.2004.2092.x.CrossRefPubMedPubMedCentral
29.
go back to reference Piggott M, McGee H, Freuer D: Has CONSORT improved the reporting of randomized controlled trials in the palliative care literature? A systematic review. Palliative Medicine. 2004, 18: 32-38. 10.1191/0269216304pm857oa.CrossRefPubMed Piggott M, McGee H, Freuer D: Has CONSORT improved the reporting of randomized controlled trials in the palliative care literature? A systematic review. Palliative Medicine. 2004, 18: 32-38. 10.1191/0269216304pm857oa.CrossRefPubMed
30.
go back to reference Gummesson C, Atroshi I, Ekdahl C: The quality of reporting and outcome measures in randomized clinical trials related to upper-extremity disorders. J Hand Surg. 2004, 29: 727-734. 10.1016/j.jhsa.2004.04.003.CrossRef Gummesson C, Atroshi I, Ekdahl C: The quality of reporting and outcome measures in randomized clinical trials related to upper-extremity disorders. J Hand Surg. 2004, 29: 727-734. 10.1016/j.jhsa.2004.04.003.CrossRef
31.
go back to reference Strippoli GFM, Craig JC, Schena FP: The number, quality, and coverage of randomized controlled trials in nephrology. J Am Soc Nephrol. 2004, 15: 411-419. 10.1097/01.ASN.0000100125.21491.46.CrossRefPubMed Strippoli GFM, Craig JC, Schena FP: The number, quality, and coverage of randomized controlled trials in nephrology. J Am Soc Nephrol. 2004, 15: 411-419. 10.1097/01.ASN.0000100125.21491.46.CrossRefPubMed
32.
go back to reference Hewit C, Hahn S, Torgerson DJ, Watson J, Bland JM: Adequacy and reporting of allocation concealment: review of recent trials published in four general medical journals. BMJ. 2005, 330: 1057-1058. 10.1136/bmj.38413.576713.AE.CrossRef Hewit C, Hahn S, Torgerson DJ, Watson J, Bland JM: Adequacy and reporting of allocation concealment: review of recent trials published in four general medical journals. BMJ. 2005, 330: 1057-1058. 10.1136/bmj.38413.576713.AE.CrossRef
33.
go back to reference Doig GS, Simpson F, Delaney A: A review of the true methodological quality of nutritional support trials conducted in the critically III: time for improvement. Anesth Analg. 2005, 100: 527-533. 10.1213/01.ANE.0000141676.12552.D0.CrossRefPubMed Doig GS, Simpson F, Delaney A: A review of the true methodological quality of nutritional support trials conducted in the critically III: time for improvement. Anesth Analg. 2005, 100: 527-533. 10.1213/01.ANE.0000141676.12552.D0.CrossRefPubMed
34.
go back to reference Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Controlled Clin Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4.CrossRefPubMed Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ: Assessing the quality of reports of randomized clinical trials: is blinding necessary?. Controlled Clin Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4.CrossRefPubMed
35.
go back to reference Clark HD, Wells GA, Huët C, McAlister FA, Salmi LR, Fergusson D, Laupacis A: Assessing the quality of randomized trials: reliability of the Jadad scale. Control Clin Trials. 1999, 20: 448-452. 10.1016/S0197-2456(99)00026-4.CrossRefPubMed Clark HD, Wells GA, Huët C, McAlister FA, Salmi LR, Fergusson D, Laupacis A: Assessing the quality of randomized trials: reliability of the Jadad scale. Control Clin Trials. 1999, 20: 448-452. 10.1016/S0197-2456(99)00026-4.CrossRefPubMed
36.
go back to reference Moher D, Jadad AJ, Nichol G, Penman M, Tugwell P, Walsh S: Assessing the quality of randomised controlled trials: an annotated bibliography of scales and checklists. Control Clin Trials. 1995, 16: 62-73. 10.1016/0197-2456(94)00031-W.CrossRefPubMed Moher D, Jadad AJ, Nichol G, Penman M, Tugwell P, Walsh S: Assessing the quality of randomised controlled trials: an annotated bibliography of scales and checklists. Control Clin Trials. 1995, 16: 62-73. 10.1016/0197-2456(94)00031-W.CrossRefPubMed
37.
go back to reference Jüni P, Witschi A, Bloch R, Egger M: The hazards of scoring the quality of clinical trials for meta-analysis. JAMA. 1999, 282: 1054-1060. 10.1001/jama.282.11.1054.CrossRefPubMed Jüni P, Witschi A, Bloch R, Egger M: The hazards of scoring the quality of clinical trials for meta-analysis. JAMA. 1999, 282: 1054-1060. 10.1001/jama.282.11.1054.CrossRefPubMed
38.
go back to reference Egger M, Jüni P, Barlett C, Holenstein F, Sterns J: How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess. 2003, 7: 1-76.PubMed Egger M, Jüni P, Barlett C, Holenstein F, Sterns J: How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess. 2003, 7: 1-76.PubMed
Metadata
Title
Reporting randomised clinical trials of analgesics after traumatic or orthopaedic surgery is inadequate: a systematic review
Authors
Eva Montané
Antoni Vallano
Xavier Vidal
Cristina Aguilera
Joan-Ramon Laporte
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Clinical Pharmacology / Issue 1/2010
Electronic ISSN: 1472-6904
DOI
https://doi.org/10.1186/1472-6904-10-2

Other articles of this Issue 1/2010

BMC Clinical Pharmacology 1/2010 Go to the issue