Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2008

Open Access 01-12-2008 | Correspondence

Abstracts in high profile journals often fail to report harm

Authors: Enrique Bernal-Delgado, Elliot S Fisher

Published in: BMC Medical Research Methodology | Issue 1/2008

Login to get access

Abstract

Background

To describe how frequently harm is reported in the abstract of high impact factor medical journals.

Methods

Design and population: We carried out a blinded structured review of a random sample of 363 Randomised Controlled Trials (RCTs) carried out on human beings, and published in high impact factor medical journals in 2003. Main endpoint: 1) Proportion of articles reporting harm in the abstract; and 2) Proportion of articles that reported harm in the abstract when harm was reported in the main body of the article. Analysis: Corrected Prevalence Ratio (cPR) and its exact confidence interval were calculated. Non-conditional logistic regression was used.

Results

363 articles and 407 possible comparisons were studied. Overall, harm was reported in 135 abstracts [37.2% (CI95%:32.2 to 42.4)]. Harm was reported in the main text of 243 articles [66.9% (CI95%: 61.8 to 71.8)] and was statistically significant in 54 articles [14.9% (CI95%: 11.4 to 19.0)]. Among the 243 articles that mentioned harm in the text, 130 articles [53.5% (CI95% 47.0 to 59.9)] reported harm in the abstract; a figure that rose to 75.9% (CI95%: 62.4 to 86.5) when the harm reported in the text was statistically significant. Harm in the abstract was more likely to be reported when statistically significant harm was reported in the main body of the article [cPR = 1.70 (CI95% 1.47 to 1.92)] and when drug companies (not public institutions) funded the RCTs [cPR = 1.29 (CI95% 1.03 to 1.67)].

Conclusion

Abstracts published in high impact factor medical journals underreport harm, even when harm is reported in the main body of the article.
Appendix
Available only for authorised users
Literature
2.
go back to reference Chan AW, Hróbjartsson A, Haahr MT, Gotzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials. JAMA. 2004, 291: 2457-2465. 10.1001/jama.291.20.2457.CrossRefPubMed Chan AW, Hróbjartsson A, Haahr MT, Gotzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials. JAMA. 2004, 291: 2457-2465. 10.1001/jama.291.20.2457.CrossRefPubMed
3.
go back to reference Jørgensen KJ, Klahn A, Gøtzsche PC: Are benefits and harm in mammography screening given equal attention in scientific articles? A cross sectional study. BMC Medicine. 2007, 5: 12-10.1186/1741-7015-5-12.CrossRefPubMedPubMedCentral Jørgensen KJ, Klahn A, Gøtzsche PC: Are benefits and harm in mammography screening given equal attention in scientific articles? A cross sectional study. BMC Medicine. 2007, 5: 12-10.1186/1741-7015-5-12.CrossRefPubMedPubMedCentral
4.
go back to reference Rochon PA, Gwrwitz JH, Fortin PR, Felson DT, Minaker KL, Chalmers TC: A study of manufacturer-supported trials of non-steroidal anti-inflammatory drugs in the treatment of arthritis. Arch Intern Med. 1994, 154: 157-63. 10.1001/archinte.154.2.157.CrossRefPubMed Rochon PA, Gwrwitz JH, Fortin PR, Felson DT, Minaker KL, Chalmers TC: A study of manufacturer-supported trials of non-steroidal anti-inflammatory drugs in the treatment of arthritis. Arch Intern Med. 1994, 154: 157-63. 10.1001/archinte.154.2.157.CrossRefPubMed
5.
go back to reference Bekelman JE, Li Y, Gross CP: Scope and impact of financial conflicts of interest in biomedical research. JAMA. 2003, 289: 454-65. 10.1001/jama.289.4.454.CrossRefPubMed Bekelman JE, Li Y, Gross CP: Scope and impact of financial conflicts of interest in biomedical research. JAMA. 2003, 289: 454-65. 10.1001/jama.289.4.454.CrossRefPubMed
6.
go back to reference Friedman LS, Ritcher ED: Relationship between conflicts of interest and research results. J Gen Intern Med. 2004, 19: 51-6. 10.1111/j.1525-1497.2004.30617.x.CrossRefPubMedPubMedCentral Friedman LS, Ritcher ED: Relationship between conflicts of interest and research results. J Gen Intern Med. 2004, 19: 51-6. 10.1111/j.1525-1497.2004.30617.x.CrossRefPubMedPubMedCentral
7.
go back to reference Stelfox HT, Grace Ch, O'Rourke K, Detsky AS: Conflict of interest in the debate over calcium-channel antagonists. NEJM. 1998, 338: 101-6. 10.1056/NEJM199801083380206.CrossRefPubMed Stelfox HT, Grace Ch, O'Rourke K, Detsky AS: Conflict of interest in the debate over calcium-channel antagonists. NEJM. 1998, 338: 101-6. 10.1056/NEJM199801083380206.CrossRefPubMed
8.
go back to reference Loke YK, Derry S: Reporting of adverse drug reactions in randomised controlled trials – a systematic review. BMC Clinical Pharmacology. 2001, 1: 3-10.1186/1472-6904-1-3.CrossRefPubMedPubMedCentral Loke YK, Derry S: Reporting of adverse drug reactions in randomised controlled trials – a systematic review. BMC Clinical Pharmacology. 2001, 1: 3-10.1186/1472-6904-1-3.CrossRefPubMedPubMedCentral
9.
go back to reference Ioannidis JPA, Lau J: Completeness of safety reporting in Randomized Trials. JAMA. 2001, 285: 437-443. 10.1001/jama.285.4.437.CrossRefPubMed Ioannidis JPA, Lau J: Completeness of safety reporting in Randomized Trials. JAMA. 2001, 285: 437-443. 10.1001/jama.285.4.437.CrossRefPubMed
10.
go back to reference Chan AW, Altman DG: Identifying outcome reporting bias in randomised trials on Pubmed: review of publications and survey of authors. BMJ. 2005, 330: 753-10.1136/bmj.38356.424606.8F.CrossRefPubMedPubMedCentral Chan AW, Altman DG: Identifying outcome reporting bias in randomised trials on Pubmed: review of publications and survey of authors. BMJ. 2005, 330: 753-10.1136/bmj.38356.424606.8F.CrossRefPubMedPubMedCentral
11.
go back to reference Forrow L, Taylor WC, Arnold RM: Absolutely Relative: How research results are summarized can affect treatment decisions. Am J Med. 1992, 92: 121-124. 10.1016/0002-9343(92)90100-P.CrossRefPubMed Forrow L, Taylor WC, Arnold RM: Absolutely Relative: How research results are summarized can affect treatment decisions. Am J Med. 1992, 92: 121-124. 10.1016/0002-9343(92)90100-P.CrossRefPubMed
12.
go back to reference Bobbio M, Demichelis B, Giustetto G: Completeness of reporting trial results: effect on physicians'willingness to prescribe. Lancet. 1994, 343: 1209-11. 10.1016/S0140-6736(94)92407-4.CrossRefPubMed Bobbio M, Demichelis B, Giustetto G: Completeness of reporting trial results: effect on physicians'willingness to prescribe. Lancet. 1994, 343: 1209-11. 10.1016/S0140-6736(94)92407-4.CrossRefPubMed
13.
go back to reference Bucher HC, Weynbacher M, Gyr K: Influence of method of reporting study results on decision of physicians to prescribe drugs to lower cholesterol concentration. BMJ. 1994, 309: 761-4.CrossRefPubMedPubMedCentral Bucher HC, Weynbacher M, Gyr K: Influence of method of reporting study results on decision of physicians to prescribe drugs to lower cholesterol concentration. BMJ. 1994, 309: 761-4.CrossRefPubMedPubMedCentral
14.
go back to reference Lacy CR, Barone JA, Suh DC, Malini PL, Bueno M, Moylan DM: Impact of presentation of research results on likelihood of prescribing medications to patients with left ventricular dysfunction. Am J Cardiol. 2001, 87: 203-7. 10.1016/S0002-9149(00)01317-5.CrossRefPubMed Lacy CR, Barone JA, Suh DC, Malini PL, Bueno M, Moylan DM: Impact of presentation of research results on likelihood of prescribing medications to patients with left ventricular dysfunction. Am J Cardiol. 2001, 87: 203-7. 10.1016/S0002-9149(00)01317-5.CrossRefPubMed
15.
go back to reference Marquez S, Meneu R, Peiró S: Influencia de la presentación de los ensayos clínicos en la intención de prescribir: relativizando el riesgo relativo. Aten Primaria. 1998, 21: 446-50. Marquez S, Meneu R, Peiró S: Influencia de la presentación de los ensayos clínicos en la intención de prescribir: relativizando el riesgo relativo. Aten Primaria. 1998, 21: 446-50.
16.
go back to reference Naylor CD, Chen E, Strauss B: Measured enthusiasm: does the method of reporting trial results alter perceptions of therapeutic effectiveness?. Ann Intern Medicine. 1992, 117: 916-21.CrossRef Naylor CD, Chen E, Strauss B: Measured enthusiasm: does the method of reporting trial results alter perceptions of therapeutic effectiveness?. Ann Intern Medicine. 1992, 117: 916-21.CrossRef
17.
go back to reference Barry HC, Ebell MH, Shaughnessy AF, David C, Neitzke F: Family Physicians' use of medical abstracts to guide decision making: style or substance?. J Am Board Fam Practice. 2001, 14: 437-42. Barry HC, Ebell MH, Shaughnessy AF, David C, Neitzke F: Family Physicians' use of medical abstracts to guide decision making: style or substance?. J Am Board Fam Practice. 2001, 14: 437-42.
18.
go back to reference Hopewell S, Eisinga A, Clarke M: Better reporting of randomized trials in biomedical journal and conference abstracts. Journal of Information Science. 2008, 34: 162-173. 10.1177/0165551507080415.CrossRef Hopewell S, Eisinga A, Clarke M: Better reporting of randomized trials in biomedical journal and conference abstracts. Journal of Information Science. 2008, 34: 162-173. 10.1177/0165551507080415.CrossRef
19.
go back to reference Hill CL, Buchbinder R, Osborne R: Quality of reporting of randomized clinical trials in abstracts of the 2005 annual meeting of the American college of Rheumatology. J Rheumatol. 2007, 34: 2476-2480.PubMed Hill CL, Buchbinder R, Osborne R: Quality of reporting of randomized clinical trials in abstracts of the 2005 annual meeting of the American college of Rheumatology. J Rheumatol. 2007, 34: 2476-2480.PubMed
20.
go back to reference Herbison P: The reporting quality of abstracts of randomized controlled trials submitted to the ICS meeting in Heidelberg. Neurourology and Urodynamics. 2005, 24: 21-24. 10.1002/nau.20076.CrossRefPubMed Herbison P: The reporting quality of abstracts of randomized controlled trials submitted to the ICS meeting in Heidelberg. Neurourology and Urodynamics. 2005, 24: 21-24. 10.1002/nau.20076.CrossRefPubMed
21.
go back to reference Ioannidis JA, Evans SJ, Gǿtzsche PC, O'Neill RT, Altman DG, Schulz K, for the CONSORT group: Better reporting of harm in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004, 141: 781-8.CrossRefPubMed Ioannidis JA, Evans SJ, Gǿtzsche PC, O'Neill RT, Altman DG, Schulz K, for the CONSORT group: Better reporting of harm in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004, 141: 781-8.CrossRefPubMed
22.
go back to reference Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, the CONSORT Group: CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med. 2008, 5: e20-10.1371/journal.pmed.0050020.CrossRefPubMedPubMedCentral Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, the CONSORT Group: CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med. 2008, 5: e20-10.1371/journal.pmed.0050020.CrossRefPubMedPubMedCentral
23.
go back to reference Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, the CONSORT Group: CONSORT for reporting randomised trials in journal and conference abstracts. Lancet. 2008, 371: 281-283. 10.1016/S0140-6736(07)61835-2.CrossRefPubMed Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, the CONSORT Group: CONSORT for reporting randomised trials in journal and conference abstracts. Lancet. 2008, 371: 281-283. 10.1016/S0140-6736(07)61835-2.CrossRefPubMed
24.
go back to reference Zhang J, Kai FY: What's the relative risk? A method of correcting the Odds Ratio in cohort studies of common outcomes. JAMA. 1998, 280: 1690-1. 10.1001/jama.280.19.1690.CrossRefPubMed Zhang J, Kai FY: What's the relative risk? A method of correcting the Odds Ratio in cohort studies of common outcomes. JAMA. 1998, 280: 1690-1. 10.1001/jama.280.19.1690.CrossRefPubMed
25.
go back to reference Lee J: Odds Ratio or Relative Risk for cross-sectional data?. Int J Epidemiol. 1994, 23: 201-3. 10.1093/ije/23.1.201.CrossRefPubMed Lee J: Odds Ratio or Relative Risk for cross-sectional data?. Int J Epidemiol. 1994, 23: 201-3. 10.1093/ije/23.1.201.CrossRefPubMed
Metadata
Title
Abstracts in high profile journals often fail to report harm
Authors
Enrique Bernal-Delgado
Elliot S Fisher
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2008
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-8-14

Other articles of this Issue 1/2008

BMC Medical Research Methodology 1/2008 Go to the issue