Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2017

Open Access 01-12-2017 | Research article

A scoping review of comparisons between abstracts and full reports in primary biomedical research

Authors: Guowei Li, Luciana P. F. Abbade, Ikunna Nwosu, Yanling Jin, Alvin Leenus, Muhammad Maaz, Mei Wang, Meha Bhatt, Laura Zielinski, Nitika Sanger, Bianca Bantoto, Candice Luo, Ieta Shams, Hamnah Shahid, Yaping Chang, Guangwen Sun, Lawrence Mbuagbaw, Zainab Samaan, Mitchell A. H. Levine, Jonathan D. Adachi, Lehana Thabane

Published in: BMC Medical Research Methodology | Issue 1/2017

Login to get access

Abstract

Background

Evidence shows that research abstracts are commonly inconsistent with their corresponding full reports, and may mislead readers. In this scoping review, which is part of our series on the state of reporting of primary biomedical research, we summarized the evidence from systematic reviews and surveys, to investigate the current state of inconsistent abstract reporting, and to evaluate factors associated with improved reporting by comparing abstracts and their full reports.

Methods

We searched EMBASE, Web of Science, MEDLINE, and CINAHL from January 1st 1996 to September 30th 2016 to retrieve eligible systematic reviews and surveys. Our primary outcome was the level of inconsistency between abstracts and corresponding full reports, which was expressed as a percentage (with a lower percentage indicating better reporting) or categorized rating (such as major/minor difference, high/medium/low inconsistency), as reported by the authors. We used medians and interquartile ranges to describe the level of inconsistency across studies. No quantitative syntheses were conducted. Data from the included systematic reviews or surveys was summarized qualitatively.

Results

Seventeen studies that addressed this topic were included. The level of inconsistency was reported to have a median of 39% (interquartile range: 14% - 54%), and to range from 4% to 78%. In some studies that separated major from minor inconsistency, the level of major inconsistency ranged from 5% to 45% (median: 19%, interquartile range: 7% - 31%), which included discrepancies in specifying the study design or sample size, designating a primary outcome measure, presenting main results, and drawing a conclusion. A longer time interval between conference abstracts and the publication of full reports was found to be the only factor which was marginally or significantly associated with increased likelihood of reporting inconsistencies.

Conclusions

This scoping review revealed that abstracts are frequently inconsistent with full reports, and efforts are needed to improve the consistency of abstract reporting in the primary biomedical community.
Literature
1.
go back to reference Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, Michie S, Moher D, Wager E. Reducing waste from incomplete or unusable reports of biomedical research. Lancet (London, England). 2014;383(9913):267–76.CrossRef Glasziou P, Altman DG, Bossuyt P, Boutron I, Clarke M, Julious S, Michie S, Moher D, Wager E. Reducing waste from incomplete or unusable reports of biomedical research. Lancet (London, England). 2014;383(9913):267–76.CrossRef
2.
go back to reference Bhandari M, Devereaux PJ, Guyatt GH, Cook DJ, Swiontkowski MF, Sprague S, Schemitsch EH. An observational study of orthopaedic abstracts and subsequent full-text publications. J Bone Joint Surg Am. 2002;84-A(4):615–21.CrossRefPubMed Bhandari M, Devereaux PJ, Guyatt GH, Cook DJ, Swiontkowski MF, Sprague S, Schemitsch EH. An observational study of orthopaedic abstracts and subsequent full-text publications. J Bone Joint Surg Am. 2002;84-A(4):615–21.CrossRefPubMed
3.
go back to reference Ochodo EA, de Haan MC, Reitsma JB, Hooft L, Bossuyt PM, Leeflang MM. Overinterpretation and misreporting of diagnostic accuracy studies: evidence of "spin". Radiology. 2013;267(2):581–8.CrossRefPubMed Ochodo EA, de Haan MC, Reitsma JB, Hooft L, Bossuyt PM, Leeflang MM. Overinterpretation and misreporting of diagnostic accuracy studies: evidence of "spin". Radiology. 2013;267(2):581–8.CrossRefPubMed
4.
go back to reference Boutron I, Dutton S, Ravaud P, Altman DG. Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA. 2010;303(20):2058–64.CrossRefPubMed Boutron I, Dutton S, Ravaud P, Altman DG. Reporting and interpretation of randomized controlled trials with statistically nonsignificant results for primary outcomes. JAMA. 2010;303(20):2058–64.CrossRefPubMed
5.
go back to reference Simera I, Altman DG. Writing a research article that is “fit for purpose”: EQUATOR network and reporting guidelines. Evidence Based. Medicine. 2009;14(5):132–4. Simera I, Altman DG. Writing a research article that is “fit for purpose”: EQUATOR network and reporting guidelines. Evidence Based. Medicine. 2009;14(5):132–4.
6.
go back to reference Fleming PS, Buckley N, Seehra J, Polychronopoulou A, Pandis N. Reporting quality of abstracts of randomized controlled trials published in leading orthodontic journals from 2006 to 2011. American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics. 2012;142(4):451–8.CrossRef Fleming PS, Buckley N, Seehra J, Polychronopoulou A, Pandis N. Reporting quality of abstracts of randomized controlled trials published in leading orthodontic journals from 2006 to 2011. American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics. 2012;142(4):451–8.CrossRef
7.
go back to reference Hopewell S, Clarke M, Askie L. Reporting of trials presented in conference abstracts needs to be improved. J Clin Epidemiol. 2006;59(7):681–4.CrossRefPubMed Hopewell S, Clarke M, Askie L. Reporting of trials presented in conference abstracts needs to be improved. J Clin Epidemiol. 2006;59(7):681–4.CrossRefPubMed
8.
go back to reference Hopewell S, Boutron I, Altman DG, Ravaud P. Deficiencies in the publication and reporting of the results of systematic reviews presented at scientific medical conferences. J Clin Epidemiol. 2015;68(12):1488–95.CrossRefPubMed Hopewell S, Boutron I, Altman DG, Ravaud P. Deficiencies in the publication and reporting of the results of systematic reviews presented at scientific medical conferences. J Clin Epidemiol. 2015;68(12):1488–95.CrossRefPubMed
9.
go back to reference Seehra J, Fleming PS, Polychronopoulou A, Pandis N. Reporting completeness of abstracts of systematic reviews published in leading dental specialty journals. Eur J Oral Sci. 2013;121(2):57–62.CrossRefPubMed Seehra J, Fleming PS, Polychronopoulou A, Pandis N. Reporting completeness of abstracts of systematic reviews published in leading dental specialty journals. Eur J Oral Sci. 2013;121(2):57–62.CrossRefPubMed
10.
go back to reference Pitkin RM, Branagan MA, Burmeister LF. Accuracy of data in abstracts of published research articles. JAMA. 1999;281(12):1110–1.CrossRefPubMed Pitkin RM, Branagan MA, Burmeister LF. Accuracy of data in abstracts of published research articles. JAMA. 1999;281(12):1110–1.CrossRefPubMed
11.
go back to reference Ward LG, Kendrach MG, Price SO. Accuracy of abstracts for original research articles in pharmacy journals. Ann Pharmacother. 2004;38(7-8):1173–7.CrossRefPubMed Ward LG, Kendrach MG, Price SO. Accuracy of abstracts for original research articles in pharmacy journals. Ann Pharmacother. 2004;38(7-8):1173–7.CrossRefPubMed
12.
go back to reference Lehmen JA, Deering RM, Simpson AK, Carrier CS, Bono CM. Inconsistencies between abstracts and manuscripts in published studies about lumbar spine surgery. Spine. 2014;39(10):841–5.CrossRefPubMed Lehmen JA, Deering RM, Simpson AK, Carrier CS, Bono CM. Inconsistencies between abstracts and manuscripts in published studies about lumbar spine surgery. Spine. 2014;39(10):841–5.CrossRefPubMed
13.
go back to reference Li G, Mbuagbaw L, Samaan Z, Jin Y, Nwosu I, Levine M, Adachi JD, Thabane L. The state of reporting of primary biomedical research: a scoping review protocol. BMJ Open 2017;7(3):e014749. Li G, Mbuagbaw L, Samaan Z, Jin Y, Nwosu I, Levine M, Adachi JD, Thabane L. The state of reporting of primary biomedical research: a scoping review protocol. BMJ Open 2017;7(3):e014749.
14.
go back to reference Peters MD, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB. Guidance for conducting systematic scoping reviews. International journal of evidence-based healthcare. 2015;13(3):141–6.CrossRefPubMed Peters MD, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB. Guidance for conducting systematic scoping reviews. International journal of evidence-based healthcare. 2015;13(3):141–6.CrossRefPubMed
15.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ (Clinical research ed). 2009;339:b2535.CrossRef Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ (Clinical research ed). 2009;339:b2535.CrossRef
16.
go back to reference Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed Viera AJ, Garrett JM. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37(5):360–3.PubMed
17.
go back to reference Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7:10.CrossRefPubMedPubMedCentral Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7:10.CrossRefPubMedPubMedCentral
18.
go back to reference Harris AH, Standard S, Brunning JL, Casey SL, Goldberg JH, Oliver L, Ito K, Marshall JM. The accuracy of abstracts in psychology journals. The Journal of psychology. 2002;136(2):141–8.CrossRefPubMed Harris AH, Standard S, Brunning JL, Casey SL, Goldberg JH, Oliver L, Ito K, Marshall JM. The accuracy of abstracts in psychology journals. The Journal of psychology. 2002;136(2):141–8.CrossRefPubMed
19.
go back to reference Kottachchi D, Nguyen GC. Quality and publication success of abstracts of randomized clinical trials in inflammatory bowel disease presented at digestive disease week. Inflamm Bowel Dis. 2010;16(6):993–8.CrossRefPubMed Kottachchi D, Nguyen GC. Quality and publication success of abstracts of randomized clinical trials in inflammatory bowel disease presented at digestive disease week. Inflamm Bowel Dis. 2010;16(6):993–8.CrossRefPubMed
20.
go back to reference Rosmarakis ES, Soteriades ES, Vergidis PI, Kasiakou SK, Falagas ME. From conference abstract to full paper: differences between data presented in conferences and journals. FASEB journal : official publication of the Federation of American Societies for Experimental Biology. 2005;19(7):673–80.CrossRef Rosmarakis ES, Soteriades ES, Vergidis PI, Kasiakou SK, Falagas ME. From conference abstract to full paper: differences between data presented in conferences and journals. FASEB journal : official publication of the Federation of American Societies for Experimental Biology. 2005;19(7):673–80.CrossRef
21.
go back to reference Snedeker KG, Campbell M, Totton SC, Guthrie A, Sargeant JM. Comparison of outcomes and other variables between conference abstracts and subsequent peer-reviewed papers involving pre-harvest or abattoir-level interventions against foodborne pathogens. Preventive veterinary medicine. 2010;97(2):67–76.CrossRefPubMed Snedeker KG, Campbell M, Totton SC, Guthrie A, Sargeant JM. Comparison of outcomes and other variables between conference abstracts and subsequent peer-reviewed papers involving pre-harvest or abattoir-level interventions against foodborne pathogens. Preventive veterinary medicine. 2010;97(2):67–76.CrossRefPubMed
22.
go back to reference Davies MW, Dunster KR, East CE, Lingwood BE. Fate of abstracts published in the proceedings of the first annual Perinatal Society of Australia and new Zealand Congress in 1997. J Paediatr Child Health. 2002;38(5):501–6.CrossRefPubMed Davies MW, Dunster KR, East CE, Lingwood BE. Fate of abstracts published in the proceedings of the first annual Perinatal Society of Australia and new Zealand Congress in 1997. J Paediatr Child Health. 2002;38(5):501–6.CrossRefPubMed
23.
go back to reference Klassen TP, Wiebe N, Russell K, Stevens K, Hartling L, Craig WR, Moher D. Abstracts of randomized controlled trials presented at the society for pediatric research meeting: an example of publication bias. Archives of pediatrics & adolescent medicine. 2002;156(5):474–9.CrossRef Klassen TP, Wiebe N, Russell K, Stevens K, Hartling L, Craig WR, Moher D. Abstracts of randomized controlled trials presented at the society for pediatric research meeting: an example of publication bias. Archives of pediatrics & adolescent medicine. 2002;156(5):474–9.CrossRef
24.
go back to reference Preston CF, Bhandari M, Fulkerson E, Ginat D, Egol KA, Koval KJ. The consistency between scientific papers presented at the Orthopaedic trauma association and their subsequent full-text publication. J Orthop Trauma. 2006;20(2):129–33.CrossRefPubMed Preston CF, Bhandari M, Fulkerson E, Ginat D, Egol KA, Koval KJ. The consistency between scientific papers presented at the Orthopaedic trauma association and their subsequent full-text publication. J Orthop Trauma. 2006;20(2):129–33.CrossRefPubMed
25.
go back to reference Toma M, McAlister FA, Bialy L, Adams D, Vandermeer B, Armstrong PW. Transition from meeting abstract to full-length journal article for randomized controlled trials. JAMA. 2006;295(11):1281–7.CrossRefPubMed Toma M, McAlister FA, Bialy L, Adams D, Vandermeer B, Armstrong PW. Transition from meeting abstract to full-length journal article for randomized controlled trials. JAMA. 2006;295(11):1281–7.CrossRefPubMed
26.
go back to reference Turpen RM, Fesperman SF, Smith WA, Vieweg J, Dahm P. Reporting quality and information consistency of randomized, controlled trials presented as abstracts at the American urological association annual meetings. J Urol. 2010;184(1):249–53.CrossRefPubMed Turpen RM, Fesperman SF, Smith WA, Vieweg J, Dahm P. Reporting quality and information consistency of randomized, controlled trials presented as abstracts at the American urological association annual meetings. J Urol. 2010;184(1):249–53.CrossRefPubMed
27.
go back to reference Dyson DH, Sparling SC. Delay in final publication following abstract presentation: American College of Veterinary Anesthesiologists annual meeting. Journal of veterinary medical education. 2006;33(1):145–8.CrossRefPubMed Dyson DH, Sparling SC. Delay in final publication following abstract presentation: American College of Veterinary Anesthesiologists annual meeting. Journal of veterinary medical education. 2006;33(1):145–8.CrossRefPubMed
28.
go back to reference Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, Group C. CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med. 2008;5(1):e20.CrossRefPubMedPubMedCentral Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, Group C. CONSORT for reporting randomized controlled trials in journal and conference abstracts: explanation and elaboration. PLoS Med. 2008;5(1):e20.CrossRefPubMedPubMedCentral
29.
go back to reference Taddio A, Pain T, Fassos FF, Boon H, Ilersich AL, Einarson TR. Quality of nonstructured and structured abstracts of original research articles in the British medical journal, the Canadian Medical Association journal and the journal of the American Medical Association. CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne. 1994;150(10):1611–5.PubMed Taddio A, Pain T, Fassos FF, Boon H, Ilersich AL, Einarson TR. Quality of nonstructured and structured abstracts of original research articles in the British medical journal, the Canadian Medical Association journal and the journal of the American Medical Association. CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne. 1994;150(10):1611–5.PubMed
30.
go back to reference Sharma S, Harrison JE. Structured abstracts: do they improve the quality of information in abstracts? American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics. 2006;130(4):523–30.CrossRef Sharma S, Harrison JE. Structured abstracts: do they improve the quality of information in abstracts? American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics. 2006;130(4):523–30.CrossRef
31.
go back to reference Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF. CONSORT for reporting randomised trials in journal and conference abstracts. Lancet (London, England). 2008;371(9609):281–3.CrossRef Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF. CONSORT for reporting randomised trials in journal and conference abstracts. Lancet (London, England). 2008;371(9609):281–3.CrossRef
32.
go back to reference Pitkin RM, Branagan MA. Can the accuracy of abstracts be improved by providing specific instructions? A randomized controlled trial. JAMA. 1998;280(3):267–9.CrossRefPubMed Pitkin RM, Branagan MA. Can the accuracy of abstracts be improved by providing specific instructions? A randomized controlled trial. JAMA. 1998;280(3):267–9.CrossRefPubMed
33.
go back to reference Li G, Taljaard M, Van den Heuvel ER, Levine MA, Cook DJ, Wells GA, Devereaux PJ, Thabane L. An introduction to multiplicity issues in clinical trials: the what, why, when and how. Int J Epidemiol. 2017;46(2):746–55. Li G, Taljaard M, Van den Heuvel ER, Levine MA, Cook DJ, Wells GA, Devereaux PJ, Thabane L. An introduction to multiplicity issues in clinical trials: the what, why, when and how. Int J Epidemiol. 2017;46(2):746–55.
34.
go back to reference Hopewell S, Eisinga A, Clarke M. Better reporting of randomized trials in biomedical journal and conference abstracts. J Inf Sci. 2008;34(2):162–73.CrossRef Hopewell S, Eisinga A, Clarke M. Better reporting of randomized trials in biomedical journal and conference abstracts. J Inf Sci. 2008;34(2):162–73.CrossRef
Metadata
Title
A scoping review of comparisons between abstracts and full reports in primary biomedical research
Authors
Guowei Li
Luciana P. F. Abbade
Ikunna Nwosu
Yanling Jin
Alvin Leenus
Muhammad Maaz
Mei Wang
Meha Bhatt
Laura Zielinski
Nitika Sanger
Bianca Bantoto
Candice Luo
Ieta Shams
Hamnah Shahid
Yaping Chang
Guangwen Sun
Lawrence Mbuagbaw
Zainab Samaan
Mitchell A. H. Levine
Jonathan D. Adachi
Lehana Thabane
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2017
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-017-0459-5

Other articles of this Issue 1/2017

BMC Medical Research Methodology 1/2017 Go to the issue