Skip to main content
Top
Published in: European Radiology 9/2018

01-09-2018 | Experimental

Reporting bias in imaging: higher accuracy is linked to faster publication

Authors: A. Dehmoobad Sharifabadi, D. A. Korevaar, T. A. McGrath, N. van Es, R. A. Frank, L. Cherpak, W. Dang, J. P. Salameh, F. Nguyen, C. Stanley, M. D. F. McInnes

Published in: European Radiology | Issue 9/2018

Login to get access

Abstract

Objectives

The objective of this study was to evaluate whether higher reported accuracy estimates are associated with shorter time to publication among imaging diagnostic accuracy studies.

Methods

We included primary imaging diagnostic accuracy studies, included in meta-analyses from systematic reviews published in 2015. For each primary study, we extracted accuracy estimates, participant recruitment periods and publication dates. Our primary outcome was the association between Youden’s index (sensitivity + specificity − 1, a single measure of diagnostic accuracy) and time to publication.

Results

We included 55 systematic reviews and 781 primary studies. Study completion dates were missing for 238 (30%) studies. The median time from completion to publication in the remaining 543 studies was 20 months (IQR 14–29). Youden’s index was negatively correlated with time from completion to publication (rho = −0.11, p = 0.009). This association remained significant in multivariable Cox regression analyses after adjusting for seven study characteristics: hazard ratio of publication was 1.09 (95% CI 1.03–1.16, p = 0.004) per unit increase for logit-transformed estimates of Youden’s index. When dichotomizing Youden’s index by a median split, time from completion to publication was 20 months (IQR 13–33) for studies with a Youden’s index below the median, and 19 months (14–27) for studies with a Youden’s index above the median (p = 0.104).

Conclusion

Imaging diagnostic accuracy studies with higher accuracy estimates were weakly associated with a shorter time to publication.

Key points

• Higher accuracy estimates are weakly associated with shorter time to publication.
• Lag in time to publication remained significant in multivariate Cox regression analyses.
• No correlation between accuracy and time from submission to publication was identified.
Appendix
Available only for authorised users
Literature
1.
go back to reference Dwan K, Gamble C, Williamson PR, Kirkham JJ, Group RB (2013) Systematic review of the empirical evidence of study publication bias and outcome reporting bias - an updated review. PLoS One 8:e66844CrossRef Dwan K, Gamble C, Williamson PR, Kirkham JJ, Group RB (2013) Systematic review of the empirical evidence of study publication bias and outcome reporting bias - an updated review. PLoS One 8:e66844CrossRef
3.
go back to reference Archer SW, Carlo WA, Truog WE et al (2016) Improving publication rates in a collaborative clinical trials research network. Semin Perinatol 40:410–417CrossRefPubMedPubMedCentral Archer SW, Carlo WA, Truog WE et al (2016) Improving publication rates in a collaborative clinical trials research network. Semin Perinatol 40:410–417CrossRefPubMedPubMedCentral
4.
go back to reference Toews I, Glenton C, Lewin S et al (2016) Extent, awareness and perception of dissemination bias in qualitative research: an explorative survey. PLoS One 11:e0159290CrossRefPubMedPubMedCentral Toews I, Glenton C, Lewin S et al (2016) Extent, awareness and perception of dissemination bias in qualitative research: an explorative survey. PLoS One 11:e0159290CrossRefPubMedPubMedCentral
5.
go back to reference Malički M, Marušić A, OPEN (to Overcome failure to Publish nEgative fiNdings) Consortium (2014) Is there a solution to publication bias? Researchers call for changes in dissemination of clinical research results. J Clin Epidemiol 67:1103–1110CrossRefPubMed Malički M, Marušić A, OPEN (to Overcome failure to Publish nEgative fiNdings) Consortium (2014) Is there a solution to publication bias? Researchers call for changes in dissemination of clinical research results. J Clin Epidemiol 67:1103–1110CrossRefPubMed
6.
go back to reference Page MJ, McKenzie JE, Kirkham J et al (2014) Bias due to selective inclusion and reporting of outcomes and analyses in systematic reviews of randomised trials of healthcare interventions. Cochrane Database Syst Rev 10:MR000035 Page MJ, McKenzie JE, Kirkham J et al (2014) Bias due to selective inclusion and reporting of outcomes and analyses in systematic reviews of randomised trials of healthcare interventions. Cochrane Database Syst Rev 10:MR000035
7.
go back to reference Driessen E, Hollon SD, Bockting CL, Cuijpers P, Turner EH (2015) Does publication bias inflate the apparent efficacy of psychological treatment for major depressive disorder? A systematic review and meta-analysis of US National Institutes of Health-funded trials. PLoS One 10:e0137864CrossRefPubMedPubMedCentral Driessen E, Hollon SD, Bockting CL, Cuijpers P, Turner EH (2015) Does publication bias inflate the apparent efficacy of psychological treatment for major depressive disorder? A systematic review and meta-analysis of US National Institutes of Health-funded trials. PLoS One 10:e0137864CrossRefPubMedPubMedCentral
8.
go back to reference Roest AM, de Jonge P, Williams CD, de Vries YA, Schoevers RA, Turner EH (2015) Reporting bias in clinical trials investigating the efficacy of second-generation antidepressants in the treatment of anxiety disorders: a report of 2 meta-analyses. JAMA Psychiatry 72:500–510CrossRefPubMed Roest AM, de Jonge P, Williams CD, de Vries YA, Schoevers RA, Turner EH (2015) Reporting bias in clinical trials investigating the efficacy of second-generation antidepressants in the treatment of anxiety disorders: a report of 2 meta-analyses. JAMA Psychiatry 72:500–510CrossRefPubMed
9.
go back to reference Song F, Loke Y, Hooper L (2014) Why are medical and health-related studies not being published? A systematic review of reasons given by investigators. PLoS One 9:e110418CrossRefPubMedPubMedCentral Song F, Loke Y, Hooper L (2014) Why are medical and health-related studies not being published? A systematic review of reasons given by investigators. PLoS One 9:e110418CrossRefPubMedPubMedCentral
10.
go back to reference Scherer RW, Ugarte-Gil C, Schmucker C, Meerpohl JJ (2015) Authors report lack of time as main reason for unpublished research presented at biomedical conferences: a systematic review. J Clin Epidemiol 68:803–810CrossRefPubMedPubMedCentral Scherer RW, Ugarte-Gil C, Schmucker C, Meerpohl JJ (2015) Authors report lack of time as main reason for unpublished research presented at biomedical conferences: a systematic review. J Clin Epidemiol 68:803–810CrossRefPubMedPubMedCentral
11.
go back to reference Lundh A, Sismondo S, Lexchin J, Busuioc OA, Bero L (2012) Industry sponsorship and research outcome. Cochrane Database Syst Rev 12:MR000033PubMed Lundh A, Sismondo S, Lexchin J, Busuioc OA, Bero L (2012) Industry sponsorship and research outcome. Cochrane Database Syst Rev 12:MR000033PubMed
12.
go back to reference de Vet H, Eisinga A, Riphagen I, Aertgeerts B, Pewsner D (2008) Chapter 7: Searching for studies. Cochrane handbook for systematic reviews of diagnostic test accuracy. Version 0.4 [updated September 2008]. The Cochrane Collaboration de Vet H, Eisinga A, Riphagen I, Aertgeerts B, Pewsner D (2008) Chapter 7: Searching for studies. Cochrane handbook for systematic reviews of diagnostic test accuracy. Version 0.4 [updated September 2008]. The Cochrane Collaboration
13.
go back to reference Porté F, Uppara M, Malietzis G et al (2017) CT colonography for surveillance of patients with colorectal cancer: systematic review and meta-analysis of diagnostic efficacy. Eur Radiol 27:51–60CrossRefPubMed Porté F, Uppara M, Malietzis G et al (2017) CT colonography for surveillance of patients with colorectal cancer: systematic review and meta-analysis of diagnostic efficacy. Eur Radiol 27:51–60CrossRefPubMed
14.
go back to reference Jarvis D, Mooney C, Cohen J et al (2017) A systematic review and meta-analysis to determine the contribution of MR imaging to the diagnosis of foetal brain abnormalities in utero. Eur Radiol 27:2367–2380CrossRefPubMed Jarvis D, Mooney C, Cohen J et al (2017) A systematic review and meta-analysis to determine the contribution of MR imaging to the diagnosis of foetal brain abnormalities in utero. Eur Radiol 27:2367–2380CrossRefPubMed
15.
go back to reference Mauri G, Sconfienza LM, Pescatori LC et al (2017) Technical success, technique efficacy and complications of minimally-invasive imaging-guided percutaneous ablation procedures of breast cancer: a systematic review and meta-analysis. Eur Radiol 27:3199–3210CrossRefPubMed Mauri G, Sconfienza LM, Pescatori LC et al (2017) Technical success, technique efficacy and complications of minimally-invasive imaging-guided percutaneous ablation procedures of breast cancer: a systematic review and meta-analysis. Eur Radiol 27:3199–3210CrossRefPubMed
16.
go back to reference Sevcenco S, Spick C, Helbich TH et al (2017) Malignancy rates and diagnostic performance of the Bosniak classification for the diagnosis of cystic renal lesions in computed tomography - a systematic review and meta-analysis. Eur Radiol 27:2239–2247CrossRefPubMed Sevcenco S, Spick C, Helbich TH et al (2017) Malignancy rates and diagnostic performance of the Bosniak classification for the diagnosis of cystic renal lesions in computed tomography - a systematic review and meta-analysis. Eur Radiol 27:2239–2247CrossRefPubMed
17.
go back to reference van Dijken BRJ, van Laar PJ, Holtman GA, van der Hoorn A (2017) Diagnostic accuracy of magnetic resonance imaging techniques for treatment response evaluation in patients with high-grade glioma, a systematic review and meta-analysis. Eur Radiol 27:4129–4144CrossRefPubMedPubMedCentral van Dijken BRJ, van Laar PJ, Holtman GA, van der Hoorn A (2017) Diagnostic accuracy of magnetic resonance imaging techniques for treatment response evaluation in patients with high-grade glioma, a systematic review and meta-analysis. Eur Radiol 27:4129–4144CrossRefPubMedPubMedCentral
18.
go back to reference Yunaga H, Ohta Y, Kaetsu Y et al (2017) Diagnostic performance of calcification-suppressed coronary CT angiography using rapid kilovolt-switching dual-energy CT. Eur Radiol 27:2794–2801CrossRefPubMed Yunaga H, Ohta Y, Kaetsu Y et al (2017) Diagnostic performance of calcification-suppressed coronary CT angiography using rapid kilovolt-switching dual-energy CT. Eur Radiol 27:2794–2801CrossRefPubMed
19.
go back to reference Korevaar DA, van Es N, Zwinderman AH, Cohen JF, Bossuyt PM (2016a) Time to publication among completed diagnostic accuracy studies: associated with reported accuracy estimates. BMC Med Res Methodol 16:68CrossRefPubMedPubMedCentral Korevaar DA, van Es N, Zwinderman AH, Cohen JF, Bossuyt PM (2016a) Time to publication among completed diagnostic accuracy studies: associated with reported accuracy estimates. BMC Med Res Methodol 16:68CrossRefPubMedPubMedCentral
20.
go back to reference McInnes MD, Bossuyt PM (2015) Pitfalls of systematic reviews and meta-analyses in imaging research. Radiology 277:13–21CrossRefPubMed McInnes MD, Bossuyt PM (2015) Pitfalls of systematic reviews and meta-analyses in imaging research. Radiology 277:13–21CrossRefPubMed
21.
go back to reference McGrath TA, McInnes MD, Korevaar DA, Bossuyt PM (2016) Meta-analyses of diagnostic accuracy in imaging journals: analysis of pooling techniques and their effect on summary estimates of diagnostic accuracy. Radiology 281:78–85CrossRefPubMed McGrath TA, McInnes MD, Korevaar DA, Bossuyt PM (2016) Meta-analyses of diagnostic accuracy in imaging journals: analysis of pooling techniques and their effect on summary estimates of diagnostic accuracy. Radiology 281:78–85CrossRefPubMed
22.
go back to reference Dressler D, Leswick D (2015) Canadian Association of Radiologists annual scientific meetings: how many abstracts go on to publication? Can Assoc Radiol J 66:96–101CrossRefPubMed Dressler D, Leswick D (2015) Canadian Association of Radiologists annual scientific meetings: how many abstracts go on to publication? Can Assoc Radiol J 66:96–101CrossRefPubMed
23.
go back to reference Dangouloff-Ros V, Ronot M, Lagadec M, Vilgrain V (2015) Analysis of subsequent publication of scientific orally presented abstracts of the French national congress of radiology. Part I: general characteristics. Diagn Interv Imaging 96:461–466CrossRefPubMed Dangouloff-Ros V, Ronot M, Lagadec M, Vilgrain V (2015) Analysis of subsequent publication of scientific orally presented abstracts of the French national congress of radiology. Part I: general characteristics. Diagn Interv Imaging 96:461–466CrossRefPubMed
24.
go back to reference Loughborough W, Dale H, Wareham JH, Youssef AH, Rodrigues MA, Rodrigues JC (2016) Characteristics and trends in publication of scientific papers presented at the European Congress of Radiology: a comparison between 2000 and 2010. Insights Imaging 7:755–762CrossRefPubMedPubMedCentral Loughborough W, Dale H, Wareham JH, Youssef AH, Rodrigues MA, Rodrigues JC (2016) Characteristics and trends in publication of scientific papers presented at the European Congress of Radiology: a comparison between 2000 and 2010. Insights Imaging 7:755–762CrossRefPubMedPubMedCentral
25.
go back to reference Shelmerdine SC, Lynch JO, Langan D, Arthurs OJ (2016) Presentation to publication: proportion of abstracts published for ESPR, SPR and IPR. Pediatr Radiol 46:1371–1377CrossRefPubMed Shelmerdine SC, Lynch JO, Langan D, Arthurs OJ (2016) Presentation to publication: proportion of abstracts published for ESPR, SPR and IPR. Pediatr Radiol 46:1371–1377CrossRefPubMed
26.
go back to reference Korevaar DA, Ochodo EA, Bossuyt PM, Hooft L (2014) Publication and reporting of test accuracy studies registered in ClinicalTrials.gov. Clin Chem 60:651–659CrossRefPubMed Korevaar DA, Ochodo EA, Bossuyt PM, Hooft L (2014) Publication and reporting of test accuracy studies registered in ClinicalTrials.gov. Clin Chem 60:651–659CrossRefPubMed
27.
go back to reference Core Team R (2017) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna Core Team R (2017) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna
28.
29.
go back to reference Suñé P, Suñé JM, Montoro JB (2013) Positive outcomes influence the rate and time to publication, but not the impact factor of publications of clinical trial results. PLoS One 8:e54583CrossRefPubMedPubMedCentral Suñé P, Suñé JM, Montoro JB (2013) Positive outcomes influence the rate and time to publication, but not the impact factor of publications of clinical trial results. PLoS One 8:e54583CrossRefPubMedPubMedCentral
30.
31.
go back to reference Song SY, Koo DH, Jung SY, Kang W, Kim EY (2017) The significance of the trial outcome was associated with publication rate and time to publication. J Clin Epidemiol 84:78–84CrossRefPubMed Song SY, Koo DH, Jung SY, Kang W, Kim EY (2017) The significance of the trial outcome was associated with publication rate and time to publication. J Clin Epidemiol 84:78–84CrossRefPubMed
32.
go back to reference Brazzelli M, Lewis SC, Deeks JJ, Sandercock PA (2009) No evidence of bias in the process of publication of diagnostic accuracy studies in stroke submitted as abstracts. J Clin Epidemiol 62:425–430CrossRefPubMed Brazzelli M, Lewis SC, Deeks JJ, Sandercock PA (2009) No evidence of bias in the process of publication of diagnostic accuracy studies in stroke submitted as abstracts. J Clin Epidemiol 62:425–430CrossRefPubMed
33.
go back to reference Wilson C, Kerr D, Noel-Storr A, Quinn TJ (2015) Associations with publication and assessing publication bias in dementia diagnostic test accuracy studies. Int J Geriatr Psychiatry 30:1250–1256CrossRefPubMed Wilson C, Kerr D, Noel-Storr A, Quinn TJ (2015) Associations with publication and assessing publication bias in dementia diagnostic test accuracy studies. Int J Geriatr Psychiatry 30:1250–1256CrossRefPubMed
34.
go back to reference Korevaar DA, Cohen JF, Spijker R et al (2016b) Reported estimates of diagnostic accuracy in ophthalmology conference abstracts were not associated with full-text publication. J Clin Epidemiol 79:96–103CrossRefPubMedPubMedCentral Korevaar DA, Cohen JF, Spijker R et al (2016b) Reported estimates of diagnostic accuracy in ophthalmology conference abstracts were not associated with full-text publication. J Clin Epidemiol 79:96–103CrossRefPubMedPubMedCentral
35.
Metadata
Title
Reporting bias in imaging: higher accuracy is linked to faster publication
Authors
A. Dehmoobad Sharifabadi
D. A. Korevaar
T. A. McGrath
N. van Es
R. A. Frank
L. Cherpak
W. Dang
J. P. Salameh
F. Nguyen
C. Stanley
M. D. F. McInnes
Publication date
01-09-2018
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 9/2018
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-018-5354-x

Other articles of this Issue 9/2018

European Radiology 9/2018 Go to the issue