Top

BMC Medical Research Methodology

Published in:

Open Access 01-12-2019 | Software

Development of an interactive web-based tool to conduct and interrogate meta-analysis of diagnostic test accuracy studies: MetaDTA

Authors: Suzanne C. Freeman, Clareece R. Kerby, Amit Patel, Nicola J. Cooper, Terry Quinn, Alex J. Sutton

Published in: BMC Medical Research Methodology | Issue 1/2019

Abstract

Background

Recommended statistical methods for meta-analysis of diagnostic test accuracy studies require relatively complex bivariate statistical models which can be a barrier for non-statisticians. A further barrier exists in the software options available for fitting such models. Software accessible to non-statisticians, such as RevMan, does not support the fitting of bivariate models thus users must seek statistical support to use R, Stata or SAS. Recent advances in web technologies make analysis tool creation much simpler than previously. As well as accessibility, online tools can allow tailored interactivity not found in other packages allowing multiple perspectives of data to be displayed and information to be tailored to the user’s preference from a simple interface. We set out to: (i) Develop a freely available web-based “point and click” interactive tool which allows users to input their DTA study data and conduct meta-analyses for DTA reviews, including sensitivity analyses. (ii) Illustrate the features and benefits of the interactive application using an existing DTA meta-analysis for detecting dementia.

Methods

To create our online freely available interactive application we used the existing R packages lme4 and Shiny to analyse the data and create an interactive user interface respectively.

Results

MetaDTA, an interactive online application was created for conducting meta-analysis of DTA studies. The user interface was designed to be easy to navigate having different tabs for different functions. Features include the ability for users to enter their own data, customise plots, incorporate quality assessment results and quickly conduct sensitivity analyses. All plots produced can be exported as either .png or .pdf files to be included in report documents. All tables can be exported as .csv files.

Conclusions

MetaDTA, is a freely available interactive online application which meta-analyses DTA studies, plots the summary ROC curve, incorporates quality assessment results and allows for sensitivity analyses to be conducted in a timely manner. Due to the rich feature-set and user-friendliness of the software it should appeal to a wide audience including those without specialist statistical knowledge. We encourage others to create similar applications for specialist analysis methods to encourage broader uptake which in-turn could improve research quality.

Thompson M, Van den Bruel A. Diagnostic Tests Toolkit. Heneghan C, Perera R, Badenoch D, editors. Chichester, West Sussex, UK: Wiley-Blackwell; 2011.

Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005;58(10):982–90.CrossRefPubMed

Rutter CM, Gatsonis CA. A hierarchical regression approach to meta-analysis of diagnostic test accuracy evaluations. Stat Med. 2001;20(19):2865–84.CrossRefPubMed

Chu H, Cole SR. Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach. J Clin Epidemiol. 2006;59(12):1331–2 author reply 2-3.CrossRefPubMed

Murray S. In: Blanchette M, Demarest R, editors. Interactive data visualization for the web. Sebastopol: California: O'Reilly Media; 2013.

Yi J, Kang Y, Stasko J, Jacko J. Toward a deeper understanding of the role of interaction in information visualization. IEEE Trans Vis Comput Graph. 2007;13(6):1224–31.CrossRefPubMed

Barrett JK, Farewell VT, Siannis F, Tierney J, Higgins J. Two-stage meta-analysis of time-to-event data from individual participants using percentile ratios. Stat Med. 2012;26:3681–99.

Littenberg B, Moses L. Estimating diagnostic accuracy from multiple conflicting reports: a new meta-analytic method. Med Decis Mak. 1993;13:313–21.CrossRef

Moses L, Shapiro D, Littenberg B. Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Stat Med. 1993;12:1293–316.CrossRefPubMed

10.

Macaskill P, Gastonis C, Deeks JJ, Harbord R, Takwoingi Y. Chapter 10: Analysing and presenting results. In: Deeks JJ, Bossuyt P, Gastonis C, editors. Cochrane handbook for systematic reviews of diagnostic test accuracy version 1. The Cochrane collaboration. Available from: http://srdta.cochrane.org/; 2010.

11.

Whiting PF, Sterne JA, Westwood ME, Bachmann LM, Harbord R, Egger M, et al. Graphical presentation of diagnostic information. BMC Med Res Methodol. 2008;8:20.CrossRefPubMedPubMedCentral

12.

Gelman A, Unwin A. Infovis and statistical graphics: different goals, different looks. J Comput Graph Stat. 2013;22(1):2–28.CrossRef

13.

R Core Team. R: A language and environment for statistical computing: R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org/; 2017.

14.

Chang W, Cheng J, Allaire J, Xie Y, McPherson J. Shiny: web application framework for R. R package version 1.0.5. https://CRAN.R-project.org/package=shiny. 2017.

15.

Bates D, Maechler M, Bolker B, Walker S, Haubo Bojesen Christensen R, Singmann H, et al. lme4: Linear Mixed-Effects Models using 'Eigen' and S4. R package version 1.1-18-1. https://CRAN.R-project.org/package=lme4. 2018.

16.

Partlett C, Takwoingi Y. Meta analysis of test accuracy studies in R: a summary of user-written programs and step-by-step guide to using glmer. Version 1.0 august 2016. Available from: https://methods.cochrane.org/sdt/software-meta-analysis-dta-studies. 2016.

17.

Harbord RM, Deeks JJ, Egger M, Whiting P, Sterne JA. A unification of models for meta-analysis of diagnostic accuracy studies. Biostatistics. 2007;8(2):239–51.CrossRefPubMed

18.

Jackson C. msm: Multi-state Markov and hidden Markov models in continuous time. R package version 1.6.6. https://CRAN.R-project.org/package=msm. 2018.

19.

Whiting P, Rutjes A, Westwood M, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155:529–36.CrossRefPubMed

20.

Kriston L, Hölzel L, Weiser A, Berner M, Härter M. Meta-analysis: are 3 questions enough to detect unhealthy alcohol use? Ann Intern Med. 2008;149:879–88.CrossRefPubMed

21.

Ritchie C, Smailagic N, Noel-Storr AH, Takwoingi Y, Flicker L, Mason SE, et al. Plasma and cerebrospinal fluid amyloid beta for the diagnosis of Alzheimer's disease dementia and other dementias in people with mild cognitive impairment (MCI). Cochrane Database Syst Rev. (2014, 6):CD008782.

22.

Bujkiewicz S, Jones HE, Lai MC, Cooper NJ, Hawkins N, Squires H, et al. Development of a transparent interactive decision interrogator to facilitate the decision-making process in health care. Value Health. 2011;14(5):768–76.CrossRefPubMedPubMedCentral

23.

Guo J, Riebler A. meta4diag: Bayesian bivariate meta-analysis of diagnostic test studies for routine practice. J Stat Softw. 2018;83(1):1–31.CrossRef

24.

Victor B. Explorable Explanations. Available from: http://worrydream.com/ExplorableExplanations/, Accessed 11th May 2018.

25.

Sutton AJ. The use of explorable explanations in learning and research. Submitted. 2018.

Title: Development of an interactive web-based tool to conduct and interrogate meta-analysis of diagnostic test accuracy studies: MetaDTA
Authors: Suzanne C. Freeman
Clareece R. Kerby
Amit Patel
Nicola J. Cooper
Terry Quinn
Alex J. Sutton
Publication date: 01-12-2019
Publisher: BioMed Central
Published in: BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI: https://doi.org/10.1186/s12874-019-0724-x

At a glance: The STEP trials

Springer Medicine

Development of an interactive web-based tool to conduct and interrogate meta-analysis of diagnostic test accuracy studies: MetaDTA

Abstract

Background

Methods

Results

Conclusions

At a glance: The STEP trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2019

Comparison of a time-varying covariate model and a joint model of time-to-event outcomes in the presence of measurement error and interval censoring: application to kidney transplantation

Chronic Headache Education and Self-management Study (CHESS) – a mixed method feasibility study to inform the design of a randomised controlled trial

Evaluating selection bias in a population-based cohort study with low baseline participation: the LIFE-Adult-Study

Correction to: Methods to adjust for multiple comparisons in the analysis and sample size calculation of randomised controlled trials with multiple primary outcomes

Assessments of attrition bias in Cochrane systematic reviews are highly inconsistent and thus hindering trial comparability

Introducing a new estimator and test for the weighted all-cause hazard ratio