Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2004

Open Access 01-12-2004 | Research article

Proportional odds ratio model for comparison of diagnostic tests in meta-analysis

Authors: Mir Said Siadaty, Jianfen Shu

Published in: BMC Medical Research Methodology | Issue 1/2004

Login to get access

Abstract

Background

Consider a meta-analysis where a 'head-to-head' comparison of diagnostic tests for a disease of interest is intended. Assume there are two or more tests available for the disease, where each test has been studied in one or more papers. Some of the papers may have studied more than one test, hence the results are not independent. Also the collection of tests studied may change from one paper to the other, hence incomplete matched groups.

Methods

We propose a model, the proportional odds ratio (POR) model, which makes no assumptions about the shape of OR p , a baseline function capturing the way OR changes across papers. The POR model does not assume homogeneity of ORs, but merely specifies a relationship between the ORs of the two tests.
One may expand the domain of the POR model to cover dependent studies, multiple outcomes, multiple thresholds, multi-category or continuous tests, and individual-level data.

Results

In the paper we demonstrate how to formulate the model for a few real examples, and how to use widely available or popular statistical software (like SAS, R or S-Plus, and Stata) to fit the models, and estimate the discrimination accuracy of tests. Furthermore, we provide code for converting ORs into other measures of test performance like predictive values, post-test probabilities, and likelihood ratios, under mild conditions. Also we provide code to convert numerical results into graphical ones, like forest plots, heterogeneous ROC curves, and post test probability difference graphs.

Conclusions

The flexibility of POR model, coupled with ease with which it can be estimated in familiar software, suits the daily practice of meta-analysis and improves clinical decision-making.
Appendix
Available only for authorised users
Literature
1.
go back to reference L'Abbe KA, Detsky AS, O'Rourke K: Meta-analysis in clinical research. Ann Intern Med. 1987, 107: 224-33.CrossRefPubMed L'Abbe KA, Detsky AS, O'Rourke K: Meta-analysis in clinical research. Ann Intern Med. 1987, 107: 224-33.CrossRefPubMed
2.
go back to reference Dorfman DD, Berbaum KS, Metz CE: Receiver operating characteristic rating analysis. Invest Radiol. 1992, 27 (9): 723-731.CrossRefPubMed Dorfman DD, Berbaum KS, Metz CE: Receiver operating characteristic rating analysis. Invest Radiol. 1992, 27 (9): 723-731.CrossRefPubMed
3.
go back to reference Irwig L, Tosteson ANA, Gatsonis C, Lau J, Colditz G, Chalmers TC, Mosteller F: Guidelines for meta-analyses evaluating diagnostic tests. Ann Intern Med. 1994, 120: 667-676.CrossRefPubMed Irwig L, Tosteson ANA, Gatsonis C, Lau J, Colditz G, Chalmers TC, Mosteller F: Guidelines for meta-analyses evaluating diagnostic tests. Ann Intern Med. 1994, 120: 667-676.CrossRefPubMed
4.
go back to reference Rutter CM, Gatsonis CA: Regression methods for meta-analysis of diagnostic test data. Acad Radiol. 1995, 2: S48-S56.PubMed Rutter CM, Gatsonis CA: Regression methods for meta-analysis of diagnostic test data. Acad Radiol. 1995, 2: S48-S56.PubMed
5.
go back to reference Nelson TO: ROC curves and measures of discrimination accuracy: A reply to Swets. Psychol Bull. 1986, 99 (1): 128-132.CrossRef Nelson TO: ROC curves and measures of discrimination accuracy: A reply to Swets. Psychol Bull. 1986, 99 (1): 128-132.CrossRef
6.
go back to reference Tosteson AN, Begg CB: A general regression methodology for ROC curve estimation. Med Decis Making. 1988, 8: 204-215.CrossRefPubMed Tosteson AN, Begg CB: A general regression methodology for ROC curve estimation. Med Decis Making. 1988, 8: 204-215.CrossRefPubMed
7.
go back to reference Kardaun JW, Kardaun OJWF: Comparative diagnostic performance of three radiological procedures for the detection of lumbar disk herniation. Meth Inform Med. 1990, 29: 12-22.PubMed Kardaun JW, Kardaun OJWF: Comparative diagnostic performance of three radiological procedures for the detection of lumbar disk herniation. Meth Inform Med. 1990, 29: 12-22.PubMed
8.
go back to reference Moses LE, Shapiro D, Littenberg B: Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Stat Med. 1993, 12 (14): 1293-316.CrossRefPubMed Moses LE, Shapiro D, Littenberg B: Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Stat Med. 1993, 12 (14): 1293-316.CrossRefPubMed
9.
go back to reference Toledano A, Gatsonis CA: Regression analysis of correlated receiver operating characteristic data. Acad Radiol. 1995, 2: S30-S36.PubMed Toledano A, Gatsonis CA: Regression analysis of correlated receiver operating characteristic data. Acad Radiol. 1995, 2: S30-S36.PubMed
10.
go back to reference Siadaty MS, Philbrick JT, Heim SW, Schectman JM: Repeated-measures modeling improved comparison of diagnostic tests in meta-analysis of dependent studies. Journal of Clinical Epidemiology. 2004, 57 (7): 698-710.CrossRefPubMed Siadaty MS, Philbrick JT, Heim SW, Schectman JM: Repeated-measures modeling improved comparison of diagnostic tests in meta-analysis of dependent studies. Journal of Clinical Epidemiology. 2004, 57 (7): 698-710.CrossRefPubMed
11.
go back to reference Irwig L, Macaskill P, Glasziou P, Fahey M: Meta-analytic methods for diagnostic test accuracy. J Clin Epidemiol. 1995, 48 (1): 119-130. 10.1016/0895-4356(94)00099-C.CrossRefPubMed Irwig L, Macaskill P, Glasziou P, Fahey M: Meta-analytic methods for diagnostic test accuracy. J Clin Epidemiol. 1995, 48 (1): 119-130. 10.1016/0895-4356(94)00099-C.CrossRefPubMed
12.
go back to reference Hosmer DW, Lemeshow S: Applied Logistic Regression. 1989, New York: Wiley-Interscience Hosmer DW, Lemeshow S: Applied Logistic Regression. 1989, New York: Wiley-Interscience
13.
go back to reference McClish DK: Combining and comparing area estimates across studies or strata. Med Decis Making. 1992, 12: 274-279.CrossRefPubMed McClish DK: Combining and comparing area estimates across studies or strata. Med Decis Making. 1992, 12: 274-279.CrossRefPubMed
14.
go back to reference McCullagh P: Regression models for ordinal data. J R Statist Soc B. 1980, 42 (2): 109-142. McCullagh P: Regression models for ordinal data. J R Statist Soc B. 1980, 42 (2): 109-142.
15.
go back to reference Diggle P, Heagerty P, Liang KY, Zeger S: Analysis of Longitudinal Data. 2002, New York: Oxford University Press Diggle P, Heagerty P, Liang KY, Zeger S: Analysis of Longitudinal Data. 2002, New York: Oxford University Press
16.
go back to reference Ihaka R, Gentleman RR: A language for data analysis and graphics. Journal of Computational and Graphical Statistics. 1996, 5: 299-314. Ihaka R, Gentleman RR: A language for data analysis and graphics. Journal of Computational and Graphical Statistics. 1996, 5: 299-314.
17.
go back to reference Agresti A: An Introduction to Categorical Data Analysis. 1996, New York: Wiley-Interscience Agresti A: An Introduction to Categorical Data Analysis. 1996, New York: Wiley-Interscience
18.
go back to reference Gleser LJ, Olkin I: Stochastically dependent effect sizes. In The Handbook of Research Synthesis. Edited by: Cooper H, Hedges LV. 1994, New York: Russell Sage Foundation, 339-56. Gleser LJ, Olkin I: Stochastically dependent effect sizes. In The Handbook of Research Synthesis. Edited by: Cooper H, Hedges LV. 1994, New York: Russell Sage Foundation, 339-56.
19.
go back to reference DuMouchel W: Repeated measures meta-analyses. Bulletin of the International Statistical Institute, Session 51, Tome LVII, Book 1. 1998, 285-288. DuMouchel W: Repeated measures meta-analyses. Bulletin of the International Statistical Institute, Session 51, Tome LVII, Book 1. 1998, 285-288.
20.
go back to reference Heim SW, Schectman JM, Siadaty MS, Philbrick JT: D-dimer testing for deep venous thrombosis: a metaanalysis. Clin Chem. 2004, 50 (7): 1136-47. 10.1373/clinchem.2004.031765.CrossRefPubMed Heim SW, Schectman JM, Siadaty MS, Philbrick JT: D-dimer testing for deep venous thrombosis: a metaanalysis. Clin Chem. 2004, 50 (7): 1136-47. 10.1373/clinchem.2004.031765.CrossRefPubMed
21.
go back to reference Hamilton GW, Trobaugh GB, Ritchie JL, Gould KL, DeRouen TA, Williams DL: Myocardial imaging with Thallium 201: an analysis of clinical usefulness based on Bayes' theorem. Semin Nucl Med. 1978, 8 (4): 358-364.CrossRefPubMed Hamilton GW, Trobaugh GB, Ritchie JL, Gould KL, DeRouen TA, Williams DL: Myocardial imaging with Thallium 201: an analysis of clinical usefulness based on Bayes' theorem. Semin Nucl Med. 1978, 8 (4): 358-364.CrossRefPubMed
22.
go back to reference Cochrane methods group on systematic review of screening and diagnostic tests: recommended methods. Cochrane methods group on systematic review of screening and diagnostic tests: recommended methods.
23.
go back to reference Spitzer WO: The challenge of meta-analysis. J Clin Epidemiol. 1995, 48 (1): 1-4. 10.1016/0895-4356(94)00109-4.CrossRefPubMed Spitzer WO: The challenge of meta-analysis. J Clin Epidemiol. 1995, 48 (1): 1-4. 10.1016/0895-4356(94)00109-4.CrossRefPubMed
24.
go back to reference Neter J, Kutner MH, Wasserman W, Nachtsheim CJ: Applied Linear Statistical Models. 1996, Boston: McGraw-Hill/Irwin Neter J, Kutner MH, Wasserman W, Nachtsheim CJ: Applied Linear Statistical Models. 1996, Boston: McGraw-Hill/Irwin
25.
go back to reference Mosteller F, Chalmers T: Some progress and problems in meta-analysis of. clinical trials. Statistical Science. 1992, 7: 227-236.CrossRef Mosteller F, Chalmers T: Some progress and problems in meta-analysis of. clinical trials. Statistical Science. 1992, 7: 227-236.CrossRef
26.
go back to reference van Houwelingen HC, Arends LR, Stijnen T: Advanced methods in meta-analysis: multivariate approach and meta-regression. Stat Med. 2002, 21 (4): 589-624. 10.1002/sim.1040.CrossRefPubMed van Houwelingen HC, Arends LR, Stijnen T: Advanced methods in meta-analysis: multivariate approach and meta-regression. Stat Med. 2002, 21 (4): 589-624. 10.1002/sim.1040.CrossRefPubMed
27.
go back to reference Peterson WW, Birdsall TG, Fox WC: The theory of signal detectability. Transactions of the IRE professional group on information theory. 1954, 4: 171-212.CrossRef Peterson WW, Birdsall TG, Fox WC: The theory of signal detectability. Transactions of the IRE professional group on information theory. 1954, 4: 171-212.CrossRef
28.
go back to reference Tanner WP, Swets JA: A decision-making theory of visual detection. Psychol Rev. 1954, 61 (6): 401-409.CrossRefPubMed Tanner WP, Swets JA: A decision-making theory of visual detection. Psychol Rev. 1954, 61 (6): 401-409.CrossRefPubMed
29.
go back to reference Swets JA: Indices of discrimination or diagnostic accuracy: Their ROCs and implied models. Psychol Bull. 1986, 99 (1): 100-117. 10.1037//0033-2909.99.1.100.CrossRefPubMed Swets JA: Indices of discrimination or diagnostic accuracy: Their ROCs and implied models. Psychol Bull. 1986, 99 (1): 100-117. 10.1037//0033-2909.99.1.100.CrossRefPubMed
30.
go back to reference Ogilvie JC, Creelman CD: Maximum likelihood estimation of receiver operating characteristic curve parameters. J Math Psychol. 1968, 5: 377-391.CrossRef Ogilvie JC, Creelman CD: Maximum likelihood estimation of receiver operating characteristic curve parameters. J Math Psychol. 1968, 5: 377-391.CrossRef
31.
go back to reference Crouchley R, Davies RB: A comparison of population average and random-effect models for the analysis of longitudinal count data with base-line information. J R Statist Soc A. 1999, 162: 331-347. 10.1111/1467-985X.00139.CrossRef Crouchley R, Davies RB: A comparison of population average and random-effect models for the analysis of longitudinal count data with base-line information. J R Statist Soc A. 1999, 162: 331-347. 10.1111/1467-985X.00139.CrossRef
32.
go back to reference Victor N: "The challenge of meta-analysis": Discussion. Indications and contra-indications for meta-analysis. J Clin Epidemiol. 1995, 48 (1): 5-8. 10.1016/0895-4356(94)00107-2.CrossRefPubMed Victor N: "The challenge of meta-analysis": Discussion. Indications and contra-indications for meta-analysis. J Clin Epidemiol. 1995, 48 (1): 5-8. 10.1016/0895-4356(94)00107-2.CrossRefPubMed
33.
go back to reference Greenland S: Quantitative methods in the review of epidemiologic literature. Epidemiol Rev. 1987, 9: 1-30.PubMed Greenland S: Quantitative methods in the review of epidemiologic literature. Epidemiol Rev. 1987, 9: 1-30.PubMed
Metadata
Title
Proportional odds ratio model for comparison of diagnostic tests in meta-analysis
Authors
Mir Said Siadaty
Jianfen Shu
Publication date
01-12-2004
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2004
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-4-27

Other articles of this Issue 1/2004

BMC Medical Research Methodology 1/2004 Go to the issue