Skip to main content
Top
Published in: BMC Urology 1/2016

Open Access 01-12-2016 | Research article

The diagnostic accuracy of urine-based tests for bladder cancer varies greatly by patient

Authors: Ajay Gopalakrishna, Thomas A. Longo, Joseph J. Fantony, Richmond Owusu, Wen-Chi Foo, Rajesh Dash, Brant A. Inman

Published in: BMC Urology | Issue 1/2016

Login to get access

Abstract

Background

Spectrum effects refer to the phenomenon that test performance varies across subgroups of a population. When spectrum effects occur during diagnostic testing for cancer, difficult patient misdiagnoses can occur. Our objective was to evaluate the effect of test indication, age, gender, race, and smoking status on the performance characteristics of two commonly used diagnostic tests for bladder cancer, urine cytology and fluorescence in situ hybridization (FISH).

Methods

We assessed all subjects who underwent cystoscopy, cytology, and FISH at our institution from 2003 to 2012. The standard diagnostic test performance metrics were calculated using marginal models to account for clustered/repeated measures within subjects. We calculated test performance for the overall cohort by test indication as well as by key patient variables: age, gender, race, and smoking status.

Results

A total of 4023 cystoscopy-cytology pairs and 1696 FISH-cystoscopy pairs were included in the analysis. In both FISH and cytology, increasing age, male gender, and history of smoking were associated with increased sensitivity and decreased specificity. FISH performance was most impacted by age, with an increase in sensitivity from 17 % at age 40 to 49 % at age 80. The same was true of cytology, with an increase in sensitivity from 50 % at age 40 to 67 % at age 80. Sensitivity of FISH was higher for a previous diagnosis of bladder cancer (46 %) than for hematuria (26 %). Test indication had no impact on the performance of cytology and race had no significant impact on the performance of either test.

Conclusions

The diagnostic performance of urine cytology and FISH vary significantly according to the patient demographic in which they were tested. Hence, the reporting of spectrum effects in diagnostic tests should become part of standard practice. Patient-related factors must contextualize the clinicians’ interpretation of test results and their decision-making.
Literature
2.
go back to reference Raghavan D, Shipley WU, Garnick MB, Russell PJ, Richie JP. Biology and management of bladder cancer. N Engl J Med. 1990;322:1129–38.CrossRefPubMed Raghavan D, Shipley WU, Garnick MB, Russell PJ, Richie JP. Biology and management of bladder cancer. N Engl J Med. 1990;322:1129–38.CrossRefPubMed
3.
go back to reference Network NCC. NCCN Clinical Practice Guidelines in Oncology. Bladder Cancer. V.2.2015. 2015. Network NCC. NCCN Clinical Practice Guidelines in Oncology. Bladder Cancer. V.2.2015. 2015.
4.
go back to reference Hall MC, Chang SS, Dalbagni G, Pruthi RS, Seigne JD, Skinner EC, et al. Guideline for the management of nonmuscle invasive bladder cancer (stages Ta, T1, and Tis): 2007 update. J Urol. 2007;178:2314–30.CrossRefPubMed Hall MC, Chang SS, Dalbagni G, Pruthi RS, Seigne JD, Skinner EC, et al. Guideline for the management of nonmuscle invasive bladder cancer (stages Ta, T1, and Tis): 2007 update. J Urol. 2007;178:2314–30.CrossRefPubMed
5.
go back to reference Babjuk M, Burger M, Zigeuner R, Shariat SF, van Rhijn BW, Comperat E, et al. EAU guidelines on non-muscle-invasive urothelial carcinoma of the bladder: update 2013. Eur Urol. 2013;64:639–53.CrossRefPubMed Babjuk M, Burger M, Zigeuner R, Shariat SF, van Rhijn BW, Comperat E, et al. EAU guidelines on non-muscle-invasive urothelial carcinoma of the bladder: update 2013. Eur Urol. 2013;64:639–53.CrossRefPubMed
6.
go back to reference van der Aa MN, Steyerberg EW, Bangma C, van Rhijn BW, Zwarthoff EC, van der Kwast TH. Cystoscopy revisited as the gold standard for detecting bladder cancer recurrence: diagnostic review bias in the randomized, prospective CEFUB trial. J Urol. 2010;183:76–80.CrossRefPubMed van der Aa MN, Steyerberg EW, Bangma C, van Rhijn BW, Zwarthoff EC, van der Kwast TH. Cystoscopy revisited as the gold standard for detecting bladder cancer recurrence: diagnostic review bias in the randomized, prospective CEFUB trial. J Urol. 2010;183:76–80.CrossRefPubMed
7.
go back to reference Majewski T, Lee S, Jeong J, Yoon DS, Kram A, Kim MS, et al. Understanding the development of human bladder cancer by using a whole-organ genomic mapping strategy. Lab Invest. 2008;88:694–721.CrossRefPubMedPubMedCentral Majewski T, Lee S, Jeong J, Yoon DS, Kram A, Kim MS, et al. Understanding the development of human bladder cancer by using a whole-organ genomic mapping strategy. Lab Invest. 2008;88:694–721.CrossRefPubMedPubMedCentral
8.
go back to reference Swartz MA, Porter MP, Lin DW, Weiss NS. Incidence of primary urethral carcinoma in the United States. Urology. 2006;68:1164–8.CrossRefPubMed Swartz MA, Porter MP, Lin DW, Weiss NS. Incidence of primary urethral carcinoma in the United States. Urology. 2006;68:1164–8.CrossRefPubMed
9.
go back to reference Roupret M, Babjuk M, Comperat E, Zigeuner R, Sylvester RJ, Burger M, et al. European Association of Urology Guidelines on upper urinary tract urothelial cell carcinoma: 2015 update. Eur Urol. 2015;68:868–79.CrossRefPubMed Roupret M, Babjuk M, Comperat E, Zigeuner R, Sylvester RJ, Burger M, et al. European Association of Urology Guidelines on upper urinary tract urothelial cell carcinoma: 2015 update. Eur Urol. 2015;68:868–79.CrossRefPubMed
10.
go back to reference Ransohoff DF, Feinstein AR. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. N Engl J Med. 1978;299:926–30.CrossRefPubMed Ransohoff DF, Feinstein AR. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. N Engl J Med. 1978;299:926–30.CrossRefPubMed
11.
go back to reference Elie C, Coste J. A methodological framework to distinguish spectrum effects from spectrum biases and to assess diagnostic and screening test accuracy for patient populations: application to the Papanicolaou cervical cancer smear test. BMC Med Res Methodol. 2008;8:7.CrossRefPubMedPubMedCentral Elie C, Coste J. A methodological framework to distinguish spectrum effects from spectrum biases and to assess diagnostic and screening test accuracy for patient populations: application to the Papanicolaou cervical cancer smear test. BMC Med Res Methodol. 2008;8:7.CrossRefPubMedPubMedCentral
12.
go back to reference Mulherin SA, Miller WC. Spectrum bias or spectrum effect? Subgroup variation in diagnostic test evaluation. Ann Intern Med. 2002;137:598–602.CrossRefPubMed Mulherin SA, Miller WC. Spectrum bias or spectrum effect? Subgroup variation in diagnostic test evaluation. Ann Intern Med. 2002;137:598–602.CrossRefPubMed
13.
go back to reference Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Standards for Reporting of Diagnostic Accuracy. Clin Chem. 2003;49:1–6.CrossRefPubMed Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Standards for Reporting of Diagnostic Accuracy. Clin Chem. 2003;49:1–6.CrossRefPubMed
14.
go back to reference Clark PE, Agarwal N, Biagioli MC, Eisenberger MA, Greenberg RE, Herr HW, et al. Bladder cancer. J Natl Compr Canc Netw. 2013;11:446–75.PubMed Clark PE, Agarwal N, Biagioli MC, Eisenberger MA, Greenberg RE, Herr HW, et al. Bladder cancer. J Natl Compr Canc Netw. 2013;11:446–75.PubMed
15.
go back to reference Kamat AM, Hegarty PK, Gee JR, Clark PE, Svatek RS, Hegarty N, et al. ICUD-EAU International Consultation on Bladder Cancer 2012: Screening, diagnosis, and molecular markers. Eur Urol. 2013;63:4–15.CrossRefPubMed Kamat AM, Hegarty PK, Gee JR, Clark PE, Svatek RS, Hegarty N, et al. ICUD-EAU International Consultation on Bladder Cancer 2012: Screening, diagnosis, and molecular markers. Eur Urol. 2013;63:4–15.CrossRefPubMed
16.
go back to reference Karl A, Adejoro O, Saigal C, Konety B. General adherence to guideline recommendations on initial diagnosis of bladder cancer in the United States and influencing factors. Clin Genitourin Cancer. 2014;12:270–7.CrossRefPubMed Karl A, Adejoro O, Saigal C, Konety B. General adherence to guideline recommendations on initial diagnosis of bladder cancer in the United States and influencing factors. Clin Genitourin Cancer. 2014;12:270–7.CrossRefPubMed
17.
go back to reference Zhou XH. Correcting for verification bias in studies of a diagnostic test’s accuracy. Stat Methods Med Res. 1998;7:337–53.CrossRefPubMed Zhou XH. Correcting for verification bias in studies of a diagnostic test’s accuracy. Stat Methods Med Res. 1998;7:337–53.CrossRefPubMed
18.
go back to reference Smith GD, Bentz JS. “FISHing” to detect urinary and other cancers: validation of an imaging system to aid in interpretation. Cancer Cytopathol. 2010;118:56–64.CrossRefPubMed Smith GD, Bentz JS. “FISHing” to detect urinary and other cancers: validation of an imaging system to aid in interpretation. Cancer Cytopathol. 2010;118:56–64.CrossRefPubMed
19.
go back to reference Genders TS, Spronk S, Stijnen T, Steyerberg EW, Lesaffre E, Hunink MG. Methods for calculating sensitivity and specificity of clustered data: a tutorial. Radiology. 2012;265:910–6.CrossRefPubMed Genders TS, Spronk S, Stijnen T, Steyerberg EW, Lesaffre E, Hunink MG. Methods for calculating sensitivity and specificity of clustered data: a tutorial. Radiology. 2012;265:910–6.CrossRefPubMed
20.
go back to reference Fitzmaurice GM. Applied Longitudinal Analysis. Hobocken, New Jersey: Wiley; 2004. Fitzmaurice GM. Applied Longitudinal Analysis. Hobocken, New Jersey: Wiley; 2004.
21.
go back to reference Hubbard AE, Ahern J, Fleischer NL, Van der Laan M, Lippman SA, Jewell N, et al. To GEE or not to GEE: comparing population average and mixed models for estimating the associations between neighborhood risk factors and health. Epidemiology. 2010;21:467–74.CrossRefPubMed Hubbard AE, Ahern J, Fleischer NL, Van der Laan M, Lippman SA, Jewell N, et al. To GEE or not to GEE: comparing population average and mixed models for estimating the associations between neighborhood risk factors and health. Epidemiology. 2010;21:467–74.CrossRefPubMed
22.
go back to reference Taylor 3rd JA, Kuchel GA. Bladder cancer in the elderly: clinical outcomes, basic mechanisms, and future research direction. Nat Clin Pract Urol. 2009;6:135–44.CrossRefPubMedPubMedCentral Taylor 3rd JA, Kuchel GA. Bladder cancer in the elderly: clinical outcomes, basic mechanisms, and future research direction. Nat Clin Pract Urol. 2009;6:135–44.CrossRefPubMedPubMedCentral
23.
go back to reference Chamssuddin AK, Saadat SH, Deiri K, Zarzar MY, Abdouche N, Deeb O, et al. Evaluation of grade and stage in patients with bladder cancer among smokers and non-smokers. Arab J Urol. 2013;11:165–8.CrossRefPubMedPubMedCentral Chamssuddin AK, Saadat SH, Deiri K, Zarzar MY, Abdouche N, Deeb O, et al. Evaluation of grade and stage in patients with bladder cancer among smokers and non-smokers. Arab J Urol. 2013;11:165–8.CrossRefPubMedPubMedCentral
24.
go back to reference Horstmann M, Todenhofer T, Hennenlotter J, Aufderklamm S, Mischinger J, Kuehs U, et al. Influence of age on false positive rates of urine-based tumor markers. World J Urol. 2013;31:935–40.CrossRefPubMed Horstmann M, Todenhofer T, Hennenlotter J, Aufderklamm S, Mischinger J, Kuehs U, et al. Influence of age on false positive rates of urine-based tumor markers. World J Urol. 2013;31:935–40.CrossRefPubMed
25.
go back to reference Dimashkieh H, Wolff DJ, Smith TM, Houser PM, Nietert PJ, Yang J. Evaluation of urovysion and cytology for bladder cancer detection: a study of 1835 paired urine samples with clinical and histologic correlation. Cancer Cytopathol. 2013;121:591–7.CrossRefPubMedPubMedCentral Dimashkieh H, Wolff DJ, Smith TM, Houser PM, Nietert PJ, Yang J. Evaluation of urovysion and cytology for bladder cancer detection: a study of 1835 paired urine samples with clinical and histologic correlation. Cancer Cytopathol. 2013;121:591–7.CrossRefPubMedPubMedCentral
26.
go back to reference Fajkovic H, Halpern JA, Cha EK, Bahadori A, Chromecki TF, Karakiewicz PI, et al. Impact of gender on bladder cancer incidence, staging, and prognosis. World J Urol. 2011;29:457–63.CrossRefPubMed Fajkovic H, Halpern JA, Cha EK, Bahadori A, Chromecki TF, Karakiewicz PI, et al. Impact of gender on bladder cancer incidence, staging, and prognosis. World J Urol. 2011;29:457–63.CrossRefPubMed
27.
go back to reference Garg T, Pinheiro LC, Atoria CL, Donat SM, Weissman JS, Herr HW, et al. Gender disparities in hematuria evaluation and bladder cancer diagnosis: a population based analysis. J Urol. 2014;192:1072–7.CrossRefPubMedPubMedCentral Garg T, Pinheiro LC, Atoria CL, Donat SM, Weissman JS, Herr HW, et al. Gender disparities in hematuria evaluation and bladder cancer diagnosis: a population based analysis. J Urol. 2014;192:1072–7.CrossRefPubMedPubMedCentral
28.
go back to reference Straface E, Gambardella L, Brandani M, Malorni W. Sex differences at cellular level: "cells have a sex". Handb Exp Pharmacol. 2012;(214):49–65. Straface E, Gambardella L, Brandani M, Malorni W. Sex differences at cellular level: "cells have a sex". Handb Exp Pharmacol. 2012;(214):49–65.
29.
go back to reference Shen SS, Smith CL, Hsieh JT, Yu J, Kim IY, Jian W, et al. Expression of estrogen receptors-alpha and -beta in bladder cancer cell lines and human bladder tumor tissue. Cancer. 2006;106:2610–6.CrossRefPubMed Shen SS, Smith CL, Hsieh JT, Yu J, Kim IY, Jian W, et al. Expression of estrogen receptors-alpha and -beta in bladder cancer cell lines and human bladder tumor tissue. Cancer. 2006;106:2610–6.CrossRefPubMed
30.
go back to reference Tabernero MD, Espinosa AB, Maillo A, Rebelo O, Vera JF, Sayagues JM, et al. Patient gender is associated with distinct patterns of chromosomal abnormalities and sex chromosome linked gene-expression profiles in meningiomas. Oncologist. 2007;12:1225–36.CrossRefPubMed Tabernero MD, Espinosa AB, Maillo A, Rebelo O, Vera JF, Sayagues JM, et al. Patient gender is associated with distinct patterns of chromosomal abnormalities and sex chromosome linked gene-expression profiles in meningiomas. Oncologist. 2007;12:1225–36.CrossRefPubMed
31.
go back to reference Lachs MS, Nachamkin I, Edelstein PH, Goldman J, Feinstein AR, Schwartz JS. Spectrum bias in the evaluation of diagnostic tests: lessons from the rapid dipstick test for urinary tract infection. Ann Intern Med. 1992;117:135–40.CrossRefPubMed Lachs MS, Nachamkin I, Edelstein PH, Goldman J, Feinstein AR, Schwartz JS. Spectrum bias in the evaluation of diagnostic tests: lessons from the rapid dipstick test for urinary tract infection. Ann Intern Med. 1992;117:135–40.CrossRefPubMed
32.
go back to reference Tiu A, Jenkins LC, Soloway MS. Active surveillance for low-risk bladder cancer. Urol Oncol. 2014;32:33.e7–10.CrossRef Tiu A, Jenkins LC, Soloway MS. Active surveillance for low-risk bladder cancer. Urol Oncol. 2014;32:33.e7–10.CrossRef
33.
go back to reference Sherman AB, Koss LG, Adams SE. Interobserver and intraobserver differences in the diagnosis of urothelial cells. Comparison with classification by computer. Anal Quant Cytol. 1984;6:112–20.PubMed Sherman AB, Koss LG, Adams SE. Interobserver and intraobserver differences in the diagnosis of urothelial cells. Comparison with classification by computer. Anal Quant Cytol. 1984;6:112–20.PubMed
34.
go back to reference Raitanen MP, Aine R, Rintala E, Kallio J, Rajala P, Juusela H, et al. Differences between local and review urinary cytology in diagnosis of bladder cancer. An interobserver multicenter analysis. Eur Urol. 2002;41:284–9.CrossRefPubMed Raitanen MP, Aine R, Rintala E, Kallio J, Rajala P, Juusela H, et al. Differences between local and review urinary cytology in diagnosis of bladder cancer. An interobserver multicenter analysis. Eur Urol. 2002;41:284–9.CrossRefPubMed
Metadata
Title
The diagnostic accuracy of urine-based tests for bladder cancer varies greatly by patient
Authors
Ajay Gopalakrishna
Thomas A. Longo
Joseph J. Fantony
Richmond Owusu
Wen-Chi Foo
Rajesh Dash
Brant A. Inman
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Urology / Issue 1/2016
Electronic ISSN: 1471-2490
DOI
https://doi.org/10.1186/s12894-016-0147-5

Other articles of this Issue 1/2016

BMC Urology 1/2016 Go to the issue