Skip to main content
Top
Published in: Endocrine Pathology 1/2019

Open Access 01-03-2019

Evaluation of 167 Gene Expression Classifier (GEC) and ThyroSeq v2 Diagnostic Accuracy in the Preoperative Assessment of Indeterminate Thyroid Nodules: Bivariate/HROC Meta-analysis

Authors: Martyna Borowczyk, Ewelina Szczepanek-Parulska, Michał Olejarz, Barbara Więckowska, Frederik A. Verburg, Szymon Dębicki, Bartłomiej Budny, Małgorzata Janicka-Jedyńska, Katarzyna Ziemnicka, Marek Ruchała

Published in: Endocrine Pathology | Issue 1/2019

Login to get access

Abstract

The objective of this meta-analysis was to evaluate the performance of the Gene Expression Classifier (GEC) and ThyroSeq v2 (ThyroSeq) in the preoperative diagnosis of thyroid nodules with indeterminate fine-needle aspiration biopsy results. We searched literature databases from January 2001 to April 2018. The bivariate model analysis was performed to estimate pooled sensitivity, specificity, positive likelihood ratio (LR+), negative likelihood ratio (LR−), positive predictive value (PPV), and negative predictive value (NPV). Pooled data from 1086 nodules with histopathologic confirmation from 16 GEC studies enabled calculation of diagnostic parameters (95% confidence interval): sensitivity 98% (96–99%), specificity 12% (8–20%), PPV 45% (37–53%), and NPV 91% (85–96%). Pooled data from five ThyroSeq studies assessing 459 nodules showed sensitivity of 84% (74–91%), specificity 78% (50–92%), PPV 58% (31–81%), and NPV 93% (89–97%). When both tools were compared, GEC had a significantly higher sensitivity (p = 0.003), while ThyroSeq had a significantly higher specificity (p < 0.001) and accuracy (p = 0.015). Pooled LR+ was higher for ThyroSeq: 3.79 (1.40–10.27) vs. 1.12 (1.05–1.20). Pooled LR− was higher for GEC, 0.20 (0.10–0.39) vs. 0.13 (0.05–0.31). The bivariate summary estimates of sensitivity and specificity for GEC and ThyroSeq and their pooled accuracy showed a superiority of the ThyroSeq test. The GEC with a high sensitivity and NPV may be helpful in ruling out malignancy in cases of indeterminate thyroid nodule cytology. ThyroSeq has a significantly higher specificity and accuracy with an acceptable sensitivity so that it has the potential for use as an all-round test of malignancy of thyroid nodules.
Literature
1.
go back to reference Bongiovanni M, Spitale A, Faquin WC, Mazzucchelli L, Baloch ZW. The Bethesda System for Reporting Thyroid Cytopathology: a meta-analysis. Acta Cytol. 2012;56(4):333–339.CrossRef Bongiovanni M, Spitale A, Faquin WC, Mazzucchelli L, Baloch ZW. The Bethesda System for Reporting Thyroid Cytopathology: a meta-analysis. Acta Cytol. 2012;56(4):333–339.CrossRef
2.
go back to reference Ho AS, Sarti EE, Jain KS, Wang H, Nixon IJ, Shaha AR, Shah JP, Kraus DH, Ghossein R, Fish SA, Wong RJ, Lin O, Morris LGT Malignancy rate in thyroid nodules classified as Bethesda category III (AUS/FLUS). Thyroid. 2014;24(5):832–839.CrossRef Ho AS, Sarti EE, Jain KS, Wang H, Nixon IJ, Shaha AR, Shah JP, Kraus DH, Ghossein R, Fish SA, Wong RJ, Lin O, Morris LGT Malignancy rate in thyroid nodules classified as Bethesda category III (AUS/FLUS). Thyroid. 2014;24(5):832–839.CrossRef
3.
go back to reference Haugen BR, Alexander EK, Bible KC, et al. 2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid. 2016;26(1):1–133. Haugen BR, Alexander EK, Bible KC, et al. 2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid. 2016;26(1):1–133.
4.
go back to reference Nikiforov YE, Ohori NP, Hodak SP, Carty SE, LeBeau SO, Ferris RL, Yip L, Seethala RR, Tublin ME, Stang MT, Coyne C, Johnson JT, Stewart AF, Nikiforova MN Impact of mutational testing on the diagnosis and management of patients with cytologically indeterminate thyroid nodules: a prospective analysis of 1056 FNA samples. J Clin Endocrinol Metab. 2011;96(11):3390–3397.CrossRef Nikiforov YE, Ohori NP, Hodak SP, Carty SE, LeBeau SO, Ferris RL, Yip L, Seethala RR, Tublin ME, Stang MT, Coyne C, Johnson JT, Stewart AF, Nikiforova MN Impact of mutational testing on the diagnosis and management of patients with cytologically indeterminate thyroid nodules: a prospective analysis of 1056 FNA samples. J Clin Endocrinol Metab. 2011;96(11):3390–3397.CrossRef
5.
go back to reference Alexander EK, Kennedy GC, Baloch ZW, Cibas ES, Chudova D, Diggans J, Friedman L, Kloos RT, LiVolsi VA, Mandel SJ, Raab SS, Rosai J, Steward DL, Walsh PS, Wilde JI, Zeiger MA, Lanman RB, Haugen BR Preoperative diagnosis of benign thyroid nodules with indeterminate cytology. N Engl J Med. 2012;367(8):705–715.CrossRef Alexander EK, Kennedy GC, Baloch ZW, Cibas ES, Chudova D, Diggans J, Friedman L, Kloos RT, LiVolsi VA, Mandel SJ, Raab SS, Rosai J, Steward DL, Walsh PS, Wilde JI, Zeiger MA, Lanman RB, Haugen BR Preoperative diagnosis of benign thyroid nodules with indeterminate cytology. N Engl J Med. 2012;367(8):705–715.CrossRef
6.
go back to reference Marti JL, Avadhani V, Donatelli LA, Niyogi S, Wang B, Wong RJ, Shaha AR, Ghossein RA, Lin O, Morris LGT, Ho AS Wide Inter-institutional Variation in Performance of a Molecular Classifier for Indeterminate Thyroid Nodules. Ann Surg Oncol. 2015;22(12):3996–4001.CrossRef Marti JL, Avadhani V, Donatelli LA, Niyogi S, Wang B, Wong RJ, Shaha AR, Ghossein RA, Lin O, Morris LGT, Ho AS Wide Inter-institutional Variation in Performance of a Molecular Classifier for Indeterminate Thyroid Nodules. Ann Surg Oncol. 2015;22(12):3996–4001.CrossRef
7.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.CrossRef Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.CrossRef
8.
go back to reference Higgins JPTG, S., eds. Cochrane hand book for systematic reviews of interventions version 5.1.0. 2011. Higgins JPTG, S., eds. Cochrane hand book for systematic reviews of interventions version 5.1.0. 2011.
9.
go back to reference Zeng X, Zhang Y, Kwong JS, et al. The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review. J Evid Based Med. 2015;8(1):2–10.CrossRef Zeng X, Zhang Y, Kwong JS, et al. The methodological quality assessment tools for preclinical and clinical studies, systematic review and meta-analysis, and clinical practice guideline: a systematic review. J Evid Based Med. 2015;8(1):2–10.CrossRef
10.
go back to reference Wells GAS, B.; O’Connell, D. et al. The Newcastle-Ottawa scale (nos) for assessing the quality of nonrandomized studies in meta-analyses. The 3rd symposium on systematic reviews: Beyond the basics. Oxford, England2000. Wells GAS, B.; O’Connell, D. et al. The Newcastle-Ottawa scale (nos) for assessing the quality of nonrandomized studies in meta-analyses. The 3rd symposium on systematic reviews: Beyond the basics. Oxford, England2000.
11.
go back to reference Macaskill P, Gatsonis C, Deeks J, Harbord R, Takwoingi Y. Chapter 10: Analysing and Presenting Results. The Cochrane Collaboration; 2010. Macaskill P, Gatsonis C, Deeks J, Harbord R, Takwoingi Y. Chapter 10: Analysing and Presenting Results. The Cochrane Collaboration; 2010.
12.
go back to reference Leeflang MM, Deeks JJ, Rutjes AW, Reitsma JB, Bossuyt PM. Bivariate meta-analysis of predictive values of diagnostic tests can be an alternative to bivariate meta-analysis of sensitivity and specificity. J Clin Epidemiol. 2012;65(10):1088–1097.CrossRef Leeflang MM, Deeks JJ, Rutjes AW, Reitsma JB, Bossuyt PM. Bivariate meta-analysis of predictive values of diagnostic tests can be an alternative to bivariate meta-analysis of sensitivity and specificity. J Clin Epidemiol. 2012;65(10):1088–1097.CrossRef
13.
go back to reference Harrell RM, Bimston DN. Surgical utility of Afirma: effects of high cancer prevalence and oncocytic cell types in patients with indeterminate thyroid cytology. Endocr Pract. 2014;20(4):364–369.CrossRef Harrell RM, Bimston DN. Surgical utility of Afirma: effects of high cancer prevalence and oncocytic cell types in patients with indeterminate thyroid cytology. Endocr Pract. 2014;20(4):364–369.CrossRef
14.
go back to reference Alexander EK, Schorr M, Klopper J, Kim C, Sipos J, Nabhan F, Parker C, Steward DL, Mandel SJ, Haugen BR Multicenter clinical experience with the Afirma gene expression classifier. J Clin Endocrinol Metab. 2014;99(1):119–125.CrossRef Alexander EK, Schorr M, Klopper J, Kim C, Sipos J, Nabhan F, Parker C, Steward DL, Mandel SJ, Haugen BR Multicenter clinical experience with the Afirma gene expression classifier. J Clin Endocrinol Metab. 2014;99(1):119–125.CrossRef
15.
go back to reference Han LO, Li XY, Cao MM, Cao Y, Zhou LH. Development and validation of an individualized diagnostic signature in thyroid cancer. Cancer Med. 2018;7(4):1135–1140.CrossRef Han LO, Li XY, Cao MM, Cao Y, Zhou LH. Development and validation of an individualized diagnostic signature in thyroid cancer. Cancer Med. 2018;7(4):1135–1140.CrossRef
16.
go back to reference Lastra RR, Pramick MR, Crammer CJ, LiVolsi VA, Baloch ZW. Implications of a suspicious afirma test result in thyroid fine-needle aspiration cytology: an institutional experience. Cancer Cytopathol. 2014;122(10):737–744.CrossRef Lastra RR, Pramick MR, Crammer CJ, LiVolsi VA, Baloch ZW. Implications of a suspicious afirma test result in thyroid fine-needle aspiration cytology: an institutional experience. Cancer Cytopathol. 2014;122(10):737–744.CrossRef
17.
go back to reference McIver B, Castro MR, Morris JC, Bernet V, Smallridge R, Henry M, Kosok L, Reddi H An independent study of a gene expression classifier (Afirma) in the evaluation of cytologically indeterminate thyroid nodules. J Clin Endocrinol Metab. 2014;99(11):4069–4077.CrossRef McIver B, Castro MR, Morris JC, Bernet V, Smallridge R, Henry M, Kosok L, Reddi H An independent study of a gene expression classifier (Afirma) in the evaluation of cytologically indeterminate thyroid nodules. J Clin Endocrinol Metab. 2014;99(11):4069–4077.CrossRef
18.
go back to reference Celik B, Whetsell CR, Nassar A. Afirma GEC and thyroid lesions: An institutional experience. Diagn Cytopathol. 2015;43(12):966–970.CrossRef Celik B, Whetsell CR, Nassar A. Afirma GEC and thyroid lesions: An institutional experience. Diagn Cytopathol. 2015;43(12):966–970.CrossRef
19.
go back to reference Noureldine SI, Olson MT, Agrawal N, Prescott JD, Zeiger MA, Tufano RP. Effect of Gene Expression Classifier Molecular Testing on the Surgical Decision-Making Process for Patients With Thyroid Nodules. JAMA Otolaryngol Head Neck Surg. 2015;141(12):1082–1088.CrossRef Noureldine SI, Olson MT, Agrawal N, Prescott JD, Zeiger MA, Tufano RP. Effect of Gene Expression Classifier Molecular Testing on the Surgical Decision-Making Process for Patients With Thyroid Nodules. JAMA Otolaryngol Head Neck Surg. 2015;141(12):1082–1088.CrossRef
20.
go back to reference Yang SE, Sullivan PS, Zhang J, Govind R, Levin MR, Rao JY, Moatamed NA Has Afirma gene expression classifier testing refined the indeterminate thyroid category in cytology? Cancer Cytopathol. 2016;124(2):100–109.CrossRef Yang SE, Sullivan PS, Zhang J, Govind R, Levin MR, Rao JY, Moatamed NA Has Afirma gene expression classifier testing refined the indeterminate thyroid category in cytology? Cancer Cytopathol. 2016;124(2):100–109.CrossRef
21.
go back to reference Zhu QL, Faquin WC, Samir AE. Relationship Between Sonographic Characteristics and Afirma Gene Expression Classifier Results in Thyroid Nodules With Indeterminate Fine-Needle Aspiration Cytopathology. AJR Am J Roentgenol. 2015;205(4):861–865.CrossRef Zhu QL, Faquin WC, Samir AE. Relationship Between Sonographic Characteristics and Afirma Gene Expression Classifier Results in Thyroid Nodules With Indeterminate Fine-Needle Aspiration Cytopathology. AJR Am J Roentgenol. 2015;205(4):861–865.CrossRef
22.
go back to reference Abeykoon JP, Mueller L, Dong F, Chintakuntlawar AV, Paludo J, Mortada R. The Effect of Implementing Gene Expression Classifier on Outcomes of Thyroid Nodules with Indeterminate Cytology. Horm Cancer. 2016;7(4):272–278.CrossRef Abeykoon JP, Mueller L, Dong F, Chintakuntlawar AV, Paludo J, Mortada R. The Effect of Implementing Gene Expression Classifier on Outcomes of Thyroid Nodules with Indeterminate Cytology. Horm Cancer. 2016;7(4):272–278.CrossRef
23.
go back to reference Chaudhary S, Hou Y, Shen R, Hooda S, Li Z. Impact of the Afirma Gene Expression Classifier Result on the Surgical Management of Thyroid Nodules with Category III/IV Cytology and Its Correlation with Surgical Outcome. Acta Cytol. 2016;60(3):205–210.CrossRef Chaudhary S, Hou Y, Shen R, Hooda S, Li Z. Impact of the Afirma Gene Expression Classifier Result on the Surgical Management of Thyroid Nodules with Category III/IV Cytology and Its Correlation with Surgical Outcome. Acta Cytol. 2016;60(3):205–210.CrossRef
24.
go back to reference Sacks WL, Bose S, Zumsteg ZS, et al. Impact of Afirma gene expression classifier on cytopathology diagnosis and rate of thyroidectomy. Cancer. 2016;124(10):722–728. Sacks WL, Bose S, Zumsteg ZS, et al. Impact of Afirma gene expression classifier on cytopathology diagnosis and rate of thyroidectomy. Cancer. 2016;124(10):722–728.
25.
go back to reference Witt RL. Outcome of thyroid gene expression classifier testing in clinical practice. Laryngoscope. 2016;126(2):524–527.CrossRef Witt RL. Outcome of thyroid gene expression classifier testing in clinical practice. Laryngoscope. 2016;126(2):524–527.CrossRef
26.
go back to reference Wu JX, Lam R, Levin M, Rao J, Sullivan PS, Yeh MW. Effect of malignancy rates on cost-effectiveness of routine gene expression classifier testing for indeterminate thyroid nodules. Surgery. 2016;159(1):118–126.CrossRef Wu JX, Lam R, Levin M, Rao J, Sullivan PS, Yeh MW. Effect of malignancy rates on cost-effectiveness of routine gene expression classifier testing for indeterminate thyroid nodules. Surgery. 2016;159(1):118–126.CrossRef
27.
go back to reference Nikiforov YE, Carty SE, Chiosea SI, Coyne C, Duvvuri U, Ferris RL, Gooding WE, Hodak SP, LeBeau SO, Ohori NP, Seethala RR, Tublin ME, Yip L, Nikiforova MN Highly accurate diagnosis of cancer in thyroid nodules with follicular neoplasm/suspicious for a follicular neoplasm cytology by ThyroSeq v2 next-generation sequencing assay. Cancer. 2014;120(23):3627–3634.CrossRef Nikiforov YE, Carty SE, Chiosea SI, Coyne C, Duvvuri U, Ferris RL, Gooding WE, Hodak SP, LeBeau SO, Ohori NP, Seethala RR, Tublin ME, Yip L, Nikiforova MN Highly accurate diagnosis of cancer in thyroid nodules with follicular neoplasm/suspicious for a follicular neoplasm cytology by ThyroSeq v2 next-generation sequencing assay. Cancer. 2014;120(23):3627–3634.CrossRef
28.
go back to reference Nikiforov YE, Carty SE, Chiosea SI, Coyne C, Duvvuri U, Ferris RL, Gooding WE, LeBeau S, Ohori NP, Seethala RR, Tublin ME, Yip L, Nikiforova MN Impact of the Multi-Gene ThyroSeq Next-Generation Sequencing Assay on Cancer Diagnosis in Thyroid Nodules with Atypia of Undetermined Significance/Follicular Lesion of Undetermined Significance Cytology. Thyroid. 2015;25(11):1217–1223.CrossRef Nikiforov YE, Carty SE, Chiosea SI, Coyne C, Duvvuri U, Ferris RL, Gooding WE, LeBeau S, Ohori NP, Seethala RR, Tublin ME, Yip L, Nikiforova MN Impact of the Multi-Gene ThyroSeq Next-Generation Sequencing Assay on Cancer Diagnosis in Thyroid Nodules with Atypia of Undetermined Significance/Follicular Lesion of Undetermined Significance Cytology. Thyroid. 2015;25(11):1217–1223.CrossRef
29.
go back to reference Shrestha RT, Evasovich MR, Amin K, Radulescu A, Sanghvi TS, Nelson AC, Shahi M, Burmeister LA Correlation Between Histological Diagnosis and Mutational Panel Testing of Thyroid Nodules: A Two-Year Institutional Experience. Thyroid. 2016;26(8):1068–1076.CrossRef Shrestha RT, Evasovich MR, Amin K, Radulescu A, Sanghvi TS, Nelson AC, Shahi M, Burmeister LA Correlation Between Histological Diagnosis and Mutational Panel Testing of Thyroid Nodules: A Two-Year Institutional Experience. Thyroid. 2016;26(8):1068–1076.CrossRef
30.
go back to reference Valderrabano P, Khazai L, Leon ME, Thompson ZJ, Ma Z, Chung CH, Hallanger-Johnson JE, Otto KJ, Rogers KD, Centeno BA, McIver B Evaluation of ThyroSeq v2 performance in thyroid nodules with indeterminate cytology. Endocr Relat Cancer. 2017;24(3):127–136.CrossRef Valderrabano P, Khazai L, Leon ME, Thompson ZJ, Ma Z, Chung CH, Hallanger-Johnson JE, Otto KJ, Rogers KD, Centeno BA, McIver B Evaluation of ThyroSeq v2 performance in thyroid nodules with indeterminate cytology. Endocr Relat Cancer. 2017;24(3):127–136.CrossRef
31.
go back to reference Taye A, Gurciullo D, Miles BA, Gupta A, Owen RP, Inabnet III WB, Beyda JN, Marti JL Clinical performance of a next-generation sequencing assay (ThyroSeq v2) in the evaluation of indeterminate thyroid nodules. Surgery. 2018;163(1):97–103.CrossRef Taye A, Gurciullo D, Miles BA, Gupta A, Owen RP, Inabnet III WB, Beyda JN, Marti JL Clinical performance of a next-generation sequencing assay (ThyroSeq v2) in the evaluation of indeterminate thyroid nodules. Surgery. 2018;163(1):97–103.CrossRef
32.
go back to reference Paschke R, Cantara S, Crescenzi A, Jarzab B, Musholt TJ, Sobrinho Simoes M. European Thyroid Association Guidelines regarding Thyroid Nodule Molecular Fine-Needle Aspiration Cytology Diagnostics. Eur Thyroid J. 2017;6(3):115–129.CrossRef Paschke R, Cantara S, Crescenzi A, Jarzab B, Musholt TJ, Sobrinho Simoes M. European Thyroid Association Guidelines regarding Thyroid Nodule Molecular Fine-Needle Aspiration Cytology Diagnostics. Eur Thyroid J. 2017;6(3):115–129.CrossRef
33.
go back to reference Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005;58(10):982–990.CrossRef Reitsma JB, Glas AS, Rutjes AW, Scholten RJ, Bossuyt PM, Zwinderman AH. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol. 2005;58(10):982–990.CrossRef
34.
go back to reference Guideline EJ. Meta-analysis of diagnostic test accuracy studies. 2014. Guideline EJ. Meta-analysis of diagnostic test accuracy studies. 2014.
35.
go back to reference Nikiforova MN, Mercurio S, Wald AI, Barbi de Moura M, Callenberg K, Santana-Santos L, Gooding WE, Yip L, Ferris RL, Nikiforov YE Analytical performance of the ThyroSeq v3 genomic classifier for cancer diagnosis in thyroid nodules. Cancer. 2018;124(8):1682–1690.CrossRef Nikiforova MN, Mercurio S, Wald AI, Barbi de Moura M, Callenberg K, Santana-Santos L, Gooding WE, Yip L, Ferris RL, Nikiforov YE Analytical performance of the ThyroSeq v3 genomic classifier for cancer diagnosis in thyroid nodules. Cancer. 2018;124(8):1682–1690.CrossRef
Metadata
Title
Evaluation of 167 Gene Expression Classifier (GEC) and ThyroSeq v2 Diagnostic Accuracy in the Preoperative Assessment of Indeterminate Thyroid Nodules: Bivariate/HROC Meta-analysis
Authors
Martyna Borowczyk
Ewelina Szczepanek-Parulska
Michał Olejarz
Barbara Więckowska
Frederik A. Verburg
Szymon Dębicki
Bartłomiej Budny
Małgorzata Janicka-Jedyńska
Katarzyna Ziemnicka
Marek Ruchała
Publication date
01-03-2019
Publisher
Springer US
Published in
Endocrine Pathology / Issue 1/2019
Print ISSN: 1046-3976
Electronic ISSN: 1559-0097
DOI
https://doi.org/10.1007/s12022-018-9560-5

Other articles of this Issue 1/2019

Endocrine Pathology 1/2019 Go to the issue