Skip to main content
Top
Published in: Annals of Surgical Oncology 12/2015

01-11-2015 | Endocrine Tumors

Wide Inter-institutional Variation in Performance of a Molecular Classifier for Indeterminate Thyroid Nodules

Authors: Jennifer L. Marti, MD, FACS, Vaidehi Avadhani, MD, Luke A. Donatelli, MD, Sayani Niyogi, DO, Beverly Wang, MD, Richard J. Wong, MD, FACS, Ashok R. Shaha, MD, FACS, Ronald A. Ghossein, MD, Oscar Lin, MD, Luc G. T. Morris, MD, MSc, FACS, Allen S. Ho, MD

Published in: Annals of Surgical Oncology | Issue 12/2015

Login to get access

Abstract

Background

The Afirma gene expression classifier (GEC) is used to assess malignancy risk in indeterminate thyroid nodules (ITNs) classified as Bethesda category III/IV. Our objective was to analyze GEC performance at two institutions with high thyroid cytopathology volumes but differing prevalence of malignancy.

Methods

Retrospective analysis of all ITNs evaluated with the GEC at Memorial Sloan Kettering Cancer Center (MSK; n = 94) and Mount Sinai Beth Israel (MSBI; n = 71). These institutions have differing prevalences of malignancy in ITNs: 30–38 % (MSK) and 10–19 % (MSBI). Surgical pathology was correlated with GEC findings for each matched nodule. Performance characteristics were estimated using Bayes Theorem.

Results

Patient and nodule characteristics were similar at MSK and MSBI. The GEC-benign call rates were 38.3 % (MSK) and 52.1 % (MSBI). Of the GEC-benign nodules, 8.3 % (MSK) and 13.5 % (MSBI) were treated surgically. Surgical pathology indicated that all of GEC-benign nodules were benign. Of the GEC-suspicious nodules, 60.0 % (MSK) and 61.7 % (MSBI) underwent surgery. Positive predictive values (PPVs) for GEC-suspicious results were 57.1 % (95 % CI 41.0–72.3) at MSK and 14.3 % (95 % CI 0.2–30.2) at MSBI. The estimated negative predictive values (NPVs) were 86–92 % at MSK and 95–98 % at MSBI.

Conclusions

There were wide variations in the Afirma GEC-benign call rate, PPV, and NPV between MSBI (a comprehensive health system) and MSK (a tertiary referral cancer center), which had differing rates of malignancy in ITNs. The GEC could not routinely alter management in either institution. We believe that this assay would be expected to be most informative in practice settings where the prevalence of malignancy is 15–21 %, such that NPV >95 % and PPV >25 % would be anticipated. Knowing the prevalence of malignancy in ITNs at a particular institution is critical for reliable interpretation of GEC results.
Literature
1.
go back to reference Cibas ES, Ali SZ. The Bethesda system for reporting thyroid cytopathology. Thyroid. 2009;19:1159–65.CrossRefPubMed Cibas ES, Ali SZ. The Bethesda system for reporting thyroid cytopathology. Thyroid. 2009;19:1159–65.CrossRefPubMed
2.
go back to reference Cibas ES, Ali SZ. NCI Thyroid FNA State of the Science Conference.The bethesda system for reporting thyroid cytopathology. Am J Clin Pathol. 2009;132:658–65.CrossRefPubMed Cibas ES, Ali SZ. NCI Thyroid FNA State of the Science Conference.The bethesda system for reporting thyroid cytopathology. Am J Clin Pathol. 2009;132:658–65.CrossRefPubMed
3.
go back to reference Alexander EK, Kennedy GC, Balock ZW, et al. Preoperative diagnosis of benign thyroid nodules with indeterminate cytology. N Engl J Med. 2012;367:705–15.CrossRefPubMed Alexander EK, Kennedy GC, Balock ZW, et al. Preoperative diagnosis of benign thyroid nodules with indeterminate cytology. N Engl J Med. 2012;367:705–15.CrossRefPubMed
5.
go back to reference Ho AS, Sarti EE Jain SK, et al. Malignancy rate in thyroid nodules classified as Bethesda category III (AUS/FLUS). Thyroid. 2014;24:832–9.CrossRefPubMed Ho AS, Sarti EE Jain SK, et al. Malignancy rate in thyroid nodules classified as Bethesda category III (AUS/FLUS). Thyroid. 2014;24:832–9.CrossRefPubMed
6.
go back to reference Iskander M, Bonomo G, Avadhani V, Persky M, Lucido D, Wang B, Marti JL. Evidence for the overestimation of malignancy in indeterminate thyroid nodules classified as bethesda III. Surgery. 2015;157:510–7.CrossRef Iskander M, Bonomo G, Avadhani V, Persky M, Lucido D, Wang B, Marti JL. Evidence for the overestimation of malignancy in indeterminate thyroid nodules classified as bethesda III. Surgery. 2015;157:510–7.CrossRef
7.
go back to reference SoxHC Jr. Probability theory in the use of diagnostic tests: an introduction to critical study of the literature. Ann Intern Med. 1986;104:60–6.CrossRefPubMed SoxHC Jr. Probability theory in the use of diagnostic tests: an introduction to critical study of the literature. Ann Intern Med. 1986;104:60–6.CrossRefPubMed
8.
go back to reference Nikiforov YE, Ohori NP, Hodak SP, et al. Impact of mutational testing on the diagnosis and management of patients with cytologically indeterminate thyroid nodules: a prospective analysis of 1056 FNA samples. J Clin Endocrinol Metab. 2011;96:3390–7.PubMedCentralCrossRefPubMed Nikiforov YE, Ohori NP, Hodak SP, et al. Impact of mutational testing on the diagnosis and management of patients with cytologically indeterminate thyroid nodules: a prospective analysis of 1056 FNA samples. J Clin Endocrinol Metab. 2011;96:3390–7.PubMedCentralCrossRefPubMed
9.
go back to reference Nikiforov YE,Carty SE, Chiosea SI, et al. Highly accurate diagnosis of cancer in thyroid nodules with follicular neoplasm/suspicious for a follicular neoplasm cytology by ThyroSeq v2 next-generation sequencing assay. Cancer. 2014;120:3627–34.CrossRefPubMed Nikiforov YE,Carty SE, Chiosea SI, et al. Highly accurate diagnosis of cancer in thyroid nodules with follicular neoplasm/suspicious for a follicular neoplasm cytology by ThyroSeq v2 next-generation sequencing assay. Cancer. 2014;120:3627–34.CrossRefPubMed
10.
go back to reference Alexander EK,Schorr M, Klopper J, et al. Multicenter clinical experience with the Afirma gene expression classifier. J Clin Endocrinol Metab. 2014;99:119–25.CrossRefPubMed Alexander EK,Schorr M, Klopper J, et al. Multicenter clinical experience with the Afirma gene expression classifier. J Clin Endocrinol Metab. 2014;99:119–25.CrossRefPubMed
11.
go back to reference McIver B,Castro MR, Morris JC, et al. An independent study of a gene expression classifier (Afirma) in the evaluation of cytologically indeterminate thyroid nodules. J Clin Endocrinol Metab. 2014;99:4069–77.CrossRefPubMed McIver B,Castro MR, Morris JC, et al. An independent study of a gene expression classifier (Afirma) in the evaluation of cytologically indeterminate thyroid nodules. J Clin Endocrinol Metab. 2014;99:4069–77.CrossRefPubMed
12.
go back to reference Lastra RR, Pramick MR, Crammer CJ, LiVolsi VA, Baloch ZW. Implications of a suspicious afirma test result in thyroid fine-needle aspiration cytology: an institutional experience. Cancer Cytopathol. 2014;122:737–44.CrossRefPubMed Lastra RR, Pramick MR, Crammer CJ, LiVolsi VA, Baloch ZW. Implications of a suspicious afirma test result in thyroid fine-needle aspiration cytology: an institutional experience. Cancer Cytopathol. 2014;122:737–44.CrossRefPubMed
13.
go back to reference Harrell RM, Bimston DN. Surgical utility of Afirma: effects of high cancer prevalence and oncocytic cell types in patients with indeterminate thyroid cytology. Endocr Pract. 2014;20:364–9.CrossRefPubMed Harrell RM, Bimston DN. Surgical utility of Afirma: effects of high cancer prevalence and oncocytic cell types in patients with indeterminate thyroid cytology. Endocr Pract. 2014;20:364–9.CrossRefPubMed
Metadata
Title
Wide Inter-institutional Variation in Performance of a Molecular Classifier for Indeterminate Thyroid Nodules
Authors
Jennifer L. Marti, MD, FACS
Vaidehi Avadhani, MD
Luke A. Donatelli, MD
Sayani Niyogi, DO
Beverly Wang, MD
Richard J. Wong, MD, FACS
Ashok R. Shaha, MD, FACS
Ronald A. Ghossein, MD
Oscar Lin, MD
Luc G. T. Morris, MD, MSc, FACS
Allen S. Ho, MD
Publication date
01-11-2015
Publisher
Springer US
Published in
Annals of Surgical Oncology / Issue 12/2015
Print ISSN: 1068-9265
Electronic ISSN: 1534-4681
DOI
https://doi.org/10.1245/s10434-015-4486-3

Other articles of this Issue 12/2015

Annals of Surgical Oncology 12/2015 Go to the issue