Skip to main content
Top
Published in: Diagnostic Pathology 1/2019

Open Access 01-12-2019 | Colposcopy | Research

Interobserver variability and accuracy of p16/Ki-67 dual immunocytochemical staining on conventional cervical smears

Authors: Veronika Kloboves Prevodnik, Tine Jerman, Nataša Nolde, Alenka Repše Fokter, Sandra Jezeršek, Živa Pohar Marinšek, Ulrika Klopčič, Simona Hutter Čelik, Kristina Gornik Kramberger, Maja Primic Žakelj, Urška Ivanuš

Published in: Diagnostic Pathology | Issue 1/2019

Login to get access

Abstract

Background

p16/Ki-67 dual immunocytochemical staining (DS) has been proven as a sensitive and specific test for triage of HPV positive women with good reproducibility and accuracy. However, implementation of the test into an organized screening program (OSP) is not easy. The aims of this study were to compare the performance and agreement of DS results among three Slovenian cytopathological laboratories involved in the national OSP, and to define cases where staining results can be difficult to interpret.

Methods

Cervical smears were obtained for DS from 129 women referred to colposcopy. Smears were evaluated blindly in three laboratories by a cytotechnologist and a cytopathologist after initial training. Results were positive, suspicious, negative or inadequate. Five characteristics of DS staining were recorded. After primary evaluation, an extensive expert-led additional training was undertaken, including a discussion of difficult cases and a practical exam. Smears were re-evaluated and results compared to primary evaluation.

Results

After the additional training, the overall percentage of agreement among the three laboratories increased from 77.5 to 89.9% and kappa increased from 0.70 to 0.86. Sensitivity for CIN2+ increased in two laboratories, to 90.5 and 85.7%, without the loss of specificity (75.8%). In one laboratory, the sensitivity slightly decreased from 90.5 to 88.9%, but the specificity increased from 63.6 to 68.2%. Difficult cases had significantly less DS cells, weak intensity of p16 staining, suboptimal cell morphology and background staining compared to positive cases.

Conclusion

Additional expert-led training and discussion of difficult cases are necessary for accurate interpretation of DS in laboratories involved in OSP. The most difficult cases were those with single stained cells and weak p16 staining. Training protocol for safe implementation of p16/Ki-67 DS in OSP is proposed.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bergeron C, Ikenberg H, Sideri M, Denton K, Bogers J, Schmidt D, Alameda F, Keller T, Rehm S, Ridder R. PALMS study group. Prospective evaluation of p16/Ki-67 dual-stained cytology for managing women with abnormal Papanicolaou cytology: PALMS study results. Cancer Cytopathol. 2015;123(6):373–81.CrossRefPubMed Bergeron C, Ikenberg H, Sideri M, Denton K, Bogers J, Schmidt D, Alameda F, Keller T, Rehm S, Ridder R. PALMS study group. Prospective evaluation of p16/Ki-67 dual-stained cytology for managing women with abnormal Papanicolaou cytology: PALMS study results. Cancer Cytopathol. 2015;123(6):373–81.CrossRefPubMed
2.
go back to reference Keisser A, Zechmeister-Koss A. A systematic review of p16/Ki67 immunotesting for triage of low-grade cervical cytology. BJOG. 2015;122:64–70.CrossRef Keisser A, Zechmeister-Koss A. A systematic review of p16/Ki67 immunotesting for triage of low-grade cervical cytology. BJOG. 2015;122:64–70.CrossRef
3.
go back to reference Ikenberg H, Bergeron C, Schmidt D, Griesser H, Alameda F, Angeloni C, Bogers J, Dachez R, Denton K, Hariri J, Keller T, von Knebel Doeberitz M, Neumann HH, Puig-Tintore LM, Sideri M, Rehm S, Ridder R. PALMS study group. Screening for cervical cancer precursors with p16/Ki-67 dual-stained cytology: results of the PALMS study. J Natl Cancer Inst. 2013;105(20):1550–7.CrossRefPubMedPubMedCentral Ikenberg H, Bergeron C, Schmidt D, Griesser H, Alameda F, Angeloni C, Bogers J, Dachez R, Denton K, Hariri J, Keller T, von Knebel Doeberitz M, Neumann HH, Puig-Tintore LM, Sideri M, Rehm S, Ridder R. PALMS study group. Screening for cervical cancer precursors with p16/Ki-67 dual-stained cytology: results of the PALMS study. J Natl Cancer Inst. 2013;105(20):1550–7.CrossRefPubMedPubMedCentral
4.
go back to reference Polman NJ, Uijterwaal MH, Witte BI, Berkhof J, van Kemenade FJ, Spruijt JW, van Baal WM, Graziosi PG, van Dijken DK, Verheijen RH, Helmerhorst TJ, Steenbergen RD, Heideman DA, Ridder R, Snijders PJ, Meijer CJ. Good performance of p16/ki-67 dual-stained cytology for surveillance of women treated for high-grade CIN. Int J Cancer. 2017;140:423–30.CrossRefPubMed Polman NJ, Uijterwaal MH, Witte BI, Berkhof J, van Kemenade FJ, Spruijt JW, van Baal WM, Graziosi PG, van Dijken DK, Verheijen RH, Helmerhorst TJ, Steenbergen RD, Heideman DA, Ridder R, Snijders PJ, Meijer CJ. Good performance of p16/ki-67 dual-stained cytology for surveillance of women treated for high-grade CIN. Int J Cancer. 2017;140:423–30.CrossRefPubMed
5.
go back to reference Wetzensen N, Bergeron C, Cas F, Eschenbach D, Vinokurova S, von Knebel Doeberitz M. Evaluation of nuclear score for p16INK4a-stained cervical squamous cells in liquid-based cytology sample. Cancer Cytopathology. 2005;105:461–7.CrossRef Wetzensen N, Bergeron C, Cas F, Eschenbach D, Vinokurova S, von Knebel Doeberitz M. Evaluation of nuclear score for p16INK4a-stained cervical squamous cells in liquid-based cytology sample. Cancer Cytopathology. 2005;105:461–7.CrossRef
6.
go back to reference Wentzensen N, Fetterman B, Tougawa D, Shiffman M, Castle PE, Wood SN, Stiemerling E, Poirtas N, Lorely T, Kinney W. Interobserver reproducibility and accuracy of p16/Ki67 dual-stain cytology in cervical cancer screening. Cancer Cytopathology. 2014;122:914–20.CrossRefPubMed Wentzensen N, Fetterman B, Tougawa D, Shiffman M, Castle PE, Wood SN, Stiemerling E, Poirtas N, Lorely T, Kinney W. Interobserver reproducibility and accuracy of p16/Ki67 dual-stain cytology in cervical cancer screening. Cancer Cytopathology. 2014;122:914–20.CrossRefPubMed
7.
go back to reference Allia E, Ronco G, Coccia A, Luparia P, Macrì L, Fiorito C, Maletta F, Deambrogio C, Tunesi S, De Marco L, Gillio-Tos A, Sapino A, Ghiringhello B. Interpretation of p16INK4a/Ki-67 dual immunostaining for the triage of human papillomavirus-positive women by experts and nonexperts in cervical cytology. Cancer Cytopathol. 2015;123:212–8.CrossRefPubMed Allia E, Ronco G, Coccia A, Luparia P, Macrì L, Fiorito C, Maletta F, Deambrogio C, Tunesi S, De Marco L, Gillio-Tos A, Sapino A, Ghiringhello B. Interpretation of p16INK4a/Ki-67 dual immunostaining for the triage of human papillomavirus-positive women by experts and nonexperts in cervical cytology. Cancer Cytopathol. 2015;123:212–8.CrossRefPubMed
8.
go back to reference Benevolo M, Allia E, Gustinucci D, Rollo F, Bulletti S, Cesarini E, Passamonti B, Giovagnoli MR, Carico E, Carozzi FM, Mongia A, Fantacci G, Confortini M, Rubino T, Fodero C, Prandi S, Marchi N, Farruggio A, Coccia A, Macrì L, Ghiringhello B, Ronco G, Bragantini E, Polla E, Maccallini V, Negri G, Giorgi Rossi P, New Technologies for Cervical Cancer Screening 2 (NTCC2) working group. Interobserver reproducibility of cytologic p16INK4a /Ki-67 dual immunostaining in human papillomavirus-positive women. Cancer Cytopathol. 2017;125(3):212–20.CrossRefPubMed Benevolo M, Allia E, Gustinucci D, Rollo F, Bulletti S, Cesarini E, Passamonti B, Giovagnoli MR, Carico E, Carozzi FM, Mongia A, Fantacci G, Confortini M, Rubino T, Fodero C, Prandi S, Marchi N, Farruggio A, Coccia A, Macrì L, Ghiringhello B, Ronco G, Bragantini E, Polla E, Maccallini V, Negri G, Giorgi Rossi P, New Technologies for Cervical Cancer Screening 2 (NTCC2) working group. Interobserver reproducibility of cytologic p16INK4a /Ki-67 dual immunostaining in human papillomavirus-positive women. Cancer Cytopathol. 2017;125(3):212–20.CrossRefPubMed
9.
go back to reference McMenamin M, McKenna M, McDowell A, Dawson C, McKenna R. Intra- and inter-observer reproducibility of CINtecR PLUS in ThinPrep cytology preparations. Cytopathol. 2017;28(4):284–90.CrossRef McMenamin M, McKenna M, McDowell A, Dawson C, McKenna R. Intra- and inter-observer reproducibility of CINtecR PLUS in ThinPrep cytology preparations. Cytopathol. 2017;28(4):284–90.CrossRef
10.
go back to reference Goh ST, Tay T, Lim KL, Song LH, Thika AA, Mantoo S. Inter-observer variability of CINtec PLUS dual staining for p16/Ki-67. J Am Soc Cytopathol. 2017;6(5):S30.CrossRef Goh ST, Tay T, Lim KL, Song LH, Thika AA, Mantoo S. Inter-observer variability of CINtec PLUS dual staining for p16/Ki-67. J Am Soc Cytopathol. 2017;6(5):S30.CrossRef
11.
go back to reference Anttila A, Arbyn M, De Vuyst H, Dillner J, Dillner L, Franceschi S, Patnick J, Ronco G, Segnan N, Suonio E, Törnberg S, von Karsa L. European guidelines for quality assurance in cervical cancer screening. Second edition, Supplements. Luxemburg: Publication Office of European Union; 2015. Anttila A, Arbyn M, De Vuyst H, Dillner J, Dillner L, Franceschi S, Patnick J, Ronco G, Segnan N, Suonio E, Törnberg S, von Karsa L. European guidelines for quality assurance in cervical cancer screening. Second edition, Supplements. Luxemburg: Publication Office of European Union; 2015.
12.
go back to reference Wright TC Jr, Behrens CM, Ranger-Moore J, Rehm S, Sharma A, Stoler MH, Ridder R. Triaging HPV-positive women with p16/Ki-67 dual-stained cytology: results from a sub-study nested into the ATHENA trail. Gynecol Oncol. 2017;144:51–6.CrossRefPubMed Wright TC Jr, Behrens CM, Ranger-Moore J, Rehm S, Sharma A, Stoler MH, Ridder R. Triaging HPV-positive women with p16/Ki-67 dual-stained cytology: results from a sub-study nested into the ATHENA trail. Gynecol Oncol. 2017;144:51–6.CrossRefPubMed
13.
go back to reference Ebisch RM, van der Horst J, Hermsen M, Rijstenberg LL, Vedder JE, Bulten J, Bosgraaf RP, Verhoef VM, Heideman DA, Snijders PJ, Meijer CJ, van Kemenade FJ, Massuger LF, Melchers WJ, Bekkers RL, Siebers AG. Evaluation of p16/Ki-67 dual-stained cytology as triage test for high-risk human papillomavirus-positive women. Mod Pathol. 2017;30(7):1021–31.CrossRefPubMed Ebisch RM, van der Horst J, Hermsen M, Rijstenberg LL, Vedder JE, Bulten J, Bosgraaf RP, Verhoef VM, Heideman DA, Snijders PJ, Meijer CJ, van Kemenade FJ, Massuger LF, Melchers WJ, Bekkers RL, Siebers AG. Evaluation of p16/Ki-67 dual-stained cytology as triage test for high-risk human papillomavirus-positive women. Mod Pathol. 2017;30(7):1021–31.CrossRefPubMed
14.
go back to reference Zadnik V, Primic Žakelj M, Lokar K, Jarm K, Ivanuš U, Žagar T. Cancer burden in Slovenia with the time trends analysis. Radiol Oncol. 2017;51(1):47–55.CrossRefPubMedPubMedCentral Zadnik V, Primic Žakelj M, Lokar K, Jarm K, Ivanuš U, Žagar T. Cancer burden in Slovenia with the time trends analysis. Radiol Oncol. 2017;51(1):47–55.CrossRefPubMedPubMedCentral
15.
go back to reference Uršic Vrscaj M, Rakar S, Možina A, Kobal B, Takač I, Deisinger I, Zore A. Smernice za celostno obravnavo žensk s predrakavimi spremembami materničnega vratu [Guidelines for management of women with cervical precancerous lesions.]. In: Ursic-Vrscaj M, editor. . Ljubljana: Institute of O6. Uršic Vrscaj M, Rakar S, Možina A, Kobal B, Takač I, Deisinger I, Zore A. Smernice za celostno obravnavo žensk s predrakavimi spremembami materničnega vratu [Guidelines for management of women with cervical precancerous lesions.]. In: Ursic-Vrscaj M, editor. . Ljubljana: Institute of O6.
16.
go back to reference Kurman RJ, Carcangiu ML, Herrington CS, Young RH, editors. WHO classification of Tumours of female reproductive organs. 4th ed. Lyon: International Agency for Research on Cancer; 2014. Kurman RJ, Carcangiu ML, Herrington CS, Young RH, editors. WHO classification of Tumours of female reproductive organs. 4th ed. Lyon: International Agency for Research on Cancer; 2014.
17.
go back to reference Ivanuš U, Jerman T, Fokter AR, Takač I, Kloboves VP, Marčec M, Salobir UG, Pakiz M, Koren J, Hutter SC, Gornik KK, Klopčič U, Kavalar R, Šramek SZ, GrČar BK, Florjančič M, Nolde N, Novaković S, Poljak M, Žakelj MP. Randomised trial of HPV self-sampling among non-attenders in the Slovenian ZORA cervical screening programme: comparing three different screening approaches. Radiol Oncol. 2018. Ivanuš U, Jerman T, Fokter AR, Takač I, Kloboves VP, Marčec M, Salobir UG, Pakiz M, Koren J, Hutter SC, Gornik KK, Klopčič U, Kavalar R, Šramek SZ, GrČar BK, Florjančič M, Nolde N, Novaković S, Poljak M, Žakelj MP. Randomised trial of HPV self-sampling among non-attenders in the Slovenian ZORA cervical screening programme: comparing three different screening approaches. Radiol Oncol. 2018.
18.
go back to reference Altman DG. Practical statistics for medical research. Boca Raton: Chapman and Hall/CRC; 1991. Altman DG. Practical statistics for medical research. Boca Raton: Chapman and Hall/CRC; 1991.
19.
go back to reference IBM Corp. IBM SPSS statistics for windows, version 24.0 FP2. Armonk: IBM Corp; 2016. IBM Corp. IBM SPSS statistics for windows, version 24.0 FP2. Armonk: IBM Corp; 2016.
Metadata
Title
Interobserver variability and accuracy of p16/Ki-67 dual immunocytochemical staining on conventional cervical smears
Authors
Veronika Kloboves Prevodnik
Tine Jerman
Nataša Nolde
Alenka Repše Fokter
Sandra Jezeršek
Živa Pohar Marinšek
Ulrika Klopčič
Simona Hutter Čelik
Kristina Gornik Kramberger
Maja Primic Žakelj
Urška Ivanuš
Publication date
01-12-2019
Publisher
BioMed Central
Published in
Diagnostic Pathology / Issue 1/2019
Electronic ISSN: 1746-1596
DOI
https://doi.org/10.1186/s13000-019-0821-5

Other articles of this Issue 1/2019

Diagnostic Pathology 1/2019 Go to the issue