Skip to main content
Top
Published in: Autoimmunity Highlights 1/2018

Open Access 01-12-2018 | Original Article

Performance analysis of automated evaluation of antinuclear antibody indirect immunofluorescent tests in a routine setting

Authors: Joyce J. B. C. van Beers, Melanie Hahn, Johanna Fraune, Kathleen Mallet, Christopher Krause, Wymke Hormann, Kai Fechner, Jan G. M. C. Damoiseaux

Published in: Autoimmunity Highlights | Issue 1/2018

Login to get access

Abstract

Purpose

Indirect immunofluorescence (IIF) on the human epithelial cell-line HEp-2 (or derivatives) serves as the gold standard in antinuclear antibody (ANA) screening. IIF, and its evaluation, is a labor-intensive method, making ANA testing a major challenge for present clinical laboratories. Nowadays, several automated ANA pattern recognition systems are on the market. In the current study, the EUROPattern Suite is evaluated for its use in daily practice in a routine setting.

Methods

A total of 1033 consecutive routine samples was used to screen for ANA. Results (positive/negative ANA screening, pattern identification and titer) were compared between software-generated results (EUROPattern) and visual interpretation (observer) of automatically acquired digital images.

Results

Considering the visual interpretation as reference, a relative sensitivity of 99.3% and a relative specificity of 88.9% were obtained for negative and positive discrimination by the software (EPa). A good agreement between visual and software-based interpretation was observed with respect to pattern recognition (mean kappa: for 7 patterns: 0.7). Interestingly, EPa software distinguished more patterns per positive sample than the observer (on average 1.5 and 1.2, respectively). Finally, a concordance of 99.3% was observed within the range of 1 titer step difference between EPa and observer.

Conclusions

The ANA IIF results reported by the EPa software are in very good agreement with the results reported by the observer with respect to being negative/positive, pattern recognition and titer, making automated ANA IIF evaluation an objective and time-efficient tool for routine testing.
Appendix
Available only for authorised users
Literature
1.
go back to reference Mahler M, Meroni PL, Bossuyt X, Fritzler MJ (2014) Current concepts and future directions for the assessment of autoantibodies to cellular antigens referred to as anti-nuclear antibodies. J Immunol Res 2014:315179–315195PubMedPubMedCentral Mahler M, Meroni PL, Bossuyt X, Fritzler MJ (2014) Current concepts and future directions for the assessment of autoantibodies to cellular antigens referred to as anti-nuclear antibodies. J Immunol Res 2014:315179–315195PubMedPubMedCentral
2.
go back to reference Chan EK, Damoiseaux J, Carballo OG, Conrad K, de Melo Cruvinel W, Francescantonio PL, Fritzler MJ, Garcia-De La Torre I, Herold M, Mimori T, Satoh M, von Muhlen CA, Andrade LE (2015) Report of the first international consensus on standardized nomenclature of antinuclear antibody hep-2 cell patterns 2014–2015. Front Immunol 6:412CrossRef Chan EK, Damoiseaux J, Carballo OG, Conrad K, de Melo Cruvinel W, Francescantonio PL, Fritzler MJ, Garcia-De La Torre I, Herold M, Mimori T, Satoh M, von Muhlen CA, Andrade LE (2015) Report of the first international consensus on standardized nomenclature of antinuclear antibody hep-2 cell patterns 2014–2015. Front Immunol 6:412CrossRef
3.
go back to reference Agmon-Levin N, Damoiseaux J, Kallenberg C, Sack U, Witte T, Herold M, Bossuyt X, Musset L, Cervera R, Plaza-Lopez A, Dias C, Sousa MJ, Radice A, Eriksson C, Hultgren O, Viander M, Khamashta M, Regenass S, Andrade LE, Wiik A, Tincani A, Ronnelid J, Bloch DB, Fritzler MJ, Chan EK, Garcia-De La Torre I, Konstantinov KN, Lahita R, Wilson M, Vainio O, Fabien N, Sinico RA, Meroni P, Shoenfeld Y (2014) International recommendations for the assessment of autoantibodies to cellular antigens referred to as anti-nuclear antibodies. Ann Rheum Dis 73:17–23CrossRef Agmon-Levin N, Damoiseaux J, Kallenberg C, Sack U, Witte T, Herold M, Bossuyt X, Musset L, Cervera R, Plaza-Lopez A, Dias C, Sousa MJ, Radice A, Eriksson C, Hultgren O, Viander M, Khamashta M, Regenass S, Andrade LE, Wiik A, Tincani A, Ronnelid J, Bloch DB, Fritzler MJ, Chan EK, Garcia-De La Torre I, Konstantinov KN, Lahita R, Wilson M, Vainio O, Fabien N, Sinico RA, Meroni P, Shoenfeld Y (2014) International recommendations for the assessment of autoantibodies to cellular antigens referred to as anti-nuclear antibodies. Ann Rheum Dis 73:17–23CrossRef
4.
go back to reference Chan EK, Damoiseaux J, de Melo Cruvinel W, Carballo OG, Conrad K, Francescantonio PL, Fritzler MJ, Garcia-De La Torre I, Herold M, Mimori T, Satoh M, von Muhlen CA, Andrade LE (2016) Report on the second international consensus on ana pattern (icap) workshop in dresden 2015. Lupus 25:797–804CrossRef Chan EK, Damoiseaux J, de Melo Cruvinel W, Carballo OG, Conrad K, Francescantonio PL, Fritzler MJ, Garcia-De La Torre I, Herold M, Mimori T, Satoh M, von Muhlen CA, Andrade LE (2016) Report on the second international consensus on ana pattern (icap) workshop in dresden 2015. Lupus 25:797–804CrossRef
5.
go back to reference Mariz HA, Sato EI, Barbosa SH, Rodrigues SH, Dellavance A, Andrade LE (2011) Pattern on the antinuclear antibody-hep-2 test is a critical parameter for discriminating antinuclear antibody-positive healthy individuals and patients with autoimmune rheumatic diseases. Arthritis Rheum 63:191–200CrossRef Mariz HA, Sato EI, Barbosa SH, Rodrigues SH, Dellavance A, Andrade LE (2011) Pattern on the antinuclear antibody-hep-2 test is a critical parameter for discriminating antinuclear antibody-positive healthy individuals and patients with autoimmune rheumatic diseases. Arthritis Rheum 63:191–200CrossRef
6.
go back to reference Damoiseaux J, von Muhlen CA, Garcia-De La Torre I, Carballo OG, de Melo Cruvinel W, Francescantonio PL, Fritzler MJ, Herold M, Mimori T, Satoh M, Andrade LE, Chan EK, Conrad K (2016) International consensus on ana patterns (icap): the bumpy road towards a consensus on reporting ana results. Auto Immun Highlights 7:1CrossRef Damoiseaux J, von Muhlen CA, Garcia-De La Torre I, Carballo OG, de Melo Cruvinel W, Francescantonio PL, Fritzler MJ, Herold M, Mimori T, Satoh M, Andrade LE, Chan EK, Conrad K (2016) International consensus on ana patterns (icap): the bumpy road towards a consensus on reporting ana results. Auto Immun Highlights 7:1CrossRef
7.
go back to reference Bossuyt X, Hendrickx A, Frans J (2005) Antinuclear antibody titer and antibodies to extractable nuclear antigens. Arthritis Rheum 53:987–988CrossRef Bossuyt X, Hendrickx A, Frans J (2005) Antinuclear antibody titer and antibodies to extractable nuclear antigens. Arthritis Rheum 53:987–988CrossRef
8.
go back to reference Meroni PL, Bizzaro N, Cavazzana I, Borghi MO, Tincani A (2014) Automated tests of ana immunofluorescence as throughput autoantibody detection technology: strengths and limitations. BMC Med 12:38CrossRef Meroni PL, Bizzaro N, Cavazzana I, Borghi MO, Tincani A (2014) Automated tests of ana immunofluorescence as throughput autoantibody detection technology: strengths and limitations. BMC Med 12:38CrossRef
9.
go back to reference Bizzaro N, Antico A, Platzgummer S, Tonutti E, Bassetti D, Pesente F, Tozzoli R, Tampoia M, Villalta D, Study Group on Autoimmune Diseases of the Italian Society of Laboratory Medicine I (2014) Automated antinuclear immunofluorescence antibody screening: A comparative study of six computer-aided diagnostic systems. Autoimmun Rev 13:292–298CrossRef Bizzaro N, Antico A, Platzgummer S, Tonutti E, Bassetti D, Pesente F, Tozzoli R, Tampoia M, Villalta D, Study Group on Autoimmune Diseases of the Italian Society of Laboratory Medicine I (2014) Automated antinuclear immunofluorescence antibody screening: A comparative study of six computer-aided diagnostic systems. Autoimmun Rev 13:292–298CrossRef
10.
go back to reference Van den Bremt S, Schouwers S, Van Blerk M, Van Hoovels L (2017) Ana IIf automation: moving towards harmonization? Results of a multicenter study. J Immunol Res 2017:6038137PubMedPubMedCentral Van den Bremt S, Schouwers S, Van Blerk M, Van Hoovels L (2017) Ana IIf automation: moving towards harmonization? Results of a multicenter study. J Immunol Res 2017:6038137PubMedPubMedCentral
11.
go back to reference Voigt J, Krause C, Rohwader E, Saschenbrecker S, Hahn M, Danckwardt M, Feirer C, Ens K, Fechner K, Barth E, Martinetz T, Stocker W (2012) Automated indirect immunofluorescence evaluation of antinuclear autoantibodies on hep-2 cells. Clin Dev Immunol 2012:651058CrossRef Voigt J, Krause C, Rohwader E, Saschenbrecker S, Hahn M, Danckwardt M, Feirer C, Ens K, Fechner K, Barth E, Martinetz T, Stocker W (2012) Automated indirect immunofluorescence evaluation of antinuclear autoantibodies on hep-2 cells. Clin Dev Immunol 2012:651058CrossRef
12.
go back to reference Gerlach S, Affeldt K, Pototzki L, Krause C, Voigt J, Fraune J, Fechner K (2015) Automated evaluation of crithidia luciliae based indirect immunofluorescence tests: a novel application of the europattern-suite technology. J Immunol Res 2015:742402CrossRef Gerlach S, Affeldt K, Pototzki L, Krause C, Voigt J, Fraune J, Fechner K (2015) Automated evaluation of crithidia luciliae based indirect immunofluorescence tests: a novel application of the europattern-suite technology. J Immunol Res 2015:742402CrossRef
13.
go back to reference Krause C, Ens K, Fechner K, Voigt J, Fraune J, Rohwader E, Hahn M, Danckwardt M, Feirer C, Barth E, Martinetz T, Stocker W (2015) Europattern suite technology for computer-aided immunofluorescence microscopy in autoantibody diagnostics. Lupus 24:516–529CrossRef Krause C, Ens K, Fechner K, Voigt J, Fraune J, Rohwader E, Hahn M, Danckwardt M, Feirer C, Barth E, Martinetz T, Stocker W (2015) Europattern suite technology for computer-aided immunofluorescence microscopy in autoantibody diagnostics. Lupus 24:516–529CrossRef
14.
go back to reference Fraune J, Gerlach S, Rentzsch K, Teegen B, Lederer S, Affeldt K, Fechner K, Danckwardt M, Voigt J, Probst C, Komorowski L, Stocker W (2016) Multiparametric serological testing in autoimmune encephalitis using computer-aided immunofluorescence microscopy (caifm). Autoimmun Rev 15:937–942CrossRef Fraune J, Gerlach S, Rentzsch K, Teegen B, Lederer S, Affeldt K, Fechner K, Danckwardt M, Voigt J, Probst C, Komorowski L, Stocker W (2016) Multiparametric serological testing in autoimmune encephalitis using computer-aided immunofluorescence microscopy (caifm). Autoimmun Rev 15:937–942CrossRef
15.
go back to reference Hormann W, Hahn M, Gerlach S, Hochstrate N, Affeldt K, Giesen J, Fechner K, Damoiseaux J (2017) Performance analysis of automated evaluation of crithidia luciliae-based indirect immunofluorescence tests in a routine setting—strengths and weaknesses. Clin Chem Lab Med 56:86–93CrossRef Hormann W, Hahn M, Gerlach S, Hochstrate N, Affeldt K, Giesen J, Fechner K, Damoiseaux J (2017) Performance analysis of automated evaluation of crithidia luciliae-based indirect immunofluorescence tests in a routine setting—strengths and weaknesses. Clin Chem Lab Med 56:86–93CrossRef
16.
go back to reference Cohen J (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 70:213–220CrossRef Cohen J (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychol Bull 70:213–220CrossRef
17.
go back to reference Landis JR, Koch GG (1977) An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics 33:363–374CrossRef Landis JR, Koch GG (1977) An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics 33:363–374CrossRef
18.
go back to reference Sack U, Knoechner S, Warschkau H, Pigla U, Emmrich F, Kamprad M (2003) Computer-assisted classification of hep-2 immunofluorescence patterns in autoimmune diagnostics. Autoimmun Rev 2:298–304CrossRef Sack U, Knoechner S, Warschkau H, Pigla U, Emmrich F, Kamprad M (2003) Computer-assisted classification of hep-2 immunofluorescence patterns in autoimmune diagnostics. Autoimmun Rev 2:298–304CrossRef
19.
go back to reference Hu Y, Murphy RF (2004) Automated interpretation of subcellular patterns from immunofluorescence microscopy. J Immunol Methods 290:93–105CrossRef Hu Y, Murphy RF (2004) Automated interpretation of subcellular patterns from immunofluorescence microscopy. J Immunol Methods 290:93–105CrossRef
20.
go back to reference Hiemann R, Hilger N, Sack U, Weigert M (2006) Objective quality evaluation of fluorescence images to optimize automatic image acquisition. Cytometry A 69:182–184CrossRef Hiemann R, Hilger N, Sack U, Weigert M (2006) Objective quality evaluation of fluorescence images to optimize automatic image acquisition. Cytometry A 69:182–184CrossRef
21.
go back to reference Glory E, Murphy RF (2007) Automated subcellular location determination and high-throughput microscopy. Dev Cell 12:7–16CrossRef Glory E, Murphy RF (2007) Automated subcellular location determination and high-throughput microscopy. Dev Cell 12:7–16CrossRef
22.
go back to reference Rigon A, Soda P, Zennaro D, Iannello G, Afeltra A (2007) Indirect immunofluorescence in autoimmune diseases: assessment of digital images for diagnostic purpose. Cytometry B Clin Cytom 72:472–477CrossRef Rigon A, Soda P, Zennaro D, Iannello G, Afeltra A (2007) Indirect immunofluorescence in autoimmune diseases: assessment of digital images for diagnostic purpose. Cytometry B Clin Cytom 72:472–477CrossRef
23.
go back to reference Tozzoli R, Bonaguri C, Melegari A, Antico A, Bassetti D, Bizzaro N (2013) Current state of diagnostic technologies in the autoimmunology laboratory. Clin Chem Lab Med 51:129–138CrossRef Tozzoli R, Bonaguri C, Melegari A, Antico A, Bassetti D, Bizzaro N (2013) Current state of diagnostic technologies in the autoimmunology laboratory. Clin Chem Lab Med 51:129–138CrossRef
24.
go back to reference Damoiseaux JG, Tervaert JW (2006) From ana to ena: how to proceed? Autoimmun Rev 5:10–17CrossRef Damoiseaux JG, Tervaert JW (2006) From ana to ena: how to proceed? Autoimmun Rev 5:10–17CrossRef
25.
go back to reference Tan EM, Feltkamp TE, Smolen JS, Butcher B, Dawkins R, Fritzler MJ, Gordon T, Hardin JA, Kalden JR, Lahita RG, Maini RN, McDougal JS, Rothfield NF, Smeenk RJ, Takasaki Y, Wiik A, Wilson MR, Koziol JA (1997) Range of antinuclear antibodies in “healthy” individuals. Arthritis Rheum 40:1601–1611CrossRef Tan EM, Feltkamp TE, Smolen JS, Butcher B, Dawkins R, Fritzler MJ, Gordon T, Hardin JA, Kalden JR, Lahita RG, Maini RN, McDougal JS, Rothfield NF, Smeenk RJ, Takasaki Y, Wiik A, Wilson MR, Koziol JA (1997) Range of antinuclear antibodies in “healthy” individuals. Arthritis Rheum 40:1601–1611CrossRef
26.
go back to reference Op De Beeck K, Vermeersch P, Verschueren P, Westhovens R, Marien G, Blockmans D, Bossuyt X (2011) Detection of antinuclear antibodies by indirect immunofluorescence and by solid phase assay. Autoimmun Rev 10:801–808CrossRef Op De Beeck K, Vermeersch P, Verschueren P, Westhovens R, Marien G, Blockmans D, Bossuyt X (2011) Detection of antinuclear antibodies by indirect immunofluorescence and by solid phase assay. Autoimmun Rev 10:801–808CrossRef
27.
go back to reference Avery TY, van de Cruys M, Austen J, Stals F, Damoiseaux JG (2014) Anti-nuclear antibodies in daily clinical practice: prevalence in primary, secondary, and tertiary care. J Immunol Res 2014:401739CrossRef Avery TY, van de Cruys M, Austen J, Stals F, Damoiseaux JG (2014) Anti-nuclear antibodies in daily clinical practice: prevalence in primary, secondary, and tertiary care. J Immunol Res 2014:401739CrossRef
28.
go back to reference Fritzler MJ (2016) Choosing wisely: review and commentary on anti-nuclear antibody (ana) testing. Autoimmun Rev 15:272–280CrossRef Fritzler MJ (2016) Choosing wisely: review and commentary on anti-nuclear antibody (ana) testing. Autoimmun Rev 15:272–280CrossRef
29.
go back to reference Alsuwaidi M, Dollinger M, Fleck M, Ehrenstein B (2016) The reliability of a novel automated system for ana immunofluorescence analysis in daily clinical practice. Int J Rheumatol 2016:6019268CrossRef Alsuwaidi M, Dollinger M, Fleck M, Ehrenstein B (2016) The reliability of a novel automated system for ana immunofluorescence analysis in daily clinical practice. Int J Rheumatol 2016:6019268CrossRef
30.
go back to reference Loock CD, Egerer K, Feist E, Burmester GR (2017) Automated evaluation of ana under real-life conditions. RMD Open 3:e000409CrossRef Loock CD, Egerer K, Feist E, Burmester GR (2017) Automated evaluation of ana under real-life conditions. RMD Open 3:e000409CrossRef
31.
go back to reference Zheng B, Li E, Zhu H, Lu J, Shi X, Zhang J, Li M (2017) Automated antinuclear immunofluorescence antibody analysis is a reliable approach in routine clinical laboratories. Clin Chem Lab Med 55:1922–1930CrossRef Zheng B, Li E, Zhu H, Lu J, Shi X, Zhang J, Li M (2017) Automated antinuclear immunofluorescence antibody analysis is a reliable approach in routine clinical laboratories. Clin Chem Lab Med 55:1922–1930CrossRef
32.
go back to reference Shovman O, Agmon-Levin N, Gilburd B, Martins T, Petzold A, Matthias T, Shoenfeld Y (2015) A fully automated IIf system for the detection of antinuclear antibodies and antineutrophil cytoplasmic antibodies. Immunol Res 61:135–140CrossRef Shovman O, Agmon-Levin N, Gilburd B, Martins T, Petzold A, Matthias T, Shoenfeld Y (2015) A fully automated IIf system for the detection of antinuclear antibodies and antineutrophil cytoplasmic antibodies. Immunol Res 61:135–140CrossRef
33.
go back to reference Melegari A, Bonaguri C, Russo A, Luisita B, Trenti T, Lippi G (2012) A comparative study on the reliability of an automated system for the evaluation of cell-based indirect immunofluorescence. Autoimmun Rev 11:713–716CrossRef Melegari A, Bonaguri C, Russo A, Luisita B, Trenti T, Lippi G (2012) A comparative study on the reliability of an automated system for the evaluation of cell-based indirect immunofluorescence. Autoimmun Rev 11:713–716CrossRef
34.
go back to reference Egerer K, Roggenbuck D, Hiemann R, Weyer MG, Buttner T, Radau B, Krause R, Lehmann B, Feist E, Burmester GR (2010) Automated evaluation of autoantibodies on human epithelial-2 cells as an approach to standardize cell-based immunofluorescence tests. Arthritis Res Ther 12:R40CrossRef Egerer K, Roggenbuck D, Hiemann R, Weyer MG, Buttner T, Radau B, Krause R, Lehmann B, Feist E, Burmester GR (2010) Automated evaluation of autoantibodies on human epithelial-2 cells as an approach to standardize cell-based immunofluorescence tests. Arthritis Res Ther 12:R40CrossRef
Metadata
Title
Performance analysis of automated evaluation of antinuclear antibody indirect immunofluorescent tests in a routine setting
Authors
Joyce J. B. C. van Beers
Melanie Hahn
Johanna Fraune
Kathleen Mallet
Christopher Krause
Wymke Hormann
Kai Fechner
Jan G. M. C. Damoiseaux
Publication date
01-12-2018
Publisher
Springer International Publishing
Published in
Autoimmunity Highlights / Issue 1/2018
Print ISSN: 2038-0305
Electronic ISSN: 2038-3274
DOI
https://doi.org/10.1007/s13317-018-0108-y

Other articles of this Issue 1/2018

Autoimmunity Highlights 1/2018 Go to the issue