Skip to main content
Top
Published in: Cancer Immunology, Immunotherapy 3/2008

Open Access 01-03-2008 | Original Article

Results and harmonization guidelines from two large-scale international Elispot proficiency panels conducted by the Cancer Vaccine Consortium (CVC/SVI)

Authors: Sylvia Janetzki, Katherine S. Panageas, Leah Ben-Porat, Jean Boyer, Cedrik M. Britten, Timothy M. Clay, Michael Kalos, Holden T. Maecker, Pedro Romero, Jianda Yuan, W. Martin Kast, Axel Hoos, for the Elispot Proficiency Panel of the CVC Immune Assay Working Group

Published in: Cancer Immunology, Immunotherapy | Issue 3/2008

Login to get access

Abstract

The Cancer Vaccine Consortium of the Sabin Vaccine Institute (CVC/SVI) is conducting an ongoing large-scale immune monitoring harmonization program through its members and affiliated associations. This effort was brought to life as an external validation program by conducting an international Elispot proficiency panel with 36 laboratories in 2005, and was followed by a second panel with 29 participating laboratories in 2006 allowing for application of learnings from the first panel. Critical protocol choices, as well as standardization and validation practices among laboratories were assessed through detailed surveys. Although panel participants had to follow general guidelines in order to allow comparison of results, each laboratory was able to use its own protocols, materials and reagents. The second panel recorded an overall significantly improved performance, as measured by the ability to detect all predefined responses correctly. Protocol choices and laboratory practices, which can have a dramatic effect on the overall assay outcome, were identified and lead to the following recommendations: (A) Establish a laboratory SOP for Elispot testing procedures including (A1) a counting method for apoptotic cells for determining adequate cell dilution for plating, and (A2) overnight rest of cells prior to plating and incubation, (B) Use only pre-tested serum optimized for low background: high signal ratio, (C) Establish a laboratory SOP for plate reading including (C1) human auditing during the reading process and (C2) adequate adjustments for technical artifacts, and (D) Only allow trained personnel, which is certified per laboratory SOPs to conduct assays. Recommendations described under (A) were found to make a statistically significant difference in assay performance, while the remaining recommendations are based on practical experiences confirmed by the panel results, which could not be statistically tested. These results provide initial harmonization guidelines to optimize Elispot assay performance to the immunotherapy community. Further optimization is in process with ongoing panels.
Appendix
Available only for authorised users
Literature
1.
go back to reference Asai T, Storkus WJ, Whiteside TL (2000) Evaluation of the modified ELISPOT assay for gamma interferon production in cancer patients receiving antitumor vaccines. Clin Diagn Lab Immunol 7:145–154PubMedCrossRef Asai T, Storkus WJ, Whiteside TL (2000) Evaluation of the modified ELISPOT assay for gamma interferon production in cancer patients receiving antitumor vaccines. Clin Diagn Lab Immunol 7:145–154PubMedCrossRef
2.
go back to reference Britten CM, Gouttefangeas C, Schoenmaekers-Welters MJP, Pawelec G, Koch S, Ottensmeier C, Mander A, Walter S, Paschen A, Müller-Berghaus J, Haas I, Mackensen A, Køllgaard T, Thor Straten P, Schmitt M, Giannopoulos K, Maier R, Veelken H, Bertinetti C, Konur A, Huber C, Stevanović S, Wölfel T and Van der Burg SH (2007) The CIMT-monitoring panel: a two-step approach to harmonize the enumeration of antigen-specific CD8+ T lymphocytes by structural and functional assays. Cancer Immunol Immunother (in press). doi: 10.1007/s00262-007-0379-z Britten CM, Gouttefangeas C, Schoenmaekers-Welters MJP, Pawelec G, Koch S, Ottensmeier C, Mander A, Walter S, Paschen A, Müller-Berghaus J, Haas I, Mackensen A, Køllgaard T, Thor Straten P, Schmitt M, Giannopoulos K, Maier R, Veelken H, Bertinetti C, Konur A, Huber C, Stevanović S, Wölfel T and Van der Burg SH (2007) The CIMT-monitoring panel: a two-step approach to harmonize the enumeration of antigen-specific CD8+ T lymphocytes by structural and functional assays. Cancer Immunol Immunother (in press). doi:​ 10.​1007/​s00262-007-0379-z
4.
go back to reference Cox JH, Ferrari G, Bailer RT, Koup RA (2004) Automating procedures for processing, cryopreservation, storage and manipulation of human peripheral mononuclear cells. J Assoc Lab Automat 9:16–23CrossRef Cox JH, Ferrari G, Bailer RT, Koup RA (2004) Automating procedures for processing, cryopreservation, storage and manipulation of human peripheral mononuclear cells. J Assoc Lab Automat 9:16–23CrossRef
5.
go back to reference Cox JH, Ferrari G, Kalams SA, Lopaczynski W, Oden N, D’Souza MP, Elispot Collaborative Study Group (2005) Results of an ELISPOT proficiency panel conducted in 11 laboratories participating in international human immunodeficiency virus type 1 vaccine trials. AIDS Res Hum Retroviruses 21:68–81PubMedCrossRef Cox JH, Ferrari G, Kalams SA, Lopaczynski W, Oden N, D’Souza MP, Elispot Collaborative Study Group (2005) Results of an ELISPOT proficiency panel conducted in 11 laboratories participating in international human immunodeficiency virus type 1 vaccine trials. AIDS Res Hum Retroviruses 21:68–81PubMedCrossRef
6.
go back to reference Cox JH, Ferrari G, Janetzki S (2006) Measurement of cytokine release at the single cell level using the ELISPOT assay. Methods 38:274–282PubMedCrossRef Cox JH, Ferrari G, Janetzki S (2006) Measurement of cytokine release at the single cell level using the ELISPOT assay. Methods 38:274–282PubMedCrossRef
7.
go back to reference Currier JR, Kuta EG, Turk E, Earhart LB, Loomis-Price L, Janetzki S, Ferrari G, Birx DL, Cox JH (2002) A panel of MHC class I restricted viral peptides for use as a quality control for vaccine trial ELISPOT assays. J Immunol Methods 260:157–172PubMedCrossRef Currier JR, Kuta EG, Turk E, Earhart LB, Loomis-Price L, Janetzki S, Ferrari G, Birx DL, Cox JH (2002) A panel of MHC class I restricted viral peptides for use as a quality control for vaccine trial ELISPOT assays. J Immunol Methods 260:157–172PubMedCrossRef
8.
go back to reference Dubey S, Clair J, Fu T-M, Guan L, Long R, Mogg R, Anderson K, Collins KB, Gaunt C, Fernandez VR, Zhu L, Kierstead L, Thaler S, Gupta SB, Straus W, Mehrotra D, Tobery TW, Casimiro DR, Shiver JW (2007) Detection of HIV vaccine-induced cell-mediated immunity in HIV-seronegative clinical trial participants using an optimized and validated enzyme-lined immunospot assay. J Acquir Immune Defic Syndr 45:20–27PubMedCrossRef Dubey S, Clair J, Fu T-M, Guan L, Long R, Mogg R, Anderson K, Collins KB, Gaunt C, Fernandez VR, Zhu L, Kierstead L, Thaler S, Gupta SB, Straus W, Mehrotra D, Tobery TW, Casimiro DR, Shiver JW (2007) Detection of HIV vaccine-induced cell-mediated immunity in HIV-seronegative clinical trial participants using an optimized and validated enzyme-lined immunospot assay. J Acquir Immune Defic Syndr 45:20–27PubMedCrossRef
10.
go back to reference Findlay JWA; Smith WC, Lee JW, Nordblom GD, Das I, DeSilva BS, Khan MN, Bowsher RR (2000) Validation of immunoassays for bioanalysis: a pharmaceutical industry perspective. J Pharm Biomed Anal 21:1249–1273CrossRef Findlay JWA; Smith WC, Lee JW, Nordblom GD, Das I, DeSilva BS, Khan MN, Bowsher RR (2000) Validation of immunoassays for bioanalysis: a pharmaceutical industry perspective. J Pharm Biomed Anal 21:1249–1273CrossRef
11.
go back to reference Hobeika AC, Morse MA, Osada T, Ghanayem M, Niedzwiecki D, Barrier R, Lyerly HK, Clay T, (2005) Enumerating antigen-specific T-cell responses in peripheral blood. J Immunother 28:63–72PubMedCrossRef Hobeika AC, Morse MA, Osada T, Ghanayem M, Niedzwiecki D, Barrier R, Lyerly HK, Clay T, (2005) Enumerating antigen-specific T-cell responses in peripheral blood. J Immunother 28:63–72PubMedCrossRef
12.
go back to reference Hoos A, Parmiani G, Hege K, Sznol M, Loibner H, Eggermont A, Urba W, Blumenstein B, Sacks N, Keilholz U, Nichol G, Cancer Vaccine Clinical Trial Working Group (2007) A clinical development paradigm for cancer vaccines and related biologics. J Immunother 30:1–15PubMedCrossRef Hoos A, Parmiani G, Hege K, Sznol M, Loibner H, Eggermont A, Urba W, Blumenstein B, Sacks N, Keilholz U, Nichol G, Cancer Vaccine Clinical Trial Working Group (2007) A clinical development paradigm for cancer vaccines and related biologics. J Immunother 30:1–15PubMedCrossRef
14.
go back to reference Janetzki S (2004) Automation of the Elispot technique: past, present and future. J Assoc Lab Automat 9:10–15CrossRef Janetzki S (2004) Automation of the Elispot technique: past, present and future. J Assoc Lab Automat 9:10–15CrossRef
15.
go back to reference Janetzki S, Schaed S, Blachere NE, Ben-Porat L, Houghton AN, Panageas KS (2004) Evaluation of Elispot assays: influence of method and operator on variability of results. J Immunol Methods 291:175–183PubMedCrossRef Janetzki S, Schaed S, Blachere NE, Ben-Porat L, Houghton AN, Panageas KS (2004) Evaluation of Elispot assays: influence of method and operator on variability of results. J Immunol Methods 291:175–183PubMedCrossRef
16.
go back to reference Janetzki S, Cox JH, Oden N, Ferrari G (2006) Standardization and validation issues of the ELISPOT assay. Methods Mol Biol 302:51–86 Janetzki S, Cox JH, Oden N, Ferrari G (2006) Standardization and validation issues of the ELISPOT assay. Methods Mol Biol 302:51–86
17.
go back to reference Keilholz U, Weber J, Finke JH, Gabrilovich DI, Kast WM, Disis ML, Kirkwood JM, Scheibenbogen C, Schlom J, Maino VC, Lyerly HK, Lee PP, Storkus W, Marincola F, Worobec A, Atkins MB (2002) Immunologic monitoring of cancer vaccine therapy: results of a workshop sponsored by the Society for Biological Therapy. J Immunother 25:97–138PubMedCrossRef Keilholz U, Weber J, Finke JH, Gabrilovich DI, Kast WM, Disis ML, Kirkwood JM, Scheibenbogen C, Schlom J, Maino VC, Lyerly HK, Lee PP, Storkus W, Marincola F, Worobec A, Atkins MB (2002) Immunologic monitoring of cancer vaccine therapy: results of a workshop sponsored by the Society for Biological Therapy. J Immunother 25:97–138PubMedCrossRef
18.
go back to reference Kierstead LS, Dubey S, Meyer B, Tobery TW, Mogg R, Fernandez VR, Long R, Guan L, Gaunt C, Collins K, Sykes KJ, Mehrotra DV, Chirmule N, Shiver JW, Casimiro DR (2007) Enhanced rates and magnitude of immune responses detected against an HIV vaccine: effect of using an optimized process for isolating PBMC. AIDS Res Hum Retroviruses 23:86–92PubMedCrossRef Kierstead LS, Dubey S, Meyer B, Tobery TW, Mogg R, Fernandez VR, Long R, Guan L, Gaunt C, Collins K, Sykes KJ, Mehrotra DV, Chirmule N, Shiver JW, Casimiro DR (2007) Enhanced rates and magnitude of immune responses detected against an HIV vaccine: effect of using an optimized process for isolating PBMC. AIDS Res Hum Retroviruses 23:86–92PubMedCrossRef
19.
go back to reference Lathey J (2003) Preliminary steps toward validating a clinical bioassay. Biopharm Int 16:42–50 Lathey J (2003) Preliminary steps toward validating a clinical bioassay. Biopharm Int 16:42–50
20.
go back to reference Lathey JL, Martinez K, Gregory S, D’Souza P, Lopaczynski W (2005) Characterization of assay variability in real-time and batch assays of sequential samples from the same donors. FOCIS 5th Annual Meeting, Poster, Abstract# Su2.96 Lathey JL, Martinez K, Gregory S, D’Souza P, Lopaczynski W (2005) Characterization of assay variability in real-time and batch assays of sequential samples from the same donors. FOCIS 5th Annual Meeting, Poster, Abstract# Su2.96
21.
go back to reference Lem L (2003) Cell counting and viability assessments in the process development of cellular therapeutics. BioProcessing J July/August:57–60 Lem L (2003) Cell counting and viability assessments in the process development of cellular therapeutics. BioProcessing J July/August:57–60
22.
go back to reference Maecker T (2005) The role of immune monitoring in evaluating cancer immunotherapy. In: Disis ML (ed) Cancer drug discovery and development: immunotherapy of cancer. Humana Press Inc., NJ, pp 59–72 Maecker T (2005) The role of immune monitoring in evaluating cancer immunotherapy. In: Disis ML (ed) Cancer drug discovery and development: immunotherapy of cancer. Humana Press Inc., NJ, pp 59–72
23.
go back to reference Maecker HT, Dunn HS, Suni MA, Khatamzas E, Pitcher CJ, Bunde T, Persaud N, Trigona W, Fu TM, Sinclair E, Bredt BM, McCune JM, Maino VC, Kern F, Picker LJ (2001) Use of overlapping peptide mixtures as antigens for cytokine flow cytometry. J Immunol Methods 255:27–40PubMedCrossRef Maecker HT, Dunn HS, Suni MA, Khatamzas E, Pitcher CJ, Bunde T, Persaud N, Trigona W, Fu TM, Sinclair E, Bredt BM, McCune JM, Maino VC, Kern F, Picker LJ (2001) Use of overlapping peptide mixtures as antigens for cytokine flow cytometry. J Immunol Methods 255:27–40PubMedCrossRef
24.
go back to reference Morse MA, Clay TM, Hobeika AC, Mosca PJ, Lyerly HK (2001) Surrogate markers of response to cancer immunotherapy. Expert Opin Biol Ther 1:153–158PubMedCrossRef Morse MA, Clay TM, Hobeika AC, Mosca PJ, Lyerly HK (2001) Surrogate markers of response to cancer immunotherapy. Expert Opin Biol Ther 1:153–158PubMedCrossRef
25.
go back to reference Mwau M, McMichael AJ, Hanke T (2002) Design and validation of an enzyme-linked immunospot assay for use in clinical trials of candidate HIV vaccines. AIDS Res Hum Retroviruses 18:611–618PubMedCrossRef Mwau M, McMichael AJ, Hanke T (2002) Design and validation of an enzyme-linked immunospot assay for use in clinical trials of candidate HIV vaccines. AIDS Res Hum Retroviruses 18:611–618PubMedCrossRef
26.
go back to reference Nagorsen D, Scheibenbogen C, Thiel E, Keilholz U (2004) Immunological monitoring of cancer vaccine therapy. Expert Opin Biol Ther 4:1677–1684PubMedCrossRef Nagorsen D, Scheibenbogen C, Thiel E, Keilholz U (2004) Immunological monitoring of cancer vaccine therapy. Expert Opin Biol Ther 4:1677–1684PubMedCrossRef
27.
go back to reference NCCLS (2001) Evaluation of matrix effects, approved guidelines. NCCLS document EP14-A NCCLS (2001) Evaluation of matrix effects, approved guidelines. NCCLS document EP14-A
28.
go back to reference NCCLS (2004) Performance of single cell immune response assays; approved guidelines. NCCLS document I/LA26-A NCCLS (2004) Performance of single cell immune response assays; approved guidelines. NCCLS document I/LA26-A
31.
go back to reference Russell ND, Hudgens MG, Ha R, Havenar-Daughton C, McElrath MJ (2003) Moving to human immunodeficiency virus type 1 vaccine efficacy trials: defining T cell responses as potential correlates of immunity. J Infect Dis 187:226–242PubMedCrossRef Russell ND, Hudgens MG, Ha R, Havenar-Daughton C, McElrath MJ (2003) Moving to human immunodeficiency virus type 1 vaccine efficacy trials: defining T cell responses as potential correlates of immunity. J Infect Dis 187:226–242PubMedCrossRef
32.
go back to reference Samri A, Durier C, Urrutia A, Sanchez I, Gahery-Segard H, Imbart S, Sinet M, Tartour E, Aboulker J-P, Autran B, Venet A, The ANRS Elispot Standardization Group (2006) Evaluation of the interlaboratory concordance in quantification of HIV-specific T cells with a gamma interferon enzyme-linked immunospot assay. Clin Vaccine Immunol 13:684–697PubMedCrossRef Samri A, Durier C, Urrutia A, Sanchez I, Gahery-Segard H, Imbart S, Sinet M, Tartour E, Aboulker J-P, Autran B, Venet A, The ANRS Elispot Standardization Group (2006) Evaluation of the interlaboratory concordance in quantification of HIV-specific T cells with a gamma interferon enzyme-linked immunospot assay. Clin Vaccine Immunol 13:684–697PubMedCrossRef
33.
go back to reference Scheibenbogen C, Romero P, Rivoltini L, Herr W, Schmittel A, Cerottini J-C, Woelfel T, Eggermont AMM, Keilholz U (2000) Quantitation of antigen-reactive T cells in peripheral blood by IFNg-ELISPOT assay and chromium-release assay: a four-centre comparative trial. J Immunol Methods 244:81–89PubMedCrossRef Scheibenbogen C, Romero P, Rivoltini L, Herr W, Schmittel A, Cerottini J-C, Woelfel T, Eggermont AMM, Keilholz U (2000) Quantitation of antigen-reactive T cells in peripheral blood by IFNg-ELISPOT assay and chromium-release assay: a four-centre comparative trial. J Immunol Methods 244:81–89PubMedCrossRef
34.
go back to reference Smith JG, Liu X, Kaufhold RM, Clair J, Caulfield MJ (2001) Development and validation of a gamma Interferon ELISPOT assay for quantitation of cellular immune responses to varicella-zoster virus. Clin Diagn Lab Immunol 8:871–879PubMedCrossRef Smith JG, Liu X, Kaufhold RM, Clair J, Caulfield MJ (2001) Development and validation of a gamma Interferon ELISPOT assay for quantitation of cellular immune responses to varicella-zoster virus. Clin Diagn Lab Immunol 8:871–879PubMedCrossRef
35.
go back to reference Smith JG, Joseph HR, Green T, Field JA, Wooters M, Kaufhold RM, Antonello J, Caulfield MJ (2007) Establishing acceptance criteria for cell-mediated-immunity assays using frozen peripheral blood mononuclear cells stored under optimal and suboptimal conditions. Clin Vaccine Immunol 14:527–537PubMedCrossRef Smith JG, Joseph HR, Green T, Field JA, Wooters M, Kaufhold RM, Antonello J, Caulfield MJ (2007) Establishing acceptance criteria for cell-mediated-immunity assays using frozen peripheral blood mononuclear cells stored under optimal and suboptimal conditions. Clin Vaccine Immunol 14:527–537PubMedCrossRef
36.
go back to reference Tuomela M, Stanescu I, Krohn K (2005) Validation overview of bio-analytical methods. Gene Ther 12(Suppl 1):131–138CrossRef Tuomela M, Stanescu I, Krohn K (2005) Validation overview of bio-analytical methods. Gene Ther 12(Suppl 1):131–138CrossRef
37.
go back to reference United States Pharmacopeia—USP (1999) Validation of compendial methods. Suppl 10, pp 5059–5062 United States Pharmacopeia—USP (1999) Validation of compendial methods. Suppl 10, pp 5059–5062
38.
go back to reference Walker EB, Disis ML (2003) Monitoring immune responses in cancer patients receiving tumor vaccines. Int Rev Immunol 22:283–319PubMedCrossRef Walker EB, Disis ML (2003) Monitoring immune responses in cancer patients receiving tumor vaccines. Int Rev Immunol 22:283–319PubMedCrossRef
39.
go back to reference Whiteside TL (2000) Immunologic monitoring of clinical trials in patients with cancer: technology versus common sense. Immunol Invest 29:149–162PubMed Whiteside TL (2000) Immunologic monitoring of clinical trials in patients with cancer: technology versus common sense. Immunol Invest 29:149–162PubMed
Metadata
Title
Results and harmonization guidelines from two large-scale international Elispot proficiency panels conducted by the Cancer Vaccine Consortium (CVC/SVI)
Authors
Sylvia Janetzki
Katherine S. Panageas
Leah Ben-Porat
Jean Boyer
Cedrik M. Britten
Timothy M. Clay
Michael Kalos
Holden T. Maecker
Pedro Romero
Jianda Yuan
W. Martin Kast
Axel Hoos
for the Elispot Proficiency Panel of the CVC Immune Assay Working Group
Publication date
01-03-2008
Publisher
Springer-Verlag
Published in
Cancer Immunology, Immunotherapy / Issue 3/2008
Print ISSN: 0340-7004
Electronic ISSN: 1432-0851
DOI
https://doi.org/10.1007/s00262-007-0380-6

Other articles of this Issue 3/2008

Cancer Immunology, Immunotherapy 3/2008 Go to the issue
Webinar | 19-02-2024 | 17:30 (CET)

Keynote webinar | Spotlight on antibody–drug conjugates in cancer

Antibody–drug conjugates (ADCs) are novel agents that have shown promise across multiple tumor types. Explore the current landscape of ADCs in breast and lung cancer with our experts, and gain insights into the mechanism of action, key clinical trials data, existing challenges, and future directions.

Dr. Véronique Diéras
Prof. Fabrice Barlesi
Developed by: Springer Medicine