Skip to main content
Top
Published in: BMC Immunology 1/2008

Open Access 01-12-2008 | Methodology article

Precision and linearity targets for validation of an IFNγ ELISPOT, cytokine flow cytometry, and tetramer assay using CMV peptides

Authors: Holden T Maecker, Jeffrey Hassler, Janice K Payne, Amanda Summers, Karrie Comatas, Manar Ghanayem, Michael A Morse, Timothy M Clay, Herbert K Lyerly, Sonny Bhatia, Smita A Ghanekar, Vernon C Maino, Corazon delaRosa, Mary L Disis

Published in: BMC Immunology | Issue 1/2008

Login to get access

Abstract

Background

Single-cell assays of immune function are increasingly used to monitor T cell responses in immunotherapy clinical trials. Standardization and validation of such assays are therefore important to interpretation of the clinical trial data. Here we assess the levels of intra-assay, inter-assay, and inter-operator precision, as well as linearity, of CD8+ T cell IFNγ-based ELISPOT and cytokine flow cytometry (CFC), as well as tetramer assays.

Results

Precision was measured in cryopreserved PBMC with a low, medium, or high response level to a CMV pp65 peptide or peptide mixture. Intra-assay precision was assessed using 6 replicates per assay; inter-assay precision was assessed by performing 8 assays on different days; and inter-operator precision was assessed using 3 different operators working on the same day. Percent CV values ranged from 4% to 133% depending upon the assay and response level. Linearity was measured by diluting PBMC from a high responder into PBMC from a non-responder, and yielded R2 values from 0.85 to 0.99 depending upon the assay and antigen.

Conclusion

These data provide target values for precision and linearity of single-cell assays for those wishing to validate these assays in their own laboratories. They also allow for comparison of the precision and linearity of ELISPOT, CFC, and tetramer across a range of response levels. There was a trend toward tetramer assays showing the highest precision, followed closely by CFC, and then ELISPOT; while all three assays had similar linearity. These findings are contingent upon the use of optimized protocols for each assay.
Appendix
Available only for authorised users
Literature
1.
go back to reference Owens MA, Vall HG, Hurley AA, Wormsley SB: Validation and quality control of immunophenotyping in clinical flow cytometry. J Immunol Methods. 2000, 243: 33-50. 10.1016/S0022-1759(00)00226-X.CrossRefPubMed Owens MA, Vall HG, Hurley AA, Wormsley SB: Validation and quality control of immunophenotyping in clinical flow cytometry. J Immunol Methods. 2000, 243: 33-50. 10.1016/S0022-1759(00)00226-X.CrossRefPubMed
2.
go back to reference Borg L, Kristiansen J, Christensen JM, Jepsen KF, Poulsen LK: Evaluation of accuracy and uncertainty of ELISA assays for the determination of interleukin-4, interleukin-5, interferon-gamma and tumor necrosis factor-alpha. Clin Chem Lab Med. 2002, 40: 509-19. 10.1515/CCLM.2002.089.CrossRefPubMed Borg L, Kristiansen J, Christensen JM, Jepsen KF, Poulsen LK: Evaluation of accuracy and uncertainty of ELISA assays for the determination of interleukin-4, interleukin-5, interferon-gamma and tumor necrosis factor-alpha. Clin Chem Lab Med. 2002, 40: 509-19. 10.1515/CCLM.2002.089.CrossRefPubMed
3.
go back to reference Findlay JW, Smith WC, Lee JW, Nordblom GD, Das I, DeSilva BS, Khan MN, Bowsher RR: Validation of immunoassays for bioanalysis: a pharmaceutical industry perspective. J Pharm Biomed Anal. 2000, 21: 1249-73. 10.1016/S0731-7085(99)00244-7.CrossRefPubMed Findlay JW, Smith WC, Lee JW, Nordblom GD, Das I, DeSilva BS, Khan MN, Bowsher RR: Validation of immunoassays for bioanalysis: a pharmaceutical industry perspective. J Pharm Biomed Anal. 2000, 21: 1249-73. 10.1016/S0731-7085(99)00244-7.CrossRefPubMed
4.
go back to reference Altman JD, Moss PAH, Goulder PJR, Barouch DH, McHeyzer-Williams MG, Bell JI, McMichael AJ, Davis MM: Phenotypic analysis of antigen-specific T lymphocytes. Science. 1996, 274: 94-6. 10.1126/science.274.5284.94.CrossRefPubMed Altman JD, Moss PAH, Goulder PJR, Barouch DH, McHeyzer-Williams MG, Bell JI, McMichael AJ, Davis MM: Phenotypic analysis of antigen-specific T lymphocytes. Science. 1996, 274: 94-6. 10.1126/science.274.5284.94.CrossRefPubMed
5.
go back to reference Suni MA, Picker LJ, Maino VC: Detection of antigen-specific T cell cytokine expression in whole blood by flow cytometry. J Immunol Methods. 1998, 212: 89-98. 10.1016/S0022-1759(98)00004-0.CrossRefPubMed Suni MA, Picker LJ, Maino VC: Detection of antigen-specific T cell cytokine expression in whole blood by flow cytometry. J Immunol Methods. 1998, 212: 89-98. 10.1016/S0022-1759(98)00004-0.CrossRefPubMed
6.
go back to reference Waldrop SL, Pitcher CJ, Peterson DM, Maino VC, Picker LJ: Determination of antigen-specific memory/effector CD4+ T cell frequencies by flow cytometry: evidence for a novel, antigen-specific homeostatic mechanism in HIV-associated immunodeficiency. J Clin Invest. 1997, 99: 1739-50. 10.1172/JCI119338.PubMedCentralCrossRefPubMed Waldrop SL, Pitcher CJ, Peterson DM, Maino VC, Picker LJ: Determination of antigen-specific memory/effector CD4+ T cell frequencies by flow cytometry: evidence for a novel, antigen-specific homeostatic mechanism in HIV-associated immunodeficiency. J Clin Invest. 1997, 99: 1739-50. 10.1172/JCI119338.PubMedCentralCrossRefPubMed
7.
go back to reference Czerkinsky C, Andersson G, Ekre HP, Nilsson LA, Klareskog L, Ouchterlony O: Reverse ELISPOT assay for clonal analysis of cytokine production. I. Enumeration of gamma-interferon-secreting cells. J Immunol Methods. 1988, 110: 29-36. 10.1016/0022-1759(88)90079-8.CrossRefPubMed Czerkinsky C, Andersson G, Ekre HP, Nilsson LA, Klareskog L, Ouchterlony O: Reverse ELISPOT assay for clonal analysis of cytokine production. I. Enumeration of gamma-interferon-secreting cells. J Immunol Methods. 1988, 110: 29-36. 10.1016/0022-1759(88)90079-8.CrossRefPubMed
8.
go back to reference Lathey J: Preliminary steps toward validating a clinical bioassay: case study of the ELISpot assay. Biopharm Intl. 2003, 42-50. Lathey J: Preliminary steps toward validating a clinical bioassay: case study of the ELISpot assay. Biopharm Intl. 2003, 42-50.
9.
go back to reference Lathey J, Sathiyaseelan J, Matijevic M, Hedley ML: Validation of pretrial ELISspot measurements. BioProcess Intl. 2003, 34-41. Lathey J, Sathiyaseelan J, Matijevic M, Hedley ML: Validation of pretrial ELISspot measurements. BioProcess Intl. 2003, 34-41.
10.
go back to reference Maecker HT, Rinfret A, D'Souza P, Darden J, Roig E, Landry C, Hayes P, Birungi J, Anzala O, Garcia M, et al.: Standardization of cytokine flow cytometry assays. BMC Immunol. 2005, 6: 13-10.1186/1471-2172-6-13.PubMedCentralCrossRefPubMed Maecker HT, Rinfret A, D'Souza P, Darden J, Roig E, Landry C, Hayes P, Birungi J, Anzala O, Garcia M, et al.: Standardization of cytokine flow cytometry assays. BMC Immunol. 2005, 6: 13-10.1186/1471-2172-6-13.PubMedCentralCrossRefPubMed
11.
go back to reference Nomura LE, Walker JM, Maecker HT: Optimization of whole blood antigen-specific cytokine assays for CD4(+) T cells. Cytometry. 2000, 40: 60-68. 10.1002/(SICI)1097-0320(20000501)40:1<60::AID-CYTO8>3.0.CO;2-J.CrossRefPubMed Nomura LE, Walker JM, Maecker HT: Optimization of whole blood antigen-specific cytokine assays for CD4(+) T cells. Cytometry. 2000, 40: 60-68. 10.1002/(SICI)1097-0320(20000501)40:1<60::AID-CYTO8>3.0.CO;2-J.CrossRefPubMed
12.
go back to reference Maino VC, Suni MA, Wormsley SB, Carlo DJ, Wallace MR, Moss RB: Enhancement of HIV type 1 antigen-specific CD4+ T cell memory in subjects with chronic HIV type 1 infection receiving an HIV type 1 immunogen. AIDS Res Hum Retroviruses. 2000, 16: 539-47. 10.1089/088922200308954.CrossRefPubMed Maino VC, Suni MA, Wormsley SB, Carlo DJ, Wallace MR, Moss RB: Enhancement of HIV type 1 antigen-specific CD4+ T cell memory in subjects with chronic HIV type 1 infection receiving an HIV type 1 immunogen. AIDS Res Hum Retroviruses. 2000, 16: 539-47. 10.1089/088922200308954.CrossRefPubMed
13.
go back to reference Smith JW, Walker EB, Fox BA, Haley D, Wisner KP, Doran T, Fisher B, Justice L, Wood W, Vetto J, et al.: Adjuvant immunization of HLA-A2-positive melanoma patients with a modified gp100 peptide induces peptide-specific CD8+ T-cell responses. J Clin Oncol. 2003, 21: 1562-73. 10.1200/JCO.2003.09.020.CrossRefPubMed Smith JW, Walker EB, Fox BA, Haley D, Wisner KP, Doran T, Fisher B, Justice L, Wood W, Vetto J, et al.: Adjuvant immunization of HLA-A2-positive melanoma patients with a modified gp100 peptide induces peptide-specific CD8+ T-cell responses. J Clin Oncol. 2003, 21: 1562-73. 10.1200/JCO.2003.09.020.CrossRefPubMed
14.
go back to reference Cox JH, Ferrari G, Kalams SA, Lopaczynski W, Oden N, D'Souza M P: Results of an ELISPOT proficiency panel conducted in 11 laboratories participating in international human immunodeficiency virus type 1 vaccine trials. AIDS Res Hum Retroviruses. 2005, 21: 68-81. 10.1089/aid.2005.21.68.CrossRefPubMed Cox JH, Ferrari G, Kalams SA, Lopaczynski W, Oden N, D'Souza M P: Results of an ELISPOT proficiency panel conducted in 11 laboratories participating in international human immunodeficiency virus type 1 vaccine trials. AIDS Res Hum Retroviruses. 2005, 21: 68-81. 10.1089/aid.2005.21.68.CrossRefPubMed
15.
go back to reference Maecker HT, Moon J, Bhatia S, Ghanekar SA, Maino VC, Payne JK, Kuus-Reichel K, Chang JC, Summers A, Clay TM, et al.: Impact of cryopreservation on tetramer, cytokine flow cytometry, and ELISPOT. BMC Immunol. 2005, 6: 17-10.1186/1471-2172-6-17.PubMedCentralCrossRefPubMed Maecker HT, Moon J, Bhatia S, Ghanekar SA, Maino VC, Payne JK, Kuus-Reichel K, Chang JC, Summers A, Clay TM, et al.: Impact of cryopreservation on tetramer, cytokine flow cytometry, and ELISPOT. BMC Immunol. 2005, 6: 17-10.1186/1471-2172-6-17.PubMedCentralCrossRefPubMed
16.
go back to reference Kern F, Surel IP, Brock C, Freistedt B, Radtke H, Scheffold A, Blasczyk R, Reinke P, Schneider-Mergener J, Radbruch A, et al.: T-cell epitope mapping by flow cytometry. Nat Med. 1998, 4: 975-8. 10.1038/nm0898-975.CrossRefPubMed Kern F, Surel IP, Brock C, Freistedt B, Radtke H, Scheffold A, Blasczyk R, Reinke P, Schneider-Mergener J, Radbruch A, et al.: T-cell epitope mapping by flow cytometry. Nat Med. 1998, 4: 975-8. 10.1038/nm0898-975.CrossRefPubMed
17.
go back to reference Kern F, Bunde T, Faulhaber N, Kiecker F, Khatamzas E, Rudawski IM, Pruss A, Gratama JW, Volkmer-Engert R, Ewert R, et al.: Cytomegalovirus (CMV) phosphoprotein 65 makes a large contribution to shaping the T cell repertoire in CMV-exposed individuals. J Infect Dis. 2002, 185: 1709-16. 10.1086/340637.CrossRefPubMed Kern F, Bunde T, Faulhaber N, Kiecker F, Khatamzas E, Rudawski IM, Pruss A, Gratama JW, Volkmer-Engert R, Ewert R, et al.: Cytomegalovirus (CMV) phosphoprotein 65 makes a large contribution to shaping the T cell repertoire in CMV-exposed individuals. J Infect Dis. 2002, 185: 1709-16. 10.1086/340637.CrossRefPubMed
18.
go back to reference Asemissen AM, Nagorsen D, Keilholz U, Letsch A, Schmittel A, Thiel E, Scheibenbogen C: Flow cytometric determination of intracellular or secreted IFNgamma for the quantification of antigen reactive T cells. J Immunol Methods. 2001, 251: 101-8. 10.1016/S0022-1759(01)00312-X.CrossRefPubMed Asemissen AM, Nagorsen D, Keilholz U, Letsch A, Schmittel A, Thiel E, Scheibenbogen C: Flow cytometric determination of intracellular or secreted IFNgamma for the quantification of antigen reactive T cells. J Immunol Methods. 2001, 251: 101-8. 10.1016/S0022-1759(01)00312-X.CrossRefPubMed
19.
go back to reference Heeger PS, Greenspan NS, Kuhlenschmidt S, Dejelo C, Hricik DE, Schulak JA, Tary-Lehmann M: Pretransplant frequency of donor-specific, IFN-gamma-producing lymphocytes is a manifestation of immunologic memory and correlates with the risk of posttransplant rejection episodes. J Immunol. 1999, 163: 2267-75.PubMed Heeger PS, Greenspan NS, Kuhlenschmidt S, Dejelo C, Hricik DE, Schulak JA, Tary-Lehmann M: Pretransplant frequency of donor-specific, IFN-gamma-producing lymphocytes is a manifestation of immunologic memory and correlates with the risk of posttransplant rejection episodes. J Immunol. 1999, 163: 2267-75.PubMed
20.
go back to reference Helms T, Boehm BO, Asaad RJ, Trezza RP, Lehmann PV, Tary-Lehmann M: Direct visualization of cytokine-producing recall antigen-specific CD4 memory T cells in healthy individuals and HIV patients. J Immunol. 2000, 164: 3723-32.CrossRefPubMed Helms T, Boehm BO, Asaad RJ, Trezza RP, Lehmann PV, Tary-Lehmann M: Direct visualization of cytokine-producing recall antigen-specific CD4 memory T cells in healthy individuals and HIV patients. J Immunol. 2000, 164: 3723-32.CrossRefPubMed
21.
go back to reference Hobeika AC, Morse MA, Osada T, Ghanayem M, Niedzwiecki D, Barrier R, Lyerly HK, Clay TM: Enumerating antigen-specific T-cell responses in peripheral blood: a comparison of peptide MHC Tetramer, ELISpot, and intracellular cytokine analysis. J Immunother. 2005, 28: 63-72. 10.1097/00002371-200501000-00008.CrossRefPubMed Hobeika AC, Morse MA, Osada T, Ghanayem M, Niedzwiecki D, Barrier R, Lyerly HK, Clay TM: Enumerating antigen-specific T-cell responses in peripheral blood: a comparison of peptide MHC Tetramer, ELISpot, and intracellular cytokine analysis. J Immunother. 2005, 28: 63-72. 10.1097/00002371-200501000-00008.CrossRefPubMed
22.
go back to reference Karlsson AC, Martin JN, Younger SR, Bredt BM, Epling L, Ronquillo R, Varma A, Deeks SG, McCune JM, Nixon DF, et al.: Comparison of the ELISPOT and cytokine flow cytometry assays for the enumeration of antigen-specific T cells. J Immunol Methods. 2003, 283: 141-53. 10.1016/j.jim.2003.09.001.CrossRefPubMed Karlsson AC, Martin JN, Younger SR, Bredt BM, Epling L, Ronquillo R, Varma A, Deeks SG, McCune JM, Nixon DF, et al.: Comparison of the ELISPOT and cytokine flow cytometry assays for the enumeration of antigen-specific T cells. J Immunol Methods. 2003, 283: 141-53. 10.1016/j.jim.2003.09.001.CrossRefPubMed
23.
go back to reference Kuzushima K, Hoshino Y, Fujii K, Yokoyama N, Fujita M, Kiyono T, Kimura H, Morishima T, Morishima Y, Tsurumi T: Rapid determination of Epstein-Barr virus-specific CD8(+) T-cell frequencies by flow cytometry. Blood. 1999, 94: 3094-100.PubMed Kuzushima K, Hoshino Y, Fujii K, Yokoyama N, Fujita M, Kiyono T, Kimura H, Morishima T, Morishima Y, Tsurumi T: Rapid determination of Epstein-Barr virus-specific CD8(+) T-cell frequencies by flow cytometry. Blood. 1999, 94: 3094-100.PubMed
24.
go back to reference Moretto WJ, Drohan LA, Nixon DF: Rapid quantification of SIV-specific CD8 T cell responses with recombinant vaccinia virus ELISPOT or cytokine flow cytometry. Aids. 2000, 14: 2625-7. 10.1097/00002030-200011100-00034.CrossRefPubMed Moretto WJ, Drohan LA, Nixon DF: Rapid quantification of SIV-specific CD8 T cell responses with recombinant vaccinia virus ELISPOT or cytokine flow cytometry. Aids. 2000, 14: 2625-7. 10.1097/00002030-200011100-00034.CrossRefPubMed
25.
go back to reference Pahar B, Li J, Rourke T, Miller CJ, McChesney MB: Detection of antigen-specific T cell interferon gamma expression by ELISPOT and cytokine flow cytometry assays in rhesus macaques. J Immunol Methods. 2003, 282: 103-15. 10.1016/j.jim.2003.08.003.CrossRefPubMed Pahar B, Li J, Rourke T, Miller CJ, McChesney MB: Detection of antigen-specific T cell interferon gamma expression by ELISPOT and cytokine flow cytometry assays in rhesus macaques. J Immunol Methods. 2003, 282: 103-15. 10.1016/j.jim.2003.08.003.CrossRefPubMed
26.
go back to reference Sun Y, Iglesias E, Samri A, Kamkamidze G, Decoville T, Carcelain G, Autran B: A systematic comparison of methods to measure HIV-1 specific CD8 T cells. J Immunol Methods. 2003, 272: 23-34. 10.1016/S0022-1759(02)00328-9.CrossRefPubMed Sun Y, Iglesias E, Samri A, Kamkamidze G, Decoville T, Carcelain G, Autran B: A systematic comparison of methods to measure HIV-1 specific CD8 T cells. J Immunol Methods. 2003, 272: 23-34. 10.1016/S0022-1759(02)00328-9.CrossRefPubMed
27.
go back to reference Whiteside TL, Zhao Y, Tsukishiro T, Elder EM, Gooding W, Baar J: Enzyme-linked immunospot, cytokine flow cytometry, and tetramers in the detection of T-cell responses to a dendritic cell-based multipeptide vaccine in patients with melanoma. Clin Cancer Res. 2003, 9: 641-9.PubMed Whiteside TL, Zhao Y, Tsukishiro T, Elder EM, Gooding W, Baar J: Enzyme-linked immunospot, cytokine flow cytometry, and tetramers in the detection of T-cell responses to a dendritic cell-based multipeptide vaccine in patients with melanoma. Clin Cancer Res. 2003, 9: 641-9.PubMed
28.
go back to reference Samri A, Durier C, Urrutia A, Sanchez I, Gahery-Segard H, Imbart S, Sinet M, Tartour E, Aboulker JP, Autran B, et al.: Evaluation of the interlaboratory concordance in quantification of human immunodeficiency virus-specific T cells with a gamma interferon enzyme-linked immunospot assay. Clin Vaccine Immunol. 2006, 13: 684-97. 10.1128/CVI.00387-05.PubMedCentralCrossRefPubMed Samri A, Durier C, Urrutia A, Sanchez I, Gahery-Segard H, Imbart S, Sinet M, Tartour E, Aboulker JP, Autran B, et al.: Evaluation of the interlaboratory concordance in quantification of human immunodeficiency virus-specific T cells with a gamma interferon enzyme-linked immunospot assay. Clin Vaccine Immunol. 2006, 13: 684-97. 10.1128/CVI.00387-05.PubMedCentralCrossRefPubMed
29.
go back to reference Motulsky H: Intuitive Biostatistics. 1995, Oxford: Oxford Univ. Press, 29- Motulsky H: Intuitive Biostatistics. 1995, Oxford: Oxford Univ. Press, 29-
30.
go back to reference Maecker HT: The role of immune monitoring in evaluating cancer immunotherapy. Cancer Drug Discovery and Development: Immunotherapy of Cancer. Edited by: Disis ML. 2005, Totowa, NJ: Humana Press, 59-71. Maecker HT: The role of immune monitoring in evaluating cancer immunotherapy. Cancer Drug Discovery and Development: Immunotherapy of Cancer. Edited by: Disis ML. 2005, Totowa, NJ: Humana Press, 59-71.
Metadata
Title
Precision and linearity targets for validation of an IFNγ ELISPOT, cytokine flow cytometry, and tetramer assay using CMV peptides
Authors
Holden T Maecker
Jeffrey Hassler
Janice K Payne
Amanda Summers
Karrie Comatas
Manar Ghanayem
Michael A Morse
Timothy M Clay
Herbert K Lyerly
Sonny Bhatia
Smita A Ghanekar
Vernon C Maino
Corazon delaRosa
Mary L Disis
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Immunology / Issue 1/2008
Electronic ISSN: 1471-2172
DOI
https://doi.org/10.1186/1471-2172-9-9

Other articles of this Issue 1/2008

BMC Immunology 1/2008 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.