Skip to main content
Top
Published in: BMC Immunology 1/2005

Open Access 01-12-2005 | Methodology article

Standardization of cytokine flow cytometry assays

Authors: Holden T Maecker, Aline Rinfret, Patricia D'Souza, Janice Darden, Eva Roig, Claire Landry, Peter Hayes, Josephine Birungi, Omu Anzala, Miguel Garcia, Alexandre Harari, Ian Frank, Ruth Baydo, Megan Baker, Jennifer Holbrook, Janet Ottinger, Laurie Lamoreaux, C Lorrie Epling, Elizabeth Sinclair, Maria A Suni, Kara Punt, Sandra Calarota, Sophia El-Bahi, Gailet Alter, Hazel Maila, Ellen Kuta, Josephine Cox, Clive Gray, Marcus Altfeld, Nolwenn Nougarede, Jean Boyer, Lynda Tussey, Timothy Tobery, Barry Bredt, Mario Roederer, Richard Koup, Vernon C Maino, Kent Weinhold, Giuseppe Pantaleo, Jill Gilmour, Helen Horton, Rafick P Sekaly

Published in: BMC Immunology | Issue 1/2005

Login to get access

Abstract

Background

Cytokine flow cytometry (CFC) or intracellular cytokine staining (ICS) can quantitate antigen-specific T cell responses in settings such as experimental vaccination. Standardization of ICS among laboratories performing vaccine studies would provide a common platform by which to compare the immunogenicity of different vaccine candidates across multiple international organizations conducting clinical trials. As such, a study was carried out among several laboratories involved in HIV clinical trials, to define the inter-lab precision of ICS using various sample types, and using a common protocol for each experiment (see additional files online).

Results

Three sample types (activated, fixed, and frozen whole blood; fresh whole blood; and cryopreserved PBMC) were shipped to various sites, where ICS assays using cytomegalovirus (CMV) pp65 peptide mix or control antigens were performed in parallel in 96-well plates. For one experiment, antigens and antibody cocktails were lyophilised into 96-well plates to simplify and standardize the assay setup. Results (CD4+cytokine+ cells and CD8+cytokine+ cells) were determined by each site. Raw data were also sent to a central site for batch analysis with a dynamic gating template.
Mean inter-laboratory coefficient of variation (C.V.) ranged from 17–44% depending upon the sample type and analysis method. Cryopreserved peripheral blood mononuclear cells (PBMC) yielded lower inter-lab C.V.'s than whole blood. Centralized analysis (using a dynamic gating template) reduced the inter-lab C.V. by 5–20%, depending upon the experiment. The inter-lab C.V. was lowest (18–24%) for samples with a mean of >0.5% IFNγ + T cells, and highest (57–82%) for samples with a mean of <0.1% IFNγ + cells.

Conclusion

ICS assays can be performed by multiple laboratories using a common protocol with good inter-laboratory precision, which improves as the frequency of responding cells increases. Cryopreserved PBMC may yield slightly more consistent results than shipped whole blood. Analysis, particularly gating, is a significant source of variability, and can be reduced by centralized analysis and/or use of a standardized dynamic gating template. Use of pre-aliquoted lyophilized reagents for stimulation and staining can provide further standardization to these assays.
Appendix
Available only for authorised users
Literature
1.
go back to reference Suni MA, Dunn HS, Orr PL, deLaat R, Sinclair E, Ghanekar SA, Bredt BM, Dunne JF, Maino VC, Maecker HT: Performance of plate-based cytokine flow cytometry with automated data analysis. BMC Immunology. 2003, 4: 9-PubMedCentralCrossRefPubMed Suni MA, Dunn HS, Orr PL, deLaat R, Sinclair E, Ghanekar SA, Bredt BM, Dunne JF, Maino VC, Maecker HT: Performance of plate-based cytokine flow cytometry with automated data analysis. BMC Immunology. 2003, 4: 9-PubMedCentralCrossRefPubMed
2.
go back to reference Maecker HT: Cytokine flow cytometry. In Flow Cytometry Protocols 2nd edition. Edited by: Hawley TS, Hawley RG. Totowa, NJ , Humana Press; 2004:95-107.CrossRef Maecker HT: Cytokine flow cytometry. In Flow Cytometry Protocols 2nd edition. Edited by: Hawley TS, Hawley RG. Totowa, NJ , Humana Press; 2004:95-107.CrossRef
3.
go back to reference Cox JH, Ferrari G, Kalams SA, Lopaczynski W, Oden N, Group ELISPOTS: Results of an ELISPOT proficiency panel conducted in 11 laboratories participating in international human immunodeficiency virus type 1 vaccine trials. AIDS Res Hum Retroviruses. 2005, Cox JH, Ferrari G, Kalams SA, Lopaczynski W, Oden N, Group ELISPOTS: Results of an ELISPOT proficiency panel conducted in 11 laboratories participating in international human immunodeficiency virus type 1 vaccine trials. AIDS Res Hum Retroviruses. 2005,
5.
go back to reference Pantaleo G, Koup RA: Correlates of immune protection in HIV-1 infection: what we know, what we don't know, what we should know. Nat Med. 2004, 10 (8): 806-810.CrossRefPubMed Pantaleo G, Koup RA: Correlates of immune protection in HIV-1 infection: what we know, what we don't know, what we should know. Nat Med. 2004, 10 (8): 806-810.CrossRefPubMed
6.
go back to reference Nomura LE, Walker JM, Maecker HT: Optimization of whole blood antigen-specific cytokine assays for CD4(+) T cells. Cytometry. 2000, 40 (1): 60-68.CrossRefPubMed Nomura LE, Walker JM, Maecker HT: Optimization of whole blood antigen-specific cytokine assays for CD4(+) T cells. Cytometry. 2000, 40 (1): 60-68.CrossRefPubMed
7.
go back to reference Landay A: Performance of single cell immune response assays. NCCLS Standards and Guidelines. 2004, Wayne, PA , NCCLS, I/LA26-A. Landay A: Performance of single cell immune response assays. NCCLS Standards and Guidelines. 2004, Wayne, PA , NCCLS, I/LA26-A.
8.
go back to reference Kern F, Faulhaber N, Frommel C, Khatamzas E, Prosch S, Schonemann C, Kretzschmar I, Volkmer-Engert R, Volk HD, Reinke P: Analysis of CD8 T cell reactivity to cytomegalovirus using protein- spanning pools of overlapping pentadecapeptides. Eur J Immunol. 2000, 30 (6): 1676-1682.CrossRefPubMed Kern F, Faulhaber N, Frommel C, Khatamzas E, Prosch S, Schonemann C, Kretzschmar I, Volkmer-Engert R, Volk HD, Reinke P: Analysis of CD8 T cell reactivity to cytomegalovirus using protein- spanning pools of overlapping pentadecapeptides. Eur J Immunol. 2000, 30 (6): 1676-1682.CrossRefPubMed
9.
go back to reference Maecker HT, Dunn HS, Suni MA, Khatamzas E, Pitcher CJ, Bunde T, Persaud N, Trigona W, Fu TM, Sinclair E, Bredt BM, McCune JM, Maino VC, Kern F, Picker LJ: Use of overlapping peptide mixtures as antigens for cytokine flow cytometry. J Immunol Methods. 2001, 255 (1-2): 27-40.CrossRefPubMed Maecker HT, Dunn HS, Suni MA, Khatamzas E, Pitcher CJ, Bunde T, Persaud N, Trigona W, Fu TM, Sinclair E, Bredt BM, McCune JM, Maino VC, Kern F, Picker LJ: Use of overlapping peptide mixtures as antigens for cytokine flow cytometry. J Immunol Methods. 2001, 255 (1-2): 27-40.CrossRefPubMed
10.
go back to reference Kern F, Bunde T, Faulhaber N, Kiecker F, Khatamzas E, Rudawski IM, Pruss A, Gratama JW, Volkmer-Engert R, Ewert R, Reinke P, Volk HD, Picker LJ: Cytomegalovirus (CMV) phosphoprotein 65 makes a large contribution to shaping the T cell repertoire in CMV-exposed individuals. J Infect Dis. 2002, 185 (12): 1709-1716.CrossRefPubMed Kern F, Bunde T, Faulhaber N, Kiecker F, Khatamzas E, Rudawski IM, Pruss A, Gratama JW, Volkmer-Engert R, Ewert R, Reinke P, Volk HD, Picker LJ: Cytomegalovirus (CMV) phosphoprotein 65 makes a large contribution to shaping the T cell repertoire in CMV-exposed individuals. J Infect Dis. 2002, 185 (12): 1709-1716.CrossRefPubMed
11.
go back to reference Kleeberger CA, Lyles RH, Margolick JB, Rinaldo CR, Phair JP, Giorgi JV: Viability and recovery of peripheral blood mononuclear cells cryopreserved for up to 12 years in a multicenter study. Clin Diagn Lab Immunol. 1999, 6 (1): 14-19.PubMedCentralPubMed Kleeberger CA, Lyles RH, Margolick JB, Rinaldo CR, Phair JP, Giorgi JV: Viability and recovery of peripheral blood mononuclear cells cryopreserved for up to 12 years in a multicenter study. Clin Diagn Lab Immunol. 1999, 6 (1): 14-19.PubMedCentralPubMed
12.
go back to reference Weinberg A, Zhang L, Brown D, Erice A, Polsky B, Hirsch MS, Owens S, Lamb K: Viability and functional activity of cryopreserved mononuclear cells. Clin Diagn Lab Immunol. 2000, 7 (4): 714-716.PubMedCentralPubMed Weinberg A, Zhang L, Brown D, Erice A, Polsky B, Hirsch MS, Owens S, Lamb K: Viability and functional activity of cryopreserved mononuclear cells. Clin Diagn Lab Immunol. 2000, 7 (4): 714-716.PubMedCentralPubMed
13.
go back to reference Currier JR, Kuta EG, Turk E, Earhart LB, Loomis-Price L, Janetzki S, Ferrari G, Birx DL, Cox JH: A panel of MHC class I restricted viral peptides for use as a quality control for vaccine trial ELISPOT assays. J Immunol Methods. 2002, 260 (1-2): 157-172.CrossRefPubMed Currier JR, Kuta EG, Turk E, Earhart LB, Loomis-Price L, Janetzki S, Ferrari G, Birx DL, Cox JH: A panel of MHC class I restricted viral peptides for use as a quality control for vaccine trial ELISPOT assays. J Immunol Methods. 2002, 260 (1-2): 157-172.CrossRefPubMed
14.
go back to reference De Rosa SC, Lu FX, Yu J, Perfetto SP, Falloon J, Moser S, Evans TG, Koup R, Miller CJ, Roederer M: Vaccination in humans generates broad T cell cytokine responses. J Immunol. 2004, 173 (9): 5372-5380.CrossRefPubMed De Rosa SC, Lu FX, Yu J, Perfetto SP, Falloon J, Moser S, Evans TG, Koup R, Miller CJ, Roederer M: Vaccination in humans generates broad T cell cytokine responses. J Immunol. 2004, 173 (9): 5372-5380.CrossRefPubMed
15.
go back to reference Kuzushima K, Hoshino Y, Fujii K, Yokoyama N, Fujita M, Kiyono T, Kimura H, Morishima T, Morishima Y, Tsurumi T: Rapid determination of Epstein-Barr virus-specific CD8(+) T-cell frequencies by flow cytometry. Blood. 1999, 94 (9): 3094-3100.PubMed Kuzushima K, Hoshino Y, Fujii K, Yokoyama N, Fujita M, Kiyono T, Kimura H, Morishima T, Morishima Y, Tsurumi T: Rapid determination of Epstein-Barr virus-specific CD8(+) T-cell frequencies by flow cytometry. Blood. 1999, 94 (9): 3094-3100.PubMed
16.
go back to reference Moretto WJ, Drohan LA, Nixon DF: Rapid quantification of SIV-specific CD8 T cell responses with recombinant vaccinia virus ELISPOT or cytokine flow cytometry. Aids. 2000, 14 (16): 2625-2627.CrossRefPubMed Moretto WJ, Drohan LA, Nixon DF: Rapid quantification of SIV-specific CD8 T cell responses with recombinant vaccinia virus ELISPOT or cytokine flow cytometry. Aids. 2000, 14 (16): 2625-2627.CrossRefPubMed
17.
go back to reference Asemissen AM, Nagorsen D, Keilholz U, Letsch A, Schmittel A, Thiel E, Scheibenbogen C: Flow cytometric determination of intracellular or secreted IFNgamma for the quantification of antigen reactive T cells. J Immunol Methods. 2001, 251 (1-2): 101-108.CrossRefPubMed Asemissen AM, Nagorsen D, Keilholz U, Letsch A, Schmittel A, Thiel E, Scheibenbogen C: Flow cytometric determination of intracellular or secreted IFNgamma for the quantification of antigen reactive T cells. J Immunol Methods. 2001, 251 (1-2): 101-108.CrossRefPubMed
18.
go back to reference Pahar B, Li J, Rourke T, Miller CJ, McChesney MB: Detection of antigen-specific T cell interferon gamma expression by ELISPOT and cytokine flow cytometry assays in rhesus macaques. J Immunol Methods. 2003, 282 (1-2): 103-115.CrossRefPubMed Pahar B, Li J, Rourke T, Miller CJ, McChesney MB: Detection of antigen-specific T cell interferon gamma expression by ELISPOT and cytokine flow cytometry assays in rhesus macaques. J Immunol Methods. 2003, 282 (1-2): 103-115.CrossRefPubMed
19.
go back to reference Sun Y, Iglesias E, Samri A, Kamkamidze G, Decoville T, Carcelain G, Autran B: A systematic comparison of methods to measure HIV-1 specific CD8 T cells. J Immunol Methods. 2003, 272 (1-2): 23-34.CrossRefPubMed Sun Y, Iglesias E, Samri A, Kamkamidze G, Decoville T, Carcelain G, Autran B: A systematic comparison of methods to measure HIV-1 specific CD8 T cells. J Immunol Methods. 2003, 272 (1-2): 23-34.CrossRefPubMed
20.
go back to reference Whiteside TL, Zhao Y, Tsukishiro T, Elder EM, Gooding W, Baar J: Enzyme-linked immunospot, cytokine flow cytometry, and tetramers in the detection of T-cell responses to a dendritic cell-based multipeptide vaccine in patients with melanoma. Clin Cancer Res. 2003, 9 (2): 641-649.PubMed Whiteside TL, Zhao Y, Tsukishiro T, Elder EM, Gooding W, Baar J: Enzyme-linked immunospot, cytokine flow cytometry, and tetramers in the detection of T-cell responses to a dendritic cell-based multipeptide vaccine in patients with melanoma. Clin Cancer Res. 2003, 9 (2): 641-649.PubMed
21.
go back to reference Karlsson AC, Martin JN, Younger SR, Bredt BM, Epling L, Ronquillo R, Varma A, Deeks SG, McCune JM, Nixon DF, Sinclair E: Comparison of the ELISPOT and cytokine flow cytometry assays for the enumeration of antigen-specific T cells. J Immunol Methods. 2003, 283 (1-2): 141-153.CrossRefPubMed Karlsson AC, Martin JN, Younger SR, Bredt BM, Epling L, Ronquillo R, Varma A, Deeks SG, McCune JM, Nixon DF, Sinclair E: Comparison of the ELISPOT and cytokine flow cytometry assays for the enumeration of antigen-specific T cells. J Immunol Methods. 2003, 283 (1-2): 141-153.CrossRefPubMed
22.
go back to reference Dunne JF, Maecker HT: Automation of cytokine flow cytometry assays. J Assoc Lab Automation. 2004, 9: 5-9.CrossRef Dunne JF, Maecker HT: Automation of cytokine flow cytometry assays. J Assoc Lab Automation. 2004, 9: 5-9.CrossRef
23.
go back to reference Motulsky H: Intuitive Biostatistics. 1995, Oxford , Oxford Univ. Press, 199-200. Motulsky H: Intuitive Biostatistics. 1995, Oxford , Oxford Univ. Press, 199-200.
24.
go back to reference Maecker HT: The role of immune monitoring in evaluatingcancer immunotherapy. In Immunotherapy of Cancer Edited by:Disis ML. Totowa, NJ , Humana Press; 2005. Maecker HT: The role of immune monitoring in evaluatingcancer immunotherapy. In Immunotherapy of Cancer Edited by:Disis ML. Totowa, NJ , Humana Press; 2005.
25.
go back to reference Trigona WL, Clair JH, Persaud N, Punt K, Bachinsky M, Sadasivan-Nair U, Dubey S, Tussey L, Fu TM, Shiver J: Intracellular staining for HIV-specific IFN-gamma production: statistical analyses establish reproducibility and criteria for distinguishing positive responses. J Interferon Cytokine Res. 2003, 23 (7): 369-377.CrossRefPubMed Trigona WL, Clair JH, Persaud N, Punt K, Bachinsky M, Sadasivan-Nair U, Dubey S, Tussey L, Fu TM, Shiver J: Intracellular staining for HIV-specific IFN-gamma production: statistical analyses establish reproducibility and criteria for distinguishing positive responses. J Interferon Cytokine Res. 2003, 23 (7): 369-377.CrossRefPubMed
26.
go back to reference Sinclair E, Black D, Epling CL, Carvidi A, Josefowicz SZ, Bredt BM, Jacobson MA: CMV antigen-specific CD4+ and CD8+ T cell IFNgamma expression and proliferation responses in healthy CMV-seropositive individuals. Viral Immunol. 2004, 17 (3): 445-454.PubMedCentralCrossRefPubMed Sinclair E, Black D, Epling CL, Carvidi A, Josefowicz SZ, Bredt BM, Jacobson MA: CMV antigen-specific CD4+ and CD8+ T cell IFNgamma expression and proliferation responses in healthy CMV-seropositive individuals. Viral Immunol. 2004, 17 (3): 445-454.PubMedCentralCrossRefPubMed
27.
go back to reference Weinberg A, Wohl DA, Brown DG, Pott GB, Zhang L, Ray MG, van der Horst C: Effect of cryopreservation on measurement of cytomegalovirus-specific cellular immune responses in HIV-infected patients. J Acquir Immune Defic Syndr. 2000, 25 (2): 109-114.CrossRefPubMed Weinberg A, Wohl DA, Brown DG, Pott GB, Zhang L, Ray MG, van der Horst C: Effect of cryopreservation on measurement of cytomegalovirus-specific cellular immune responses in HIV-infected patients. J Acquir Immune Defic Syndr. 2000, 25 (2): 109-114.CrossRefPubMed
28.
go back to reference Costantini A, Mancini S, Giuliodoro S, Butini L, Regnery CM, Silvestri G, Montroni M: Effects of cryopreservation on lymphocyte immunophenotype and function. J Immunol Methods. 2003, 278 (1-2): 145-155.CrossRefPubMed Costantini A, Mancini S, Giuliodoro S, Butini L, Regnery CM, Silvestri G, Montroni M: Effects of cryopreservation on lymphocyte immunophenotype and function. J Immunol Methods. 2003, 278 (1-2): 145-155.CrossRefPubMed
29.
go back to reference Lathey J: Preliminary steps toward validating a clinical bioassay: case study of the ELISpot assay. Biopharm Intl. 2003, March: 42-50. Lathey J: Preliminary steps toward validating a clinical bioassay: case study of the ELISpot assay. Biopharm Intl. 2003, March: 42-50.
30.
go back to reference Lathey J, Sathiyaseelan J, Matijevic M, Hedley ML: Validation of pretrial ELISspot measurements. BioProcess Intl. 2003, Sept.: 34-41. Lathey J, Sathiyaseelan J, Matijevic M, Hedley ML: Validation of pretrial ELISspot measurements. BioProcess Intl. 2003, Sept.: 34-41.
31.
go back to reference Borg L, Kristiansen J, Christensen JM, Jepsen KF, Poulsen LK: Evaluation of accuracy and uncertainty of ELISA assays for the determination of interleukin-4, interleukin-5, interferon-gamma and tumor necrosis factor-alpha. Clin Chem Lab Med. 2002, 40 (5): 509-519.CrossRefPubMed Borg L, Kristiansen J, Christensen JM, Jepsen KF, Poulsen LK: Evaluation of accuracy and uncertainty of ELISA assays for the determination of interleukin-4, interleukin-5, interferon-gamma and tumor necrosis factor-alpha. Clin Chem Lab Med. 2002, 40 (5): 509-519.CrossRefPubMed
32.
go back to reference Findlay JW, Smith WC, Lee JW, Nordblom GD, Das I, DeSilva BS, Khan MN, Bowsher RR: Validation of immunoassays for bioanalysis: a pharmaceutical industry perspective. J Pharm Biomed Anal. 2000, 21 (6): 1249-1273.CrossRefPubMed Findlay JW, Smith WC, Lee JW, Nordblom GD, Das I, DeSilva BS, Khan MN, Bowsher RR: Validation of immunoassays for bioanalysis: a pharmaceutical industry perspective. J Pharm Biomed Anal. 2000, 21 (6): 1249-1273.CrossRefPubMed
33.
go back to reference Reimann KA, O'Gorman MR, Spritzler J, Wilkening CL, Sabath DE, Helm K, Campbell DE: Multisite comparison of CD4 and CD8 T-lymphocyte counting by single- versus multiple-platform methodologies: evaluation of Beckman Coulter flow-count fluorospheres and the tetraONE system.The NIAID DAIDS New Technologies Evaluation Group. Clin Diagn Lab Immunol. 2000, 7 (3): 344-351.PubMedCentralPubMed Reimann KA, O'Gorman MR, Spritzler J, Wilkening CL, Sabath DE, Helm K, Campbell DE: Multisite comparison of CD4 and CD8 T-lymphocyte counting by single- versus multiple-platform methodologies: evaluation of Beckman Coulter flow-count fluorospheres and the tetraONE system.The NIAID DAIDS New Technologies Evaluation Group. Clin Diagn Lab Immunol. 2000, 7 (3): 344-351.PubMedCentralPubMed
34.
go back to reference Koepke JA, Landay AL: Precision and accuracy of absolute lymphocyte counts. Clin Immunol Immunopathol. 1989, 52 (1): 19-27.CrossRefPubMed Koepke JA, Landay AL: Precision and accuracy of absolute lymphocyte counts. Clin Immunol Immunopathol. 1989, 52 (1): 19-27.CrossRefPubMed
Metadata
Title
Standardization of cytokine flow cytometry assays
Authors
Holden T Maecker
Aline Rinfret
Patricia D'Souza
Janice Darden
Eva Roig
Claire Landry
Peter Hayes
Josephine Birungi
Omu Anzala
Miguel Garcia
Alexandre Harari
Ian Frank
Ruth Baydo
Megan Baker
Jennifer Holbrook
Janet Ottinger
Laurie Lamoreaux
C Lorrie Epling
Elizabeth Sinclair
Maria A Suni
Kara Punt
Sandra Calarota
Sophia El-Bahi
Gailet Alter
Hazel Maila
Ellen Kuta
Josephine Cox
Clive Gray
Marcus Altfeld
Nolwenn Nougarede
Jean Boyer
Lynda Tussey
Timothy Tobery
Barry Bredt
Mario Roederer
Richard Koup
Vernon C Maino
Kent Weinhold
Giuseppe Pantaleo
Jill Gilmour
Helen Horton
Rafick P Sekaly
Publication date
01-12-2005
Publisher
BioMed Central
Published in
BMC Immunology / Issue 1/2005
Electronic ISSN: 1471-2172
DOI
https://doi.org/10.1186/1471-2172-6-13

Other articles of this Issue 1/2005

BMC Immunology 1/2005 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.