Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2015

Open Access 01-12-2015 | Research article

Some extensions in continuous models for immunological correlates of protection

Authors: Andrew J. Dunning, Jennifer Kensler, Laurent Coudeville, Fabrice Bailleux

Published in: BMC Medical Research Methodology | Issue 1/2015

Login to get access

Abstract

Background

A scaled logit model has previously been proposed to quantify the relationship between an immunological assay and protection from disease, and has been applied in a number of settings. The probability of disease was modelled as a function of the probability of exposure, which was assumed to be fixed, and of protection, which was assumed to increase smoothly with the value of the assay.

Methods

Some extensions are here investigated. Alternative functions to represent the protection curve are explored, applications to case-cohort designs are evaluated, and approaches to variance estimation compared. The steepness of the protection curve must sometimes be bounded to achieve convergence and methods for doing so are outlined. Criteria for evaluating the fit of models are proposed and approaches to assessing the utility of results suggested. Models are evaluated by application to sixteen datasets from vaccine clinical trials.

Results

Alternative protection curve functions improved model evaluation criteria for every dataset. Standard errors based on the observed information were found to be unreliable; bootstrap estimates of precision were to be preferred. In most instances, case-cohort designs resulted in little loss of precision. Some results achieved suggested measures for utility.

Conclusions

The original scaled logit model can be improved upon. Evaluation criteria permit well-fitting models and useful results to be identified. The proposed methods provide a comprehensive set of tools for quantifying the relationship between immunological assays and protection from disease.
Appendix
Available only for authorised users
Literature
2.
go back to reference Hosmer DW, Lemeshow S. Applied logistic regression. 2nd ed. New York: Wiley; 2000.CrossRef Hosmer DW, Lemeshow S. Applied logistic regression. 2nd ed. New York: Wiley; 2000.CrossRef
3.
go back to reference Qin L, Gilbert PB, Corey L, McElrath MJ, Self SG. A framework for assessing immunological correlates of protection in vaccine trials. J Infect Dis. 2007;196(9):1304–12.CrossRefPubMed Qin L, Gilbert PB, Corey L, McElrath MJ, Self SG. A framework for assessing immunological correlates of protection in vaccine trials. J Infect Dis. 2007;196(9):1304–12.CrossRefPubMed
4.
6.
go back to reference Initiative for Vaccine Research of the Department of Immunization, Vaccines and Biologicals, World Health Organization. Correlates of vaccine-induced protection: methods and implications. WHO/IVB/13.01; May 2013. Initiative for Vaccine Research of the Department of Immunization, Vaccines and Biologicals, World Health Organization. Correlates of vaccine-induced protection: methods and implications. WHO/IVB/13.01; May 2013.
8.
go back to reference Prentice RL. Surrogate endpoints in clinical trials: definition and operational criteria. Stat Med. 1989;8:431–40.CrossRefPubMed Prentice RL. Surrogate endpoints in clinical trials: definition and operational criteria. Stat Med. 1989;8:431–40.CrossRefPubMed
9.
go back to reference Lin DY, Fleming TR, De Gruttola V. Estimating the proportion of treatment effect explained by a surrogate marker. Stat Med. 1997;16(13):1515–27.CrossRefPubMed Lin DY, Fleming TR, De Gruttola V. Estimating the proportion of treatment effect explained by a surrogate marker. Stat Med. 1997;16(13):1515–27.CrossRefPubMed
10.
go back to reference Borrow R, Balmer P, Miller E. Meningococcal surrogates of protection--serum bactericidal antibody activity. Vaccine. 2005;23(17-18):2222–7.CrossRefPubMed Borrow R, Balmer P, Miller E. Meningococcal surrogates of protection--serum bactericidal antibody activity. Vaccine. 2005;23(17-18):2222–7.CrossRefPubMed
11.
go back to reference Franco MA, Angel J, Greenberg HB. Immunity and correlates of protection for rotavirus vaccines. Vaccine. 2006;24(15):2718–31.CrossRefPubMed Franco MA, Angel J, Greenberg HB. Immunity and correlates of protection for rotavirus vaccines. Vaccine. 2006;24(15):2718–31.CrossRefPubMed
12.
go back to reference Weinberg A, Zhang JH, Oxman MN, Johnson GR, Hayward AR, Caulfield MJ, et al. Varicella–zoster virus-specific immune responses to herpes zoster in elderly participants in a trial of a clinically effective zoster vaccine. J Infect Dis. 2009;200(7):1068–77.CrossRefPubMedPubMedCentral Weinberg A, Zhang JH, Oxman MN, Johnson GR, Hayward AR, Caulfield MJ, et al. Varicella–zoster virus-specific immune responses to herpes zoster in elderly participants in a trial of a clinically effective zoster vaccine. J Infect Dis. 2009;200(7):1068–77.CrossRefPubMedPubMedCentral
14.
16.
go back to reference Gilbert PB, Gabriel EE, Miao X, Li X, Su SC, Parrino J, et al. Fold Rise in Antibody Titers Measured by Glycoprotein-Based Enzyme-Linked Immunosorbent Assay Is an Excellent Correlate of Protection for a Herpes Zoster Vaccine, Demonstrated via the Vaccine Efficacy Curve. J Infect Dis. 2014;210(10):1573–81.CrossRefPubMedPubMedCentral Gilbert PB, Gabriel EE, Miao X, Li X, Su SC, Parrino J, et al. Fold Rise in Antibody Titers Measured by Glycoprotein-Based Enzyme-Linked Immunosorbent Assay Is an Excellent Correlate of Protection for a Herpes Zoster Vaccine, Demonstrated via the Vaccine Efficacy Curve. J Infect Dis. 2014;210(10):1573–81.CrossRefPubMedPubMedCentral
17.
go back to reference Jódar L, Butler J, Carlone G, Dagan R, Goldblatt D, Käyhty H, et al. Serological criteria for evaluation and licensure of new pneumococcal conjugate vaccine formulations for use in infants. Vaccine. 2003;21(23):3265–72.CrossRefPubMed Jódar L, Butler J, Carlone G, Dagan R, Goldblatt D, Käyhty H, et al. Serological criteria for evaluation and licensure of new pneumococcal conjugate vaccine formulations for use in infants. Vaccine. 2003;21(23):3265–72.CrossRefPubMed
18.
go back to reference Andrews N, Borrow R, Miller E. Validation of serological correlate of protection for meningococcal C conjugate vaccine by using efficacy estimates from postlicensure surveillance in England. Clin Diagn Lab Immunol. 2003;10(5):780–6.PubMedPubMedCentral Andrews N, Borrow R, Miller E. Validation of serological correlate of protection for meningococcal C conjugate vaccine by using efficacy estimates from postlicensure surveillance in England. Clin Diagn Lab Immunol. 2003;10(5):780–6.PubMedPubMedCentral
19.
20.
go back to reference Li S, Parnes M, Chan IS. Determining the cutoff based on a continuous variable to define two populations with application to vaccines. J Biopharm Stat. 2013;23(3):662–80.CrossRefPubMed Li S, Parnes M, Chan IS. Determining the cutoff based on a continuous variable to define two populations with application to vaccines. J Biopharm Stat. 2013;23(3):662–80.CrossRefPubMed
21.
go back to reference Zhu FC, Meng FY, Li JX, Li XL, Mao QY, Tao H, et al. Efficacy, safety, and immunology of an inactivated alum-adjuvant enterovirus 71 vaccine in children in China: a multicentre, randomised, double-blind, placebo-controlled, phase 3 trial. Lancet. 2013;381(9882):2024–32.CrossRefPubMed Zhu FC, Meng FY, Li JX, Li XL, Mao QY, Tao H, et al. Efficacy, safety, and immunology of an inactivated alum-adjuvant enterovirus 71 vaccine in children in China: a multicentre, randomised, double-blind, placebo-controlled, phase 3 trial. Lancet. 2013;381(9882):2024–32.CrossRefPubMed
22.
23.
go back to reference White CJ, Kuter BJ, Ngai A, Hildebrand CS, Isganitis KL, Patterson CM, et al. Modified cases of chickenpox after varicella vaccination: correlation of protection with antibody response. Pediatr Infect Dis J. 1992;11(1):19–23.CrossRefPubMed White CJ, Kuter BJ, Ngai A, Hildebrand CS, Isganitis KL, Patterson CM, et al. Modified cases of chickenpox after varicella vaccination: correlation of protection with antibody response. Pediatr Infect Dis J. 1992;11(1):19–23.CrossRefPubMed
24.
go back to reference Forrest BD, Pride MW, Dunning AJ, Capeding MR, Chotpitayasunondh T, Tam JS, et al. Correlation of cellular immune responses with protection against culture-confirmed influenza virus in young children. Clin Vaccine Immunol. 2008;15(7):1042–53.CrossRefPubMedPubMedCentral Forrest BD, Pride MW, Dunning AJ, Capeding MR, Chotpitayasunondh T, Tam JS, et al. Correlation of cellular immune responses with protection against culture-confirmed influenza virus in young children. Clin Vaccine Immunol. 2008;15(7):1042–53.CrossRefPubMedPubMedCentral
25.
go back to reference Coudeville L, Bailleux F, Riche B, Megas F, André P, Ecochard R. Relationship between haemagglutination-inhibiting antibody titres and clinical protection against influenza: development and application of a bayesian random-effects model. BMC Med Res Methodol. 2010;10(1):18.CrossRefPubMedPubMedCentral Coudeville L, Bailleux F, Riche B, Megas F, André P, Ecochard R. Relationship between haemagglutination-inhibiting antibody titres and clinical protection against influenza: development and application of a bayesian random-effects model. BMC Med Res Methodol. 2010;10(1):18.CrossRefPubMedPubMedCentral
26.
go back to reference Black S, Nicolay U, Vesikari T, Knuf M, Del Giudice G, Della Cioppa G, et al. Hemagglutination Inhibition Antibody Titers as a Correlate of Protection for Inactivated Influenza Vaccines in Children. Pediatr Infect Dis J. 2011;30(12):1081–5.CrossRefPubMed Black S, Nicolay U, Vesikari T, Knuf M, Del Giudice G, Della Cioppa G, et al. Hemagglutination Inhibition Antibody Titers as a Correlate of Protection for Inactivated Influenza Vaccines in Children. Pediatr Infect Dis J. 2011;30(12):1081–5.CrossRefPubMed
27.
go back to reference Nosyk B, Sharif B, Sun H, Cooper C, Anis AH, CIHR Canadian HIV Trials Network Influenza Vaccine Research Group. The cost-effectiveness and value of information of three influenza vaccination dosing strategies for individuals with human immunodeficiency virus. PLoS One. 2011;6(12):e27059.CrossRefPubMedPubMedCentral Nosyk B, Sharif B, Sun H, Cooper C, Anis AH, CIHR Canadian HIV Trials Network Influenza Vaccine Research Group. The cost-effectiveness and value of information of three influenza vaccination dosing strategies for individuals with human immunodeficiency virus. PLoS One. 2011;6(12):e27059.CrossRefPubMedPubMedCentral
28.
go back to reference European Medicines Agency Committee for Medicinal Products for Human Use. Draft guideline on influenza vaccines: non-clinical and clinical module 25 July 2014; EMA/CHMP/VWP/457259/2014. European Medicines Agency Committee for Medicinal Products for Human Use. Draft guideline on influenza vaccines: non-clinical and clinical module 25 July 2014; EMA/CHMP/VWP/457259/2014.
29.
go back to reference Prentice RL. A case-cohort design for epidemiologic cohort studies and disease prevention trials. Biometrika. 1986;73(1):1–11.CrossRef Prentice RL. A case-cohort design for epidemiologic cohort studies and disease prevention trials. Biometrika. 1986;73(1):1–11.CrossRef
30.
go back to reference Qin L, Gilbert PB, Follmann D, Li D. Assessing surrogate endpoints in vaccine trials with case-cohort sampling and the Cox model. Ann Appl Stat. 2008;2(1):386–407.CrossRefPubMedPubMedCentral Qin L, Gilbert PB, Follmann D, Li D. Assessing surrogate endpoints in vaccine trials with case-cohort sampling and the Cox model. Ann Appl Stat. 2008;2(1):386–407.CrossRefPubMedPubMedCentral
31.
32.
go back to reference Efron B, Tibshirani R. An Introduction to the Bootstrap. Boca Raton: Chapman & Hall/CRC; 1993.CrossRef Efron B, Tibshirani R. An Introduction to the Bootstrap. Boca Raton: Chapman & Hall/CRC; 1993.CrossRef
33.
go back to reference Hosmer DW, Lemeshow S. Goodness of fit tests for the multiple logistic regression model. Communications in Statistics - Theory and Methods. 1980;9(10):1043–69.CrossRef Hosmer DW, Lemeshow S. Goodness of fit tests for the multiple logistic regression model. Communications in Statistics - Theory and Methods. 1980;9(10):1043–69.CrossRef
34.
go back to reference Stehr K, Cherry JD, Heininger U, Schmitt-Grohé S, Uberall M, Laussucq S, et al. A comparative efficacy trial in Germany in infants who received either the Lederle/Takeda acellular pertussis component DTP (DTaP) vaccine, the Lederle whole-cell component DTP vaccine, or DT vaccine. Pediatrics. 1998;101(1):1–11.CrossRefPubMed Stehr K, Cherry JD, Heininger U, Schmitt-Grohé S, Uberall M, Laussucq S, et al. A comparative efficacy trial in Germany in infants who received either the Lederle/Takeda acellular pertussis component DTP (DTaP) vaccine, the Lederle whole-cell component DTP vaccine, or DT vaccine. Pediatrics. 1998;101(1):1–11.CrossRefPubMed
35.
go back to reference Piedra PA, Jewell AM, Cron SG, Atmar RL, Glezen WP. Correlates of immunity to respiratory syncytial virus (RSV) associated-hospitalization: establishment of minimum protective threshold levels of serum neutralizing antibodies. Vaccine. 2003;21(24):3479–82.CrossRefPubMed Piedra PA, Jewell AM, Cron SG, Atmar RL, Glezen WP. Correlates of immunity to respiratory syncytial virus (RSV) associated-hospitalization: establishment of minimum protective threshold levels of serum neutralizing antibodies. Vaccine. 2003;21(24):3479–82.CrossRefPubMed
36.
go back to reference Storsaeter J, Hallander HO, Gustafsson L, Olin P. Levels of anti-pertussis antibodies related to protection after household exposure to Bordetella pertussis. Vaccine. 1998;16(20):1907–16.CrossRefPubMed Storsaeter J, Hallander HO, Gustafsson L, Olin P. Levels of anti-pertussis antibodies related to protection after household exposure to Bordetella pertussis. Vaccine. 1998;16(20):1907–16.CrossRefPubMed
37.
go back to reference Casella G, Berger RL. Statistical inference. Belmont: Duxbury Press; 1990. Casella G, Berger RL. Statistical inference. Belmont: Duxbury Press; 1990.
38.
go back to reference Plotkin SA. Complex correlates of protection after vaccination. Clin Infect Dis. 2013;56(10):1458–65.CrossRefPubMed Plotkin SA. Complex correlates of protection after vaccination. Clin Infect Dis. 2013;56(10):1458–65.CrossRefPubMed
39.
go back to reference Siber GR, Chang I, Baker S, Fernsten P, O’Brien KL, Santosham M, et al. Estimating the protective concentration of anti-pneumococcal capsular polysaccharide antibodies. Vaccine. 2007;25:3816–26.CrossRefPubMed Siber GR, Chang I, Baker S, Fernsten P, O’Brien KL, Santosham M, et al. Estimating the protective concentration of anti-pneumococcal capsular polysaccharide antibodies. Vaccine. 2007;25:3816–26.CrossRefPubMed
40.
go back to reference Barrett PN, Berezuk G, Fritsch S, Aichinger G, Hart MK, El-Amin W, et al. Efficacy, safety, and immunogenicity of a Vero-cell-culture-derived trivalent influenza vaccine: a multicentre, double-blind, randomised, placebo-controlled trial. Lancet. 2011;377(9767):751–9.CrossRefPubMed Barrett PN, Berezuk G, Fritsch S, Aichinger G, Hart MK, El-Amin W, et al. Efficacy, safety, and immunogenicity of a Vero-cell-culture-derived trivalent influenza vaccine: a multicentre, double-blind, randomised, placebo-controlled trial. Lancet. 2011;377(9767):751–9.CrossRefPubMed
Metadata
Title
Some extensions in continuous models for immunological correlates of protection
Authors
Andrew J. Dunning
Jennifer Kensler
Laurent Coudeville
Fabrice Bailleux
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2015
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-015-0096-9

Other articles of this Issue 1/2015

BMC Medical Research Methodology 1/2015 Go to the issue