Skip to main content
Top
Published in: BMC Medicine 1/2017

Open Access 01-12-2017 | Opinion

The public health value of vaccines beyond efficacy: methods, measures and outcomes

Authors: A. Wilder-Smith, I. Longini, P. L. Zuber, T. Bärnighausen, W. J. Edmunds, N. Dean, V. Masserey Spicher, M. R. Benissa, B. D. Gessner

Published in: BMC Medicine | Issue 1/2017

Login to get access

Abstract

Background

Assessments of vaccine efficacy and safety capture only the minimum information needed for regulatory approval, rather than the full public health value of vaccines. Vaccine efficacy provides a measure of proportionate disease reduction, is usually limited to etiologically confirmed disease, and focuses on the direct protection of the vaccinated individual. Herein, we propose a broader scope of methods, measures and outcomes to evaluate the effectiveness and public health impact to be considered for evidence-informed policymaking in both pre- and post-licensure stages.

Discussion

Pre-licensure: Regulatory concerns dictate an individually randomised clinical trial. However, some circumstances (such as the West African Ebola epidemic) may require novel designs that could be considered valid for licensure by regulatory agencies. In addition, protocol-defined analytic plans for these studies should include clinical as well as etiologically confirmed endpoints (e.g. all cause hospitalisations, pneumonias, acute gastroenteritis and others as appropriate to the vaccine target), and should include vaccine-preventable disease incidence and ‘number needed to vaccinate’ as outcomes.
Post-licensure: There is a central role for phase IV cluster randomised clinical trials that allows for estimation of population-level vaccine impact, including indirect, total and overall effects. Dynamic models should be prioritised over static models as the constant force of infection assumed in static models will usually underestimate the effectiveness and cost-effectiveness of the immunisation programme by underestimating indirect effects. The economic impact of vaccinations should incorporate health and non-health benefits of vaccination in both the vaccinated and unvaccinated populations, thus allowing for estimation of the net social value of vaccination.

Conclusions

The full benefits of vaccination reach beyond direct prevention of etiologically confirmed disease and often extend across the life course of a vaccinated person, prevent outcomes in the wider community, stabilise health systems, promote health equity, and benefit local and national economies. The degree to which vaccinations provide broad public health benefits is stronger than for other preventive and curative interventions.
Literature
1.
go back to reference Council for International Organizations of Medical Sciences. CIOMS Guide to Active Vaccine Safety Surveillance: Report of CIOMS Working Group on Vaccine Safety. Geneva: CIOMS; 2017. Council for International Organizations of Medical Sciences. CIOMS Guide to Active Vaccine Safety Surveillance: Report of CIOMS Working Group on Vaccine Safety. Geneva: CIOMS; 2017.
2.
go back to reference Andrews N. Epidemiological designs for vaccine safety assessment: methods and pitfalls. Biologicals. 2012;40(5):389–92.CrossRefPubMed Andrews N. Epidemiological designs for vaccine safety assessment: methods and pitfalls. Biologicals. 2012;40(5):389–92.CrossRefPubMed
3.
go back to reference Saadatian-Elahi M, Horstick O, Breiman RF, Gessner BD, Gubler DJ, Louis J, Parashar UD, Tapia R, Picot V, Zinsou JA, et al. Beyond efficacy: the full public health impact of vaccines. Vaccine. 2016;34(9):1139–47.CrossRefPubMed Saadatian-Elahi M, Horstick O, Breiman RF, Gessner BD, Gubler DJ, Louis J, Parashar UD, Tapia R, Picot V, Zinsou JA, et al. Beyond efficacy: the full public health impact of vaccines. Vaccine. 2016;34(9):1139–47.CrossRefPubMed
4.
go back to reference Clemens J, Brenner R, Rao M, Tafari N, Lowe C. Evaluating new vaccines for developing countries. Efficacy or effectiveness? JAMA. 1996;275(5):390–7.CrossRefPubMed Clemens J, Brenner R, Rao M, Tafari N, Lowe C. Evaluating new vaccines for developing countries. Efficacy or effectiveness? JAMA. 1996;275(5):390–7.CrossRefPubMed
5.
go back to reference Henao-Restrepo AM, Longini IM, Egger M, Dean NE, Edmunds WJ, Camacho A, Carroll MW, Doumbia M, Draguez B, Duraffour S, et al. Efficacy and effectiveness of an rVSV-vectored vaccine expressing Ebola surface glycoprotein: interim results from the Guinea ring vaccination cluster-randomised trial. Lancet. 2015;386(9996):857–66.CrossRefPubMed Henao-Restrepo AM, Longini IM, Egger M, Dean NE, Edmunds WJ, Camacho A, Carroll MW, Doumbia M, Draguez B, Duraffour S, et al. Efficacy and effectiveness of an rVSV-vectored vaccine expressing Ebola surface glycoprotein: interim results from the Guinea ring vaccination cluster-randomised trial. Lancet. 2015;386(9996):857–66.CrossRefPubMed
6.
go back to reference Russek-Cohen E, Rubin D, Price D, Sun W, Cox E, Borio L. A US Food and Drug Administration perspective on evaluating medical products for Ebola. Clin Trials. 2016;13(1):105–9.CrossRefPubMed Russek-Cohen E, Rubin D, Price D, Sun W, Cox E, Borio L. A US Food and Drug Administration perspective on evaluating medical products for Ebola. Clin Trials. 2016;13(1):105–9.CrossRefPubMed
7.
go back to reference Ebola ça Suffit Ring Vaccination Trial Consortium. The ring vaccination trial: a novel cluster randomised controlled trial design to evaluate vaccine efficacy and effectiveness during outbreaks, with special reference to Ebola. BMJ. 2015;351:h3740.PubMedCentral Ebola ça Suffit Ring Vaccination Trial Consortium. The ring vaccination trial: a novel cluster randomised controlled trial design to evaluate vaccine efficacy and effectiveness during outbreaks, with special reference to Ebola. BMJ. 2015;351:h3740.PubMedCentral
9.
go back to reference Cutts FT, Zaman SM, Enwere G, Jaffar S, Levine OS, Okoko JB, Oluwalana C, Vaughan A, Obaro SK, Leach A, et al. Efficacy of nine-valent pneumococcal conjugate vaccine against pneumonia and invasive pneumococcal disease in The Gambia: randomised, double-blind, placebo-controlled trial. Lancet. 2005;365(9465):1139–46.CrossRefPubMed Cutts FT, Zaman SM, Enwere G, Jaffar S, Levine OS, Okoko JB, Oluwalana C, Vaughan A, Obaro SK, Leach A, et al. Efficacy of nine-valent pneumococcal conjugate vaccine against pneumonia and invasive pneumococcal disease in The Gambia: randomised, double-blind, placebo-controlled trial. Lancet. 2005;365(9465):1139–46.CrossRefPubMed
10.
go back to reference Mdege ND, Man MS, Taylor Nee Brown CA, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol. 2011;64(9):936–48.CrossRefPubMed Mdege ND, Man MS, Taylor Nee Brown CA, Torgerson DJ. Systematic review of stepped wedge cluster randomized trials shows that design is particularly used to evaluate interventions during routine implementation. J Clin Epidemiol. 2011;64(9):936–48.CrossRefPubMed
11.
go back to reference Beard E, Lewis JJ, Copas A, Davey C, Osrin D, Baio G, Thompson JA, Fielding KL, Omar RZ, Ononge S, et al. Stepped wedge randomised controlled trials: systematic review of studies published between 2010 and 2014. Trials. 2015;16:353.CrossRefPubMedPubMedCentral Beard E, Lewis JJ, Copas A, Davey C, Osrin D, Baio G, Thompson JA, Fielding KL, Omar RZ, Ononge S, et al. Stepped wedge randomised controlled trials: systematic review of studies published between 2010 and 2014. Trials. 2015;16:353.CrossRefPubMedPubMedCentral
12.
go back to reference Bhattacharya SK, Sur D, Ali M, Kanungo S, You YA, Manna B, Sah B, Niyogi SK, Park JK, Sarkar B, et al. 5 year efficacy of a bivalent killed whole-cell oral cholera vaccine in Kolkata, India: a cluster-randomised, double-blind, placebo-controlled trial. Lancet Infect Dis. 2013;13(12):1050–6.CrossRefPubMed Bhattacharya SK, Sur D, Ali M, Kanungo S, You YA, Manna B, Sah B, Niyogi SK, Park JK, Sarkar B, et al. 5 year efficacy of a bivalent killed whole-cell oral cholera vaccine in Kolkata, India: a cluster-randomised, double-blind, placebo-controlled trial. Lancet Infect Dis. 2013;13(12):1050–6.CrossRefPubMed
13.
go back to reference Sur D, Ochiai RL, Bhattacharya SK, Ganguly NK, Ali M, Manna B, Dutta S, Donner A, Kanungo S, Park JK, et al. A cluster-randomized effectiveness trial of Vi typhoid vaccine in India. N Engl J Med. 2009;361(4):335–44.CrossRefPubMed Sur D, Ochiai RL, Bhattacharya SK, Ganguly NK, Ali M, Manna B, Dutta S, Donner A, Kanungo S, Park JK, et al. A cluster-randomized effectiveness trial of Vi typhoid vaccine in India. N Engl J Med. 2009;361(4):335–44.CrossRefPubMed
14.
go back to reference Pitman R, Fisman D, Zaric GS, Postma M, Kretzschmar M, Edmunds J, Brisson M, Force I-SMGRPT. Dynamic transmission modeling: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force Working Group-5. Med Decis Making. 2012;32(5):712–21.CrossRefPubMed Pitman R, Fisman D, Zaric GS, Postma M, Kretzschmar M, Edmunds J, Brisson M, Force I-SMGRPT. Dynamic transmission modeling: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force Working Group-5. Med Decis Making. 2012;32(5):712–21.CrossRefPubMed
15.
go back to reference Edmunds WJ, Medley GF, Nokes DJ. Evaluating the cost-effectiveness of vaccination programmes: a dynamic perspective. Stat Med. 1999;18(23):3263–82.CrossRefPubMed Edmunds WJ, Medley GF, Nokes DJ. Evaluating the cost-effectiveness of vaccination programmes: a dynamic perspective. Stat Med. 1999;18(23):3263–82.CrossRefPubMed
16.
go back to reference Goldie SJ, O'Shea M, Campos NG, Diaz M, Sweet S, Kim SY. Health and economic outcomes of HPV 16,18 vaccination in 72 GAVI-eligible countries. Vaccine. 2008;26(32):4080–93.CrossRefPubMed Goldie SJ, O'Shea M, Campos NG, Diaz M, Sweet S, Kim SY. Health and economic outcomes of HPV 16,18 vaccination in 72 GAVI-eligible countries. Vaccine. 2008;26(32):4080–93.CrossRefPubMed
17.
go back to reference Feikin DR, Laserson KF, Ojwando J, Nyambane G, Ssempijja V, Audi A, Nyakundi D, Oyieko J, Dallas MJ, Ciarlet M, et al. Efficacy of pentavalent rotavirus vaccine in a high HIV prevalence population in Kenya. Vaccine. 2012;30 Suppl 1:A52–60.CrossRefPubMed Feikin DR, Laserson KF, Ojwando J, Nyambane G, Ssempijja V, Audi A, Nyakundi D, Oyieko J, Dallas MJ, Ciarlet M, et al. Efficacy of pentavalent rotavirus vaccine in a high HIV prevalence population in Kenya. Vaccine. 2012;30 Suppl 1:A52–60.CrossRefPubMed
18.
go back to reference Madhi SA, Cunliffe NA, Steele D, Witte D, Kirsten M, Louw C, Ngwira B, Victor JC, Gillard PH, Cheuvart BB, et al. Effect of human rotavirus vaccine on severe diarrhea in African infants. N Engl J Med. 2010;362(4):289–98.CrossRefPubMed Madhi SA, Cunliffe NA, Steele D, Witte D, Kirsten M, Louw C, Ngwira B, Victor JC, Gillard PH, Cheuvart BB, et al. Effect of human rotavirus vaccine on severe diarrhea in African infants. N Engl J Med. 2010;362(4):289–98.CrossRefPubMed
19.
go back to reference Gessner BD, Feikin DR. Vaccine preventable disease incidence as a complement to vaccine efficacy for setting vaccine policy. Vaccine. 2014;32(26):3133–8.CrossRefPubMedPubMedCentral Gessner BD, Feikin DR. Vaccine preventable disease incidence as a complement to vaccine efficacy for setting vaccine policy. Vaccine. 2014;32(26):3133–8.CrossRefPubMedPubMedCentral
20.
go back to reference Gessner BD, Wilder-Smith A. Estimating the public health importance of the CYD-tetravalent dengue vaccine: vaccine preventable disease incidence and numbers needed to vaccinate. Vaccine. 2016;34(20):2397–401.CrossRefPubMed Gessner BD, Wilder-Smith A. Estimating the public health importance of the CYD-tetravalent dengue vaccine: vaccine preventable disease incidence and numbers needed to vaccinate. Vaccine. 2016;34(20):2397–401.CrossRefPubMed
21.
go back to reference Kelly H, Attia J, Andrews R, Heller RF. The number needed to vaccinate (NNV) and population extensions of the NNV: comparison of influenza and pneumococcal vaccine programmes for people aged 65 years and over. Vaccine. 2004;22(17-18):2192–8.CrossRefPubMed Kelly H, Attia J, Andrews R, Heller RF. The number needed to vaccinate (NNV) and population extensions of the NNV: comparison of influenza and pneumococcal vaccine programmes for people aged 65 years and over. Vaccine. 2004;22(17-18):2192–8.CrossRefPubMed
22.
go back to reference Klugman KP, Madhi SA, Huebner RE, Kohberger R, Mbelle N, Pierce N, Vaccine Trialists Group. A trial of a 9-valent pneumococcal conjugate vaccine in children with and those without HIV infection. N Engl J Med. 2003;349(14):1341–8.CrossRefPubMed Klugman KP, Madhi SA, Huebner RE, Kohberger R, Mbelle N, Pierce N, Vaccine Trialists Group. A trial of a 9-valent pneumococcal conjugate vaccine in children with and those without HIV infection. N Engl J Med. 2003;349(14):1341–8.CrossRefPubMed
23.
go back to reference Gessner BD, Sutanto A, Linehan M, Djelantik IG, Fletcher T, Gerudug IK, Ingerani, Mercer D, Moniaga V, Moulton LH, et al. Incidences of vaccine-preventable Haemophilus influenzae type b pneumonia and meningitis in Indonesian children: hamlet-randomised vaccine-probe trial. Lancet. 2005;365(9453):43–52.CrossRefPubMed Gessner BD, Sutanto A, Linehan M, Djelantik IG, Fletcher T, Gerudug IK, Ingerani, Mercer D, Moniaga V, Moulton LH, et al. Incidences of vaccine-preventable Haemophilus influenzae type b pneumonia and meningitis in Indonesian children: hamlet-randomised vaccine-probe trial. Lancet. 2005;365(9453):43–52.CrossRefPubMed
24.
go back to reference Leino T, Ollgren J, Salo H, Tiihonen P, Kilpi T. First year experience of rotavirus immunisation programme in Finland. Vaccine. 2012;31(1):176–82.CrossRefPubMed Leino T, Ollgren J, Salo H, Tiihonen P, Kilpi T. First year experience of rotavirus immunisation programme in Finland. Vaccine. 2012;31(1):176–82.CrossRefPubMed
25.
go back to reference RTS,S Clinical Trials Partnership. Efficacy and safety of RTS, S/AS01 malaria vaccine with or without a booster dose in infants and children in Africa: final results of a phase 3, individually randomised, controlled trial. Lancet. 2015;386(9988):31–45.CrossRef RTS,S Clinical Trials Partnership. Efficacy and safety of RTS, S/AS01 malaria vaccine with or without a booster dose in infants and children in Africa: final results of a phase 3, individually randomised, controlled trial. Lancet. 2015;386(9988):31–45.CrossRef
27.
go back to reference Bärnighausen T, Oldenburg C, Tugwell P, Bommer C, Ebert C, Barreto M, Djimeu E, Haber N, Waddington H, Rockers P, et al. Quasi-experimental study designs series - Paper 7: assessing the assumptions. J Clin Epidemiol. 2017. doi:10.1016/j.jclinepi.2017.02.017. Bärnighausen T, Oldenburg C, Tugwell P, Bommer C, Ebert C, Barreto M, Djimeu E, Haber N, Waddington H, Rockers P, et al. Quasi-experimental study designs series - Paper 7: assessing the assumptions. J Clin Epidemiol. 2017. doi:10.​1016/​j.​jclinepi.​2017.​02.​017.
28.
go back to reference Bärnighausen T, Tugwell P, Røttingen J, Shemilt I, Rockers P, Geldsetzer P, Lavis J, Grimshaw J, Daniels K, Brown A et al: Quasi-experimental study designs series - Paper 4: uses and value. J Clin Epidemiol. 2017. doi:10.1016/j.jclinepi.2017.03.012. Bärnighausen T, Tugwell P, Røttingen J, Shemilt I, Rockers P, Geldsetzer P, Lavis J, Grimshaw J, Daniels K, Brown A et al: Quasi-experimental study designs series - Paper 4: uses and value. J Clin Epidemiol. 2017. doi:10.​1016/​j.​jclinepi.​2017.​03.​012.
29.
go back to reference Anekwe TD, Newell ML, Tanser F, Pillay D, Barnighausen T. The causal effect of childhood measles vaccination on educational attainment: a mother fixed-effects study in rural South Africa. Vaccine. 2015;33(38):5020–6.CrossRefPubMedPubMedCentral Anekwe TD, Newell ML, Tanser F, Pillay D, Barnighausen T. The causal effect of childhood measles vaccination on educational attainment: a mother fixed-effects study in rural South Africa. Vaccine. 2015;33(38):5020–6.CrossRefPubMedPubMedCentral
30.
go back to reference Smith LM, Kaufman JS, Strumpf EC, Levesque LE. Effect of human papillomavirus (HPV) vaccination on clinical indicators of sexual behaviour among adolescent girls: the Ontario Grade 8 HPV Vaccine Cohort Study. CMAJ. 2015;187(2):E74–81.CrossRefPubMedPubMedCentral Smith LM, Kaufman JS, Strumpf EC, Levesque LE. Effect of human papillomavirus (HPV) vaccination on clinical indicators of sexual behaviour among adolescent girls: the Ontario Grade 8 HPV Vaccine Cohort Study. CMAJ. 2015;187(2):E74–81.CrossRefPubMedPubMedCentral
31.
go back to reference Wong K, Campitelli MA, Stukel TA, Kwong JC. Estimating influenza vaccine effectiveness in community-dwelling elderly patients using the instrumental variable analysis method. Arch Intern Med. 2012;172(6):484–91.CrossRefPubMed Wong K, Campitelli MA, Stukel TA, Kwong JC. Estimating influenza vaccine effectiveness in community-dwelling elderly patients using the instrumental variable analysis method. Arch Intern Med. 2012;172(6):484–91.CrossRefPubMed
33.
go back to reference Barnighausen T, Bloom DE, Cafiero ET, O'Brien JC. Valuing the broader benefits of dengue vaccination, with a preliminary application to Brazil. Semin Immunol. 2013;25(2):104–13.CrossRefPubMed Barnighausen T, Bloom DE, Cafiero ET, O'Brien JC. Valuing the broader benefits of dengue vaccination, with a preliminary application to Brazil. Semin Immunol. 2013;25(2):104–13.CrossRefPubMed
34.
go back to reference Halloran ME, Longini Jr IM, Struchiner CJ. Design and Analysis of Vaccine Studies. New York, NY: Springer; 2010.CrossRef Halloran ME, Longini Jr IM, Struchiner CJ. Design and Analysis of Vaccine Studies. New York, NY: Springer; 2010.CrossRef
Metadata
Title
The public health value of vaccines beyond efficacy: methods, measures and outcomes
Authors
A. Wilder-Smith
I. Longini
P. L. Zuber
T. Bärnighausen
W. J. Edmunds
N. Dean
V. Masserey Spicher
M. R. Benissa
B. D. Gessner
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2017
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-017-0911-8

Other articles of this Issue 1/2017

BMC Medicine 1/2017 Go to the issue