Skip to main content
Top
Published in: BMC Infectious Diseases 1/2017

Open Access 01-12-2017 | Research article

A comparison of the test-negative and the traditional case-control study designs for estimation of influenza vaccine effectiveness under nonrandom vaccination

Authors: Meng Shi, Qian An, Kylie E. C. Ainslie, Michael Haber, Walter A. Orenstein

Published in: BMC Infectious Diseases | Issue 1/2017

Login to get access

Abstract

Background

As annual influenza vaccination is recommended for all U.S. persons aged 6 months or older, it is unethical to conduct randomized clinical trials to estimate influenza vaccine effectiveness (VE). Observational studies are being increasingly used to estimate VE. We developed a probability model for comparing the bias and the precision of VE estimates from two case-control designs: the traditional case-control (TCC) design and the test-negative (TN) design. In both study designs, acute respiratory illness (ARI) patients seeking medical care testing positive for influenza infection are considered cases. In the TN design, ARI patients seeking medical care who test negative serve as controls, while in the TCC design, controls are randomly selected individuals from the community who did not contract an ARI.

Methods

Our model assigns each study participant a covariate corresponding to the person’s health status. The probabilities of vaccination and of contracting influenza and non-influenza ARI depend on health status. Hence, our model allows non-random vaccination and confounding. In addition, the probability of seeking care for ARI may depend on vaccination and health status. We consider two outcomes of interest: symptomatic influenza (SI) and medically-attended influenza (MAI).

Results

If vaccination does not affect the probability of non-influenza ARI, then VE estimates from TN studies usually have smaller bias than estimates from TCC studies. We also found that if vaccinated influenza ARI patients are less likely to seek medical care than unvaccinated patients because the vaccine reduces symptoms’ severity, then estimates of VE from both types of studies may be severely biased when the outcome of interest is SI. The bias is not present when the outcome of interest is MAI.

Conclusions

The TN design produces valid estimates of VE if (a) vaccination does not affect the probabilities of non-influenza ARI and of seeking care against influenza ARI, and (b) the confounding effects resulting from non-random vaccination are similar for influenza and non-influenza ARI. Since the bias of VE estimates depends on the outcome against which the vaccine is supposed to protect, it is important to specify the outcome of interest when evaluating the bias.
Literature
1.
go back to reference Skowronski DM, Masaro C, Kwindt TL, Mak A, Petric M, Li Y, Sebastian R, Chong M, Tam T, De Serres G. Estimating vaccine effectiveness against laboratory-confirmed influenza using a sentinel physician network: results from the 2005-2006 season of dual a and b vaccine mismatch in canada. Vaccine. 2007; 25(15):2842–51. doi:10.1016/j.vaccine.2006.10.002.CrossRefPubMed Skowronski DM, Masaro C, Kwindt TL, Mak A, Petric M, Li Y, Sebastian R, Chong M, Tam T, De Serres G. Estimating vaccine effectiveness against laboratory-confirmed influenza using a sentinel physician network: results from the 2005-2006 season of dual a and b vaccine mismatch in canada. Vaccine. 2007; 25(15):2842–51. doi:10.​1016/​j.​vaccine.​2006.​10.​002.CrossRefPubMed
2.
go back to reference Belongia EA, Kieke BA, Donahue JG, Greenlee RT, Balish A, Foust A, Lindstrom S, Shay DK, Marshfield Influenza Study Group. Effectiveness of inactivated influenza vaccines varied substantially with antigenic match from the 2004-2005 season to the 2006-2007 season. J Infect Dis. 2009; 199(2):159–67. doi:10.1086/595861.CrossRefPubMed Belongia EA, Kieke BA, Donahue JG, Greenlee RT, Balish A, Foust A, Lindstrom S, Shay DK, Marshfield Influenza Study Group. Effectiveness of inactivated influenza vaccines varied substantially with antigenic match from the 2004-2005 season to the 2006-2007 season. J Infect Dis. 2009; 199(2):159–67. doi:10.​1086/​595861.CrossRefPubMed
3.
go back to reference Choi WS, Noh JY, Seo YB, Baek JH, Lee J, Song JY, Park DW, Lee JS, Cheong HJ, Kim WJ. Case-control study of the effectiveness of the 2010-2011 seasonal influenza vaccine for prevention of laboratory-confirmed influenza virus infection in the korean adult population. Clin Vaccine Immunol. 2013; 20(6):877–1. doi:10.1128/CVI.00009-13.CrossRefPubMedPubMedCentral Choi WS, Noh JY, Seo YB, Baek JH, Lee J, Song JY, Park DW, Lee JS, Cheong HJ, Kim WJ. Case-control study of the effectiveness of the 2010-2011 seasonal influenza vaccine for prevention of laboratory-confirmed influenza virus infection in the korean adult population. Clin Vaccine Immunol. 2013; 20(6):877–1. doi:10.​1128/​CVI.​00009-13.CrossRefPubMedPubMedCentral
4.
go back to reference Havers F, Sokolow L, Shay DK, Farley MM, Monroe M, Meek J, Daily Kirley P, Bennett NM, Morin C, Aragon D, Thomas A, Schaffner W, Zansky SM, Baumbach J, Ferdinands J, Fry AM. Case-control study of vaccine effectiveness in preventing laboratory-confirmed influenza hospitalizations in older adults, united states, 2010-2011. Clin Infect Dis. 2016; 63(10):1304–11. doi:10.1093/cid/ciw512.CrossRefPubMed Havers F, Sokolow L, Shay DK, Farley MM, Monroe M, Meek J, Daily Kirley P, Bennett NM, Morin C, Aragon D, Thomas A, Schaffner W, Zansky SM, Baumbach J, Ferdinands J, Fry AM. Case-control study of vaccine effectiveness in preventing laboratory-confirmed influenza hospitalizations in older adults, united states, 2010-2011. Clin Infect Dis. 2016; 63(10):1304–11. doi:10.​1093/​cid/​ciw512.CrossRefPubMed
6.
go back to reference Cowling BJ, Fang VJ, Nishiura H, Chan KH, Ng S, Ip DKM, Chiu SS, Leung GM, Peiris JSM. Increased risk of noninfluenza respiratory virus infections associated with receipt of inactivated influenza vaccine. Clin Infect Dis. 2012; 54(12):1778–83. doi:10.1093/cid/cis307.CrossRefPubMedPubMedCentral Cowling BJ, Fang VJ, Nishiura H, Chan KH, Ng S, Ip DKM, Chiu SS, Leung GM, Peiris JSM. Increased risk of noninfluenza respiratory virus infections associated with receipt of inactivated influenza vaccine. Clin Infect Dis. 2012; 54(12):1778–83. doi:10.​1093/​cid/​cis307.CrossRefPubMedPubMedCentral
7.
go back to reference Castilla J, Godoy P, Dominguez A, Martinez-Baz I, Astray J, Martin V, Delgado-Rodriguez M, Baricot M, Soldevila N, Maria Mayoral J, Maria Quintana J, Carlos Galan J, Castro A, Gonzalez-Candelas F, Garin O, Saez M, Tamames S, Pumarola T, Influenza CCC. Influenza vaccine effectiveness in preventing outpatient, inpatient, and severe cases of laboratory-confirmed influenza. Clin Infect Dis. 2013; 57(2):167–75. doi:10.1093/cid/cit194.CrossRefPubMed Castilla J, Godoy P, Dominguez A, Martinez-Baz I, Astray J, Martin V, Delgado-Rodriguez M, Baricot M, Soldevila N, Maria Mayoral J, Maria Quintana J, Carlos Galan J, Castro A, Gonzalez-Candelas F, Garin O, Saez M, Tamames S, Pumarola T, Influenza CCC. Influenza vaccine effectiveness in preventing outpatient, inpatient, and severe cases of laboratory-confirmed influenza. Clin Infect Dis. 2013; 57(2):167–75. doi:10.​1093/​cid/​cit194.CrossRefPubMed
10.
go back to reference Haber M, Longini Jr IM, Halloran ME. Measures of the effects of vaccination in a randomly mixing population. Int J Epidemiol. 1991; 20(1):300–10.CrossRefPubMed Haber M, Longini Jr IM, Halloran ME. Measures of the effects of vaccination in a randomly mixing population. Int J Epidemiol. 1991; 20(1):300–10.CrossRefPubMed
12.
go back to reference Lipsitch M, Jha A, Simonsen L. Observational studies and the difficult quest for causality: lessons from vaccine effectiveness and impact studies. Int J Epidemiol. 2016. doi:10.1093/ije/dyw124. Lipsitch M, Jha A, Simonsen L. Observational studies and the difficult quest for causality: lessons from vaccine effectiveness and impact studies. Int J Epidemiol. 2016. doi:10.​1093/​ije/​dyw124.
13.
go back to reference Agresti A. Categorical Data Analysis, 3rd ed. Wiley series in probability and statistics, vol. 792. Hoboken, NJ: Wiley; 2013. Agresti A. Categorical Data Analysis, 3rd ed. Wiley series in probability and statistics, vol. 792. Hoboken, NJ: Wiley; 2013.
14.
go back to reference Haber M, An Q, Foppa IM, Shay DK, Ferdinands JM, Orenstein WA. A probability model for evaluating the bias and precision of influenza vaccine effectiveness estimates from case-control studies. Epidemiol Infect. 2015; 143(7):1417–26. doi:10.1017/S0950268814002179.CrossRefPubMed Haber M, An Q, Foppa IM, Shay DK, Ferdinands JM, Orenstein WA. A probability model for evaluating the bias and precision of influenza vaccine effectiveness estimates from case-control studies. Epidemiol Infect. 2015; 143(7):1417–26. doi:10.​1017/​S095026881400217​9.CrossRefPubMed
15.
go back to reference Orenstein EW, De Serres G, Haber MJ, Shay DK, Bridges CB, Gargiullo P, Orenstein WA. Methodologic issues regarding the use of three observational study designs to assess influenza vaccine effectiveness. Int J Epidemiol. 2007; 36(3):623–31. doi:10.1093/ije/dym021.CrossRefPubMed Orenstein EW, De Serres G, Haber MJ, Shay DK, Bridges CB, Gargiullo P, Orenstein WA. Methodologic issues regarding the use of three observational study designs to assess influenza vaccine effectiveness. Int J Epidemiol. 2007; 36(3):623–31. doi:10.​1093/​ije/​dym021.CrossRefPubMed
16.
Metadata
Title
A comparison of the test-negative and the traditional case-control study designs for estimation of influenza vaccine effectiveness under nonrandom vaccination
Authors
Meng Shi
Qian An
Kylie E. C. Ainslie
Michael Haber
Walter A. Orenstein
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Infectious Diseases / Issue 1/2017
Electronic ISSN: 1471-2334
DOI
https://doi.org/10.1186/s12879-017-2838-2

Other articles of this Issue 1/2017

BMC Infectious Diseases 1/2017 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.