Skip to main content
Top
Published in: Systematic Reviews 1/2017

Open Access 01-12-2017 | Commentary

O’Connor et al. systematic review regarding animal feeding operations and public health: critical flaws may compromise conclusions

Published in: Systematic Reviews | Issue 1/2017

Login to get access

Abstract

In this comment, we summarize several scientific concerns with the recently published systematic review from O’Connor and colleagues that examined the relationship between proximity to animal-feeding operations and health of individuals in nearby communities. The authors utilized a bias tool not designed for environmental health research, erroneously excluded important studies, and incorrectly interpreted others. As a result, the conclusions drawn in the review misrepresent the evidence from the published literature, limiting its value to policymakers, researchers, and the public.
Literature
1.
go back to reference Ioannidis J. The mass production of redundant, misleading, and conflicted systematic reviews and meta-analyses. Milbank Q. 2016;94:485–514.CrossRefPubMed Ioannidis J. The mass production of redundant, misleading, and conflicted systematic reviews and meta-analyses. Milbank Q. 2016;94:485–514.CrossRefPubMed
2.
go back to reference Woodruff TJ, Sutton P. The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes. Environ Health Perspect. 2014;122:1007.PubMedPubMedCentral Woodruff TJ, Sutton P. The Navigation Guide systematic review methodology: a rigorous and transparent method for translating environmental health science into better health outcomes. Environ Health Perspect. 2014;122:1007.PubMedPubMedCentral
3.
go back to reference Johnson PI, Sutton P, Atchley DS, Koustas E, Lam J, Sen S, Robinson KA, Axelrad DA, Woodruff TJ. The Navigation Guide—evidence-based medicine meets environmental health: systematic review of human evidence for PFOA effects on fetal growth. Environ Health Perspect. 2014;122 Johnson PI, Sutton P, Atchley DS, Koustas E, Lam J, Sen S, Robinson KA, Axelrad DA, Woodruff TJ. The Navigation Guide—evidence-based medicine meets environmental health: systematic review of human evidence for PFOA effects on fetal growth. Environ Health Perspect. 2014;122
4.
go back to reference Morgan RL, Thayer KA, Bero L, Bruce N, Falck-Ytter Y, Ghersi D, Guyatt G, Hooijmans C, Langendam M, Mandrioli D. GRADE: assessing the quality of evidence in environmental and occupational health. Environ Int. 2016;92:611–6.CrossRefPubMed Morgan RL, Thayer KA, Bero L, Bruce N, Falck-Ytter Y, Ghersi D, Guyatt G, Hooijmans C, Langendam M, Mandrioli D. GRADE: assessing the quality of evidence in environmental and occupational health. Environ Int. 2016;92:611–6.CrossRefPubMed
5.
go back to reference Rooney AA, Cooper GS, Jahnke GD, Lam J, Morgan RL, Boyles AL, Ratcliffe JM, Kraft AD, Schünemann HJ, Schwingl P, et al. How credible are the study results? Evaluating and applying internal validity tools to literature-based assessments of environmental health hazards. Environ Int. 2016;92–93:617–29.CrossRefPubMedPubMedCentral Rooney AA, Cooper GS, Jahnke GD, Lam J, Morgan RL, Boyles AL, Ratcliffe JM, Kraft AD, Schünemann HJ, Schwingl P, et al. How credible are the study results? Evaluating and applying internal validity tools to literature-based assessments of environmental health hazards. Environ Int. 2016;92–93:617–29.CrossRefPubMedPubMedCentral
6.
go back to reference O’connor AM, Auvermann BW, Dzikamunhenga RS, Glanville JM, Higgins JP, Kirychuk SP, Sargeant JM, Totton SC, Wood H, Von Essen SG. Updated systematic review: associations between proximity to animal feeding operations and health of individuals in nearby communities. Syst Rev. 2017;6:86.CrossRefPubMedPubMedCentral O’connor AM, Auvermann BW, Dzikamunhenga RS, Glanville JM, Higgins JP, Kirychuk SP, Sargeant JM, Totton SC, Wood H, Von Essen SG. Updated systematic review: associations between proximity to animal feeding operations and health of individuals in nearby communities. Syst Rev. 2017;6:86.CrossRefPubMedPubMedCentral
7.
go back to reference Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, Henry D, Altman DG, Ansari MT, Boutron I. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. Br Med J. 2016;355:I4919.CrossRef Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, Henry D, Altman DG, Ansari MT, Boutron I. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. Br Med J. 2016;355:I4919.CrossRef
8.
go back to reference Rooney AA, Boyles AL, Wolfe MS, Bucher JR, Thayer KA. Systematic review and evidence integration for literature-based environmental health science assessments. Environ Health Perspect. 2014;122:711.PubMedPubMedCentral Rooney AA, Boyles AL, Wolfe MS, Bucher JR, Thayer KA. Systematic review and evidence integration for literature-based environmental health science assessments. Environ Health Perspect. 2014;122:711.PubMedPubMedCentral
9.
go back to reference Johnson PI, Koustas E, Vesterinen HM, Sutton P, Atchley DS, Kim AN, Campbell M, Donald JM, Sen S, Bero L. Application of the Navigation Guide systematic review methodology to the evidence for developmental and reproductive toxicity of triclosan. Environ Int. 2016;92:716–28.CrossRefPubMed Johnson PI, Koustas E, Vesterinen HM, Sutton P, Atchley DS, Kim AN, Campbell M, Donald JM, Sen S, Bero L. Application of the Navigation Guide systematic review methodology to the evidence for developmental and reproductive toxicity of triclosan. Environ Int. 2016;92:716–28.CrossRefPubMed
10.
go back to reference Koustas E, Lam J, Sutton P, Johnson PI, Atchley DS, Sen S, Robinson KA, Axelrad DA, Woodruff TJ. The Navigation Guide—evidence-based medicine meets environmental health: systematic review of nonhuman evidence for PFOA effects on fetal growth. Environ Health Perspect. 2014;122:1015.PubMedPubMedCentral Koustas E, Lam J, Sutton P, Johnson PI, Atchley DS, Sen S, Robinson KA, Axelrad DA, Woodruff TJ. The Navigation Guide—evidence-based medicine meets environmental health: systematic review of nonhuman evidence for PFOA effects on fetal growth. Environ Health Perspect. 2014;122:1015.PubMedPubMedCentral
11.
go back to reference Lam J, Koustas E, Sutton P, Johnson PI, Atchley DS, Sen S, Robinson KA, Axelrad DA, Woodruff TJ. The Navigation Guide—evidence-based medicine meets environmental health: integration of animal and human evidence for PFOA effects on fetal growth. Environ Health Perspect. 2014;122:1040.PubMedPubMedCentral Lam J, Koustas E, Sutton P, Johnson PI, Atchley DS, Sen S, Robinson KA, Axelrad DA, Woodruff TJ. The Navigation Guide—evidence-based medicine meets environmental health: integration of animal and human evidence for PFOA effects on fetal growth. Environ Health Perspect. 2014;122:1040.PubMedPubMedCentral
12.
go back to reference Lam J, Sutton P, Kalkbrenner A, Windham G, Halladay A, Koustas E, Lawler C, Davidson L, Daniels N, Newschaffer C. A systematic review and meta-analysis of multiple airborne pollutants and autism spectrum disorder. PLoS One. 2016;11:E0161851.CrossRefPubMedPubMedCentral Lam J, Sutton P, Kalkbrenner A, Windham G, Halladay A, Koustas E, Lawler C, Davidson L, Daniels N, Newschaffer C. A systematic review and meta-analysis of multiple airborne pollutants and autism spectrum disorder. PLoS One. 2016;11:E0161851.CrossRefPubMedPubMedCentral
13.
go back to reference Vesterinen HM, Johnson PI, Atchley DS, Sutton P, Lam J, Zlatnik MG, Sen S, Woodruff TJ. Fetal growth and maternal glomerular filtration rate: a systematic review. J Matern Fetal Neonatal Med. 2015;28:2176–81.CrossRefPubMed Vesterinen HM, Johnson PI, Atchley DS, Sutton P, Lam J, Zlatnik MG, Sen S, Woodruff TJ. Fetal growth and maternal glomerular filtration rate: a systematic review. J Matern Fetal Neonatal Med. 2015;28:2176–81.CrossRefPubMed
14.
go back to reference Carrel M, Schweizer ML, Sarrazin MV, Smith TC, Perencevich EN. Residential proximity to large numbers of swine in feeding operations is associated with increased risk of methicillin-resistant Staphylococcus aureus colonization at time of hospital admission in rural Iowa veterans. Infect Control Hosp Epidemiol. 2014;35:190–2.CrossRefPubMed Carrel M, Schweizer ML, Sarrazin MV, Smith TC, Perencevich EN. Residential proximity to large numbers of swine in feeding operations is associated with increased risk of methicillin-resistant Staphylococcus aureus colonization at time of hospital admission in rural Iowa veterans. Infect Control Hosp Epidemiol. 2014;35:190–2.CrossRefPubMed
15.
go back to reference Casey JA, Curriero FC, Cosgrove SE, Nachman KE, Schwartz BS. High-density livestock operations, crop field application of manure, and risk of community-associated methicillin-resistant Staphylococcus aureus infection in Pennsylvania. JAMA Intern Med. 2013;173:1980–90.CrossRefPubMedPubMedCentral Casey JA, Curriero FC, Cosgrove SE, Nachman KE, Schwartz BS. High-density livestock operations, crop field application of manure, and risk of community-associated methicillin-resistant Staphylococcus aureus infection in Pennsylvania. JAMA Intern Med. 2013;173:1980–90.CrossRefPubMedPubMedCentral
16.
go back to reference Davis MA, Moore DL, Baker KN, French NP, Patnode M, Hensley J, Macdonald K, Besser TE. risk factors for campylobacteriosis in two Washington state counties with high numbers of dairy farms. J Clin Microbiol. 2013;51:3921–7.CrossRefPubMedPubMedCentral Davis MA, Moore DL, Baker KN, French NP, Patnode M, Hensley J, Macdonald K, Besser TE. risk factors for campylobacteriosis in two Washington state counties with high numbers of dairy farms. J Clin Microbiol. 2013;51:3921–7.CrossRefPubMedPubMedCentral
17.
go back to reference Pavilonis B, Sanderson W, Merchant JA. Relative exposure to swine animal feeding operations and childhood asthma prevalence in an agricultural cohort. Environ Res. 2013;122:74–80.CrossRefPubMedPubMedCentral Pavilonis B, Sanderson W, Merchant JA. Relative exposure to swine animal feeding operations and childhood asthma prevalence in an agricultural cohort. Environ Res. 2013;122:74–80.CrossRefPubMedPubMedCentral
18.
go back to reference Wing S, Horton RA, Marshall SW, Thu K, Tajik M, Schinasi L, Schiffman SS. Air pollution and odor in communities near industrial swine operations. Environ Health Perspect. 2008;116:1362.CrossRefPubMedPubMedCentral Wing S, Horton RA, Marshall SW, Thu K, Tajik M, Schinasi L, Schiffman SS. Air pollution and odor in communities near industrial swine operations. Environ Health Perspect. 2008;116:1362.CrossRefPubMedPubMedCentral
19.
go back to reference Casey JA, Shopsin B, Cosgrove SE, Nachman KE, Curriero FC, Rose HR, Schwartz BS. High-density livestock production and molecularly characterized MRSA infections in Pennsylvania. Environ Health Perspect. 2014;122:464.PubMedPubMedCentral Casey JA, Shopsin B, Cosgrove SE, Nachman KE, Curriero FC, Rose HR, Schwartz BS. High-density livestock production and molecularly characterized MRSA infections in Pennsylvania. Environ Health Perspect. 2014;122:464.PubMedPubMedCentral
21.
go back to reference Price LB, Graham JP, Lackey LG, Roess A, Vailes R, Silbergeld E. Elevated risk of carrying gentamicin-resistant Escherichia coli among US poultry workers. Environ Health Perspect. 2007:1738–42. Price LB, Graham JP, Lackey LG, Roess A, Vailes R, Silbergeld E. Elevated risk of carrying gentamicin-resistant Escherichia coli among US poultry workers. Environ Health Perspect. 2007:1738–42.
22.
go back to reference Smith TC, Male MJ, Harper AL, Kroeger JS, Tinkler GP, Moritz ED, Capuano AW, Herwaldt LA, Diekema DJ. Methicillin-resistant Staphylococcus aureus (MRSA) strain ST398 is present in midwestern US swine and swine workers. PLoS One. 2009;4:E4258.CrossRefPubMedPubMedCentral Smith TC, Male MJ, Harper AL, Kroeger JS, Tinkler GP, Moritz ED, Capuano AW, Herwaldt LA, Diekema DJ. Methicillin-resistant Staphylococcus aureus (MRSA) strain ST398 is present in midwestern US swine and swine workers. PLoS One. 2009;4:E4258.CrossRefPubMedPubMedCentral
23.
go back to reference Hatcher SM, Rhodes SM, Stewart JR, Silbergeld E, Pisanic N, Larsen J, Jiang S, Krosche A, Hall D, Carroll KC. The prevalence of antibiotic-resistant Staphylococcus aureus nasal carriage among industrial hog operation workers, community residents, and children living in their households: North Carolina, USA. Environ Health Perspect. 2017;125:560.PubMed Hatcher SM, Rhodes SM, Stewart JR, Silbergeld E, Pisanic N, Larsen J, Jiang S, Krosche A, Hall D, Carroll KC. The prevalence of antibiotic-resistant Staphylococcus aureus nasal carriage among industrial hog operation workers, community residents, and children living in their households: North Carolina, USA. Environ Health Perspect. 2017;125:560.PubMed
24.
go back to reference Rinsky JL, Nadimpalli M, Wing S, Hall D, Baron D, Lb P, Larsen J, Stegger M, Stewart J, Heaney CD. Livestock-associated methicillin and multidrug resistant Staphylococcus aureus is present among industrial, not antibiotic-free livestock operation workers in North Carolina. PLoS One. 2013;8:E67641.CrossRefPubMedPubMedCentral Rinsky JL, Nadimpalli M, Wing S, Hall D, Baron D, Lb P, Larsen J, Stegger M, Stewart J, Heaney CD. Livestock-associated methicillin and multidrug resistant Staphylococcus aureus is present among industrial, not antibiotic-free livestock operation workers in North Carolina. PLoS One. 2013;8:E67641.CrossRefPubMedPubMedCentral
25.
go back to reference Gray GC, Mccarthy T, Capuano AW, Setterquist SF, Olsen CW, Alavanja MC, Lynch CF. Swine workers and swine influenza virus infections. Emerg Infect Dis. 2007;13:1871.CrossRefPubMedPubMedCentral Gray GC, Mccarthy T, Capuano AW, Setterquist SF, Olsen CW, Alavanja MC, Lynch CF. Swine workers and swine influenza virus infections. Emerg Infect Dis. 2007;13:1871.CrossRefPubMedPubMedCentral
26.
go back to reference Lantos PM, Hoffman K, Höhle M, Anderson B, Gray GC. Are people living near modern swine production facilities at increased risk of influenza virus infection? Clin Infect Dis. 2016;63:1558–63.CrossRefPubMed Lantos PM, Hoffman K, Höhle M, Anderson B, Gray GC. Are people living near modern swine production facilities at increased risk of influenza virus infection? Clin Infect Dis. 2016;63:1558–63.CrossRefPubMed
27.
go back to reference Heederik D, Sigsgaard T, Thorne PS, Kline JN, Avery R, Bønløkke JH, Chrischilles EA, Dosman JA, Duchaine C, Kirkhorn SR. Health effects of airborne exposures from concentrated animal feeding operations. Environ Health Perspect. 2007:298–302. Heederik D, Sigsgaard T, Thorne PS, Kline JN, Avery R, Bønløkke JH, Chrischilles EA, Dosman JA, Duchaine C, Kirkhorn SR. Health effects of airborne exposures from concentrated animal feeding operations. Environ Health Perspect. 2007:298–302.
28.
go back to reference Feingold BJ, Silbergeld EK, Curriero FC, Van Cleef BA, Heck ME, Kluytmans JA. Livestock density as risk factor for livestock-associated methicillin-resistant Staphylococcus Aureus, the Netherlands. Emerg Infect Dis. 2012;18:1841.CrossRefPubMedPubMedCentral Feingold BJ, Silbergeld EK, Curriero FC, Van Cleef BA, Heck ME, Kluytmans JA. Livestock density as risk factor for livestock-associated methicillin-resistant Staphylococcus Aureus, the Netherlands. Emerg Infect Dis. 2012;18:1841.CrossRefPubMedPubMedCentral
29.
go back to reference Avery RC, Wing S, Marshall SW, Schiffman SS. Odor from industrial hog farming operations and mucosal immune function in neighbors. Arch Environ Health. 2004;59:101–8.CrossRefPubMed Avery RC, Wing S, Marshall SW, Schiffman SS. Odor from industrial hog farming operations and mucosal immune function in neighbors. Arch Environ Health. 2004;59:101–8.CrossRefPubMed
30.
go back to reference Schinasi L, Horton RA, Guidry VT, Wing S, Marshall SW, Morland KB. Air pollution, lung function, and physical symptoms in communities near concentrated swine feeding operations. Epidemiology. 2011;22:208–15.CrossRefPubMed Schinasi L, Horton RA, Guidry VT, Wing S, Marshall SW, Morland KB. Air pollution, lung function, and physical symptoms in communities near concentrated swine feeding operations. Epidemiology. 2011;22:208–15.CrossRefPubMed
31.
go back to reference Arah OA, Chiba Y, Greenland S. Bias formulas for external adjustment and sensitivity analysis of unmeasured confounders. Ann Epidemiol. 2008;18:637–46.CrossRefPubMed Arah OA, Chiba Y, Greenland S. Bias formulas for external adjustment and sensitivity analysis of unmeasured confounders. Ann Epidemiol. 2008;18:637–46.CrossRefPubMed
32.
go back to reference Cornfield J, Haenszel W, Hammond EC, Lilienfeld AM, Shimkin MB, Wynder EL. Smoking and lung cancer: recent evidence and a discussion of some questions. Int J Epidemiol. 2009;38:1175–91.CrossRefPubMed Cornfield J, Haenszel W, Hammond EC, Lilienfeld AM, Shimkin MB, Wynder EL. Smoking and lung cancer: recent evidence and a discussion of some questions. Int J Epidemiol. 2009;38:1175–91.CrossRefPubMed
33.
go back to reference Horton RA, Wing S, Marshall SW, Brownley KA. Malodor as a trigger of stress and negative mood in neighbors of industrial hog operations. Am J Public Health. 2009;99:S610–5.CrossRefPubMedPubMedCentral Horton RA, Wing S, Marshall SW, Brownley KA. Malodor as a trigger of stress and negative mood in neighbors of industrial hog operations. Am J Public Health. 2009;99:S610–5.CrossRefPubMedPubMedCentral
34.
go back to reference Wing S, Horton RA, Rose KM. Air pollution from industrial swine operations and blood pressure of neighboring residents. Environ Health Perspect. 2013;121:92.PubMed Wing S, Horton RA, Rose KM. Air pollution from industrial swine operations and blood pressure of neighboring residents. Environ Health Perspect. 2013;121:92.PubMed
35.
go back to reference Pd A. Fixed effects regression models: Sage Publications; 2009. Pd A. Fixed effects regression models: Sage Publications; 2009.
36.
go back to reference Maclure M. The case-crossover design: a method for studying transient effects on the risk of acute events. Am J Epidemiol. 1991;133:144–53.CrossRefPubMed Maclure M. The case-crossover design: a method for studying transient effects on the risk of acute events. Am J Epidemiol. 1991;133:144–53.CrossRefPubMed
37.
go back to reference Radon K, Schulze A, Ehrenstein V, Van Strien RT, Praml G, Nowak D. Environmental exposure to confined animal feeding operations and respiratory health of neighboring residents. Epidemiology. 2007;18:300–8.CrossRefPubMed Radon K, Schulze A, Ehrenstein V, Van Strien RT, Praml G, Nowak D. Environmental exposure to confined animal feeding operations and respiratory health of neighboring residents. Epidemiology. 2007;18:300–8.CrossRefPubMed
38.
go back to reference Schulze A, Römmelt H, Ehrenstein V, Van Strien R, Praml G, Küchenhoff H, Nowak D, Radon K. Effects on pulmonary health of neighboring residents of concentrated animal feeding operations: exposure assessed using optimized estimation technique. Arch Environ Occup Health. 2011;66:146–54.CrossRefPubMed Schulze A, Römmelt H, Ehrenstein V, Van Strien R, Praml G, Küchenhoff H, Nowak D, Radon K. Effects on pulmonary health of neighboring residents of concentrated animal feeding operations: exposure assessed using optimized estimation technique. Arch Environ Occup Health. 2011;66:146–54.CrossRefPubMed
44.
go back to reference Casey JA, Kim BF, Larsen J, Price LB, Nachman KE. Industrial food animal production and community health. Curr Environ Health Rep. 2015;2:259–71.CrossRefPubMed Casey JA, Kim BF, Larsen J, Price LB, Nachman KE. Industrial food animal production and community health. Curr Environ Health Rep. 2015;2:259–71.CrossRefPubMed
Metadata
Title
O’Connor et al. systematic review regarding animal feeding operations and public health: critical flaws may compromise conclusions
Publication date
01-12-2017
Published in
Systematic Reviews / Issue 1/2017
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-017-0575-7

Other articles of this Issue 1/2017

Systematic Reviews 1/2017 Go to the issue