Skip to main content
Top
Published in: Systematic Reviews 1/2021

Open Access 01-12-2021 | Letter

Integrated Risk Information System (IRIS) response to “Assessing risk of bias in human environmental epidemiology studies using three tools: different conclusions from different tools”

Authors: Elizabeth G. Radke, Barbara S. Glenn, Andrew D. Kraft

Published in: Systematic Reviews | Issue 1/2021

Login to get access

Abstract

“Assessing risk of bias in human environmental epidemiology studies using three tools: different conclusions from different tools,” a recent publication in this journal, applied the study evaluation approach developed by the U.S. Environmental Protection Agency’s Integrated Risk Information System (IRIS), as well as other approaches, to a set of studies examining polybrominated diphenyl ethers (PBDEs) and neurodevelopment. They concluded that use of the IRIS approach resulted in exclusion of studies, which would lead to hazard conclusions based on an incomplete body of evidence. As scientists in the IRIS program, we support the comparison of approaches to improve systematic review methods for environmental exposures; however, we believe the IRIS approach was misrepresented. In this letter, we demonstrate that the ratings attributed to the IRIS approach were not consistent with our own application of the tool. We also clarify the use of studies rated as “low confidence” and the use of an overall study confidence rating in our systematic reviews. In conclusion, the IRIS study evaluation approach is a transparent method to inform certainty in our evidence synthesis decisions and ensures consistency in the development of IRIS health assessments.
Literature
1.
go back to reference Eick SM, Goin DE, Chartres N, Lam J, Woodruff TJ. Assessing risk of bias in human environmental epidemiology studies using three tools: different conclusions from different tools. Syst Rev. 2020;9:249.CrossRef Eick SM, Goin DE, Chartres N, Lam J, Woodruff TJ. Assessing risk of bias in human environmental epidemiology studies using three tools: different conclusions from different tools. Syst Rev. 2020;9:249.CrossRef
2.
go back to reference U.S. EPA (2020). ORD Staff Handbook for Developing IRIS Assessments (Public Comment Draft, Nov 2020). U.S. EPA Office of Research and Development, Washington, DC, EPA/600/R-20/137, 2020. U.S. EPA (2020). ORD Staff Handbook for Developing IRIS Assessments (Public Comment Draft, Nov 2020). U.S. EPA Office of Research and Development, Washington, DC, EPA/600/R-20/137, 2020.
3.
go back to reference Radke EG, Yost EE, Roth N, Sathyanarayana S, Whaley P. Application of US EPA IRIS systematic review methods to the health effects of phthalates: lessons learned and path forward. Environ Int. 2020;145:105820.CrossRef Radke EG, Yost EE, Roth N, Sathyanarayana S, Whaley P. Application of US EPA IRIS systematic review methods to the health effects of phthalates: lessons learned and path forward. Environ Int. 2020;145:105820.CrossRef
4.
go back to reference U.S. EPA (2021). Human health toxicity values for perfluorobutane sulfonic acid and related compound potassium perfluorobutane sulfonate. U.S. Environmental Protection Agency, Washington, DC, EPA/600/R-20/345F. U.S. EPA (2021). Human health toxicity values for perfluorobutane sulfonic acid and related compound potassium perfluorobutane sulfonate. U.S. Environmental Protection Agency, Washington, DC, EPA/600/R-20/345F.
5.
go back to reference Radke EG, Glenn BS, Galizia A, Persad A, Nachman R, Bateson T, et al. Development of outcome-specific criteria for study evaluation in systematic reviews of epidemiology studies. Environ Int. 2019;130:104884.CrossRef Radke EG, Glenn BS, Galizia A, Persad A, Nachman R, Bateson T, et al. Development of outcome-specific criteria for study evaluation in systematic reviews of epidemiology studies. Environ Int. 2019;130:104884.CrossRef
7.
go back to reference Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919.CrossRef Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919.CrossRef
Metadata
Title
Integrated Risk Information System (IRIS) response to “Assessing risk of bias in human environmental epidemiology studies using three tools: different conclusions from different tools”
Authors
Elizabeth G. Radke
Barbara S. Glenn
Andrew D. Kraft
Publication date
01-12-2021
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2021
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-021-01783-6

Other articles of this Issue 1/2021

Systematic Reviews 1/2021 Go to the issue