Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2023

Open Access 01-12-2023 | Confusion | Research

Mitigating underreported error in food frequency questionnaire data using a supervised machine learning method and error adjustment algorithm

Authors: Anjolaoluwa Ayomide Popoola, Jennifer Koren Frediani, Terryl Johnson Hartman, Kamran Paynabar

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Login to get access

Abstract

Background

Food frequency questionnaires (FFQs) are one of the most useful tools for studying and understanding diet-disease relationships. However, because FFQs are self-reported data, they are susceptible to response bias, social desirability bias, and misclassification. Currently, several methods have been created to combat these issues by modelling the measurement error in diet-disease relationships.

Method

In this paper, a novel machine learning method is proposed to adjust for measurement error found in misreported data by using a random forest (RF) classifier to label the responses in the FFQ based on the input dataset and creating an algorithm that adjusts the measurement error. We demonstrate this method by addressing underreporting in selected FFQ responses.

Result

According to the results, we have high model accuracies ranging from 78% to 92% in participant collected data and 88% in simulated data.

Conclusion

This shows that our proposed method of using a RF classifier and an error adjustment algorithm is efficient to correct most of the underreported entries in the FFQ dataset and could be used independent of diet-disease models. This could help nutrition researchers and other experts to use dietary data estimated by FFQs with less measurement error and create models from the data with minimal noise.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kirkpatrick SI, Troiano RP, Barrett B, Cunningham C, Subar AF, Park Y, et al. Measurement error affecting web- and paper-based dietary assessment instruments: insights from the multi-cohort eating and activity study for understanding reporting error. Am J Epidemiol. 2022;191(6):1125–39.CrossRefPubMedPubMedCentral Kirkpatrick SI, Troiano RP, Barrett B, Cunningham C, Subar AF, Park Y, et al. Measurement error affecting web- and paper-based dietary assessment instruments: insights from the multi-cohort eating and activity study for understanding reporting error. Am J Epidemiol. 2022;191(6):1125–39.CrossRefPubMedPubMedCentral
2.
go back to reference Alonso A, Yu B, Sun YV, Chen LY, Loehr LR, O’Neal WT, et al. Serum metabolomics and incidence of atrial fibrillation (from the Atherosclerosis Risk in Communities Study). Am J Cardiol. 2019;123(12):1955–61.CrossRefPubMedPubMedCentral Alonso A, Yu B, Sun YV, Chen LY, Loehr LR, O’Neal WT, et al. Serum metabolomics and incidence of atrial fibrillation (from the Atherosclerosis Risk in Communities Study). Am J Cardiol. 2019;123(12):1955–61.CrossRefPubMedPubMedCentral
3.
go back to reference Kipnis V, Midthune D, Freedman L, Bingham S, Day NE, Riboli E, et al. Bias in dietary-report instruments and its implications for nutritional epidemiology. Public Health Nutr. 2002;5(6A):915–23.CrossRefPubMed Kipnis V, Midthune D, Freedman L, Bingham S, Day NE, Riboli E, et al. Bias in dietary-report instruments and its implications for nutritional epidemiology. Public Health Nutr. 2002;5(6A):915–23.CrossRefPubMed
4.
go back to reference Kristal AR, Andrilla CH, Koepsell TD, Diehr PH, Cheadle A. Dietary assessment instruments are susceptible to intervention-associated response set bias. J Am Diet Assoc. 1998;98(1):40–3.CrossRefPubMed Kristal AR, Andrilla CH, Koepsell TD, Diehr PH, Cheadle A. Dietary assessment instruments are susceptible to intervention-associated response set bias. J Am Diet Assoc. 1998;98(1):40–3.CrossRefPubMed
5.
go back to reference Kipnis V, Midthune D, Freedman LS, Bingham S, Schatzkin A, Subar A, et al. Empirical evidence of correlated biases in dietary assessment instruments and its implications. Am J Epidemiol. 2001;153(4):394–403.CrossRefPubMed Kipnis V, Midthune D, Freedman LS, Bingham S, Schatzkin A, Subar A, et al. Empirical evidence of correlated biases in dietary assessment instruments and its implications. Am J Epidemiol. 2001;153(4):394–403.CrossRefPubMed
6.
go back to reference Aaby D, Siddique J. Effects of differential measurement error in self-reported diet in longitudinal lifestyle intervention studies. Int J Behav Nutr Phys Act. 2021;18(1):125.CrossRefPubMedPubMedCentral Aaby D, Siddique J. Effects of differential measurement error in self-reported diet in longitudinal lifestyle intervention studies. Int J Behav Nutr Phys Act. 2021;18(1):125.CrossRefPubMedPubMedCentral
7.
go back to reference Freedman LS, Midthune D, Carroll RJ, Kipnis V. A comparison of regression calibration, moment reconstruction and imputation for adjusting for covariate measurement error in regression. Stat Med. 2008;27(25):5195–216.CrossRefPubMedPubMedCentral Freedman LS, Midthune D, Carroll RJ, Kipnis V. A comparison of regression calibration, moment reconstruction and imputation for adjusting for covariate measurement error in regression. Stat Med. 2008;27(25):5195–216.CrossRefPubMedPubMedCentral
8.
go back to reference Agogo GO. A zero-augmented generalized gamma regression calibration to adjust for covariate measurement error: a case of an episodically consumed dietary intake: a zero-augmented generalized gamma regression calibration to adjust for measurement error. Biom J. 2017;59(1):94–109.CrossRefPubMed Agogo GO. A zero-augmented generalized gamma regression calibration to adjust for covariate measurement error: a case of an episodically consumed dietary intake: a zero-augmented generalized gamma regression calibration to adjust for measurement error. Biom J. 2017;59(1):94–109.CrossRefPubMed
9.
go back to reference Agogo GO, van der Voet H, van’t Veer P, Ferrari P, Leenders M, Muller DC, et al. Use of two-part regression calibration model to correct for measurement error in episodically consumed foods in a single-replicate study design: EPIC case study. PLoS One. 2014;9(11):e113160.CrossRefPubMedPubMedCentral Agogo GO, van der Voet H, van’t Veer P, Ferrari P, Leenders M, Muller DC, et al. Use of two-part regression calibration model to correct for measurement error in episodically consumed foods in a single-replicate study design: EPIC case study. PLoS One. 2014;9(11):e113160.CrossRefPubMedPubMedCentral
10.
go back to reference Grech A, Hasick M, Gemming L, Rangan A. Energy misreporting is more prevalent for those of lower socio-economic status and is associated with lower reported intake of discretionary foods. Br J Nutr. 2021;125(11):1291–8.CrossRefPubMed Grech A, Hasick M, Gemming L, Rangan A. Energy misreporting is more prevalent for those of lower socio-economic status and is associated with lower reported intake of discretionary foods. Br J Nutr. 2021;125(11):1291–8.CrossRefPubMed
11.
go back to reference Tooze JA, Subar AF, Thompson FE, Troiano R, Schatzkin A, Kipnis V. Psychosocial predictors of energy underreporting in a large doubly labeled water study. Am J Clin Nutr. 2004;79(5):795–804.CrossRefPubMed Tooze JA, Subar AF, Thompson FE, Troiano R, Schatzkin A, Kipnis V. Psychosocial predictors of energy underreporting in a large doubly labeled water study. Am J Clin Nutr. 2004;79(5):795–804.CrossRefPubMed
12.
go back to reference Heitmann BL, Lissner L. Can adverse effects of dietary fat intake be overestimated as a consequence of dietary fat underreporting? Public Health Nutr. 2005;8(8):1322–7.CrossRefPubMed Heitmann BL, Lissner L. Can adverse effects of dietary fat intake be overestimated as a consequence of dietary fat underreporting? Public Health Nutr. 2005;8(8):1322–7.CrossRefPubMed
13.
go back to reference Becker W, Welten D. Under-reporting in dietary surveys – implications for development of food-based dietary guidelines. Public Health Nutr. 2001;4(2b):683–7.CrossRefPubMed Becker W, Welten D. Under-reporting in dietary surveys – implications for development of food-based dietary guidelines. Public Health Nutr. 2001;4(2b):683–7.CrossRefPubMed
14.
go back to reference Johansson G, Wikman A, Ahrén AM, Hallmans G, Johansson I. Underreporting of energy intake in repeated 24-hour recalls related to gender, age, weight status, day of interview, educational level, reported food intake, smoking habits and area of living. Public Health Nutr. 2001;4(4):919–27.CrossRefPubMed Johansson G, Wikman A, Ahrén AM, Hallmans G, Johansson I. Underreporting of energy intake in repeated 24-hour recalls related to gender, age, weight status, day of interview, educational level, reported food intake, smoking habits and area of living. Public Health Nutr. 2001;4(4):919–27.CrossRefPubMed
15.
go back to reference Krebs-Smith SM, Graubard BI, Kahle LL, Subar AF, Cleveland LE, Ballard-Barbash R. Low energy reporters vs others: a comparison of reported food intakes. Eur J Clin Nutr. 2000;54(4):281–7.CrossRefPubMed Krebs-Smith SM, Graubard BI, Kahle LL, Subar AF, Cleveland LE, Ballard-Barbash R. Low energy reporters vs others: a comparison of reported food intakes. Eur J Clin Nutr. 2000;54(4):281–7.CrossRefPubMed
16.
go back to reference Lafay L, Mennen L, Basdevant A, Charles MA, Borys JM, Eschwège E, et al. Does energy intake underreporting involve all kinds of food or only specific food items? Results from the Fleurbaix Laventie Ville Santé (FLVS) study. Int J Obes Relat Metab Disord J Int Assoc Study Obes. 2000;24(11):1500–6.CrossRef Lafay L, Mennen L, Basdevant A, Charles MA, Borys JM, Eschwège E, et al. Does energy intake underreporting involve all kinds of food or only specific food items? Results from the Fleurbaix Laventie Ville Santé (FLVS) study. Int J Obes Relat Metab Disord J Int Assoc Study Obes. 2000;24(11):1500–6.CrossRef
17.
go back to reference Tabassum R, Cunningham L, Stephens E, Sturdivant K, Martin G, Brigham K, et al. A longitudinal study of health improvement in the Atlanta CHDWB Wellness Cohort. J Pers Med. 2014;4(4):489–507.CrossRefPubMedPubMedCentral Tabassum R, Cunningham L, Stephens E, Sturdivant K, Martin G, Brigham K, et al. A longitudinal study of health improvement in the Atlanta CHDWB Wellness Cohort. J Pers Med. 2014;4(4):489–507.CrossRefPubMedPubMedCentral
18.
go back to reference Boeckner LS, Pullen CH, Walker SN, Abbott GW, Block T. Use and reliability of the world wide web version of the block health habits and history questionnaire with older rural women. J Nutr Educ Behav. 2002;34:S20–4.CrossRefPubMed Boeckner LS, Pullen CH, Walker SN, Abbott GW, Block T. Use and reliability of the world wide web version of the block health habits and history questionnaire with older rural women. J Nutr Educ Behav. 2002;34:S20–4.CrossRefPubMed
19.
go back to reference Subar AF, Freedman LS, Tooze JA, Kirkpatrick SI, Boushey C, Neuhouser ML, et al. Addressing current criticism regarding the value of self-report dietary data. J Nutr. 2015;145(12):2639–45.CrossRefPubMedPubMedCentral Subar AF, Freedman LS, Tooze JA, Kirkpatrick SI, Boushey C, Neuhouser ML, et al. Addressing current criticism regarding the value of self-report dietary data. J Nutr. 2015;145(12):2639–45.CrossRefPubMedPubMedCentral
20.
go back to reference Streppel MT, de Vries JH, Meijboom S, Beekman M, de Craen AJ, Slagboom PE, et al. Relative validity of the food frequency questionnaire used to assess dietary intake in the Leiden Longevity Study. Nutr J. 2013;12(1):75.CrossRefPubMedPubMedCentral Streppel MT, de Vries JH, Meijboom S, Beekman M, de Craen AJ, Slagboom PE, et al. Relative validity of the food frequency questionnaire used to assess dietary intake in the Leiden Longevity Study. Nutr J. 2013;12(1):75.CrossRefPubMedPubMedCentral
21.
go back to reference Kulkarni V, Sinha P. Random forest classifiers: A survey and future research directions. Int J Adv Comput. 2013;36:1144–53. Kulkarni V, Sinha P. Random forest classifiers: A survey and future research directions. Int J Adv Comput. 2013;36:1144–53.
22.
go back to reference Reščič N, Eftimov T, KoroušićSeljak B, Luštrek M. Optimising an FFQ using a machine learning pipeline to teach an efficient nutrient intake predictive model. Nutrients. 2020;12(12):3789.CrossRefPubMedPubMedCentral Reščič N, Eftimov T, KoroušićSeljak B, Luštrek M. Optimising an FFQ using a machine learning pipeline to teach an efficient nutrient intake predictive model. Nutrients. 2020;12(12):3789.CrossRefPubMedPubMedCentral
23.
go back to reference Agogo GO, Muoka AK. A three-part regression calibration to handle excess zeroes, skewness and heteroscedasticity in adjusting for measurement error in dietary intake data. J Appl Stat. 2022;49(4):884–901.CrossRefPubMed Agogo GO, Muoka AK. A three-part regression calibration to handle excess zeroes, skewness and heteroscedasticity in adjusting for measurement error in dietary intake data. J Appl Stat. 2022;49(4):884–901.CrossRefPubMed
Metadata
Title
Mitigating underreported error in food frequency questionnaire data using a supervised machine learning method and error adjustment algorithm
Authors
Anjolaoluwa Ayomide Popoola
Jennifer Koren Frediani
Terryl Johnson Hartman
Kamran Paynabar
Publication date
01-12-2023
Publisher
BioMed Central
Keyword
Confusion
Published in
BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-023-02262-9

Other articles of this Issue 1/2023

BMC Medical Informatics and Decision Making 1/2023 Go to the issue