Skip to main content
Top
Published in: International Journal of Public Health 4/2011

01-08-2011 | Original Article

Agreement between web-based and paper versions of a socio-demographic questionnaire in the NutriNet-Santé study

Authors: Anne-Claire Vergnaud, Mathilde Touvier, Caroline Méjean, Emmanuelle Kesse-Guyot, Clothilde Pollet, Aurélie Malon, Katia Castetbon, Serge Hercberg

Published in: International Journal of Public Health | Issue 4/2011

Login to get access

Abstract

Objectives

Web-based studies nowadays raise a major interest as they can improve all steps involved in observational studies. Our objective was to compare the web-based version of the NutriNet-Santé self-administered socio-demographic and economic questionnaire with the traditional paper version.

Methods

Both versions of the questionnaire were sent to 170 volunteers and filled in by 147 of them (either paper first, n = 76, or web-based first, n = 71). Agreement between versions was assessed by intraclass correlations (ICC) and kappas.

Results

Agreement between both versions was high, with ICC and kappas ranging between 0.81–1.00 and 0.76–1.00, respectively, similarly across groups of administration order, age, gender and self-estimated web knowledge in general. The web-based version was the one preferred by 93.7% of the subjects and enabled to avoid 553 missing values (2.00% of the total entries), 24 inconsistent data (0.09%), 8 aberrant data (0.03%), 472 data entry errors (0.85%) and to save 2,800 € (US $4,072) when sent to 170 subjects.

Conclusion

The web-based socio-demographic and economic questionnaire provided information of similar-to-superior quality compared to the traditional paper version, with substantial logistic and cost advantages.
Literature
go back to reference Bertrais S, Preziosi P, Mennen L, Galan P, Hercberg S, Oppert JM (2004) Sociodemographic and geographic correlates of meeting current recommendations for physical activity in middle-aged French adults: the Supplementation en Vitamines et Mineraux Antioxydants (SUVIMAX) Study. Am J Public Health 94:1560–1566PubMedCrossRef Bertrais S, Preziosi P, Mennen L, Galan P, Hercberg S, Oppert JM (2004) Sociodemographic and geographic correlates of meeting current recommendations for physical activity in middle-aged French adults: the Supplementation en Vitamines et Mineraux Antioxydants (SUVIMAX) Study. Am J Public Health 94:1560–1566PubMedCrossRef
go back to reference Brigham J, Lessov-Schlaggar CN, Javitz HS, Krasnow RE, McElroy M, Swan GE (2009) Test–retest reliability of web-based retrospective self-report of tobacco exposure and risk. J Med Internet Res 11:35CrossRef Brigham J, Lessov-Schlaggar CN, Javitz HS, Krasnow RE, McElroy M, Swan GE (2009) Test–retest reliability of web-based retrospective self-report of tobacco exposure and risk. J Med Internet Res 11:35CrossRef
go back to reference Clark AM, DesMeules M, Luo W, Duncan AS, Wielgosz A (2009) Socioeconomic status and cardiovascular disease: risks and implications for care. Nat Rev Cardiol 6:712–722PubMedCrossRef Clark AM, DesMeules M, Luo W, Duncan AS, Wielgosz A (2009) Socioeconomic status and cardiovascular disease: risks and implications for care. Nat Rev Cardiol 6:712–722PubMedCrossRef
go back to reference Drewnowski A (2009) Obesity, diets, and social inequalities. Nutr Rev 67(Suppl 1):36–39CrossRef Drewnowski A (2009) Obesity, diets, and social inequalities. Nutr Rev 67(Suppl 1):36–39CrossRef
go back to reference Feinstein AR, Cicchetti DV (1990) High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 43:543–549PubMedCrossRef Feinstein AR, Cicchetti DV (1990) High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol 43:543–549PubMedCrossRef
go back to reference Graham AL, Papandonatos GD (2008) Reliability of internet-versus telephone-administered questionnaires in a diverse sample of smokers. J Med Internet Res 10:8CrossRef Graham AL, Papandonatos GD (2008) Reliability of internet-versus telephone-administered questionnaires in a diverse sample of smokers. J Med Internet Res 10:8CrossRef
go back to reference Greene J, Speizer H, Wiitala W (2008) Telephone and web: mixed-mode challenge. Health Serv Res 43:230–248PubMedCrossRef Greene J, Speizer H, Wiitala W (2008) Telephone and web: mixed-mode challenge. Health Serv Res 43:230–248PubMedCrossRef
go back to reference Hercberg S, Preziosi P, Briancon S, Galan P, Triol I, Malvy D, Roussel AM, Favier A (1998) A primary prevention trial using nutritional doses of antioxidant vitamins and minerals in cardiovascular diseases and cancers in a general population: the SU.VI.MAX study—design, methods, and participant characteristics. SUpplementation en VItamines et Mineraux AntioXydants. Control Clin Trials 19:336–351PubMedCrossRef Hercberg S, Preziosi P, Briancon S, Galan P, Triol I, Malvy D, Roussel AM, Favier A (1998) A primary prevention trial using nutritional doses of antioxidant vitamins and minerals in cardiovascular diseases and cancers in a general population: the SU.VI.MAX study—design, methods, and participant characteristics. SUpplementation en VItamines et Mineraux AntioXydants. Control Clin Trials 19:336–351PubMedCrossRef
go back to reference Joinson A (1999) Social desirability, anonymity, and Internet-based questionnaires. Behav Res Methods Instrum Comput 31:433–438PubMedCrossRef Joinson A (1999) Social desirability, anonymity, and Internet-based questionnaires. Behav Res Methods Instrum Comput 31:433–438PubMedCrossRef
go back to reference Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174PubMedCrossRef Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174PubMedCrossRef
go back to reference McCabe SE, Boyd CJ, Couper MP, Crawford S, D’Arcy H (2002) Mode effects for collecting alcohol and other drug use data: web and U.S. mail. J Stud Alcohol 63:755–761PubMed McCabe SE, Boyd CJ, Couper MP, Crawford S, D’Arcy H (2002) Mode effects for collecting alcohol and other drug use data: web and U.S. mail. J Stud Alcohol 63:755–761PubMed
go back to reference Pealer LN, Weiler RM, Pigg RM Jr, Miller D, Dorman SM (2001) The feasibility of a web-based surveillance system to collect health risk behavior data from college students. Health Educ Behav 28:547–559PubMedCrossRef Pealer LN, Weiler RM, Pigg RM Jr, Miller D, Dorman SM (2001) The feasibility of a web-based surveillance system to collect health risk behavior data from college students. Health Educ Behav 28:547–559PubMedCrossRef
go back to reference Rankin KM, Rauscher GH, McCarthy B, Erdal S, Lada P, Il’yasova D, Davis F (2008) Comparing the reliability of responses to telephone-administered versus self-administered Web-based surveys in a case–control study of adult malignant brain cancer. Cancer Epidemiol Biomarkers Prev 17:2639–2646PubMedCrossRef Rankin KM, Rauscher GH, McCarthy B, Erdal S, Lada P, Il’yasova D, Davis F (2008) Comparing the reliability of responses to telephone-administered versus self-administered Web-based surveys in a case–control study of adult malignant brain cancer. Cancer Epidemiol Biomarkers Prev 17:2639–2646PubMedCrossRef
go back to reference Schatzkin A, Subar AF, Moore S, Park Y, Potischman N, Thompson FE, Leitzmann M, Hollenbeck A, Morrissey KG, Kipnis V (2009) Observational epidemiologic studies of nutrition and cancer: the next generation (with better observation). Cancer Epidemiol Biomarkers Prev 18:1026–1032PubMedCrossRef Schatzkin A, Subar AF, Moore S, Park Y, Potischman N, Thompson FE, Leitzmann M, Hollenbeck A, Morrissey KG, Kipnis V (2009) Observational epidemiologic studies of nutrition and cancer: the next generation (with better observation). Cancer Epidemiol Biomarkers Prev 18:1026–1032PubMedCrossRef
go back to reference Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420–428PubMedCrossRef Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420–428PubMedCrossRef
go back to reference Stanton CA, Papandonatos G, Lloyd-Richardson EE, Niaura R (2007) Consistency of self-reported smoking over a 6-year interval from adolescence to young adulthood. Addiction 102:1831–1839PubMedCrossRef Stanton CA, Papandonatos G, Lloyd-Richardson EE, Niaura R (2007) Consistency of self-reported smoking over a 6-year interval from adolescence to young adulthood. Addiction 102:1831–1839PubMedCrossRef
go back to reference Touvier M, Mejean C, Kesse-Guyot E, Pollet C, Malon A, Castetbon K, Hercberg S (2010) Comparison between web-based and paper versions of a self-administered anthropometric questionnaire. Eur J Epidemiol 25(5):287–296PubMedCrossRef Touvier M, Mejean C, Kesse-Guyot E, Pollet C, Malon A, Castetbon K, Hercberg S (2010) Comparison between web-based and paper versions of a self-administered anthropometric questionnaire. Eur J Epidemiol 25(5):287–296PubMedCrossRef
go back to reference Wang YC, Lee CM, Lew-Ting CY, Hsiao CK, Chen DR, Chen WJ (2005) Survey of substance use among high school students in Taipei: web-based questionnaire versus paper-and-pencil questionnaire. J Adolesc Health 37:289–295PubMedCrossRef Wang YC, Lee CM, Lew-Ting CY, Hsiao CK, Chen DR, Chen WJ (2005) Survey of substance use among high school students in Taipei: web-based questionnaire versus paper-and-pencil questionnaire. J Adolesc Health 37:289–295PubMedCrossRef
go back to reference Ward E, Jemal A, Cokkinides V, Singh GK, Cardinez C, Ghafoor A, Thun M (2004) Cancer disparities by race/ethnicity and socioeconomic status. CA Cancer J Clin 54:78–93PubMedCrossRef Ward E, Jemal A, Cokkinides V, Singh GK, Cardinez C, Ghafoor A, Thun M (2004) Cancer disparities by race/ethnicity and socioeconomic status. CA Cancer J Clin 54:78–93PubMedCrossRef
Metadata
Title
Agreement between web-based and paper versions of a socio-demographic questionnaire in the NutriNet-Santé study
Authors
Anne-Claire Vergnaud
Mathilde Touvier
Caroline Méjean
Emmanuelle Kesse-Guyot
Clothilde Pollet
Aurélie Malon
Katia Castetbon
Serge Hercberg
Publication date
01-08-2011
Publisher
SP Birkhäuser Verlag Basel
Published in
International Journal of Public Health / Issue 4/2011
Print ISSN: 1661-8556
Electronic ISSN: 1661-8564
DOI
https://doi.org/10.1007/s00038-011-0257-5

Other articles of this Issue 4/2011

International Journal of Public Health 4/2011 Go to the issue