Top

The European Journal of Health Economics

Published in:

Open Access 01-06-2019 | Original Paper

Psychometric properties of the Hungarian version of the eHealth Literacy Scale

Authors: Zsombor Zrubka, Ottó Hajdu, Fanni Rencz, Petra Baji, László Gulácsi, Márta Péntek

Published in: The European Journal of Health Economics | Special Issue 1/2019

Abstract

Background

We adapted the eHealth Literacy Scale (eHEALS) for Hungary and tested its psychometric properties on a large representative online sample of the general population.

Methods

The Hungarian version of eHEALS was developed using forward–backward translation. For the valuation study, 1000 respondents were recruited in early 2019 from a large online panel by a survey company. We tested internal consistency, test–retest reliability and construct and criterion validity using classical test theory, as well as item characteristics using an item-response theory (IRT) graded response model (GRM).

Results

55% of respondents were female, and 22.1% were ≥ 65 years old. Mean eHEALS score was 29.2 (SD: 5.18). Internal consistency was good (Cronbach’s α = 0.90), and test–retest reliability was moderate (intraclass correlation r = 0.64). We identified a single-factor structure by exploratory factor analysis, explaining 85% of test variance. Essential criteria for GRM analysis were met. Items 3 and 4 (search of health resources) were the least difficult, followed by items 5 and 8 (utilisation of health information), and then items 1 and 2 (awareness of health resources). Items 6 and 7 (appraisal of health resources) were most difficult. The measurement properties of eHEALS were not affected by gender, age, education or income levels. Female gender, older age, intensity of health information seeking, formal health education and visit at the electronic health-record website were associated with higher eHEALS scores, as well as best and worst self-perceived health states, BMI < 25 and participation at health screenings over the past year.

Conclusions

The Hungarian eHEALS is a useful and valid tool for measuring subjective eHealth literacy.

Available only for authorised users

TNS: European Citizen’s Digital Health Literacy. In: Flash Eurobarometer 404. European Commission Directorate-General for Communication, (2014)

Mesko, B., Drobni, Z., Benyei, E., Gergely, B., Gyorffy, Z.: Digital health is a cultural transformation of traditional healthcare. Mhealth 3, 38 (2017). https://doi.org/10.21037/mhealth.2017.08.07 CrossRefPubMedPubMedCentral

Frist, W.H.: Connected health and the rise of the patient-consumer. Health Aff. (Millwood) 33(2), 191–193 (2014). https://doi.org/10.1377/hlthaff.2013.1464 CrossRef

Elbert, N.J., van Os-Medendorp, H., van Renselaar, W., Ekeland, A.G., Hakkaart-van Roijen, L., Raat, H., Nijsten, T.E., Pasmans, S.G.: Effectiveness and cost-effectiveness of ehealth interventions in somatic diseases: a systematic review of systematic reviews and meta-analyses. J. Med. Internet Res. 16(4), e110 (2014). https://doi.org/10.2196/jmir.2790 CrossRefPubMedPubMedCentral

Lau, A.Y., Gabarron, E.F.-L.L., Armayones, M.: Social media in health–what are the safety concerns for health consumers. Health Inf Manag 41(2), 30–35 (2012)PubMed

Chen, Y.Y., Chen, L., Kao, Y.H., Chu, T.S., Huang, T.S., Ko, W.J.: The over-optimistic portrayal of life-supporting treatments in newspapers and on the Internet: a cross-sectional study using extra-corporeal membrane oxygenation as an example. BMC Med. Ethics 15, 59 (2014). https://doi.org/10.1186/1472-6939-15-59 CrossRefPubMedPubMedCentral

Institute of Medicine Committee on Health, L.: In: Nielsen-Bohlman, L., Panzer, A.M., Kindig, D.A. (eds.) Health Literacy: A Prescription to End Confusion. National Academies Press (US) Copyright 2004 by the National Academy of Sciences. All rights reserved., Washington (DC) (2004)

Norman, C.D., Skinner, H.A.: eHealth literacy: essential skills for consumer health in a networked world. J. Med. Internet Res. 8(2), e9 (2006). https://doi.org/10.2196/jmir.8.2.e9 CrossRefPubMedPubMedCentral

Aponte, J., Nokes, K.M.: Electronic health literacy of older Hispanics with diabetes. Health Promot. Int. 32(3), 482–489 (2017). https://doi.org/10.1093/heapro/dav112 CrossRefPubMed

10.

Hogan, T.P., Hill, J.N., Locatelli, S.M., Weaver, F.M., Thomas, F.P., Nazi, K.M., Goldstein, B., Smith, B.M.: Health information seeking and technology use among veterans with spinal cord injuries and disorders. PM R 8(2), 123–130 (2016). https://doi.org/10.1016/j.pmrj.2015.06.443 CrossRefPubMed

11.

Vicente, M.R., Madden, G.: Assessing eHealth skills across Europeans. Health Policy Technol. 6(2), 161–168 (2017). https://doi.org/10.1016/j.hlpt.2017.04.001 CrossRef

12.

Neter, E., Brainin, E.: eHealth literacy: extending the digital divide to the realm of health information. J. Med. Internet Res. 14(1), e19 (2012). https://doi.org/10.2196/jmir.1619 CrossRefPubMedPubMedCentral

13.

Neuhauser, L., Kreps, G.L.: eHealth communication and behavior change: promise and performance. Soc. Semiot. 20(1), 9–27 (2010). https://doi.org/10.1080/10350330903438386 CrossRef

14.

Kim, S.H., Son, Y.J.: Relationships Between eHealth Literacy and Health Behaviors in Korean Adults. Comput. Inf. Nurs 35(2), 84–90 (2017). https://doi.org/10.1097/CIN.0000000000000255 CrossRef

15.

Mitsutake, S., Shibata, A., Ishii, K., Oka, K.: Associations of eHealth Literacy With Health Behavior Among Adult Internet Users. J. Med. Internet Res. 18(7), e192 (2016). https://doi.org/10.2196/jmir.5413 CrossRefPubMedPubMedCentral

16.

Hsu, W., Chiang, C., Yang, S.: The effect of individual factors on health behaviors among college students: the mediating effects of eHealth literacy. J. Med. Internet Res. 16(12), e287 (2014). https://doi.org/10.2196/jmir.3542 CrossRefPubMedPubMedCentral

17.

Mitsutake, S., Shibata, A., Ishii, K., Oka, K.: Association of eHealth literacy with colorectal cancer knowledge and screening practice among internet users in Japan. J. Med. Internet Res. 14(6), e153 (2012). https://doi.org/10.2196/jmir.1927 CrossRefPubMedPubMedCentral

18.

Choi, N.G., Dinitto, D.M.: The digital divide among low-income homebound older adults: internet use patterns, eHealth literacy, and attitudes toward computer/Internet use. J. Med. Internet Res. 15(5), e93 (2013). https://doi.org/10.2196/jmir.2645 CrossRefPubMedPubMedCentral

19.

Mackert, M., Mabry-Flynn, A., Champlin, S., Donovan, E.E., Pounders, K.: Health literacy and health information technology adoption: the potential for a new digital divide. J. Med. Internet Res. 18(10), e264 (2016). https://doi.org/10.2196/jmir.6349 CrossRefPubMedPubMedCentral

20.

Kim, H., Xie, B.: Health literacy and internet- and mobile app-based health services: a systematic review of the literature. Proc. Assoc. Inf. Sci. Technol. 52(1), 1–4 (2015). https://doi.org/10.1002/pra2.2015.145052010075 CrossRef

21.

Brusaferro, S., Parpinel, M., Del Giudice, P., Poletto, M.: Report on key factors, drivers, barriers and trends on digital health literacy. In: Improving digital health literacy in Europe. IC-Health Consortium, https://ichealth.eu/wp-content/uploads/2018/06/D1.1-Report-on-key-factors-drivers-barriers-and-trends-on-digital-health-literacy.pdf, (2018). Accessed 20 Mar 2019

22.

Neter, E., Brainin, E.: Perceived and performed eHealth Literacy: survey and simulated performance test. JMIR Hum. Factors 4(1), e2 (2017). https://doi.org/10.2196/humanfactors.6523 CrossRefPubMedPubMedCentral

23.

van der Vaart, R., van Deursen, A.J., Drossaert, C.H., Taal, E., van Dijk, J.A., van de Laar, M.A.: Does the eHealth Literacy Scale (eHEALS) measure what it intends to measure? Validation of a Dutch version of the eHEALS in two adult populations. J. Med. Internet Res. 13(4), e86 (2011). https://doi.org/10.2196/jmir.1840 CrossRefPubMedPubMedCentral

24.

van der Vaart, R., Drossaert, C.: Development of the digital health literacy instrument: measuring a broad spectrum of health 10 and health 20 skills. J. Med. Internet Res. 19(1), e27 (2017). https://doi.org/10.2196/jmir.6709 CrossRefPubMedPubMedCentral

25.

Quinn, S., Bond, R., Nugent, C.: Quantifying health literacy and eHealth literacy using existing instruments and browser-based software for tracking online health information seeking behavior. Comput. Hum. Behav. 69, 256–267 (2017). https://doi.org/10.1016/j.chb.2016.12.032 CrossRef

26.

Dt. Jean, B., Greene Taylor, N., Kodama, C., Subramaniam, M.: Assessing the digital health literacy skills of tween participants in a school-library-based after-school program. J. Consum. Health Internet 21(1), 40–61 (2017). https://doi.org/10.1080/15398285.2017.1279894 CrossRef

27.

Norman, C.D., Skinner, H.A.: eHEALS: the eHealth literacy scale. J. Med. Internet Res. 8(4), e27 (2006). https://doi.org/10.2196/jmir.8.4.e27 CrossRefPubMedPubMedCentral

28.

Kayser, L., Karnoe, A., Furstrand, D., Batterham, R., Christensen, K.B., Elsworth, G., Osborne, R.H.: A Multidimensional Tool Based on the eHealth Literacy Framework: development and Initial Validity Testing of the eHealth Literacy Questionnaire (eHLQ). J. Med. Internet Res. 20(2), e36 (2018). https://doi.org/10.2196/jmir.8371 CrossRefPubMedPubMedCentral

29.

Koopman, R.J., Petroski, G.F., Canfield, S.M., Stuppy, J.A., Mehr, D.R.: Development of the PRE-HIT instrument: patient readiness to engage in health information technology. BMC Fam. Pract. 15, 18 (2014). https://doi.org/10.1186/1471-2296-15-18 CrossRefPubMedPubMedCentral

30.

Seckin, G., Yeatts, D., Hughes, S., Hudson, C., Bell, V.: Being an informed consumer of health information and assessment of electronic health literacy in a national sample of internet users: validity and reliability of the e-HLS instrument. J. Med. Internet Res. 18(7), e161 (2016). https://doi.org/10.2196/jmir.5496 CrossRefPubMedPubMedCentral

31.

Karnoe, A., Kayser, L.: How is eHealth literacy measured and what do the measurements tell us? A systematic review. Knowl. Manag. E-Learn. 7(4), 576–600 (2015)

32.

Bandura, A.: Self-Efficacy: The Exercise of Control. W.H. Freeman, New York (1997)

33.

Monkmana, H., Kushniruka, A., Barnetta, J., Boryckia, E., Greiner, L., Sheetsc, D.: are health literacy and ehealth literacy the same or different? Stud. Health Technol. Inf. 245, 178–182 (2017). https://doi.org/10.3233/978-1-61499-830-3-178 CrossRef

34.

Noblin, A.M., Rutherford, A.: Impact of health literacy on senior citizen engagement in health care IT usage. Gerontol Geriatr Med 3, 2333721417706300 (2017). https://doi.org/10.1177/2333721417706300 CrossRefPubMedPubMedCentral

35.

Paige, S.R., Krieger, J.L., Stellefson, M., Alber, J.M.: eHealth literacy in chronic disease patients: an item response theory analysis of the eHealth literacy scale (eHEALS). Patient Educ. Couns. 100(2), 320–326 (2017). https://doi.org/10.1016/j.pec.2016.09.008 CrossRefPubMed

36.

Richtering, S.S., Morris, R., Soh, S.E., Barker, A., Bampi, F., Neubeck, L., Coorey, G., Mulley, J., Chalmers, J., Usherwood, T., Peiris, D., Chow, C.K., Redfern, J.: Examination of an eHealth literacy scale and a health literacy scale in a population with moderate to high cardiovascular risk: rasch analyses. PLoS One 12(4), e0175372 (2017). https://doi.org/10.1371/journal.pone.0175372 CrossRefPubMedPubMedCentral

37.

Chesser, A., Burke, A., Reyes, J., Rohrberg, T.: Navigating the digital divide: a systematic review of eHealth literacy in underserved populations in the United States. Inf. Health Soc. Care 41(1), 1–19 (2016). https://doi.org/10.3109/17538157.2014.948171 CrossRef

38.

Manafò, E., Wong, S.: Assessing the eHealth literacy skills of older adults: a preliminary study. J. Consum. Health Internet 16(4), 369–381 (2012). https://doi.org/10.1080/15398285.2012.701163 CrossRef

39.

Sudbury-Riley, L., FitzPatrick, M., Schulz, P.J.: Exploring the measurement properties of the eHealth Literacy Scale (eHEALS) among baby boomers: a multinational test of measurement invariance. J. Med. Internet Res. 19(2), e53 (2017). https://doi.org/10.2196/jmir.5998 CrossRefPubMedPubMedCentral

40.

Aponte, J., Nokes, K.M.: Validating an electronic health literacy scale in an older hispanic population. J. Clin. Nurs. 26(17–18), 2703–2711 (2017). https://doi.org/10.1111/jocn.13763 CrossRefPubMed

41.

Diviani, N., Dima, A.L., Schulz, P.J.: A psychometric analysis of the italian version of the ehealth literacy scale using item response and classical test theory methods. J. Med. Internet Res. 19(4), e114 (2017). https://doi.org/10.2196/jmir.6749 CrossRefPubMedPubMedCentral

42.

Chung, S., Park, B.K., Nahm, E.S.: The Korean eHealth Literacy Scale (K-eHEALS): reliability and validity testing in younger adults recruited online. J. Med. Internet Res. 20(4), e138 (2018). https://doi.org/10.2196/jmir.8759 CrossRefPubMedPubMedCentral

43.

Mitsutake, S., Shibata, A., Ishii, K., Okazaki, K., Oka, K.: Developing Japanese version of the eHealth Literacy Scale (eHEALS). Nihon Koshu Eisei Zasshi 58(5), 361–371 (2011)PubMed

44.

Paramio Perez, G., Almagro, B.J., Hernando Gomez, A., Aguaded Gomez, J.I.: Validation of the eHealth Literacy Scale (eHEALS) in Spanish University Students. Rev. Esp. Salud. Publ. 89(3), 329–338 (2015). https://doi.org/10.4321/S1135-57272015000300010 CrossRef

45.

Tomás, C., Queirós, P., TFerreira, T.: Análise das propriedades psicométricas da versão portuguesa de um instrumento de avaliação de e-Literacia em Saúde. Revista de Enfermagem Referência IV Série(2), 19–28 (2014). https://doi.org/10.12707/riv14004 CrossRef

46.

Stellefson, M., Paige, S.R., Tennant, B., Alber, J.M., Chaney, B.H., Chaney, D., Grossman, S.: Reliability and validity of the telephone-based eHealth literacy scale among older adults: cross-sectional survey. J Med. Internet Res. 19(10), e362 (2017). https://doi.org/10.2196/jmir.8481 CrossRefPubMedPubMedCentral

47.

Walters, S., Suhrcke, M.: Socioeconomic inequalities in health and health care access in central and eastern Europe and the CIS: a review of the recent literature. WHO European Office for Investment for Health and Development Working Paper 2005/1. Venice, Italy (2005). http://www.euro.who.int/__data/assets/pdf_file/0006/125457/e94412.pdf. Accessed 20 Mar 2019

48.

Eurostat: European Health Interview Survey (EHIS wave 2) Methodological Manual. European Union, Luxembourg (2013)

49.

Herdman, M., Gudex, C., Lloyd, A., Janssen, M., Kind, P., Parkin, D., Bonsel, G., Badia, X.: Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual. Life Res. 20(10), 1727–1736 (2011). https://doi.org/10.1007/s11136-011-9903-x CrossRefPubMedPubMedCentral

50.

Garrow, J.: Treat Obesity Seriously: A Clinical Manual. Churchill Livingstone, Edinburgh (1981)

51.

Schane, R.E., Ling, P.M., Glantz, S.A.: Health effects of light and intermittent smoking: a review. Circulation 121(13), 1518–1522 (2010). https://doi.org/10.1161/CIRCULATIONAHA.109.904235 CrossRefPubMedPubMedCentral

52.

Breslow, R.A., Graubard, B.I.: Prospective study of alcohol consumption in the United States: quantity, frequency, and cause-specific mortality. Alcohol. Clin. Exp. Res. 32(3), 513–521 (2008). https://doi.org/10.1111/j.1530-0277.2007.00595.x CrossRefPubMed

53.

Arem, H., Moore, S.C., Patel, A., Hartge, P., Berrington de Gonzalez, A., Visvanathan, K., Campbell, P.T., Freedman, M., Weiderpass, E., Adami, H.O., Linet, M.S., Lee, I.M., Matthews, C.E.: Leisure time physical activity and mortality: a detailed pooled analysis of the dose-response relationship. JAMA Intern Med 175(6), 959–967 (2015). https://doi.org/10.1001/jamainternmed.2015.0533 CrossRefPubMedPubMedCentral

54.

Swenson, P.F., Ebell, M.H.: Introducing a one-page adult preventive health care schedule: uSPSTF recommendations at a glance. Am. Fam. Phys. 93(9), 738–740 (2016)

55.

Levene, H.: Robust tests for equality of variances. In: Olkin, I.E.A. (ed.) Contributions to Probability and Statistics: Essays in Honor of Harold Hotelling, pp. 278–292. Stanford University Press, Palo Alto (1960)

56.

Feldt, L.S.: A test of the hypothesis that Cronbach’s alpha or Kuder–Richardson coefficient twenty is the same for two tests. Psychometrika 34(3), 363–373 (1969). https://doi.org/10.1007/bf02289364 CrossRef

57.

Bartolucci, F., Bacci, S., Gnaldi, M.: Statistical Analysis of Questionnaires: a Unified Approach Based on R and Stata. Taylor & Francis Group, London (2016)

58.

StataCorp: Statistical Software: Release 14.2. StataCorp LP, College Station (2015)

59.

Rizopoulos, D.: ltm: an R package for latent variable modelling and item response theory analyses. J. Stat. Softw. 17(5), 1–25 (2006)CrossRef

60.

Linacre, J.M.: Optimizing rating scale category effectiveness. J. Appl. Measur. 3(1), 85–106 (2002)

61.

Nering, M.L., Ostini, R.: Handbook of Polytomous Item Response Theory Models. Taylor & Francis Group, New York (2010)

62.

Tennant, B., Stellefson, M., Dodd, V., Chaney, B., Chaney, D., Paige, S., Alber, J.: eHealth literacy and Web 20 health information seeking behaviors among baby boomers and older adults. J Med. Internet Res. 17(3), e70 (2015). https://doi.org/10.2196/jmir.3992 CrossRefPubMedPubMedCentral

63.

Soellner, R., Huber, S., Reder, M.: The concept of EHEALTH LITERACY AND ITS MEASUREMENt. J. Media Psychol. 26(1), 29–38 (2014). https://doi.org/10.1027/1864-1105/a000104 CrossRef

64.

Dashti, S., Peyman, N., Tajfard, M., Esmaeeli, H.: E-Health literacy of medical and health sciences university students in Mashhad, Iran in 2016: a pilot study. Electron. Phys. 9(3), 3966–3973 (2017). https://doi.org/10.19082/3966 CrossRef

65.

Samejima, F.: (1997) Graded response model. In: van der Linden, W.J., Hambleton, R.K. (eds) Handbook of Modern Item Response Theory. Springer, New York, NY

66.

Diviani, N., van den Putte, B., Meppelink, C.S., van Weert, J.C.: Exploring the role of health literacy in the evaluation of online health information: insights from a mixed-methods study. Patient Educ. Couns. 99(6), 1017–1025 (2016). https://doi.org/10.1016/j.pec.2016.01.007 CrossRefPubMed

67.

Nguyen, J., Moorhouse, M., Curbow, B., Christie, J., Walsh-Childers, K., Islam, S.: Construct validity of the ehealth literacy scale (eHEALS) among two adult populations: a rasch analysis. JMIR Public Health Surveill. 2(1), e24 (2016). https://doi.org/10.2196/publichealth.4967 CrossRefPubMedPubMedCentral

68.

Jiang, S., Wang, C., Weiss, D.J.: Sample size requirements for estimation of item parameters in the multidimensional graded response model. Front. Psychol. 7, 109 (2016). https://doi.org/10.3389/fpsyg.2016.00109 CrossRefPubMedPubMedCentral

69.

Noblin, A.M., Wan, T.H.T., Fottler, M.: The impact of health literacy on a patient’s decision to adopt a personal health record. Perspect. Health Inf Manag. 9(Fall), 1e (2012)PubMedCentral

70.

Merritt, K., Smith, K., Di Renzo Jr, J.: An investigation of self-reported computer literacy: is it reliable. Issues Inf Syst. 6(1), 289–295 (2005)

71.

Hevey, D., Ml, Smith, McGee, H.M.: Self-efficacy and health behaviour: a review. Ir. J. Psychol. 19(2-3), 248–273 (1998). https://doi.org/10.1080/03033910.1998.10558189 CrossRef

72.

Hungarian Central Statistical Office, K.: Population census (2011)

Title: Psychometric properties of the Hungarian version of the eHealth Literacy Scale
Authors: Zsombor Zrubka
Ottó Hajdu
Fanni Rencz
Petra Baji
László Gulácsi
Márta Péntek
Publication date: 01-06-2019
Publisher: Springer Berlin Heidelberg
Published in: The European Journal of Health Economics / Issue Special Issue 1/2019
Print ISSN: 1618-7598
Electronic ISSN: 1618-7601
DOI: https://doi.org/10.1007/s10198-019-01062-1

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Psychometric properties of the Hungarian version of the eHealth Literacy Scale

Abstract

Background

Methods

Results

Conclusions

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Special Issue 1/2019

Validity and reliability of the 9-item Shared Decision Making Questionnaire (SDM-Q-9) in a national survey in Hungary

EQ-5D studies in nervous system diseases in eight Central and East European countries: a systematic literature review

Subjective expectations regarding ageing: a cross-sectional online population survey in Hungary

Patient-reported outcomes: opportunities and challenges in Central Europe

Patient experiences with outpatient care in Hungary: results of an online population survey

Determinants of the acceptability of health problems in different ages: exploring a new application of the EQ VAS