Skip to main content
Top
Published in: BMC Public Health 1/2024

Open Access 01-12-2024 | Research

Measuring General Health Literacy in Chinese adults: validation of the HLS19-Q12 instrument

Authors: Rongmei Liu, Qiuping Zhao, Mingyang Yu, Hui Chen, Xiaomo Yang, Shuaibin Liu, Orkan Okan, Xinghan Chen, Yuhan Xing, Shuaijun Guo

Published in: BMC Public Health | Issue 1/2024

Login to get access

Abstract

Background

Health literacy measurement lays a solid foundation to identify associations with health outcomes and monitor population health literacy levels over time. In mainland China, most existing health literacy instruments are either knowledge-based or practice-based, making health literacy results incomparable between China and other countries. This study aimed to examine the reliability and validity of the 12-item Health Literacy Population Survey (HLS19-Q12) in a general population of Chinese adults.

Methods

A cross-sectional study was conducted to recruit primary carers of students from 11 schools in Zhengzhou, Henan Province, using convenience cluster sampling. Participants completed an online self-administered survey that collected information on key sociodemographics, health literacy (HLS19-Q12 and a comparison tool: Health Literacy Questionnaire (HLQ)), and health-related outcomes. Using the COnsensus-based Standards for the selection of health status Measurement Instruments (COSMIN) checklist as a guideline, we tested internal consistency, test-retest reliability, content validity, structural validity, concurrent predictive validity, and convergent validity of the HLS19-Q12.

Results

Overall, 14,184 participants completed the full survey. The HLS19-Q12 showed excellent internal consistency (Cronbach’s α = 0.93), moderate test-retest reliability (intra-class correlation coefficient = 0.54), satisfactory content validity (based on the 12-matrix health literacy model), and strong structural validity (comparative fit index = 0.94, Tucker and Lewis’s index of fit = 0.93, root mean square error of approximation = 0.095). Concurrent predictive validity results showed health literacy was associated with both health determinants and health-related outcomes. The HLS19-Q12 had weak to strong correlations (coefficients = 0.24 to 0.42) with the nine scales of the HLQ. Respondents had an average score of 81.6 (± 23.0) when using the HLS19-Q12, with 35.0% and 7.5% having problematic and inadequate levels of health literacy, respectively.

Conclusions

The HLS19-Q12 is a reliable and valid instrument to measure health literacy in our sample. Further validation is needed with a more nationally representative sample of Chinese adults. The HLS19-Q12 could be used as a comprehensive, skills-based, and easy-to-administer health literacy assessment tool integrated into population surveys and intervention evaluations.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bitzer EM, Schwendemann HE. The significance of health literacy for public health and health promotion. New Approaches Health Literacy: Link Different Perspect 2021:83–97. Bitzer EM, Schwendemann HE. The significance of health literacy for public health and health promotion. New Approaches Health Literacy: Link Different Perspect 2021:83–97.
2.
go back to reference Sørensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, Brand H. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health. 2012;12:80.CrossRefPubMedPubMedCentral Sørensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, Brand H. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health. 2012;12:80.CrossRefPubMedPubMedCentral
3.
go back to reference Guo S, Davis E, Yu X, Naccarella L, Armstrong R, Abel T, Browne G, Shi Y. Measuring functional, interactive and critical health literacy of Chinese secondary school students: reliable, valid and feasible? Glob Health Promot. 2018;25(4):6–14.CrossRefPubMed Guo S, Davis E, Yu X, Naccarella L, Armstrong R, Abel T, Browne G, Shi Y. Measuring functional, interactive and critical health literacy of Chinese secondary school students: reliable, valid and feasible? Glob Health Promot. 2018;25(4):6–14.CrossRefPubMed
4.
go back to reference Nutbeam D, Lloyd JE. Understanding and responding to Health Literacy as a Social Determinant of Health. Annu Rev Public Health. 2021;42(1):159–73.CrossRefPubMed Nutbeam D, Lloyd JE. Understanding and responding to Health Literacy as a Social Determinant of Health. Annu Rev Public Health. 2021;42(1):159–73.CrossRefPubMed
5.
go back to reference Yusoff HAM, Hamzah MR, Manaf ARA, Ismail A, Ahmad Y, Hussin H. The influence of health literacy on health outcomes: a systematic literature review perspective. In: 2021: AIP Publishing. Yusoff HAM, Hamzah MR, Manaf ARA, Ismail A, Ahmad Y, Hussin H. The influence of health literacy on health outcomes: a systematic literature review perspective. In: 2021: AIP Publishing.
6.
go back to reference Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med. 2011;155(2):97–107.CrossRefPubMed Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med. 2011;155(2):97–107.CrossRefPubMed
7.
go back to reference Australian Commission on Safety and Quality in Health Care: National Statement on Health Literacy. In: Sydney NSW, editor. Taking action to improve safety and quality. Australian Commission on Safety and Quality in Health Care; 2014. Australian Commission on Safety and Quality in Health Care: National Statement on Health Literacy. In: Sydney NSW, editor. Taking action to improve safety and quality. Australian Commission on Safety and Quality in Health Care; 2014.
9.
go back to reference Dietscher C, Pelikan J, Bobek J, Nowak P, World Health O. The Action Network on Measuring Population and Organizational Health Literacy (M-POHL): a network under the umbrella of the WHO European Health Information Initiative (EHII). Public Health Panorama. 2019;5(01):65–71. Dietscher C, Pelikan J, Bobek J, Nowak P, World Health O. The Action Network on Measuring Population and Organizational Health Literacy (M-POHL): a network under the umbrella of the WHO European Health Information Initiative (EHII). Public Health Panorama. 2019;5(01):65–71.
10.
go back to reference Dodson S, Good S, Osborne R. Health literacy toolkit for low-and middle-income countries: a series of information sheets to empower communities and strengthen health systems. In. New Delhi: World Health Organization, Regional Office for South-East Asia; 2015. Dodson S, Good S, Osborne R. Health literacy toolkit for low-and middle-income countries: a series of information sheets to empower communities and strengthen health systems. In. New Delhi: World Health Organization, Regional Office for South-East Asia; 2015.
12.
go back to reference Sørensen K, Pelikan JM, Röthlin F, Ganahl K, Slonska Z, Doyle G, Fullam J, Kondilis B, Agrafiotis D, Uiters E. Health literacy in Europe: comparative results of the European health literacy survey (HLS-EU). Eur J Pub Health. 2015;25(6):1053–8.CrossRef Sørensen K, Pelikan JM, Röthlin F, Ganahl K, Slonska Z, Doyle G, Fullam J, Kondilis B, Agrafiotis D, Uiters E. Health literacy in Europe: comparative results of the European health literacy survey (HLS-EU). Eur J Pub Health. 2015;25(6):1053–8.CrossRef
13.
go back to reference Mialhe FL, Moraes KL, Bado FMR, Brasil VV, Sampaio HADC, Rebustini F. Psychometric properties of the adapted instrument European Health Literacy Survey Questionnaire short-short form. Rev Latinoam Enferm 2021, 29. Mialhe FL, Moraes KL, Bado FMR, Brasil VV, Sampaio HADC, Rebustini F. Psychometric properties of the adapted instrument European Health Literacy Survey Questionnaire short-short form. Rev Latinoam Enferm 2021, 29.
14.
go back to reference Mekhail KT, Burström B, Marttila A, Wångdahl J, Lindberg L. Psychometric qualities of the HLS-EU-Q16 instrument for parental health literacy in Swedish multicultural settings. BMC Public Health. 2022;22(1):293.CrossRefPubMedPubMedCentral Mekhail KT, Burström B, Marttila A, Wångdahl J, Lindberg L. Psychometric qualities of the HLS-EU-Q16 instrument for parental health literacy in Swedish multicultural settings. BMC Public Health. 2022;22(1):293.CrossRefPubMedPubMedCentral
17.
go back to reference Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the health literacy questionnaire (HLQ). BMC Public Health. 2013;13:658.CrossRefPubMedPubMedCentral Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the health literacy questionnaire (HLQ). BMC Public Health. 2013;13:658.CrossRefPubMedPubMedCentral
19.
go back to reference Okan O, Lopes E, Bollweg TM, Bröder J, Messer M, Bruland D, Bond E, Carvalho GS, Sørensen K, Saboga-Nunes LJBPH. Generic health literacy measurement instruments for children and adolescents: a systematic review of the literature. BMC Public Health. 2018;18(1):166.CrossRefPubMedPubMedCentral Okan O, Lopes E, Bollweg TM, Bröder J, Messer M, Bruland D, Bond E, Carvalho GS, Sørensen K, Saboga-Nunes LJBPH. Generic health literacy measurement instruments for children and adolescents: a systematic review of the literature. BMC Public Health. 2018;18(1):166.CrossRefPubMedPubMedCentral
20.
go back to reference Haun JN, Valerio MA, McCormack LA, Sørensen K, Paasche-Orlow MK. Health literacy measurement: an inventory and descriptive summary of 51 instruments. J Health Commun. 2014;19(sup2):302–33.CrossRefPubMed Haun JN, Valerio MA, McCormack LA, Sørensen K, Paasche-Orlow MK. Health literacy measurement: an inventory and descriptive summary of 51 instruments. J Health Commun. 2014;19(sup2):302–33.CrossRefPubMed
21.
go back to reference Guo S, Armstrong R, Waters E, Sathish T, Alif SM, Browne GR, Yu X. Quality of health literacy instruments used in children and adolescents: a systematic review. BMJ Open. 2018;8(6):e020080.CrossRefPubMedPubMedCentral Guo S, Armstrong R, Waters E, Sathish T, Alif SM, Browne GR, Yu X. Quality of health literacy instruments used in children and adolescents: a systematic review. BMJ Open. 2018;8(6):e020080.CrossRefPubMedPubMedCentral
22.
go back to reference Pelikan JM, Link T, Straßmayr C, Waldherr K, Alfers T, Bøggild H, Griebler R, Lopatina M, Mikšová D, Nielsen MG et al. Measuring Comprehensive, General Health Literacy in the General Adult Population: the Development and Validation of the HLS(19)-Q12 instrument in Seventeen Countries. Int J Environ Res Public Health 2022, 19(21). Pelikan JM, Link T, Straßmayr C, Waldherr K, Alfers T, Bøggild H, Griebler R, Lopatina M, Mikšová D, Nielsen MG et al. Measuring Comprehensive, General Health Literacy in the General Adult Population: the Development and Validation of the HLS(19)-Q12 instrument in Seventeen Countries. Int J Environ Res Public Health 2022, 19(21).
23.
go back to reference Lopatina M, Berens E-M, Klinger J, Levin-Zamir D, Kostareva U, Aringazina A, Drapkina O, Pelikan JM. Adaptation of the health literacy Survey Questionnaire (HLS19-Q) for russian-speaking populations—international collaboration across Germany, Israel, Kazakhstan, Russia, and the USA. Int J Environ Res Public Health. 2022;19(6):3572.CrossRefPubMedPubMedCentral Lopatina M, Berens E-M, Klinger J, Levin-Zamir D, Kostareva U, Aringazina A, Drapkina O, Pelikan JM. Adaptation of the health literacy Survey Questionnaire (HLS19-Q) for russian-speaking populations—international collaboration across Germany, Israel, Kazakhstan, Russia, and the USA. Int J Environ Res Public Health. 2022;19(6):3572.CrossRefPubMedPubMedCentral
24.
go back to reference Zhang L, Ding D, Fethney J, Neubeck L, Gallagher R. Tools to measure health literacy among Chinese speakers: a systematic review. Patient Educ Couns. 2020;103(5):888–97.CrossRefPubMed Zhang L, Ding D, Fethney J, Neubeck L, Gallagher R. Tools to measure health literacy among Chinese speakers: a systematic review. Patient Educ Couns. 2020;103(5):888–97.CrossRefPubMed
25.
go back to reference Huang Y, Ruan T, Yi Q, Wang T, Guo Z. The health literacy questionnaire among the aged in Changsha, China: confirmatory factor analysis. BMC Public Health. 2019;19(1):1220.CrossRefPubMedPubMedCentral Huang Y, Ruan T, Yi Q, Wang T, Guo Z. The health literacy questionnaire among the aged in Changsha, China: confirmatory factor analysis. BMC Public Health. 2019;19(1):1220.CrossRefPubMedPubMedCentral
26.
go back to reference Mantwill S, Schulz PJ. Health literacy in Mainland China: validation of a functional health literacy test in simplified Chinese. Health Promot Int. 2016;31(4):742–8.PubMed Mantwill S, Schulz PJ. Health literacy in Mainland China: validation of a functional health literacy test in simplified Chinese. Health Promot Int. 2016;31(4):742–8.PubMed
27.
go back to reference Sun X, Chen J, Shi Y, Zeng Q, Wei N, Xie R, Chang C, Du W. Measuring health literacy regarding infectious respiratory diseases: a new skills-based instrument. PLoS ONE. 2013;8(5):e64153.CrossRefPubMedPubMedCentral Sun X, Chen J, Shi Y, Zeng Q, Wei N, Xie R, Chang C, Du W. Measuring health literacy regarding infectious respiratory diseases: a new skills-based instrument. PLoS ONE. 2013;8(5):e64153.CrossRefPubMedPubMedCentral
28.
go back to reference Chang L-C, Chen Y-C, Liao L-L, Wu FL, Hsieh P-L, Chen H-J. Validation of the instrument of health literacy competencies for chinese-speaking health professionals. PLoS ONE. 2017;12(3):e0172859.CrossRefPubMedPubMedCentral Chang L-C, Chen Y-C, Liao L-L, Wu FL, Hsieh P-L, Chen H-J. Validation of the instrument of health literacy competencies for chinese-speaking health professionals. PLoS ONE. 2017;12(3):e0172859.CrossRefPubMedPubMedCentral
29.
go back to reference Charter RA. Sample size requirements for precise estimates of reliability, generalizability, and validity coefficients. J Clin Exp Neuropsychol. 1999;21(4):559–66.CrossRefPubMed Charter RA. Sample size requirements for precise estimates of reliability, generalizability, and validity coefficients. J Clin Exp Neuropsychol. 1999;21(4):559–66.CrossRefPubMed
30.
go back to reference Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The strengthening the reporting of Observational studies in Epidemiology [STROBE] statement: guidelines for reporting observational studies. Lancet. 2007;370(9596):1453–7.CrossRef Von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The strengthening the reporting of Observational studies in Epidemiology [STROBE] statement: guidelines for reporting observational studies. Lancet. 2007;370(9596):1453–7.CrossRef
31.
go back to reference Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, Bouter LM, De Vet HC. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10:22.CrossRefPubMedPubMedCentral Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, Bouter LM, De Vet HC. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10:22.CrossRefPubMedPubMedCentral
32.
go back to reference Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186–91.CrossRefPubMed Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186–91.CrossRefPubMed
33.
go back to reference Haddock CK, Poston WS, Pyle SA, Klesges RC, Vander Weg MW, Peterson A, Debon M. The validity of self-rated health as a measure of health status among young military personnel: evidence from a cross-sectional survey. Health Qual Life Outcomes. 2006;4:57.CrossRefPubMedPubMedCentral Haddock CK, Poston WS, Pyle SA, Klesges RC, Vander Weg MW, Peterson A, Debon M. The validity of self-rated health as a measure of health status among young military personnel: evidence from a cross-sectional survey. Health Qual Life Outcomes. 2006;4:57.CrossRefPubMedPubMedCentral
34.
go back to reference Guo S, Naccarella L, Yu X, Armstrong R, Browne G, Shi Y, Davis E. Health literacy and its mediating role in predicting health behaviors among Chinese secondary students. Asia Pac J Public Health 2020:1010539520980926. Guo S, Naccarella L, Yu X, Armstrong R, Browne G, Shi Y, Davis E. Health literacy and its mediating role in predicting health behaviors among Chinese secondary students. Asia Pac J Public Health 2020:1010539520980926.
35.
go back to reference Guo S. Understanding and measuring health literacy among secondary students in Beijing and Melbourne. PhD thesis Melbourne, Australia: The University of Melbourne; 2018. Guo S. Understanding and measuring health literacy among secondary students in Beijing and Melbourne. PhD thesis Melbourne, Australia: The University of Melbourne; 2018.
36.
go back to reference StataCorp. Stata Statistical Software: Release 18. College Station, TX: StataCorp LLC; 2023. StataCorp. Stata Statistical Software: Release 18. College Station, TX: StataCorp LLC; 2023.
37.
go back to reference Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.CrossRefPubMed Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.CrossRefPubMed
38.
go back to reference Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63.CrossRefPubMedPubMedCentral Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63.CrossRefPubMedPubMedCentral
39.
go back to reference Barber MN, Staples M, Osborne RH, Clerehan R, Elder C, Buchbinder R. Up to a quarter of the Australian population may have suboptimal health literacy depending upon the measurement tool: results from a population-based survey. Health Promot Int. 2009;24(3):252–61.CrossRefPubMed Barber MN, Staples M, Osborne RH, Clerehan R, Elder C, Buchbinder R. Up to a quarter of the Australian population may have suboptimal health literacy depending upon the measurement tool: results from a population-based survey. Health Promot Int. 2009;24(3):252–61.CrossRefPubMed
41.
go back to reference White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med. 2011;30(4):377–99.CrossRefPubMed White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med. 2011;30(4):377–99.CrossRefPubMed
42.
go back to reference Kostareva U, Albright CL, Berens E-M, Klinger J, Ivanov LL, Guttersrud Ø, Liu M, Sentell TL. Health literacy in former Soviet Union immigrants in the US: a mixed methods study. Appl Nurs Res. 2022;67:151598.CrossRefPubMed Kostareva U, Albright CL, Berens E-M, Klinger J, Ivanov LL, Guttersrud Ø, Liu M, Sentell TL. Health literacy in former Soviet Union immigrants in the US: a mixed methods study. Appl Nurs Res. 2022;67:151598.CrossRefPubMed
43.
go back to reference Fleary SA, Joseph P, Pappagianopoulos JE. Adolescent health literacy and health behaviors: a systematic review. J Adolesc. 2018;62:116–27.CrossRefPubMed Fleary SA, Joseph P, Pappagianopoulos JE. Adolescent health literacy and health behaviors: a systematic review. J Adolesc. 2018;62:116–27.CrossRefPubMed
44.
go back to reference Vandenbosch J, Van den Broucke S, Vancorenland S, Avalosse H, Verniest R, Callens M. Health literacy and the use of healthcare services in Belgium. J Epidemiol Community Health. 2016;70(10):1032–8.CrossRefPubMed Vandenbosch J, Van den Broucke S, Vancorenland S, Avalosse H, Verniest R, Callens M. Health literacy and the use of healthcare services in Belgium. J Epidemiol Community Health. 2016;70(10):1032–8.CrossRefPubMed
45.
go back to reference Lee S-YD, Tsai T-I, Tsai Y-W. Accuracy in self-reported health literacy screening: a difference between men and women in Taiwan. BMJ Open. 2013;3(11):e002928.CrossRefPubMedPubMedCentral Lee S-YD, Tsai T-I, Tsai Y-W. Accuracy in self-reported health literacy screening: a difference between men and women in Taiwan. BMJ Open. 2013;3(11):e002928.CrossRefPubMedPubMedCentral
Metadata
Title
Measuring General Health Literacy in Chinese adults: validation of the HLS19-Q12 instrument
Authors
Rongmei Liu
Qiuping Zhao
Mingyang Yu
Hui Chen
Xiaomo Yang
Shuaibin Liu
Orkan Okan
Xinghan Chen
Yuhan Xing
Shuaijun Guo
Publication date
01-12-2024
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2024
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-024-17977-1

Other articles of this Issue 1/2024

BMC Public Health 1/2024 Go to the issue