Skip to main content
Top
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

The Health Literacy Questionnaire (HLQ) at the patient-clinician interface: a qualitative study of what patients and clinicians mean by their HLQ scores

Authors: Melanie Hawkins, Stephen D Gill, Roy Batterham, Gerald R Elsworth, Richard H Osborne

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

The Health Literacy Questionnaire (HLQ) has nine scales that each measure an aspect of the multidimensional construct of health literacy. All scales have good psychometric properties. However, it is the interpretations of data within contexts that must be proven valid, not just the psychometric properties of a measurement instrument. The purpose of this study was to establish the extent of concordance and discordance between individual patient and clinician interpretations of HLQ data in the context of complex case management.

Methods

Sixteen patients with complex needs completed the HLQ and were interviewed to discuss the reasons for their answers. Also, the clinicians of each of these patients completed the HLQ about their patient, and were interviewed to discuss the reasons for their answers. Thematic analysis of HLQ scores and interview data determined the extent of concordance between patient and clinician HLQ responses, and the reasons for discordance.

Results

Highest concordance (80%) between patient and clinician item-response pairs was seen in Scale 1 and highest discordance (56%) was seen in Scale 6. Four themes were identified to explain discordance: 1) Technical or literal meaning of specific words; 2) Patients’ changing or evolving circumstances; 3) Different expectations and criteria for assigning HLQ scores; and 4) Different perspectives about a patient’s reliance on healthcare providers.

Conclusion

This study shows that the HLQ can act as an adjunct to clinical practice to help clinicians understand a patient’s health literacy challenges and strengths early in a clinical encounter. Importantly, clinicians can use the HLQ to detect differences between their own perspectives about a patient’s health literacy and the patient’s perspective, and to initiate discussion to explore this. Provision of training to better detect these differences may assist clinicians to provide improved care.
The outcomes of this study contribute to the growing body of international validation evidence about the use of the HLQ in different contexts. More specifically, this study has shown that the HLQ has measurement veracity at the patient and clinician level and may support clinicians to understand patients’ health literacy and enable a deeper engagement with healthcare services.
Literature
1.
go back to reference Buchbinder R, Batterham R, Elsworth G, Dionne CE, Irvin E, Osborne RH. A validity-driven approach to the understanding of the personal and societal burden of low back pain: development of a conceptual and measurement model. Arthritis Res Ther. 2011;13(5):R152.CrossRefPubMedPubMedCentral Buchbinder R, Batterham R, Elsworth G, Dionne CE, Irvin E, Osborne RH. A validity-driven approach to the understanding of the personal and societal burden of low back pain: development of a conceptual and measurement model. Arthritis Res Ther. 2011;13(5):R152.CrossRefPubMedPubMedCentral
2.
go back to reference American Educational Research Association. American Psychological Association, Joint Committee on Standards for Educational and Psychological Testing (U.S.), National Council on Measurement in Education. Standards for educational and psychological testing. Washington, DC: American Educational Research Association; 1999. American Educational Research Association. American Psychological Association, Joint Committee on Standards for Educational and Psychological Testing (U.S.), National Council on Measurement in Education. Standards for educational and psychological testing. Washington, DC: American Educational Research Association; 1999.
3.
go back to reference Cronbach LJ. Test Validation. In: Thorndike RL, Angoff WH, Lindquist EF, editors. Educational measurement. Washington: American Council on Education; 1971. p. 483–507. Cronbach LJ. Test Validation. In: Thorndike RL, Angoff WH, Lindquist EF, editors. Educational measurement. Washington: American Council on Education; 1971. p. 483–507.
4.
go back to reference Stenner AJ, Smith III M, Burdick DS. Toward a theory of construct definition. J Educ Meas. 1983;20:305–16.CrossRef Stenner AJ, Smith III M, Burdick DS. Toward a theory of construct definition. J Educ Meas. 1983;20:305–16.CrossRef
5.
go back to reference Pedhazur E, Schmelkin LP. Measurement, design, and analysis: an integrated analysis. Hillsdale: Erlbaum; 1991. Pedhazur E, Schmelkin LP. Measurement, design, and analysis: an integrated analysis. Hillsdale: Erlbaum; 1991.
6.
go back to reference Messick S. Foundations of validity: Meaning and consequences in psychological assessment. ETS Res Rep Ser. 1993;1993(2):i–18. Messick S. Foundations of validity: Meaning and consequences in psychological assessment. ETS Res Rep Ser. 1993;1993(2):i–18.
7.
go back to reference Moss PA. Shifting conceptions of validity in educational measurement: implications for performance assessment. Rev Educ Res. 1992;62(3):229–58.CrossRef Moss PA. Shifting conceptions of validity in educational measurement: implications for performance assessment. Rev Educ Res. 1992;62(3):229–58.CrossRef
8.
go back to reference Kane MT. An argument-based approach to validity. Psychol Bull. 1992;112(3):527.CrossRef Kane MT. An argument-based approach to validity. Psychol Bull. 1992;112(3):527.CrossRef
9.
go back to reference Elsworth GR, Nolte S, Osborne RH. Factor structure and measurement invariance of the health education impact questionnaire: Does the subjectivity of the response perspective threaten the contextual validity of inferences? SAGE Open Med. 2015;3:2050312115585041.CrossRefPubMedPubMedCentral Elsworth GR, Nolte S, Osborne RH. Factor structure and measurement invariance of the health education impact questionnaire: Does the subjectivity of the response perspective threaten the contextual validity of inferences? SAGE Open Med. 2015;3:2050312115585041.CrossRefPubMedPubMedCentral
10.
11.
go back to reference Nunnally J, Bernstein I. Psychometric Theory. 3rd ed. New York: MacGraw-Hill; 1994. Nunnally J, Bernstein I. Psychometric Theory. 3rd ed. New York: MacGraw-Hill; 1994.
12.
go back to reference Adamson J, Gooberman-Hill R, Woolhead G, Donovan J. ‘Questerviews’: using questionnaires in qualitative interviews as a method of integrating qualitative and quantitative health services research. J Health Serv Res Policy. 2004;9(3):139–45.CrossRefPubMed Adamson J, Gooberman-Hill R, Woolhead G, Donovan J. ‘Questerviews’: using questionnaires in qualitative interviews as a method of integrating qualitative and quantitative health services research. J Health Serv Res Policy. 2004;9(3):139–45.CrossRefPubMed
13.
go back to reference Sørensen K, Pelikan JM, Röthlin F, Ganahl K, Slonska Z, Doyle G, et al. Health literacy in Europe: comparative results of the European health literacy survey (HLS-EU). Eur J Public Health. 2015;25:1053. ckv043.CrossRefPubMedPubMedCentral Sørensen K, Pelikan JM, Röthlin F, Ganahl K, Slonska Z, Doyle G, et al. Health literacy in Europe: comparative results of the European health literacy survey (HLS-EU). Eur J Public Health. 2015;25:1053. ckv043.CrossRefPubMedPubMedCentral
14.
go back to reference Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC Public Health. 2013;13:658.CrossRefPubMedPubMedCentral Osborne RH, Batterham RW, Elsworth GR, Hawkins M, Buchbinder R. The grounded psychometric development and initial validation of the Health Literacy Questionnaire (HLQ). BMC Public Health. 2013;13:658.CrossRefPubMedPubMedCentral
16.
go back to reference Sorensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, et al. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health. 2012;12:80.CrossRefPubMedPubMedCentral Sorensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, et al. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health. 2012;12:80.CrossRefPubMedPubMedCentral
17.
go back to reference Nutbeam D. Health promotion glossary. Health Promot Int. 1998;13(4):349–64.CrossRef Nutbeam D. Health promotion glossary. Health Promot Int. 1998;13(4):349–64.CrossRef
18.
go back to reference Maindal HT, Kayser L, Norgaard O, Bo A, Elsworth GR, Osborne RH. Cultural adaptation and validation of the Health Literacy Questionnaire (HLQ): robust nine-dimension Danish language confirmatory factor model. SpringerPlus. 2016;5(1):1232.CrossRefPubMedPubMedCentral Maindal HT, Kayser L, Norgaard O, Bo A, Elsworth GR, Osborne RH. Cultural adaptation and validation of the Health Literacy Questionnaire (HLQ): robust nine-dimension Danish language confirmatory factor model. SpringerPlus. 2016;5(1):1232.CrossRefPubMedPubMedCentral
19.
go back to reference Batterham RW, Buchbinder R, Beauchamp A, Dodson S, Elsworth GR, Osborne RH. The OPtimising HEalth LIterAcy (Ophelia) process: study protocol for using health literacy profiling and community engagement to create and implement health reform. BMC Public Health. 2014;14(1):694.CrossRefPubMedPubMedCentral Batterham RW, Buchbinder R, Beauchamp A, Dodson S, Elsworth GR, Osborne RH. The OPtimising HEalth LIterAcy (Ophelia) process: study protocol for using health literacy profiling and community engagement to create and implement health reform. BMC Public Health. 2014;14(1):694.CrossRefPubMedPubMedCentral
20.
go back to reference Bo A, Friis K, Osborne RH, Maindal HT. National indicators of health literacy: ability to understand health information and to engage actively with healthcare providers-a population-based survey among Danish adults. BMC Public Health. 2014;14(1):1095.CrossRefPubMedPubMedCentral Bo A, Friis K, Osborne RH, Maindal HT. National indicators of health literacy: ability to understand health information and to engage actively with healthcare providers-a population-based survey among Danish adults. BMC Public Health. 2014;14(1):1095.CrossRefPubMedPubMedCentral
21.
go back to reference Livingston PM, Osborne RH, Botti M, Mihalopoulos C, McGuigan S, Heckel L, et al. Efficacy and cost-effectiveness of an outcall program to reduce carer burden and depression among carers of cancer patients [PROTECT]: rationale and design of a randomized controlled trial. BMC Health Serv Res. 2014;14(1):1.CrossRef Livingston PM, Osborne RH, Botti M, Mihalopoulos C, McGuigan S, Heckel L, et al. Efficacy and cost-effectiveness of an outcall program to reduce carer burden and depression among carers of cancer patients [PROTECT]: rationale and design of a randomized controlled trial. BMC Health Serv Res. 2014;14(1):1.CrossRef
22.
go back to reference Faruqi N, Stocks N, Spooner C, el Haddad N, Harris MF. Research protocol: management of obesity in patients with low health literacy in primary health care. BMC Obesity. 2015;2(1):1.CrossRef Faruqi N, Stocks N, Spooner C, el Haddad N, Harris MF. Research protocol: management of obesity in patients with low health literacy in primary health care. BMC Obesity. 2015;2(1):1.CrossRef
23.
go back to reference Elsworth GR, Beauchamp A, Osborne RH. Measuring health literacy in community agencies: a Bayesian study of the factor structure and measurement invariance of the health literacy questionnaire (HLQ). BMC Health Serv Res. 2016;16(1):508.CrossRefPubMedPubMedCentral Elsworth GR, Beauchamp A, Osborne RH. Measuring health literacy in community agencies: a Bayesian study of the factor structure and measurement invariance of the health literacy questionnaire (HLQ). BMC Health Serv Res. 2016;16(1):508.CrossRefPubMedPubMedCentral
24.
go back to reference Beauchamp A, Buchbinder R, Dodson S, Batterham RW, Elsworth GR, McPhee C, et al. Distribution of health literacy strengths and weaknesses across socio-demographic groups: a cross-sectional survey using the Health Literacy Questionnaire (HLQ). BMC Public Health. 2015;15:678.CrossRefPubMedPubMedCentral Beauchamp A, Buchbinder R, Dodson S, Batterham RW, Elsworth GR, McPhee C, et al. Distribution of health literacy strengths and weaknesses across socio-demographic groups: a cross-sectional survey using the Health Literacy Questionnaire (HLQ). BMC Public Health. 2015;15:678.CrossRefPubMedPubMedCentral
25.
go back to reference Green J, Willis K, Hughes E, Small R, Welch N, Gibbs L, et al. Generating best evidence from qualitative research: the role of data analysis. Aust N Z J Public Health. 2007;31(6):545–50.CrossRefPubMed Green J, Willis K, Hughes E, Small R, Welch N, Gibbs L, et al. Generating best evidence from qualitative research: the role of data analysis. Aust N Z J Public Health. 2007;31(6):545–50.CrossRefPubMed
26.
go back to reference Saldaña J. The coding manual for qualitative researchers. London: Sage Publications Ltd; 2015. Saldaña J. The coding manual for qualitative researchers. London: Sage Publications Ltd; 2015.
27.
go back to reference Schwartz CE, Rapkin BD. Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal. Health Qual Life Outcomes. 2004;2:1–11.CrossRef Schwartz CE, Rapkin BD. Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal. Health Qual Life Outcomes. 2004;2:1–11.CrossRef
30.
go back to reference Australian Commission on Safety and Quality in Health Care. Health Literacy: Taking Action to Improve Safety and Quality Sydney: ACSQHC, 2014. Australian Commission on Safety and Quality in Health Care. Health Literacy: Taking Action to Improve Safety and Quality Sydney: ACSQHC, 2014.
31.
go back to reference United Nations Economic Social Council. Health literacy and the Millennium Development Goals: United Nations Economic and Social Council (ECOSOC) regional meeting background paper (abstracted). J Health Commun. 2010;15(S2):211–23.CrossRef United Nations Economic Social Council. Health literacy and the Millennium Development Goals: United Nations Economic and Social Council (ECOSOC) regional meeting background paper (abstracted). J Health Commun. 2010;15(S2):211–23.CrossRef
Metadata
Title
The Health Literacy Questionnaire (HLQ) at the patient-clinician interface: a qualitative study of what patients and clinicians mean by their HLQ scores
Authors
Melanie Hawkins
Stephen D Gill
Roy Batterham
Gerald R Elsworth
Richard H Osborne
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-017-2254-8

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue