Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on medication adherence

LIVE: Thursday 27th June 2024, 18:00-19:30 (CEST)
Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2016

Open Access 01-12-2016 | Research article

Methodological review: quality of randomized controlled trials in health literacy

Authors: Julii Brainard, Stephanie Howard Wilsher, Charlotte Salter, Yoon Kong Loke

Published in: BMC Health Services Research | Issue 1/2016

Login to get access

Abstract

Background

The growing move towards patient-centred care has led to substantial research into improving the health literacy skills of patients and members of the public. Hence, there is a pressing need to assess the methodology used in contemporary randomized controlled trials (RCTs) of interventions directed at health literacy, in particular the quality (risk of bias), and the types of outcomes reported.

Methods

We conducted a systematic database search for RCTs involving interventions directed at health literacy in adults, published from 2009 to 2014. The Cochrane Risk of Bias tool was used to assess quality of RCT implementation. We also checked the sample size calculation for primary outcomes. Reported evidence of efficacy (statistical significance) was extracted for intervention outcomes in any of three domains of effect: knowledge, behaviour, health status. Demographics of intervention participants were also extracted, including socioeconomic status.

Results

We found areas of methodological strength (good randomization and allocation concealment), but areas of weakness regarding blinding of participants, people delivering the intervention and outcomes assessors. Substantial attrition (losses by monitoring time point) was seen in a third of RCTs, potentially leading to insufficient power to obtain precise estimates of intervention effect on primary outcomes. Most RCTs showed that the health literacy interventions had some beneficial effect on knowledge outcomes, but this was typically for less than 3 months after intervention end. There were far fewer reports of significant improvements in substantive patient-oriented outcomes, such as beneficial effects on behavioural change or health (clinical) status. Most RCTs featured participants from vulnerable populations.

Conclusions

Our evaluation shows that health literacy trial design, conduct and reporting could be considerably improved, particularly by reducing attrition and obtaining longer follow-up. More meaningful RCTs would also result if health literacy trials were designed with public and patient involvement to focus on clinically important patient-oriented outcomes, rather than just knowledge, behaviour or skills in isolation.
Appendix
Available only for authorised users
Literature
1.
Kindig DA, Panzer AM, Nielsen-Bohlman L. Health Literacy: A Prescription to End Confusion. Washington D.C.: National Academies Press; 2004.
2.
Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Viera A, Crotty K, Holland A, Brasure M, Lohr KN, Harden E, et al. Health literacy interventions and outcomes: an updated systematic review. Evid Rep Technol Assess. 2011;199:1–941.
3.
4.
Logan RA, Wong WF, Villaire M, Daus G, Parnell TA, Willis E, Paasche-Orlow MK. Health literacy: a necessary element for achieving health equity. 2015.
5.
Paasche‐Orlow MK, Schillinger D, Greene SM, Wagner EH. How health care systems can begin to address the challenge of limited literacy. J Gen Intern Med. 2006;21(8):884–7.CrossRefPubMedPubMedCentral
6.
Edwards A, Elwyn G. Shared decision-making in health care: Achieving evidence-based patient choice. Oxford University Press; 2009.
7.
Zeni MB. Systematic review of health literacy in Cochrane database studies on paediatric asthma educational interventions: searching beyond rigorous design. Int J Evid Based Healthc. 2012;10(1):3–8.CrossRefPubMed
8.
Australian Commission on Safety and Quality in Health Care. Health Literacy: Taking action to improve safety and quality. Sydney NSW: Commonwealth of Australia. 2014.
9.
Heijmans M, Uiters E, Rose T, Hofstede J, Deville W, van der Heide I, Boshuisen H, Rademaker J. Study on sound evidence for a better understanding of health literacy in the European Union. Brussels: European Commission. 2015.
10.
Health UDo, Services H, Prevention OoD, Promotion H. National action plan to improve health literacy. Washington, DC: Department of Health and Human Services; 2010.
11.
12.
Rootman I, Gordon-El-Bihbety D. A vision for a health literate Canada. Ottawa: Canadian Public Health Association; 2008.
13.
Geboers B, Brainard JS, Loke YK, Jansen CJ, Salter C, Reijneveld SA, de Winter AF. The association of health literacy with adherence in older adults, and its role in interventions: a systematic meta-review. BMC Public Health. 2015;15(1):1.CrossRef
14.
Loke YK, Hinz I, Wang X, Salter C. Systematic review of consistency between adherence to cardiovascular or diabetes medication and health literacy in older adults. Ann Pharmacother. 2012;46(6):863–72.CrossRefPubMed
15.
Manafo E, Wong S. Health literacy programs for older adults: A systematic literature review. Health Educ Res. 2012;27(6):947–960.
16.
17.
Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, Savović J, Schulz KF, Weeks L, Sterne JA. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.CrossRefPubMedPubMedCentral
18.
Dattalo M, Giovannetti ER, Scharfstein D, Boult C, Wegener S, Wolff JL, Leff B, Frick KD, Reider L, Frey K. Who Participates in Chronic Disease Self-Management (CDSM) programs? Differences between Participants and non-participants in a population of multi-morbid older adults. Med Care. 2012;50(12):1071.CrossRefPubMedPubMedCentral
19.
Hussain‐Gambles M, Atkin K, Leese B. Why ethnic minority groups are under‐represented in clinical trials: a review of the literature. Health Soc Care Community. 2004;12(5):382–8.CrossRefPubMed
20.
McKibbon KA, Wilczynski NL, Haynes RB. Retrieving randomized controlled trials from medline: a comparison of 38 published search filters. Health Inf Libr J. 2009;26(3):187–202.CrossRef
21.
Dwan K, Altman DG, Cresswell L, Blundell M, Gamble CL, Williamson PR. Comparison of protocols and registry entries to published reports for randomised controlled trials. The Cochrane Library; 2011.
22.
DeWalt DA, Hink A. Health literacy and child health outcomes: a systematic review of the literature. Pediatrics. 2009;124(Supplement 3):S265–74.CrossRefPubMed
23.
World Health Organization. Adherence to long-term therapies - evidence for action. 2003.
24.
Jibaja-Weiss ML, Volk RJ, Granchi TS, Neff NE, Robinson EK, Spann SJ, Aoki N, Friedman LC, Beck JR. Entertainment education for breast cancer surgery decisions: a randomized trial among patients with low health literacy. Patient Educ Couns. 2011;84(1):41–8.CrossRefPubMed
25.
Smith MY, Wallace LS. Reducing drug self-injection errors: a randomized trial comparing a "standard" versus "plain language" version of patient instructions for use. Res Social Adm Pharm. 2013;9(5):621–5.CrossRefPubMed
26.
Australian Bureau of Statistics. A Picture of the Nation. 2006.
27.
Paasche‐Orlow MK, Parker RM, Gazmararian JA, Nielsen‐Bohlman LT, Rudd RR. The prevalence of limited health literacy. J Gen Intern Med. 2005;20(2):175–84.CrossRefPubMedPubMedCentral
28.
Eckman MH, Wise R, Leonard AC, Dixon E, Burrows C, Khan F, Warm E. Impact of health literacy on outcomes and effectiveness of an educational intervention in patients with chronic diseases. Patient Educ Couns. 2012;87(2):143–51.CrossRefPubMed
29.
Otilingam PG, Gatz M, Tello E, Escobar AJ, Goldstein A, Torres M, Varma R. Buenos Habitos Alimenticios para Una Buena Salud: Evaluation of a Nutrition Education Program to Improve Heart Health and Brain Health in Latinas. J Aging Health. 2015;27(1):177–92.CrossRefPubMed
30.
Zite NB, Wallace LS. Use of a low-literacy informed consent form to improve women's understanding of tubal sterilization: a randomized controlled trial. Obstet Gynecol. 2011;117(5):1160–6.CrossRefPubMed
31.
Kalichman SC, Cherry C, Kalichman MO, Amaral C, White D, Grebler T. Randomized clinical trial of HIV treatment adherence counseling interventions for people living with HIV and limited health literacy. J Acquir Immune Defic Syndr. 2013;63(1):42.CrossRefPubMedPubMedCentral
32.
Reavley NJ, McCann TV, Cvetkovski S, Jorm AF. A multifaceted intervention to improve mental health literacy in students of a multicampus university: a cluster randomised trial. Soc Psychiatry Psychiatr Epidemiol. 2014;49(10):1655–66.CrossRefPubMed
33.
Unger JB, Cabassa LJ, Molina GB, Contreras S, Baron M. Evaluation of a fotonovela to increase depression knowledge and reduce stigma among Hispanic adults. J Immigr Minor Health. 2013;15(2):398–406.CrossRefPubMedPubMedCentral
34.
Giuse NB, Koonce TY, Storrow AB, Kusnoor SV, Ye F. Using health literacy and learning style preferences to optimize the delivery of health information. J Health Commun. 2012;17 Suppl 3:122–40.CrossRefPubMed
35.
McCarthy DM, Davis TC, King JP, Mullen RJ, Bailey SC, Serper M, Jacobson KL, Parker RM, Wolf MS. Take-Wait-Stop: a patient-centered strategy for writing PRN medication instructions. J Health Commun. 2013;18 Suppl 1:40–8.CrossRefPubMedPubMedCentral
36.
Crowley MJ, Powers BJ, Olsen MK, Grubber JM, Koropchak C, Rose CM, Gentry P, Bowlby L, Trujillo G, Maciejewski ML, et al. The Cholesterol, Hypertension, And Glucose Education (CHANGE) study: results from a randomized controlled trial in African Americans with diabetes. Am Heart J. 2013;166(1):179–86.CrossRefPubMed
37.
Duncan M, Vandelanotte C, Kolt GS, Rosenkranz RR, Caperchione CM, George ES, Ding H, Hooker C, Karunanithi M, Maeder AJ, et al. Effectiveness of a web- and mobile phone-based intervention to promote physical activity and healthy eating in middle-aged males: randomized controlled trial of the ManUp study. J Med Internet Res. 2014;16(6):e136.CrossRefPubMedPubMedCentral
38.
Freed E, Long D, Rodriguez T, Franks P, Kravitz RL, Jerant A. The effects of two health information texts on patient recognition memory: a randomized controlled trial. Patient Educ Couns. 2013;92(2):260–5.CrossRefPubMedPubMedCentral
39.
Gulliver A, Griffiths KM, Christensen H, Mackinnon A, Calear AL, Parsons A, Bennett K, Batterham PJ, Stanimirovic R. Internet-based interventions to promote mental health help-seeking in elite athletes: an exploratory randomized controlled trial. J Med Internet Res. 2012;14(3):e69.CrossRefPubMedPubMedCentral
40.
Kiropoulos LA, Griffiths KM, Blashki G. Effects of a multilingual information website intervention on the levels of depression literacy and depression-related stigma in Greek-born and Italian-born immigrants living in Australia: a randomized controlled trial. J Med Internet Res. 2011;13(2):e34.CrossRefPubMedPubMedCentral
41.
Landrey AR, Matlock DD, Andrews L, Bronsert M, Denberg T. Shared decision making in prostate-specific antigen testing: the effect of a mailed patient flyer prior to an annual exam. J Prim Care Community Health. 2013;4(1):67–74.CrossRefPubMed
42.
Bailey SC, Sarkar U, Chen AH, Schillinger D, Wolf MS. Evaluation of language concordant, patient-centered drug label instructions. J Gen Intern Med. 2012;27(12):1707–13.CrossRefPubMedPubMedCentral
43.
Calderon JL, Shaheen M, Hays RD, Fleming ES, Norris KC, Baker RS. Improving diabetes health literacy by animation. Diabetes Educ. 2014;40(3):361–72.CrossRefPubMed
44.
Taylor-Rodgers E, Batterham PJ. Evaluation of an online psychoeducation intervention to promote mental health help seeking attitudes and intentions among young adults: Randomised controlled trial. J Affect Disord. 2014;168:65–71.CrossRefPubMed
45.
Rosal MC, Ockene IS, Restrepo A, White MJ, Borg A, Olendzki B, Scavron J, Candib L, Welch G, Reed G. Randomized trial of a literacy-sensitive, culturally tailored diabetes self-management intervention for low-income latinos: latinos en control. Diabetes Care. 2011;34(4):838–44.CrossRefPubMedPubMedCentral
46.
Horvath KJ, Trudeau SA, Rudolph JL, Trudeau PA, Duffy ME, Berlowitz D. Clinical trial of a home safety toolkit for Alzheimer's disease. Int J Alzheimers Dis. 2013;2013:913606.PubMedPubMedCentral
47.
Bickmore TW, Silliman RA, Nelson K, Cheng DM, Winter M, Henault L, Paasche-Orlow MK. A randomized controlled trial of an automated exercise coach for older adults. J Am Geriatr Soc. 2013;61(10):1676–83.CrossRefPubMed
48.
Walker JG, Mackinnon AJ, Batterham P, Jorm AF, Hickie I, McCarthy A, Fenech M, Christensen H. Mental health literacy, folic acid and vitamin B12, and physical activity for the prevention of depression in older adults: randomised controlled trial. Br J Psychiatry. 2010;197(1):45–54.CrossRefPubMed
49.
Caldwell PH, Hamilton S, Tan A, Craig JC. Strategies for increasing recruitment to randomised controlled trials: systematic review. PLoS Med. 2010;7(11):1441.CrossRef
50.
51.
52.
Salter C, Brainard J, McDaid L, Loke Y. Challenges and opportunities: what can we learn from patients living with chronic musculoskeletal conditions, health professionals and carers about the concept of health literacy using qualitative methods of inquiry? PLoS One. 2014;9(11):e112041.CrossRefPubMedPubMedCentral
53.
Murdoch J, Varley A, Lattimer V, Campbell J, Salter C. Designing process evaluations for cluster randomised controlled trials: definitions of context and implications for data collection. 2014.
54.
Murdoch J, Salter C, Cross J, Smith J, Poland F. Resisting medications: moral discourses and performances in illness narratives. Sociol Health Illn. 2013;35(3):449–64.CrossRefPubMed
55.
56.
Song F, Hooper L, Loke YK. Publication bias: what is it? How do we measure it? How do we avoid it? Open Access J Clin Trials. 2013;5:51–81.
57.
Koletsi D, Spineli LM, Lempesi E, Pandis N. Risk of bias and magnitude of effect in orthodontic randomized controlled trials: a meta-epidemiological review. Eur J Orthod. 2015;38(3):308–312.CrossRefPubMed
58.
Gargon E, Williamson PR, Altman DG, Blazeby JM, Clarke M. The COMET Initiative database: progress and activities from 2011 to 2013. Trials. 2014;15(1):279.CrossRefPubMedPubMedCentral
59.
60.
Wolf MS, Bailey SC, Serper M, Smith M, Davis TC, Russell AL, Manzoor BS, Belter L, Parker RM, Lambert B. Comparative effectiveness of patient-centered strategies to improve FDA medication guides. Med Care. 2014;52(9):781–9.CrossRefPubMed
61.
Cordasco KM, Asch SM, Bell DS, Guterman JJ, Gross-Schulman S, Ramer L, Elkayam U, Franco I, Leatherwood CL, Mangione CM. A low-literacy medication education tool for safety-net hospital patients. Am J Prev Med. 2009;37(6 Suppl 1):S209–216.CrossRefPubMed
62.
Negarandeh R, Mahmoodi H, Noktehdan H, Heshmat R, Shakibazadeh E. Teach back and pictorial image educational strategies on knowledge about diabetes and medication/dietary adherence among low health literate patients with type 2 diabetes. Prim Care Diabetes. 2013;7(2):111–8.CrossRefPubMed
63.
Rudd RE, Blanch DC, Gall V, Chibnik LB, Wright EA, Reichmann W, Liang MH, Katz JN. A randomized controlled trial of an intervention to reduce low literacy barriers in inflammatory arthritis management. Patient Educ Couns. 2009;75(3):334–9.CrossRefPubMedPubMedCentral
64.
Unk JA, Brasington R. Efficacy study of multimedia rheumatoid arthritis patient education program. J Am Assoc Nurse Pract. 2014;26(7):370–7.PubMed
65.
Galliher JM, Post DM, Weiss BD, Dickinson LM, Manning BK, Staton EW, Brown JB, Hickner JM, Bonham AJ, Ryan BL, et al. Patients' question-asking behavior during primary care visits: a report from the AAFP National Research Network. Ann Fam Med. 2010;8(2):151–9.CrossRefPubMedPubMedCentral
66.
Muir KW, Ventura A, Stinnett SS, Enfiedjian A, Allingham RR, Lee PP. The influence of health literacy level on an educational intervention to improve glaucoma medication adherence. Patient Educ Couns. 2012;87(2):160–4.CrossRefPubMed
67.
Kripalani S, Roumie CL, Dalal AK, Cawthon C, Businger A, Eden SK, Shintani A, Sponsler KC, Harris LJ, Theobald C, et al. Effect of a pharmacist intervention on clinically important medication errors after hospital discharge: a randomized trial. Ann Intern Med. 2012;157(1):1–10.CrossRefPubMedPubMedCentral
68.
Kavin M, Anel-Tiangco RM, Mauger DT, Gabbay RA. Development and pilot of a low-literacy diabetes education book using social marketing techniques. 2010. p. 93–102.
69.
Price-Haywood EG, Harden-Barrios J, Cooper LA. Comparative effectiveness of audit-feedback versus additional physician communication training to improve cancer screening for patients with limited health literacy. J Gen Intern Med. 2014;29(8):1113–21.CrossRefPubMedPubMedCentral
70.
Zoellner J, Cook E, Chen Y, You W, Davy B, Estabrooks P. Mixed methods evaluation of a randomized control pilot trial targeting sugar-sweetened beverage behaviors. Open J Prev Med. 2013;3(1):51–7.CrossRefPubMedPubMedCentral
71.
Brega AG, Pratte KA, Jiang L, Mitchell CM, Stotz SA, Loudhawk-Hedgepeth C, Morse BD, Noe T, Moore KR, Beals J. Impact of targeted health promotion on cardiovascular knowledge among American Indians and Alaska Natives. Health Educ Res. 2013;28(3):437–49.CrossRefPubMedPubMedCentral
72.
Kiser K, Jonas D, Warner Z, Scanlon K, Shilliday BB, DeWalt DA. A randomized controlled trial of a literacy-sensitive self-management intervention for chronic obstructive pulmonary disease patients. J Gen Intern Med. 2012;27(2):190–5.CrossRefPubMed
73.
Goeman D, Jenkins C, Crane M, Paul E, Douglass J. Educational intervention for older people with asthma: a randomised controlled trial. Patient Educ Couns. 2013;93(3):586–95.CrossRefPubMed
74.
Hernandez MY, Organista KC. Entertainment-education? A fotonovela? A new strategy to improve depression literacy and help-seeking behaviors in at-risk immigrant Latinas. Am J Community Psychol. 2013;52(3-4):224–35.CrossRefPubMed
75.
Miller Jr DP, Spangler JG, Case LD, Goff Jr DC, Singh S, Pignone MP. Effectiveness of a web-based colorectal cancer screening patient decision aid: a randomized controlled trial in a mixed-literacy population. Am J Prev Med. 2011;40(6):608–15.CrossRefPubMedPubMedCentral
76.
Jay M, Adams J, Herring SJ, Gillespie C, Ark T, Feldman H, Jones V, Zabar S, Stevens D, Kalet A. A randomized trial of a brief multimedia intervention to improve comprehension of food labels. Prev Med. 2009;48(1):25–31.CrossRefPubMed
77.
Zoellner J, Chen Y, Davy B, You W, Hedrick V, Corsi T, Estabrooks P. Talking health, a pragmatic randomized-controlled health literacy trial targeting sugar-sweetened beverage consumption among adults: rationale, design & methods. Contemp Clin Trials. 2014;37(1):43–57.CrossRefPubMed
Metadata
Title
Methodological review: quality of randomized controlled trials in health literacy
Authors
Julii Brainard
Stephanie Howard Wilsher
Charlotte Salter
Yoon Kong Loke
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2016
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-016-1479-2

Other articles of this Issue 1/2016

BMC Health Services Research 1/2016 Go to the issue

Research article

Economic evaluation of treatments for patients with localized prostate cancer in Europe: a systematic review

Research article

Post-acute pathways among hip fracture patients: a system-level analysis

Research article

The role of primary care providers in patient activation and engagement in self-management: a cross-sectional analysis

Research article

Health worker perspectives on the possible use of intramuscular artesunate for the treatment of severe malaria at lower-level health facilities in settings with poor access to referral facilities in Nigeria: a qualitative study

Research article

Managing Matajoosh: determinants of first Nations’ cancer care decisions

Research article

A quantitative study on factors influencing enrolment of dairy farmers in a community health insurance scheme