Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on sleep in brain health

LIVE: Thursday 2nd May 2024, 18:00-19:30 (CEST)

Quality sleep is essential for health. But what happens to our brains when sleep patterns are disturbed? Join our experts to explore the interplay between sleep disruption and neurological diseases, and the questions that you need to be asking your patients to help you prevent the harmful effects of sleep deprivation.
ADVANCED SEARCH
Log in
Top
Systematic Reviews
Published in: Systematic Reviews 1/2017

Open Access 01-12-2017 | Research

Use of programme theory to understand the differential effects of interventions across socio-economic groups in systematic reviews—a systematic methodology review

Authors: Michelle Maden, Alex Cunliffe, Naoimh McMahon, Andrew Booth, Gina Michelle Carey, Suzy Paisley, Rumona Dickson, Mark Gabbay

Published in: Systematic Reviews | Issue 1/2017

Login to get access

Abstract

Background

Systematic review guidance recommends the use of programme theory to inform considerations of if and how healthcare interventions may work differently across socio-economic status (SES) groups. This study aimed to address the lack of detail on how reviewers operationalise this in practice.

Methods

A methodological systematic review was undertaken to assess if, how and the extent to which systematic reviewers operationalise the guidance on the use of programme theory in considerations of socio-economic inequalities in health. Multiple databases were searched from January 2013 to May 2016. Studies were included if they were systematic reviews assessing the effectiveness of an intervention and included data on SES. Two reviewers independently screened all studies, undertook quality assessment and extracted data. A narrative approach to synthesis was adopted.

Results

A total of 37 systematic reviews were included, 10 of which were explicit in the use of terminology for ‘programme theory’. Twenty-nine studies used programme theory to inform both their a priori assumptions and explain their review findings. Of these, 22 incorporated considerations of both what and how interventions do/do not work in SES groups to both predict and explain their review findings. Thirteen studies acknowledged 24 unique theoretical references to support their assumptions of what or how interventions may have different effects in SES groups. Most reviewers used supplementary evidence to support their considerations of differential effectiveness. The majority of authors outlined a programme theory in the “Introduction” and “Discussion” sections of the review to inform their assumptions or provide explanations of what or how interventions may result in differential effects within or across SES groups. About a third of reviews used programme theory to inform the review analysis and/or synthesis. Few authors used programme theory to inform their inclusion criteria, data extraction or quality assessment. Twenty-one studies tested their a priori programme theory.

Conclusions

The use of programme theory to inform considerations of if, what and how interventions lead to differential effects on health in different SES groups in the systematic review process is not yet widely adopted, is used implicitly, is often fragmented and is not implemented in a systematic way.
Appendix
Available only for authorised users
Literature
1.
Welch V, Petticrew M, Tugwell P, Moher D, O'Neill J, Waters E, White H. PRISMA-Equity 2012 Extension: reporting guidelines for systematic reviews with a focus on health equity. PLoS Med. 2012;9(10):e1001333.CrossRefPubMedPubMedCentral
2.
Tripney J, Roulstone A, Hogrebe N, Vigurs C, Schmidt E, Stewart R: Interventions to improve the labour market situation of adults with physical and/or sensory disabilities in low- and middle-income countries: a systematic review. 2015.
3.
Tugwell P, Petticrew M, Kristjansson E, Welch V, Ueffing E, Waters E, Bonnefoy J, Morgan A, Doohan E, Kelly MP. Assessing equity in systematic reviews: realising the recommendations of the Commission on Social Determinants of Health. BMJ. 2010;341:c4739.CrossRefPubMed
4.
Ueffing E TP, Welch V, Petticrew M, Kristjansson E for the Campbell and Cochrane Equity Methods Group.: Equity checklist for systematic review authors. 2012:Version 2012-2010-2002.
5.
Welch V, Petticrew M, Petkovic J, Moher D, Waters E, White H, Tugwell P. Extending the PRISMA statement to equity-focused systematic reviews (PRISMA-E 2012): explanation and elaboration. J Clin Epidemiol. 2016;70:68–89.CrossRefPubMed
6.
Welch V, Brand K, Kristjansson E, Smylie J, Wells G, Tugwell P. Systematic reviews need to consider applicability to disadvantaged populations: inter-rater agreement for a health equity plausibility algorithm. BMC Med Res Methodol. 2012;12:187.CrossRefPubMedPubMedCentral
7.
MDR M. Health inequalities and evidence synthesis as part of the CLAHRC NWC. In: Position Statement. Liverpool: Evidence Synthesis Theme, CLARHC NWC, University of Liverpool; 2015.
8.
Davies KS. Formulating the evidence based practice question: a review of the frameworks. Evid Based Libr Inf Pract. 2011;6(2).
9.
Anderson LM, Oliver S, Michie S, Rehfuss E, Noyes J, Shemilt I. Investigating complexity in systematic reviews of interventions using a spectrum of methods. J Clin Epidemiol. 2013;66:1223–9.CrossRefPubMed
10.
11.
Funnells SCRP, J. Purposeful program theory: effective use of theories of change and logic models. Jossey-Bass: California; 2011.
12.
Kneale D, Thomas J, Harris K. Developing and optimising the use of logic models in systematic reviews: exploring practice and good practice in the use of programme theory in reviews. PLoS One. 2015;10(11):e0142187.CrossRefPubMedPubMedCentral
13.
Popay J, Sowden A, Petticrew M, Arai L, Rodgers M, Britten N, Roen K, Duffy S.: Guidance on the conduct of narrative synthesis in systematic reviews. A product from the ESRC methods programme. 2006.
14.
Noyes JL, Lewin S: Supplemental guidance on selecting a method of qualitative evidence synthesis, and integrating qualitative evidence with Cochrane intervention reviews. In: Supplementary guidance for inclusion of qualitative research in Cochrane systematic reviews of interventions version 1 (updated August 2011). edn. Edited by Noyes J, HannesK, Harden A, Harris J, Lewin S, Lockwood C.: Cochrane Collaboration Qualitative Methods Group; 2011.
15.
Tranfield D, Denyer D, Smart P. Towards a methodology for developing evidence-informed management knowledge by means of systematic review. Br J Manag. 2003;14:207–22.CrossRef
16.
Noyes J, Hendry M, Booth A, Chandler J, Lewin S, Glenton C, Garside R. Current use was established and Cochrane guidance on selection of social theories for systematic reviews of complex interventions was developed. J Clin Epidemiol. 2016;75:78–92.CrossRefPubMed
17.
18.
19.
Guise JM, Chang C, Viswanathan M, Glick S, Treadwell J, Umscheid C, Whitlock E, Fu R, Berliner E, Paynter R, Anderson J, Motu’apuaka M, Trikalinos T. Systematic reviews of complex multicomponent health care interventions. Research white paper. Rockville, MD: Agency for Healthcare Research and Quality; 2014.
20.
McLean S, Gee M, Booth A, Salway S, Nancarrow S, Cobb M, Bhanbhro S. Targeting the Use of Reminders and Notifications for Uptake by Populations (TURNUP): a systematic review and evidence synthesis (structured abstract). In: Health technology assessment database: Health Services and Delivery Research; 2014.
21.
Baxter S, Killoran A, Kelly MP, Goyder E. Synthesizing diverse evidence: the use of primary qualitative data analysis methods and logic models in public health reviews. Public Health. 2010;124(2):99–106.CrossRefPubMed
22.
23.
24.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred Reporting Items for Systematic Reviews and Meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.CrossRefPubMedPubMedCentral
25.
Gentles SJ, Charles C, Nicholas DB, Ploeg J, McKibbon KA. Reviewing the research methods literature: principles and strategies illustrated by a systematic overview of sampling in qualitative research. Syst Rev. 2016;5(1):172.CrossRefPubMedPubMedCentral
26.
Lilford RJ, Richardson A, Stevens A, Fitzpatrick R, Edwards S, Rock F, Hutton JL. Issues in methodological research: perspectives from researchers and commissioners. Health Technol Assess. 2001;5(8):1–57.CrossRefPubMed
27.
Snilstveit B. Systematic reviews: from ‘bare bones’ reviews to policy relevance. J Dev Effect. 2012;4:388–408.CrossRef
28.
Backholer K, Sarink D, Beauchamp A, Keating C, Loh V, Peeters A. The effect of a sugar sweetened beverage tax among different socioeconomic groups: a systematic review. Obes Res Clin Pract. 2014;8:4–5.CrossRef
29.
Bambra C, Hillier F, Cairns-Nagi J, Kasim A, Moore H, Summerbell C. How effective are interventions at reducing socioeconomic inequalities in obesity among children and adults? Two systematic reviews (structured abstract). In: Health technology assessment database: Public Health Research; 2015.
30.
Hillier-Brown FC, Bambra CL, Cairns JM, Kasim A, Moore HJ, Summerbell CD. A systematic review of the effectiveness of individual, community and societal-level interventions at reducing socio-economic inequalities in obesity among adults. Int J Obes. 2014;38(12):1483–90.CrossRef
31.
Hillier-Brown FC, Bambra CL, Cairns J-M, Kasim A, Moore HJ, Summerbell CD: A systematic review of the effectiveness of individual, community and societal level interventions at reducing socioeconomic inequalities in obesity amongst children. BMC Public Health 2014, 14(1):834-834.
32.
Cairns J-M, Bambra C, Hillier-Brown FC, Moore HJ, Summerbell CD. Weighing up the evidence: a systematic review of the effectiveness of workplace interventions to tackle socio-economic inequalities in obesity. J Public Health. 2015;37(4):659–70.
33.
Beauchamp A, Backholer K, Magliano D, Peeters A. The effect of obesity prevention interventions according to socioeconomic position: a systematic review (provisional abstract). Obes Rev. 2014;15:541–54.CrossRefPubMed
34.
Boelsen-Robinson T, Peeters A, Beauchamp A, Chung A, Gearon E, Backholer K. A systematic review of the effectiveness of whole-of-community interventions by socioeconomic position. Obes Rev. 2015;16(9):806–16.CrossRefPubMed
35.
Brown TJ, Todd A, O'Malley C, Moore HJ, Husband AK, Bambra C, Kasim A, Sniehotta FF, Steed L, Smith S, et al. Community pharmacy-delivered interventions for public health priorities: a systematic review of interventions for alcohol reduction, smoking cessation and weight management, including meta-analysis for smoking cessation. BMJ Open. 2016;6(2):e009828.CrossRefPubMedPubMedCentral
36.
Brown TJ, Todd A, O'Malley CL, Moore HJ, Husband AK, Bambra C, Kasim A, Sniehotta FF, Steed L, Summerbell CD. Community pharmacy interventions for public health priorities: a systematic review of community pharmacy-delivered smoking, alcohol and weight management interventions (structured abstract). In: Health technology assessment database: Public Health Research; 2016.
37.
Brown T, Platt S, Amos A. Equity impact of population-level interventions and policies to reduce smoking in adults: a systematic review. Drug Alcohol Depend. 2014;138:7–16.CrossRefPubMed
38.
Brown T, Platt S, Amos A. Equity impact of European individual-level smoking cessation interventions to reduce smoking in adults: a systematic review. Eur J Pub Health. 2014;24(4):551–6.CrossRef
39.
Brown T, Platt S, Amos A. Equity impact of interventions and policies to reduce smoking in youth: systematic review. Tob Control. 2014;23(S1):e98–e105.CrossRefPubMed
40.
Bull ER, Dombrowski SU, McCleary N, Johnston M. Are interventions for low-income groups effective in changing healthy eating, physical activity and smoking behaviours? A systematic review and meta-analysis. BMJ Open. 2014;4(11):e006046.CrossRefPubMedPubMedCentral
41.
Cleland V, Granados A, Crawford D, Winzenberg T, Ball K. Effectiveness of interventions to promote physical activity among socioeconomically disadvantaged women: a systematic review and meta-analysis. Obes Rev. 2013;14(3):197–212.CrossRefPubMed
42.
Everson-Hock ES, Johnson M, Jones R, Woods HB, Goyder E, Payne N, Chilcott J. Community-based dietary and physical activity interventions in low socioeconomic groups in the UK: a mixed methods systematic review. Prev Med. 2013;56(5):265–72.CrossRefPubMed
43.
Gardner MP, Adams A, Jeffreys M. Interventions to increase the uptake of mammography amongst low income women: a systematic review and meta-analysis. PLoS One [Electronic Resource]. 2013;8(2):e55574.CrossRef
44.
Hill S, Amos A, Clifford D, Platt S. Impact of tobacco control interventions on socioeconomic inequalities in smoking: review of the evidence. Tob Control. 2014;23(S1):e89–97.CrossRefPubMed
45.
Hollands GJ, Shemilt I, Marteau TM, Jebb SA, Lewis HB, Wei Y, Higgins JP, Ogilvie D. Portion, package or tableware size for changing selection and consumption of food, alcohol and tobacco. Cochrane Database Syst Rev. 2015;(9):Cd011045.
46.
Kader M, Sundblom E, Elinder LS. Effectiveness of universal parental support interventions addressing children's dietary habits, physical activity and bodyweight: a systematic review. Prev Med. 2015;77:52–67.CrossRefPubMed
47.
Kendrick D, Young B, Mason-Jones AJ, Ilyas N, Achana FA, Cooper NJ, Hubbard SJ, Sutton AJ, Smith S, Wynn P, et al. Home safety education and provision of safety equipment for injury prevention (review). Evid Based Child Health Cochrane Rev J. 2013;8(3):761–939.CrossRef
48.
Kristjansson E, Francis DK, Liberato S, Benkhalti Jandu M, Welch V, Batal M, Greenhalgh T, Rader T, Noonan E, Shea B et al: Food supplementation for improving the physical and psychosocial health of socio-economically disadvantaged children aged three months to five years. In: Cochrane Database Syst Rev: John Wiley & Sons, Ltd; 2015.
49.
Laba TL, Bleasel J, Brien JA, Cass A, Howard K, Peiris D, Redfern J, Salam A, Usherwood T, Jan S. Strategies to improve adherence to medications for cardiovascular diseases in socioeconomically disadvantaged populations: a systematic review (provisional abstract). Int J Cardiol. 2013;167:2430–40.CrossRefPubMed
50.
Laws R, Campbell KJ, van der Pligt P, Russell G, Ball K, Lynch J, Crawford D, Taylor R, Askew D, Denney-Wilson E: The impact of interventions to prevent obesity or improve obesity related behaviours in children (0-5 years) from socioeconomically disadvantaged and/or indigenous families: a systematic review. BMC Public Health 2014, 14(1):779–779
51.
Magnee T, Burdorf A, Brug J, Kremers SP, Oenema A, van Assema P, Ezendam NP, van Genugten L, Hendriksen IJ, Hopman-Rock M, et al. Equity-specific effects of 26 Dutch obesity-related lifestyle interventions. Am J Prev Med. 2013;44(6):e57–66.CrossRefPubMed
52.
McGill R, Anwar E, Orton L, Bromley H, Lloyd-Williams F, O'Flaherty M, Taylor-Robinson D, Guzman-Castillo M, Gillespie D, Moreira P et al: Are interventions to promote healthy eating equally effective for all? Systematic review of socioeconomic inequalities in impact. BMC Public Health 2015, 15(1):457-457.
53.
Mizdrak A, Scarborough P, Waterlander WE, Rayner M. Differential responses to food price changes by personal characteristic: a systematic review of experimental studies. PLoS ONE [Electronic Resource]. 2015;10(7):e0130320.CrossRef
54.
Moore GF, Littlecott HJ, Turley R, Waters E, Murphy S. Socioeconomic gradients in the effects of universal school-based health behaviour interventions: a systematic review of intervention studies. BMC Public Health. 2015;15(1):1–15.CrossRef
55.
Moredich CA, Kessler TA. Physical activity and nutritional weight loss interventions in obese, low-income women: an integrative review (provisional abstract). J Midwifery Womens Health. 2014;59:380–7.CrossRefPubMed
56.
Rojas-Garcia A, Ruiz-Perez I, Rodriguez-Barranco M, Goncalves Bradley DC, Pastor-Moreno G, Ricci-Cabello I. Healthcare interventions for depression in low socioeconomic status populations: a systematic review and meta-analysis. Clin Psychol Rev. 2015;38:65–78.CrossRefPubMed
57.
Sarink D, Peeters A, Freak-Poli R, Beauchamp A, Woods J, Ball K, Backholer K. The impact of menu energy labelling across socioeconomic groups: a systematic review. Appetite. 2016;99:59–75.CrossRefPubMed
58.
Ciciriello S, Johnston Renea V, Osborne Richard H, Wicks I, de Kroo T, Clerehan R, O'Neill C, Buchbinder R. Multimedia educational interventions for consumers about prescribed and over-the-counter medications. In: Cochrane Database Syst Rev: John Wiley & Sons, Ltd; 2013.
59.
Ejemot-Nwadiaro Regina I, Ehiri John E, Arikpo D, Meremikwu Martin M, Critchley Julia A. Hand washing promotion for preventing diarrhoea. In: Cochrane database of systematic reviews: John Wiley & Sons, Ltd; 2015.
60.
61.
Gurol-Urganci I, de Jongh T, Vodopivec-Jamsek V, Atun R, Car J. Mobile phone messaging reminders for attendance at healthcare appointments. In: Cochrane Database Syst Rev: John Wiley & Sons, Ltd; 2013.
62.
Hartmann-Boyce J, Jebb SA, Fletcher BR, Aveyard P. Self-help for weight loss in overweight and obese adults: systematic review and meta-analysis. Am J Public Health. 2015;105(3):e43–57.CrossRefPubMedPubMedCentral
63.
Kroon Féline PB, van der Burg Lennart RA, Buchbinder R, Osborne Richard H, Johnston Renea V, Pitt V. Self-management education programmes for osteoarthritis. In: Cochrane Database Syst Rev: John Wiley & Sons, Ltd; 2014.
64.
Lutge Elizabeth E, Wiysonge Charles S, Knight Stephen E, Sinclair D, Volmink J. Incentives and enablers to improve adherence in tuberculosis. In: Cochrane Database Syst Rev: John Wiley & Sons, Ltd; 2015.
65.
Pega F, Carter K, Blakely T, Lucas Patricia J. In-work tax credits for families and their impact on health status in adults. In: Cochrane Database Syst Rev: John Wiley & Sons, Ltd; 2013.
66.
Augustincic Polec L, Petkovic J, Welch VA, Ueffing E, Ghogomu ET, Pardo JP, Grabowsky M, Attaran A, Wells GA, Tugwell P: Strategies to increase the ownership and use of insecticide-treated bednets to prevent malaria. In Cochrane Database Syst Rev: John Wiley & Sons, Ltd; 2015
67.
Cutrona SL, Choudhry NK, Stedman M, Servi A, Liberman JN, Brennan T, Fischer MA, Brookhart MA, Shrank WH. Physician effectiveness in interventions to improve cardiovascular medication adherence: a systematic review. J Gen Intern Med. 2010;25(10):1090–6.CrossRefPubMedPubMedCentral
68.
White M, Adams J, Heywood P. How and why do interventions that increase health overall widen inequalities within populations? In: Barbones S, editor. Health, Inequality and Public Health. Bristol: Policy Press; 2009.
69.
Lorenc T, Petticrew M, Welch V, Tugwell P. What types of interventions generate inequalities? Evidence from systematic reviews. J Epidemiol Community Health. 2013;67(2):190–3.CrossRefPubMed
70.
Arblaster L, Lambert M, Entwistle V, Forster M, Fullerton D, Sheldon T, Watt I. A systematic review of the effectiveness of health service interventions aimed at reducing inequalities in health. J Health Serv Res Policy. 1996;1(2):93–103.PubMed
71.
Petticrew M, Welch V, Tugwell P. ‘It is surely a great criticism of our profession...’ the next 20 years of equity-focused systematic reviews. J Epidemiol Community Health. 2014;68(4):291–2.CrossRefPubMed
72.
Welch V, Petticrew M, Ueffing E, Benkhalti Jandu M, Brand K, Dhaliwal B, Kristjansson E, Smylie J, Wells GA, Tugwell P. Does consideration and assessment of effects on health equity affect the conclusions of systematic reviews? A methodology study. PLoS One. 2012;7(3):e31360.CrossRefPubMedPubMedCentral
73.
Azjen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50:179–211.CrossRef
74.
MacLure M. ‘Clarity bordering on stupidity’: Where’s the quality in systematic review? In: British Educational Research Association annual conference. Manchester; 2004.
75.
Cochrane Handbook for Systematic Reviews of Intervetions.: The Cochrane Collaboration; 2011.
76.
Rohwer A, Booth, A., Pfadenhauer, L., Brereton, L., Gerhardus, A., Mozygemba, K., Oortwijn, W., Tummers, M., Van Der Wilt, G.J., Rehfuess, E.: Guidance on the use of logic models in health technology assessments of complex interventions. 2016.
77.
Dahlgren G, Whitehead, M.: Tackling inequalities in health: what can we learn from what has been tried? In: Working paper prepared for the Kings Fund International Seminar on Tackling Inequalities in Health. Ditchley Park, Oxfordshire; 1993.
78.
Sutton S: Determinants of health related behaviours: theoretical and methodological issues. In: The SAGE handbook of Health Psychology. Edited by Sutton S, Baum, A., Johnston, M. London: SAGE Publications Ltd; 2004: 94-126.
Metadata
Title
Use of programme theory to understand the differential effects of interventions across socio-economic groups in systematic reviews—a systematic methodology review
Authors
Michelle Maden
Alex Cunliffe
Naoimh McMahon
Andrew Booth
Gina Michelle Carey
Suzy Paisley
Rumona Dickson
Mark Gabbay
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2017
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-017-0638-9

Other articles of this Issue 1/2017

Systematic Reviews 1/2017 Go to the issue

Protocol

Prevalence and prognosis of acutely ill patients with organ failure at arrival to hospital: protocol for a systematic review

Research

Interventions for acute stroke management in Africa: a systematic review of the evidence

Research

Evaluative reports on medical malpractice policies in obstetrics: a rapid scoping review

Protocol

The effects of dietary and lifestyle interventions among pregnant women who are overweight or obese on longer-term maternal and early childhood outcomes: protocol for an individual participant data (IPD) meta-analysis

Research

The validity and reliability of the four square step test in different adult populations: a systematic review

Protocol

Understanding the experience of initiating community-based physical activity and social support by people with serious mental illness: a systematic review using a meta-ethnographic approach