Skip to main content
Top
Published in: BMC Public Health 1/2019

Open Access 01-12-2019 | Research article

To what extent can the activities of the South Australian Health in All Policies initiative be linked to population health outcomes using a program theory-based evaluation?

Authors: Fran Baum, Toni Delany-Crowe, Colin MacDougall, Helen van Eyk, Angela Lawless, Carmel Williams, Michael Marmot

Published in: BMC Public Health | Issue 1/2019

Login to get access

Abstract

Background

This paper reports on a five-year study using a theory-based program logic evaluation, and supporting survey and interview data to examine the extent to which the activites of the South Australian Health in All Policies initiative can be linked to population health outcomes.

Methods

Mixed-methods data were collected between 2012 and 2016 in South Australia (144 semi-structured key informant interviews; two electronic surveys of public servants in 2013 (n = 435) and 2015 (n = 483); analysis of state government policy documents; and construction of a program logic model to shape assessment of the feasibility of attribution to population health outcomes).

Results

Multiple actions on social determinants of health in a range of state government sectors were reported and most could be linked through a program logic model to making some contribution to future population health outcomes. Context strongly influences implementation; not all initiatives will be successful and experimentation is vital. Successful initiatives included HiAP influencing the urban planning department to be more concerned with the health impacts of planning decisions, and encouraging the environment department to be concerned with the health impacts of its work.

Conclusions

The theory-based program logic suggests that SA HiAP facilitated improved population health through working with multiple government departments. Public servants came to appreciate how their sectors impact on health. Program logic is a mechanism to evaluate complex public health interventions in a way that takes account of political and economic contexts. SA HiAP was mainly successful in avoiding lifestyle drift in strategy. The initiative encouraged a range of state government departments to tackle conditions of daily living. The broader underpinning factors dictating the distribution of power, money and resources were not addressed by HiAP. This reflects HiAP’s use of a consensus model which was driven by (rather than drove) state priorities and sought ‘win-win’ strategies.
Literature
6.
go back to reference Funnell S, Rogers P. Purposeful Program theory: effective use of the theories of change and logic models. San Francisco: John Wiley & Sons; 2011. Funnell S, Rogers P. Purposeful Program theory: effective use of the theories of change and logic models. San Francisco: John Wiley & Sons; 2011.
10.
go back to reference Mayne J. Contribution analysis: Addressing cause and effect. In: Forss K, Marra M, Schwartz R, editors. Evaluating the complex: Attribution, contribution, and beyond. Volume 18; 2011. p. 53–96. Mayne J. Contribution analysis: Addressing cause and effect. In: Forss K, Marra M, Schwartz R, editors. Evaluating the complex: Attribution, contribution, and beyond. Volume 18; 2011. p. 53–96.
11.
go back to reference Layder D. New strategies in social research: an introduction and guide. Cambridge, UK: Polity Press; 1993. Layder D. New strategies in social research: an introduction and guide. Cambridge, UK: Polity Press; 1993.
12.
go back to reference Lawless A, Baum F, Delany-Crowe T, MacDougall C, Williams C, McDermott D et al. Developing a framework for a theory-based approach to evaluating policy processes and outcomes: Health in All Policies in South Australia. International Journal of Health Policy and Management. 2017; doi:https://doi.org/10.15171/ijhpm.2017.121. Lawless A, Baum F, Delany-Crowe T, MacDougall C, Williams C, McDermott D et al. Developing a framework for a theory-based approach to evaluating policy processes and outcomes: Health in All Policies in South Australia. International Journal of Health Policy and Management. 2017; doi:https://​doi.​org/​10.​15171/​ijhpm.​2017.​121.
14.
go back to reference Pawson R, Tilley N. Realistic Evaluation. London: Sage; 1997. Pawson R, Tilley N. Realistic Evaluation. London: Sage; 1997.
15.
go back to reference Baum F, Lawless A, Williams C. Health in All Policies from international ideas to local implementation: policies, systems and organizations. In: Clavier C, de Leeuw E, editors. Health Promotion and the Policy Process: Practical and Critical Theories. Oxford University Press; 2013. p. 188–217. Baum F, Lawless A, Williams C. Health in All Policies from international ideas to local implementation: policies, systems and organizations. In: Clavier C, de Leeuw E, editors. Health Promotion and the Policy Process: Practical and Critical Theories. Oxford University Press; 2013. p. 188–217.
17.
go back to reference Pollitt C. Context: what kind of missing link? In: Pollitt C, editor. Context in public policy and management - the missing link? Cheltenham: Edward Elgar; 2013. p. 415–22. Pollitt C. Context: what kind of missing link? In: Pollitt C, editor. Context in public policy and management - the missing link? Cheltenham: Edward Elgar; 2013. p. 415–22.
20.
23.
24.
go back to reference Dillman DA. Mail and internet surveys: the tailored design method. New Jersey: John Wiley & Sons; 2007. Dillman DA. Mail and internet surveys: the tailored design method. New Jersey: John Wiley & Sons; 2007.
25.
go back to reference Harris P, Williams C, Harris L, Delany T. Health impact assessment and health in all policies in Australia: similarities and differences International Union of Health Promotion and Education World Conference on health promotion Pattaya, Thailand; 2013. Harris P, Williams C, Harris L, Delany T. Health impact assessment and health in all policies in Australia: similarities and differences International Union of Health Promotion and Education World Conference on health promotion Pattaya, Thailand; 2013.
27.
go back to reference Feinstein L, Sabates R, Anderson T, Sorhaindo A, Hammond C. What are the effects of education on health? Report on measuring the effects of education and health and civic engagement. In proceedings of the Copenhagen symposium. Copenhagen. 2006. pp. 171–340. Feinstein L, Sabates R, Anderson T, Sorhaindo A, Hammond C. What are the effects of education on health? Report on measuring the effects of education and health and civic engagement. In proceedings of the Copenhagen symposium. Copenhagen. 2006. pp. 171–340.
28.
go back to reference DeWalt DA, Berkman ND, Sheridan S, Lohr KN, Pignone MP. Literacy and health outcomes: a systematic review of the literature. J Gen Intern Med. 2004;19(12):1228–39. DeWalt DA, Berkman ND, Sheridan S, Lohr KN, Pignone MP. Literacy and health outcomes: a systematic review of the literature. J Gen Intern Med. 2004;19(12):1228–39.
30.
go back to reference Spoehr J. Stormy times: Living with uncertainty [online]. Griffith Review. 2017;55:19–31. Spoehr J. Stormy times: Living with uncertainty [online]. Griffith Review. 2017;55:19–31.
31.
go back to reference Barton H, Tsourou C. Healthy Urban Planning: Taylor & Francis; 2013. Barton H, Tsourou C. Healthy Urban Planning: Taylor & Francis; 2013.
33.
go back to reference Bowen KJ, Parry M. The evidence base for linkages between green infrastructure, public health and economic benefit. Paper prepared for the project Assessing the Economic Value of Green Infrastructure: 2015. Accessed 10 Oct 2018. Bowen KJ, Parry M. The evidence base for linkages between green infrastructure, public health and economic benefit. Paper prepared for the project Assessing the Economic Value of Green Infrastructure: 2015. Accessed 10 Oct 2018.
37.
go back to reference Leppo K, Ollila E, Peña S, Wismar M, Cook S. Lessons for policy-makers. In: Leppo K, Ollila E, Peña S, Wismar M, Cook S, editors. Health in All Policies: Seizing opportunities, implementing policies. Helsinki: Ministry of Social Affairs and Health Finland, National Institute for Health and Welfare, and the European Observatory for Health Systems and Policies; 2013. p. 325–338. Leppo K, Ollila E, Peña S, Wismar M, Cook S. Lessons for policy-makers. In: Leppo K, Ollila E, Peña S, Wismar M, Cook S, editors. Health in All Policies: Seizing opportunities, implementing policies. Helsinki: Ministry of Social Affairs and Health Finland, National Institute for Health and Welfare, and the European Observatory for Health Systems and Policies; 2013. p. 325–338.
39.
go back to reference Labonté R. From mid-level policy analysis to macro-level political economy: Comment on “Developing a framework for a program theory-based approach to evaluating policy processes and outcomes: Health in All Policies in South Australia.”. Int J Health Policy Manag. 2018; doi:https://doi.org/10.15171/IJHPM.2018.12. Labonté R. From mid-level policy analysis to macro-level political economy: Comment on “Developing a framework for a program theory-based approach to evaluating policy processes and outcomes: Health in All Policies in South Australia.”. Int J Health Policy Manag. 2018; doi:https://​doi.​org/​10.​15171/​IJHPM.​2018.​12.
42.
go back to reference Delany T, Baum F, Lawless A, MacDougall C, Harris E, McDermott D. Creating a burden of evidence to consider the impact of Health in All Policies: A program logic approach. In: International Political Science Association World Congress: 2014; Montreal; 2014. Delany T, Baum F, Lawless A, MacDougall C, Harris E, McDermott D. Creating a burden of evidence to consider the impact of Health in All Policies: A program logic approach. In: International Political Science Association World Congress: 2014; Montreal; 2014.
43.
go back to reference Baum F, Graycar A, Delany-Crowe T, de Leeuw E, Bacchi C, Popay J, et al. Understanding Australian policies on public health using social and political science theories: reflections from an Academy of the Social Sciences in Australia workshop. Health Promot Int. 2018. https://doi.org/10.1093/heapro/day014. Baum F, Graycar A, Delany-Crowe T, de Leeuw E, Bacchi C, Popay J, et al. Understanding Australian policies on public health using social and political science theories: reflections from an Academy of the Social Sciences in Australia workshop. Health Promot Int. 2018. https://​doi.​org/​10.​1093/​heapro/​day014.
Metadata
Title
To what extent can the activities of the South Australian Health in All Policies initiative be linked to population health outcomes using a program theory-based evaluation?
Authors
Fran Baum
Toni Delany-Crowe
Colin MacDougall
Helen van Eyk
Angela Lawless
Carmel Williams
Michael Marmot
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2019
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-019-6408-y

Other articles of this Issue 1/2019

BMC Public Health 1/2019 Go to the issue