Skip to main content
Top
Published in: BMC Public Health 1/2015

Open Access 01-12-2015 | Research article

Social Return on Investment (SROI) methodology to account for value for money of public health interventions: a systematic review

Authors: Aduragbemi Oluwabusayo Banke-Thomas, Barbara Madaj, Ameh Charles, Nynke van den Broek

Published in: BMC Public Health | Issue 1/2015

Login to get access

Abstract

Background

Increased scarcity of public resources has led to a concomitant drive to account for value-for-money of interventions. Traditionally, cost-effectiveness, cost-utility and cost-benefit analyses have been used to assess value-for-money of public health interventions. The social return on investment (SROI) methodology has capacity to measure broader socio-economic outcomes, analysing and computing views of multiple stakeholders in a singular monetary ratio. This review provides an overview of SROI application in public health, explores lessons learnt from previous studies and makes recommendations for future SROI application in public health.

Methods

A systematic review of peer-reviewed and grey literature to identify SROI studies published between January 1996 and December 2014 was conducted. All articles describing conduct of public health SROI studies and which reported a SROI ratio were included. An existing 12-point framework was used to assess study quality. Data were extracted using pre-developed codes: SROI type, type of commissioning organisation, study country, public health area in which SROI was conducted, stakeholders included in study, discount rate used, SROI ratio obtained, time horizon of analysis and reported lessons learnt.

Results

40 SROI studies, of varying quality, including 33 from high-income countries and 7 from low middle-income countries, met the inclusion criteria. SROI application increased since its first use in 2005 until 2011, declining afterwards. SROI has been applied across different public health areas including health promotion (12 studies), mental health (11), sexual and reproductive health (6), child health (4), nutrition (3), healthcare management (2), health education and environmental health (1 each). Qualitative and quantitative methods have been used to gather information for public health SROI studies. However, there remains a lack of consensus on who to include as beneficiaries, how to account for counterfactual and appropriate study-time horizon.
Reported SROI ratios vary widely (1.1:1 to 65:1).

Conclusions

SROI can be applied across healthcare settings. Best practices such as analysis involving only beneficiaries (not all stakeholders), providing justification for discount rates used in models, using purchasing power parity equivalents for monetary valuations and incorporating objective designs such as case–control or before-and-after designs for accounting for outcomes will improve robustness of public health SROI studies.
Appendix
Available only for authorised users
Literature
3.
go back to reference Taylor J, Bradbury-Jones C. International principles of social impact assessment: lessons for research? J Res Nurs. 2011;16:133–45.CrossRef Taylor J, Bradbury-Jones C. International principles of social impact assessment: lessons for research? J Res Nurs. 2011;16:133–45.CrossRef
6.
go back to reference Millar R, Hall K. Social Return on Investment (SROI) and Performance Measurement. Public Manag Rev. 2013;15:923–41.CrossRef Millar R, Hall K. Social Return on Investment (SROI) and Performance Measurement. Public Manag Rev. 2013;15:923–41.CrossRef
7.
go back to reference Arvidson M, Lyon F. McKay S, Moro D. The ambitions and challenges of SROI. Birmingham: Third Sector Research Centre; 2010. Arvidson M, Lyon F. McKay S, Moro D. The ambitions and challenges of SROI. Birmingham: Third Sector Research Centre; 2010.
9.
go back to reference Scholten P, Nicholls J, Olsen S, Galimidi B. Social Return on Investment: A Guide to SROI Analysis. Amsterdam: Lenthe Publishers; 2006. Scholten P, Nicholls J, Olsen S, Galimidi B. Social Return on Investment: A Guide to SROI Analysis. Amsterdam: Lenthe Publishers; 2006.
10.
go back to reference Emerson J, Cabaj M. Social Return on Investment. Making Waves. 2000;11:10–4. Emerson J, Cabaj M. Social Return on Investment. Making Waves. 2000;11:10–4.
12.
go back to reference Rotheroe N, Richards A. Social return on investment and social enterprise: transparent accountability for sustainable development. Social Enterprise Journal. 2007;3:31–48.CrossRef Rotheroe N, Richards A. Social return on investment and social enterprise: transparent accountability for sustainable development. Social Enterprise Journal. 2007;3:31–48.CrossRef
13.
go back to reference Norman W, MacDonald C. Getting to the bottom of triple bottom line. Bus Ethics Q. 2004;14:243–62.CrossRef Norman W, MacDonald C. Getting to the bottom of triple bottom line. Bus Ethics Q. 2004;14:243–62.CrossRef
14.
go back to reference Emerson J. The Blended Value Proposition: Integrating Social and Financial Returns. Calif Manage Rev. 2003;45:35–51.CrossRef Emerson J. The Blended Value Proposition: Integrating Social and Financial Returns. Calif Manage Rev. 2003;45:35–51.CrossRef
15.
go back to reference Arvidson M, Lyon F, McKay S, Moro D. Valuing the social? The nature and controversies of measuring social return on investment (SROI). Voluntary Sector Rev. 2013;4:3–18.CrossRef Arvidson M, Lyon F, McKay S, Moro D. Valuing the social? The nature and controversies of measuring social return on investment (SROI). Voluntary Sector Rev. 2013;4:3–18.CrossRef
17.
go back to reference Hutton G, Rehfuess E. Guidelines for Conducting Cost-benefit Analysis of Household Energy and Health Interventions. Geneva, Switzerland: World Health Organization; 2006. Hutton G, Rehfuess E. Guidelines for Conducting Cost-benefit Analysis of Household Energy and Health Interventions. Geneva, Switzerland: World Health Organization; 2006.
18.
go back to reference Gold MR, Siegel JE, Russell LB, Weinstein MC. Cost-effectiveness in Health and Medicine. Oxford: Oxford University Press; 1996. Gold MR, Siegel JE, Russell LB, Weinstein MC. Cost-effectiveness in Health and Medicine. Oxford: Oxford University Press; 1996.
19.
go back to reference Brady R. The True Cost of Stigma: Evaluating the Social Return on Investment of the Stigma and Discrimination Component of the Alliance’s Africa Regional Programme II. International HIV/AIDS Alliance: Hove, United Kingdom; 2011. Brady R. The True Cost of Stigma: Evaluating the Social Return on Investment of the Stigma and Discrimination Component of the Alliance’s Africa Regional Programme II. International HIV/AIDS Alliance: Hove, United Kingdom; 2011.
20.
go back to reference Edwards RT, Charles JM, Lloyd-Williams H. Public health economics: a systematic review of guidance for the economic evaluation of public health interventions and discussion of key methodological issues. BMC Public Health. 2013;13:1001.CrossRefPubMedPubMedCentral Edwards RT, Charles JM, Lloyd-Williams H. Public health economics: a systematic review of guidance for the economic evaluation of public health interventions and discussion of key methodological issues. BMC Public Health. 2013;13:1001.CrossRefPubMedPubMedCentral
22.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS medicine. 2009;6:e1000097.CrossRefPubMedPubMedCentral Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS medicine. 2009;6:e1000097.CrossRefPubMedPubMedCentral
23.
go back to reference Gough D, Oliver S, Thomas J. An Introduction to Systematic Reviews. London: Sage Publications Limited; 2012. Gough D, Oliver S, Thomas J. An Introduction to Systematic Reviews. London: Sage Publications Limited; 2012.
24.
go back to reference Phillips R. Stakeholder Theory and Organizational Ethics. San Francisco, CA: Berrett-Koehler Publishers; 2010. Phillips R. Stakeholder Theory and Organizational Ethics. San Francisco, CA: Berrett-Koehler Publishers; 2010.
25.
go back to reference Briner W, Hastings C, Geddes M. Project Leadership. 2nd ed. Gower: Aldershot, UK; 1996. Briner W, Hastings C, Geddes M. Project Leadership. 2nd ed. Gower: Aldershot, UK; 1996.
26.
go back to reference Walker D, Hampson K. Procurement Strategies: A Relation-based Approach. Oxford: John Wiley & Sons; 2008. Walker D, Hampson K. Procurement Strategies: A Relation-based Approach. Oxford: John Wiley & Sons; 2008.
27.
go back to reference Hyder AA, Bloom G, Leach M, Syed SB, Peters DH. Exploring health systems research and its influence on policy processes in low income countries. BMC Public Health. 2007;7:309.CrossRefPubMedPubMedCentral Hyder AA, Bloom G, Leach M, Syed SB, Peters DH. Exploring health systems research and its influence on policy processes in low income countries. BMC Public Health. 2007;7:309.CrossRefPubMedPubMedCentral
31.
go back to reference Bhaumik U, Norris K, Charron G, Walker SP, Sommer SJ, Chan E, et al. A cost analysis for a community-based case management intervention program for pediatric asthma. J Asthma. 2013;50:310–7.CrossRefPubMed Bhaumik U, Norris K, Charron G, Walker SP, Sommer SJ, Chan E, et al. A cost analysis for a community-based case management intervention program for pediatric asthma. J Asthma. 2013;50:310–7.CrossRefPubMed
32.
go back to reference Whelan G. An Evaluation of the Social Value of the Get into Reading Initiative in Wirral, Merseyside. Liverpool: Liverpool John Moores University; 2013. Whelan G. An Evaluation of the Social Value of the Get into Reading Initiative in Wirral, Merseyside. Liverpool: Liverpool John Moores University; 2013.
34.
go back to reference nef consulting, Christian Aid. Filling the Gaps: A Social Return on Investment Analysis. London: nef consulting; 2013. nef consulting, Christian Aid. Filling the Gaps: A Social Return on Investment Analysis. London: nef consulting; 2013.
37.
go back to reference Glasgow Association for Mental Health (GAMH). GAMH Annual Report. Glasgow; 2011. Glasgow Association for Mental Health (GAMH). GAMH Annual Report. Glasgow; 2011.
39.
go back to reference Carrick K, Lindhof J. The Value of Walking: A Social Return on Investment Report of a Walking Project. Greenspace Scotland: Glasgow; 2011. Carrick K, Lindhof J. The Value of Walking: A Social Return on Investment Report of a Walking Project. Greenspace Scotland: Glasgow; 2011.
40.
go back to reference Brady R. Value for Money in Arthritis Care’s Training Courses: Making Self-Management Count - A Social Return on Investment Evaluation. London: Arthritis Care; 2011. Brady R. Value for Money in Arthritis Care’s Training Courses: Making Self-Management Count - A Social Return on Investment Evaluation. London: Arthritis Care; 2011.
41.
go back to reference Frontier Economics Whizz-Kidz Ltd. Social Return on Investment for Whizz-Kidz’ Services: An Evaluation. London: Frontier Economics Ltd; 2011. Frontier Economics Whizz-Kidz Ltd. Social Return on Investment for Whizz-Kidz’ Services: An Evaluation. London: Frontier Economics Ltd; 2011.
44.
go back to reference McCorriston E. SROI Analysis: Hertfordshire Community Meal’s Meals on Wheels Service. Hemel Hempstead: Hertfordshire County Council; 2012. McCorriston E. SROI Analysis: Hertfordshire Community Meal’s Meals on Wheels Service. Hemel Hempstead: Hertfordshire County Council; 2012.
46.
go back to reference Age Concern Kingston upon Thames. Stay Well at Home Social Return on Investment (SROI) Evaluation Report. New Malden: Age Concern Kingston upon Thames; 2012. Age Concern Kingston upon Thames. Stay Well at Home Social Return on Investment (SROI) Evaluation Report. New Malden: Age Concern Kingston upon Thames; 2012.
47.
go back to reference Arvidson M, Battye F, Salisbury D. The social return on investment in community befriending. Int J Public Sector Manag. 2014;27:225–40.CrossRef Arvidson M, Battye F, Salisbury D. The social return on investment in community befriending. Int J Public Sector Manag. 2014;27:225–40.CrossRef
51.
go back to reference Tong L, Sopheab H, Sovannary T. “Doing More with Less”: Social Return on Investment on KHANA Integrated Care and Prevention Program. Hove: International HIV/AIDS Alliance; 2012. Tong L, Sopheab H, Sovannary T. “Doing More with Less”: Social Return on Investment on KHANA Integrated Care and Prevention Program. Hove: International HIV/AIDS Alliance; 2012.
52.
go back to reference Action on Addiction. SROI Analysis: A Social Return on Investment Analysis of the M-PACT (Moving Parents and Children Together) Programme. Salisbury: Action on Addiction; 2014. Action on Addiction. SROI Analysis: A Social Return on Investment Analysis of the M-PACT (Moving Parents and Children Together) Programme. Salisbury: Action on Addiction; 2014.
57.
go back to reference Eckley L. Befriending at the Quays: A Social Return on Investment Analysis. Liverpool: Liverpool John Moores University, Centre for Public Health; 2013. Eckley L. Befriending at the Quays: A Social Return on Investment Analysis. Liverpool: Liverpool John Moores University, Centre for Public Health; 2013.
58.
go back to reference Forth Sector Development. Restart: Social Return on Investment Report. Edinburgh: Forth Sector Development; 2007. Forth Sector Development. Restart: Social Return on Investment Report. Edinburgh: Forth Sector Development; 2007.
60.
go back to reference Lobley N, Carrick K, McNiven V. “Bums Off Seats” A Social Return on Investment Evaluation Report. Glasgow: Greenspace Scotland; 2012. Lobley N, Carrick K, McNiven V. “Bums Off Seats” A Social Return on Investment Evaluation Report. Glasgow: Greenspace Scotland; 2012.
62.
go back to reference Shipley R, Hamilton L. Healthwise Hull. Goodwin Development Trust: Hull; 2011. Shipley R, Hamilton L. Healthwise Hull. Goodwin Development Trust: Hull; 2011.
63.
go back to reference Somers AB. A Social Return on Investment Analysis, 2005–2006. MillRace IT: Chelmsford; 2005. Somers AB. A Social Return on Investment Analysis, 2005–2006. MillRace IT: Chelmsford; 2005.
65.
go back to reference Social Ventures Australia (SVA) Consulting. Spinal Cord Injuries Australia’s National Walk On Program. Melbourne: Spinal Cord Injuries Australia; 2013. Social Ventures Australia (SVA) Consulting. Spinal Cord Injuries Australia’s National Walk On Program. Melbourne: Spinal Cord Injuries Australia; 2013.
66.
go back to reference Satchwell Smith P. Social Return on Investment Analysis. Harare: Positive Initiative Trust (PIT); 2012. Satchwell Smith P. Social Return on Investment Analysis. Harare: Positive Initiative Trust (PIT); 2012.
67.
go back to reference Harrison M. Valuing the Future: The Social Discount Rate in Cost-benefit Analysis. Productivity Commission: Canberra; 2010. Harrison M. Valuing the Future: The Social Discount Rate in Cost-benefit Analysis. Productivity Commission: Canberra; 2010.
68.
go back to reference Greene JC, Caracelli VJ, Graham WF. Toward a Conceptual Framework for Mixed-Method Evaluation Designs. Educ Eval Policy An. 1989;11:255–74.CrossRef Greene JC, Caracelli VJ, Graham WF. Toward a Conceptual Framework for Mixed-Method Evaluation Designs. Educ Eval Policy An. 1989;11:255–74.CrossRef
69.
go back to reference Cheung Y-W. Purchasing Power Parity. In: Reinert KA, Rajan RS, Glass AJ, Davis LS, editors. The Princeton Encyclopedia of the World Economy. Princeton: Princeton University Press; 2009. p. 942–4. Cheung Y-W. Purchasing Power Parity. In: Reinert KA, Rajan RS, Glass AJ, Davis LS, editors. The Princeton Encyclopedia of the World Economy. Princeton: Princeton University Press; 2009. p. 942–4.
70.
go back to reference Hiles DR. Transparency. In: Given LM, editor. The SAGE Encyclopedia of Qualitative Research Methods. London: SAGE Publications; 2008. p. 891–3. Hiles DR. Transparency. In: Given LM, editor. The SAGE Encyclopedia of Qualitative Research Methods. London: SAGE Publications; 2008. p. 891–3.
75.
go back to reference Kumar SR. Social return on investment (SROI) analysis: A new tool for strategic decision making, planning, and evaluation for managers, investors, and policy makers in international aid and development. PhD Thesis. Los Angeles: University of California; 2011. p. 193. Kumar SR. Social return on investment (SROI) analysis: A new tool for strategic decision making, planning, and evaluation for managers, investors, and policy makers in international aid and development. PhD Thesis. Los Angeles: University of California; 2011. p. 193.
78.
go back to reference King N. Making the case for sport and recreation services: The utility of social return on investment (SROI) analysis. Int J Public Sector Manag. 2014;27:152–64.CrossRef King N. Making the case for sport and recreation services: The utility of social return on investment (SROI) analysis. Int J Public Sector Manag. 2014;27:152–64.CrossRef
79.
go back to reference Banke-Thomas A, Wilton-Waddell O, Kouraogo S, Mueller J. Current Evidence Supporting Obstetric Fistula Prevention Strategies in Sub Saharan Africa: A Systematic Review of the Literature. Afr J Reprod Healt. 2014;18:118–27. Banke-Thomas A, Wilton-Waddell O, Kouraogo S, Mueller J. Current Evidence Supporting Obstetric Fistula Prevention Strategies in Sub Saharan Africa: A Systematic Review of the Literature. Afr J Reprod Healt. 2014;18:118–27.
82.
go back to reference O’Cathain A, Murphy E, Nicholl J. Three techniques for integrating data in mixed methods studies. BMJ (Clinical research ed). 2010;341:c4587.CrossRef O’Cathain A, Murphy E, Nicholl J. Three techniques for integrating data in mixed methods studies. BMJ (Clinical research ed). 2010;341:c4587.CrossRef
87.
go back to reference Weatherly H, Drummond M, Claxton K, Cookson R, Ferguson B, Godfrey C, et al. Methods for assessing the cost-effectiveness of public health interventions: Key challenges and recommendations. Health Policy. 2009;93:85–92.CrossRefPubMed Weatherly H, Drummond M, Claxton K, Cookson R, Ferguson B, Godfrey C, et al. Methods for assessing the cost-effectiveness of public health interventions: Key challenges and recommendations. Health Policy. 2009;93:85–92.CrossRefPubMed
88.
go back to reference Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS)–explanation and elaboration: a report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. Value Health. 2013;16:231–50.CrossRefPubMed Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS)–explanation and elaboration: a report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. Value Health. 2013;16:231–50.CrossRefPubMed
91.
92.
go back to reference Gair C. SROI act II: A call to action for next generation SROI. London: REDF; 2009. Gair C. SROI act II: A call to action for next generation SROI. London: REDF; 2009.
Metadata
Title
Social Return on Investment (SROI) methodology to account for value for money of public health interventions: a systematic review
Authors
Aduragbemi Oluwabusayo Banke-Thomas
Barbara Madaj
Ameh Charles
Nynke van den Broek
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2015
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/s12889-015-1935-7

Other articles of this Issue 1/2015

BMC Public Health 1/2015 Go to the issue