Skip to main content
Top
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

A review of Grey and academic literature of evaluation guidance relevant to public health interventions

Authors: Sarah Denford, Charles Abraham, Margaret Callaghan, Peter Aighton, Frank De Vocht, Steven Arris

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

Public Health evaluation is essential to understanding what does and does not work, and robust demonstration of effectiveness may be crucial to securing future funding. Despite this, programs are often implemented with poor, incomplete or no evaluation. Public health practitioners are frequently required to provide evidence for the effectiveness of their services; thus, there is a growing need for evaluation guidance on how to evaluate public health programs. The aim of this study is to identify accessible high-quality, evaluation guidance, available to researchers and practitioners and to catalogue, summarise and categorise the content of a subset of accessible, quality guides to evaluation.

Methods

We systematically reviewed grey and academic literature for documents providing support for evaluation of complex health interventions. Searches were conducted January to March 2015, and included academic databases, internet search engines, and consultations with academic and practicing public health experts. Data were extracted by two authors and sent to the authors of the guidance documents for comments.

Results

Our initial search identified 402 unique documents that were screened to identify those that were (1) developed by or for a national or international organization (2) freely available to all (3) published during or after 2000 (4) specific to public health. This yielded 98 documents from 43 organisations. Of these, 48 were reviewed in detail. This generated a detailed catalogue of quality evaluation guidance. The content included in documents covers 37 facets of evaluation.

Conclusions

A wide range of guidance on evaluation of public health initiatives is available. Time and knowledge constraints may mean that busy practitioners find it challenging to access the most, up-to-date, relevant and useful guidance. This review presents links to and reviews of 48 quality guides to evaluation as well as categorising their content. This facilitates quick and each access to multiple selected sources of specific guidance.
Appendix
Available only for authorised users
Literature
1.
go back to reference Centres for Disease Control and Prevention (CDC). Framework for program evaluation in public health. Morb Mortal Wkly Rep. 1999;48:RR-11. Centres for Disease Control and Prevention (CDC). Framework for program evaluation in public health. Morb Mortal Wkly Rep. 1999;48:RR-11.
4.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. Int J Nurs Stud. 2013;50:587–92.CrossRefPubMed Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. Int J Nurs Stud. 2013;50:587–92.CrossRefPubMed
6.
go back to reference Ogilvie D, Cummins S, Petticrew M, White M, Jones A, Wheeler K. Assessing the evaluability of complex public health interventions: five questions for researchers, funders, and policymakers. Milbank Q. 2011;89:206–25.CrossRefPubMedPubMedCentral Ogilvie D, Cummins S, Petticrew M, White M, Jones A, Wheeler K. Assessing the evaluability of complex public health interventions: five questions for researchers, funders, and policymakers. Milbank Q. 2011;89:206–25.CrossRefPubMedPubMedCentral
7.
go back to reference Denford S, Callaghan M, Abraham C, Lakshman R. A qualitative study of public health practitioners’ views of evaluation guidance. Manuscript (2017). Denford S, Callaghan M, Abraham C, Lakshman R. A qualitative study of public health practitioners’ views of evaluation guidance. Manuscript (2017).
9.
go back to reference Moore G, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions. UK Medical Research Council guidance. London: MRC Population Health Science Research Network; 2014. http://www.sphsu.mrc.ac.uk/research-programmes/ev/methop/evalci.html. Accessed 7/1/14 19 Moore G, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions. UK Medical Research Council guidance. London: MRC Population Health Science Research Network; 2014. http://​www.​sphsu.​mrc.​ac.​uk/​research-programmes/​ev/​methop/​evalci.​html.​ Accessed 7/1/14 19
Metadata
Title
A review of Grey and academic literature of evaluation guidance relevant to public health interventions
Authors
Sarah Denford
Charles Abraham
Margaret Callaghan
Peter Aighton
Frank De Vocht
Steven Arris
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-017-2588-2

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue