Skip to main content
Top
Published in: Allergy, Asthma & Clinical Immunology 1/2013

Open Access 01-12-2013 | Research

Conducting retrospective impact analysis to inform a medical research charity’s funding strategies: the case of Asthma UK

Authors: Stephen R Hanney, Amanda Watt, Teresa H Jones, Leanne Metcalf

Published in: Allergy, Asthma & Clinical Immunology | Issue 1/2013

Login to get access

Abstract

Background

Debate is intensifying about how to assess the full range of impacts from medical research. Complexity increases when assessing the diverse funding streams of funders such as Asthma UK, a charitable patient organisation supporting medical research to benefit people with asthma. This paper aims to describe the various impacts identified from a range of Asthma UK research, and explore how Asthma UK utilised the characteristics of successful funding approaches to inform future research strategies.

Methods

We adapted the Payback Framework, using it both in a survey and to help structure interviews, documentary analysis, and case studies. We sent surveys to 153 lead researchers of projects, plus 10 past research fellows, and also conducted 14 detailed case studies. These covered nine projects and two fellowships, in addition to the innovative case studies on the professorial chairs (funded since 1988) and the MRC-Asthma UK Centre in Allergic Mechanisms of Asthma (the ‘Centre’) which together facilitated a comprehensive analysis of the whole funding portfolio. We organised each case study to capture whatever academic and wider societal impacts (or payback) might have arisen given the diverse timescales, size of funding involved, and extent to which Asthma UK funding contributed to the impacts.

Results

Projects recorded an average of four peer-reviewed journal articles. Together the chairs reported over 500 papers. All streams of funding attracted follow-on funding. Each of the various categories of societal impacts arose from only a minority of individual projects and fellowships. Some of the research portfolio is influencing asthma-related clinical guidelines, and some contributing to product development. The latter includes potentially major breakthroughs in asthma therapies (in immunotherapy, and new inhaled drugs) trialled by university spin-out companies. Such research-informed guidelines and medicines can, in turn, contribute to health improvements. The role of the chairs and the pioneering collaborative Centre is shown as being particularly important.

Conclusions

We systematically demonstrate that all types of Asthma UK’s research funding assessed are making impacts at different levels, but the main societal impacts from projects and fellowships come from a minority of those funded. Asthma UK used the study’s findings, especially in relation to the Centre, to inform research funding strategies to promote the achievement of impact.
Appendix
Available only for authorised users
Literature
1.
go back to reference Editorial: Unknown quantities. Nature. 2010, 465: 665-666. Editorial: Unknown quantities. Nature. 2010, 465: 665-666.
2.
go back to reference UK Evaluation Forum: Medical research: assessing the benefits to society. 2006, London: Academy of Medical Sciences UK Evaluation Forum: Medical research: assessing the benefits to society. 2006, London: Academy of Medical Sciences
4.
go back to reference Pang T, Terry RF, The PloS Medicine editors: WHO/PloS collection “No health without research”: a call for papers. PloS Medicine. 2011, 8: 1.CrossRef Pang T, Terry RF, The PloS Medicine editors: WHO/PloS collection “No health without research”: a call for papers. PloS Medicine. 2011, 8: 1.CrossRef
5.
go back to reference Hanney S, Grant J, Wooding S, Buxton M: Proposed methods for reviewing the outcomes of health research: the impact of funding by the UK’s ‘Arthritis Research Campaign’. Health Res Policy Syst. 2004, 2: 4. 10.1186/1478-4505-2-4.PubMedCentralCrossRefPubMed Hanney S, Grant J, Wooding S, Buxton M: Proposed methods for reviewing the outcomes of health research: the impact of funding by the UK’s ‘Arthritis Research Campaign’. Health Res Policy Syst. 2004, 2: 4. 10.1186/1478-4505-2-4.PubMedCentralCrossRefPubMed
6.
go back to reference Lee TH, Barnes J: Where next in basic allergy?. Clin Exp Allergy. 2002, 32: 499-506. 10.1046/j.0954-7894.2002.01367.x.CrossRefPubMed Lee TH, Barnes J: Where next in basic allergy?. Clin Exp Allergy. 2002, 32: 499-506. 10.1046/j.0954-7894.2002.01367.x.CrossRefPubMed
7.
go back to reference Buxton M, Hanney S, Morris S, Sundmacher L, Mestre-Ferrandiz J, Garau M, Sussex J, Grant J, Ismail S, Nason E, Wooding S: Medical research - What’s it worth? estimating the economic benefits from medical research in the UK. 2008, London: UK Evaluation Forum (Academy of Medical Sciences, MRC, Wellcome Trust) Buxton M, Hanney S, Morris S, Sundmacher L, Mestre-Ferrandiz J, Garau M, Sussex J, Grant J, Ismail S, Nason E, Wooding S: Medical research - What’s it worth? estimating the economic benefits from medical research in the UK. 2008, London: UK Evaluation Forum (Academy of Medical Sciences, MRC, Wellcome Trust)
8.
go back to reference Hanney S, Buxton M, Green C, Coulson D, Raftery J: An assessment of the impact of the NHS health technology assessment programme. Health Technol Assess. 2007, 11: 53.CrossRef Hanney S, Buxton M, Green C, Coulson D, Raftery J: An assessment of the impact of the NHS health technology assessment programme. Health Technol Assess. 2007, 11: 53.CrossRef
9.
go back to reference Canadian Academy of Medical Sciences: Making an impact: a preferred framework and indicators to measure returns on investment in health research. 2009, Ottowa: Canadian Academy of Medical Sciences Canadian Academy of Medical Sciences: Making an impact: a preferred framework and indicators to measure returns on investment in health research. 2009, Ottowa: Canadian Academy of Medical Sciences
10.
go back to reference Banzi R, Moja L, Pistotti V, Facchini A, Liberati A: Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviews. Health Res Policy Syst. 2011, 9: 26. 10.1186/1478-4505-9-26.PubMedCentralCrossRefPubMed Banzi R, Moja L, Pistotti V, Facchini A, Liberati A: Conceptual frameworks and empirical approaches used to assess the impact of health research: an overview of reviews. Health Res Policy Syst. 2011, 9: 26. 10.1186/1478-4505-9-26.PubMedCentralCrossRefPubMed
11.
go back to reference Buxton M, Hanney S: How can payback from health services research be assessed?. J Health Serv Res Policy. 1996, 1: 35-43.PubMed Buxton M, Hanney S: How can payback from health services research be assessed?. J Health Serv Res Policy. 1996, 1: 35-43.PubMed
12.
go back to reference Wooding S, Hanney S, Buxton M, Grant J: Payback arising from research funding: evaluation of the arthritis research campaign. Rheumatology (Oxford). 2005, 44: 1145-1156. 10.1093/rheumatology/keh708.CrossRef Wooding S, Hanney S, Buxton M, Grant J: Payback arising from research funding: evaluation of the arthritis research campaign. Rheumatology (Oxford). 2005, 44: 1145-1156. 10.1093/rheumatology/keh708.CrossRef
13.
go back to reference Oortwijn WJ, Hanney SR, Ligtvoet A, Hoorens S, Wooding S, Grant J, Buxton M, Bouter L: Assessing the impact of health technology assessment in The Netherlands. Int J Technol Assess Health Care. 2008, 24: 259-269.CrossRefPubMed Oortwijn WJ, Hanney SR, Ligtvoet A, Hoorens S, Wooding S, Grant J, Buxton M, Bouter L: Assessing the impact of health technology assessment in The Netherlands. Int J Technol Assess Health Care. 2008, 24: 259-269.CrossRefPubMed
14.
go back to reference Hanney S, Gonzalez-Block M, Buxton M, Kogan M: The utilisation of health research in policy-making: concepts, examples and methods of assessment. Health Res Policy Syst. 2003, 1: 2. 10.1186/1478-4505-1-2.PubMedCentralCrossRefPubMed Hanney S, Gonzalez-Block M, Buxton M, Kogan M: The utilisation of health research in policy-making: concepts, examples and methods of assessment. Health Res Policy Syst. 2003, 1: 2. 10.1186/1478-4505-1-2.PubMedCentralCrossRefPubMed
15.
go back to reference Jose PJ, Griffiths-Johnson DA, Collins PD, Walsh DT, Moqbel R, Totty NF, Truong O, Hsuan JJ, Williams TJ: Eotaxin: a potent eosinophil chemoattractant cytokine detected in a guinea-pig model of allergic airways inflammation. J Exp Med. 1994, 179: 881-887. 10.1084/jem.179.3.881.CrossRefPubMed Jose PJ, Griffiths-Johnson DA, Collins PD, Walsh DT, Moqbel R, Totty NF, Truong O, Hsuan JJ, Williams TJ: Eotaxin: a potent eosinophil chemoattractant cytokine detected in a guinea-pig model of allergic airways inflammation. J Exp Med. 1994, 179: 881-887. 10.1084/jem.179.3.881.CrossRefPubMed
16.
go back to reference Christie PE, Tagari P, Ford-Hutchinson AW, Charlesson S, Chee P, Arm JP, Lee TH: Urinary leukotriene-e4 concentrations increase after aspirin challenge in aspirin-sensitive asthmatic subjects. Am Rev Respir Dis. 1991, 143: 1025-1029. 10.1164/ajrccm/143.5_Pt_1.1025.CrossRefPubMed Christie PE, Tagari P, Ford-Hutchinson AW, Charlesson S, Chee P, Arm JP, Lee TH: Urinary leukotriene-e4 concentrations increase after aspirin challenge in aspirin-sensitive asthmatic subjects. Am Rev Respir Dis. 1991, 143: 1025-1029. 10.1164/ajrccm/143.5_Pt_1.1025.CrossRefPubMed
17.
go back to reference Durham SR, Walker SM, Varga EM, Jacobson MR, O’Brien F, Noble W, Till SJ, Hamid QA, Nouria-Aria KT: Long-term clinical efficacy of grass-pollen immunotherapy. N Engl J Med. 1999, 341: 468-475. 10.1056/NEJM199908123410702.CrossRefPubMed Durham SR, Walker SM, Varga EM, Jacobson MR, O’Brien F, Noble W, Till SJ, Hamid QA, Nouria-Aria KT: Long-term clinical efficacy of grass-pollen immunotherapy. N Engl J Med. 1999, 341: 468-475. 10.1056/NEJM199908123410702.CrossRefPubMed
18.
go back to reference Oldfield WL, Larche M, Kay AB: Effect of T-cell peptides derived from Fel d 1 on allergic reactions and cytokine production in patients sensitive to cats: a randomised controlled trial. Lancet. 2002, 360: 47-53. 10.1016/S0140-6736(02)09332-7.CrossRefPubMed Oldfield WL, Larche M, Kay AB: Effect of T-cell peptides derived from Fel d 1 on allergic reactions and cytokine production in patients sensitive to cats: a randomised controlled trial. Lancet. 2002, 360: 47-53. 10.1016/S0140-6736(02)09332-7.CrossRefPubMed
20.
go back to reference Thomas M, McKinley RK, Mellor S, Watkin G, Holloway E, Scullion J, Shaw DE, Warlaw A, Price D, Pavord I: Breathing exercises for asthma: a randomised controlled trial. Thorax. 2009, 64: 55-61.CrossRefPubMed Thomas M, McKinley RK, Mellor S, Watkin G, Holloway E, Scullion J, Shaw DE, Warlaw A, Price D, Pavord I: Breathing exercises for asthma: a randomised controlled trial. Thorax. 2009, 64: 55-61.CrossRefPubMed
21.
go back to reference Bott J, Blumenthal S, Buxton M, Ellum S, Falconer C, Garrod R: Guidelines for the physiotherapy management of the adult, medical, spontaneously breathing patient. Thorax. 2009, 64 (Suppl 1): i1-i51. 10.1136/thx.2008.110726.CrossRefPubMed Bott J, Blumenthal S, Buxton M, Ellum S, Falconer C, Garrod R: Guidelines for the physiotherapy management of the adult, medical, spontaneously breathing patient. Thorax. 2009, 64 (Suppl 1): i1-i51. 10.1136/thx.2008.110726.CrossRefPubMed
22.
go back to reference Scadding GK, Durham SR, Mirakian R, Jones NS, Leech SC, Farooque S: BSACI guidelines for the management of allergic and non-allergic rhinitis. Clin Exp Allergy. 2008, 38: 19-42.CrossRefPubMed Scadding GK, Durham SR, Mirakian R, Jones NS, Leech SC, Farooque S: BSACI guidelines for the management of allergic and non-allergic rhinitis. Clin Exp Allergy. 2008, 38: 19-42.CrossRefPubMed
23.
go back to reference Bacharier LB, Boner A, Carlsen KH, Eigenmann PA, Frischer T, Gotz M, Helms PJ, Hunt J, Liu A, Papadopoulos N, Platts-Mills T, Pohunek P, Simons FER, Valovirta E, Wahn U, Wildhaber J, The European Pediatric Asthma Group: Diagnosis and treatment of asthma in childhood: a PRACTALL consensus report. Allergy. 2008, 63: 5-34. 10.1111/j.1398-9995.2008.01640.x.CrossRefPubMed Bacharier LB, Boner A, Carlsen KH, Eigenmann PA, Frischer T, Gotz M, Helms PJ, Hunt J, Liu A, Papadopoulos N, Platts-Mills T, Pohunek P, Simons FER, Valovirta E, Wahn U, Wildhaber J, The European Pediatric Asthma Group: Diagnosis and treatment of asthma in childhood: a PRACTALL consensus report. Allergy. 2008, 63: 5-34. 10.1111/j.1398-9995.2008.01640.x.CrossRefPubMed
24.
go back to reference Dicpinigaitis PV: Chronic cough due to asthma: ACCP evidence-based clinical practice guidelines. Chest. 2006, 129 (1 Suppl): 75S-79S.CrossRefPubMed Dicpinigaitis PV: Chronic cough due to asthma: ACCP evidence-based clinical practice guidelines. Chest. 2006, 129 (1 Suppl): 75S-79S.CrossRefPubMed
25.
go back to reference Brightling CE, Bradding P, Symon FA, Holgate ST, Wardlaw AJ, Pavord ID: Mast-cell infiltration of airway smooth muscle in asthma. N Engl J Med. 2002, 346: 1699-1705. 10.1056/NEJMoa012705.CrossRefPubMed Brightling CE, Bradding P, Symon FA, Holgate ST, Wardlaw AJ, Pavord ID: Mast-cell infiltration of airway smooth muscle in asthma. N Engl J Med. 2002, 346: 1699-1705. 10.1056/NEJMoa012705.CrossRefPubMed
27.
go back to reference Saglani S, Nicholson AG, Scallan M, Balfour-Lynn I, Rosenthal M, Payne DN, Bush A: Investigation of young children with severe recurrent wheeze: any clinical benefit?. Eur Respir J. 2006, 27: 29-35. 10.1183/09031936.06.00030605.CrossRefPubMed Saglani S, Nicholson AG, Scallan M, Balfour-Lynn I, Rosenthal M, Payne DN, Bush A: Investigation of young children with severe recurrent wheeze: any clinical benefit?. Eur Respir J. 2006, 27: 29-35. 10.1183/09031936.06.00030605.CrossRefPubMed
28.
go back to reference Berry MA, Shaw DE, Green RH, Brightling CE, Wardlaw AJ, Pavord ID: The use of exhaled nitric oxide concentration to identify eosinophilic airway inflammation: an observational study in adults with asthma. Clin Exp Allergy. 2005, 35: 1175-1179. 10.1111/j.1365-2222.2005.02314.x.CrossRefPubMed Berry MA, Shaw DE, Green RH, Brightling CE, Wardlaw AJ, Pavord ID: The use of exhaled nitric oxide concentration to identify eosinophilic airway inflammation: an observational study in adults with asthma. Clin Exp Allergy. 2005, 35: 1175-1179. 10.1111/j.1365-2222.2005.02314.x.CrossRefPubMed
29.
go back to reference Jadad AR, Sigouin C, Mohide PT, Levine M, Fuentes M: Risk of congenital malformations associated with treatment of asthma during early pregnancy. Lancet. 2000, 355: 119. 10.1016/S0140-6736(99)02542-8.CrossRefPubMed Jadad AR, Sigouin C, Mohide PT, Levine M, Fuentes M: Risk of congenital malformations associated with treatment of asthma during early pregnancy. Lancet. 2000, 355: 119. 10.1016/S0140-6736(99)02542-8.CrossRefPubMed
30.
go back to reference Tata LJ, Lewis SA, McKeever TM, Smith CJ, Doyle P, Smeeth L, Gibson JE, Hubbard RH: Effect of maternal asthma, exacerbations and asthma medication use on congenital malformations in offspring: a UK population-based study. Thorax. 2008, 63: 981-987. 10.1136/thx.2008.098244.CrossRefPubMed Tata LJ, Lewis SA, McKeever TM, Smith CJ, Doyle P, Smeeth L, Gibson JE, Hubbard RH: Effect of maternal asthma, exacerbations and asthma medication use on congenital malformations in offspring: a UK population-based study. Thorax. 2008, 63: 981-987. 10.1136/thx.2008.098244.CrossRefPubMed
32.
go back to reference Xystrakis E, Kusumakar S, Boswell S, Peek E, Urry Z, Richards DF, Adikibi T, Pridgeon C, Dallman M, Loke TK, Robinson DS, Barrat FJ, O’Garra A, Lavender P, Lee TH, Corrigan C, Hawrylowicz CM: Reversing the defective induction of IL-10-secreting regulatory T cells in glucocorticoid-resistant asthma patients. J Clin Invest. 2006, 116: 146-155.PubMedCentralCrossRefPubMed Xystrakis E, Kusumakar S, Boswell S, Peek E, Urry Z, Richards DF, Adikibi T, Pridgeon C, Dallman M, Loke TK, Robinson DS, Barrat FJ, O’Garra A, Lavender P, Lee TH, Corrigan C, Hawrylowicz CM: Reversing the defective induction of IL-10-secreting regulatory T cells in glucocorticoid-resistant asthma patients. J Clin Invest. 2006, 116: 146-155.PubMedCentralCrossRefPubMed
33.
go back to reference Christie PE, Smith CM, Lee TH: The potent and selective sulfidopeptide leukotriene antagonist, SK&F 104353, inhibits aspirin-induced asthma. Am Rev Respir Dis. 1991, 144: 957-958. 10.1164/ajrccm/144.4.957.CrossRefPubMed Christie PE, Smith CM, Lee TH: The potent and selective sulfidopeptide leukotriene antagonist, SK&F 104353, inhibits aspirin-induced asthma. Am Rev Respir Dis. 1991, 144: 957-958. 10.1164/ajrccm/144.4.957.CrossRefPubMed
34.
go back to reference Laitinen LA, Laitinen A, Haahtela T, Vikka V, Spur BW, Lee TH: Leukotriene E and granulocytic infiltration into asthmatic airways. The Lancet. 1993, 341: 989-990. 10.1016/0140-6736(93)91073-U.CrossRef Laitinen LA, Laitinen A, Haahtela T, Vikka V, Spur BW, Lee TH: Leukotriene E and granulocytic infiltration into asthmatic airways. The Lancet. 1993, 341: 989-990. 10.1016/0140-6736(93)91073-U.CrossRef
35.
go back to reference Wark PA, Johnston SL, Bucchieri F, Powell R, Puddicombe S, Laza-Stanca V, Holgate ST, Davies DE: Asthmatic bronchial epithelial cells have a deficient innate immune response to infection with rhinovirus. J Exp Med. 2005, 201: 937-947. 10.1084/jem.20041901.PubMedCentralCrossRefPubMed Wark PA, Johnston SL, Bucchieri F, Powell R, Puddicombe S, Laza-Stanca V, Holgate ST, Davies DE: Asthmatic bronchial epithelial cells have a deficient innate immune response to infection with rhinovirus. J Exp Med. 2005, 201: 937-947. 10.1084/jem.20041901.PubMedCentralCrossRefPubMed
36.
go back to reference Synairgen: IFNβ in Asthma. http://www.synairgen.com/programmes/ifn-β-in-asthma.aspx. Synairgen: IFNβ in Asthma. http://​www.​synairgen.​com/​programmes/​ifn-β-in-asthma.​aspx.​
37.
go back to reference O’Byrne PM, Gauvreau GM, Murphy DM: Efficacy of leukotriene receptor antagonists and synthesis inhibitors in asthma. J Allergy Clin Immunol. 2009, 124: 397-403. 10.1016/j.jaci.2009.05.029.CrossRefPubMed O’Byrne PM, Gauvreau GM, Murphy DM: Efficacy of leukotriene receptor antagonists and synthesis inhibitors in asthma. J Allergy Clin Immunol. 2009, 124: 397-403. 10.1016/j.jaci.2009.05.029.CrossRefPubMed
38.
go back to reference Walker S, Khan-Wasti S, Fletcher M, Cullinan P, Harris J, Sheikh A: Seasonal allergic rhinitis is associated with a detrimental effect on examination performance in united kingdom teenagers: case-controlled study. J Allergy Clin Immunol. 2007, 120: 381-387. 10.1016/j.jaci.2007.03.034.CrossRefPubMed Walker S, Khan-Wasti S, Fletcher M, Cullinan P, Harris J, Sheikh A: Seasonal allergic rhinitis is associated with a detrimental effect on examination performance in united kingdom teenagers: case-controlled study. J Allergy Clin Immunol. 2007, 120: 381-387. 10.1016/j.jaci.2007.03.034.CrossRefPubMed
39.
go back to reference House of Lords Science and Technology Committee: Allergy. Volume 1: Report. HL Paper 166-1. 2007, London: The Stationery Office House of Lords Science and Technology Committee: Allergy. Volume 1: Report. HL Paper 166-1. 2007, London: The Stationery Office
40.
go back to reference Cooksey D: A review of UK health research funding. 2006, London: HM Treasury Cooksey D: A review of UK health research funding. 2006, London: HM Treasury
41.
go back to reference Hanney S, Kuruvilla S, Soper B, Mays N: Who needs what from a national health research system: lessons from reforms to the English department of Health’s R&D system. Health Res Policy Syst. 2010, 8: 11. 10.1186/1478-4505-8-11.PubMedCentralCrossRefPubMed Hanney S, Kuruvilla S, Soper B, Mays N: Who needs what from a national health research system: lessons from reforms to the English department of Health’s R&D system. Health Res Policy Syst. 2010, 8: 11. 10.1186/1478-4505-8-11.PubMedCentralCrossRefPubMed
42.
go back to reference National Institute for Health Research: Delivering health research: national institute for health research progress report 2008/9. 2009, London: Department of Health National Institute for Health Research: Delivering health research: national institute for health research progress report 2008/9. 2009, London: Department of Health
44.
go back to reference Nason E, Curran B, Hanney S, Janta B, Hastings G, O’Driscoll M, Wooding S: Evaluating health research funding in Ireland: assessing the impacts of the Health Research Board of Ireland’s funding activities. Res Eval. 2011, 20: 193-200. 10.3152/095820211X12941371876823.CrossRef Nason E, Curran B, Hanney S, Janta B, Hastings G, O’Driscoll M, Wooding S: Evaluating health research funding in Ireland: assessing the impacts of the Health Research Board of Ireland’s funding activities. Res Eval. 2011, 20: 193-200. 10.3152/095820211X12941371876823.CrossRef
45.
go back to reference Adam P, Solans-Domènech M, Pons JMV, Aymerich M, Berra S, Guillamon I, Sánchez E, Permanyer-Miralda G: Assessment of the impact of a clinical and health services research call in Catalonia. Res Eval. 2012, 21: 319-328. 10.1093/reseval/rvs024.CrossRef Adam P, Solans-Domènech M, Pons JMV, Aymerich M, Berra S, Guillamon I, Sánchez E, Permanyer-Miralda G: Assessment of the impact of a clinical and health services research call in Catalonia. Res Eval. 2012, 21: 319-328. 10.1093/reseval/rvs024.CrossRef
Metadata
Title
Conducting retrospective impact analysis to inform a medical research charity’s funding strategies: the case of Asthma UK
Authors
Stephen R Hanney
Amanda Watt
Teresa H Jones
Leanne Metcalf
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Allergy, Asthma & Clinical Immunology / Issue 1/2013
Electronic ISSN: 1710-1492
DOI
https://doi.org/10.1186/1710-1492-9-17

Other articles of this Issue 1/2013

Allergy, Asthma & Clinical Immunology 1/2013 Go to the issue