Skip to main content
Top
Published in: PharmacoEconomics 5/2017

Open Access 01-05-2017 | Original Research Article

Economic Evaluations Alongside Efficient Study Designs Using Large Observational Datasets: the PLEASANT Trial Case Study

Authors: Matthew Franklin, Sarah Davis, Michelle Horspool, Wei Sun Kua, Steven Julious

Published in: PharmacoEconomics | Issue 5/2017

Login to get access

Abstract

Background

Large observational datasets such as Clinical Practice Research Datalink (CPRD) provide opportunities to conduct clinical studies and economic evaluations with efficient designs.

Objectives

Our objectives were to report the economic evaluation methodology for a cluster randomised controlled trial (RCT) of a UK NHS-delivered public health intervention for children with asthma that was evaluated using CPRD and describe the impact of this methodology on results.

Methods

CPRD identified eligible patients using predefined asthma diagnostic codes and captured 1-year pre- and post-intervention healthcare contacts (August 2012 to July 2014). Quality-adjusted life-years (QALYs) 4 months post-intervention were estimated by assigning utility values to exacerbation-related contacts; a systematic review identified these utility values because preference-based outcome measures were not collected. Bootstrapped costs were evaluated 12 months post-intervention, both with 1-year regression-based baseline adjustment (BA) and without BA (observed).

Results

Of 12,179 patients recruited, 8190 (intervention 3641; control 4549) were evaluated in the primary analysis, which included patients who received the protocol-defined intervention and for whom CPRD data were available. The intervention’s per-patient incremental QALY loss was 0.00017 (bias-corrected and accelerated 95% confidence intervals [BCa 95% CI] –0.00051 to 0.00018) and cost savings were £14.74 (observed; BCa 95% CI –75.86 to 45.19) or £36.07 (BA; BCa 95% CI –77.11 to 9.67), respectively. The probability of cost savings was much higher when accounting for BA versus observed costs due to baseline cost differences between trial arms (96.3 vs. 67.3%, respectively).

Conclusion

Economic evaluations using data from a large observational database without any primary data collection is feasible, informative and potentially efficient.
Clinical Trials Registration Number: ISRCTN03000938.
Appendix
Available only for authorised users
Literature
4.
go back to reference van Staa T-P, Goldacre B, Gulliford M, Cassell J, Pirmohamed M, Taweel A, et al. Pragmatic randomised trials using routine electronic health records: putting them to the test. BMJ. 2012;344:1–7.CrossRef van Staa T-P, Goldacre B, Gulliford M, Cassell J, Pirmohamed M, Taweel A, et al. Pragmatic randomised trials using routine electronic health records: putting them to the test. BMJ. 2012;344:1–7.CrossRef
5.
go back to reference Thorn JC, Coast J, Cohen D, Hollingworth W, Knapp M, Noble SM, et al. Resource-use measurement based on patient recall: issues and challenges for economic evaluation. Appl Health Econ Health Policy. 2013;11(3):155–61.CrossRef Thorn JC, Coast J, Cohen D, Hollingworth W, Knapp M, Noble SM, et al. Resource-use measurement based on patient recall: issues and challenges for economic evaluation. Appl Health Econ Health Policy. 2013;11(3):155–61.CrossRef
6.
go back to reference Franklin M, Berdunov V, Edmans J, Conroy S, Gladman J, Tanajewski L, et al. Identifying patient-level health and social care costs for older adults discharged from acute medical units in England. Age Ageing. 2014;43(5):703–7.CrossRef Franklin M, Berdunov V, Edmans J, Conroy S, Gladman J, Tanajewski L, et al. Identifying patient-level health and social care costs for older adults discharged from acute medical units in England. Age Ageing. 2014;43(5):703–7.CrossRef
7.
go back to reference Tanajewski L, Franklin M, Gkountouras G, Berdunov V, Edmans J, Conroy S, et al. Cost-effectiveness of a specialist geriatric medical intervention for frail older people discharged from acute medical units: economic evaluation in a two-centre randomised controlled trial (AMIGOS). PloS One. 2015;10(5):1–18.CrossRef Tanajewski L, Franklin M, Gkountouras G, Berdunov V, Edmans J, Conroy S, et al. Cost-effectiveness of a specialist geriatric medical intervention for frail older people discharged from acute medical units: economic evaluation in a two-centre randomised controlled trial (AMIGOS). PloS One. 2015;10(5):1–18.CrossRef
8.
go back to reference Tanajewski L, Franklin M, Gkountouras G, Berdunov V, Harwood RH, Goldberg SE, et al. Economic Evaluation of a general hospital unit for older people with delirium and dementia (TEAM Randomised Controlled Trial). PloS One. 2015;10(12):1–20.CrossRef Tanajewski L, Franklin M, Gkountouras G, Berdunov V, Harwood RH, Goldberg SE, et al. Economic Evaluation of a general hospital unit for older people with delirium and dementia (TEAM Randomised Controlled Trial). PloS One. 2015;10(12):1–20.CrossRef
9.
go back to reference Horspool MJ, Julious SA, Boote J, Bradburn MJ, Cooper CL, Davis S, et al. Preventing and lessening exacerbations of asthma in school-age children associated with a new term (PLEASANT): study protocol for a cluster randomised control trial. Trials. 2013;14:297–307.CrossRef Horspool MJ, Julious SA, Boote J, Bradburn MJ, Cooper CL, Davis S, et al. Preventing and lessening exacerbations of asthma in school-age children associated with a new term (PLEASANT): study protocol for a cluster randomised control trial. Trials. 2013;14:297–307.CrossRef
10.
go back to reference Julious SA, Horspool MJ, Davis S, Bradburn M, Norman P, Shephard N, et al. PLEASANT: preventing and lessening exacerbations of asthma in school-age children associated with a new term—a cluster randomised controlled trial and economic evaluation. Health Technol Assess. 2016;20(93). Julious SA, Horspool MJ, Davis S, Bradburn M, Norman P, Shephard N, et al. PLEASANT: preventing and lessening exacerbations of asthma in school-age children associated with a new term—a cluster randomised controlled trial and economic evaluation. Health Technol Assess. 2016;20(93).
11.
go back to reference Williams T, Van Staa T, Puri S, Eaton S. Recent advances in the utility and use of the General Practice Research Database as an example of a UK Primary Care Data resource. Ther Adv Drug Saf. 2012;3(2):89–99.CrossRef Williams T, Van Staa T, Puri S, Eaton S. Recent advances in the utility and use of the General Practice Research Database as an example of a UK Primary Care Data resource. Ther Adv Drug Saf. 2012;3(2):89–99.CrossRef
12.
go back to reference Tate AR, Beloff N, Al-Radwan B, Wickson J, Puri S, Williams T, et al. Exploiting the potential of large databases of electronic health records for research using rapid search algorithms and an intuitive query interface. J Am Med Inform Assoc. 2014;21(2):292–8.CrossRef Tate AR, Beloff N, Al-Radwan B, Wickson J, Puri S, Williams T, et al. Exploiting the potential of large databases of electronic health records for research using rapid search algorithms and an intuitive query interface. J Am Med Inform Assoc. 2014;21(2):292–8.CrossRef
13.
go back to reference Herrett E, Gallagher AM, Bhaskaran K, Forbes H, Mathur R, van Staa T, et al. Data resource profile: clinical practice research datalink (CPRD). Int J Epidemiol. 2015;44(3):827–36.CrossRef Herrett E, Gallagher AM, Bhaskaran K, Forbes H, Mathur R, van Staa T, et al. Data resource profile: clinical practice research datalink (CPRD). Int J Epidemiol. 2015;44(3):827–36.CrossRef
14.
go back to reference Julious S, Campbell M, Bianchi S, Murray-Thomas T. Seasonality of medical contacts in school-aged children with asthma: association with school holidays. Public Health. 2011;125(11):769–76.CrossRef Julious S, Campbell M, Bianchi S, Murray-Thomas T. Seasonality of medical contacts in school-aged children with asthma: association with school holidays. Public Health. 2011;125(11):769–76.CrossRef
15.
go back to reference Horspool MJ, Julious SA, Mooney C, May R, Sully B, Smithson WH. Preventing and lessening exacerbations of asthma in school-aged children associated with a new term (PLEASANT): recruiting primary care research sites–the PLEASANT experience. NPJ Prim Care Respir Med. 2015;25:15066.CrossRef Horspool MJ, Julious SA, Mooney C, May R, Sully B, Smithson WH. Preventing and lessening exacerbations of asthma in school-aged children associated with a new term (PLEASANT): recruiting primary care research sites–the PLEASANT experience. NPJ Prim Care Respir Med. 2015;25:15066.CrossRef
16.
go back to reference British Thoracic Society/Scottish Intercollegiate Guidelines Network. British guideline on the management of asthma: a national clinical guideline. Edinburgh: BTS; 2012. British Thoracic Society/Scottish Intercollegiate Guidelines Network. British guideline on the management of asthma: a national clinical guideline. Edinburgh: BTS; 2012.
17.
go back to reference Bush A. Diagnosis of asthma in children under five. Prim Care Respir J. 2007;16(1):7–15.CrossRef Bush A. Diagnosis of asthma in children under five. Prim Care Respir J. 2007;16(1):7–15.CrossRef
18.
go back to reference Curtis L. Unit costs of health and social care. Cantebury: University of Kent; 2014. Curtis L. Unit costs of health and social care. Cantebury: University of Kent; 2014.
19.
go back to reference Hatfield I, Julious S, Davis S, Horspool M, Norman P, Mooney C. An assessment of the resources used by general practices in the intervention arm of the PLEASANT study in sending out the intervention. ScHARR Report Series: no. 302015. Sheffield: University of Sheffield; 2015. Hatfield I, Julious S, Davis S, Horspool M, Norman P, Mooney C. An assessment of the resources used by general practices in the intervention arm of the PLEASANT study in sending out the intervention. ScHARR Report Series: no. 302015. Sheffield: University of Sheffield; 2015.
20.
go back to reference National Institute for Health Research. Clinical Research Network Industry Costing Template. NIHR; 2015. National Institute for Health Research. Clinical Research Network Industry Costing Template. NIHR; 2015.
21.
go back to reference Department of Health. National schedule of reference costs. UK DoH; 2014. Department of Health. National schedule of reference costs. UK DoH; 2014.
22.
go back to reference Joint Formularly Committee. BNF for Children August 2015. 2015. Joint Formularly Committee. BNF for Children August 2015. 2015.
23.
go back to reference National Institute for Health and Care Excellence. Guide to the methods of technology appraisal. London: NICE; 2013. National Institute for Health and Care Excellence. Guide to the methods of technology appraisal. London: NICE; 2013.
24.
go back to reference Kua WS, Davis S. Systematic review of health state utilities in children with asthma. Health Economics and Decision Science (HEDS) Discussion Paper Series. Sheffield; University of Sheffield; 2016. Kua WS, Davis S. Systematic review of health state utilities in children with asthma. Health Economics and Decision Science (HEDS) Discussion Paper Series. Sheffield; University of Sheffield; 2016.
25.
go back to reference Briggs A, Bousquet J, Wallace M, Busse WW, Clark T, Pedersen S, et al. Cost-effectiveness of asthma control: an economic appraisal of the GOAL study. Allergy. 2006;61(5):531–6.CrossRef Briggs A, Bousquet J, Wallace M, Busse WW, Clark T, Pedersen S, et al. Cost-effectiveness of asthma control: an economic appraisal of the GOAL study. Allergy. 2006;61(5):531–6.CrossRef
26.
go back to reference Lloyd A, Price D, Brown R. The impact of asthma exacerbations on health-related quality of life in moderate to severe asthma patients in the UK. Prim Care Respir J. 2007;16(1):22–7.CrossRef Lloyd A, Price D, Brown R. The impact of asthma exacerbations on health-related quality of life in moderate to severe asthma patients in the UK. Prim Care Respir J. 2007;16(1):22–7.CrossRef
27.
go back to reference Willems DC, Joore MA, Hendriks JJ, Wouters EF, Severens JL. Cost-effectiveness of a nurse-led telemonitoring intervention based on peak expiratory flow measurements in asthmatics: results of a randomised controlled trial. Cost Effect Resour Alloc. 2007;5:10–25.CrossRef Willems DC, Joore MA, Hendriks JJ, Wouters EF, Severens JL. Cost-effectiveness of a nurse-led telemonitoring intervention based on peak expiratory flow measurements in asthmatics: results of a randomised controlled trial. Cost Effect Resour Alloc. 2007;5:10–25.CrossRef
29.
go back to reference Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. Oxford: Oxford University Press; 2005. Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. Oxford: Oxford University Press; 2005.
30.
go back to reference Hunter RM, Baio G, Butt T, Morris S, Round J, Freemantle N. An educational review of the statistical issues in analysing utility data for cost-utility analysis. Pharmacoeconomics. 2015;33(4):355–66.CrossRef Hunter RM, Baio G, Butt T, Morris S, Round J, Freemantle N. An educational review of the statistical issues in analysing utility data for cost-utility analysis. Pharmacoeconomics. 2015;33(4):355–66.CrossRef
31.
go back to reference Ridyard CH, Hughes DA. Methods for the collection of resource use data within clinical trials: a systematic review of studies funded by the UK Health Technology Assessment program. Value Health. 2010;13(8):867–72.CrossRef Ridyard CH, Hughes DA. Methods for the collection of resource use data within clinical trials: a systematic review of studies funded by the UK Health Technology Assessment program. Value Health. 2010;13(8):867–72.CrossRef
32.
go back to reference van Asselt AD, van Mastrigt GA, Dirksen CD, Arntz A, Severens JL, Kessels AG. How to deal with cost differences at baseline. Pharmacoeconomics. 2009;27(6):519–28.CrossRef van Asselt AD, van Mastrigt GA, Dirksen CD, Arntz A, Severens JL, Kessels AG. How to deal with cost differences at baseline. Pharmacoeconomics. 2009;27(6):519–28.CrossRef
33.
go back to reference Manca A, Hawkins N, Sculpher MJ. Estimating mean QALYs in trial-based cost-effectiveness analysis: the importance of controlling for baseline utility. Health Econ. 2005;14(5):487–96.CrossRef Manca A, Hawkins N, Sculpher MJ. Estimating mean QALYs in trial-based cost-effectiveness analysis: the importance of controlling for baseline utility. Health Econ. 2005;14(5):487–96.CrossRef
34.
go back to reference Efron B. Better bootstrap confidence intervals. J Am Stat Assoc. 1987;82(397):171–85.CrossRef Efron B. Better bootstrap confidence intervals. J Am Stat Assoc. 1987;82(397):171–85.CrossRef
35.
go back to reference Oehlert GW. A note on the delta method. Am Stat. 1992;46(1):27–9. Oehlert GW. A note on the delta method. Am Stat. 1992;46(1):27–9.
36.
go back to reference StataCorp. Stata Statistical Software: Release 14. College Station: StataCorp LP; 2015. StataCorp. Stata Statistical Software: Release 14. College Station: StataCorp LP; 2015.
37.
go back to reference Felli JC, Hazen GB. Sensitivity analysis and the expected value of perfect information. Med Decis Mak. 1998;18(1):95–109.CrossRef Felli JC, Hazen GB. Sensitivity analysis and the expected value of perfect information. Med Decis Mak. 1998;18(1):95–109.CrossRef
38.
go back to reference Geue C, Lewsey J, Lorgelly P, Govan L, Hart C, Briggs A. Spoilt for choice: implications of using alternative methods of costing hospital episode statistics. Health Econ. 2012;21(10):1201–16.CrossRef Geue C, Lewsey J, Lorgelly P, Govan L, Hart C, Briggs A. Spoilt for choice: implications of using alternative methods of costing hospital episode statistics. Health Econ. 2012;21(10):1201–16.CrossRef
39.
go back to reference Thorn JC, Turner E, Hounsome L, Walsh E, Donovan JL, Verne J, et al. Validation of the hospital episode statistics outpatient dataset in England. Pharmacoeconomics. 2016;34(2):161–8.CrossRef Thorn JC, Turner E, Hounsome L, Walsh E, Donovan JL, Verne J, et al. Validation of the hospital episode statistics outpatient dataset in England. Pharmacoeconomics. 2016;34(2):161–8.CrossRef
40.
go back to reference Spencer SA, Davies MP. Hospital episode statistics: improving the quality and value of hospital data: a national internet e-survey of hospital consultants. BMJ Open. 2012;2(6):e001651.CrossRef Spencer SA, Davies MP. Hospital episode statistics: improving the quality and value of hospital data: a national internet e-survey of hospital consultants. BMJ Open. 2012;2(6):e001651.CrossRef
41.
go back to reference Thorn JC, Turner EL, Hounsome L, Walsh E, Down L, Verne J, et al. Validating the use of Hospital Episode Statistics data and comparison of costing methodologies for economic evaluation: an end-of-life case study from the Cluster randomised triAl of PSA testing for Prostate cancer (CAP). BMJ Open. 2016;6(4):e011063.CrossRef Thorn JC, Turner EL, Hounsome L, Walsh E, Down L, Verne J, et al. Validating the use of Hospital Episode Statistics data and comparison of costing methodologies for economic evaluation: an end-of-life case study from the Cluster randomised triAl of PSA testing for Prostate cancer (CAP). BMJ Open. 2016;6(4):e011063.CrossRef
42.
go back to reference Baker R, Tata LJ, Kendrick D, Orton E. Identification of incident poisoning, fracture and burn events using linked primary care, secondary care and mortality data from England: implications for research and surveillance. Inj Prev. 2016;22(1):59–67.CrossRef Baker R, Tata LJ, Kendrick D, Orton E. Identification of incident poisoning, fracture and burn events using linked primary care, secondary care and mortality data from England: implications for research and surveillance. Inj Prev. 2016;22(1):59–67.CrossRef
43.
go back to reference Herrett E, Shah AD, Boggon R, Denaxas S, Smeeth L, van Staa T, et al. Completeness and diagnostic validity of recording acute myocardial infarction events in primary care, hospital care, disease registry, and national mortality records: cohort study. BMJ. 2013;346:f2350.CrossRef Herrett E, Shah AD, Boggon R, Denaxas S, Smeeth L, van Staa T, et al. Completeness and diagnostic validity of recording acute myocardial infarction events in primary care, hospital care, disease registry, and national mortality records: cohort study. BMJ. 2013;346:f2350.CrossRef
44.
go back to reference Asaria M, Grasic K, Walker S. Using linked electronic health records to estimate healthcare costs: key challenges and opportunities. Pharmacoeconomics. 2016;34(2):155–60.CrossRef Asaria M, Grasic K, Walker S. Using linked electronic health records to estimate healthcare costs: key challenges and opportunities. Pharmacoeconomics. 2016;34(2):155–60.CrossRef
45.
go back to reference Cropper J, Frank T, Frank P, Laybourn M, Hannaford P. Respiratory illness and healthcare utilization in children: the primary and secondary care interface. Eur Respir J. 2001;17(5):892–7.CrossRef Cropper J, Frank T, Frank P, Laybourn M, Hannaford P. Respiratory illness and healthcare utilization in children: the primary and secondary care interface. Eur Respir J. 2001;17(5):892–7.CrossRef
46.
go back to reference ONS. Census—population and household estimates for England and Wales, March 2011. UK: Office for National Statistics (ONS); 2012. ONS. Census—population and household estimates for England and Wales, March 2011. UK: Office for National Statistics (ONS); 2012.
47.
go back to reference Mathur R, Bhaskaran K, Chaturvedi N, Leon DA, Grundy E, Smeeth L. Completeness and usability of ethnicity data in UK-based primary care and hospital databases. J Public Health. 2014;36(4):684–92.CrossRef Mathur R, Bhaskaran K, Chaturvedi N, Leon DA, Grundy E, Smeeth L. Completeness and usability of ethnicity data in UK-based primary care and hospital databases. J Public Health. 2014;36(4):684–92.CrossRef
48.
go back to reference Bhaskaran K, Forbes HJ, Douglas I, Leon DA, Smeeth L. Representativeness and optimal use of body mass index (BMI) in the UK clinical practice research datalink (CPRD). BMJ Open. 2013;3(9):e003389.CrossRef Bhaskaran K, Forbes HJ, Douglas I, Leon DA, Smeeth L. Representativeness and optimal use of body mass index (BMI) in the UK clinical practice research datalink (CPRD). BMJ Open. 2013;3(9):e003389.CrossRef
49.
go back to reference Campbell J, Dedman DJ, Eaton SC, Gallagher AM, Williams TJ, editors. Is the CPRD GOLD population comparable to the UK population? Pharmacoepidemiology and Drug Safety. Hoboken: Wiley-Blackwell; 2013. Campbell J, Dedman DJ, Eaton SC, Gallagher AM, Williams TJ, editors. Is the CPRD GOLD population comparable to the UK population? Pharmacoepidemiology and Drug Safety. Hoboken: Wiley-Blackwell; 2013.
50.
go back to reference Department of Health. A Simple Guide to Payment by Results. UK DoH; 2013. Department of Health. A Simple Guide to Payment by Results. UK DoH; 2013.
52.
go back to reference Wright N, Ivers N, Eldridge S, Taljaard M, Bremner S. A review of the use of covariates in cluster randomized trials uncovers marked discrepancies between guidance and practice. J Clin Epidemiol. 2015;68(6):603–9.CrossRef Wright N, Ivers N, Eldridge S, Taljaard M, Bremner S. A review of the use of covariates in cluster randomized trials uncovers marked discrepancies between guidance and practice. J Clin Epidemiol. 2015;68(6):603–9.CrossRef
53.
go back to reference Morriss R, Kai J, Atha C, Avery A, Bayes S, Franklin M, et al. Persistent frequent attenders in primary care: costs, reasons for attendance, organisation of care and potential for cognitive behavioural therapeutic intervention. BMC Fam Pract. 2012;13(1):39–53.CrossRef Morriss R, Kai J, Atha C, Avery A, Bayes S, Franklin M, et al. Persistent frequent attenders in primary care: costs, reasons for attendance, organisation of care and potential for cognitive behavioural therapeutic intervention. BMC Fam Pract. 2012;13(1):39–53.CrossRef
Metadata
Title
Economic Evaluations Alongside Efficient Study Designs Using Large Observational Datasets: the PLEASANT Trial Case Study
Authors
Matthew Franklin
Sarah Davis
Michelle Horspool
Wei Sun Kua
Steven Julious
Publication date
01-05-2017
Publisher
Springer International Publishing
Published in
PharmacoEconomics / Issue 5/2017
Print ISSN: 1170-7690
Electronic ISSN: 1179-2027
DOI
https://doi.org/10.1007/s40273-016-0484-y

Other articles of this Issue 5/2017

PharmacoEconomics 5/2017 Go to the issue