Skip to main content
Top
Published in: PharmacoEconomics 2/2016

01-02-2016 | Original Research Article

Validation of the Hospital Episode Statistics Outpatient Dataset in England

Authors: Joanna C. Thorn, Emma Turner, Luke Hounsome, Eleanor Walsh, Jenny L. Donovan, Julia Verne, David E. Neal, Freddie C. Hamdy, Richard M. Martin, Sian M. Noble

Published in: PharmacoEconomics | Issue 2/2016

Login to get access

Abstract

Objectives

The Hospital Episode Statistics (HES) dataset is a source of administrative ‘big data’ with potential for costing purposes in economic evaluations alongside clinical trials. This study assesses the validity of coverage in the HES outpatient dataset.

Methods

Men who died of, or with, prostate cancer were selected from a prostate-cancer screening trial (CAP, Cluster randomised triAl of PSA testing for Prostate cancer). Details of visits that took place after 1/4/2003 to hospital outpatient departments for conditions related to prostate cancer were extracted from medical records (MR); these appointments were sought in the HES outpatient dataset based on date. The matching procedure was repeated for periods before and after 1/4/2008, when the HES outpatient dataset was accredited as a national statistic.

Results

4922 outpatient appointments were extracted from MR for 370 men. 4088 appointments recorded in MR were identified in the HES outpatient dataset (83.1 %; 95 % confidence interval [CI] 82.0–84.1). For appointments occurring prior to 1/4/2008, 2195/2755 (79.7 %; 95 % CI 78.2–81.2) matches were observed, while 1893/2167 (87.4 %; 95 % CI 86.0–88.9) appointments occurring after 1/4/2008 were identified (p for difference <0.001). 215/370 men (58.1 %) had at least one appointment in the MR review that was unmatched in HES, 155 men (41.9 %) had all their appointments identified, and 20 men (5.4 %) had no appointments identified in HES.

Conclusions

The HES outpatient dataset appears reasonably valid for research, particularly following accreditation. The dataset may be a suitable alternative to collecting MR data from hospital notes within a trial, although caution should be exercised with data collected prior to accreditation.
Literature
2.
go back to reference Lewsey J, Leyland A, Murray G, Boddy F. Using routine data to complement and enhance the results of randomised controlled trials. Health Technol Assess. 2000;4(22):1–45.PubMed Lewsey J, Leyland A, Murray G, Boddy F. Using routine data to complement and enhance the results of randomised controlled trials. Health Technol Assess. 2000;4(22):1–45.PubMed
3.
go back to reference Williams J, Cheung W, Cohen D, Hutchings H, Longo M, Russell I. Can randomised trials rely on existing electronic data? A feasibility study to explore the value of routine data in health technology assessment. Health Technol Assess. 2003;7(26):1–117.CrossRef Williams J, Cheung W, Cohen D, Hutchings H, Longo M, Russell I. Can randomised trials rely on existing electronic data? A feasibility study to explore the value of routine data in health technology assessment. Health Technol Assess. 2003;7(26):1–117.CrossRef
10.
go back to reference Williams J, Mann R. Hospital episode statistics: time for clinicians to get involved? Clin Med. 2002;2(1):34–7.CrossRef Williams J, Mann R. Hospital episode statistics: time for clinicians to get involved? Clin Med. 2002;2(1):34–7.CrossRef
11.
go back to reference Aylin P, Lees T, Baker S, Prytherch D, Ashley S. Descriptive study comparing routine hospital administrative data with the Vascular Society of Great Britain and Ireland’s National Vascular Database. Eur J Vasc Endovasc Surg. 2007;33(4):461–5.CrossRefPubMed Aylin P, Lees T, Baker S, Prytherch D, Ashley S. Descriptive study comparing routine hospital administrative data with the Vascular Society of Great Britain and Ireland’s National Vascular Database. Eur J Vasc Endovasc Surg. 2007;33(4):461–5.CrossRefPubMed
12.
go back to reference Garout M, Tilney HS, Tekkis PP, Aylin P. Comparison of administrative data with the Association of Coloproctology of Great Britain and Ireland (ACPGBI) colorectal cancer database. Int J Colorectal Dis. 2008;23(2):155–63.CrossRefPubMed Garout M, Tilney HS, Tekkis PP, Aylin P. Comparison of administrative data with the Association of Coloproctology of Great Britain and Ireland (ACPGBI) colorectal cancer database. Int J Colorectal Dis. 2008;23(2):155–63.CrossRefPubMed
13.
go back to reference Dixon J, Sanderson C, Elliott P, Walls P, Jones J, Petticrew M. Assessment of the reproducibility of clinical coding in routinely collected hospital activity data: a study in two hospitals. J Public Health. 1998;20(1):63–9.CrossRef Dixon J, Sanderson C, Elliott P, Walls P, Jones J, Petticrew M. Assessment of the reproducibility of clinical coding in routinely collected hospital activity data: a study in two hospitals. J Public Health. 1998;20(1):63–9.CrossRef
14.
go back to reference Burns EM, Rigby E, Mamidanna R, Bottle E, Aylin P, Ziprin P, Faiz OD. Systematic review of discharge coding accuracy. J Public Health. 2011;34(1):138.CrossRef Burns EM, Rigby E, Mamidanna R, Bottle E, Aylin P, Ziprin P, Faiz OD. Systematic review of discharge coding accuracy. J Public Health. 2011;34(1):138.CrossRef
16.
go back to reference Britton A, Milne B, Butler T, Sanchez-Galvez A, Shipley M, Rudd A, et al. Validating self-reported strokes in a longitudinal UK cohort study (Whitehall II): extracting information from hospital medical records versus the Hospital Episode Statistics database. BMC Med Res Method. 2012;12(1):83.CrossRef Britton A, Milne B, Butler T, Sanchez-Galvez A, Shipley M, Rudd A, et al. Validating self-reported strokes in a longitudinal UK cohort study (Whitehall II): extracting information from hospital medical records versus the Hospital Episode Statistics database. BMC Med Res Method. 2012;12(1):83.CrossRef
17.
go back to reference Gaughan J, Mason A, Street A, Ward P. English hospitals can improve their use of resources: an analysis of costs and length of stay for ten treatments. CHE Research Paper 78. 2012. Gaughan J, Mason A, Street A, Ward P. English hospitals can improve their use of resources: an analysis of costs and length of stay for ten treatments. CHE Research Paper 78. 2012.
18.
go back to reference Thomas G. A cost-benefit analysis of the immunisation of children against respiratory syncytial virus (RSV) using the English Hospital Episode Statistics (HES) data set. Eur J Health Econ. 2015. doi:10.1007/s10198-014-0662-9. Thomas G. A cost-benefit analysis of the immunisation of children against respiratory syncytial virus (RSV) using the English Hospital Episode Statistics (HES) data set. Eur J Health Econ. 2015. doi:10.​1007/​s10198-014-0662-9.
19.
go back to reference Bradshaw J, Noble M, Bloor K, Huby M, McLennan D, Rhodes D, et al. A child well-being index at a small area level in England. Child Indic Res. 2009;2(2):201–19.CrossRef Bradshaw J, Noble M, Bloor K, Huby M, McLennan D, Rhodes D, et al. A child well-being index at a small area level in England. Child Indic Res. 2009;2(2):201–19.CrossRef
20.
go back to reference Marques E, Noble S, Blom AW, Hollingworth W. Disclosing total waiting times for joint replacement: evidence from the English NHS using linked HES data. Health Econ. 2014;23(7):806–20.CrossRefPubMed Marques E, Noble S, Blom AW, Hollingworth W. Disclosing total waiting times for joint replacement: evidence from the English NHS using linked HES data. Health Econ. 2014;23(7):806–20.CrossRefPubMed
22.
go back to reference Lambrelli D, Burge R, Raluy-Callado M, Chen S-Y, Wu N, Schoenfeld MJ. Retrospective database study to assess the economic impact of hip fracture in the United Kingdom. J Med Econ. 2014;17(11):817–25.CrossRefPubMed Lambrelli D, Burge R, Raluy-Callado M, Chen S-Y, Wu N, Schoenfeld MJ. Retrospective database study to assess the economic impact of hip fracture in the United Kingdom. J Med Econ. 2014;17(11):817–25.CrossRefPubMed
23.
go back to reference Turner E, Metcalfe C, Donovan J, Noble S, Sterne J, Lane J, et al. Design and preliminary recruitment results of the Cluster randomised triAl of PSA testing for Prostate cancer (CAP). Br J Cancer. 2014;110(12):2829–36.PubMedCentralCrossRefPubMed Turner E, Metcalfe C, Donovan J, Noble S, Sterne J, Lane J, et al. Design and preliminary recruitment results of the Cluster randomised triAl of PSA testing for Prostate cancer (CAP). Br J Cancer. 2014;110(12):2829–36.PubMedCentralCrossRefPubMed
24.
go back to reference Lane JA, Donovan JL, Davis M, Walsh E, Dedman D, Down L, et al. Active monitoring, radical prostatectomy, or radiotherapy for localised prostate cancer: study design and diagnostic and baseline results of the ProtecT randomised phase 3 trial. Lancet Oncol. 2014;15(10):1109–18.CrossRefPubMed Lane JA, Donovan JL, Davis M, Walsh E, Dedman D, Down L, et al. Active monitoring, radical prostatectomy, or radiotherapy for localised prostate cancer: study design and diagnostic and baseline results of the ProtecT randomised phase 3 trial. Lancet Oncol. 2014;15(10):1109–18.CrossRefPubMed
26.
go back to reference Williams NJ, Hill EM, Ng SY, Martin RM, Metcalfe C, Donovan JL, et al. Standardisation of information submitted to an endpoint committee for cause of death assignment in a cancer screening trial-lessons learnt from CAP (Cluster randomised triAl of PSA testing for Prostate cancer). BMC Med Res Method. 2015;15(1):6.CrossRef Williams NJ, Hill EM, Ng SY, Martin RM, Metcalfe C, Donovan JL, et al. Standardisation of information submitted to an endpoint committee for cause of death assignment in a cancer screening trial-lessons learnt from CAP (Cluster randomised triAl of PSA testing for Prostate cancer). BMC Med Res Method. 2015;15(1):6.CrossRef
28.
go back to reference StataCorp. Stata Statistical Software: Release 12. College Station, TX: StataCorp LP; 2011. StataCorp. Stata Statistical Software: Release 12. College Station, TX: StataCorp LP; 2011.
29.
go back to reference Benchimol EI, Manuel DG, To T, Griffiths AM, Rabeneck L, Guttmann A. Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. J Clin Epidemiol. 2011;64(8):821–9.CrossRefPubMed Benchimol EI, Manuel DG, To T, Griffiths AM, Rabeneck L, Guttmann A. Development and use of reporting guidelines for assessing the quality of validation studies of health administrative data. J Clin Epidemiol. 2011;64(8):821–9.CrossRefPubMed
31.
go back to reference Head RF, Byrom A, Ellison GT. A qualitative exploration of the production of Hospital Episode Statistics in a Guernsey hospital: implications for regional comparisons of UK health data. Health Serv Manag Res. 2008;21(3):178–84.CrossRef Head RF, Byrom A, Ellison GT. A qualitative exploration of the production of Hospital Episode Statistics in a Guernsey hospital: implications for regional comparisons of UK health data. Health Serv Manag Res. 2008;21(3):178–84.CrossRef
32.
go back to reference Thorn JC, Coast J, Cohen D, Hollingworth W, Knapp M, Noble SM, et al. Resource-use measurement based on patient recall: issues and challenges for economic evaluation. Appl Health Econ Health Policy. 2013;11(3):155–61.CrossRefPubMed Thorn JC, Coast J, Cohen D, Hollingworth W, Knapp M, Noble SM, et al. Resource-use measurement based on patient recall: issues and challenges for economic evaluation. Appl Health Econ Health Policy. 2013;11(3):155–61.CrossRefPubMed
33.
go back to reference Spencer SA, Davies MP. Hospital Episode Statistics: improving the quality and value of hospital data: a national internet e-survey of hospital consultants. BMJ Open. 2012;2(6):e001651.PubMedCentralCrossRefPubMed Spencer SA, Davies MP. Hospital Episode Statistics: improving the quality and value of hospital data: a national internet e-survey of hospital consultants. BMJ Open. 2012;2(6):e001651.PubMedCentralCrossRefPubMed
Metadata
Title
Validation of the Hospital Episode Statistics Outpatient Dataset in England
Authors
Joanna C. Thorn
Emma Turner
Luke Hounsome
Eleanor Walsh
Jenny L. Donovan
Julia Verne
David E. Neal
Freddie C. Hamdy
Richard M. Martin
Sian M. Noble
Publication date
01-02-2016
Publisher
Springer International Publishing
Published in
PharmacoEconomics / Issue 2/2016
Print ISSN: 1170-7690
Electronic ISSN: 1179-2027
DOI
https://doi.org/10.1007/s40273-015-0326-3

Other articles of this Issue 2/2016

PharmacoEconomics 2/2016 Go to the issue