Skip to main content
Top
Published in: BMC Health Services Research 1/2019

Open Access 01-12-2019 | Decubitus Ulcer | Research article

Diagnostic value and reliability of the present-on-admission indicator in different diagnosis groups: pilot study at a Swiss tertiary care center

Authors: Karen Triep, Thomas Beck, Jacques Donzé, Olga Endrich

Published in: BMC Health Services Research | Issue 1/2019

Login to get access

Abstract

Background

With few exceptions the International Statistical Classification of Diseases (ICD) codes for diagnoses and official coding guidelines do not distinguish pre-existing conditions from complications or comorbidities which occur during hospitalization. However, information on diagnosis timing is relevant with regard to the case’s severity, resource consumption and quality of care. In this study we analyzed the diagnostic value and reliability of the present-on-admission (POA) indicator using routinely collected health data.

Methods

We included all inpatient cases of the department of medicine during 2016 with a diagnosis of deep vein thrombosis, decubitus ulcer or delirium. Swiss coding guidelines of 2016 and the definitions of the Swiss medical statistics of hospitals were analyzed to evaluate the potential to encode information on diagnosis timing. The diagnoses were revised by applying the information present-on-admission by a coding specialist and by a medical expert, serving as Gold Standard. The diagnostic value and reliability were evaluated.

Results

The inter-rater reliability for POA of all diagnoses was 0.7133 (Cohen’s kappa), but differed between diagnosis groups (0.558–0.7164). The rate of POA positive of the total applied by the coding specialist versus the expert was similar, but differed between diagnoses. In group “thrombosis” SEN was 0.95, SPE 0.75, PPV 0.97 and NPV 0.60, in group “decubitus ulcer” SEN 0.89, SPE 0.82, PPV 0.89 and NPV 0.82, in group “delirium” SEN 0.91, SPE 0.65, PPV 0.71 and NPV 0.88 For all diagnoses SEN 0.92, SPE 0.73, PPV 0.87, NPV 0.82, summing up the cases of all diagnosis groups.

Conclusions

Coding the POA indicator identified diagnoses which were pre-existent with insufficient reliability on individual patient’s level. The overall fair to sufficient diagnostic quality is appropriate for screening and benchmarking performance on population level. As the medical statistics of hospitals carries no variable on pre-existing conditions, the novel approach to apply the POA indicator to diagnoses gives more information on quality of hospital care and complexity of cases. By preparing documentation for POA reporting diagnostic quality must be increased before implementation for risk-assessment or reimbursement on the individual patient’s level.
Appendix
Available only for authorised users
Literature
3.
go back to reference Sundararajan V, Romano PS, Quan H, Burnand B, Drosler SE, Brien S, Pincus HA, Ghali WA. Capturing diagnosis-timing in ICD-coded hospital data: recommendations from the WHO ICD-11 topic advisory group on quality and safety. Int J Qual Health Care. 2015;27(4):328–33.CrossRef Sundararajan V, Romano PS, Quan H, Burnand B, Drosler SE, Brien S, Pincus HA, Ghali WA. Capturing diagnosis-timing in ICD-coded hospital data: recommendations from the WHO ICD-11 topic advisory group on quality and safety. Int J Qual Health Care. 2015;27(4):328–33.CrossRef
5.
go back to reference Protschka J. Indikatoren für die Bewertung von Komplikationsraten. Deutsches Ärzteblatt. 2012;109(41):A-2026. Protschka J. Indikatoren für die Bewertung von Komplikationsraten. Deutsches Ärzteblatt. 2012;109(41):A-2026.
6.
go back to reference Quan H, Moskal L, Forster AJ, Brien S, Walker R, Romano PS, Sundararajan V, Burnand B, Henriksson G, Steinum O, et al. International variation in the definition of ‘main condition’ in ICD-coded health data. Int J Qual Health Care. 2014;26(5):511–5.CrossRef Quan H, Moskal L, Forster AJ, Brien S, Walker R, Romano PS, Sundararajan V, Burnand B, Henriksson G, Steinum O, et al. International variation in the definition of ‘main condition’ in ICD-coded health data. Int J Qual Health Care. 2014;26(5):511–5.CrossRef
12.
go back to reference Trentino KSS, Burrows S, Sprivulis P, Daly F. Measuring the incidence of hospital-acquired complications and their effect on length of stay using CHADx. Med J Aust. 2013;199(8):543–7.CrossRef Trentino KSS, Burrows S, Sprivulis P, Daly F. Measuring the incidence of hospital-acquired complications and their effect on length of stay using CHADx. Med J Aust. 2013;199(8):543–7.CrossRef
21.
go back to reference Hughes JS, Averill RF, Goldfield NI, Gay JC, Muldoon J, McCullough E, Xiang J. Identifying potentially preventable complications using a present on admission indicator. Health Care Financ Rev. 2006;27(3):63–82.PubMedPubMedCentral Hughes JS, Averill RF, Goldfield NI, Gay JC, Muldoon J, McCullough E, Xiang J. Identifying potentially preventable complications using a present on admission indicator. Health Care Financ Rev. 2006;27(3):63–82.PubMedPubMedCentral
22.
go back to reference Fuller RL, McCullough EC, Bao MZ, Averill RF. Estimating the costs of potentially preventable hospital acquired complications. Health Care Financ Rev. 2009;30(4):17–32.PubMedPubMedCentral Fuller RL, McCullough EC, Bao MZ, Averill RF. Estimating the costs of potentially preventable hospital acquired complications. Health Care Financ Rev. 2009;30(4):17–32.PubMedPubMedCentral
23.
go back to reference McNutt R, Johnson TJ, Odwazny R, Remmich Z, Skarupski K, Meurer S, Hohmann S, Harting B. Change in MS-DRG assignment and hospital reimbursement as a result of centers for Medicare & Medicaid changes in payment for hospital-acquired conditions: is it coding or quality? Qual Manag Health Care. 2010;19(1):17–24.CrossRef McNutt R, Johnson TJ, Odwazny R, Remmich Z, Skarupski K, Meurer S, Hohmann S, Harting B. Change in MS-DRG assignment and hospital reimbursement as a result of centers for Medicare & Medicaid changes in payment for hospital-acquired conditions: is it coding or quality? Qual Manag Health Care. 2010;19(1):17–24.CrossRef
24.
go back to reference Goldman LE, Chu PW, Bacchetti P, Kruger J, Bindman A. Effect of present-on-admission (POA) reporting accuracy on hospital performance assessments using risk-adjusted mortality. Health Serv Res. 2015;50(3):922–38.CrossRef Goldman LE, Chu PW, Bacchetti P, Kruger J, Bindman A. Effect of present-on-admission (POA) reporting accuracy on hospital performance assessments using risk-adjusted mortality. Health Serv Res. 2015;50(3):922–38.CrossRef
26.
go back to reference Sorensen A, Jarrett N, Tant E, Bernard S, McCall N. HAC-POA policy effects on hospitals, other payers and patients. Medicare Medicaid Res Rev. 2014;4(3):A-2026. Sorensen A, Jarrett N, Tant E, Bernard S, McCall N. HAC-POA policy effects on hospitals, other payers and patients. Medicare Medicaid Res Rev. 2014;4(3):A-2026.
27.
go back to reference Goldman LE, Chu PW, Osmond D, Bindman A. The accuracy of present-on-admission reporting in administrative data. Health Serv Res. 2011;46(6pt1):1946–62.CrossRef Goldman LE, Chu PW, Osmond D, Bindman A. The accuracy of present-on-admission reporting in administrative data. Health Serv Res. 2011;46(6pt1):1946–62.CrossRef
28.
go back to reference Jackson TJ, Michel JL, Roberts R, Shepheard J, Cheng D, Rust J, Perry C. Development of a validation algorithm for 'present on admission' flagging. BMC Med Inform Decis Mak. 2009;9:48.CrossRef Jackson TJ, Michel JL, Roberts R, Shepheard J, Cheng D, Rust J, Perry C. Development of a validation algorithm for 'present on admission' flagging. BMC Med Inform Decis Mak. 2009;9:48.CrossRef
29.
go back to reference Coomer NM, McCall NT. Examination of the accuracy of coding hospital-acquired pressure ulcer stages. Medicare Medicaid Res Rev. 2013;3(4):A-2026. Coomer NM, McCall NT. Examination of the accuracy of coding hospital-acquired pressure ulcer stages. Medicare Medicaid Res Rev. 2013;3(4):A-2026.
30.
go back to reference Khanna RR, Kim SB, Jenkins I, El-Kareh R, Afsarmanesh N, Amin A, Sand H, Auerbach A, Chia CY, Maynard G, et al. Predictive value of the present-on-admission indicator for hospital-acquired venous thromboembolism. Med Care. 2015;53(4):e31–6.PubMed Khanna RR, Kim SB, Jenkins I, El-Kareh R, Afsarmanesh N, Amin A, Sand H, Auerbach A, Chia CY, Maynard G, et al. Predictive value of the present-on-admission indicator for hospital-acquired venous thromboembolism. Med Care. 2015;53(4):e31–6.PubMed
31.
go back to reference Winters BD, Bharmal A, Wilson RF, Zhang A, Engineer L, Defoe D, Bass EB, Dy S, Pronovost PJ. Validity of the Agency for Health Care Research and Quality Patient Safety Indicators and the centers for Medicare and Medicaid hospital-acquired conditions: a systematic review and meta-analysis. Med Care. 2016;54(12):1105–11.CrossRef Winters BD, Bharmal A, Wilson RF, Zhang A, Engineer L, Defoe D, Bass EB, Dy S, Pronovost PJ. Validity of the Agency for Health Care Research and Quality Patient Safety Indicators and the centers for Medicare and Medicaid hospital-acquired conditions: a systematic review and meta-analysis. Med Care. 2016;54(12):1105–11.CrossRef
33.
go back to reference Pine M, Fry DE, Jones B, Meimban R. Screening algorithms to assess the accuracy of present-on-admission coding. Perspect Health Inf Manag. 2009;6:2.PubMedPubMedCentral Pine M, Fry DE, Jones B, Meimban R. Screening algorithms to assess the accuracy of present-on-admission coding. Perspect Health Inf Manag. 2009;6:2.PubMedPubMedCentral
37.
go back to reference McHugh ML. Interrater reliability: the kappa statistic. Biochemia Medica. 2012;22(3):276–82.CrossRef McHugh ML. Interrater reliability: the kappa statistic. Biochemia Medica. 2012;22(3):276–82.CrossRef
39.
go back to reference Wilson L. POA coding challenges. Concern grows over quality of documentation. Mod Healthc. 2008;10:12. Wilson L. POA coding challenges. Concern grows over quality of documentation. Mod Healthc. 2008;10:12.
Metadata
Title
Diagnostic value and reliability of the present-on-admission indicator in different diagnosis groups: pilot study at a Swiss tertiary care center
Authors
Karen Triep
Thomas Beck
Jacques Donzé
Olga Endrich
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2019
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-018-3858-3

Other articles of this Issue 1/2019

BMC Health Services Research 1/2019 Go to the issue