Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2017

Open Access 01-12-2017 | Research article

ACSC Indicator: testing reliability for hypertension

Authors: Robin L. Walker, William A. Ghali, Guanmin Chen, Tej K. Khalsa, Birinder K. Mangat, Norm R. C. Campbell, Elijah Dixon, Doreen Rabi, Nathalie Jette, Robyn Dhanoa, Hude Quan

Published in: BMC Medical Informatics and Decision Making | Issue 1/2017

Login to get access

Abstract

Background

With high-quality community-based primary care, hospitalizations for ambulatory care sensitive conditions (ACSC) are considered avoidable. The purpose of this study was to test the inter-physician reliability of judgments of avoidable hospitalizations for one ACSC, uncomplicated hypertension, derived from medical chart review.

Methods

We applied the Canadian Institute for Health Information’s case definition to obtain a random sample of patients who had an ACSC hospitalization for uncomplicated hypertension in Calgary, Alberta. Medical chart review was conducted by three experienced internal medicine specialists. Implicit methods were used to judge avoidability of hospitalization using a validated 5-point scale.

Results

There was poor agreement among three physicians raters when judging the avoidability of 82 ACSC hospitalizations for uncomplicated hypertension (κ = 0.092). The κ also remained low when assessing agreement between raters 1 and 3 (κ = 0.092), but the κ was lower (less than chance agreement) for raters 1 and 2 (κ = -0.119) and raters 2 and 3 (κ = -0.008). When the 5-point scale was dichotomized, there was fair agreement among three raters (κ = 0.217). The proportion of ACSC hospitalizations for uncomplicated hypertension that were rated as avoidable was 32.9%, 6.1% and 26.8% for raters 1, 2, and 3, respectively.

Conclusions

This study found a low proportion of ACSC hospitalization were rated as avoidable, with poor to fair agreement of judgment between physician raters. This suggests that the validity and utility of this health indicator is questionable. It points to a need to abandon the use of ACSC entirely; or alternatively to work on the development of explicit criteria for judging avoidability of hospitalization for ACSC such as hypertension.
Appendix
Available only for authorised users
Literature
1.
go back to reference Ajmera M, Wilkins TL, Sambamoorthi U. Dual Medicare and Veteran Health Administration use and ambulatory care sensitive hospitalizations. J Gen Intern Med. 2011;26 Suppl 2:669–75.CrossRefPubMedPubMedCentral Ajmera M, Wilkins TL, Sambamoorthi U. Dual Medicare and Veteran Health Administration use and ambulatory care sensitive hospitalizations. J Gen Intern Med. 2011;26 Suppl 2:669–75.CrossRefPubMedPubMedCentral
2.
go back to reference Tian Y, Dixon A, Gao H. Emergency hospital admissions for ambulatory care-sensitive conditions: identifying the potential for reductions. The King's Fund. 2012;1-13. Tian Y, Dixon A, Gao H. Emergency hospital admissions for ambulatory care-sensitive conditions: identifying the potential for reductions. The King's Fund. 2012;1-13.
7.
go back to reference Cloutier-Fisher D, Penning MJ, Zheng C, Druyts EB. The devil is in the details: trends in avoidable hospitalization rates by geography in British Columbia, 1990-2000. BMC Health Serv Res. 2006;6:104.CrossRefPubMedPubMedCentral Cloutier-Fisher D, Penning MJ, Zheng C, Druyts EB. The devil is in the details: trends in avoidable hospitalization rates by geography in British Columbia, 1990-2000. BMC Health Serv Res. 2006;6:104.CrossRefPubMedPubMedCentral
8.
go back to reference Brown AD, Goldacre MJ, Hicks N, Rourke JT, McMurtry RY, Brown JD, et al. Hospitalization for ambulatory care-sensitive conditions: a method for comparative access and quality studies using routinely collected statistics. Can J Public Health. 2001;92:155–9.PubMed Brown AD, Goldacre MJ, Hicks N, Rourke JT, McMurtry RY, Brown JD, et al. Hospitalization for ambulatory care-sensitive conditions: a method for comparative access and quality studies using routinely collected statistics. Can J Public Health. 2001;92:155–9.PubMed
9.
go back to reference Sanmartin C, Khan S. Hospitalizations for Ambulatory Care Sensitive Conditions: The factors that matter. Ottawa: Statistics Canada; 2011. Report No.: 82-622-X. Sanmartin C, Khan S. Hospitalizations for Ambulatory Care Sensitive Conditions: The factors that matter. Ottawa: Statistics Canada; 2011. Report No.: 82-622-X.
10.
go back to reference Pappas G, Hadden WC, Kozak LJ, Fisher GF. Potentially avoidable hospitalizations: inequalities in rates between US socioeconomic groups. Am J Public Health. 1997;87:811–6.CrossRefPubMedPubMedCentral Pappas G, Hadden WC, Kozak LJ, Fisher GF. Potentially avoidable hospitalizations: inequalities in rates between US socioeconomic groups. Am J Public Health. 1997;87:811–6.CrossRefPubMedPubMedCentral
11.
go back to reference Nyweide DJ, Weeks WB, Gottlieb DJ, Casalino LP, Fisher ES. Relationship of primary care physicians' patient caseload with measurement of quality and cost performance. JAMA. 2009;302:2444–50.CrossRefPubMedPubMedCentral Nyweide DJ, Weeks WB, Gottlieb DJ, Casalino LP, Fisher ES. Relationship of primary care physicians' patient caseload with measurement of quality and cost performance. JAMA. 2009;302:2444–50.CrossRefPubMedPubMedCentral
12.
go back to reference Rizza P, Bianco A, Pavia M, Angelillo IF. Preventable hospitalization and access to primary health care in an area of Southern Italy. BMC Health Serv Res. 2007;7:134.CrossRefPubMedPubMedCentral Rizza P, Bianco A, Pavia M, Angelillo IF. Preventable hospitalization and access to primary health care in an area of Southern Italy. BMC Health Serv Res. 2007;7:134.CrossRefPubMedPubMedCentral
13.
go back to reference Paramore LC, Elixhauser A. Assessment of quality of care for managed care and fee-for-service patients based on analysis of avoidable hospitalizations. Value Health. 1999;2:258–68.CrossRefPubMed Paramore LC, Elixhauser A. Assessment of quality of care for managed care and fee-for-service patients based on analysis of avoidable hospitalizations. Value Health. 1999;2:258–68.CrossRefPubMed
14.
go back to reference Backus L, Moron M, Bacchetti P, Baker LC, Bindman AB. Effect of managed care on preventable hospitalization rates in California. Med Care. 2002;40:315–24.CrossRefPubMed Backus L, Moron M, Bacchetti P, Baker LC, Bindman AB. Effect of managed care on preventable hospitalization rates in California. Med Care. 2002;40:315–24.CrossRefPubMed
15.
go back to reference Laditka SB, Laditka JN. Geographic variation in preventable hospitalization of older women and men: implications for access to primary health care. J Women Aging. 1999;11:43–56.CrossRefPubMed Laditka SB, Laditka JN. Geographic variation in preventable hospitalization of older women and men: implications for access to primary health care. J Women Aging. 1999;11:43–56.CrossRefPubMed
16.
go back to reference Canadian Institute for Health Information. Health Indicators 2013. Ottawa: Canadian Institute for Health Information; 2013. Canadian Institute for Health Information. Health Indicators 2013. Ottawa: Canadian Institute for Health Information; 2013.
17.
go back to reference McAlister FA, Wilkins K, Joffres M, Leenen FH, Fodor G, Gee M, et al. Changes in the rates of awareness, treatment and control of hypertension in Canada over the past two decades. CMAJ. 2011;183:1007–13.CrossRefPubMedPubMedCentral McAlister FA, Wilkins K, Joffres M, Leenen FH, Fodor G, Gee M, et al. Changes in the rates of awareness, treatment and control of hypertension in Canada over the past two decades. CMAJ. 2011;183:1007–13.CrossRefPubMedPubMedCentral
18.
go back to reference Hemmelgarn BR, Chen G, Walker R, McAlister FA, Quan H, Tu K, et al. Trends in antihypertensive drug prescriptions and physician visits in Canada between 1996 and 2006. Can J Cardiol. 2008;24:507–12.CrossRefPubMedPubMedCentral Hemmelgarn BR, Chen G, Walker R, McAlister FA, Quan H, Tu K, et al. Trends in antihypertensive drug prescriptions and physician visits in Canada between 1996 and 2006. Can J Cardiol. 2008;24:507–12.CrossRefPubMedPubMedCentral
19.
go back to reference World Health Organization. World Health Organization 2008-2013 action plan for global strategy for the prevention and control of noncommunicable diseases: prevent and control cardiovascular diseases, cancers, chronic respiratory diseases and diabetes. Geneva: World Health Organization; 2008. World Health Organization. World Health Organization 2008-2013 action plan for global strategy for the prevention and control of noncommunicable diseases: prevent and control cardiovascular diseases, cancers, chronic respiratory diseases and diabetes. Geneva: World Health Organization; 2008.
20.
go back to reference Cecchini M, Sassi F, Lauer JA, Lee YY, Guajardo-Barron V, Chisholm D. Tackling of unhealthy diets, physical inactivity, and obesity: health effects and cost-effectiveness. Lancet. 2010;376:1775–84.CrossRefPubMed Cecchini M, Sassi F, Lauer JA, Lee YY, Guajardo-Barron V, Chisholm D. Tackling of unhealthy diets, physical inactivity, and obesity: health effects and cost-effectiveness. Lancet. 2010;376:1775–84.CrossRefPubMed
21.
go back to reference Quan H, Parsons GA, Ghali WA. Assessing accuracy of diagnosis-type indicators for flagging complications in administrative data. J Clin Epidemiol. 2004;57:366–72.CrossRefPubMed Quan H, Parsons GA, Ghali WA. Assessing accuracy of diagnosis-type indicators for flagging complications in administrative data. J Clin Epidemiol. 2004;57:366–72.CrossRefPubMed
22.
go back to reference Canadian Institute for Health Information. Health Indicators 2011. Ottawa; Canadian Institute for Health Information; 2011. Canadian Institute for Health Information. Health Indicators 2011. Ottawa; Canadian Institute for Health Information; 2011.
23.
go back to reference Guo L, MacDowell M, Levin L, Hornung RW, Linn S. How are age and payors related to avoidable hospitalization conditions? Manag Care Q. 2001;9:33–42.PubMed Guo L, MacDowell M, Levin L, Hornung RW, Linn S. How are age and payors related to avoidable hospitalization conditions? Manag Care Q. 2001;9:33–42.PubMed
24.
go back to reference Brook RH, Appel FA. Quality-of-care assessment: choosing a method for peer review. N Engl J Med. 1973;288:1323–9.CrossRefPubMed Brook RH, Appel FA. Quality-of-care assessment: choosing a method for peer review. N Engl J Med. 1973;288:1323–9.CrossRefPubMed
25.
go back to reference Forster AJ, Murff HJ, Peterson JF, Gandhi TK, Bates DW. Adverse drug events occurring following hospital discharge. J Gen Intern Med. 2005;20:317–23.CrossRefPubMedPubMedCentral Forster AJ, Murff HJ, Peterson JF, Gandhi TK, Bates DW. Adverse drug events occurring following hospital discharge. J Gen Intern Med. 2005;20:317–23.CrossRefPubMedPubMedCentral
26.
go back to reference Barbara O, Jose SM, Jayna HL, Ward F, Maeve O, Deborah W, et al. A framework to assess patient-reported adverse outcoms stemming from hospitalization. BMC Health Serv Res. 2016;16:357.CrossRefPubMedPubMedCentral Barbara O, Jose SM, Jayna HL, Ward F, Maeve O, Deborah W, et al. A framework to assess patient-reported adverse outcoms stemming from hospitalization. BMC Health Serv Res. 2016;16:357.CrossRefPubMedPubMedCentral
27.
go back to reference Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, et al. The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ. 2004;170:1678–86.CrossRefPubMedPubMedCentral Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, et al. The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ. 2004;170:1678–86.CrossRefPubMedPubMedCentral
28.
go back to reference Yam CH, Wong EL, Chan FW, Wong FY, Leung MC, Yeoh EK. Measuring and preventing potentially avoidable hospital readmissions: a review of the literature. Hong Kong Med J. 2010;16:383–9.PubMed Yam CH, Wong EL, Chan FW, Wong FY, Leung MC, Yeoh EK. Measuring and preventing potentially avoidable hospital readmissions: a review of the literature. Hong Kong Med J. 2010;16:383–9.PubMed
29.
go back to reference Jette N, Quan H, Tellez-Zenteno JF, Macrodimitris S, Hader WJ, Sherman EM, et al. Development of an online tool to determine appropriateness for an epilepsy surgery evaluation. Neurology. 2012;79:1084–93.CrossRefPubMed Jette N, Quan H, Tellez-Zenteno JF, Macrodimitris S, Hader WJ, Sherman EM, et al. Development of an online tool to determine appropriateness for an epilepsy surgery evaluation. Neurology. 2012;79:1084–93.CrossRefPubMed
30.
go back to reference Quan H, Drosler S, Sundararajan V, Wen E, Burnand B, Couris CM, et al. Adaptation of AHRQ Patient Safety Indicators for Use in ICD-10 Administrative Data by an International Consortium. Advances in Patient Safety: New Directions and Alternative Approaches. Rockville, MD: Agency for Health Care Research and Quality. 2008. http://www.ahrq.gov/qual/advances2/. Accessed 2 May 2014. Quan H, Drosler S, Sundararajan V, Wen E, Burnand B, Couris CM, et al. Adaptation of AHRQ Patient Safety Indicators for Use in ICD-10 Administrative Data by an International Consortium. Advances in Patient Safety: New Directions and Alternative Approaches. Rockville, MD: Agency for Health Care Research and Quality. 2008. http://​www.​ahrq.​gov/​qual/​advances2/​. Accessed 2 May 2014.
31.
32.
go back to reference Feasby TE, Quan H, Tubman M, Pi D, Tinmouth A, So L, et al. Appropriateness of the use of intravenous immune globulin before and after the introduction of a utilization control program. Open Med. 2012;6:e28–34.CrossRefPubMedPubMedCentral Feasby TE, Quan H, Tubman M, Pi D, Tinmouth A, So L, et al. Appropriateness of the use of intravenous immune globulin before and after the introduction of a utilization control program. Open Med. 2012;6:e28–34.CrossRefPubMedPubMedCentral
34.
go back to reference Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43:1130–9.CrossRefPubMed Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, et al. Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005;43:1130–9.CrossRefPubMed
35.
go back to reference Muenchberger H, Kendall E. Predictors of preventable hospitalization in chronic disease: priorities for change. J Public Health Policy. 2010;31:150–63.CrossRefPubMed Muenchberger H, Kendall E. Predictors of preventable hospitalization in chronic disease: priorities for change. J Public Health Policy. 2010;31:150–63.CrossRefPubMed
36.
go back to reference Chen B, Zaebst D, Seel L. A macro to calculate kappa statistics for categorizations by multiple raters. Philadelphia: Sugi, editor. 2005. SAS. 11-5-2014. Chen B, Zaebst D, Seel L. A macro to calculate kappa statistics for categorizations by multiple raters. Philadelphia: Sugi, editor. 2005. SAS. 11-5-2014.
37.
go back to reference Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRefPubMed Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.CrossRefPubMed
38.
go back to reference Weingart SN, Davis RB, Palmer RH, Cahalane M, Hamel MB, Mukamal K, et al. Discrepancies between explicit and implicit review: physician and nurse assessments of complications and quality. Health Serv Res. 2002;37:483–98.CrossRefPubMedPubMedCentral Weingart SN, Davis RB, Palmer RH, Cahalane M, Hamel MB, Mukamal K, et al. Discrepancies between explicit and implicit review: physician and nurse assessments of complications and quality. Health Serv Res. 2002;37:483–98.CrossRefPubMedPubMedCentral
40.
go back to reference van Walraven C, Bennett C, Jennings A, Austin PC, Forster AJ. Proportion of hospital readmissions deemed avoidable: a systematic review. CMAJ. 2011;183:E391–402.CrossRefPubMedPubMedCentral van Walraven C, Bennett C, Jennings A, Austin PC, Forster AJ. Proportion of hospital readmissions deemed avoidable: a systematic review. CMAJ. 2011;183:E391–402.CrossRefPubMedPubMedCentral
41.
go back to reference Ashton CM, Kuykendall DH, Johnson ML, Wray NP. An empirical assessment of the validity of explicit and implicit process-of-care criteria for quality assessment. Med Care. 1999;37:798–808.CrossRefPubMed Ashton CM, Kuykendall DH, Johnson ML, Wray NP. An empirical assessment of the validity of explicit and implicit process-of-care criteria for quality assessment. Med Care. 1999;37:798–808.CrossRefPubMed
Metadata
Title
ACSC Indicator: testing reliability for hypertension
Authors
Robin L. Walker
William A. Ghali
Guanmin Chen
Tej K. Khalsa
Birinder K. Mangat
Norm R. C. Campbell
Elijah Dixon
Doreen Rabi
Nathalie Jette
Robyn Dhanoa
Hude Quan
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2017
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-017-0487-4

Other articles of this Issue 1/2017

BMC Medical Informatics and Decision Making 1/2017 Go to the issue