Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

Hospital quality measures: are process indicators associated with hospital standardized mortality ratios in French acute care hospitals?

Authors: Marcus Ngantcha, Marie-Annick Le-Pogam, Sophie Calmus, Catherine Grenier, Isabelle Evrard, Agathe Lamarche-Vadel, Grégoire Rey

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

Results of associations between process and mortality indicators, both used for the external assessment of hospital care quality or public reporting, differ strongly across studies. However, most of those studies were conducted in North America or United Kingdom. Providing new evidence based on French data could fuel the international debate on quality of care indicators and help inform French policy-makers. The objective of our study was to explore whether optimal care delivery in French hospitals as assessed by their Hospital Process Indicators (HPIs) is associated with low Hospital Standardized Mortality Ratios (HSMRs).

Methods

The French National Authority for Health (HAS) routinely collects for each hospital located in France, a set of mandatory HPIs. Five HPIs were selected among the process indicators collected by the HAS in 2009. They were measured using random samples of 60 to 80 medical records from inpatients admitted between January 1st, 2009 and December 31, 2009 in respect with some selection criteria. HSMRs were estimated at 30, 60 and 90 days post-admission (dpa) using administrative health data extracted from the national health insurance information system (SNIIR-AM) which covers 77% of the French population. Associations between HPIs and HSMRs were assessed by Poisson regression models corrected for measurement errors with a simulation-extrapolation (SIMEX) method.

Results

Most associations studied were not statistically significant. Only two process indicators were found associated with HSMRs. Completeness and quality of anesthetic records was negatively associated with 30 dpa HSMR (0.72 [0.52–0.99]). Early detection of nutritional disorders was negatively associated with all HSMRs: 30 dpa HSMR (0.71 [0.54–0.95]), 60 dpa HSMR (0.51 [0.39–0.67]) and 90 dpa HSMR (0.52 [0.40–0.68]).

Conclusion

In absence of gold standard of quality of care measurement, the limited number of associations suggested to drive in-depth improvements in order to better determine associations between process and mortality indicators. A smart utilization of both process and outcomes indicators is mandatory to capture aspects of the hospital quality of care complexity.
Appendix
Available only for authorised users
Literature
1.
2.
Brook RH, Appel FA. Quality-of-care assessment: choosing a method for peer review. N Engl J Med. 1973;288:1323–9.CrossRefPubMed
3.
Brook RH, McGlynn EA, Shekelle PG. Defining and measuring quality of care: a perspective from US researchers. Int J Qual Health Care. 2000;12:281–95.CrossRefPubMed
4.
Thomas JW, Hofer TP. Research evidence on the validity of risk-adjusted mortality rate as a measure of hospital quality of care. Med Care Res Rev. 1998;55:371–404.CrossRefPubMed
5.
Donabedian A. The quality of care: how can it be assessed? JAMA. 1988;260:1743–8.CrossRef
6.
Jencks SF, Huff ED, Cuerdon T. Change in the quality of care delivered to medicare beneficiaries, 1998-1999 to 2000-2001. JAMA. 2003;289:305–12.CrossRefPubMed
7.
Jha AK, Li Z, Orav EJ, et al. Care in U.S. hospitals--the Hospital Quality Alliance program. N Engl J Med. 2005;353:265–74.CrossRefPubMed
8.
Bilimoria KY. Facilitating quality improvement: pushing the pendulum back toward process measures. JAMA. 2015;314:1333–4.CrossRefPubMed
9.
Greenfield D, Pawsey M, Hinchcliff R, et al. The standard of healthcare accreditation standards: a review of empirical research underpinning their development and impact. BMC Health Serv Res. 2012;12:329.CrossRefPubMedPubMedCentral
10.
Guérin S, Le-Pogam MA, Robillard B, et al. Can we simplify the hospital accreditation process? Predicting accreditation decisions from a reduced dataset of focus priority standards and quality indicators: results of predictive modelling. BMJ Open. 2013;3:e003289.CrossRefPubMedPubMedCentral
11.
Drye EE, Normand SLT, Wang Y, et al. Comparison of hospital risk-standardized mortality rates calculated by using in-hospital and 30-day models: an observational study with implications for hospital profiling. Ann Intern Med. 2012;156:19–26.CrossRefPubMedPubMedCentral
12.
Girling AJ, Hofer TP, Wu J, et al. Case-mix adjusted hospital mortality is a poor proxy for preventable mortality: a modelling study. BMJ Qual Saf. 2012;21:1052–6.CrossRefPubMedPubMedCentral
13.
Lilford R, Pronovost P. Using hospital mortality rates to judge hospital performance: a bad idea that just won’t go away. BMJ. 2010;340:c2016.CrossRefPubMed
14.
Bradley EH, Herrin J, Elbel B, et al. Hospital quality for acute myocardial infarction: correlation among process measures and relationship with short-term mortality. JAMA. 2006;296:72–8.CrossRefPubMed
15.
Fonarow GC, Abraham WT, Albert NM, et al. Association between performance measures and clinical outcomes for patients hospitalized with heart failure. JAMA. 2007;297:61–70.CrossRefPubMed
16.
Fu R, Xiang J, Bao X, et al. Association between process indicators and in-hospital mortality among patients with chronic heart failure in China. Eur J Pub Health. 2015;25:373–8.CrossRef
17.
Pitches DW, Mohammed MA, Lilford RJ. What is the empirical evidence that hospitals with higher-risk adjusted mortality rates provide poorer quality care? A systematic review of the literature. BMC Health Serv Res. 2007;7:91.CrossRefPubMedPubMedCentral
18.
Lamarche-Vadel A, Pavillon G, Aouba A, et al. Automated comparison of last hospital main diagnosis and underlying cause of death ICD10 codes, France, 2008–2009. BMC Med Inform Decis Mak. 2014;14:44.CrossRefPubMedPubMedCentral
19.
Lamarche-Vadel A, Ngantcha M, Le-Pogam MA, et al. Hospital comparisons based on mortality: revisiting the choice of postadmission timeframe and evaluating the contribution of cause-of-death data, France, 2009. Med Care. 2015;53:736–42.CrossRefPubMed
20.
Bottle A, Jarman B, Aylin P. Strengths and weaknesses of hospital standardised mortality ratios. BMJ. 2010;342:c7116.CrossRefPubMed
21.
22.
Couralet M, Guérin S, Le Vaillant M, et al. Constructing a composite quality score for the care of acute myocardial infarction patients at discharge: impact on hospital ranking. Med Care. 2011;49:569–76.CrossRefPubMed
23.
Minvielle E, Leleu H, Capuano F, et al. Suitability of three indicators measuring the quality of coordination within hospitals. BMC Health Serv Res. 2010;10:93.CrossRefPubMedPubMedCentral
24.
McGlynn EA, Kerr EA, Adams J, Keesey J, Asch S. Quality of health care for women: a demonstration of the quality assessment tools system. Med Care. 2003;41:616–25.PubMed
25.
Corriol C, Daucourt V, Grenier C, et al. How to limit the burden of data collection for quality indicators based on medical records? The COMPAQH experience. BMC Health Serv Res. 2008;8:215.CrossRefPubMedPubMedCentral
26.
Tuppin P, De Roquefeuil L, Weill A, et al. French national health insurance information system and the permanent beneficiaries sample. Rev Dépidémiologie Santé Publique. 2010;58:286–90.CrossRef
27.
Bottle A, Aylin P. Comorbidity scores for administrative data benefited from adaptation to local coding and diagnostic practices. J Clin Epidemiol. 2011;64:1426–33.CrossRefPubMed
28.
29.
Royston P, Sauerbrei W. Multivariable model - building: a pragmatic approach to regression anaylsis based on fractional polynomials for modelling continuous variables. Sussex: Wiley; 2008. p. 324.CrossRef
30.
Rey G, Jougla E, Fouillet A, et al. Ecological association between a deprivation index and mortality in France over the period 1997 – 2001: variations with spatial scale, degree of urbanicity, age, gender and cause of death. BMC Public Health. 2009;9:33.CrossRefPubMedPubMedCentral
31.
Charlson ME, Pompei P, Ales KL, et al. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373–83.CrossRefPubMed
32.
Buzas JS, Stefanski LA, Tosteson TD. Measurement error. Handbook of epidemiology. 2014:1241–82.
33.
34.
Bender R, Lange S. Adjusting for multiple testing—when and how? J clin Epidemio. 2001;54(4):343–9.CrossRef
35.
Lilford R, Mohammed MA, Spiegelhalter D, Thomson R. Use and misuse of process and outcome data in managing performance of acute medical care: avoiding institutional stigma. Lancet Lond Engl. 2004;363:1147–54.CrossRef
36.
Borzecki AM, Christiansen CL, Chew P, et al. Comparison of in-hospital versus 30-day mortality assessments for selected medical conditions. Med Care. 2010;48:1117–21.CrossRefPubMed
37.
DeLong ER, Garnick DW, Luft H, et al. Measuring hospital mortality rates: are 30-day data enough? Ischemic heart disease patient outcomes research team. Health Serv Res. 1995;29:679–95.PubMedPubMedCentral
38.
39.
Peterson ED, Roe MT, Mulgund J, et al. Association between hospital process performance and outcomes among patients with acute coronary syndromes. JAMA. 2006;295:1912–20.CrossRefPubMed
40.
41.
Shahian DM, Iezzoni LI, Meyer GS, et al. Hospital-wide mortality as a quality metric: conceptual and methodological challenges. Am J Med Qual Off J Am Coll Med Qual. 2012;27:112–23.CrossRef
42.
Friese CR, Earle CC, Silber JH, et al. Hospital characteristics, clinical severity, and outcomes for surgical oncology patients. Surgery. 2010;147:602–9.CrossRefPubMedPubMedCentral
43.
Hogan H, Healy F, Neale G, et al. Preventable deaths due to problems in care in English acute hospitals: a retrospective case record review study. BMJ Qual Saf. 2012;21:737–45. doi: 10.1136/bmjqs-2011-001159CrossRefPubMedPubMedCentral
44.
Hogan H, Zipfel R, Neuburger J, Hutchings A, Darzi A, Black N. Avoidability of hospital deaths and association with hospital-wide mortality ratios: retrospective case record review and regression analysis. BMJ. 2015;351:h3239.CrossRefPubMedPubMedCentral
45.
Patterson ME, Hernandez AF, Hammill BG, et al. Process of care performance measures and long-term outcomes in patients hospitalized with heart failure. Med Care. 2010;48:210–6.CrossRefPubMedPubMedCentral
46.
Shahian DM, Meyer GS, Mort E, et al. Association of National Hospital Quality Measure adherence with long-term mortality and readmissions. BMJ Qual Saf. 2012;21:325–36.CrossRefPubMed
47.
Hall P. Methodology and Theory for the Bootstrap. Handbook of econometrics. 1994;4:2341–81.CrossRef
48.
Küchenhoff H, Carroll RJ. Segmented regression with errors in predictors: semi-parametric and parametric methods. Stat Med. 1997;16:169–88.CrossRef
49.
White HA. Heteroskedasticity-consistent covariance matrix estimator and a direct test for Heteroskedasticity. Econometrica. 1980;48:817–38.CrossRef
50.
Breusch TS, Pagan AR. A simple test for heteroscedasticity and random coefficient variation. Econometrica. 1979;47:1287–94.CrossRef
Metadata
Title
Hospital quality measures: are process indicators associated with hospital standardized mortality ratios in French acute care hospitals?
Authors
Marcus Ngantcha
Marie-Annick Le-Pogam
Sophie Calmus
Catherine Grenier
Isabelle Evrard
Agathe Lamarche-Vadel
Grégoire Rey
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-017-2534-3

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue

Research article

Frequency, associated features, and burden of neurological disorders in older adult inpatients in Brazil: a retrospective cross-sectional study

Research article

Who benefits from free institutional delivery? evidence from a cross sectional survey of North Central and Southwestern Nigeria

Erratum

Erratum to: Assessing the reporting of categorised quantitative variables in observational epidemiological studies

Research article

Examining the relationship between therapeutic self-care and adverse events for home care clients in Ontario, Canada: a retrospective cohort study

Research article

The role of simulation in mixed-methods research: a framework & application to patient safety

Research article

Are physicians aware enough of patient radiation protection? Results from a survey among physicians of Pavia District– Italy