Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
BMC Medical Research Methodology
Published in: BMC Medical Research Methodology 1/2008

Open Access 01-12-2008 | Research article

Improving quality indicator report cards through Bayesian modeling

Authors: Byron J Gajewski, Jonathan D Mahnken, Nancy Dunton

Published in: BMC Medical Research Methodology | Issue 1/2008

Login to get access

Abstract

Background

The National Database for Nursing Quality Indicators® (NDNQI®) was established in 1998 to assist hospitals in monitoring indicators of nursing quality (eg, falls and pressure ulcers). Hospitals participating in NDNQI transmit data from nursing units to an NDNQI data repository. Data are summarized and published in reports that allow participating facilities to compare the results for their units with those from other units across the nation. A disadvantage of this reporting scheme is that the sampling variability is not explicit. For example, suppose a small nursing unit that has 2 out of 10 (rate of 20%) patients with pressure ulcers. Should the nursing unit immediately undertake a quality improvement plan because of the rate difference from the national average (7%)?

Methods

In this paper, we propose approximating 95% credible intervals (CrIs) for unit-level data using statistical models that account for the variability in unit rates for report cards.

Results

Bayesian CrIs communicate the level of uncertainty of estimates more clearly to decision makers than other significance tests.

Conclusion

A benefit of this approach is that nursing units would be better able to distinguish problematic or beneficial trends from fluctuations likely due to chance.
Appendix
Available only for authorised users
Literature
1.
Dunton N, Gajewski B, Klaus S, Pierson B: The relationship of nursing workforce characteristics to patient outcomes. OJIN: The Online Journal of Issues in Nursing. 2007, 12 (3):
2.
Austin PC, Brunner LJ: Optimal Bayesian probability levels for hospital report cards. Health Services and Outcomes Research Methodology. 2008, 8 (2): 80-97. 10.1007/s10742-007-0025-4.CrossRef
3.
Draper D, Gittoes M: Statistical analysis of performance indicators in UK higher education. Journal of the Royal Statistical Society Series A. 2004, 167: 449-474.CrossRef
4.
Gelman A, Carlin JB, Stern HS, Rubin DB: Bayesian data analysis. 2000, Washington, DC: Chapman and Hall/CRC
5.
Elliott MN, Zaslavsky AM, Cleary PD: Are finite population corrections appropriate when profiling institutions?. Health Services and Outcomes Research Methodology. 2006, 6 (3–4): 153-156. 10.1007/s10742-006-0011-2.CrossRef
6.
Carlin BP, Louis TA: Bayes and Empirical Bayes Methods for Data Analysis. 1996, Chapman and Hall, London, UK
7.
Dunton N, Gajewski B, Taunton RL, Moore J: Nurse staffing and patient falls on acute care hospital units. Nursing Outlook. 2004, 52 (1): 53-59. 10.1016/j.outlook.2003.11.006.CrossRefPubMed
8.
Gajewski BJ, Hart S, Bergquist A, Dunton N: Inter-rater reliability of pressure ulcer staging: probit Bayesian hierarchical model that allows for uncertain rater response. Statistics in Medicine. 2007, 26 (25): 4602-4618. 10.1002/sim.2877.CrossRefPubMed
9.
Boyle DK, Miller PA, Gajewski BJ, Hart S, Dunton N: Nurse satisfaction differences among practice specialties. Western Journal of Nursing Research. 2006, 28 (6): 622-640. 10.1177/0193945906289506.CrossRefPubMed
10.
Li Y, Dick AW, Glance LG, Cai X, Mukamel DB: Misspecification issues in risk adjustment and construction of outcome-based quality indicators. Health Services and Outcomes Research Methodology. 2007, 7 (1–2): 39-56. 10.1007/s10742-006-0014-z.CrossRef
11.
Gibbons RD, Hur K, Bhaumik DK, Bell CC: Profiling of county-level foster care placements using random-effects Poisson regression models. Health Services and Outcomes Research Methodology. 2007, 7 (3–4): 97-108. 10.1007/s10742-007-0019-2.CrossRef
12.
Arling G, Lewis T, Kane RL, Mueller C, Flood S: Improving quality assessment through multilevel modeling: the case of nursing home compare. Health Services Research. 2007, 42 (3p1): 1177-1199. 10.1111/j.1475-6773.2006.00647.x.CrossRefPubMedPubMedCentral
13.
Gajewski BJ, Petroski G, Thompson S, Dunton N, Wrona M, Becker A, Coffland V: Letter to the editor: the effect of provider-level ascertainment bias on profiling nursing homes by Roy J, Mor V. Statistics in Medicine. 2006, 25 (11): 1976-1977. 10.1002/sim.2480.CrossRefPubMed
14.
Rantz MJ, Petroski GF, Madsen RW, Mehr DR, Popejoy L, Hicks LL, Porter R, Zwygart-Stauffacher M, Grando V: Setting thresholds for quality indicators derived from MDS data for nursing home quality improvement reports: an update. Jt Comm J Qual Improv. 2000, 26 (2): 101-110.PubMed
15.
Normand SL, Glickman ME, Gatsonis CA: Statistical methods for profiling providers of medical care: issues and applications. Journal of the American Statistical Association. 1997, 92: 803-814. 10.2307/2965545.CrossRef
16.
Christiansen CL, Morris CN: Improving the statistical approach to health care provider profiling. Annals of Internal Medicine. 1997, 127: 764-768.CrossRefPubMed
17.
Spiegelhalter DJ, Aylin P, Best NG, Evans SJW, Murray GD: Commissioned analysis of surgical performance using routine data: lessons from the Bristol inquiry. Journal of Royal Statistical Society A. 2000, 165: 191-231. 10.1111/1467-985X.02021.CrossRef
18.
Ashby D: Bayesian statistics in medicine: a 25 year review. Statistics in Medicine. 2006, 25 (21): 3589-3631. 10.1002/sim.2672.CrossRefPubMed
19.
Austin PC: A comparison of Bayesian methods for profiling hospital performance. Medical Decision Making. 2002, 22: 163-172. 10.1177/02729890222063044.CrossRefPubMed
20.
Austin PC: Bayes rules for optimally using Bayesian hierarchical regression models in provider profiling to identify high-mortality hospitals. BMC Medical Research Methodology. 2008, 8: 30-10.1186/1471-2288-8-30.CrossRefPubMedPubMedCentral
21.
22.
Thomas N, Longford NT, Rolph JE: Empirical Bayes methods for estimating hospital-specific mortality rates. Statistics in Medicine. 1994, 13: 889-903. 10.1002/sim.4780130902.CrossRefPubMed
23.
Bernardinelli L, Montomili C: Empirical Bayes versus fully Bayesian analysis of geographical variation in disease risk. Statistics in Medicine. 1992, 11: 983-1007. 10.1002/sim.4780110802.CrossRefPubMed
24.
Zhou XH, Katz BP, Holleman E, Melfi CA, Dittus R: An empirical Bayes method for studying variation in knee replacement rates. Statistics in Medicine. 1996, 15 (17–18): 1875-1884. 10.1002/(SICI)1097-0258(19960915)15:17<1875::AID-SIM399>3.0.CO;2-4.CrossRefPubMed
25.
LaValley MP, DeGruttola V: Models for empirical Bayes estimators of longitudinal CD4 counts. Statistics in Medicine. 1996, 15 (21–22): 2289-2305. 10.1002/(SICI)1097-0258(19961115)15:21<2289::AID-SIM449>3.0.CO;2-I.CrossRefPubMed
26.
Louis TA, Shen W: Innovations in Bayes and empirical Bayes methods: estimating parameters, populations and ranks. Statistics in Medicine. 1999, 18 (17–18): 2493-2505. 10.1002/(SICI)1097-0258(19990915/30)18:17/18<2493::AID-SIM271>3.0.CO;2-S.CrossRefPubMed
27.
Casella G, Berger RL: Statistical Inference. 1990, Duxbury Press, Belmont, CA, USA
28.
Spiegelhalter DJ, Best NG, Carlin BP, Linde van der A: Bayesian measures of model complexity and fit (with discussion). Journal of the Royal Statistical Society B. 2002, 64: 583-640. 10.1111/1467-9868.00353.CrossRef
29.
Glickman ME, Stern HS: A state-space model for National Football League scores. Journal of the American Statistical Association. 1998, 93 (441): 25-35. 10.2307/2669599.CrossRef
Metadata
Title
Improving quality indicator report cards through Bayesian modeling
Authors
Byron J Gajewski
Jonathan D Mahnken
Nancy Dunton
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2008
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-8-77

Other articles of this Issue 1/2008

BMC Medical Research Methodology 1/2008 Go to the issue

Research article

Demonstrating the robustness of population surveillance data: implications of error rates on demographic and mortality estimates

Research article

Simpson's paradox visualized: The example of the Rosiglitazone meta-analysis

Research article

Bayes rules for optimally using Bayesian hierarchical regression models in provider profiling to identify high-mortality hospitals

Research article

Vignette studies of medical choice and judgement to study caregivers' medical decision behaviour: systematic review

Research article

Accuracy of self-reported body weight, height and waist circumference in a Dutch overweight working population

Software

Balance algorithm for cluster randomized trials