Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2011

Open Access 01-12-2011 | Research

Validity and usefulness of members reports of implementation progress in a quality improvement initiative: findings from the Team Check-up Tool (TCT)

Authors: Kitty S Chan, Yea-Jen Hsu, Lisa H Lubomski, Jill A Marsteller

Published in: Implementation Science | Issue 1/2011

Login to get access

Abstract

Background

Team-based interventions are effective for improving safety and quality of healthcare. However, contextual factors, such as team functioning, leadership, and organizational support, can vary significantly across teams and affect the level of implementation success. Yet, the science for measuring context is immature. The goal of this study is to validate measures from a short instrument tailored to track dynamic context and progress for a team-based quality improvement (QI) intervention.

Methods

Design: Secondary cross-sectional and longitudinal analysis of data from a clustered randomized controlled trial (RCT) of a team-based quality improvement intervention to reduce central line-associated bloodstream infection (CLABSI) rates in intensive care units (ICUs).
Setting: Forty-six ICUs located within 35 faith-based, not-for-profit community hospitals across 12 states in the U.S.
Population: Team members participating in an ICU-based QI intervention.
Measures: The primary measure is the Team Check-up Tool (TCT), an original instrument that assesses context and progress of a team-based QI intervention. The TCT is administered monthly. Validation measures include CLABSI rate, Team Functioning Survey (TFS) and Practice Environment Scale (PES) from the Nursing Work Index.
Analysis: Temporal stability, responsiveness and validity of the TCT.

Results

We found evidence supporting the temporal stability, construct validity, and responsiveness of TCT measures of intervention activities, perceived group-level behaviors, and barriers to team progress.

Conclusions

The TCT demonstrates good measurement reliability, validity, and responsiveness. By having more validated measures on implementation context, researchers can more readily conduct rigorous studies to identify contextual variables linked to key intervention and patient outcomes and strengthen the evidence base on successful spread of efficacious team-based interventions. QI teams participating in an intervention should also find data from a validated tool useful for identifying opportunities to improve their own implementation.
Appendix
Available only for authorised users
Literature
1.
Lemieux-Charles L, McGuire WL: What do we know about health care team effectiveness? A review of the literature. Med Care Res Rev. 2006, 63: 263-300. 10.1177/1077558706287003.CrossRefPubMed
2.
Lynn J, Schall MW, Milne C, Nolan KM, Kabcenell A: Quality improvements in end of life care: insights from two collaboratives. Jt Comm J Qual Improv. 2000, 26: 254-267.PubMed
3.
Pronovost P, Needham D, Berenholtz S, Sinopoli D, Chu H, Cosgrove S, Sexton B, Hyzy R, Welsh R, Roth G: An intervention to decrease catheter-related bloodstream infections in the ICU. N Engl J Med. 2006, 355: 2725-2732. 10.1056/NEJMoa061115.CrossRefPubMed
4.
Schouten LM, Hulscher ME, Akkermans R, van Everdingen JJ, Grol RP, Huijsman R: Factors that influence the stroke care team's effectiveness in reducing the length of hospital stay. Stroke. 2008, 39: 2515-2521. 10.1161/STROKEAHA.107.510537.CrossRefPubMed
5.
ØVretveit J, Bate P, Cleary P, Cretin S, Gustafson D, McInnes K, McLeod H, Molfenter T, Plsek P, Robert G: Quality collaboratives: lessons from research. Qual Saf Health Care. 2002, 11: 345-351. 10.1136/qhc.11.4.345.CrossRefPubMed
6.
Mills PD, Weeks WB: Characteristics of successful quality improvement teams: lessons from five collaborative projects in the VHA. Jt Comm J Qual Saf. 2004, 30: 152-162.PubMed
7.
Shortell SM, Marsteller JA, Lin M, Pearson ML, Wu SY, Mendel P, Cretin S, Rosen M: The role of perceived team effectiveness in improving chronic illness care. Med Care. 2004, 42: 1040-1048. 10.1097/00005650-200411000-00002.CrossRefPubMed
8.
Hroscikoski MC, Solberg LI, Sperl-Hillen JM, Harper PG, McGrail MP, Crabtree BF: Challenges of change: a qualitative study of chronic care model implementation. Ann Fam Med. 2006, 4: 317-326. 10.1370/afm.570.CrossRefPubMedPubMedCentral
9.
Newton PJ, Halcomb EJ, Davidson PM, Denniss AR: Barriers and facilitators to the implementation of the collaborative method: reflections from a single site. Qual Saf Health Care. 2007, 16: 409-414. 10.1136/qshc.2006.019125.CrossRefPubMedPubMedCentral
10.
Pearson ML, Wu S, Schaefer J, Bonomi AE, Shortell SM, Mendel PJ, Marsteller JA, Louis TA, Rosen M, Keeler EB: Assessing the implementation of the chronic care model in quality improvement collaboratives. Health Serv Res. 2005, 40: 978-996. 10.1111/j.1475-6773.2005.00397.x.CrossRefPubMedPubMedCentral
11.
Anderson NR, West MA: Measuring climate for work group innovation: development and validation of the team climate inventory. J Organiz Behav. 1998, 19: 235-258. 10.1002/(SICI)1099-1379(199805)19:3<235::AID-JOB837>3.0.CO;2-C.CrossRef
12.
Lubomski LH, Marsteller JA, Hsu YJ, Goeschel CA, Holzmueller CG, Pronovost PJ: The team checkup tool: evaluating QI team activities and giving feedback to senior leaders. Jt Comm J Qual Patient Saf. 2008, 34: 619-623. 561PubMed
13.
Marsteller JA, Sexton B, Hsu YJ, Hsiao CJ, Pronovost PJ, Thompson DA: A multicenter, phased cluster-randomized controlled trial to reduce central line-associated blood stream infections. Johns Hopkins Bloomberg School of Public Health and Johns Hopkins School of Medicine. 2010, July , submitted to a peer-reviewed journal
14.
Lake ET: Development of the practice environment scale of the Nursing Work Index. Res Nurs Health. 2002, 25: 176-188. 10.1002/nur.10032.CrossRefPubMed
15.
Pronovost P, Weast B, Rosenstein B, Sexton JB, Holzmueller CG, Paine L, Davis R, Rubin HR: Implementing and validating a comprehensive unit-based safety program. J Patient Safety. 2005, 1: 33-40. 10.1097/01209203-200503000-00008.CrossRef
16.
Pronovost PJ, Berenholtz SM, Goeschel C, Thom I, Watson SR, Holzmueller CG, Lyon JS, Lubomski LH, Thompson DA, Needham D: Improving patient safety in intensive care units in Michigan. J Crit Care. 2008, 23: 207-221. 10.1016/j.jcrc.2007.09.002.CrossRefPubMed
17.
Pronovost PJ, Berenholtz SM, Goeschel CA, Needham DM, Sexton JB, Thompson DA, Lubomski LH, Marsteller JA, Makary MA, Hunt E: Creating high reliability in health care organizations. Health Serv Res. 2006, 41: 1599-1617. 10.1111/j.1475-6773.2006.00567.x.CrossRefPubMedPubMedCentral
18.
Sawyer M, Weeks K, Goeschel CA, Thompson DA, Berenholtz SM, Marsteller JA, Lubomski LH, Cosgrove SE, Winters BD, Murphy DJ: Using evidence, rigorous measurement, and collaboration to eliminate central catheter-associated bloodstream infections. Crit Care Med. 2010, 38: S292-298.CrossRefPubMed
19.
Caverzagie KJ, Bernabeo EC, Reddy SG, Holmboe ES: The role of physician engagement on the impact of the hospital-based practice improvement module (PIM). J Hosp Med. 2009, 4: 466-470. 10.1002/jhm.495.CrossRefPubMed
20.
Heenan M, Higgins D: Engaging physician leaders in performance measurement and quality. Healthc Q. 2009, 12: 66-69.CrossRefPubMed
21.
Strasser DC, Burridge AB, Falconer JA, Herrin J, Uomoto J: Measuring team process for quality improvement. Top Stroke Rehabil. 2010, 17: 282-293. 10.1310/tsr1704-282.CrossRefPubMed
22.
Helfrich CD, Weiner BJ, McKinney MM, Minasian L: Determinants of implementation effectiveness: adapting a framework for complex innovations. Med Care Res Rev. 2007, 64: 279-303. 10.1177/1077558707299887.CrossRefPubMed
23.
Powell AA, Gravely AA, Ordin DL, Schlosser JE, Partin MR: Timely follow-up of positive fecal occult blood tests strategies associated with improvement. Am J Prev Med. 2009, 37: 87-93. 10.1016/j.amepre.2009.05.013.CrossRefPubMed
24.
Wheelan SA, Hochberger JM: Validation studies of group development questionnaire. Small Group Research. 1996, 27: 143-10.1177/1046496496271007.CrossRef
25.
Dückers ML, Wagner C, Groenewegen PP: Developing and testing an instrument to measure the presence of conditions for successful implementation of quality improvement collaboratives. BMC Health Serv Res. 2008, 8: 172-10.1186/1472-6963-8-172.CrossRefPubMedPubMedCentral
Metadata
Title
Validity and usefulness of members reports of implementation progress in a quality improvement initiative: findings from the Team Check-up Tool (TCT)
Authors
Kitty S Chan
Yea-Jen Hsu
Lisa H Lubomski
Jill A Marsteller
Publication date
01-12-2011
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2011
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-6-115

Other articles of this Issue 1/2011

Implementation Science 1/2011 Go to the issue

Study protocol

Barriers and facilitators to the dissemination of DECISION+, a continuing medical education program for optimizing decisions about antibiotics for acute respiratory infections in primary care: A study protocol

Research

Bridging the gap between basic science and clinical practice: The role of organizations in addressing clinician barriers

Study protocol

Disseminating quality improvement: study protocol for a large cluster-randomized trial

Study protocol

'Communicate to vaccinate' (COMMVAC). building evidence for improving communication about childhood vaccinations in low- and middle-income countries: protocol for a programme of research

Research article

Feasibility of a randomised trial of a continuing medical education program in shared decision-making on the use of antibiotics for acute respiratory infections in primary care: the DECISION+ pilot trial

Research

Understanding the context of balanced scorecard implementation: a hospital-based case study in Pakistan