Skip to main content
Top
Published in: BMC Health Services Research 1/2013

Open Access 01-12-2013 | Research article

The Care Process Self-Evaluation Tool: a valid and reliable instrument for measuring care process organization of health care teams

Authors: Deborah Seys, Svin Deneckere, Walter Sermeus, Eva Van Gerven, Massimiliano Panella, Luk Bruyneel, Timothy Mutsvari, Rafaela Camacho Bejarano, Seval Kul, Kris Vanhaecht

Published in: BMC Health Services Research | Issue 1/2013

Login to get access

Abstract

Background

Patient safety can be increased by improving the organization of care. A tool that evaluates the actual organization of care, as perceived by multidisciplinary teams, is the Care Process Self-Evaluation Tool (CPSET). CPSET was developed in 2007 and includes 29 items in five subscales: (a) patient-focused organization, (b) coordination of the care process, (c) collaboration with primary care, (d) communication with patients and family, and (e) follow-up of the care process. The goal of the present study was to further evaluate the psychometric properties of the CPSET at the team and hospital levels and to compile a cutoff score table.

Methods

The psychometric properties of the CPSET were assessed in a multicenter study in Belgium and the Netherlands. In total, 3139 team members from 114 hospitals participated. Psychometric properties were evaluated by using confirmatory factor analysis (CFA), Cronbach’s alpha, interclass correlation coefficients (ICCs), Kruskall-Wallis test, and Mann–Whitney test. For the cutoff score table, percentiles were used. Demographic variables were also evaluated.

Results

CFA showed a good model fit: a normed fit index of 0.93, a comparative fit index of 0.94, an adjusted goodness-of-fit index of 0.87, and a root mean square error of approximation of 0.06. Cronbach’s alpha values were between 0.869 and 0.950. The team-level ICCs varied between 0.127 and 0.232 and were higher than those at the hospital level (0.071-0.151). Male team members scored significantly higher than females on 2 of the 5 subscales and on the overall CPSET. There were also significant differences among age groups. Medical doctors scored significantly higher on 4 of the 5 subscales and on the overall CPSET. Coordinators of care processes scored significantly lower on 2 of the 5 subscales and on the overall CPSET. Cutoff scores for all subscales and the overall CPSET were calculated.

Conclusions

The CPSET is a valid and reliable instrument for health care teams to measure the extent care processes are organized. The cutoff table permits teams to compare how they perceive the organization of their care process relative to other teams.
Literature
1.
go back to reference Altman DE, Clancy C, Blandon RJ: Improving patient safety – five years after the IOM report. N Eng J Med. 2004, 351: 2041-2043. 10.1056/NEJMp048243.CrossRef Altman DE, Clancy C, Blandon RJ: Improving patient safety – five years after the IOM report. N Eng J Med. 2004, 351: 2041-2043. 10.1056/NEJMp048243.CrossRef
2.
go back to reference Classen DC, Resar R, Griffin F, Federico F, Frankel T, Kimmel N, Whittington JC, Frankel A, Seger A, James BC: ‘Global Trigger Tool’ shows that adverse events in hospitals may be ten times greater than previously measured. Health Aff. 2011, 30: 581-589. 10.1377/hlthaff.2011.0190.CrossRef Classen DC, Resar R, Griffin F, Federico F, Frankel T, Kimmel N, Whittington JC, Frankel A, Seger A, James BC: ‘Global Trigger Tool’ shows that adverse events in hospitals may be ten times greater than previously measured. Health Aff. 2011, 30: 581-589. 10.1377/hlthaff.2011.0190.CrossRef
3.
go back to reference Landrigan CP, Parry GJ, Bones CB, Hackbarth AD, Goldmann DA, Sharek PJ: Temporal trends in rates of patient harm resulting from medical care. N Engl J Med. 2010, 363: 2124-2134. 10.1056/NEJMsa1004404.CrossRefPubMed Landrigan CP, Parry GJ, Bones CB, Hackbarth AD, Goldmann DA, Sharek PJ: Temporal trends in rates of patient harm resulting from medical care. N Engl J Med. 2010, 363: 2124-2134. 10.1056/NEJMsa1004404.CrossRefPubMed
4.
go back to reference Committee on Quality of Health Care in America, Institute of Medicine: Crossing the quality chasm: A new health system for the 21st century. 2001, Washington DC: National Academy Press Committee on Quality of Health Care in America, Institute of Medicine: Crossing the quality chasm: A new health system for the 21st century. 2001, Washington DC: National Academy Press
5.
go back to reference Porter ME, Teisberg EO: How physicians can change the future of health care. JAMA. 2007, 297: 1103-1111. 10.1001/jama.297.10.1103.CrossRefPubMed Porter ME, Teisberg EO: How physicians can change the future of health care. JAMA. 2007, 297: 1103-1111. 10.1001/jama.297.10.1103.CrossRefPubMed
6.
go back to reference Chilingerian JA, Glavin MP: Temporary firms in community hospitals: elements of a managerial theory of clinical efficiency. Med Care Rev. 1994, 51: 289-335. 10.1177/107755879405100303.CrossRefPubMed Chilingerian JA, Glavin MP: Temporary firms in community hospitals: elements of a managerial theory of clinical efficiency. Med Care Rev. 1994, 51: 289-335. 10.1177/107755879405100303.CrossRefPubMed
7.
go back to reference Deneckere S, Euwema M, Van Herck P, Lodewijckx C, Panella M, Sermeus W, Vanhaecht K: Care Pathways Lead to Better Teamwork: Results of a Systematic Review. Soc Sci Med. 2012, 75: 264-268. 10.1016/j.socscimed.2012.02.060.CrossRefPubMed Deneckere S, Euwema M, Van Herck P, Lodewijckx C, Panella M, Sermeus W, Vanhaecht K: Care Pathways Lead to Better Teamwork: Results of a Systematic Review. Soc Sci Med. 2012, 75: 264-268. 10.1016/j.socscimed.2012.02.060.CrossRefPubMed
8.
go back to reference Manser T: Teamwork and patient safety in dynamic domains of healthcare: a review of the literature. Acta Anaesthesiol Scand. 2009, 53: 143-151. 10.1111/j.1399-6576.2008.01717.x.CrossRefPubMed Manser T: Teamwork and patient safety in dynamic domains of healthcare: a review of the literature. Acta Anaesthesiol Scand. 2009, 53: 143-151. 10.1111/j.1399-6576.2008.01717.x.CrossRefPubMed
9.
go back to reference Vanhaecht K, De Witte K, Depreitere R, van Zelm R, De Bleser L, Proost K, Sermeus W: Development and validation of a care process self-evaluation tool. Health Serv Manage Res. 2007, 20: 189-202. 10.1258/095148407781395964.CrossRefPubMed Vanhaecht K, De Witte K, Depreitere R, van Zelm R, De Bleser L, Proost K, Sermeus W: Development and validation of a care process self-evaluation tool. Health Serv Manage Res. 2007, 20: 189-202. 10.1258/095148407781395964.CrossRefPubMed
10.
go back to reference Deneckere S, Robyns N, Vanhaecht K, Euwema M, Panella M, Lodewijckx C, Leigheb F, Sermeus W: Indicators for follow-up of multidisciplinary teamwork in care processes: results of an international expert panel. Eval Health Prof. 2011, 34: 258-277. 10.1177/0163278710393736.CrossRefPubMed Deneckere S, Robyns N, Vanhaecht K, Euwema M, Panella M, Lodewijckx C, Leigheb F, Sermeus W: Indicators for follow-up of multidisciplinary teamwork in care processes: results of an international expert panel. Eval Health Prof. 2011, 34: 258-277. 10.1177/0163278710393736.CrossRefPubMed
11.
go back to reference Vanhaecht K, Van Gerven E, Segal O, Panella M, Sermeus W, Bellemans J, Simon JP: Is variation in the content of care pathways leading to quality and patient safety problems?. Hip Int. 2011, 21: 770-771. 10.5301/HIP.2011.8844.CrossRefPubMed Vanhaecht K, Van Gerven E, Segal O, Panella M, Sermeus W, Bellemans J, Simon JP: Is variation in the content of care pathways leading to quality and patient safety problems?. Hip Int. 2011, 21: 770-771. 10.5301/HIP.2011.8844.CrossRefPubMed
12.
go back to reference Segal O, Bellemans J, Van Gerven E, Deneckere S, Panella M, Sermeus W, Vanhaecht K: Important variations in the content of care pathway documents for total knee arthroplasty may lead to quality and patient safety problems. J Eval Clin Practice. 2013, 19: 11-15. 10.1111/j.1365-2753.2011.01760.x.CrossRef Segal O, Bellemans J, Van Gerven E, Deneckere S, Panella M, Sermeus W, Vanhaecht K: Important variations in the content of care pathway documents for total knee arthroplasty may lead to quality and patient safety problems. J Eval Clin Practice. 2013, 19: 11-15. 10.1111/j.1365-2753.2011.01760.x.CrossRef
13.
go back to reference Van Gerven E, Vanhaecht K, Deneckere S, Vleugels A, Sermeus W: Management challenges in care pathways: conclusions of a qualitative study within 57 health care organizations. Int J Care Path. 2010, 14: 142-149. 10.1258/jicp.2010.010029.CrossRef Van Gerven E, Vanhaecht K, Deneckere S, Vleugels A, Sermeus W: Management challenges in care pathways: conclusions of a qualitative study within 57 health care organizations. Int J Care Path. 2010, 14: 142-149. 10.1258/jicp.2010.010029.CrossRef
14.
go back to reference Deneckere S, Euwema M, Lodewijckx C, Panella M, Sermeus W, Vanhaecht K: The European Quality of Care Pathways (EQCP) study on the impact of care pathways on interprofessional teamwork in an acute hospital setting: study protocol: for a cluster randomised controlled trail and evaluation of implementation processes. Implement Sci. 2012, 7: 47-http://dx.doi.org/10.1186/1748-5908-7-47.CrossRefPubMedPubMedCentral Deneckere S, Euwema M, Lodewijckx C, Panella M, Sermeus W, Vanhaecht K: The European Quality of Care Pathways (EQCP) study on the impact of care pathways on interprofessional teamwork in an acute hospital setting: study protocol: for a cluster randomised controlled trail and evaluation of implementation processes. Implement Sci. 2012, 7: 47-http://​dx.​doi.​org/​10.​1186/​1748-5908-7-47.​CrossRefPubMedPubMedCentral
16.
go back to reference Medsker GJ, Williams LJ, Holahan PJ: A review of current practices for evaluating causal models in organizational behavior and human resources management research. J manage. 1994, 20: 439-464. Medsker GJ, Williams LJ, Holahan PJ: A review of current practices for evaluating causal models in organizational behavior and human resources management research. J manage. 1994, 20: 439-464.
17.
go back to reference Waltz CF, Strickland OL, Lenz ER: Measurement in nursing and health research. 2005, New York: Springer, (3rd edition) Waltz CF, Strickland OL, Lenz ER: Measurement in nursing and health research. 2005, New York: Springer, (3rd edition)
18.
go back to reference Donner A, Klar N: Design and analysis of cluster randomization trails in health research. 2000, London: Arnold Donner A, Klar N: Design and analysis of cluster randomization trails in health research. 2000, London: Arnold
19.
go back to reference Thomas EJ, Sexton JB, Helmreich RL: Discrepant attitudes about teamwork among critical care nurses and physicians. Crit Care Med. 2003, 31: 956-959. 10.1097/01.CCM.0000056183.89175.76.CrossRefPubMed Thomas EJ, Sexton JB, Helmreich RL: Discrepant attitudes about teamwork among critical care nurses and physicians. Crit Care Med. 2003, 31: 956-959. 10.1097/01.CCM.0000056183.89175.76.CrossRefPubMed
20.
go back to reference Wauben LS, Dekker-Van Doorn CM, van Wijngaarden JD, Goossens RH, Huijsman R, Klein J, Lange JF: Discrepant perceptions of communication, teamwork and situation awareness among surgical team members. Int J Qual Health Care. 2011, 23: 159-166. 10.1093/intqhc/mzq079.CrossRefPubMedPubMedCentral Wauben LS, Dekker-Van Doorn CM, van Wijngaarden JD, Goossens RH, Huijsman R, Klein J, Lange JF: Discrepant perceptions of communication, teamwork and situation awareness among surgical team members. Int J Qual Health Care. 2011, 23: 159-166. 10.1093/intqhc/mzq079.CrossRefPubMedPubMedCentral
21.
go back to reference Carney BT, West P, Neily JB, Mills PD, Bagian JP: Improving perceptions of teamwork climate with the Veterans Health Administration medical team training program. Am J Med Qual. 2011, 26: 480-484. 10.1177/1062860611401653.CrossRefPubMed Carney BT, West P, Neily JB, Mills PD, Bagian JP: Improving perceptions of teamwork climate with the Veterans Health Administration medical team training program. Am J Med Qual. 2011, 26: 480-484. 10.1177/1062860611401653.CrossRefPubMed
22.
go back to reference Papathanassoglou ED, Karanikola MN, Kalafati M, Giannakopoulou M, Lemonidou C, Albarran JW: Professional autonomy, collaboration with physicians and moral distress among European intensive care nurses. Am J Crit Care. 2012, 21: 41-52. 10.4037/ajcc2012205.CrossRef Papathanassoglou ED, Karanikola MN, Kalafati M, Giannakopoulou M, Lemonidou C, Albarran JW: Professional autonomy, collaboration with physicians and moral distress among European intensive care nurses. Am J Crit Care. 2012, 21: 41-52. 10.4037/ajcc2012205.CrossRef
23.
go back to reference Nørgaard B, Kofoed PE, Ohm Kyvik K, Ammentorp J: Communication skills training for health care professionals improves the adult orthopaedic patient’s experience of quality of care. Scan J Caring Sci. 2012, 26: 698-704. 10.1111/j.1471-6712.2012.00982.x.CrossRef Nørgaard B, Kofoed PE, Ohm Kyvik K, Ammentorp J: Communication skills training for health care professionals improves the adult orthopaedic patient’s experience of quality of care. Scan J Caring Sci. 2012, 26: 698-704. 10.1111/j.1471-6712.2012.00982.x.CrossRef
24.
go back to reference Bates DW, Larizgoitia I, Prasopa-Plaizier N, Jha AK, Research Priority Setting Working Group of the WHO World Alliance for Patient Safety: Global priorities for patient safety research. BMJ. 2009, 338: b1775-10.1136/bmj.b1775.CrossRefPubMed Bates DW, Larizgoitia I, Prasopa-Plaizier N, Jha AK, Research Priority Setting Working Group of the WHO World Alliance for Patient Safety: Global priorities for patient safety research. BMJ. 2009, 338: b1775-10.1136/bmj.b1775.CrossRefPubMed
25.
go back to reference Havens DS, Vasey J, Gittel JH, Lin WT: Relational coordination among nurses and other providers: impact on the quality of care. J Nurs Manag. 2010, 18: 926-937. 10.1111/j.1365-2834.2010.01138.x.CrossRefPubMed Havens DS, Vasey J, Gittel JH, Lin WT: Relational coordination among nurses and other providers: impact on the quality of care. J Nurs Manag. 2010, 18: 926-937. 10.1111/j.1365-2834.2010.01138.x.CrossRefPubMed
26.
go back to reference O’Leary KJ, Sehgal NL, Terrell G, Williams MV, For the High Performance Teams and the Hospital of the Future Project Team: Interdisciplinary teamwork in hospitals: a review and practical recommendations for improvement. J Hosp Med. 2012, 7: 48-54. 10.1002/jhm.970.CrossRefPubMed O’Leary KJ, Sehgal NL, Terrell G, Williams MV, For the High Performance Teams and the Hospital of the Future Project Team: Interdisciplinary teamwork in hospitals: a review and practical recommendations for improvement. J Hosp Med. 2012, 7: 48-54. 10.1002/jhm.970.CrossRefPubMed
27.
go back to reference Aiken LH, Sermeus W, Van den Heede K, Sloane DM, Busse R, McKee M, Bruyneel L, Rafferty AM, Griffiths P, Moreno-Casbas MT, Tishelman C, Scott A, Brzostek T, Kinnunen J, Schwendimann R, Heinen M, Zikos D, Sjetne IS, Smith HL, Kutney-Lee A: Patient safety, satisfaction, and quality of hospital care: cross sectional surveys of nurses and patients in 12 countries in Europe and the United States. BMJ. 2012, 344: e1717-10.1136/bmj.e1717.CrossRefPubMedPubMedCentral Aiken LH, Sermeus W, Van den Heede K, Sloane DM, Busse R, McKee M, Bruyneel L, Rafferty AM, Griffiths P, Moreno-Casbas MT, Tishelman C, Scott A, Brzostek T, Kinnunen J, Schwendimann R, Heinen M, Zikos D, Sjetne IS, Smith HL, Kutney-Lee A: Patient safety, satisfaction, and quality of hospital care: cross sectional surveys of nurses and patients in 12 countries in Europe and the United States. BMJ. 2012, 344: e1717-10.1136/bmj.e1717.CrossRefPubMedPubMedCentral
28.
go back to reference Verhaeghe R, Vlerick P, De Backer G, Van Maele G, Gemmel P: Recurrent changes in the work environment, job resources and distress among nurses: a comparative cross-sectional survey. Int J Nurs Stud. 2008, 45: 382-392. 10.1016/j.ijnurstu.2006.10.003.CrossRefPubMed Verhaeghe R, Vlerick P, De Backer G, Van Maele G, Gemmel P: Recurrent changes in the work environment, job resources and distress among nurses: a comparative cross-sectional survey. Int J Nurs Stud. 2008, 45: 382-392. 10.1016/j.ijnurstu.2006.10.003.CrossRefPubMed
Metadata
Title
The Care Process Self-Evaluation Tool: a valid and reliable instrument for measuring care process organization of health care teams
Authors
Deborah Seys
Svin Deneckere
Walter Sermeus
Eva Van Gerven
Massimiliano Panella
Luk Bruyneel
Timothy Mutsvari
Rafaela Camacho Bejarano
Seval Kul
Kris Vanhaecht
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2013
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-13-325

Other articles of this Issue 1/2013

BMC Health Services Research 1/2013 Go to the issue