Skip to main content
Top
Published in: BMC Health Services Research 1/2013

Open Access 01-12-2013 | Research article

Developing content for a process-of-care checklist for use in intensive care units: a dual-method approach to establishing construct validity

Authors: Karena M Conroy, Doug Elliott, Anthony R Burrell

Published in: BMC Health Services Research | Issue 1/2013

Login to get access

Abstract

Background

In the intensive care unit (ICU), checklists can be used to support the delivery of quality and consistent clinical care. While studies have reported important benefits for clinical checklists in this context, lack of formal validity testing in the literature prompted the study aim; to develop relevant ‘process-of-care’ checklist statements, using rigorously applied and reported methods that were clear, concise and reflective of the current evidence base. These statements will be sufficiently instructive for use by physicians during ICU clinical rounds.

Methods

A dual-method approach was utilized; semi-structured interviews with local clinicians; and rounds of surveys to an expert Delphi panel. The interviews helped determine checklist item inclusion/exclusion prior to the first round Delphi survey. The panel for the modified-Delphi technique consisted of local intensivists and a state-wide ICU quality committee. Minimum standards for consensus agreement were set prior to the distribution of questionnaires, and rounds of surveys continued until consensus was achieved.

Results

A number of important issues such as overlap with other initiatives were identified in interviews with clinicians and integrated into the Delphi questionnaire, but no additional checklist items were suggested, demonstrating adequate checklist coverage sourced from the literature. These items were verified by local clinicians as being relevant to ICU and important elements of care that required checking during ward rounds. Two rounds of Delphi surveys were required to reach consensus on nine checklist statements: nutrition, pain management, sedation, deep vein thrombosis and stress ulcer prevention, head-of-bed elevation, blood glucose levels, readiness to extubate, and medications.

Conclusions

Statements were developed as the most clear, concise, evidence-informed and instructive statements for use during clinical rounds in an ICU. Initial evidence in support of the checklist’s construct validity was established prior to further prospective evaluation in the same ICU.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hales B, Terblanche M, Fowler R, Sibbald W: Development of medical checklists for improved quality of patient care. Int J Qual Health Care. 2008, 20: 22-30.CrossRefPubMed Hales B, Terblanche M, Fowler R, Sibbald W: Development of medical checklists for improved quality of patient care. Int J Qual Health Care. 2008, 20: 22-30.CrossRefPubMed
2.
go back to reference Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat A-H, Dellinger P, Herbosa T, Joseph S, Kibatala PL, Lapitan MCM, et al: A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009, 360: 491-499. 10.1056/NEJMsa0810119.CrossRefPubMed Haynes AB, Weiser TG, Berry WR, Lipsitz SR, Breizat A-H, Dellinger P, Herbosa T, Joseph S, Kibatala PL, Lapitan MCM, et al: A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009, 360: 491-499. 10.1056/NEJMsa0810119.CrossRefPubMed
3.
go back to reference Hewson-Conroy KM, Elliott D, Burrell AR: Quality and safety in intensive care - a means to an end is critical. Aust Crit Care. 2010, 23: 109-129. 10.1016/j.aucc.2009.12.001.CrossRefPubMed Hewson-Conroy KM, Elliott D, Burrell AR: Quality and safety in intensive care - a means to an end is critical. Aust Crit Care. 2010, 23: 109-129. 10.1016/j.aucc.2009.12.001.CrossRefPubMed
4.
go back to reference Weiss CH, Moazed F, McEvoy CA, Singer BD, Szleifer I, Amaral LAN, Kwasny M, Watts CM, Persell SD, Baker DW, et al: Prompting physicians to address a daily checklist and process of care and clinical outcomes: a single-site study. Am J Respir Crit Care Med. 2011, 184: 680-686. 10.1164/rccm.201101-0037OC.CrossRefPubMedPubMedCentral Weiss CH, Moazed F, McEvoy CA, Singer BD, Szleifer I, Amaral LAN, Kwasny M, Watts CM, Persell SD, Baker DW, et al: Prompting physicians to address a daily checklist and process of care and clinical outcomes: a single-site study. Am J Respir Crit Care Med. 2011, 184: 680-686. 10.1164/rccm.201101-0037OC.CrossRefPubMedPubMedCentral
5.
go back to reference Winters BD, Gurses AP, Lehmann H, Sexton JB, Rampersad CJ, Pronovost PJ: Clinical review: checklists - translating evidence into practice. Crit Care. 2009, 13: 210.CrossRefPubMedPubMedCentral Winters BD, Gurses AP, Lehmann H, Sexton JB, Rampersad CJ, Pronovost PJ: Clinical review: checklists - translating evidence into practice. Crit Care. 2009, 13: 210.CrossRefPubMedPubMedCentral
6.
go back to reference Hewson-Conroy KM, Burrell AR, Elliott D, Webb SAR, Seppelt IM, Taylor C, Glass P: Compliance with processes of care in intensive care units in Australia and New Zealand- A point prevalence study. Anaesth Intensive Care. 2011, 39: 926-935.PubMed Hewson-Conroy KM, Burrell AR, Elliott D, Webb SAR, Seppelt IM, Taylor C, Glass P: Compliance with processes of care in intensive care units in Australia and New Zealand- A point prevalence study. Anaesth Intensive Care. 2011, 39: 926-935.PubMed
7.
go back to reference Conroy KM, Elliott D, Burrell AR: Validating a process-of-care checklist for intensive care units. Anaesth Intensive Care. 2013, 41: 342-348.PubMed Conroy KM, Elliott D, Burrell AR: Validating a process-of-care checklist for intensive care units. Anaesth Intensive Care. 2013, 41: 342-348.PubMed
8.
go back to reference Hewson KM, Burrell AR: A pilot study to test the use of a checklist in a tertiary intensive care unit as a method of ensuring quality processes of care. Anaesth Intensive Care. 2006, 34: 322-328.PubMed Hewson KM, Burrell AR: A pilot study to test the use of a checklist in a tertiary intensive care unit as a method of ensuring quality processes of care. Anaesth Intensive Care. 2006, 34: 322-328.PubMed
9.
go back to reference Goodwin L: Changing conceptions of measurement validity: an update on the new standards. Nurs Educ. 2002, 41: 100-106. Goodwin L: Changing conceptions of measurement validity: an update on the new standards. Nurs Educ. 2002, 41: 100-106.
10.
go back to reference Pittman J, Bakas T: Measurement and instrument design. J Wound Ostomy Continence Nurs. 2010, 37: 603-607. 10.1097/WON.0b013e3181f90a60.CrossRefPubMed Pittman J, Bakas T: Measurement and instrument design. J Wound Ostomy Continence Nurs. 2010, 37: 603-607. 10.1097/WON.0b013e3181f90a60.CrossRefPubMed
11.
go back to reference DeVon HA, Block ME, Moyle-Wright P, Ernst DM, Hayden SJ, Lazzara DJ, Savoy SM, Kostas-Polston E: A psychometric toolbox for testing validity and reliability. J Nurs Scholarsh. 2007, 39: 155-164. 10.1111/j.1547-5069.2007.00161.x.CrossRefPubMed DeVon HA, Block ME, Moyle-Wright P, Ernst DM, Hayden SJ, Lazzara DJ, Savoy SM, Kostas-Polston E: A psychometric toolbox for testing validity and reliability. J Nurs Scholarsh. 2007, 39: 155-164. 10.1111/j.1547-5069.2007.00161.x.CrossRefPubMed
12.
go back to reference Hasson F, Keeney S: Enhancing rigour in the Delphi technique research. Technol Forecast Soc Change. 2011, 78: 1695-1704. 10.1016/j.techfore.2011.04.005.CrossRef Hasson F, Keeney S: Enhancing rigour in the Delphi technique research. Technol Forecast Soc Change. 2011, 78: 1695-1704. 10.1016/j.techfore.2011.04.005.CrossRef
13.
go back to reference Huang HC, Lin WC, Lin JD: Development of a fall-risk checklist using the Delphi technique. J Clin Nurs. 2008, 17: 2275-2283. 10.1111/j.1365-2702.2008.02337.x.CrossRefPubMed Huang HC, Lin WC, Lin JD: Development of a fall-risk checklist using the Delphi technique. J Clin Nurs. 2008, 17: 2275-2283. 10.1111/j.1365-2702.2008.02337.x.CrossRefPubMed
14.
go back to reference Minkman M, Ahaus K, Fabbricotti I, Nabitz U, Huiisman R: A quality management model for integrated care: results of a Delphi and concept mapping study. Int J Qual Health Care. 2009, 21: 66-75. 10.1093/intqhc/mzn048.CrossRefPubMed Minkman M, Ahaus K, Fabbricotti I, Nabitz U, Huiisman R: A quality management model for integrated care: results of a Delphi and concept mapping study. Int J Qual Health Care. 2009, 21: 66-75. 10.1093/intqhc/mzn048.CrossRefPubMed
15.
go back to reference Biondo PD, Nekolaichuk CL, Stiles C, Fainsinger R, Hagen NA: Applying the Delphi process to palliative care tool development: lessons learned. Support Care Cancer. 2008, 16: 935-942. 10.1007/s00520-007-0348-2.CrossRefPubMed Biondo PD, Nekolaichuk CL, Stiles C, Fainsinger R, Hagen NA: Applying the Delphi process to palliative care tool development: lessons learned. Support Care Cancer. 2008, 16: 935-942. 10.1007/s00520-007-0348-2.CrossRefPubMed
16.
go back to reference Ursprung R, Gray JE, Edwards WH, Horbar JD, Nickerson J, Plsek P, Shiono PH, Suresh GK, Goldman DA: Real time patient safety audits: improving safety every day. Qual Saf Health Care. 2005, 14: 284-289. 10.1136/qshc.2004.012542.CrossRefPubMedPubMedCentral Ursprung R, Gray JE, Edwards WH, Horbar JD, Nickerson J, Plsek P, Shiono PH, Suresh GK, Goldman DA: Real time patient safety audits: improving safety every day. Qual Saf Health Care. 2005, 14: 284-289. 10.1136/qshc.2004.012542.CrossRefPubMedPubMedCentral
17.
go back to reference Hart EM, Owen H: Errors and omissions in anesthesia: a pilot study using a pilot’s checklist. Anesth Analg. 2005, 101: 246-250. 10.1213/01.ANE.0000156567.24800.0B.CrossRefPubMed Hart EM, Owen H: Errors and omissions in anesthesia: a pilot study using a pilot’s checklist. Anesth Analg. 2005, 101: 246-250. 10.1213/01.ANE.0000156567.24800.0B.CrossRefPubMed
18.
go back to reference Pronovost PJ, Berenholtz S, Ngo K, McDowell M, Holzmueller C, Haraden C, Resar R, Rainey T, Nolan T, Dorman T: Developing and pilot testing quality indicators in the intensive care unit. J Crit Care. 2003, 18: 145-155. 10.1016/j.jcrc.2003.08.003.CrossRefPubMed Pronovost PJ, Berenholtz S, Ngo K, McDowell M, Holzmueller C, Haraden C, Resar R, Rainey T, Nolan T, Dorman T: Developing and pilot testing quality indicators in the intensive care unit. J Crit Care. 2003, 18: 145-155. 10.1016/j.jcrc.2003.08.003.CrossRefPubMed
19.
go back to reference Morgan PJ, Lam-McCulloch J, Herold-McIlroy J, Tarshis J: Simulation performance checklist generation using the Delphi technique. Can J Anesth. 2007, 54: 992-997. 10.1007/BF03016633.CrossRefPubMed Morgan PJ, Lam-McCulloch J, Herold-McIlroy J, Tarshis J: Simulation performance checklist generation using the Delphi technique. Can J Anesth. 2007, 54: 992-997. 10.1007/BF03016633.CrossRefPubMed
20.
go back to reference McKenna HP: The Delphi technique: a worthwhile research approach for nursing?. J Adv Nurs. 1994, 19: 1221-1225. 10.1111/j.1365-2648.1994.tb01207.x.CrossRefPubMed McKenna HP: The Delphi technique: a worthwhile research approach for nursing?. J Adv Nurs. 1994, 19: 1221-1225. 10.1111/j.1365-2648.1994.tb01207.x.CrossRefPubMed
21.
go back to reference Roberts-Davis M, Read S: Clinical role clarification: using the Delphi method to establish similarities and differences between nurse practitioners and clinical nurse specialists. J Clin Nurs. 2001, 10: 33-43. 10.1046/j.1365-2702.2001.00437.x.CrossRefPubMed Roberts-Davis M, Read S: Clinical role clarification: using the Delphi method to establish similarities and differences between nurse practitioners and clinical nurse specialists. J Clin Nurs. 2001, 10: 33-43. 10.1046/j.1365-2702.2001.00437.x.CrossRefPubMed
22.
go back to reference Duffield C: The Delphi technique: a comparison of results obtained using two expert panels. Int J Nurs Stud. 1993, 30: 227-237. 10.1016/0020-7489(93)90033-Q.CrossRefPubMed Duffield C: The Delphi technique: a comparison of results obtained using two expert panels. Int J Nurs Stud. 1993, 30: 227-237. 10.1016/0020-7489(93)90033-Q.CrossRefPubMed
23.
go back to reference Loughlin K, Moore L: Using Delphi to achieve congruent objectives and activities in a pediatrics department. Med Educ. 1979, 54: 101-106. Loughlin K, Moore L: Using Delphi to achieve congruent objectives and activities in a pediatrics department. Med Educ. 1979, 54: 101-106.
24.
go back to reference McKenna H: The essential elements of a practitioners’ nursing model: a survey of psychiatric nurse managers. J Adv Nurs. 1994, 19: 870-877. 10.1111/j.1365-2648.1994.tb01163.x.CrossRefPubMed McKenna H: The essential elements of a practitioners’ nursing model: a survey of psychiatric nurse managers. J Adv Nurs. 1994, 19: 870-877. 10.1111/j.1365-2648.1994.tb01163.x.CrossRefPubMed
25.
go back to reference Crisp J, Pelletier D, Duffield C, Adams A, Nagy S: The Delphi method?. Nurs Res. 1997, 46: 116-118. 10.1097/00006199-199703000-00010.CrossRefPubMed Crisp J, Pelletier D, Duffield C, Adams A, Nagy S: The Delphi method?. Nurs Res. 1997, 46: 116-118. 10.1097/00006199-199703000-00010.CrossRefPubMed
26.
go back to reference Keeney S, Hasson F, McKenna H: Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nur. 2006, 53: 205-212. 10.1111/j.1365-2648.2006.03716.x.CrossRef Keeney S, Hasson F, McKenna H: Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nur. 2006, 53: 205-212. 10.1111/j.1365-2648.2006.03716.x.CrossRef
27.
go back to reference Burrell AR, McLaws M-L, Murgo M, Calabria E, Pantle AC, Herkes R: Aseptic insertion of central venous lines to reduce bacteraemia: the Central Line Associated Bacteraemia in NSW Intensive Care Units (CLAB ICU) Collaborative. MJA. 2011, 194: 583-587.PubMed Burrell AR, McLaws M-L, Murgo M, Calabria E, Pantle AC, Herkes R: Aseptic insertion of central venous lines to reduce bacteraemia: the Central Line Associated Bacteraemia in NSW Intensive Care Units (CLAB ICU) Collaborative. MJA. 2011, 194: 583-587.PubMed
28.
go back to reference Wentworth Area Health Service: Nutritional support in the Intensive Care Unit. 2004, Penrith: Nepean Hospital; ICU Management Committee, Department of Intensive Care Medicine Wentworth Area Health Service: Nutritional support in the Intensive Care Unit. 2004, Penrith: Nepean Hospital; ICU Management Committee, Department of Intensive Care Medicine
29.
go back to reference Wentworth Area Health Service: Prevention of venous thromboembolism in the critically ill. 2003, Penrith: Nepean Hospital; ICU Management Committee, Department of Intensive Care Medicine Wentworth Area Health Service: Prevention of venous thromboembolism in the critically ill. 2003, Penrith: Nepean Hospital; ICU Management Committee, Department of Intensive Care Medicine
30.
go back to reference Wentworth Area Health Service: Prevention of upper gastrointestinal bleeding. 2005, Penrith: Nepean Hospital; Protocol Committee, Department of Intensive Care Medicine Wentworth Area Health Service: Prevention of upper gastrointestinal bleeding. 2005, Penrith: Nepean Hospital; Protocol Committee, Department of Intensive Care Medicine
31.
go back to reference Vincent J-L: Give your patient a FAST HUG (at least) once a day. Crit Care Med. 2005, 33: 1225-1229. 10.1097/01.CCM.0000165962.16682.46.CrossRefPubMed Vincent J-L: Give your patient a FAST HUG (at least) once a day. Crit Care Med. 2005, 33: 1225-1229. 10.1097/01.CCM.0000165962.16682.46.CrossRefPubMed
32.
go back to reference Hasson F, Keeney S, McKenna H: Research guidelines for the Delphi survey technique. J Adv Nurs. 2000, 32: 1008-1015.PubMed Hasson F, Keeney S, McKenna H: Research guidelines for the Delphi survey technique. J Adv Nurs. 2000, 32: 1008-1015.PubMed
33.
go back to reference Boberg AL, Morris-Khoo SA: The Delphi method: a review of methodology and an application in the evaluation of a higher education program. Can J Program Eval. 1992, 7: 27-39. Boberg AL, Morris-Khoo SA: The Delphi method: a review of methodology and an application in the evaluation of a higher education program. Can J Program Eval. 1992, 7: 27-39.
Metadata
Title
Developing content for a process-of-care checklist for use in intensive care units: a dual-method approach to establishing construct validity
Authors
Karena M Conroy
Doug Elliott
Anthony R Burrell
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2013
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-13-380

Other articles of this Issue 1/2013

BMC Health Services Research 1/2013 Go to the issue