Skip to main content
Top
Published in: BMC Infectious Diseases 1/2018

Open Access 01-12-2018 | Research article

Identifying heterogeneity in the Hawthorne effect on hand hygiene observation: a cohort study of overtly and covertly observed results

Authors: Kuan-Sheng Wu, Susan Shin-Jung Lee, Jui-Kuang Chen, Yao-Shen Chen, Hung-Chin Tsai, Yueh-Ju Chen, Yu-Hsiu Huang, Huey-Shyan Lin

Published in: BMC Infectious Diseases | Issue 1/2018

Login to get access

Abstract

Background

Observation and feedback are core strategies of hand hygiene (HH) improvement. Direct overt observation is currently the gold standard method. Observation bias, also known as the Hawthorne effect, is a major disadvantage of this method. Our aim was to examine the variation of the Hawthorne effect on HH observation in different healthcare groups and settings.

Methods

A prospective cohort study was performed in a tertiary teaching hospital during a 15-month period. Up to 38 overt observers (82% nurses) and 93 covert observers (81% medical students) participated in HH observation. The HH events observed overtly were matched for occupation, department, observation time, and location with those observed covertly. The data of matched pairs were then analysed to detect possible Hawthorne effects on different variables.

Results

A total of 31,522 HH opportunities were observed (4581 overtly, 26,941 covertly). There were 3047 matched pairs after 1:1 matching of overt and covert observations. The overall HH compliance was higher with overt observation than with covert observation (78% vs. 55%, p < 0.001). The Hawthorne effect was nearly three times larger in nurses (30 percentage points) than in physicians (11 percentage points) and was significantly greater in outpatient clinics (41 percentage points) than in intensive care units (11 percentage points). The magnitude of the Hawthorne effect varied among healthcare worker occupations and observation locations (p values both < 0.001) but not among departments, observation times, or HH indications.

Conclusions

Heterogeneity in the Hawthorne effect may influence the interpretation of overt observations and prevent the correct identification of target populations with poor HH compliance. Therefore, directly observed HH compliance may not be an adequate performance indicator for infection control.
Literature
1.
go back to reference Larson E. A causal link between handwashing and risk of infection? Examination of the evidence. Infect Control. 1988;9:28–36. Epub 1988/01/01PubMed Larson E. A causal link between handwashing and risk of infection? Examination of the evidence. Infect Control. 1988;9:28–36. Epub 1988/01/01PubMed
2.
go back to reference Larson E. Skin hygiene and infection prevention: more of the same or different approaches? Clin Infect Dis. 1999;29:1287–94. Epub 1999/10/19CrossRefPubMed Larson E. Skin hygiene and infection prevention: more of the same or different approaches? Clin Infect Dis. 1999;29:1287–94. Epub 1999/10/19CrossRefPubMed
3.
go back to reference WHO Guidelines approved by the guidelines review committee. WHO Guidelines on hand hygiene in health care: first global patient safety challenge clean care is safer care. Geneva: World Health Organization; 2009. WHO Guidelines approved by the guidelines review committee. WHO Guidelines on hand hygiene in health care: first global patient safety challenge clean care is safer care. Geneva: World Health Organization; 2009.
4.
go back to reference Boyce JM, Pittet D. Healthcare Infection Control Practices Advisory Committee; HICPAC/SHEA/APIC/IDSA Hand Hygiene Task Force. Guideline for Hand Hygiene in Health-Care Settings. Recommendations of the Healthcare Infection Control Practices Advisory Committee and the HICPAC/SHEA/APIC/IDSA Hand Hygiene Task Force. Society for Healthcare Epidemiology of America/Association for Professionals in Infection Control/Infectious Diseases Society of America. MMWR Recomm Rep. 2002;51(RR-16):1–45. quiz CE1–4. Epub 2002/11/07PubMed Boyce JM, Pittet D. Healthcare Infection Control Practices Advisory Committee; HICPAC/SHEA/APIC/IDSA Hand Hygiene Task Force. Guideline for Hand Hygiene in Health-Care Settings. Recommendations of the Healthcare Infection Control Practices Advisory Committee and the HICPAC/SHEA/APIC/IDSA Hand Hygiene Task Force. Society for Healthcare Epidemiology of America/Association for Professionals in Infection Control/Infectious Diseases Society of America. MMWR Recomm Rep. 2002;51(RR-16):1–45. quiz CE1–4. Epub 2002/11/07PubMed
5.
go back to reference Boyce JM. Electronic monitoring in combination with direct observation as a means to significantly improve hand hygiene compliance. Am J Infect Control. 2017;45:528–35. Epub 2017/05/01CrossRefPubMed Boyce JM. Electronic monitoring in combination with direct observation as a means to significantly improve hand hygiene compliance. Am J Infect Control. 2017;45:528–35. Epub 2017/05/01CrossRefPubMed
6.
go back to reference Gould DJ, Creedon S, Jeanes A, Drey NS, Chudleigh J, Moralejo D. Impact of observing hand hygiene in practice and research: a methodological reconsideration. J Hosp Infect. 2017;95:169–74. Epub 2016/09/17CrossRefPubMed Gould DJ, Creedon S, Jeanes A, Drey NS, Chudleigh J, Moralejo D. Impact of observing hand hygiene in practice and research: a methodological reconsideration. J Hosp Infect. 2017;95:169–74. Epub 2016/09/17CrossRefPubMed
7.
go back to reference Eckmanns T, Bessert J, Behnke M, Gastmeier P, Ruden H. Compliance with antiseptic hand rub use in intensive care units: the Hawthorne effect. Infect Control Hosp Epidemiol. 2006;27:931–4. Epub 2006/08/31CrossRefPubMed Eckmanns T, Bessert J, Behnke M, Gastmeier P, Ruden H. Compliance with antiseptic hand rub use in intensive care units: the Hawthorne effect. Infect Control Hosp Epidemiol. 2006;27:931–4. Epub 2006/08/31CrossRefPubMed
8.
go back to reference Maury E, Moussa N, Lakermi C, Barbut F, Offenstadt G. Compliance of health care workers to hand hygiene: awareness of being observed is important. Intensive Care Med. 2006;32:2088–9. Epub 2006/10/24CrossRefPubMed Maury E, Moussa N, Lakermi C, Barbut F, Offenstadt G. Compliance of health care workers to hand hygiene: awareness of being observed is important. Intensive Care Med. 2006;32:2088–9. Epub 2006/10/24CrossRefPubMed
9.
go back to reference Kohli E, Ptak J, Smith R, Taylor E, Talbot EA, Kirkland KB. Variability in the Hawthorne effect with regard to hand hygiene performance in high- and low-performing inpatient care units. Infect Control Hosp Epidemiol. 2009;30:222–5. Epub 2009/02/10CrossRefPubMed Kohli E, Ptak J, Smith R, Taylor E, Talbot EA, Kirkland KB. Variability in the Hawthorne effect with regard to hand hygiene performance in high- and low-performing inpatient care units. Infect Control Hosp Epidemiol. 2009;30:222–5. Epub 2009/02/10CrossRefPubMed
10.
go back to reference Pan SC, Tien KL, Hung IC, Lin YJ, Sheng WH, Wang MJ, et al. Compliance of health care workers with hand hygiene practices: independent advantages of overt and covert observers. PLoS One. 2013;8:e53746. Epub 2013/01/24CrossRefPubMedPubMedCentral Pan SC, Tien KL, Hung IC, Lin YJ, Sheng WH, Wang MJ, et al. Compliance of health care workers with hand hygiene practices: independent advantages of overt and covert observers. PLoS One. 2013;8:e53746. Epub 2013/01/24CrossRefPubMedPubMedCentral
11.
go back to reference Kovacs-Litman A, Wong K, Shojania KG, Callery S, Vearncombe M, Leis JA. Do physicians clean their hands? Insights from a covert observational study. J Hosp Med. 2016;11:862–4. Epub 2016/07/06CrossRefPubMed Kovacs-Litman A, Wong K, Shojania KG, Callery S, Vearncombe M, Leis JA. Do physicians clean their hands? Insights from a covert observational study. J Hosp Med. 2016;11:862–4. Epub 2016/07/06CrossRefPubMed
12.
go back to reference Srigley JA, Furness CD, Baker GR, Gardam M. Quantification of the Hawthorne effect in hand hygiene compliance monitoring using an electronic monitoring system: a retrospective cohort study. BMJ Qual Saf. 2014;23:974–80. Epub 2014/07/09CrossRefPubMedPubMedCentral Srigley JA, Furness CD, Baker GR, Gardam M. Quantification of the Hawthorne effect in hand hygiene compliance monitoring using an electronic monitoring system: a retrospective cohort study. BMJ Qual Saf. 2014;23:974–80. Epub 2014/07/09CrossRefPubMedPubMedCentral
13.
go back to reference Hagel S, Reischke J, Kesselmeier M, Winning J, Gastmeier P, Brunkhorst FM, et al. Quantifying the Hawthorne effect in hand hygiene compliance through comparing direct observation with automated hand hygiene monitoring. Infect Control Hosp Epidemiol. 2015;36:957–62. Epub 2015/04/24CrossRefPubMed Hagel S, Reischke J, Kesselmeier M, Winning J, Gastmeier P, Brunkhorst FM, et al. Quantifying the Hawthorne effect in hand hygiene compliance through comparing direct observation with automated hand hygiene monitoring. Infect Control Hosp Epidemiol. 2015;36:957–62. Epub 2015/04/24CrossRefPubMed
15.
go back to reference Chen LF, Vander Weg MW, Hofmann DA, Reisinger HS. The Hawthorne effect in infection prevention and epidemiology. Infect Control Hosp Epidemiol. 2015;36:1444–50. Epub 2015/09/19CrossRefPubMed Chen LF, Vander Weg MW, Hofmann DA, Reisinger HS. The Hawthorne effect in infection prevention and epidemiology. Infect Control Hosp Epidemiol. 2015;36:1444–50. Epub 2015/09/19CrossRefPubMed
16.
go back to reference Chen JK, Wu KS, Lee SS, Lin HS, Tsai HC, Li CH, et al. Impact of implementation of the World Health Organization multimodal hand hygiene improvement strategy in a teaching hospital in Taiwan. Am J Infect Control. 2016;44:222–7. Epub 2015/12/24CrossRefPubMed Chen JK, Wu KS, Lee SS, Lin HS, Tsai HC, Li CH, et al. Impact of implementation of the World Health Organization multimodal hand hygiene improvement strategy in a teaching hospital in Taiwan. Am J Infect Control. 2016;44:222–7. Epub 2015/12/24CrossRefPubMed
17.
go back to reference Wu KS, Chen YS, Lin HS, Hsieh EL, Chen JK, Tsai HC, et al. A nationwide covert observation study using a novel method for hand hygiene compliance in health care. Am J Infect Control. 2017;45:240–4. Epub 2016/11/14CrossRefPubMed Wu KS, Chen YS, Lin HS, Hsieh EL, Chen JK, Tsai HC, et al. A nationwide covert observation study using a novel method for hand hygiene compliance in health care. Am J Infect Control. 2017;45:240–4. Epub 2016/11/14CrossRefPubMed
19.
go back to reference WHO. Hand Hygiene Technical Reference Manual. Geneva: World Health Organization; 2009. WHO. Hand Hygiene Technical Reference Manual. Geneva: World Health Organization; 2009.
20.
go back to reference Mahfouz AA, El Gamal MN, Al-Azraqi TA. Hand hygiene non-compliance among intensive care unit health care workers in Aseer central hospital, South-Western Saudi Arabia. Int J Infect Dis. 2013;17:e729–32. Epub 2013/04/23CrossRefPubMed Mahfouz AA, El Gamal MN, Al-Azraqi TA. Hand hygiene non-compliance among intensive care unit health care workers in Aseer central hospital, South-Western Saudi Arabia. Int J Infect Dis. 2013;17:e729–32. Epub 2013/04/23CrossRefPubMed
21.
go back to reference Korniewicz DM, El-Masri M. Exploring the factors associated with hand hygiene compliance of nurses during routine clinical practice. Appl Nurs Res. 2010;23:86–90. Epub 2010/04/28CrossRefPubMed Korniewicz DM, El-Masri M. Exploring the factors associated with hand hygiene compliance of nurses during routine clinical practice. Appl Nurs Res. 2010;23:86–90. Epub 2010/04/28CrossRefPubMed
22.
go back to reference Kwok YL, Harris P, McLaws ML. Social cohesion: the missing factor required for a successful hand hygiene program. Am J Infect Control. 2017;45:222–7. Epub 2016/12/9CrossRefPubMed Kwok YL, Harris P, McLaws ML. Social cohesion: the missing factor required for a successful hand hygiene program. Am J Infect Control. 2017;45:222–7. Epub 2016/12/9CrossRefPubMed
24.
go back to reference KPong S, Holliday P, Fernie G. Effect of electronic real-time prompting on hand hygiene behaviors in health care workers. Am J Infect Control. 2018;46:768–74. Epub 2018/3/2CrossRef KPong S, Holliday P, Fernie G. Effect of electronic real-time prompting on hand hygiene behaviors in health care workers. Am J Infect Control. 2018;46:768–74. Epub 2018/3/2CrossRef
Metadata
Title
Identifying heterogeneity in the Hawthorne effect on hand hygiene observation: a cohort study of overtly and covertly observed results
Authors
Kuan-Sheng Wu
Susan Shin-Jung Lee
Jui-Kuang Chen
Yao-Shen Chen
Hung-Chin Tsai
Yueh-Ju Chen
Yu-Hsiu Huang
Huey-Shyan Lin
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Infectious Diseases / Issue 1/2018
Electronic ISSN: 1471-2334
DOI
https://doi.org/10.1186/s12879-018-3292-5

Other articles of this Issue 1/2018

BMC Infectious Diseases 1/2018 Go to the issue
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discuss last year's major advances in heart failure and cardiomyopathies.