A large-scale assessment of hand hygiene quality and the effectiveness of the “WHO 6-steps”
BMC Infectious Diseases volume 13, Article number: 249 (2013)
Hand hygiene compliance is generally assessed by observation of adherence to the “WHO five moments” using numbers of opportunities as the denominator. The quality of the activity is usually not monitored since there is no established methodology for the routine assessment of hand hygiene technique. The aim of this study was to objectively assess hand rub coverage of staff using a novel imaging technology and to look for patterns and trends in missed areas after the use of WHO’s 6 Step technique.
A hand hygiene education and assessment program targeted 5200 clinical staff over 7 days at the National University Hospital, Singapore. Participants in small groups were guided by professional trainers through 5 educational stations, which included technique-training and UV light assessment supported by digital photography of hands. Objective criteria for satisfactory hand hygiene quality were defined a priori. The database of images created during the assessment program was analyzed subsequently. Patterns of poor hand hygiene quality were identified and linked to staff demographic.
Despite the assessment taking place immediately after the training, only 72% of staff achieved satisfactory coverage. Failure to adequately clean the dorsal and palmar aspects of the hand occurred in 24% and 18% of the instances, respectively. Fingertips were missed by 3.5% of subjects. The analysis based on 4642 records showed that nurses performed best (77% pass), and women performed better than men (75% vs. 62%, p<0.001). Further risk indicators have been identified regarding age and occupation.
Ongoing education and training has a vital role in improving hand hygiene compliance and technique of clinical staff. Identification of typical sites of failure can help to develop improved training.
Failed hand hygiene of clinical staff is the major contributor to Healthcare-Associated Infections (HAIs) which occur in 7.1% of hospital admissions in the Western world . Each year around 150,000 deaths in Europe and 100,000 in the USA are attributed to HAIs . European and US standards have been developed in accordance with the World Health Organization’s (WHO) recommendations, defining 5 crucial moments of hand hygiene and 6 practical hand rubbing steps through which alcohol-based hand rub solutions have been proven effective .
Several studies have investigated staff compliance to hand hygiene guidelines, however, most involved relatively small number of subjects, typically 50–500 [4–8]. Studies of hand hygiene in hospitals have focused on hand washing standards [9–11], improving hand rubbing technique [12, 13], or the composition of the hand rub and scrub [14–18], the attitude of staff regarding compliance to hand hygiene moments [19, 20], the impact of finger rings, wrist watches and other accessories upon hand hygiene quality [8, 21], and strategies of monitoring the compliance to the 5 moments . Consensus guidelines and recommendations regarding hand hygiene have been produced through the WHO and descriptions on how they can be introduced have been published in [23, 24]. Automated audits of hand hygiene have recently been trialled [25–27], but these are limited to monitoring compliance to the 5 moments rather than the quality of application as intended via the 6 steps.
The National University Hospital (NUH) of Singapore is a 1000-bed tertiary referral center. Hand hygiene training, assessment and monitoring have been a core activity since 2007, but the focus like in most other institutions has been on compliance with the 5 moments, which has improved from 15% to 69% based on up to 800 observations/month (unpublished). Less attention has been given to the technique and quality of hand hygiene .
In May 2011, NUH undertook a program to coincide with the WHO World Hand Hygiene Day within the frame of WHO Save Lives: Clean Your Hands campaign. Building from past subjective assessments of hand hygiene quality using Ultra Violet (UV)-marked alcoholic hand rub (Schülke Optik; Schülke & Mayr GmbH, Norderstedt, Germany) and regular desk top UV lights, we established a process for blinded assessment and storage of digital images for subsequent analysis. In this study digital images were used to analyze hand hygiene quality and therefore the effectiveness of a training program based on WHO’s 6 steps approach.
Clinical staff received a 15-minute training in small groups (3–8 people), the first of which comprised of senior management, intentionally designed as a statement to encourage broad participation. In addition, staff were informed that undertaking the course was mandatory, with potential for personal financial penalties. As this was a regular educational exercise and the study was an audit of this process, ethics approval was not required.
At commencement of the training, all participants were registered and given information about the training and the evaluation. They received a personal Hand Hygiene Assessment Sheet (HHAS) where their progress was recorded. A stamp on the HHAS verified completion of each station. The programme consisted of 5 stations:
Station 1: Information on WHO’s 5 moments of hand hygiene.
Station 2: Demonstration of WHO’s 6-step hand hygiene technique.
Station 3: Individual hand hygiene practice with UV-marked hand rub solution.
Station 4: Objective (double blinded) real-time assessment of hand hygiene technique with a purpose built imaging device.
Station 5: Upon completion, a pledge recital and receiving of a sticker for their name tag certifying the credential.
Those who failed the assessment repeated the whole process.
The assessment of hand hygiene quality utilized the Stery-Hand monitoring devices provided by the Budapest University of Technology and Economics (BME, Hungary), and supported by a team from the developer group. Stery-Hand consisted of a black box with UV lighting inside and a digital camera connected to a notebook computer . Digital images of both sides of employees’ hands were recorded. These images were then observed on separate screens, and evaluated by NUH infection control specialists, physically separated from the subjects. Pass and fail conditions had been determined, allowing a maximum of two small mistakes (see definition below) only on the dorsal side of the hand and no missed areas on the palmar aspect. We also investigated the distribution of “small” and “big” missed spots. According to the definition, every area uncovered by UV on either side of the hand was a mistake. Dark (untreated) spots >0.6 cm2 were defined as “big” mistakes. This tolerance margin allowed the faster and streamlined evaluation of the hand rubbing coverage.
All clinical staff of NUH (approx. 5200 people) were targeted for assessment. Images of participants’ hands were further processed and analyzed afterwards, creating a database on hospital-wide hand hygiene performance.
Data collection and analysis
At Station 4 (assessment), each person was assigned an individual quick response (QR) code (ISO/IEC 18004:2006 standard) to facilitate anonymous identification. These codes were scanned and assigned to the respective images. The palmar and dorsal aspects of hands were recorded, along with personal data (age bracket, gender, occupation). Physically separated infection control team members could view the digital images on separate screens, quickly identify failings in the hand rub coverage with a basic (custom developed) drawing software, and transmit the results to the front-end trainers, who communicated them to the employee. The overall pass ratio according to the on-site “live” team was 67% (3108 out of 4642), despite the fact that trial and assessment took place immediately after demonstration. Thus 33% repeated the training, and were reassessed.
All data, original and evaluated images were stored. Only the images recorded at a participant’s first assessment have been included in this study.
The statistical analysis of the data was performed using the “R” program package, version 2.15.0 (The R Foundation for Statistical Computing, Vienna, Austria). The difference between two sets of samples was evaluated with 2-sample tests for equality of proportions with continuity correction, and considered significant if p-value was found less than 0.001. Confidence intervals were computed using the Wilson method .
Over 90% of eligible staff participated. Out of the 4762 enrolled staff members, 120 provided incomplete surveys, resulting in 4642 evaluable participants: 3559 females (age range 18–66 years, mean 35.2 years, standard deviation (SD) 10.0 years), and 1083 males (age range 18–73 years, mean 38.0 years, SD 11.1 years). Further breakdown of participants by age and occupation is shown in Table 1.
After the week-long assessment period, all images were reanalyzed applying the same definitions as used on site. This resulted in 3349 passes (72%) consistent with a good level of inter rater concordance between the on-site team and the later re-evaluation. The amount of overruled on-site decisions added up to approximately 8.5% of the total cases. The kappa concordance test between on-site evaluation and re-evaluation gave κ=0.80 (95% CI 0.78–0.82). We used the post-evaluation metrics for further analysis.
Pass rates by staff occupation type and demographics are summarized in Table 1. Figure 1 shows the rate and confidence interval of satisfactory hand washing, plotted against occupation and gender. Similarly, in Figure 2, rates and confidence intervals are arranged by age groups and gender.
The overall pass rate was 72% (95% CI 71%–73%). Female staff performed significantly better in almost all job and age categories, with an overall pass rate of 75% (95% CI 73%–77%) versus 62% (95% CI 59%–65%) that of males.
Risk indicators (RI) for failed hand rub application were identified and listed in Table 2. For these risk groups, a higher incidence of unsatisfactory hand washing was found. Identified RI’s are supported by non-overlapping confidence intervals (Figure 3) and statistical significance.
We classified all individuals into three quality groups based on whether they made no mistakes, small mistakes only, or big mistakes. Figure 4 shows the distribution of these groups defined by gender and occupation. Among those who failed the first assessment, we further distinguished three categories: those who made mistakes on the palmar side of the hand, on the dorsal side, or both. The distribution of these categories, within the gender and occupation groups is presented in Figure 5.
The most frequently missed sites were identified on the dorsal side of fingers in the proximity of the nails (16%), on the thenar eminence and in the proximity of the wrist crease (18%). Figure 6 shows example images taken during the exercise.
This study evaluated the effectiveness of the WHO 6-step hand rubbing technique, involving a large number of health care workers and a novel screening technology.
A key advantage of the applied methodology is the ability to evaluate the actual outcome of hand washing and in this situation, the educational process. Identifying failures in hand hygiene coverage represents an opportunity to enhance one’s infection prevention efforts. Identifying certain risk groups and typical mistakes regarding the application patterns allows for the design of specific education programs and also helps to left the use of a hand rubbing protocol. Another advantage of the methodology is the ability to easily involve several thousand health care staff in the investigation, a major increase compared to the 465 subjects of the largest similar study . Instead of applying restricted observation of nurses and physicians only, as most similar studies do, our investigations involved all staff of a single hospital because all health workers have the potential to contribute to cross-infection .
Previous studies have found a higher incidence of unsatisfactory hand hygiene in males, but this difference is generally insignificant possibly due to small samples size. A recent study culturing glove juice found the prevalence of Enterobacteriaceae higher in males by 55% (23.8% vs. 15.4%, p=0.156) , similar to our findings (Table 2). The differences we found between various occupational groups were similar to non-significant trends observed by others [32–34], but in our study statistical significance was evident.
Our study did not apply microbiological validation but assumed that bright areas of the hand were clean, while dark spots could contain potentially dangerous pathogens. The general intention in hand hygiene is to fully cover the surface of both hands with antiseptic solution. Our methodology monitors this information. Microbiological techniques provide an alternative and arguably more useful assessment but are more complex and expensive to undertake particularly on this scale. All commercial solutions must undergo specific tests for efficacy against germs: they are approved as bactericidal (EN 1276), fungicidal (EN 1650), or sporicidal (EN 13704) solutions. These tests provide the evidence that once the surface is treated appropriately, efficacy is guaranteed. Occasionally microbiological studies have been employed for randomized hand hygiene assessment, however, always on a small scale [5, 8]. Nevertheless, sampling and cultivation are susceptible to environmental effects and cross-contamination, distorting the results of the evaluation. In this respect our methodology provides a simpler alternative to culture techniques.
The main contribution of our study is not the monitoring methodology itself, but the statistical findings of the hand hygiene quality assessment. Microbiological validation of our monitoring and assessment methodology is an area for future research.
The setting of our study is likely to have actually overestimated the real life quality of hand rub application given that it was a specific and overtly observed assessment. The generalizability of our findings therefore has some limitations however monitoring staff in everyday practice would carry significant challenges. The fact that a single measurement was taken of each subject, and the deviation between on-site and subsequent evaluation, may slightly distort the statistical data.Similarly, another limitation of the study is that it was undertaken at a single institution.
This study has demonstrated that a high failure rate in hand hygiene coverage among health care workers can occur even when observed immediately after a specific training programme of the WHO’s 6 steps. It is a significant and generally underrated risk factor since imperfect hand hygiene technique may endanger the effectiveness of the entire hand hygiene routine.
We established an environment to observe and evaluate the effectiveness of the 6 step hand washing procedure, which—when applied at the times of the WHO 5 moments—is considered the most effective way to prevent the transmission of HAIs. The quality of hand rub application was analyzed on 4642 hospital staff immediately after a personalized education program. High failure rates suggest that the 6 steps, as advocated by the WHO, may be too complex to expect staff to comply with routinely. Our findings have revealed that besides effective monitoring of compliance with the five moments, there is a strong need for improved, targeted educational efforts on handhygiene technique.
Health care-associated infections.
European Centre for Disease Prevention and Control (ECDC): Annual Report. 2010, Solna, Sweden, ECDC
Pollack A: Rising threat of infections unfazed by antibiotics. New York Times. 2010, [http://www.nytimes.com/2010/02/27/business/27germ.html?_r=0]
World Health Organization: WHO Guidelines on Hand Hygiene in Health Care. 2009, Geneva: WHO Press, [http://apps.who.int/medicinedocs/documents/s16320e/s16320e.pdf]
Simon A, Hugonnet S, Pessoa-Silva CL, Sauvan V, Pernerger TV, Pittet D: Hand hygiene among physicians: performance, beliefs, and perceptions. Ann Intern Med. 2004, 141: 1-8. 10.7326/0003-4819-141-1-200407060-00008.
Kampf G, Reichel M, Feil Y, Kaulfers PM, Eggerstedt S: Influence of rub-in technique on required application time and hand coverage in hygienic hand disinfection. BMC Infect Dis. 2008, 8: 149-10.1186/1471-2334-8-149.
Scheithauer S, Haefner H, Schwanz T, Schultze-Steinen H, Schiefer J, Koch A, Engels A, Lemmen SW: Compliance with hand hygiene on surgical, medical, and neurologic intensive care units: Direct observation versus calculated disinfectant usage. Am J Infect Control. 2009, 37 (10): 835-841. 10.1016/j.ajic.2009.06.005.
Hübner NO, Hübner C, Wodny M, Kampf G, Kramer A: Effectiveness of alcohol-based hand disinfectants in a public administration: Impact on health and work performance related to acute respiratory symptoms and diarrhoea. BMC Infect Dis. 2010, 10: 250-10.1186/1471-2334-10-250.
Fagernes M, Lingaas E: Factors interfering with the microflora on hands: a regression analysis of samples from 465 healthcare workers. J Adv Nurs. 2011, 67 (2): 297-307. 10.1111/j.1365-2648.2010.05462.x.
Pittet D, Mourouga P, Perneger TV, the Members of the Infection Control Program: Compliance with handwashing in a teaching hospital. Ann Intern Med. 1999, 130 (2): 126-130. 10.7326/0003-4819-130-2-199901190-00006.
Pittet D, Hugonnet S, Harbarth S, Mourouga P, Sauvan V, Touveneau S, Perneger TV: Effectiveness of a hospital-wide programme to improve compliance with hand hygiene. Lancet. 2000, 356 (9238): 1307-1312. 10.1016/S0140-6736(00)02814-2.
Pittet D: Hand hygiene: improved standards and practice for hospital care. Curr Opin Infect Dis. 2003, 16 (4): 327-335. 10.1097/00001432-200308000-00004.
Eksi F, Mehli M, Akgun S, Bayram A, Balci I, Aydin N: Evaluation of two different hand hygiene procedures during routine patient care. J Int Med Res. 2010, 38 (6): 2084-2092. 10.1177/147323001003800624.
Nandrup-Bus I: Comparative studies of hand disinfection and handwashing procedures as tested by pupils in intervention programs. Am J Infect Control. 2011, 39 (6): 450-455. 10.1016/j.ajic.2010.10.023.
Kampf G: Efficacy of two distinct ethanol-based hand rubs for surgical hand disinfection – a controlled trial according to prEN 12791. BMC Infect Dis. 2005, 5: 17-10.1186/1471-2334-5-17.
Kramer A, Schwebke I, Kampf G: How long do nosocomial pathogens persist on inanimate surfaces? A systematic review. BMC Infect Dis. 2006, 6: 130-10.1186/1471-2334-6-130.
Kampf G, Marschall S, Eggerstedt S, Ostermayer C: Efficacy of ethanol-based hand foams using clinically relevant amounts: A cross-over controlled study among healthy volunteers. BMC Infect Dis. 2010, 10: 78-10.1186/1471-2334-10-78.
Goroncy-Bermes P, Koburger T, Meyer B: Impact of the amount of hand rub applied in hygienic hand disinfection on the reduction of microbial counts on hands. J Hosp Infect. 2010, 74 (3): 212-218. 10.1016/j.jhin.2009.09.018.
Suchomel M, Rotter M: Ethanol in pre-surgical hand rubs: Concentration and duration of application for achieving European Norm EN 12791. J Hosp Infect. 2011, 77 (3): 263-266. 10.1016/j.jhin.2010.10.014.
Duerink DO, Farida H, Nagelkerke NJ, Wahyono H, Keuter M, Lestari ES, Hadi U, Van der Broek PJ: Preventing nosocomial infections: improving compliance with standard precautions in an Indonesian teaching hospital. J Hosp Infect. 2006, 64: 36-43. 10.1016/j.jhin.2006.03.017.
Sessa A, Di Giuseppe G, Albano L, Angelillo IF, the Collaborative Working Group: An investigation of nurses’ knowledge, attitudes, and practices regarding disinfection procedures in Italy. BMC Infect Dis. 2011, 11: 148-10.1186/1471-2334-11-148.
Trick WE, Vernon MO, Hayes RA, Nathan C, Rice TW, Peterson BJ, Segreti J, Welbel SF, Solomon SL, Weinstein RA: Impact of ring wearing on hand contamination and comparison of hand hygiene agents in a hospital. Clin Infect Dis. 2003, 36: 1383-1390. 10.1086/374852.
Fries J, Segre A, Thomas G, Herman T, Ellingson K, Polgreen P: Monitoring hand hygiene via human observers: how should we be sampling?. Infect Control Hosp Epidemiol. 2012, 33 (7): 689-695. 10.1086/666346.
Pittet D: The World Health Organization guidelines on hand hygiene in health care and their consensus recommendations. Infect Control Hosp Epidemiol. 2009, 30 (7): 611-622. 10.1086/600379.
Pincock T, Bernstein P, Warthman S, Holst E: Bundling hand hygiene interventions and measurement to decrease health care-associated infections. Am J Infect Control. 2012, 40: S18-S27. 10.1016/j.ajic.2012.02.008.
Edmond MB, Goodell A, Zuelzer W, Sanogo K, Elam K, Bearman G: Successful use of alcohol sensor technology to monitor and report hand hygiene compliance. J Hosp Infect. 2010, 76: 364-365. 10.1016/j.jhin.2010.07.006.
Cheng VC, Tai JW, Ho SK, Chan JF, Hung KN, Ho PL, Yuen KY: Introduction of an electronic monitoring system for monitoring compliance with Moments 1 and 4 of the WHO “My 5 Moments for Hand Hygiene” methodology. BMC Infect Dis. 2011, 11: 151-10.1186/1471-2334-11-151.
Armellino D, Hussain E, Schilling ME, Senicola W, Eichorn A, Dlugacz Y, Farber BF: Using high-technology to enforce low-technology safety measures the use of third-party remote video auditing and real-time feedback in healthcare. Clin Infect Dis. 2012, 54: 1-7.
Fisher D, Aw M, Hsu LY, Patlovich K, Ho KY: The challenge of introducing a hand hygiene standard to clinical examinations. Med Teach. 2011, 33 (2): 171-172.
Haidegger T, Nagy M, Lehotsky A, Szilágyi L: Digital imaging for the education of proper surgical hand disinfection. Lect Notes Comp Sci. 2011, 6893: 619-626. 10.1007/978-3-642-23626-6_76.
Evans JR: Statistics, Data Analysis, and Decision Modeling – 4th Edition. 2009, Lebanon, Indiana, USA: Prentice Hall
Gould DJ, Chudleigh J, Drey NS, Moralejo D: Measuring handwashing performance in health service audits and research studies. J Hosp Infect. 2007, 66: 109-115. 10.1016/j.jhin.2007.02.009.
Berhe M, Edmond MB, Bearman GM: Practices and an assessment of health care workers’ perceptions of compliance with infection control knowledge of nosocomial infections. Am J Infect Control. 2005, 33: 55-57. 10.1016/j.ajic.2004.07.011.
Eckmanns T, Schwab F, Bessert J, Wettstein R, Behnke M, Grundmann H, Rüden H, Gastmeir P: Hand hygiene compliance in healthcare workers. J Hosp Infect. 2006, 63 (4): 406-411. 10.1016/j.jhin.2006.03.015.
Randle J, Clarke M, Storr J: Hand hygiene compliance in healthcare workers. J Hosp Infect. 2006, 64 (3): 205-209. 10.1016/j.jhin.2006.06.008.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2334/13/249/prepub
The system development and study was additionally supported by Contact Singapore and the Austrian Center for Medical Innovation and Technology (ACMIT). The work of L. Szilágyi was funded by the Hungarian Academy of Sciences under the János Bolyai Fellowship Program. T. Haidegger is a Hungarian Eötvös Fellow. This research is connected to the New Széchenyi Plan (Project ID: TÁMOP-4.2.1/B-09/1/KMR-2010-0002). We thank the NUHS Infection Control Team and Mr. Tamás Ferenci for their efforts.
TH, MN, ÁL and LS are listed as inventors on a pending patent related to hand hygiene control: “Method and apparatus for hand disinfection quality control”, (Budapest University of Technology and Economics) PCT/HU2011/000094, WO2012042285, 2010.
ÁL, MN, LS and TH designed and implemented the measurement system. DF, TH, MN, LS, KLO and XS designed the assessment process. All authors participated in the data collection. DF, KLO and XS were responsible for on-site expert evaluation. ÁL, MN, LS, TH and EAC performed the re-evaluation of the collected data. LS and TH were responsible for the statistical data analysis. LS, TH and DF prepared the manuscript. All authors read and approved the final version of the manuscript before submission.
Authors’ original submitted files for images
About this article
Cite this article
Szilágyi, L., Haidegger, T., Lehotsky, Á. et al. A large-scale assessment of hand hygiene quality and the effectiveness of the “WHO 6-steps”. BMC Infect Dis 13, 249 (2013). https://doi.org/10.1186/1471-2334-13-249