Skip to main content

How to protect long-term care facilities from pandemic-like events? - A systematic review on the effectiveness of non-pharmacological measures to prevent viral respiratory infections

Abstract

Background

The SARS-CoV-2 pandemic underscored the need for pandemic preparedness, with respiratory-transmitted viruses considered as a substantial risk. In pandemics, long‐term care facilities (LTCFs) are a high-risk setting with severe outbreaks and burden of disease. Non‐pharmacological interventions (NPIs) constitute the primary defence mechanism when pharmacological interventions are not available. However, evidence on the effectiveness of NPIs implemented in LTCFs remains unclear.

Methods

We conducted a systematic review assessing the effectiveness of NPIs implemented in LTCFs to protect residents and staff from viral respiratory pathogens with pandemic potential. We searched Medline, Embase, CINAHL, and two COVID-19 registries in 09/2022. Screening and data extraction was conducted independently by two experienced researchers. We included randomized controlled trials and non-randomized observational studies of intervention effects. Quality appraisal was conducted using ROBINS-I and RoB2. Primary outcomes encompassed number of outbreaks, infections, hospitalizations, and deaths. We synthesized findings narratively, focusing on the direction of effect. Certainty of evidence (CoE) was assessed using GRADE.

Results

We analysed 13 observational studies and three (cluster) randomized controlled trials. All studies were conducted in high-income countries, all but three focused on SARS-CoV-2 with the rest focusing on influenza or upper-respiratory tract infections. The evidence indicates that a combination of different measures and hand hygiene interventions can be effective in protecting residents and staff from infection-related outcomes (moderate CoE). Self-confinement of staff with residents, compartmentalization of staff in the LTCF, and the routine testing of residents and/or staff in LTCFs, among others, may be effective (low CoE). Other measures, such as restricting shared spaces, serving meals in room, cohorting infected and non-infected residents may be effective (very low CoE). An evidence gap map highlights the lack of evidence on important interventions, encompassing visiting restrictions, pre-entry testing, and air filtration systems.

Conclusions

Although CoE of interventions was low or very low for most outcomes, the implementation of NPIs identified as potentially effective in this review often constitutes the sole viable option, particularly prior to the availability of vaccinations. Our evidence-gap map underscores the imperative for further research on several interventions. These gaps need to be addressed to prepare LTCFs for future pandemics.

Trial registration

CRD42022344149.

Peer Review reports

Background

The SARS-CoV-2 pandemic is estimated to have taken the lives of 18.2 million people worldwide between January 2020 and December 2021 [1], prior to the widespread availability of effective vaccines. However, it is just one of several major epidemics and pandemics that have occurred in the past century, including the 2003 SARS epidemic, the 2012 MERS epidemic, the H1N1 influenza pandemics in 2009 and 2018, and the 1957 H2N2 and 1968 influenza pandemics. As similar epidemic and pandemics are to be expected, preparation is essential.

According to the Johns Hopkins Center for Health Security, RNA viruses with respiratory transmission, particularly those disseminated through airborne and respiratory droplet routes, represent the most probable aetiological agents for initiating pandemics [2]. These included for example orthomyxoviruses, paramyxoviruses, pneumoviruses, coronaviruses, and some picornaviruses [3]. Moreover, non-epidemic acute respiratory tract infections (RTIs) resulting from viral pathogens, such as seasonal influenza, place a considerable burden on population health and healthcare systems around the world [4]. Beyond their immediate repercussions, viral-induced acute RTIs can lead to secondary bacterial lower RTIs, notably pneumococcal pneumonia, which engender elevated mortality rates, particularly within vulnerable demographic cohorts, such as the elderly.

During epidemic or pandemic events, individuals residing in long-term care facilities (LTCFs) are confronted with an elevated susceptibility. These residents often necessitate intimate care interactions involving multiple disciplines and healthcare providers. This circumstance constrains the feasibility of implementing social distancing measures and concurrently heightens the risk for infections and outbreaks within LTCFs [5, 6]. In case of an outbreak, the underlying conditions requiring individuals to receive care in the first place also increases their risk of severe courses of disease in case of infection, e.g. in the case of COVID-19 or influenza [7]. This amalgamation of factors has positioned LTCFs as focal points for the morbidity and mortality burdens associated with the SARS-CoV-2 pandemic [8] and other outbreaks precipitated by respiratory infections [9]. Notably, during the initial wave of the SARS-CoV-2 pandemic in Europe, LTCF residents accounted for a substantial proportion of fatalities, ranging from 26 and 66% deaths across 11 European countries [10]. Another analysis encompassing 21 high- and middle-income countries during the early phase of the pandemic attributed 46% of deaths to LTCF residents, although they constitute less than 1% of the population [8].

In the context of an epidemic or pandemic event, particular during the early phases when effective vaccines or treatments are scarce or non-existent, non-pharmacological interventions (NPIs) constitute the primary and often sole defence against infectious pathogens [11,12,13]. NPIs have several potential advantages over pharmacological interventions (PIs) of suppressing outbreaks within LTCFs. They can be swiftly implemented, are often less resource- and technology-dependent, and exhibit effectiveness across a spectrum of infectious agents, including novel viruses [11]. Even under conditions where pharmaceutical agents or vaccines are available, as exemplified in the case of influenza, reliance solely on PIs may not be sufficient to contain outbreaks in LTCFs or sufficiently ameliorating their adverse health consequences [14,15,16]. Consequently, the World Health Organization (WHO) has emphasized the importance of NPIs in its recent Global Influenza Strategy 2019 to 2030 [11] and other guidance documents on the management of the SARS-CoV-2 pandemic within LTCFs [6].

Amidst the backdrop of the SARS-CoV-2 pandemic, NPIs implemented within LTCFs encompassed a range of measures, as depicted in the process-based logic model in Fig. 1. These included, but were not limited to, measures designed to restrict the introduction of the pathogen into the facility, such as entry regulation measures like visitor restrictions, contact-reduction measures involving for example the compartmentalization of residents, transmission-reducing measures like the utilization of masks and heightens surface hygiene, surveillance and testing initiatives, and measures directed at controlling outbreaks, including contact tracing, quarantine, and isolation [17]. Nonetheless, considerable uncertainties remain regarding the effectiveness of these and other NPIs to prevent or mitigate outbreaks due to SARS-CoV-2, as well as other viral RTIs aside from SARS-CoV-2.

Fig. 1
figure 1

Process-based logic model on the relation between non-pharmaceutical intervention domains and potential outcome measures

Objectives

The primary aim of this review was to provide evidence on the effectiveness of NPIs designed to prevent outbreaks within LTCFs and mitigate their infection-related consequences. Specifically, we assessed the impact of these interventions on the incidence of infections, hospitalizations, and mortality rates among both LTCF residents and staff, focusing on viral RTIs as a proxy for pathogens with pandemic potential. Additionally, we enhanced the applicability of our findings by consolidating the evidence related to these infection-related outcomes into one composite outcome, reflecting the potential effectiveness of the measure as a safeguarding strategy for LTCFs in forthcoming pandemics.

Methods

In this review, we conducted an update of the Cochrane review Non-pharmacological measures implemented in the setting of long-term care facilities to prevent SARS-CoV-2 infections and their consequences: a rapid review (from here on: Cochrane SARS-CoV-2 LTCF review) [17] up to September 2022 as well as expanded the focus to include infections due to other viral pathogens with pandemic potential. In doing so, we partly draw on the methods of the Cochrane SARS-CoV-2 LTCF review as well as the Cochrane review Physical interventions to interrupt or reduce the spread of respiratory viruses by Jefferson et al. [18].

This review was prospectively registered in PROSPERO (CRD42022344149). The research process followed the recommendations outlined in the Cochrane Handbook for Systematic Reviews of Interventions. The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement, updated in 2020, was used to report this study [19].

Criteria for including studies

We included both (cluster) randomized controlled trials (RCTs/cRCTs) as well as non-randomized observational studies of intervention effects (NRSIs) [20, 21]. We included NRSIs which allow control of observed and unobserved confounding, such as controlled before-and-after (CBA) studies, interrupted-time-series (ITS) studies, or regression discontinuity (RD) studies [21]. We furthermore included controlled prospective and retrospective cohort studies (PCS/RCS), where it was established that the intervention was introduced prior to the occurrence of the outcome. Mathematical modelling studies were excluded.

Studies that assessed at least one measure subsumed in one of the following intervention categories were included:

  1. (i)

    Entry regulation measures (ERM) intended to limit the introduction of the pathogen into the LTCF (e.g., access restrictions for visitors),

  2. (ii)

    Contact regulating measures (CRM) intended to reduce the number of contacts at risk of transmission within the facility (e.g., closing communal spaces),

  3. (iii)

    Transmission-reduction measures (TRM) intended to reduce the risk of transmission upon contact or via surfaces (e.g., use of respiratory protective equipment, improving hand hygiene, or installing air filters),

  4. (iv)

    Screening and surveillance measures (SSM) intended to detect cases early or identify asymptomatic but contagious individuals, and

  5. (v)

    Outbreak control measures (OCM) implemented to interrupt or prevent further spread of an outbreak after a case of the respective disease detected (e.g., contact-tracing and quarantine).

Our review exclusively focused on NPIs implemented within the setting of LTCFs, defined as residential establishments providing care for people requiring support due to difficulties in maintaining independent living within the community. In this review, the term “LTCF” encompasses various types of facilities, including skilled nursing facilities, nursing homes, retirement homes, assisted-living facilities, residential care homes, and similar institutions [10]. We included studies that assessed the outcomes among three distinct groups: adult residents (≥ 18 years) primarily residing in LTCFs (referred to as residents), individuals visiting LTCFs (referred to as visitors), and nursing and non-nursing staff employed in LTCFs (referred to as staff). Furthermore, our inclusion criteria encompassed studies examining the impact of NPIs by means of comparative analyses, juxtaposing them against either the absence of any intervention (referred to as no measure), baseline infection control measures exclusively, less stringent implementation, or alternative NPIs.

We encompassed studies assessing infection-related outcomes in LTCFs or the population of interest. These outcomes included the number, rate, or proportion of

  1. (i)

    viral respiratory infections (both confirmed or suspected),

  2. (ii)

    contaminations of LTCFs (defined as at least one infection that was introduced into the LTCF),

  3. (iii)

    outbreaks in LTCFs (defined as more than one infection in the facility or one case where the infection had occurred within the LTCF),

  4. (iv)

    hospitalizations due to the pathogens of interest and

  5. (v)

    deaths due to the pathogen of interest.

We included studies that assessed these outcomes in the context of a pandemic or epidemic event of a viral, respiratory-transmitted pathogen. Viruses of interest included, but were not limited to, Influenza, SARS-CoV-2, SARS, MERS. Additionally, we considered studies evaluating the effectiveness of NPIs against infection-related outcomes caused by similar viral pathogens which are transmitted via the respiratory route, such as influenza-like illnesses in general or acute upper respiratory tract infections (e.g., influenza, RSV-infections, rhinovirus-infections). See Supplementary files for details.

We considered studies published in English, French, German, Italian, and Spanish and excluded studies in languages other than those listed. In order to reflect changes in (medical) care and public health practice but to include publications from the 2003 SARS-pandemic, we restricted searches to the past 30 years (i.e., in or before 1992). The search covered the period up to September 2022, as this was the month the searches were conducted.

The eligibility criteria are provided in more details in Supplement Ib.

Identification of relevant literature

Our database searches consisted of two components: The first component, an update of the database searches of the Cochrane SARS-CoV-2 LTCF review [17], focused on SARS-CoV-2 literature and was conducted in the two SARS-CoV-2 specific study registries Cochrane COVID-19 Register and WHO COVID-19 Global literature on coronavirus disease, which collectively encompass various databases. Additionally, we searched the CINAHL EBSCO database. The second component focused on literature searches on other pathogens of interest, conducted within the databases Embase (Ovid), MEDLINE (Ovid), and CINAHL EBSCO. The search strategy is provided in Supplement II. To identify relevant literature, we conducted backward citation searches via Scopus for all known literature reviews (provided in Supplement III), guidelines and all included studies.

Following Cochrane guidance [22], initial screening of titles and abstracts was carried out independently and in duplicate by two review authors, guided by pre-specified eligibility criteria (Supplement Ib) using the web-based application Rayyan [23]. Subsequently, full-text screening was similarly conducted in duplicate and independently. In both stages, discrepancies were resolved through discussion in the presence of an additional reviewer.

Data collection, extraction, and assessment

Data extraction was performed by one author using a pre-developed and validated data extraction form and checked by one additional review author. For the risk of bias (RoB) assessment, two review authors independently employed specific tools tailored to the study type. RCTs were assessed using the Cochrane RoB 2 tool [24] with adapted versions for cluster-RCTs [25]. NRSIs were assessed using the ROBINS-I tool [26], employing guidance on the adaption of the tool laid out in the Cochrane Handbook for the RoB assessment of CBA and (controlled) ITS studies [27]. NRSI which were evaluated with ROBINS-I and judged to have a critical risk of bias rating were excluded from the evidence synthesis.

Our primary focus during the RoB assessment laid on assessing the potential influence of bias in the reported direction of effect. Specifically, the likelihood that bias may have contributed to the observed effect direction, as opposed to the true effect being either null or in the opposite direction.

An extended description of the risk of bias assessment is provided in Supplement IV.

Data synthesis

For the data synthesis, we initially planned a meta-analysis to pool intervention effects within the same domain and category, contingent on the availability of a minimum of three relevant studies and data compatibility [28]. However, since there were fewer than three studies reporting the same outcome measure for all comparisons, we resorted to a narrative synthesis through using vote counting based on the direction of effect and visualization through effect-direction plots [29, 30], aligning with guidance from the Cochrane Handbook and reporting guideline on Synthesis without meta-analysis (SWiM) [28, 31].

The threshold for the public health relevance was defined as any difference from the null, regardless of statistical significance. We assumed that in an ongoing pandemic, any intervention which allows for a reduction of infection risk could potentially be relevant. Accordingly, the focus of the evidence appraisal and synthesis lay on the direction of effect, rather than the effect size.

Our synthesis approach involved a vote counting to determine effect directions, culminating in composite outcome measures that encapsulated intervention effectiveness in safeguarding LTCFs against infection-related endpoints. Within this composite outcome, we synthesized the direction of effect for the different infection-related outcome measures. In this synthesis, each study contributed one single effect estimate per comparison. In cases where a study addressed multiple infection-related endpoints (e.g., the study reporting both on number of infections and number of hospitalizations), priority was given to outcomes in the following order: Number, rate, or proportion of (1) outbreaks or (2) LTCF contaminations, followed by (3) infections, (4) hospital admission and (5) deaths resulting from infections caused by the pathogens of interest.

Our main interest was in assessing the components of interventions intended to prevent or reduce infection-related outcome, focusing on the effectiveness of adherence to these components, such as mask usage. Interventions intended to implement or increase effective components, like educative initiatives promoting mask wearing, were not within our scope.

More details on our approach is provided in Supplement IV.

Assessment of certainty of evidence

We used the GRADE framework to assess the certainty of evidence regarding the primary outcomes [32, 33]. Initially, one review author compiled the evidence in summary of findings tables and established an initial certainty of evidence assessment, which was subsequently refined though deliberations within the research team. Finally, all results were verified by the research team [34].

Results

Results of the search

The database searches focused on SARS-CoV-2 spanned from January 2021 to September 2022, as the period before January 2021 was addressed in the Cochrane SARS-CoV-2 LTCF review [17], resulting in initial 6,934 records prior to deduplication. Additionally, 22 studies with 23 records from the previous Cochrane SARS-CoV-2 LTCF review were included in the full-text screening stage. The second component, focusing on pathogens other than SARS-CoV-2, covered the period up to September 2022 and yielded 7,974 records prior to deduplication. During full-text screening, 482 unique records were assessed. Overall, we included 23 records reporting on unique 16 studies [35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57]. Refer to Fig. 2 for more details. In our searches, we also included NRSIs investigating the adverse and unintended consequences of NPIs on resident’s and staff’s mental and physical health, which will be addressed in a separate publication. Regarding this outcome, we identified an additional two studies [58, 59].

Fig. 2
figure 2

PRISMA 2020 flow diagram for new systematic reviews. (Abbreviations: NPI Non-pharmacological intervention, AUC Adverse and other unintended outcomes)

Description of included studies

As shown in Table 1, entry regulation measures (ERM) were assessed in one study [36], contact-regulating measures (CRM) in three [39, 42, 49] and transmission-reduction measures (TRM) in six [43, 45, 46, 48, 49, 54]. Five studies assessed screening and surveillance measures (SSM) [35, 41, 50, 55, 56] and two studies outbreak control measures (OCM) [45, 48]. Additionally, three studies examined the effects of multi-component measures (MCM) [44, 45, 57].

Table 1 Characteristics of the included studies

Most studies (n = 13), focused on infection-related outcomes regarding SARS-CoV-2/COVID-19 [35, 38, 39, 41, 42, 44, 45, 48,49,50, 55,56,57]. Only three studies—all cRCTs focusing on the effectiveness of hand hygiene interventions—focused on other pathogens or diseases of relevance: respiratory outbreaks [43], influenza-like illnesses [54], and upper-respiratory tract infections [46]. Within the infection-related outcomes, seven studies reported on outbreaks in LTCFs [38, 39, 42, 43, 49, 50, 56], nine studies reported on the number of infections among residents and/or staff [35, 38, 41, 44,45,46, 48, 54, 56], three studies reported on hospitalizations [38, 45, 55] and five studies reported on the number of deaths due to the pathogens of interest [38, 39, 45, 50, 55]. Notably, no study reported outcomes associated with facility contamination.

We identified 13 NRSI studies [35, 38, 39, 41, 42, 44, 45, 48,49,50, 55,56,57] and three cRCTs [43, 46, 54]. One study utilized two LTCFs to either intervention or control group [50]; due to the low number of sites this was classified as NRSI. Among the NRSIs, four employed a cohort-like design, examining the association between intervention presence or absence and outcome over time [39, 42, 48, 49]. Three studies used an ITS-like design [35, 41, 57], using longitudinal data with multiple pre- and post-intervention data points to assess the intervention’s impact on outcome trend or level changes. One study employed longitudinal data for a difference-in-difference analysis [44].

The studies assessed NPIs in LTCFs located in Canada [57], France [38, 39, 48, 49], Germany [50], the UK [42, 56], China—Hong Kong [43], the Netherlands [54, 58], and the USA [35, 41, 44,45,46, 55].

Six studies exclusively assessed outcomes in residents [39, 41, 44, 46, 48, 54], four investigated both residents and staff members, allowing population group differentiation [38, 45, 55, 57], while five included both residents and staff members without the option for population group stratification [35, 43, 49, 50, 56].

Risk of bias and quality of included studies

Among the three RCTs assessed with the RoB 2 tool [43, 46, 54], one study was classified with some concerns [43], while two were deemed to have a high risk of bias [46, 54].

Upon assessment with ROBINS-I, the comparisons in all but two NRSIs [44, 57] were deemed to exhibit a serious risk of bias, primarily stemming from concerns regarding the domain bias due to confounding and the domain bias due to deviation from intended intervention. In instances involving the domain bias due to confounding it remained uncertain whether observed effects were influenced by underlying LTCF attributes, such as overall LTCF quality, associated with both the presence or absence of the intervention and the outcomes.

Four studies employed a cohort-like design, employing various forms of regression analysis, to estimate the association between intervention and outcome status (e.g., occurrence of an outcome at a later time point) [39, 42, 48, 49]. In these assessments, several were considered to be at serious or critical risk of bias within the domain bias due to deviation from intended intervention. This was primarily due to inadequate consideration of effects of other implemented infection-control measures that may have varied across intervention and control groups and/or multicollinearity in the assessed measures.

The implementation and adherence to the effective component of the intervention was assessed in the domain bias due to deviation from intended intervention. Within this domain, two studies were classified as having a critical risk of bias and were consequently excluded from synthesis [50, 56]. Both studies examined the impact of providing opportunities for voluntary self-testing of staff and visitors, with very low adherence to testing observed. Thus, while these studies indicated that within the specific contexts, providing opportunities for voluntary self-testing did not increase testing rates, they did not provide evidence on the effect of routine testing to prevent or mitigate outbreaks in LTCFs.

More details on the risk of bias of included studies is provided in Supplement V.

Evidence summary on the composite outcome

In the following, the effectiveness of the various measures presented in the included studies to protect residents and staff from infections caused by viral respiratory pathogens with pandemic potential is presented. Table 2 provides a comprehensive representation of all measures, categorized by intervention domain and category. We present the direction of effect plot of the effect measures alongside with the level of certainty of evidence. More comprehensive versions of the composite outcomes and the evidence synthesis can be found in Supplement VI and VII.

Table 2 Direction of effect table on the composite outcomes of effectiveness of protecting LTCF residents and/or staff against pathogens with pandemic potential

Entry regulation measures (ERM)

We included one observational study [38], that provided evidence on ERMs, namely self-confinement of staff with residents. The evidence based on this study conducted in France in the context of the SARS-CoV-2 pandemic suggested that self-confinement of staff may prevent infection-related outcomes due to SARS-CoV-2 (low certainty of evidence).

Contact-regulating measures (CRM)

We included three observational studies [39, 42, 49] that contributed evidence on multiple different CRMs.

One NRSI conducted in France in the early phase of the SARS-CoV-2 pandemic [49] suggests that compartmentalization of staff members may reduce infection-related outcomes due to SARS-CoV-2 (low certainty of evidence).

The evidence from another NRSI, a case–control study also conducted in France during the SARS-CoV-2 pandemic, suggested that restricting the use of shared spaces [39], may be effective in reducing infection-related outcomes, but the evidence was very uncertain (very low certainty of evidence). The results of two studies also analysing the restriction of shared spaces had been excluded from this synthesis due to critical risk of bias [42, 49].

Furthermore, two NRSIs from France indicated, that serving meals in rooms, may have beneficial effects against infection-related outcomes due to SARS-CoV-2, but the evidence was very uncertain (very low certainty of evidence) [39, 49].

Transmission-reduction measures (TRM)

We included six studies [43, 45, 46, 48, 49, 54] that contributed evidence on TRMs.

According to three cRCTs [43, 46, 54] conducted in the USA, the Netherlands, and Hong-Kong measures to improve hand hygiene likely reduce infection-related outcomes due to influenza and other upper respiratory tract infections (moderate certainty of evidence). These three studies were the only cRCTs identified in this review and the only studies not focusing on infection-related outcomes in the context of the SARS-CoV-2 pandemic.

We included two NRSIs assessing the effectiveness of mask and the use of personal protective equipment (PPE) to prevent infection-related outcomes due to SARS-CoV-2 [45, 48]. The results of another study, also assessing the effectiveness of mask and PPE use were excluded from this synthesis due to critical risk of bias [49]. One of the included studies conducted in LTCFs in the USA showed clear beneficial effects of mask and PPE use as a measure to reduce the number of infections in LTCFs and unclear beneficial effects regarding the outcome number of deaths [45]. The other study assessed the effects of delayed implementation of generalized mask-wearing in outbreaks of SARS-CoV-2 in French LTCFs. This study found a non-significant increase in the risk of infection per additional day in delay of generalized mask wearing [48]. In summary, the measure may be effective as a strategy to protect LTCFs in the context of a pandemic-like event, however the evidence was very uncertain (very low certainty of evidence).

Screening and surveillance measures (SSM)

We included three studies that provided evidence on SSMs. These NRSIs conducted in the USA indicated that routine testing of residents and/or staff in LTCFs may be an effective measure to protect against SARS-CoV-2 [35, 41, 55], but there was a high uncertainty in the evidence (very low certainty of evidence). Another two studies focusing on the effectiveness of routine testing of staff and visitors were excluded from the analysis due to critical risk of bias [50, 56].

Outbreak control measures (OCM)

We included two studies from the USA and from France, that provided evidence on OCMs, namely the separation of infected and non-infected residents (referred to as cohorting) [45, 48]. Both studies were conducted in the early phase of the SARS-CoV-2 pandemic. As both studies showed an effect in favour of the intervention, the measure may be effective as a strategy to protect LTCFs in the context of a pandemic-like event, but the evidence was very uncertain (very low certainty of evidence).

Multi-component measures (MCM)

We included three studies [44, 45, 57], that provided evidence on the combination of multiple measures across multiple intervention domains (MCM). The three NRSIs showed clear beneficial effects of combining multi-component interventions as a measure to reduce the number of infections [44, 45, 57]. One of these studies also showed clear beneficial effects regarding the reduction of the number of deaths [45]. Two of these studies were the only NRSIs judged to have a moderate, rather than a serious risk of bias among all NRSIs assessed in this review. This evidence on combined multi-component interventions including entry regulation measures, contact regulating measures, transmission-reduction measures, screening and surveillance measures and outbreak control measures suggests that especially a combination of the different components were probably effective in protecting residents and staff (moderate certainty of evidence).

Evidence-gap map

To identify gaps in the available evidence, we created an evidence-gap map derived from the logic model displayed in Fig. 1. As presented in Table 3, the evidence-gap map reveals a strong concentration on SARS-CoV-2 studies and a dearth of research on other viral, respiratory transmitted pathogens and other than hand hygiene interventions. The map furthermore shows a gap in the available evidence base for several relevant interventions (e.g., the lack of empirical studies on visiting restrictions, air filtration systems, or routine screening/testing using point of care (POC) tests).

Discussion

Summary of main findings

We identified 16 unique studies (13 NRSIs and three cRCTs) that assessed the effectiveness of various NPIs on infection-related outcomes intended to safeguard LTCF residents and staff against viral respiratory pathogens with pandemic potential. All but three studies focused on SARS-CoV-2. The remaining three studies examined the effect of hand hygiene interventions against influenza or upper respiratory tract infections. The evidence in this review indicates that especially a combination of measures across multiple intervention domains as well as hand hygiene interventions are probably effective in protecting residents and staff from infection-related outcomes due to viral respiratory pathogens (moderate certainty of evidence). Furthermore, the evidence suggests that the entry-regulation measure of self-confinement of residents with staff, the contact regulation measure of compartmentalization of staff members and the screening and surveillance measure of routine testing of residents and/or staff in LTCFs may be effective in protecting residents and staff (low certainty of evidence). Other measures, such as restricting shared spaces, serving meals in room, separating infected, or non-infected residents may be effective, but the evidence is very uncertain (very low certainty of evidence).

Risk of bias and certainty of the evidence

The certainty of evidence, as defined within GRADE, was rated as moderate for only two interventions, namely the effectiveness of hand hygiene measures and the combination of multiple different measures. All other NPI assessments were rated as either low or very low. This suggests that the true effects may be substantially different from the estimates reported in this review [60, 61]. The common reasons for downgrading the evidence included concerns about potential risk of bias regarding confounding and imprecision.

Most assessments in the NRSIs were judged to be at high risk of bias due to confounding. Although many of these studies were well conducted under the circumstances and with the limited data available at the time, we cannot rule out the possibility that other factors, such as confounding by underlying characteristics of the facilities and/or the population within them or concordantly implemented NPIs, may have influenced the observed associations between intervention and outcome.

We downgraded our certainty of evidence for imprecision primarily when the confidence intervals for the effect estimates within a given body of evidence crossed the null effect, our predefined threshold of interest in this review. This would allow for the possibility of the true effect being either in the opposite direction or non-existent.

As specified in our protocol, we intended to assess publication bias through visual examination of funnel plots and the application of tests for funnel plot asymmetry, such as Egger’s tests [62]. However, this approach proved unfeasible in our review due to the scarcity of studies within the same intervention domain and category, falling short of the required minimum of ten comparable studies. Nonetheless, our comprehensive search strategy covered pre-print servers and study-registries, revealing no indication of publication bias for any intervention.

In addressing potential biases, it's key to recognize that intervention effectiveness can be reduced by inconsistent adherence. For instance, despite providing training and resources to enhance hand hygiene, effectiveness might be compromised by poor adherence, misuse of measures like incorrect mask-wearing or handwashing techniques, or the use of inadequate tools such as low-sensitivity point-of-care tests or defective masks. These critical factors are often unreported in studies, potentially compromising the real effectiveness of interventions and leading to underestimation or misinterpretation of their assumed benefits. These issues may conceal an intervention's true efficacy.

Generalizability of findings

Many studies lacked comprehensive descriptions of the specific LTCFs and their residents, limiting the transferability of findings to other types of facilities like assisted living facilities or populations with varying care needs. The lack of detailed facility and population data as well as the limited availability of evidence from a diverse range of settings (e.g., countries in which a study was conducted) limits the applicability and generalizability of the results beyond the studied context.

All studies were conducted in high-income settings, with the majority being conducted in Western high-income countries (only exception a study from Hong Kong [43]), thereby constraining the generalizability of the findings to low- and middle-income country settings. However, even within western high-income countries, transferability and generalizability of the findings can be limited: The divergent structures of long-term care systems, healthcare funding models, access to care, and policies regarding e.g., infection control practices or staffing levels between these contexts necessitate caution in the adaption and application of the results. While the research gap indicates a need for more research beyond high-income Western countries, a better understanding of contextual factors mediating the effect of the intervention and the feasibility of implementation within different political and long-term care systems is warranted.

Furthermore, most studies predominantly focused on SARS-CoV-2, with limited exploration of other pathogens. Remarkably, no study on hand hygiene interventions focusing on SARS-CoV-2 was identified. Variations in the transmission mode, infectiousness levels, and the relative importance of fomite, droplet, or airborne aerosol transmission plays a significant role in determining the effectiveness of measures. Consequently, the relevance of findings on hand hygiene or screening (to name only two examples) may not directly translate to different pathogens, leaving the transferability of these findings to other infectious diseases or future pathogens uncertain.

In many instances, both the setting and the interventions were inadequately described in the studies. This lack of detail hampers the assessment of the generalizability of their findings to other contexts or intervention strategies.

Adverse and other unintended consequences of NPIs implemented in LTCFs

While our review primarily focused on the effectiveness of NPIs in protecting LTCF residents and staff during pandemics and severe influenza seasons, we are aware that these measures can impose substantial adverse effects on the mental and physical health of residents (e.g., reduced physical activity, social isolation, depression, and anxiety) [63,64,65,66,67,68,69] and staff (e.g., psychological distress or burnout) [70,71,72,73,74]. In our searches, we also included NRSIs investigating the adverse and unintended consequences of NPIs on resident’s and staff’s mental and physical health. See Supplementary material for more details. These findings will be addressed in more detail in a separate publication, including other forms of evidence, such as qualitative study results.

In summary, concerning NRSIs investigating adverse and other unintended outcomes, we identified two NRSIs of high quality conducted in Canada and the Netherlands that assessed adverse effects of lockdown measures, including visiting restrictions and contact reduction measures among residents, during the SARS-CoV-2 pandemic [58, 59]. In these studies, these lockdown measures were accompanied by various measures to reduce potential adverse consequences. After adjusting for multiple testing, neither study found statistically significant adverse effects for several mental health-related outcomes. While NPIs implemented in the setting of LTCFs can lead to severe harmful consequences [75], these studies indicate this may not universally apply for all residents and under all conditions. Moreover, the findings suggest that adverse effects of NPIs may be mitigated through additional countermeasures. Nevertheless, further research with robust study designs is needed to comprehensively assess not only assess the effects of the NPIs against infection related outcomes, but also what additional measures and contextual factors are effective in mitigating harm.

Strengths and potential biases in the review process

Our review adhered to the systematic, transparent, and reproducible methodology outlined in the Cochrane Handbook for Systematic Reviews of Interventions [61]. Furthermore, we employed methods similar to those used in the Cochrane SARS-CoV-2 LTCF review, which underwent critical assessment by several content and method experts at both the protocol level and final manuscript level [17, 76]. In order to comprehensively describe the growing bodies of evidence, particularly in the context of the SARS-CoV-2 pandemic, we encompassed not only RCTs but also NRSIs. While these studies inherently possess higher internal validity risks, we consider this a strength of our systematic review, given the impracticality and ethical constraints associated with conducting RCTs during ongoing pandemic-like events. Expanding the scope to NRSIs allowed us to contribute evidence in the absence of RCTs.

We did not include mathematical modelling studies. Although these studies can provide valuable insights, especially where other designs are impractical or unethical (e.g., on the rate of routine surveillance testing), their reliance on a number of assumptions may raise concern about reliability and generalizability. Furthermore, approaches to include them in evidence syntheses are not well established yet [17, 77, 78]. Nevertheless, conducting a systematic review of modelling studies assessing NPIs in LTCFs could yield important insights.

Due to the limited number of studies in each intervention domain and the heterogeneity of reported outcome measures, conducting a meta-analysis was unfeasible. Instead, we adopted a structured narrative synthesis approach, focusing on the direction of effect [28, 31]. Vote-counting, reliant solely on direction, may introduce bias away from the null when small and non-significant findings are present. In order to enhance precision, we consistently applied the terms unclear and clear effects to distinguish effect estimates with confidence intervals overlapping the null (thus allowing the possibility of a different direction of effect) from those with intervals falling exclusively on one side of the null.

The quality of systematic review findings depends on the quality of the studies conducted on the topic. Many of the studies we identified, including both RCTs and NRSIs, displayed methodological limitations and other deficiencies. It is important to note that these studies, frequently assessing complex interventions in the context of an ongoing pandemic, were not necessarily poorly conducted. To advance the evidence base more robust study designs are needed, with a particular emphasis on quasi-experimental NRSIs.

Furthermore, our searches only include studies published up to September 2022. We therefore do not cover publications which may have been eligible for inclusion but were published after this point. For example, we are aware of such a study conducted on air purification systems in the USA [79].

Infection control within healthcare and long-term care environments has undergone significant evolution and expansion since its inception in the mid-twentieth century, particularly when juxtaposed with practices from earlier periods. This evolution encompasses a heightened safety culture, achieved through organizational modifications in care delivery. These modifications include evaluating effectiveness, along with revising, standardizing, and monitoring procedures, all of which are underpinned by the adoption of evidence-based strategies [80,81,82,83]. In particular, the development of guidelines and recommendations in the 1990s, in the wake of the AIDS epidemic, shaped the way modern health care and long-term care infection control practices are conducted [80]. There is a considerable contrast between the IPC practices implemented during the SARS-CoV-2 pandemic and the practices in e.g., the 1950 or 19060 s. To account for these changes and produce evidence of relevance for the current day, we decided to exclude literature published prior to 1992, thus focusing on the most recent three decades of research. However, an exact date at which these gradual changes have occurred cannot be established. Therefore, we consider the line we drew as part of our eligibility criteria as a limitation of our review.

Conclusions

Conclusion for research

This review has highlighted several relevant evidence gaps regarding the effectiveness of measures to protect residents and staff from viral respiratory pathogens with pandemic potential, as displayed in the evidence gap map (Table 3).

Table 3 Evidence-gap map

Addressing these gaps requires the generation of more reliable and robust empirical evidence, to assess the effectiveness and unintended consequences of non NPIs aimed at safeguarding LTCFs against viral respiratory infections. While experimental trials like RCTs are valuable evidence sources, their logistical feasibility during rapidly evolving epidemics and pandemics is challenging. Quasi-experimental designs, such as interrupted time-series analysis, difference-in-difference studies, or propensity score matching can offer practical insights in a timely manner with sufficient reliability of their findings. Public health agencies should consider whether integrating robust evaluation practices can be integrated in their outbreak response and general infection control practices to expand on the body of evidence and provide mode real world data.

In addition, the current body of evidence has a strong focus on SARS-CoV-2, and additional studies addressing infection-related outcomes of other pathogens are needed for almost all interventions except hand hygiene, for which we identified several studies of good to moderate quality.

Moreover, improved reporting is essential. Current studies often inadequately report on interventions, infection control measures, facility information, and contextual details. Enhancing reporting can facilitate the transferability of findings and improve the quality of research within LTCFs.

Furthermore, there is a pressing need for additional research in settings outside Western high-income countries. We did not identify any studies implemented in a low- or middle-income country setting, thereby limiting the generalizability of findings. Research conducted in diverse settings is essential, given the structural and institutional disparities prevalent in long-term care.

Understanding the influence of political priorities, ethical considerations in research, and (existing) limitations in resources like staff, equipment, and funding on implementing NPIs in LTCFs as well as their impact on effectiveness and harmful consequences is crucial. Closing these knowledge gaps can help to facilitate the development context-specific guidelines and recommendations which maximize benefit while minimizing harm within the specific context the LTCFs are placed in.

More research is needed on the effectiveness of various interventions. As displayed in the evidence gap map in Table 3. On many NPIs no reliable evidence was available, while for others only low and very low certainty evidence was available.

Conclusion for practice

We have identified several measures that may serve as effective strategies to protect residents and staff in LTCFs against outbreaks, infections, and their associated consequences in future pandemic-like events. Our evidence suggests that the implementation of NPIs in combination with each other is crucial to fully realize their potential [44, 45, 57]. However, it is important to note that, with some exceptions, the certainty of the evidence was low to very low. This reflects the inherent challenges of generating robust evidence in the context of pandemics, where conducting rigorous RCTs with a high internal validity is often technically infeasible or ethically unjustifiable. Given the high burden of morbidity and mortality in LTCFs without adequate vaccination coverage, implementing NPI measures identified as potentially effective is often the only reasonable option available until satisfactory vaccination rates can be achieved, despite concerns about the certainty of evidence.

Although we did not find evidence to numerous important interventions, including visiting restrictions, pre-entry testing with point-of-care tests, quarantine and isolation, air filters, or improved environmental hygiene, this absence of evidence should not be equated with evidence of absence [84]. The lack of direct evidence from LTCFs setting should not hinder the implementation of these measures if expert judgement from practitioners working in the field, modelling studies, evidence from other settings, or other sources of evidence indicate their benefits and necessity.

Given the gaps in the evidence base regarding the effectiveness of these NPIs, their implementation should always be accompanied with appropriate evaluations mechanisms to avoid allocating resources to ineffective measures and to close these evidence gaps in the future.

Many NPIs assessed in this review pose a substantial infringement of the individual rights and liberties of one of the most vulnerable populations in our society. During the SARS-CoV-2 pandemic, many LTCF residents spent their last weeks or months confined to their room and in isolation from family and friends. This raises questions about the potential benefit in terms of reduction of infection-related outcomes and the need to critically evaluate and balance them against potential harms. NPIs should always be accompanied by adequate countermeasures to assess and mitigate adverse consequences.

Considering the low certainty of evidence regarding the effectiveness of these NPIs and the potential yet uncertain harm they may cause, careful deliberation processes are imperative. We have proposed the WHO-INTEGRATE COVID-19 (WICID) framework as a tool to aid public health practitioners, public health experts, and public health policy decision makers in navigating this complex task [85, 86]. WICID aims to facilitate the development of effective strategies to safeguard LTCF residents and staff during future epidemics and pandemics [44, 45, 57].

In summary, our review highlights the gaps in the evidence and the need for additional research, but also provides a comprehensive and systematic review of the available measures potentially effective in protecting residents and staff of long-term care facilities in the pandemics to come.

Availability of data and materials

All data generated or analysed during this study are included in this published article. They are based on research articles available in the public domain.

Abbreviations

AUC:

Adverse and other unintended outcomes

CBA:

Controlled before-and-after study

CINAHL:

Cumulative Index to Nursing and Allied health Literature

(c)ITS:

(Controlled) interrupted-time-series analysis

COVID-19:

Coronavirus disease 2019

CRM:

Contact regulation measure

(c)RCT:

(Cluster) Randomized Controlled Trial

ECDC:

Europen Centre for Disease Prevention and Contol

EPIET:

ECDC Fellowship Programme, Field Epidemiology Path

ERM:

Entry regulation measure

GRADE:

Grading of Recommendations, Assessment, Development and Evaluation

LTCF:

Long-term care facility

MCM:

Multi-component measure

MERS:

Middle East Respiratory Syndrome

NPI(s):

Non-pharmacological intervention(s)

NRSI:

Non-randomized observational study of intervention effects

OCM:

Outbreak control measure

PI(s):

Pharmacological intervention(s)

PPE:

Personal protective equipment

PCR:

Polymerase chain reaction

PCR/RCS:

Controlled prospective / retrospective cohort study

POC:

Point of care

RD:

Regression discontinuity

RMS:

Repeated measurement study

RNA:

Ribonucliec acid

RoB:

Risk of Bias

ROBINS-I:

Risk Of Bias In Non-randomised Studies-of Interventions

RTI:

Respiratory tract infection

SARS:

Severe acute respiratory syndrome

SARS-CoV-2:

Severe acute respiratory syndrome coronavirus type 2

SSM:

Screening and surveillance measure

SWIM:

Synthesis without meta-analysis

TRM:

Transmission reduction measure

WHO:

World Health Organization

WICID:

WHO-INTEGRATE COVID-19

References

  1. Wang H, Paulson K, Pease S, Watson S. Estimating excess mortality due to the COVID-19 pandemic: a systematic analysis of COVID-19-related mortality, 2020–21. Lancet. 2022;399(10334):1513–36. https://doi.org/10.1016/S0140-6736(21)02796-3.

    Article  CAS  Google Scholar 

  2. Johns Hopkins Center for Health Security (Ed.). The Characteristics of PANDEMIC PATHOGENS; 2018. Available from: https://centerforhealthsecurity.org/sites/default/files/2022-12/180510-pandemic-pathogens-report.pdf. Accessed 19 Aug 2023.

  3. Adalja AA, Watson M, Toner ES, Cicero A, Inglesby TV. Characteristics of Microbes Most Likely to Cause Pandemics and Global Catastrophes. In: Inglesby TV, Adalja AA, editors. Global Catastrophic Biological Risks. Cham: Springer International Publishing; 2019. 1–20. https://doi.org/10.1007/82_2019_176.

  4. Forum of International Respiratory Societies. The Global Impact of Respiratory Disease - 3rd Edition. Forum of International Respiratory Societies; 2021.

  5. D’Adamo H, Yoshikawa T, Ouslander JG. Coronavirus Disease 2019 in Geriatrics and Long-Term Care: The ABCDs of COVID-19. J Am Geriatr Soc. 2020;68(5):912–7. https://doi.org/10.1111/jgs.16445.

    Article  PubMed  Google Scholar 

  6. World Health Organization. Preventing and managing COVID-19 across long-term care services: Policy brief, 24 July 2020. World Health Organization; 2020. Available from: https://www.who.int/publications/i/item/WHO-2019-nCoV-Policy_Brief-Long-term_Care-2020.1. Accessed 8 Dec 2022.

  7. Comas-Herrera A, Marczak J, Byrd W, Lorenz-Dant K, Patel D, Pharoah D (eds.) and LTCcovid contributors. LTCcovid International living report on COVID-19 and Long-Term Care. LTCCovid and Care Policy and Evaluation Centre, London School of Economics; 2021. https://doi.org/10.21953/lse.mlre15e0u6s6, http://eprints.lse.ac.uk/id/eprint/112781. Accessed 13 May 2024.

  8. Comas-Herrera A, Zalakaín J, Lemmon E, Henderson D, Litwin C, Hsu AT et al. Mortality associated with COVID-19 in care homes: international evidence. International Long Term Care Policy Network; 2021. Available from: https://ltccovid.org/wp-content/uploads/2021/02/LTC_COVID_19_international_report_January-1-February-1-2.pdf. Accessed 8 Dec 2022.

  9. Childs A, Zullo AR, Joyce NR, McConeghy KW, van Aalst R, Moyo P, et al. The burden of respiratory infections among older adults in long-term care: a systematic review. BMC Geriatr. 2019;19(1):210. https://doi.org/10.1186/s12877-019-1236-6.

    Article  PubMed  PubMed Central  Google Scholar 

  10. ECDC Public Health Emergency Team, Danis K, Fonteneau L, Georges S, Daniau C, Bernard-Stoecklin S et al. High impact of COVID-19 in long-term care facilities, suggestion for monitoring in the EU/EEA, May 2020. Euro Surveill 2020;25(22). https://doi.org/10.2807/1560-7917.ES.2020.25.22.2000956.

  11. World Health Organization. Global Influenza Strategy 2019–2030: Prevent. Control. Prepare. [Licence: CC BY-NC-SA 3.0 IGO.]. Geneva; 2019. Available from: https://www.who.int/publications/i/item/9789241515320. Accessed 19 Aug 2023.

  12. Volkman JC, Rebmann T, Hilley S, Alexander S, Russell B, Wagner W. Infection prevention disaster preparedness planning for long-term care facilities. Am J Infect Control. 2012;40(3):206–10. https://doi.org/10.1016/j.ajic.2011.03.029

    Article  PubMed  Google Scholar 

  13. Usher K, Durkin J, Gyamfi N, Warsini S, Jackson D. Preparedness for viral respiratory infection pandemic in residential aged care facilities: A review of the literature to inform post-COVID-19 response. J Clin Nurs. 2021. https://doi.org/10.1111/jocn.15863.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Demicheli V, Jefferson T, Di Pietrantonj C, Ferroni E, Thorning S, Thomas RE, et al. Vaccines for preventing influenza in the elderly. Cochrane Database Syst Rev. 2018;2(2):CD004876. https://doi.org/10.1002/14651858.CD004876.pub4.

    Article  PubMed  Google Scholar 

  15. Jefferson T, Jones MA, Doshi P, Del Mar CB, Hama R, Thompson MJ, et al. Neuraminidase inhibitors for preventing and treating influenza in adults and children. Cochrane Database Syst Rev. 2014;2014(4):CD006207. https://doi.org/10.1002/14651858.CD008965.pub4.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Thomas RE, Jefferson T, Lasserson TJ. Influenza vaccination for healthcare workers who care for people aged 60 or older living in long-term care institutions. Cochrane Database Syst Rev. 2016;2016(6):CD005187. https://doi.org/10.1002/14651858.CD005187.pub5.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Stratil JM, Biallas RL, Burns J, Arnold L, Geffert K, Kunzler AM, et al. Non-pharmacological measures implemented in the setting of long-term care facilities to prevent SARS-CoV-2 infections and their consequences: a rapid review. Cochrane Database Syst Rev. 2021;9:CD015085. https://doi.org/10.1002/14651858.CD015085.pub2.

    Article  PubMed  Google Scholar 

  18. Jefferson T, Del Mar CB, Dooley L, Ferroni E, La Al-Ansary, Bawazeer GA et al. Physical interventions to interrupt or reduce the spread of respiratory viruses. Cochrane Database of Systematic Reviews 2020;(11). https://doi.org/10.1002/14651858.CD006207.pub5.

  19. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. https://doi.org/10.1136/bmj.n71.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Reeves BC, Deeks JJ, Higgins JP, Shea B, Tugwell P, Wells GA. Chapter 24: Including non-randomized studies on intervention effects. In: Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Page M et al., editors. Cochrane Handbook for Systematic Reviews of Interventions. 6.3 (updated February 2022); 2022. Available from: https://training.cochrane.org/handbook/current/chapter-24. Accessed 8 Dec 2022.

  21. Reeves BC, Wells GA, Waddington H. Quasi-experimental study designs series-paper 5: a checklist for classifying studies evaluating the effects on health interventions-a taxonomy without labels. J Clin Epidemiol. 2017;89:30–42. https://doi.org/10.1016/j.jclinepi.2017.02.016.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Lefebvre C, Glanville J, Briscoe S, Featherstone R, Littlewood A, Marshall C et al. Chapter 4: Searching for and selecting studies. In: Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Page M et al., editors. Cochrane Handbook for Systematic Reviews of Interventions. 6.3 (updated February 2022); 2022. Available from: https://training.cochrane.org/handbook/current/chapter-04. Accessed 8 Dec 2022.

  23. Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan—a web and mobile app for systematic reviews. Syst Rev 2016;5(1). https://doi.org/10.1186/s13643-016-0384-4.

  24. Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 2019:l4898. https://doi.org/10.1136/bmj.l4898.

  25. Eldridge S, Campbell M, Campbell M, Dahota A, Giraudeau B, Higgins J, Reeves B, Siegfried N. Revised Cochrane risk of bias tool for randomized trials (RoB 2.0): additional considerations for cluster-randomized trials; 2016. Available from: https://www.unisa.edu.au/contentassets/72bf75606a2b4abcaf7f17404af374ad/rob2-0_cluster_parallel_guidance.pdf. Accessed 8 Dec 2022.

  26. Sterne JA, Hernán MA, Reeves BC, Savović J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016;355:i4919. https://doi.org/10.1136/bmj.i4919.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Sterne JA, Hernán MA, McAleenan A, Reeves BC, Higgins JP. Chapter 25: Assessing risk of bias in a non-randomized study. In: Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Page M et al, editors. Cochrane Handbook for Systematic Reviews of Interventions. 6.3 (updated February 2022); 2022. Available from: https://training.cochrane.org/handbook/current/chapter-25. Accessed 8 Dec 2022.

  28. McKenzie JE, Brennan SE. Chapter 12: Synthesizing and presenting findings using other methods. In: Higgins J, Thomas J, Chandler J, et al., editors. Cochrane Handbook for Systematic Reviews of Interventions. 6.3 (updated February 2022). 2022. Available from: https://training.cochrane.org/handbook/current/chapter-12. Accessed 8 Dec 2022.

  29. Ogilvie D, Fayter D, Petticrew M, Sowden A, Thomas S, Whitehead M, et al. The harvest plot: A method for synthesising evidence about the differential effects of interventions. BMC Med Res Methodol. 2008;8(1). https://doi.org/10.1186/1471-2288-8-8.

  30. Thomson HJ, Thomas S. The effect direction plot: visual display of non-standardised effects across multiple outcome domains. Res Syn Meth. 2013;4(1):95–101. https://doi.org/10.1002/jrsm.1060.

    Article  Google Scholar 

  31. Campbell M, McKenzie JE, Sowden A, Katikireddi SV, Brennan SE, Ellis S, et al. Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline. BMJ. 2020;368:l6890. https://doi.org/10.1136/bmj.l6890.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94. https://doi.org/10.1016/j.jclinepi.2010.04.026.

    Article  PubMed  Google Scholar 

  33. Santesso N, Glenton C, Dahm P, Garner P, Akl EA, Alper B, et al. GRADE guidelines 26: informative statements to communicate the findings of systematic reviews of interventions. J Clin Epidemiol. 2020;119:126–35. https://doi.org/10.1016/j.jclinepi.2019.10.014.

    Article  PubMed  Google Scholar 

  34. Schünemann H, Higgins J, Vist G, Glasziou P, Akl E, Skoetz N et al. Chapter 14: Completing ‘Summary of findings’ tables and grading the certainty of the evidence. In: Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Page M et al., editors. Cochrane Handbook for Systematic Reviews of Interventions. 6.3 (updated February 2022); 2022. Available from: https://training.cochrane.org/handbook/current/chapter-14. Accessed 8 Dec 2022.

  35. Allan-Blitz L-T, Aboabdo B, Turner I, Klausner JD. Effect of Frequent SARS-CoV-2 Testing on Weekly Case Rates in Long-Term Care Facilities, Florida, USA. Emerging infectious diseases 2022;28(9). https://doi.org/10.3201/eid2809.212577.

  36. Belmin J, Um Din N, Pariel S, Lafuente-Lafuente C. Confinement du personnel d’Ehpad avec les residents: une solution contre le Covid-19? [Confinement of staff with residents in nursing homes: a solution against COVID-19?]. Gériatrie et Psychologie Neuropsychiatrie du Vieillissement. 2020;18(3):238–40. https://doi.org/10.1684/pnv.2020.0885.

    Article  PubMed  Google Scholar 

  37. Belmin J, Um Din N, Pariel S, Lafuente-Lafuente C. Comment le personnel de 17 maisons de retraite francaises a protégé ses résidents contre la Covid-19 [How staff members of 17 French nursing homes protected their residents from Covid-19]. Gériatrie et Psychologie Neuropsychiatrie du Vieillissement. 2021;19(3):243–4. https://doi.org/10.1684/pnv.2021.0951.

    Article  PubMed  Google Scholar 

  38. Belmin J, Um-Din N, Donadio C, Magri M, Nghiem QD, Oquendo B, Pariel S, Lafuente-Lafuente C. Coronavirus Disease 2019 Outcomes in French Nursing Homes That Implemented Staff Confinement With Residents. JAMA Netw Open. 2020;3(8):e2017533. https://doi.org/10.1001/jamanetworkopen.2020.17533.

  39. Corvol A, Charras K, Prud’homm J, Lemoine F, Ory F, Viel JF, et al. Structural and Managerial Risk Factors for COVID-19 Occurrence in French Nursing Homes. International Journal of Health Policy and Management. 2022;11(11):2630–7. https://doi.org/10.34172/ijhpm.2022.6741.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Dufour AB, Kosar C, Mor V, Lipsitz LA. The Effect of Race and Dementia Prevalence on a COVID-19 Infection Control Intervention in Massachusetts Nursing Homes. Journals of Gerontology: Medical Sciences. 2022;77(7):1361–5. https://doi.org/10.1093/gerona/glab355.

    Article  CAS  Google Scholar 

  41. Ehrlich HY, Harizaj A, Campbell L, Colt M, Yuan K, Rabatsky-Ehr T, et al. SARS-CoV-2 in Nursing Homes after 3 Months of Serial, Facilitywide Point Prevalence Testing, Connecticut, USA. Emerging infectious diseases. 2021;27(5):1288–95. https://doi.org/10.3201/eid2705.204936

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Green R, Tulloch JSP, Tunnah C, Coffey E, Lawrenson K, Fox A, et al. COVID-19 testing in outbreak-free care homes: what are the public health benefits? J Hosp Infect. 2021;111:89–95. https://doi.org/10.1016/j.jhin.2020.12.024.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. Ho M, Seto W, Wong L, Wong T. Effectiveness of multifaceted hand hygiene interventions in long-term care facilities in Hong Kong: a cluster-randomized controlled trial. Infect Control Hosp Epidemiol. 2012;33(8):761–7. https://doi.org/10.1086/666740

    Article  PubMed  Google Scholar 

  44. Lipsitz LA, Kosar C, Dufour AB, Travison TG, Mor V. Evaluation of a state-wide effort to improve COVID-19 infection control in Massachusetts nursing homes. J Am Geriatr Soc. 2022. https://doi.org/10.1111/jgs.17984.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Lipsitz LA, Lujan AM, Dufour A, Abrahams G, Magliozzi H, Herndon L, et al. Stemming the Tide of COVID-19 Infections in Massachusetts Nursing Homes. Journal of the American Geriatrics Society. 2020;68(11):2447–53. https://doi.org/10.1111/jgs.16832.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Makris AT, Morgan L, Gaber DJ, Richter A, Rubino JR. Effect of a comprehensive infection control program on the incidence of infections in long-term care facilities. Am J Infect Control. 2000;28(1):3–7. https://doi.org/10.1016/s0196-6553(00)90004-x.

    Article  CAS  PubMed  Google Scholar 

  47. Parikh S, O’Laughlin K, Ehrlich HY, Campbell L, Harizaj A, Durante A, et al. Point Prevalence Testing of Residents for SARS-CoV-2 in a Subset of Connecticut Nursing Homes. JAMA. 2020;324(11):1101–3. https://doi.org/10.1001/jama.2020.14984.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  48. Reyné B, Selinger C, Sofonea MT, Miot S, Pisoni A, Tuaillon E, et al. Analysing different exposures identifies that wearing masks and establishing COVID-19 areas reduce secondary-attack risk in aged-care facilities. Int J Epidemiol. 2022;50(6):1788–94. https://doi.org/10.1093/ije/dyab121.

    Article  PubMed  Google Scholar 

  49. Rolland Y, Lacoste MH, de Mauleon A, Ghisolfi A, de Souto Barreto P, Blain H, et al. Guidance for the Prevention of the COVID-19 Epidemic in Long-Term Care Facilities: A Short-Term Prospective Study. Journal of Nutrition, Health and Aging. 2020;24(8):812–6. https://doi.org/10.1007/s12603-020-1440-2.

    Article  CAS  Google Scholar 

  50. Stemler J, Kramer T, Dimitriou V, Wieland U, Schumacher S, Sprute R, et al. Mobile PCR-based surveillance for SARS-CoV-2 to reduce visiting restrictions in nursing homes during the COVID-19 pandemic: a pilot study. Infection. 2022;50(3):607–16. https://doi.org/10.1007/s15010-021-01716-4.

    Article  CAS  PubMed  Google Scholar 

  51. Teesing GR, Erasmus V, Petrignani M, Koopmans MPG, de Graaf M, Vos MC, et al. Improving Hand Hygiene Compliance in Nursing Homes: Protocol for a Cluster Randomized Controlled Trial (HANDSOME Study). JMIR Research Protocols. 2020;9(5):e17419. https://doi.org/10.2196/17419.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Teesing GR, Erasmus V, Nieboer D, Petrignani M, Koopmans MPG, Vos MC, et al. Increased hand hygiene compliance in nursing homes after a multimodal intervention: A cluster randomized controlled trial (HANDSOME). Infect Control Hosp Epidemiol. 2020;41(10):1169–77. https://doi.org/10.1017/ice.2020.319.

    Article  PubMed  Google Scholar 

  53. Teesing GR, Graaf M de, Petrignani M, Erasmus V, Klaassen CHW, Schapendonk CME et al. Association of environmental surface contamination with hand hygiene and infections in nursing homes: a prospective cohort study. Infect Prev Pract 2021;3(2). https://doi.org/10.1016/j.infpip.2021.100129.

  54. Teesing GR, Richardus JH, Nieboer D, Petrignani M, Erasmus V, Verduijn-Leenman A et al. The effect of a hand hygiene intervention on infections in residents of nursing homes: a cluster randomized controlled trial. Antimicrob Resist Infect Control 2021;10(1). https://doi.org/10.1186/s13756-021-00946-3.

  55. Telford CT, Onwubiko U, Holland DP, Turner K, Prieto J, Smith S, et al. Preventing COVID-19 Outbreaks in Long-Term Care Facilities Through Preemptive Testing of Residents and Staff Members - Fulton County, Georgia, March-May. Morbidity and Mortality Weekly Report. 2020;2020:1296–9. Available from: https://www.cdc.gov/mmwr/volumes/69/wr/mm6937a4.htm?s_cid=mm6937a4_w. Accessed 8 Dec 2022.

    Article  Google Scholar 

  56. Tulloch JSP, Micocci M, Buckle P, Lawrenson K, Kierkegaard P, McLister A, et al. Enhanced lateral flow testing strategies in care homes are associated with poor adherence and were insufficient to prevent COVID-19 outbreaks: results from a mixed methods implementation study. Age Ageing. 2021;50(6):1868–75. https://doi.org/10.1093/ageing/afab162.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Vijh R, Prairie J, Otterstatter MC, Hu Y, Hayden AS, Yau B, et al. Evaluation of a multisectoral intervention to mitigate the risk of severe acute respiratory coronavirus virus 2 (SARS-CoV-2) transmission in long-term care facilities. Infect Control Hosp Epidemiol. 2021;42(10):1181–8. https://doi.org/10.1017/ice.2020.1407.

    Article  PubMed  Google Scholar 

  58. Angevaare MJ, Joling KJ, Smalbrugge M, Hertogh Cees M. P. M, Twisk JWR, van Hout HPJ. The Effects of the 2020 COVID-19 Lockdown on Mood, Behavior, and Social and Cognitive Functioning in Older Long-Term Care Residents. J Am Med Directors Assoc. 2022;23(9):1608.e9-1608.e18. https://doi.org/10.1016/j.jamda.2022.07.003.

    Article  Google Scholar 

  59. McArthur C, Saari M, Heckman GA, Wellens N, Weir J, Hebert P, et al. Evaluating the Effect of COVID-19 Pandemic Lockdown on Long-Term Care Residents’ Mental Health: A Data-Driven Approach in New Brunswick. J Am Med Dir Assoc. 2021;22(1):187–92. https://doi.org/10.1016/j.jamda.2020.10.028.

    Article  PubMed  Google Scholar 

  60. Hultcrantz M, Rind D, Akl EA, Treweek S, Mustafa RA, Iorio A, et al. The GRADE Working Group clarifies the construct of certainty of evidence. J Clin Epidemiol. 2017;87:4–13. https://doi.org/10.1016/j.jclinepi.2017.05.006.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Page M et al., editors. Cochrane Handbook for Systematic Reviews of Interventions. version 6.2; 2021. Available from: www.training.cochrane.org/handbook. Accessed 8 Dec 2022.

  62. Page M, Higgins J, Sterne J. Chapter 13: Assessing risk of bias due to missing results in a synthesis. In: Higgins J, Thomas J, Chandler J, Cumpston M, Li T, Page M et al., editors. Cochrane Handbook for Systematic Reviews of Interventions. 6.3 (updated February 2022); 2022. Available from: https://training.cochrane.org/handbook/current/chapter-13. Accessed 8 Dec 2022.

  63. El Haj M, Altintas E, Chapelet G, Kapogiannis D, Gallouj K. High depression and anxiety in people with Alzheimer’s disease living in retirement homes during the covid-19 crisis. Psychiatry Res. 2020;291:113294. https://doi.org/10.1016/j.psychres.2020.113294.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  64. Cortés Zamora EB, Mas Romero M, Tabernero Sahuquillo MT, Avendaño Céspedes A, Andrés-Petrel F, Gómez Ballesteros C, et al. Psychological and Functional Impact of COVID-19 in Long-Term Care Facilities: The COVID-A Study. Am J Geriatr Psychiatry. 2022;30(4):431–43. https://doi.org/10.1016/j.jagp.2022.01.007.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Abbasi J. Social Isolation—the Other COVID-19 Threat in Nursing Homes. JAMA. 2020;324(7):619. https://doi.org/10.1001/jama.2020.13484.

    Article  PubMed  Google Scholar 

  66. Armitage R, Nellums LB. COVID-19 and the consequences of isolating the elderly. The Lancet Public Health. 2020;5(5):e256. https://doi.org/10.1016/S2468-2667(20)30061-X.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Wu B. Social isolation and loneliness among older adults in the context of COVID-19: a global challenge. glob health res policy 2020;5(1). https://doi.org/10.1186/s41256-020-00154-3.

  68. Chu CH, Donato-Woodger S, Dainton CJ. Competing crises: COVID-19 countermeasures and social isolation among older adults in long-term care. J Adv Nurs. 2020;76(10):2456–9. https://doi.org/10.1111/jan.14467.

    Article  PubMed  PubMed Central  Google Scholar 

  69. D’cruz M, Banerjee D. ‘An invisible human rights crisis’: The marginalization of older adults during the COVID-19 pandemic – An advocacy review. Psychiatry Res. 2020;292:113369. https://doi.org/10.1016/j.psychres.2020.113369.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  70. Senczyszyn A, Lion KM, Szcześniak D, Trypka E, Mazurek J, Ciułkowicz M, et al. Mental Health Impact of SARS-COV-2 Pandemic on Long-Term Care Facility Personnel in Poland. J Am Med Dir Assoc. 2020;21(11):1576–7. https://doi.org/10.1016/j.jamda.2020.09.020.

    Article  PubMed  PubMed Central  Google Scholar 

  71. El Haj M, Allain P, Annweiler C, Boutoleau-Bretonnière C, Chapelet G, Gallouj K, et al. Burnout of Healthcare Workers in Acute Care Geriatric Facilities During the COVID-19 Crisis: An Online-Based Study. JAD. 2020;78(2):847–52. https://doi.org/10.3233/JAD-201029.

    Article  CAS  PubMed  Google Scholar 

  72. Blanco-Donoso LM, Moreno-Jiménez J, Amutio A, Gallego-Alberto L, Moreno-Jiménez B, Garrosa E. Stressors, Job Resources, Fear of Contagion, and Secondary Traumatic Stress Among Nursing Home Workers in Face of the COVID-19: The Case of Spain. J Appl Gerontol. 2021;40(3):244–56. https://doi.org/10.1177/0733464820964153.

    Article  PubMed  Google Scholar 

  73. Lu W, Wang H, Lin Y, Li L. Psychological status of medical workforce during the COVID-19 pandemic: A cross-sectional study. Psychiatry Res. 2020;288:112936. https://doi.org/10.1016/j.psychres.2020.112936.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  74. Huang L, Lei W, Xu F, Liu H, Yu L. Emotional responses and coping strategies in nurses and nursing students during Covid-19 outbreak: A comparative study. PLoS ONE. 2020;15(8):e0237303. https://doi.org/10.1371/journal.pone.0237303.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  75. Suarez-Gonzalez A, Rajagopalan J, Livingston G, Alladi S. The effect of Covid-19 isolation measures on the cognition and mental health of people living with dementia: a rapid systematic review of one year of evidence 2021. Available from: https://medrxiv.org/cgi/content/short/2021.03.17.21253805. Accessed 8 Dec 2022.

  76. Stratil JM, Biallas RL, Burns J, Arnold L, Geffert K, Kunzler AM, et al. Non-pharmacological measures implemented in the setting of long-term care facilities to prevent SARS-CoV-2 infections and their consequences: a rapid review: Protocol. Cochrane Database Syst Rev. 2021. https://doi.org/10.1002/14651858.CD015085.

    Article  PubMed  PubMed Central  Google Scholar 

  77. Burns J, Movsisyan A, Stratil JM, Biallas RL, Coenen M, Emmert-Fees KM, et al. International travel-related control measures to contain the COVID-19 pandemic: a rapid review. Cochrane Database Syst Rev. 2021;3(3):CD013717. https://doi.org/10.1002/14651858.CD013717.pub2.

    Article  PubMed  Google Scholar 

  78. Brozek JL, Canelo-Aybar C, Akl EA, Bowen JM, Bucher J, Chiu WA, et al. GRADE Guidelines 30: the GRADE approach to assessing the certainty of modeled evidence-An overview in the context of health decision-making. J Clin Epidemiol. 2021;129:138–50. https://doi.org/10.1016/j.jclinepi.2020.09.018.

    Article  PubMed  Google Scholar 

  79. Jutkowitz E, Shewmaker P, Reddy A, Braun JM, Baier RR. The Benefits of Nursing Home Air Purification on COVID-19 Outcomes: A Natural Experiment. J Am Med Dir Assoc. 2023;24(8):1151–6. https://doi.org/10.1016/j.jamda.2023.05.026.

    Article  PubMed  Google Scholar 

  80. Garcia R, Barnard B, Kennedy V. The fifth evolutionary era in infection control: interventional epidemiology. Am J Infect Control. 2000;28(1):30–43. https://doi.org/10.1016/s0196-6553(00)90009-9.

    Article  CAS  PubMed  Google Scholar 

  81. Garcia R, Barnes S, Boukidjian R, Goss LK, Spencer M, Septimus EJ, et al. Recommendations for change in infection prevention programs and practice. Am J Infect Control. 2022;50(12):1281–95. https://doi.org/10.1016/j.ajic.2022.04.007.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  82. Torriani F, Taplitz R. Chapter 6 - History of infection prevention and control. In: Cohen J, Opal SM, Powderly WG, editors. Infectious Diseases (Third Edition). London: Mosby; 2010. p. 76–85.

  83. Larson A. A retrospective on infection control. Part 2: twentieth century--the flame burns. Am J Infect Control. 1997;25(4):340–9. https://doi.org/10.1016/S0196-6553(97)90027-4.

    Article  CAS  PubMed  Google Scholar 

  84. Altman DG, Bland JM. Absence of evidence is not evidence of absence. BMJ. 1995;311(7003):485. https://doi.org/10.1136/bmj.311.7003.485.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  85. Stratil JM, Voss M, Arnold L. WICID framework version 1.0: criteria and considerations to guide evidence-informed decision-making on non-pharmacological interventions targeting COVID-19. BMJ Glob Health. 2020;5(11):e003699. https://doi.org/10.1136/bmjgh-2020-003699.

    Article  PubMed  Google Scholar 

  86. Rehfuess EA, Stratil JM, Scheel IB, Portela A, Norris SL, Baltussen R. The WHO-INTEGRATE evidence to decision framework version 1.0: integrating WHO norms and values and a complexity perspective. BMJ Glob Health. 2019;4(1Suppl 1):e000844. https://doi.org/10.1136/bmjgh-2018-000844.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We would like to thank the unit ZIG2 Evidence-based public health at the RKI in Germany for their support in conducting this research project. Additionally, we would like to thank Tim Eckmanns at the Unit 37 Health­care associated Infections, Surveillance of Antibiotic Resistance and Consumption for his support of the project. We are also thankful to Andrea Hinsche-Böckenholt for her support in developing the search strategy for this review. Furthermore, our thanks go to Lena Hesselbarth, Josefina Lehner, Benjamin Preisler, and Xenia Reimer for their contribution during the initial title and abstract screening phase.

Funding

Open Access funding enabled and organized by Projekt DEAL. This study was partially supported by the Evidence-based Public Health Unit (ZIG2) of the Center for International Health Protection (ZIG) at the Robert Koch Institute (RKI) (Call for Proposals: LTCF_221, July 2022). The authors had regular calls with a representative of the funder to provide updates on the current state of the research, but the funder did not have a specific role in the conceptualization, design, data collection, analysis, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

LA and JMS conceived the overall study design and approach. LA and JMS developed the eligibility criteria. JMS developed the search strategy with support from LA and AHB. Screening for title and abstract was conducted by LA, SB, HS, SLW, and JMS. Data extraction was conducted by SB, HS, and SLW and was checked by LA and JMS. Risk of bias assessment was conducted by LA and JMS with major contributions from SB, HS, and SLW. Evidence synthesis and assessment of the certainty of evidence was conducted by LA and JMS. The manuscript was drafted by LA and JMS, and reviewed and approved by SB, HS, BB, and SLW. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Jan M Stratil.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Arnold, L., Bimczok, S., Schütt, H. et al. How to protect long-term care facilities from pandemic-like events? - A systematic review on the effectiveness of non-pharmacological measures to prevent viral respiratory infections. BMC Infect Dis 24, 589 (2024). https://doi.org/10.1186/s12879-024-09271-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12879-024-09271-7

Keywords