- Open Access
COVID-19: interpreting scientific evidence – uncertainty, confusion and delays
BMC Infectious Diseases volume 20, Article number: 653 (2020)
- The Publisher Correction to this article has been published in BMC Infectious Diseases 2020 20:701
One of the emerging aspects of the current severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2), coronavirus disease 2019 (COVID-19) pandemic, is how different governments and institutions interpret and apply the same scientific evidence. This impacts on how the local guidance within each country is written and passed down to health and care workers and the general public.
Although a consensus amongst experts would be ideal, this is difficult if not impossible with a new emerging pathogen, and in some aspects, such as aerosol transmission, many experts already have pre-conceived notions which have been upheld for a long time related to other pathogens [1,2,3]. Such preconceptions and strongly held opinions will hamper any consensus, and bias how emerging evidence is interpreted for any new pathogen.
Issues around how a new infectious agent spreads are perhaps the most predominant, as the interventions such as social distancing, lockdowns and use of personal protective equipment (PPE) can have direct and practical impact on how people live, work and study. One of the most dramatic instances of this was (and is) the ongoing advice over the wearing of face masks.
Face masks have been used to some extent in Asia for many years to protect against inorganic airborne pollutants [4,5,6], so the extension to wearing masks to protect against airborne infection was relatively easy. The key aspect here is how quickly the universal masking was adopted in many Asian counties for this purpose – particularly those who had experienced and were hardest hit by the 2003 SARS-CoV-1 outbreaks. Such universal masking reduces cross-transmission and effectively creates a degree of herd immunity, which may explain why countries like Hong Kong, Taiwan, Vietnam, South Korea and Japan have experienced relatively few COVID-19 cases and deaths [7,8,9,10,11,12].
Thus, the impact of COVID-19 has been far less in those countries that experienced the SARS-CoV-1, 2003 or Middle East respiratory syndrome coronavirus (MERS-CoV) outbreaks, whose populations were already used to wearing face masks. This is in stark contrast to the countries that have not had this experience (including UK, Europe, North and South America), where such masking culture was relatively absent and the casualties from COVID-19 have been much higher [7, 8]. Of course, the control of COVID-19 in those Asian countries was not just due to mask-wearing but this was achieved in combination with other factors such as a relatively compliant populations, and the efficient, rapid roll-outs of mass testing, tracking and tracing, with prompt isolation of those infected, or the quarantining of those exposed.
Healthcare systems in many developed countries have gradually become more adapted to dealing with non-communicable chronic diseases (e.g. diabetes, chronic heart and lung disease, rheumatological conditions, dementia and Parkinson’s disease, etc.), depending mostly on effective vaccination programmes and a good supply of antimicrobials to deal with infectious diseases. Thus, they may be ill-prepared to deal with novel emerging pathogens. Yet, in such situations, as in any other walk of life, where expertise lies elsewhere, it seems sensible to seek and heed such advice - in this case, the Asian countries that had experienced the 2003 SARS-CoV-1 outbreaks, many of whom had also dealt with emerging threats from avian influenza A(H5N1), A(H7N9) and Middle East Respiratory Syndrome coronavirus (MERS)  .
Governments and populations in these Asian countries readily accepted that masking in public would protect everyone to some extent, despite relatively little evidence for the benefit of masks available at that time [14,15,16]. There was no prolonged debate about this and it was quickly adopted, presumably on the grounds of common sense, i.e. that any physical barrier across the face between you and someone else, without knowing which of you might be infected, was better than nothing. The protective effect of face masks has since been supported in a systematic review based on older and newer studies [17, 18].
In contrast, there were prolonged and at times acrimonious debates in Europe, North America and Australia about the benefits of wearing masks, first for healthcare workers and then in the community [19,20,21]. These debates went on for several months (during March–June 2020) amongst government ‘experts’ and within the media, causing much confusion to the general public. The debates initially started off with various statements to the effect that ‘masks don’t work – don’t buy them!’, which eventually changed to the more recent mandatory order that ‘masks must be worn in shops and on public transport’ [22,23,24].
But why the complete reversal of advice? The body of evidence for the protective effect of masks had not changed that much during this period (April–June 2020), but the way the existing evidence was presented and interpreted may have changed [17, 18], together with people’s perceptions of how the pandemic was progressing. It was becoming increasingly evident that hand-washing and social distancing alone was not controlling the spread. This was all coupled with additional, rapidly emerging evidence of airborne (i.e. fine particle) transmission, including opinions from scientists, many of whom were frequently interviewed in the media on this topic. One of the last vestiges of resistance to the benefits of masking, based on the risk compensation hypothesis (that masking makes people over-confident and take more risks), which had never been proven by any objective evidence, was also finally rebuffed .
There were other less dramatic examples of such reversals based on ‘mounting evidence’, such as whether or not asymptomatic SARS-CoV-2 infections truly existed - then whether or not they could transmit the virus [26,27,28]; and whether SARS-CoV-2 was airborne or not - and whether it could be transmitted by exhaled aerosols [29,30,31,32]. All of these possible means of SARS-CoV-2 transmission (asymptomatic and airborne) have now been acknowledged and accepted by the World Health Organization .
One problem is that many of these questions were initially presented in a very binary way, i.e. that some things work or don’t work, or some things happen or don’t happen, when in fact some things do work to some degree (like masks and antibody tests), and some things can occur to some extent (like asymptomatic and airborne transmission) in different circumstances. So it is perhaps not surprising that eventually some degree of reversal was inevitable. While it is understandable that government and public health guidance endeavours to be clear and concise, this is rarely possible with an emerging pathogen with limited data available. Thus, there is always the risk that an overly emphatic message may be eventually proved wrong and require correction later.
Few, if any, aspects (except survival versus death) of infectious diseases are purely black and white. It has often been forgotten that the absence of evidence is not evidence of absence (no matter how loudly and widely this is proclaimed) – especially with a novel pandemic virus. If one study does not show that something happens in a particular cohort (like asymptomatic or airborne transmission) it does not necessarily mean that it is not happening in other cohorts elsewhere.
Several obvious questions arise from this – how much and what kind of evidence needs to be presented to policy-makers to support or change their guidance? Exactly because of the nature of an emerging, novel pathogen, there is no easy answer to this, but in the face of uncertainty, some general preparedness measures can still be put in place, depending on the available resources and infrastructure, e.g. the stockpiling of PPE, the identification, enhancement and expansion of existing capacity in diagnostic laboratories, as well as isolation, quarantine and intensive care facilities.
Some of the best epidemiological modelling studies have been performed in Hong Kong since the SARS-CoV-1, 2003 outbreaks. One such study, published in the early stages of the Wuhan novel coronavirus outbreak, predicted the potential for widespread transmission, globally, if quick and drastic action was not taken:
“On the present trajectory, 2019-nCoV could be about to become a global epidemic in the absence of mitigation …. Should containment fail and local transmission is established, mitigation measures according to plans that had been drawn up and executed during previous major outbreaks, such as those of SARS, MERS, or pandemic influenza, could serve as useful reference templates.” (published online 31 January 2020, The Lancet) .
However, this produced relatively little response in the UK and other European countries :
“The NHS has been wholly unprepared for this pandemic. It’s impossible to understand why.”
Unfortunately, by then it was already too late to prevent cases of the novel coronavirus being imported into Europe. A week earlier (24 January 2020) the first three known cases had already been detected in France , with 2 cases confirmed in the UK by end of January 2020 . Thereafter, multiple cases of COVID-19 were reported throughout Europe [38, 39]. Yet it took another 7 weeks, despite rapidly increasing numbers of cases before there was a national lockdown on 17 March 2020 across France .
Hindsight is a wonderful thing, yet it is acknowledged that clear, decisive interpretations of emerging evidence for a novel pathogen will always be difficult. Early evidence will be rarely definitive from a limited number of studies, but in fact we make this kind of judgement all the time as individuals, e.g. when we buy various forms of insurance. Although certain types of insurance (like for car and buildings) are mandated by law, other forms of insurance like contents and travel insurance are really down to individual choice – which will depend on their affordability as well as that individual’s risk assessment.
So, with hindsight, could an earlier more drastic lockdown or mandated masking approach (e.g. when in crowded, essential indoor spaces, like supermarkets for food shopping) have reduced the eventual COVID-19 case numbers and deaths? Recent modelling studies in the USA along these lines suggest that this was likely, where earlier interventions could have saved 30,000–40,000 American lives [41, 42]. This could also be true of other countries.
So what factors inhibit the rapid and drastic decision-making to implement such necessary, draconian infection control measures? Many separate factors may hinder this, such as the familiarity with and the availability of masks, the significant impact of lockdown on social and economic well-being, and school and university education, etc. When experiencing such events for the first time, an interval is needed to process that information before coming up with a viable action plan that takes into account all angles unique to that population. Yet such delays only allow the virus to spread further. Even New Zealand, which has been one of the most successful countries in limiting the transmission of SARS-CoV-2, took a month after its first diagnosed case of COVID-19 to impose its strict national lockdown . In a sense, each country may have to reinvent its own, unique wheel, the first time such events are encountered – thus giving the virus additional time to spread and seed greater numbers in the population.
Yet, things can improve with practice. Those countries with the experience of dealing with such epidemics of novel infectious agents will be more familiar with the need to adapt and make dramatic decisions quickly [7, 8, 44], and can offer advice to others that are willing to listen.
This advice could be related to the nature of preparedness, such as setting up rapid pathways for enhanced hospital and community-based mobile and drive-thru testing, across multiple laboratories and sites (i.e. not to keep it centralised); to develop and test mobile phone apps for enhancing track-and-trace measures; optimising existing infrastructure and facilities to enable the rapid expansion of isolation, quarantine and intensive care capacities at short notice. These preparedness capabilities will have to be developed, maintained and practiced in ‘peace’ time between pandemics, and will, inevitably, incur an ongoing cost.
Even experienced countries will need time to adapt to a new pathogen, so novel infectious agents will always be one step ahead of us, and casualties will be initially inevitable. Yet with a more coordinated international approach, an awareness of pre-conceived notions and barriers that need to be overcome, greater improvements in rapid diagnostics, epidemiological modelling, infection control, drug and vaccine development technologies, as seen since SARS-CoV-1, 2003 we will further reduce these delays before taking informed and effective action.
Brankston G, Gitterman L, Hirji Z, Lemieux C, Gardam M. Transmission of influenza A in human beings. Lancet Infect Dis. 2007;7(4):257–65. https://doi.org/10.1016/S1473-3099(07)70029-4.
Seto WH. Airborne transmission and precautions: facts and myths. J Hosp Infect. 2015;89(4):225–8. https://doi.org/10.1016/j.jhin.2014.11.005.
Conly J, Seto WH, Pittet D, et al. Use of medical face masks versus particulate respirators as a component of personal protective equipment for health care workers in the context of the COVID-19 pandemic. Antimicrob Resist Infect Control. 2020;9(1):126. https://doi.org/10.1186/s13756-020-00779-6 Published 2020 Aug 6.
Wongsurakiat P, Maranetra KN, Nana A, Naruman C, Aksornint M, Chalermsanyakorn T. Respiratory symptoms and pulmonary function of traffic policemen in Thonburi. J Med Assoc Thail. 1999;82(5):435–43.
Kunii O, Kanagawa S, Yajima I, et al. The 1997 haze disaster in Indonesia: its air quality and health effects. Arch Environ Health. 2002;57(1):16–22. https://doi.org/10.1080/00039890209602912.
Cherrie JW, Apsley A, Cowie H, et al. Effectiveness of face masks used to protect Beijing residents against particulate air pollution. Occup Environ Med. 2018;75(6):446–52. https://doi.org/10.1136/oemed-2017-104765.
Wong SYS, Kwok KO, Chan FKL. What can countries learn from Hong Kong's response to the COVID-19 pandemic? CMAJ. 2020;192(19):E511–5. https://doi.org/10.1503/cmaj.200563.
Cheng VC, Wong SC, Chuang VW, So SY, Chen JH, Sridhar S, To KK, Chan JF, Hung IF, Ho PL, Yuen KY. The role of community-wide wearing of face mask for control of coronavirus disease 2019 (COVID-19) epidemic due to SARS-CoV-2. J Inf Secur. 2020;81(1):107–14. https://doi.org/10.1016/j.jinf.2020.04.024.
Yi-Fong Su V, Yen YF, Yang KY, Su WJ, Chou KT, Chen YM, Perng DW. Masks and medical care: two keys to Taiwan's success in preventing COVID-19 spread. Travel Med Infect Dis. 2020;4:101780. https://doi.org/10.1016/j.tmaid.2020.101780.
Huynh TLD. The COVID-19 containment in Vietnam: what are we doing? J Glob Health. 2020;10(1):010338. https://doi.org/10.7189/jogh.10.010338.
Kim YJ, Jeong YJ, Kim SH, Kim YJ, Lee SY, Kim TY, Choi MS, Ahn JH. Preparedness for COVID-19 infection prevention in Korea: a single-centre experience. J Hosp Infect. 2020;105(2):370–2. https://doi.org/10.1016/j.jhin.2020.04.018.
Iwasaki A, Grubaugh ND. Why does Japan have so few cases of COVID-19? EMBO Mol Med. 2020;12(5):e12481. https://doi.org/10.15252/emmm.202012481.
Park S, Park JY, Song Y, How SH, Jung KS, Respiratory Infections Assembly of the APSR. Emerging respiratory infections threatening public health in the Asia-Pacific region: a position paper of the Asian Pacific Society of Respirology. Respirology. 2019;24(6):590–7. https://doi.org/10.1111/resp.13558.
van der Sande M, Teunis P, Sabel R. Professional and home-made face masks reduce exposure to respiratory infections among the general population. PLoS One. 2008;3(7):e2618. https://doi.org/10.1371/journal.pone.0002618 PMID: 18612429; PMCID: PMC2440799.
Milton DK, Fabian MP, Cowling BJ, Grantham ML, McDevitt JJ. Influenza virus aerosols in human exhaled breath: particle size, culturability, and effect of surgical masks. PLoS Pathog. 2013;9(3):e1003205. https://doi.org/10.1371/journal.ppat.1003205 Epub 2013 Mar 7. PMID: 23505369; PMCID: PMC3591312.
Makison Booth C, Clayton M, Crook B, Gawn JM. Effectiveness of surgical masks against influenza bioaerosols. J Hosp Infect. 2013;84(1):22–6. https://doi.org/10.1016/j.jhin.2013.02.007.
Chu DK, Akl EA, Duda S, et al. Physical distancing, face masks, and eye protection to prevent person-to-person transmission of SARS-CoV-2 and COVID-19: a systematic review and meta-analysis. Lancet. 2020;395(10242):1973–87. https://doi.org/10.1016/S0140-6736(20)31142-9.
MacIntyre CR, Wang Q. Physical distancing, face masks, and eye protection for prevention of COVID-19. Lancet. 2020;395(10242):1950–1. https://doi.org/10.1016/S0140-6736(20)31183-1.
Leung CC, Lam TH, Cheng KK. Mass masking in the COVID-19 epidemic: people need guidance. Lancet. 2020;395(10228):945. https://doi.org/10.1016/S0140-6736(20)30520-1.
Feng S, Shen C, Xia N, Song W, Fan M, Cowling BJ. Rational use of face masks in the COVID-19 pandemic. Lancet Respir Med. 2020;8(5):434–6. https://doi.org/10.1016/S2213-2600(20)30134-X.
Klompas M, Morris CA, Sinclair J, Pearson M, Shenoy ES. Universal masking in hospitals in the Covid-19 era. N Engl J Med. 2020;382(21):e63. https://doi.org/10.1056/NEJMp2006372.
Wired. How masks went from don’t-wear to must-have. 2020. https://www.wired.com/story/how-masks-went-from-dont-wear-to-must-have/. Accessed 4 Aug 2020.
UK government. Staying safe outside your home. Updated 24 June 2020. https://www.gov.uk/government/publications/staying-safe-outside-your-home/staying-safe-outside-your-home. Accessed 4 Aug 2020.
Euronews. Coronavirus: Mandatory mask-wearing becomes the norm in Europe as cases rise. 24 July 2020. https://www.euronews.com/2020/07/24/coronavirus-mandatory-mask-wearing-becomes-the-norm-in-europe-as-cases-rise. Accessed 4 Aug 2020.
Eleni M, James RG, Marteau Theresa M. Is risk compensation threatening public health in the covid-19 pandemic? BMJ. 2020;370:m2913.
Consumer News and Business Channel (CNBC). WHO walks back comments on asymptomatic coronavirus spread, says much is still unknown. 2020. https://www.cnbc.com/2020/06/09/who-scrambles-to-clarify-comments-on-asymptomatic-coronavirus-spread-much-is-still-unknown.html. Accessed 4 Aug 2020.
World Health Organization (WHO). Transmission of SARS-CoV-2: implications for infection prevention precautions. 2020. https://www.who.int/news-room/commentaries/detail/transmission-of-sars-cov-2-implications-for-infection-prevention-precautions. Accessed 4 Aug 2020.
Furukawa NW, Brooks JT, Sobel J. Evidence supporting transmission of severe acute respiratory syndrome coronavirus 2 while presymptomatic or asymptomatic. Emerg Infect Dis. 2020;26(7):e201595. https://doi.org/10.3201/eid2607.201595.
Nature. Is the coronavirus airborne? Experts can’t agree. 2020. https://www.nature.com/articles/d41586-020-00974-w. Accessed 4 Aug 2020.
Morawska L, Cao J. Airborne transmission of SARS-CoV-2: The world should face the reality. Environ Int. 2020;139:105730. https://doi.org/10.1016/j.envint.2020.105730 Epub 2020 Apr 10. PMID: 32294574; PMCID: PMC7151430.
Prather KA, Wang CC, Schooley RT. Reducing transmission of SARS-CoV-2. Science. 2020;368(6498):1422–4. https://doi.org/10.1126/science.abc6197.
Morawska L, Milton DK. It is Time to Address Airborne Transmission of COVID-19 [published online ahead of print, 2020 Jul 6]. Clin Infect Dis. 2020:ciaa939. https://doi.org/10.1093/cid/ciaa939.
World Health Orgnaization (WHO). Transmission of SARS-CoV-2: implications for infection prevention precautions. 2020. https://www.who.int/news-room/commentaries/detail/transmission-of-sars-cov-2-implications-for-infection-prevention-precautions. Accessed 26 Aug 2020.
Wu JT, Leung K, Leung GM. Nowcasting and forecasting the potential domestic and international spread of the 2019-nCoV outbreak originating in Wuhan, China: a modelling study [published correction appears in Lancet. 2020 Feb 4]. Lancet. 2020;395(10225):689–97. https://doi.org/10.1016/S0140-6736(20)30260-9.
Horton R. Offline: COVID-19 and the NHS-“a national scandal”. Lancet. 2020;395(10229):1022. https://doi.org/10.1016/S0140-6736(20)30727-3.
Bernard Stoecklin S, Rolland P, Silue Y, et al. First cases of coronavirus disease 2019 (COVID-19) in France: surveillance, investigations and control measures, January 2020. Euro Surveill. 2020;25(6):2000094. https://doi.org/10.2807/1560-7917.ES.2020.25.6.2000094.
Jit M, Jombart T, Nightingale ES, et al. Estimating number of cases and spread of coronavirus disease (COVID-19) using critical care admissions, United Kingdom, February to March 2020. Euro Surveill. 2020;25(18):2000632. https://doi.org/10.2807/1560-7917.ES.2020.25.18.2000632.
Kinross P, Suetens C, Gomes Dias J, Alexakis L, Wijermans A, Colzani E, Monnet DL, ECDC Public Health Emergency Team. Rapidly increasing cumulative incidence of coronavirus disease (COVID-19) in the European Union/European Economic Area and the United Kingdom, 1 January to 15 March 2020. Euro Surveill. 2020;25(11):2000285. https://doi.org/10.2807/1560-7917.ES.2020.25.11.2000285.
Spiteri G, Fielding J, Diercke M, et al. First cases of coronavirus disease 2019 (COVID-19) in the WHO European region, 24 January to 21 February 2020. Euro Surveill. 2020;25(9):2000178. https://doi.org/10.2807/1560-7917.ES.2020.25.9.2000178.
France 24. French lockdown comes into force in bid to curtail spread of deadly virus. 2020. https://www.france24.com/en/20200317-french-lockdown-comes-into-force-in-bid-to-curtail-spread-of-deadly-virus. Accessed 4 Aug 2020.
Chernozhukov V, Kasahara H, Schrimpf P. Causal Impact of Masks, Policies, Behavior on Early Covid-19 Pandemic in the U.S. Posted 13 July 2020. medRxiv 2020.05.27.20115139; https://doi.org/10.1101/2020.05.27.20115139. Accessed 4 Aug 2020.
Institute for Health Metrics and Evaluation. Updated 30 July 2020. COVID-19 Projections. https://covid19.healthdata.org/united-states-of-america. Accessed 4 Aug 2020.
Cousins S. New Zealand eliminates COVID-19. Lancet. 2020;395(10235):1474. https://doi.org/10.1016/S0140-6736(20)31097-7.
Sung H, Yoo CK, Han MG, et al. Preparedness and rapid implementation of external quality assessment helped quickly increase COVID-19 testing capacity in the Republic of Korea. Clin Chem. 2020;66(7):979–81. https://doi.org/10.1093/clinchem/hvaa097.
None to declare
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The author identified three errors in the article body: The typo “SARS-CoV-12,003”, should be written as ‘SARS-CoV-1, 2003’: i. in the 1st page, right-hand column, 2nd paragraph and ii. in the 2nd page, right-hand column, 4th paragraph; In the last paragraph “SARS-CoV-2, 2003” should be written as ‘SARS-CoV-1, 2003’. The typo has been updated above and the original article  has been corrected. The publisher apologizes for the inconvenience caused to the author and readers.
About this article
Cite this article
Tang, J.W. COVID-19: interpreting scientific evidence – uncertainty, confusion and delays. BMC Infect Dis 20, 653 (2020). https://doi.org/10.1186/s12879-020-05387-8