- Research article
- Open Access
- Open Peer Review
Mathematical models used to inform study design or surveillance systems in infectious diseases: a systematic review
BMC Infectious Diseases volume 17, Article number: 775 (2017)
Mathematical models offer the possibility to investigate the infectious disease dynamics over time and may help in informing design of studies. A systematic review was performed in order to determine to what extent mathematical models have been incorporated into the process of planning studies and hence inform study design for infectious diseases transmitted between humans and/or animals.
We searched Ovid Medline and two trial registry platforms (Cochrane, WHO) using search terms related to infection, mathematical model, and study design from the earliest dates to October 2016. Eligible publications and registered trials included mathematical models (compartmental, individual-based, or Markov) which were described and used to inform the design of infectious disease studies. We extracted information about the investigated infection, population, model characteristics, and study design.
We identified 28 unique publications but no registered trials. Focusing on compartmental and individual-based models we found 12 observational/surveillance studies and 11 clinical trials. Infections studied were equally animal and human infectious diseases for the observational/surveillance studies, while all but one between humans for clinical trials. The mathematical models were used to inform, amongst other things, the required sample size (n = 16), the statistical power (n = 9), the frequency at which samples should be taken (n = 6), and from whom (n = 6).
Despite the fact that mathematical models have been advocated to be used at the planning stage of studies or surveillance systems, they are used scarcely. With only one exception, the publications described theoretical studies, hence, not being utilised in real studies.
Infectious diseases contribute substantially to the global burden of disease and are major public health issues worldwide . The value of mathematical models for infectious diseases is widely recognised in various fields such as ecology or epidemiology [2,3,4]. These models have been used with different objectives such as understanding infectious disease dynamics, informing public health policies or guidelines through, for example, the modelling of potential additional interventions , or computing key indicators . In the context of public health surveillance in particular, mathematical models have been also used to detect potential epidemics making use of (temporal) surveillance system data , evaluate the performances of a surveillance system , or monitor programmes .
Mathematical models may also help in informing design of studies, including cross-sectional studies, clinical trials, or surveillance systems, and have been advocated to be used at the planning stage of studies to inform their design [5, 10,11,12,13]. Well-designed clinical trials and observational studies are needed to investigate the impact of interventions before they can be used on large scale. Furthermore, public health authorities also need efficient tools for monitoring infectious diseases. Each improvement in design and monitoring of clinical trials and observational studies will allow a more efficient usage of resources crucial to current and later implementation, monitoring, and evaluation of promising interventions.
The current use of mathematical models in planning studies has to our knowledge never been systematically summarised. The objective of our study was to systematically review mathematical models used to inform the design of a study related to an infectious disease transmitted between humans, between animals, or between animals and humans (zoonosis). We documented to which extent and how mathematical models have been incorporated into the process of planning studies or surveillance systems. Finally, by performing this review, we hope to trigger more attention to the use of mathematical models in planning studies and to more explicitly document design considerations in mathematical modelling studies in abstract and keywords.
We used a protocol to describe the methods in detail for our systematic review (Additional file 1).
We searched for publications and registered trials in which mathematical models were described and used to inform the design of infectious disease studies, i.e. inform study design in the context of sample sizes and/or selecting the (number of) sampling times and/or power calculation and/or from whom to collect samples and/or what should be monitored. We were interested in implemented studies as well as in methodological papers.
We included studies that used individual-based models (IBMs, including agent-based models, microsimulation, etc.), compartmental models, or Markov models [14, 15]. IBMs are models in which the infection process for every individual in the population is tracked; compartmental models are models in which individuals in the population are subdivided into ‘compartments’ and the models track the infection process for these individuals collectively; and Markov models predict how an individual moves from one health state to another over time, assuming that the individual is always in one of a finite number of states and that the transition to the next state depends only on the values of the current state.
We excluded publications and study protocols of registered trials if the mathematical model was not used to design a study, for example, the model was only used for data analysis or only used for investigating the potential impact of new interventions on infectious disease spread.
We searched Ovid Medline, Cochrane Central Register of Controlled Trials, and WHO International Clinical Trials Registry Platform from the earliest date of the database to October 2016 without language restrictions. Search strategies used subject headings specific to each database and free text search that combined terms for: infection, mathematical models, and study designs (see Appendix 1 in Additional file 1 for the detailed search strategies). Reference lists of included publications and study protocols of registered trials were screened to identify additional relevant publications.
Two reviewers (SH, SB) screened titles and abstracts of retrieved publications and description of registered trials in the database. Discrepancies were solved by discussion or by consulting a third reviewer (NH). Any publication or registered trial selected as being potentially eligible was retained for review of the full text; for registered trials we made three attempts to retrieve the study protocol by contacting electronically the principal investigator (listed in the trial registry).
The primary outcomes were the description of the characteristics of the mathematical models incorporated, and the description of the design part considered in the process of planning studies or surveillance systems.
Data collection and analysis
The two reviewers (SH, SB) independently extracted data and discrepancies were solved by discussion or by consulting the third reviewer (NH). An extraction sheet was developed using Microsoft Excel and piloted to extract information about the investigated infection, population, model characteristics, and study design.
The characteristics of mathematical models used in planning studies were summarised stratified by study type, i.e. observational and surveillance studies, and clinical trials. We described the infections and populations studied, the main characteristics of the mathematical model used, the main outcome of the study, and the design outcomes (see Table 1) investigated by the authors. If there were multiple publications using the same model for the same setting to investigate the same study design, the earliest publication was considered to be the original (see further). We also documented model reporting items (e.g. diagram of the model or parameters values) and how the infection transmission was modelled.
Our literature searches identified 571 unique publications/registered trials; 68 full-text publications were screened and 6 principal investigators of registered trials were contacted; 30 eligible publications were included [16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45]. Reasons for exclusion are summarised in Fig. 1. Of these 30 publications, 28 were considered to be unique, i.e. different models were used for different settings and study designs. There were two publications referring to the same randomised controlled trial (RCT) and reporting the same model (Cori 2014  and Hayes 2014 ), and one publication re-stated the results from a previous publication (Wu 2005  and Wu 2002 ).With only one exception (Cori 2014 ), the publications described theoretical studies, hence, not being utilised in real trials.
We focused on the characteristics of the 23 studies which used IBMs or compartmental models to inform the study design because, in the context of infectious diseases, these types of models are most used and allow infectious disease dynamics (e.g. herd immunity) to be directly incorporated. There were 12 observational or surveillance studies [16,17,18,19,20,21,22,23,24,25,26,27] (Table 2, Additional file 2: Table S1) and 11 clinical trials [28,29,30,31,32,33,34,35,36,37,38] (Table 3, Additional file 2: Table S2). The characteristics of the 5 studies which used Markov models [41,42,43,44,45] (all clinical trials for humans) are given in Additional file 2 (Table S3 and Table S4).
Results of the considered 23 studies show that compartmental models were the most commonly used models (8 observational/surveillance studies, 10 clinical trials). Infections studied were equally animal and human infectious diseases for the observational or surveillance studies, while all but one between humans for clinical trials. Epidemiological categories of infections transmitted between humans were sexually transmitted infections (STIs, mainly HIV; 6 clinical trials), respiratory infections (2 observational/surveillance studies, 2 clinical trials), nosocomial infections (2 observational/surveillance studies), vector-borne infections (2 observational/surveillance studies), water-borne infections (1 observational/surveillance study), hypothetical bacterial infection (1 observational/surveillance study). Influenza (avian, n = 4, or in ferrets, n = 1) was the infection the most studied among infections transmitted between animals. A population structure was reflected in 14 models (9 observational/surveillance studies, 5 clinical trials) and a network of contacts between individuals was explicitly modelled in 8 models (5 observational/surveillance studies, 3 clinical trials).
We observed diverse patterns of model reporting across the publications (Additional file 2: Table S1 and Table S2). Almost all publications described - to a certain extent - the model structure, some reported equations, figures, and how the course of infection was implemented, while others reported only one or even none of those. For three publications [17, 23, 28] we had to obtain the model type from the referenced original publication [46,47,48]. About a third of the publications reported the software in which the mathematical model was implemented but code is available, either as a supplementary material or through request to the authors, in only two publications [36, 38]. The sources for the model parameters used were mostly a mixture of calibration, assumptions by authors, and estimations from other data.
In observational or surveillance studies, the design outcome most studied was sample size (n = 10), followed by frequency of sampling and population from whom to sample (n = 5), monitoring and power (n = 2), and number of samples and timing of sampling (n = 2). In clinical trials, the most studied design outcome was power (n = 7), followed by sample size (n = 6), timing of sampling and follow-up (n = 3), monitoring (n = 2), frequency of sampling, number of samples and population from whom to sample (n = 1). Seven research question categories were identified among the studies included: detect infection early, estimate epidemiological parameters, compare different trial arms, include potentially good responders in an RCT, follow trial progression, detect changes in infection values over time, and determine appropriate time point(s) to estimate a parameter. Table 4 shows for each design outcome which research questions were investigated. More details about the study designs can be found in Additional file 2: Table S1 and Table S2.
We found in this systematic review 28 unique publications but no registered trials in which mathematical models were described and used to inform the design of infectious disease studies. Only one mathematical model was effectively used to plan a study (a three-arm cluster RCT) whereas all others described theoretical studies. Focusing on the 23 compartmental and individual-based models, we found almost equal amount of observational or surveillance studies and clinical trials whereby compartmental models were most commonly used. Various infection categories have been investigated with equal numbers of animal and human infections studied among the observational or surveillance studies and mainly human infections among the clinical trials. Enough details are provided for the compartmental models, except for two [17, 22], to replicate the model. For IBMs more details are needed in order to replicate the model if the source code is not available. For example, the ‘ODD’ (Overview, Design concepts, and Details) protocol has been proposed to standardize reporting of individual-based and agent-based models [49, 50]. None of the five IBM publications followed or mentioned this protocol, however, one provides the model source code . The mathematical models were utilised to inform, amongst other things, the following design outcomes: required sample size, statistical power, frequency at which samples should be taken, and from whom.
One explanation of the scarcity of mathematical modelling to design real studies, despite the anticipated gain in study efficiency, is arguably the lack of fundamental research in the sense that there are no existing databases or software to access mathematical models which are already implemented in a study design framework in contrast to classical sample size calculation with freely-available or chargeable software. In our systematic review, only a third of the publications reported the software used for the mathematical model and only two mentioned availability of code. Additionally, it is even difficult to ascertain which mathematical models already exist for a specific infection in order to extend them to the study design framework. Account should be taken of the fact that building a (well-validated) model is time-consuming and modelling expertise specific to the infectious disease of interest is needed. On the other hand, finding the optimal sample size, frequency of sampling, etc. using a mathematical model can lead to computer intense processing steps.
Sample size is not the only design outcome which can be investigated by the mathematical models as shown in our results. Interestingly, mathematical models have been used to determine the appropriate time point(s) at which a parameter such as the effect size of the intervention should be estimated. For example, a publication in the field of vaccination investigated two different estimates of vaccine efficacy (prevalence odds ratio and prevalence ratios) and their change over time. The authors found that the timing of sample collection can affect the interpretation of results about vaccine efficacy against bacterial carriage in an RCT .
We observed that the same research question was investigated looking at different design outcomes. For example, the question about early detection of an infection was studied by exploring the frequency at which samples should be taken, the number of samples to be collected, and the sample size but also from whom samples should be taken, and what parameters or indicators should be monitored during a study [16,17,18,19,20,21,22,23, 26].
There is no guarantee that a study would not fail to show the expected effect size in case the study team used a mathematical model at the planning stage of a study. A mathematical model always implies underlying assumptions by its structure and parameter values. However, those assumptions for mathematical models can be taken into account in uncertainty and sensitivity analyses for the effect size of interest. The estimated effect size and its uncertainty, in turn, can be considered in, for example, sample size calculations. Most importantly, mathematical models can be used to deal with the complexity of infectious diseases like the dependency between individuals and give insights how this can influence the study design.
The strength of our study is that the search of publications and registered trials had no restriction about the type of infection or the transmission route. Additionally, this is, to our knowledge, the first systematic review of the current use of mathematical models in planning infectious disease studies. A weakness of this review is that the literature search might have missed some relevant publications and registered trials because there is neither a single MeSH term for mathematical models nor a general usage of keywords to describe mathematical models, a problem observed also in other systematic reviews [51, 52]. In addition, for some infections, like HIV, only the abbreviation is commonly stated. Hence, no variation of the word ‘infection’ is used in the title, abstract, or especially in the description of the registered trial on the trial registry platform. We tested the inclusion of specific infections (HIV, malaria, and tuberculosis) which resulted in a limited number of additional hits, of which only two would meet our inclusion criteria [53, 54]. We tried to overcome the limitations of keywords and MeSH terms used by building a search strategy which uses different terms to identify models and infections and by searching for additional publications in the reference lists of included publications. However, we do not present mathematical models that are only described in grey literature like reports or that are not publicly available. Similarly, publications that only used indirect modelling results without describing the mathematical model were not included.
Despite the fact that mathematical models have been advocated to be used at the planning stage of studies or surveillance systems [5, 10,11,12,13], they are used scarcely as shown by this systematic review. With only one exception, the publications described theoretical studies, hence, not being utilised in real studies. Generic statistical approaches for sample size calculations, most often assuming independence between individuals, do not capture the complex nature of infectious disease epidemiology. This is an oversimplification as e.g. treating infected persons may affect the people around them by reducing the spreading of the infection; mathematical modelling could thus be used to account for such characteristics. The results of this systematic review offer an overview of the current use of mathematical models in the context of study design and indicate that future research is needed.
Randomised controlled trial
Sexually transmitted infection
World Health Organization. Research for universal health coverage. Geneva, Switzerland: World Health Organization; 2013.
Anderson RM, May RM. Infectious diseases of humans: dynamics and control. Oxford, New York: Oxford University Press; 1991.
Keeling MJ, Rohani P. Modeling infectious diseases in humans and animals. Princeton, NJ: Princeton University Press; 2008.
Heesterbeek H, Anderson RM, Andreasen V, Bansal S, De Angelis D, Dye C, et al. Modeling infectious disease dynamics in the complex landscape of global health. Science. 2015;347:aaa4339. doi: 10.1126/science.aaa4339.
Garnett GP, Cousens S, Hallett TB, Steketee R, Walker N. Mathematical models in the evaluation of health programmes. Lancet. 2011;378:515–25. https://doi.org/10.1016/S0140-6736(10)61505-X.
Hens N, Shkedy Z, Aerts M, Faes C, Van Damme P, Beutels P. Modeling infectious disease parameters based on serological and social contact data: a modern statistical perspective. New York: Springer; 2012.
Mohtashemi M, Szolovits P, Dunyak J, Mandl KD. A susceptible-infected model of early detection of respiratory infection outbreaks on a background of influenza. J Theor Biol. 2006;241:954–63. doi: 10.1016/j.jtbi.2006.01.031.
Buckeridge DL, Burkom H, Moore A, Pavlin J, Cutchis P, Hogan W. Evaluation of syndromic surveillance systems--design of an epidemic simulation model. MMWR supplements. 2004;53:137–43.
Cauchemez S, Boelle PY, Thomas G, Valleron AJ. Estimating in real time the efficacy of measures to control emerging communicable diseases. Am J Epidemiol. 2006;164:591–7.
Boily MC, Masse B, Alsallaq R, Padian NS, Eaton JW, Vesga JF, Hallett TB. HIV treatment as prevention: considerations in the design, conduct, and analysis of cluster randomized controlled trials of combination HIV prevention. PLoS Med. 2012;9:e1001250.
Koopman JS, Jacquez G, Chick SE. New data and tools for integrating discrete and continuous population modeling strategies. Ann N Y Acad Sci. 2001;954:268–94.
Michael E, Malecela-Lazaro MN, Kazura JW. Epidemiological modelling for monitoring and evaluation of lymphatic filariasis control. Adv Parasit. 2007;65:191–237.
Restif O, Hayman DT, Pulliam JR, Plowright RK, George DB, Luis AD, et al. Model-guided fieldwork: practical guidelines for multidisciplinary research on wildlife ecological and epidemiological dynamics. Ecol Lett. 2012;15:1083–94.
Vynnycky E, White R. An introduction to disease modelling. Oxford: Oxford University Press; 2010.
Sonnenberg FA, Gregory P, Yomtovian R, Russell LB, Tierney W, Kosmin M, Carson JL. The cost-effectiveness of autologous transfusion revisited: implications of an increased risk of bacterial infection with allogeneic transfusion. Transfusion. 1999;39:808–17.
Graat EA, de Jong MC, Frankena K, Franken P. Modelling the effect of surveillance programmes on spread of bovine herpesvirus 1 between certified cattle herds. Vet Microbiol. 2001;79:193–208.
Michael E, Malecela-Lazaro MN, Maegga BT, Fischer P, Kazura JW. Mathematical models and lymphatic filariasis control: monitoring and evaluating interventions. Trends Parasitol. 2006;22:529–35.
Savill NJ, St Rose SG, Woolhouse ME. Detection of mortality clusters associated with highly pathogenic avian influenza in poultry: a theoretical analysis. J R Soc Interface. 2008;5:1409–19.
Arnold ME, Irvine RM, Tearne O, Rae D, Cook AJ, Breed AC. Investigation into sampling strategies in response to potential outbreaks of low pathogenicity notifiable avian influenza initiated in commercial duck holdings in great Britain. Epidemiol Infect. 2013;141:751–62.
Smieszek T, Salathe M. A low-cost method to assess the epidemiological importance of individuals in controlling infectious disease outbreaks. BMC Med. 2013;11:35. doi: 10.1186/1741-7015-11-35.
Ciccolini M, Donker T, Grundmann H, Bonten MJ, Woolhouse ME. Efficient surveillance for healthcare-associated infections spreading between hospitals. P Natl Acad Sci USA. 2014;111:2271–6.
Gonzales JL, Boender GJ, Elbers AR, Stegeman JA, de Koeijer AA. Risk based surveillance for early detection of low pathogenic avian influenza outbreaks in layer chickens. Prev Vet Med. 2014;117:251–9.
Leslie E, Cowled B, Graeme Garner M, Toribio JA, Ward MP. Effective surveillance strategies following a potential classical swine fever incursion in a remote wild pig population in North-Western Australia. Transbound Emerg Dis. 2014;61:432–42.
Mizumoto K, Ejima K, Yamamoto T, Nishiura H. On the risk of severe dengue during secondary infection: a systematic review coupled with mathematical modeling. J Vector Dis. 2014;51:153–64.
Pinsent A, Blake IM, White MT, Riley S. Surveillance of low pathogenic novel H7N9 avian influenza in commercial poultry barns: detection of outbreaks and estimation of virus introduction time. BMC Infect Dis. 2014;14:427.
van Bunnik BAD, Ciccolini M, Gibbons CL, Edwards G, Fitzgerald R, McAdam PR, et al. Efficient national surveillance for health-care-associated infections. BMC Public Health. 2015;15:832.
Vinh DN, Boni MF. Statistical identifiability and sample size calculations for serial seroepidemiology. Epidemics. 2015;12:30–9.
Atlas RS, DuPont HL, Overall JE. Computer simulation of alternative sampling strategies to estimate risk of infection from cryptosporidium. Comput Biol Med. 1993;23:283–94.
Lipsitch M. Measuring and interpreting associations between antibiotic use and penicillin resistance in Streptococcus Pneumoniae. Clin Infect Dis. 2001;32:1044–54.
Wu HL, Ding AA. Design of viral dynamic studies for efficiently assessing potency of anti-HIV therapies in AIDS clinical trials. Biom J. 2002;44:175–96. doi: 10.1002/1521-4036(200203)44:2<175::Aid-Bimj175>3.0.Co;2-3.
Clermont G, Bartels J, Kumar R, Constantine G, Vodovotz Y, Chow C. Silico design of clinical trials: a method coming of age. Crit Care Med. 2004;32:2061–70.
Hallett TB, Garnett GP, Mupamberiyi Z, Gregson S. Measuring effectiveness in community randomized trials of HIV prevention. Int J Epidemiol. 2008;37:77–87.
Dimitrov DT, Masse BR, Boily MC. Beating the placebo in HIV prevention efficacy trials: the role of the minimal efficacy bound. J Acq Immun Def Synd. 2013;62:95–101.
Nishiura H, Yen H, Cowling BJ. Sample size considerations for one-to-one animal transmission studies of the influenza a viruses. PLoS One. 2013;8:e55358.
Cori A, Ayles H, Beyers N, Schaap A, Floyd S, Sabapathy K, et al. HPTN 071 (PopART): a cluster-randomized trial of the population impact of an HIV combination prevention intervention including universal testing and treatment: mathematical model. PLoS One. 2014;9:e84511.
Cuadros DF, Abu-Raddad LJ, Awad SF, Garcia-Ramos G. Use of agent-based simulations to design and interpret HIV clinical trials. Comput Biol Med. 2014;50:1–8.
Scott P, Herzog SA, Auranen K, Dagan R, Low N, Egger M, Heijne JCM. Timing of bacterial carriage sampling in vaccine trials: a modelling study. Epidemics. 2014;9:8–17.
Herzog SA, Low N, Berghold A. Sample size considerations using mathematical models: an example with Chlamydia trachomatis infection and its sequelae pelvic inflammatory disease. BMC Infect Dis. 2015;15:233.
Wu HL. Statistical methods for HIV dynamic studies in AIDS clinical trials. Stat Methods Med Res. 2005;14:171–92.
Hayes R, Ayles H, Beyers N, Sabapathy K, Floyd S, Shanaube K, et al. HPTN 071 (PopART): rationale and design of a cluster-randomised trial of the population impact of an HIV combination prevention intervention including universal testing and treatment - a study protocol for a cluster randomised trial. Trials. 2014;15:57.
Chen HH, Prevost TC, Duffy SW. Evaluation of screening for nasopharyngeal carcinoma: trial design using Markov chain models. Brit J Cancer. 1999;79:1894–900.
Longini IM, Hudgens MG, Halloran ME, Sagatelian KA. Markov model for measuring vaccine efficacy for both susceptibility to infection and reduction in infectiousness for prophylactic HIV vaccines. Stat Med. 1999;18:53–68.
Hoad KA, van't Hoog AH, Rosen D, Marston B, Nyabiage L, Williams BG, et al. Modelling local and global effects on the risk of contracting tuberculosis using stochastic Markov-chain models. Math Biosci. 2009;218:98–104.
Tuite AR, Fisman DN. Spectrum bias and loss of statistical power in discordant couple studies of sexually transmitted infections. STD. 2011;38:50–6.
Auranen K, Rinta-Kokko H, Goldblatt D, Nohynek H, O'Brien KL, Satzke C, et al. Design questions for Streptococcus Pneumoniae vaccine trials with a colonisation endpoint. Vaccine. 2014;32:159–64. doi: 10.1016/j.vaccine.2013.06.105.
Chan MS, Srividya A, Norman RA, Pani SP, Ramaiah KD, Vanamail P, et al. Epifil: a dynamic model of infection and disease in lymphatic filariasis. Am J Trop Med Hyg. 1998;59:606–14.
Cowled BD, Garner MG, Negus K, Ward MP. Controlling disease outbreaks in wildlife using limited culling: modelling classical swine fever incursions in wild pigs in Australia. Vet Res. 2012; doi: 10.1186/1297-9716-43-3.
Auranen K, Rinta-Kokko H, Goldblatt D, Nohynek H, O'Brien KL, Satzke C, et al. Colonisation endpoints in Streptococcus Pneumoniae vaccine trials. Vaccine. 2013;32:153–8. doi: 10.1016/j.vaccine.2013.08.061.
Grimm V, Berger U, DeAngelis DL, Polhill JG, Giske J, Railsback SF. The ODD protocol: a review and first update. Ecol Model. 2010;221:2760–8. doi: 10.1016/j.ecolmodel.2010.08.019.
Grimm V, Berger U, Bastiansen F, Eliassen S, Ginot V, Giske J, et al. A standard protocol for describing individual-based and agent-based models. Ecol Model. 2006;198:115–26. doi: 10.1016/j.ecolmodel.2006.04.023.
Willem L, Verelst F, Bilcke J, Hens N, Beutels P. Lessons from a decade of individual-based models for infectious disease transmission: a systematic review (2006-2015). BMC Infect Dis. 2017;17:612. doi: 10.1186/s12879-017-2699-8.
Herzog SA, Heijne JCM, Althaus CL, Low N. Describing the progression from Chlamydia trachomatis and Neisseria gonorrhoeae to pelvic inflammatory disease: systematic review of mathematical modeling studies. Sex Transm Dis. 2012;39:628–37. doi: 10.1097/OLQ.0b013e31825159ff.
Boily MC, Mâsse BR, Desai K, Alary M, Anderson RM. Some important issues in the planning of phase III HIV vaccine efficacy trials. Vaccine. 1999;17:989–1004.
Cohen T, Hedt BL, Pagano M. Estimating the magnitude and direction of bias in tuberculosis drug resistance surveys conducted only in the public sector: a simulation study. BMC Public Health. 2010;10:355. doi: 10.1186/1471-2458-10-355.
Authors SB and NH acknowledge support of the Antwerp Study Centre for Infectious Diseases (ASCID) at the University of Antwerp.
Funding SH: Part of this work has been funded by the Special Research Fund of Hasselt University and by the Mobility Grant of Medical University of Graz. Funding SB, NH: This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement 682,540 — TransMID). NH further acknowledges support of the Chair in Evidence-based Vaccinology at the University of Antwerp financed by a gift from Pfizer (2009–2017) and GSK (2016).
Availability of data and materials
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.