Selected articles from the 16th International Symposium on Bioinformatics Research and Applications (ISBRA-20): infectious diseases
- Research
- Open access
- Published:
Improving dengue fever predictions in Taiwan based on feature selection and random forests
BMC Infectious Diseases volume 24, Article number: 334 (2024)
Abstract
Background
Dengue fever is a well-studied vector-borne disease in tropical and subtropical areas of the world. Several methods for predicting the occurrence of dengue fever in Taiwan have been proposed. However, to the best of our knowledge, no study has investigated the relationship between air quality indices (AQIs) and dengue fever in Taiwan.
Results
This study aimed to develop a dengue fever prediction model in which meteorological factors, a vector index, and AQIs were incorporated into different machine learning algorithms. A total of 805 meteorological records from 2013 to 2015 were collected from government open-source data after preprocessing. In addition to well-known dengue-related factors, we investigated the effects of novel variables, including particulate matter with an aerodynamic diameter < 10 µm (PM10), PM2.5, and an ultraviolet index, for predicting dengue fever occurrence. The collected dataset was randomly divided into an 80% training set and a 20% test set. The experimental results showed that the random forests achieved an area under the receiver operating characteristic curve of 0.9547 for the test set, which was the best compared with the other machine learning algorithms. In addition, the temperature was the most important factor in our variable importance analysis, and it showed a positive effect on dengue fever at < 30 °C but had less of an effect at > 30 °C. The AQIs were not as important as temperature, but one was selected in the process of filtering the variables and showed a certain influence on the final results.
Conclusions
Our study is the first to demonstrate that AQI negatively affects dengue fever occurrence in Taiwan. The proposed prediction model can be used as an early warning system for public health to prevent dengue fever outbreaks.
Background
Dengue fever is caused by the dengue virus, a well-studied arboviral disease worldwide, with more than 50 million new cases reported annually [1]. There are four types of dengue viruses: DENV-1, DENV-2, DENV-3, and DENV-4. All types of viruses can cause severe diseases in humans [2]. Dengue virus transmission is a major issue in tropical and subtropical areas of the world. Because the virus is transmitted by mosquitoes, transmission intensity is limited by changes in weather and climate, such as rainfall, humidity, and temperature [3]. Aedes aegypti is one of the most important vectors of chikungunya, dengue, and Zika viruses. Over the past few decades, the incidence of dengue fever has continued to increase [4]. Dengue fever is primarily observed in tropical regions. The first local European dengue fever cases reported in France and Croatia occurred in 2010 [5]. Bhatt et al. estimated that there are 390 million dengue infections per year in the tropics, of which 96 million appear to be significant [6]. Another study also demonstrated evidence of dengue in 128 countries, with an estimated 3.97 billion population at risk [7].
History of dengue fever outbreaks in Taiwan
In the last century (i.e., 1901, 1915, 1931, 1942–1943, 1981, 1991, 1994, 1995, and 1998), several severe dengue fever outbreaks occurred in Taiwan. Among these records, 1915, 1931, and 1942–1943 outbreaks affected the entire island [4]. In general, dengue fever is not considered a local epidemic in Taiwan, but originates in neighboring countries in Southeast Asia and is brought to Taiwan through close commercial and travel activities. Each outbreak was different, and various strains were determined to be related to those imported from Vietnam, Thailand, Indonesia, and Cambodia [1].
Between 2010 and 2015, severe outbreaks of dengue fever occurred three times in Taiwan. The first epidemic occurred in Penghu County in 2010, with a prevalence of 101 per 100,000 people. The second was in Kaohsiung City in 2014, with a prevalence rate of 540 per 100,000 population. A recent outbreak occurred in 2015 in Tainan City with a prevalence rate of 1208 per 100,000 population. The national prevalence rate in 2010 was 8 per 100,000 people (i.e., 1,888 cases), which increased to 187 per 100,000 people in 2015 (i.e., 43,832 cases). Furthermore, the prevalence rate in people aged over 50 years is higher than that in other groups [8, 9]. Currently, dengue fever outbreaks occur mainly in southern Taiwan, where Ae. aegypti and Ae. albopictus coexist, but rarely in the northern or central regions, where only Ae. albopictus exists. Local outbreaks are most frequent in summer and fall, less frequent in winter, and caused by a single dengue fever virus strain that disappears when the outbreak ends [10].
Literature review of dengue fever prediction
Several methods have been proposed to analyze dengue fever. In Sakon Nakhon Province, Thailand, the incidence of dengue virus infection (DVI) is related to meteorological factors and socioeconomic covariates based on a generalized linear model. The monthly minimum temperature had a positive effect, but the 2-month cumulative rainfall had a negative effect on the DVI [11]. In Singapore, the Ae. aegypti breeding percentage was positively correlated with annual case counts by Spearman’s correlation coefficient across 11 years, which ranged between 0.547 and 0.737 [12]. A previous study found no relationship between air pollution index (API) levels and dengue cases in all five study zones in Selangor, Malaysia [13]. In Greater São Paulo, Brazil, statistical associations of particulate matter with an aerodynamic diameter of < 10 µm (PM10) and moisture were found in reported dengue fever cases. This study showed that PM10 had a negative effect on dengue fever [14].
Furthermore, the lag effect of variables is a key factor influencing dengue fever occurrence and has been incorporated in several studies. Chen et al. found that several monthly meteorological factors with lag periods of 0–4 months were positively associated with dengue fever cases in Kaohsiung, Taiwan using Spearman’s coefficient [15]. Wu et al. used the autoregressive integrated moving average (ARIMA) model to analyze the incidence of dengue fever and found that temperature and relative humidity with a lag effect of 2 months had significant effects on the incidence of dengue fever in Kaohsiung [16]. Chuang et al. analyzed weekly dengue incidence rates in a distributed lag non-linear model, which can simultaneously handle the lag effects of factors and non-linear relationships. Minimum temperature and precipitation were non-linear. The incidence rate increased when the temperature was either lower than 17 °C or higher than 23 °C. Moderate to heavy rainfall had a stronger effect than low to moderate or heavy rainfall. This might increase the risk of transmission at a lag of 10 or 20 weeks [17]. Phung et al. used generalized linear distributed lag models to analyze dengue cases and meteorological data of the Mekong Delta region (MDR) from 2003 to 2013, and found that the northeast MDR was a high-risk cluster. A 1 °C increase in temperature at lags of 1–4, 5–8, and 9–12 weeks increases the risk of dengue by 11, 7, and 5%, respectively. However, a 1% rise in humidity and a 1-mm increase in rainfall increased the risk by less than 1% [18]. Johansson et al. used Poisson regression and distributed lag models to analyze monthly dengue incidences. The temperature at lag periods of 0, 1, and 2 months and precipitation at lag periods of 1 and 2 months were positively associated with variances in monthly dengue incidence [3].
In addition to statistical methods, machine learning is a computer method that focuses on learning by experience from data [19]. Machine learning algorithms combine statistics and make predictions in a dataset by finding patterns [20]. Recently, the use of machine learning algorithms to make reliable predictions from datasets has become increasingly common [21]. Guo et al. utilized six machine-learning algorithms to predict the weekly incidence of dengue fever using data from 2011 to 2014 in Guangdong, China. The results showed that the support vector regression model was the best prediction model with the smallest prediction error rates for tracking the status and predicting outbreaks of dengue fever in other areas [22]. Carvajal et al. incorporated four models to predict dengue incidence with meteorological factors, and found that random forests with lagged meteorological factors were the best prediction models based on the minimum root mean square error and mean absolute error [23]. In Selangor, Malaysia, Salim et al. used machine learning techniques, including decision trees, artificial neural networks, support vector machines (SVM), and naïve Bayes, to predict dengue outbreaks. They incorporated climate variables, such as temperature, wind speed, humidity, and rainfall, into each model. The results showed that the SVM with a linear kernel had the best performance based on a test set with the highest prediction accuracy of 70% [24]. Compared to regression and ARIMA, Benedum et al. used dengue surveillance, population, temporal, and weather data to build models based on random forests, regression, and ARIMA to predict dengue fever counts and outbreaks in three geographic locations. They concluded that the random forests outperformed the other algorithms, with 21% and 33% fewer errors than Poisson regression and ARIMA, respectively [25].
Specific aims of this study
Our study aimed to build a prediction model with lag times of 0–10 days, which included meteorological factors, a vector index, and air quality indices (AQIs), to predict dengue fever occurrences. Furthermore, the importance of the variables and predictors of dengue fever were analyzed. We chose the best prediction model for classification by comparing three machine learning algorithms to predict cases of dengue fever. AQIs, including PM10 and PM2.5, are reported to be important features of environmental air pollution. However, the relationship between AQIs and dengue fever remains unknown and has rarely been studied. Furthermore, the ultraviolet (UV) index is an important factor. These environmental factors were incorporated into our method to further determine their relationship with dengue fever.
Methods
Data source
This study attempted to identify the factors affecting the occurrence of dengue fever. From October 18, 2013, to December 31, 2015, 805 observations (days) with 57,724 infected cases were collected from open-source data from several official websites in Taiwan. Dengue cases and the vector index were collected from the Centers for Disease Control, meteorological data were obtained from the Central Weather Bureau, and the AQIs were downloaded from the Environmental Protection Administration. These datasets are publicly available and can be downloaded freely (as shown in Table 1). Meteorological variables are used to analyze and predict dengue fever cases or incidence in many countries [3, 18, 26,27,28,29]. Variable-related vectors were used in previous studies [12, 30]. In previous studies, variables related to AQIs were considered when analyzing their associations with dengue fever in other countries [13, 14]. This is the first study to incorporate Taiwan’s AQIs to identify their associations with dengue fever. In addition, to consider lag effects, 121 variables ( 11 features × and 11 lagged days) were included in our models. The main study areas included Tainan City and Kaohsiung City in southern Taiwan, which have a tropical climate. At the end of 2015, 1.7 million households and 4.7 million people lived in these areas. We chose these two cities as our study objects because 98% of all indigenous cases in Taiwan occurred in Kaohsiung and Tainan in 2015. More than half of the local dengue fever cases were recorded in Tainan City.
Statistical analyses
SAS 9.4 (SAS Institute, Cary, NC, USA) was used to analyze baseline characteristics, and RStudio ver. The 1.2.5001 software (2009–2019 RStudio) was used to construct the prediction model. Means and standard deviations (SDs) were reported for continuous variables and compared using Student’s t-test to examine whether there were significant differences in the occurrence of dengue fever. For model comparison, we used the area under the receiver operating characteristic curve (AUC) as an evaluation measure to select the best prediction model.
Machine learning algorithms
Logistic regression analyzes the relationships between a categorical variable, which is either dichotomous or multinomial, and multiple dependent variables. The regression output directly generates an effect estimate and a p-value [31, 32]. In 2001, Breiman proposed random forests [33], which used a bagging ensemble method to randomly create several independent and unpruned trees from a dataset. The forest generalization error converges to a limit when the number of trees generated in the model becomes larger [34]. The package, “randomForest” was developed by Breiman and Culter and is available in the R environment. XGBoost is an algorithm based on the gradient boosting decision tree [35] proposed by Chen and Guestrin. Using an additive training strategy, it combines all predictions of a group of weak learners to build a strong classifier [36]. In our study, we used the “xgboost” package in the R environment.
Evaluation metrics
The AUC, accuracy, sensitivity, and specificity are the four measures used to evaluate prediction performance. These are defined in Eqs. (1, 2 and 3):
Here, TP, TN, FP, and FN denote the true positives, true negatives, false positives, and false negatives, respectively.
The receiver operating characteristic (ROC) curve plot shows tradeoffs between sensitivities and specificities, in which the y-axis represents sensitivity and the x-axis denotes [1—specificity]. Models with higher sensitivity and specificity generated curves close to the upper-left corner of the ROC plot. The AUC has been used in medical research since the 1970s and is considered a standard indicator for evaluating the performance of predictive models. Previous research suggested that AUC is a better measure for comparing the performance of classifiers [37]. It summarizes a model's performance and avoids the threshold selected by the supposed subjectivity by converting a continuous probability into a binary positive–negative variable [38].
System architecture
The original dataset was divided into training and test sets for the development of the prediction model and validation of the predictive performance. We used three algorithms, logistic regression, random forests, and XGBoost, to build a prediction model for the occurrence of dengue fever and compared them using the AUC of the test set. Finally, we interpreted the effects of each variable on dengue fever occurrence. The workflow is illustrated in Fig. 1.
Results
Descriptive statistical analysis of dengue fever outbreaks
A total of 805 samples were collected, and 65.96% of the records had dengue fever. We used Student’s t-test for evaluation, and the means of all variables showed significant differences (as shown in Table 2) between the occurrence or non-occurrence of dengue fever. The results showed that meteorological variables and the vector index had statistically significant differences between occurrence and nonoccurrence. In AQIs (PM10 and PM2.5), the mean concentration of occurrence was significantly lower than that of non-occurrence.
Prediction of dengue fever occurrences using machine learning algorithms and lag effects
To predict dengue fever, a random forest algorithm was first incorporated to choose the best feature set with the lowest prediction error in the feature selection. The original dataset was randomly divided into two parts: 80% as a training set with 636 observations and 20% as a test set with 159 observations. In the random forest package, the “rfcv” function was used to optimize the prediction model by examining errors under different combinations of variables. There were 121 variables (11 features × and 11 lag days) in the models. We found that the minimum error occurred for 60 variables (indicated by the dashed line in Fig. 2).
The top 60 variables generated the lowest error compared to using all variables, and the model trained on 60 variables performed slightly better than the original model using all variables in terms of both accuracy and AUC (Table 3). The new model had a higher AUC and accuracy based on fewer variables than the original model. We chose the model with the top 60 variables for comparison with other machine learning algorithms.
Principal component analysis (PCA) is a well-known approach for feature extraction. Kaiser criterion and scree plot were used to determine the number of components in the PCA. The Kaiser criterion drops all components with an eigenvalue < 1 [39]. The scree plot shows the top 25 components with eigenvalues > 1 (Figure S1 in Additional File 1). The top 25, 60, and all components were incorporated into the prediction model based on the random forests. The prediction model with 25 components achieved the highest AUC of 0.9512 among the three models (Table S1 in Additional File 1); however, it was lower than that of the model with the top 60 variables.
For the performance comparison based on 60 selected variables, as shown in Fig. 3, the random forests outperformed the other algorithms in terms of accuracy, specificity, and AUC, except that XGBoost also performed well in terms of sensitivity. For the test set, the random forests achieved an AUC of 0.9547, compared with 0.9329 for XGBoost and 0.7905 for logistic regression. Therefore, we chose random forest as the best prediction model.
Effects of variables on dengue fever outbreaks
The selected variables were ranked according to the mean decrease in accuracy (MDA) estimated using our model. The MDA is an index generated by observing out-of-bag errors for a given variable. The MDA index of each variable was averaged for comparison with the others, as shown on the x-axis in Fig. 4. The results showed that temperature was the most important factor, and UV was the second-most important variable compared to the others. This suggests that these two variables could be considered critical factors in the occurrence of dengue fever.
Figure 5 depicts the relationship between dengue fever occurrence and the predictors. The variables are labeled on the x-axis, and changes in the marginal effects of dengue fever occurrences are illustrated on the y-axis. The marginal effects generated by the “partial” function in the “pdp” package were averaged in the plots. Changes in the marginal effects of temperature showed a non-linear relationship, with a peak near 30 °C (Fig. 5a). Below 30 °C, the temperature has a positive effect on dengue fever occurrence. Although higher temperatures increased the probability of occurrence, an overheated environment above 30 °C decreased the occurrence. According to the World Health Organization classification, the UV index is categorized into five levels:1 and 2, low; 3–5, moderate; 6 and 7, high; 8–10, very high; and 11 + : extreme [40]. In Fig. 5b, the peak of the UV index was near 5, indicating that the marginal effect of UV increased slightly before the moderate level and began to fall afterwards. Relative humidity (RH) had a positive effect and peaked at approximately 78% (Fig. 5c). As shown in Fig. 5d, the marginal effect of PM10 was negative on the probability of occurrence. The figure shows that higher PM10 levels lead to a lower probability of dengue occurrence.
Discussion
Our research attempted to select the best model to predict dengue fever outbreaks and investigate the relationships between predictors and dengue fever. From our experimental results, the random forests outperformed the other two algorithms in terms of AUC for predicting dengue fever outbreaks (Fig. 3, Table S2 in Additional File 1). The temperature was the most important factor influencing the occurrence of dengue fever.
In previous studies, dengue fever cases or incidence rates were used as target variables for the estimation. A time series model and generalized additive model have been used to explain predictors of dengue cases or incidence rates [16, 18, 24, 28, 41]. Compared to those studies, the random forest algorithm not only accurately predicted the occurrence of dengue fever but also provided a partial dependence plot to depict the relationships between predictors and dengue fever. The importance of a variable is generated by observing the out-of-bag error for that specific variable as other variables remain [33]. Biomedical interpretations of predictors from our results correspond well with the domain knowledge.
AUC is a good indicator for measuring the performance of prediction models. Based on our results, random forests achieved the highest AUC of 0.9547. Ghosh et al.. used logistic regression to predict the occurrence of dengue in Kharaghur, India. Their results showed that the AUC values for the training and testing data were 0.854 and 0.858, respectively [42]. Adde et al. used logistic binomial regression to predict outbreaks over the period 1991–2013 in French Guiana using climate indicators, and their best result was an AUC of 0.88 [43]. Additionally, in some previous studies, models were built to predict the epidemic years. Descloux et al. used an SVM explicative model to predict outbreak years in Noumea, New Caledonia, with an AUC of 0.8 [44]. Hii et al. used Singaporean weekly data at lag times of up to 20 weeks to develop a time-series Poisson multivariate regression to detect outbreaks (when the weekly clinical cases exceeded the epidemic threshold) in 2004–2010 and 2011. Their results showed AUCs of 0.96 in 2004–2010 and 0.98 in 2011 [45]. Compared with other studies, the prediction model based on random forests achieved a higher AUC.
Random forest achieved the highest accuracy of 89.94% in our experimental results. Nejad et al.. used five algorithms to construct prediction models for dengue outbreaks from 2010 to 2013. Their results showed that the Bayes network model with mean and maximum temperature, mean relative humidity, and TempeRain factor (TRF, which consists of the average of minimum temperature five weeks plus a current week and cumulative rainfall for two weeks before the current week) achieved the best accuracy of 92.35% [46]. Anno et al. used deep learning based on AlexNet to predict dengue fever outbreaks using a dataset of longitudinal-time sea surface temperature via eightfold cross-validation and yielded an accuracy of 100% [27]. Moreover, the highest sensitivity and specificity in our study were 0.9688 and 0.7302, respectively. Althouse et al. used the Singapore dataset to develop a prediction model for periods with high dengue incidence, and the results showed that the sensitivity and specificity were 0.861 and 0.765, respectively [47]. Compared with the above study, our results showed higher sensitivity but lower specificity. This result is similar to that of their study, although the outcome of interest was slight.
Temperature plays a key role in the life cycle and growth period of viruses in mosquitoes [48]. Temperature showed a non-linear relationship with and a positive effect on dengue fever occurrence, indicating that higher temperatures increased the probability of occurrence before 30 °C, which began to decrease afterwards. Colon-Gonzalez et al. also reported that the effect of temperature has a highly non-linear relationship with dengue incidence in their generalized additive model [28]. This demonstrates that the effect of temperature on the incidence of dengue fever is not constant. Under different conditions, the effect of temperature on dengue incidence did not increase or decrease linearly. Yang et al. also reported that female mosquitoes survive in a temperature range of 15–30 °C and they bite more to raise mosquito offspring [49]. Furthermore, the number of offspring peaks near 30 °C, which might be a risk for dengue outbreaks [50]. The number of mosquitoes is associated with temperature, and the probability of dengue is higher at optimal temperatures for mosquitoes.
In our study, UV had a negative effect on dengue fever outbreaks when the UV intensity exceeded a moderate level. Villena et al. found that the metabolic rate of Ae. albopictus was higher after exposure to full sun conditions on days 8 and 15 compared to the non-UV condition. This shows that UVB radiation is harmful to the larval survival of Ae. albopictus, owing to adverse effects on their cells [51]. Compared to Ae. aegypti, Ae. albopictus is unlikely to spread the dengue fever virus on a large scale in most situations, but speculating on its presence is easier and less threatening to the public [49]. UV radiation has a limited effect on reducing the spread of the virus, but a higher intensity has a certain effect.
Regarding the particulate matter, PM2.5 and PM10 are two important AQI measures widely used worldwide. Thiruchelvam et al. found no relationship between the air pollution index and dengue fever cases in five zones in Selangor, Malaysia, based on the ARIMA model [13]. Based on our research, PM2.5 and the related lag effect variables were removed in the process of optimizing our model. PM10 appeared to reduce the occurrence of disease in our study. PM10 was negatively correlated with dengue fever in a previous study. Although air pollution has not been confirmed in other studies, it has shown obvious influences on the life cycle of Ae. aegypti mosquito [14]. In our experimental results, the relationship between the larval index and PM10 was significantly negative (Tables S3, S4, and Figure S2 in Additional File 1). The AQI is not as important as temperature, but it was selected in the process of filtering the variables and had a certain influence on the final results (Tables S5 and S6 in Additional File 1).
The lifespan of mosquitoes and virus transmission is influenced by RH [26]. Phung et al. reported that the RH with lag times of 1 ~ 4 and 5–8 weeks in the range of 83.5 ~ 86 had a larger effect on the risk of dengue fever through a categorical distributed lag model in Vietnam [18]. In our results, an RH of approximately 77% had the greatest effect on the probability of dengue occurrence. In general, a higher RH resulted in a higher probability. The trend was similar, although the peaks were different. In Yangon, the largest city in Myanmar, Thu et al. reported that the rainy season (with temperatures of 23–30 °C and RH of 90%) is the peak period of survival of Ae. aegypti mosquitoes. High virus transmission and longer mosquito life are beneficial conditions for outbreaks [52]. According to our results, the plum rainy season in Taiwan, when temperatures and RHs are similar to those in Yangon, might be a key prevention period.
A limitation of our research is that we did not account for the effect of El Niño Southern Oscillation (ENSO). Many studies [17, 23, 26, 48, 53] have determined that ENSO is an important factor influencing climate and dengue transmission. Furthermore, transportation, clustering effect of population density, urbanization, and geography are factors affecting virus transmission, but these data are difficult to quantify accurately. These factors can be included in future prediction models. In addition, our study included 805 records from October 2013 to December 2015. In the process of collecting data, some information might not have been released or may have been missing. In the future, the completeness of the public data can be analyzed to improve our research. Furthermore, in the available public dataset, no information about the serotypes of the dengue virus was provided. The relationship between serotype and occurrence was not investigated in our study, owing to the limitations of our dataset.
Conclusions
Prediction models built for dengue fever cases and incidence rates use statistics and machine learning models. Our study attempted to predict the occurrence of dengue fever because predictions can be used for epidemic prevention. We considered the lag times of the meteorological, vector, and AQI variables to build prediction models using machine learning tools for the probability of occurrence. In a comparison of the studies, the lag time was shorter, but the warning was immediate. Our study can also be used to predict dengue fever within a few days.
Availability of data and materials
The complete dataset used for this study is available as a supplementary material file.
Abbreviations
- AQI:
-
Air quality index
- ARIMA:
-
Autoregressive Integrated Moving Average
- AUC:
-
Area under the curve
- DVI:
-
Dengue virus infection
- ENSO:
-
El Niño southern oscillation
- FN:
-
False negative
- FP:
-
False positive
- MDA:
-
Mean decrease in accuracy
- MDR:
-
Mekong Delta region
- PCA:
-
Principal component analysis
- ROC:
-
Receiver operating characteristics
- TN:
-
True negative
- TP:
-
True positive
- UV:
-
Ultraviolet
- XGBoost:
-
Extreme Gradient Boosting
References
Chang SF, Huang JH, Shu PY. Characteristics of dengue epidemics in Taiwan. J Formos Med Assoc. 2012;111(6):297–9.
Kularatne SA. Dengue fever. BMJ. 2015;351:h4661.
Johansson MA, Dominici F, Glass GE. Local and global effects of climate on dengue transmission in Puerto Rico. PLoS Negl Trop Dis. 2009;3(2):e382.
Scavuzzo JM, Trucco F, Espinosa M, Tauro CB, Abril M, Scavuzzo CM, Frery AC. Modeling Dengue vector population using remotely sensed data and machine learning. Acta Trop. 2018;185:167–75.
Tjaden NB, Thomas SM, Fischer D, Beierkuhnlein C. Extrinsic incubation period of dengue: knowledge, backlog, and applications of temperature dependence. PLoS Negl Trop Dis. 2013;7(6):e2207.
Bhatt S, Gething PW, Brady OJ, Messina JP, Farlow AW, Moyes CL, Drake JM, Brownstein JS, Hoen AG, Sankoh O, et al. The global distribution and burden of dengue. Nature. 2013;496(7446):504–7.
Brady OJ, Gething PW, Bhatt S, Messina JP, Brownstein JS, Hoen AG, Moyes CL, Farlow AW, Scott TW, Hay SI. Refining the global spatial limits of dengue virus transmission by evidence-based consensus. PLoS Negl Trop Dis. 2012;6(8):e1760.
Hsu JC, Hsieh CL, Lu CY. Trend and geographic analysis of the prevalence of dengue in Taiwan, 2010–2015. Int J Infect Dis. 2017;54:43–9.
Yeh CY, Chen PL, Chuang KT, Shu YC, Chien YW, Perng GC, Ko WC, Ko NY. Symptoms associated with adverse dengue fever prognoses at the time of reporting in the 2015 dengue outbreak in Taiwan. PLoS Negl Trop Dis. 2017;11(12):e0006091.
Shu PY, Chien LJ, Chang SF, Su CL, Kuo YC, Liao TL, Ho MS, Lin TH, Huang JH. Fever screening at airports and imported dengue. Emerg Infect Dis. 2005;11(3):460–2.
Sriprom M, Chalvet-Monfray K, Chaimane T, Vongsawat K, Bicout DJ. Monthly district level risk of dengue occurrences in Sakon Nakhon Province. Thailand Sci Total Environ. 2010;408(22):5521–8.
Ong J, Liu X, Rajarethinam J, Yap G, Ho D, Ng LC. A novel entomological index, Aedes aegypti Breeding Percentage, reveals the geographical spread of the dengue vector in Singapore and serves as a spatial risk indicator for dengue. Parasit Vectors. 2019;12(1):17.
Thiruchelvam L, Dass SC, Zaki R, Yahya A, Asirvadam VS. Correlation analysis of air pollutant index levels and dengue cases across five different zones in Selangor, Malaysia. Geospat Health. 2018;13(1):613.
Carneiro MAF, Alves B, Gehrke FS, Domingues JN, Sa N, Paixao S, Figueiredo J, Ferreira A, Almeida C, Machi A, et al. Environmental factors can influence dengue reported cases. Rev Assoc Med Bras (1992). 2017;63(11):957–61.
Chen SC, Liao CM, Chio CP, Chou HH, You SH, Cheng YH. Lagged temperature effect with mosquito transmission potential explains dengue variability in southern Taiwan: insights from a statistical analysis. Sci Total Environ. 2010;408(19):4069–75.
Wu PC, Guo HR, Lung SC, Lin CY, Su HJ. Weather as an effective predictor for occurrence of dengue fever in Taiwan. Acta Trop. 2007;103(1):50–7.
Chuang TW, Chaves LF, Chen PJ. Effects of local and regional climatic fluctuations on dengue outbreaks in southern Taiwan. PLoS One. 2017;12(6):e0178698.
Phung D, Talukder MR, Rutherford S, Chu C. A climate-based prediction model in the high-risk clusters of the Mekong Delta region, Vietnam: towards improving dengue prevention and control. Trop Med Int Health. 2016;21(10):1324–33.
Deo RC. Machine Learning in Medicine. Circulation. 2015;132(20):1920–30.
Curchoe CL, Bormann CL. Artificial intelligence and machine learning for human reproduction and embryology presented at ASRM and ESHRE 2018. J Assist Reprod Genet. 2019;36(4):591–600.
Weber A, Darmstadt GL, Gruber S, Foeller ME, Carmichael SL, Stevenson DK, Shaw GM. Application of machine-learning to predict early spontaneous preterm birth among nulliparous non-Hispanic black and white women. Ann Epidemiol. 2018;28(11):783-789.e781.
Guo P, Liu T, Zhang Q, Wang L, Xiao J, Zhang Q, Luo G, Li Z, He J, Zhang Y, et al. Developing a dengue forecast model using machine learning: a case study in China. PLoS Negl Trop Dis. 2017;11(10):e0005973.
Carvajal TM, Viacrusis KM, Hernandez LFT, Ho HT, Amalin DM, Watanabe K. Machine learning methods reveal the temporal pattern of dengue incidence using meteorological factors in metropolitan Manila, Philippines. BMC Infect Dis. 2018;18(1):183.
Salim NAM, Wah YB, Reeves C, Smith M, Yaacob WFW, Mudin RN, Dapari R, Sapri NNFF, Haque U. Prediction of dengue outbreak in Selangor Malaysia using machine learning techniques. Sci Rep. 2021;11(1):939.
Benedum CM, Shea KM, Jenkins HE, Kim LY, Markuzon N. Weekly dengue forecasts in Iquitos, Peru; San Juan, Puerto Rico; and Singapore. Plos Neglect Trop D. 2020;14(10):e0008710.
Ramachandran VG, Roy P, Das S, Mogha NS, Bansal AK. Empirical model for estimating dengue incidence using temperature, rainfall, and relative humidity: a 19-year retrospective analysis in East Delhi. Epidemiol Health. 2016;38:e2016052.
Anno S, Hara T, Kai H, Lee MA, Chang Y, Oyoshi K, Mizukami Y, Tadono T. Spatiotemporal dengue fever hotspots associated with climatic factors in Taiwan including outbreak predictions based on machine-learning. Geospatial Health. 2019;14(2). https://doi.org/10.4081/gh.2019.771.
Colon-Gonzalez FJ, Fezzi C, Lake IR, Hunter PR. The effects of weather and climate change on dengue. PLoS Negl Trop Dis. 2013;7(11):e2503.
Xu HY, Fu X, Lee LK, Ma S, Goh KT, Wong J, Habibullah MS, Lee GK, Lim TK, Tambyah PA, et al. Statistical modeling reveals the effect of absolute humidity on dengue in Singapore. PLoS Negl Trop Dis. 2014;8(5):e2805.
Liu K, Hou X, Wang Y, Sun J, Xiao J, Li R, Lu L, Xu L, Sang S, Hu J, et al. The driver of dengue fever incidence in two high-risk areas of China: A comparative study. Sci Rep. 2019;9(1):19510.
Pandis N. Logistic regression: part 1. Am J Orthod Dentofacial Orthop. 2017;151(4):824–5.
Park HA. An introduction to logistic regression: from basic concepts to interpretation with particular attention to nursing domain. J Korean Acad Nurs. 2013;43(2):154–64.
Liaw A, Wiener M. Classification and Regression by RandomForest. R News. 2002;2(3):18–22.
Breiman L. Random forests. Mach Learn. 2001;45(1):5–32.
Zheng H, Yuan J, Chen L. Short-term load forecasting using EMD-LSTM Neural Networks with a Xgboost algorithm for feature importance evaluation. Energies. 2017;10(8):1168.
Fan J, Wang X, Wu L, Zhou H, Zhang F, Yu X, Lu X, Xiang Y. Comparison of support vector machine and extreme gradient boosting for predicting daily global solar radiation using temperature and precipitation in humid subtropical climates: a case study in China. Energy Convers Manage. 2018;164:102–11.
Jin H, Ling CX. Using AUC and accuracy in evaluating learning algorithms. IEEE Trans Knowl Data Eng. 2005;17(3):299–310.
Lobo JM, Jiménez-Valverde A, Real R. AUC: a misleading measure of the performance of predictive distribution models. Glob Ecol Biogeogr. 2008;17(2):145–51.
Kaiser HF. The application of electronic computers to factor analysis. Educ Psychol Meas. 1960;20:141–51.
Blumthaler M. UV Monitoring for Public Health. Int J Environ Res Public Health. 2018;15(8):1723.
Stolerman LM, Maia PD, Kutz JN. Forecasting dengue fever in Brazil: an assessment of climate conditions. PLoS One. 2019;14(8):e0220106.
Ghosh S, Dinda S, Das Chatterjee N, Das K, Mahata R. The spatial clustering of dengue disease and risk susceptibility mapping: an approach towards sustainable health management in Kharagpur city, India. Spatial Inform Res. 2018;27(2):187–204.
Adde A, Roucou P, Mangeas M, Ardillon V, Desenclos JC, Rousset D, Girod R, Briolant S, Quenel P, Flamand C. Predicting dengue fever outbreaks in French Guiana using climate indicators. PLoS Negl Trop Dis. 2016;10(4):e0004681.
Descloux E, Mangeas M, Menkes CE, Lengaigne M, Leroy A, Tehei T, Guillaumot L, Teurlai M, Gourinat AC, Benzler J, et al. Climate-based models for understanding and forecasting dengue epidemics. PLoS Negl Trop Dis. 2012;6(2):e1470.
Hii YL, Zhu H, Ng N, Ng LC, Rocklov J. Forecast of dengue incidence using temperature and rainfall. PLoS Negl Trop Dis. 2012;6(11):e1908.
YavariNejad F, Varathan KD. Identification of significant climatic risk factors and machine learning models in dengue outbreak prediction. BMC Med Inform Decis Mak. 2021;21(1):141.
Althouse BM, Ng YY, Cummings DA. Prediction of dengue incidence using search query surveillance. PLoS Negl Trop Dis. 2011;5(8):e1258.
Ebi KL, Nealon J. Dengue in a changing climate. Environ Res. 2016;151:115–23.
Yang HM, Macoris ML, Galvani KC, Andrighetti MT, Wanderley DM. Assessing the effects of temperature on dengue transmission. Epidemiol Infect. 2009;137(8):1179–87.
Yang HM, Macoris ML, Galvani KC, Andrighetti MT, Wanderley DM. Assessing the effects of temperature on the population of Aedes aegypti, the vector of dengue. Epidemiol Infect. 2009;137(8):1188–202.
Villena OC, Momen B, Sullivan J, Leisnham PT. Effects of ultraviolet radiation on metabolic rate and fitness of Aedes albopictus and Culex pipiens mosquitoes. PeerJ. 2018;6:e6133.
Thu HM, Aye KM, Thein S. The effect of temperature and humidity on dengue virus propagation in Aedes aegypti mosquitos. Southeast Asian J Trop Med Public Health. 1998;29(2):280–4.
Lowe R, Gasparrini A, Van Meerbeeck CJ, Lippi CA, Mahon R, Trotman AR, Rollock L, Hinds AQJ, Ryan SJ, Stewart-Ibarra AM. Nonlinear and delayed impacts of climate on dengue risk in Barbados: a modelling study. PLoS Med. 2018;15(7):e1002613.
Acknowledgements
Not applicable.
About this supplement
This article has been published as part of BMC Infectious Diseases Volume 24 Supplement 2, 2024: Selected articles from the 16th International Symposium on Bioinformatics Research and Applications (ISBRA-20): infectious diseases. The full contents of the supplement are available online at https://bmcinfectdis.biomedcentral.com/articles/supplements/volume-24-supplement-2.
Funding
The research was supported partly by National Taipei University of Nursing and Health Sciences in Taiwan under grant 107EH12-504 and 113K200-03 to Chao-Yang Kuo. The research was supported in part by the Ministry of Science and Technology (MOST) in Taiwan under grant MOST109–2221-E-038–018, MOST110–2628-E-038–001 and MOST111–2628-E-038–001-MY2 to Emily Chia-Yu Su. This work was also financially supported of the Higher Education Sprout Project by the Ministry of Education (MOE) in Taiwan under grant DP2-111–21121-01-A-05 to Emily Chia-Yu Su.
Author information
Authors and Affiliations
Contributions
CYK and ECYS conceived the study. CYK designed the experiments. WWY collected the data. CYK and WWY performed data cleaning and preprocessing. CYK and ECYS analyzed and interpreted the statistical results. CYK wrote the manuscript under supervision of ECYS. All authors approved the final version of the manuscript and agreed to be personally accountable for each author’s own contribution.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1: Table S1.
Prediction performance of the random forest model with feature reduction based on a principal component analysis in different dataset partitions. Table S2. Comparison of predictive performance of model based on random forest, logistic regression, and XGBoost by three different split methods. Table S3. Pearson’s correlation coefficients between Larvae index and PM10 with different lagged days. Table S4. Coefficient of PM10 for predicting Larvae Index. Table S5. Comparison of predictive performance using features with AQI and without AQI based on random forest by 80/20 percentage split. Table S6. Comparison of predictive performance using features with AQI and without AQI by 10-fold cross-validation. Figure S1. Scree plot of the numbers of components chosen by the Kaiser Criterion. Figure S2. The distribution of data and regression formula.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Kuo, CY., Yang, WW. & Su, E.CY. Improving dengue fever predictions in Taiwan based on feature selection and random forests. BMC Infect Dis 24 (Suppl 2), 334 (2024). https://doi.org/10.1186/s12879-024-09220-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12879-024-09220-4