 Research article
 Open Access
 Open Peer Review
 Published:
Accounting for behavioral responses during a flu epidemic using home television viewing
BMC Infectious Diseasesvolume 15, Article number: 21 (2015)
The Erratum to this article has been published in BMC Infectious Diseases 2016 16:474
Abstract
Background
Theory suggests that individual behavioral responses impact the spread of flulike illnesses, but this has been difficult to empirically characterize. Social distancing is an important component of behavioral response, though analyses have been limited by a lack of behavioral data. Our objective is to use media data to characterize social distancing behavior in order to empirically inform explanatory and predictive epidemiological models.
Methods
We use data on variation in home television viewing as a proxy for variation in time spent in the home and, by extension, contact. This behavioral proxy is imperfect but appealing since information on a rich and representative sample is collected using consistent techniques across time and most major cities. We study the AprilMay 2009 outbreak of A/H1N1 in Central Mexico and examine the dynamic behavioral response in aggregate and contrast the observed patterns of various demographic subgroups. We develop and calibrate a dynamic behavioral model of disease transmission informed by the proxy data on daily variation in contact rates and compare it to a standard (nonadaptive) model and a fixed effects model that crudely captures behavior.
Results
We find that after a demonstrable initial behavioral response (consistent with social distancing) at the onset of the outbreak, there was attenuation in the response before the conclusion of the public health intervention. We find substantial differences in the behavioral response across age subgroups and socioeconomic levels. We also find that the dynamic behavioral and fixed effects transmission models better account for variation in new confirmed cases, generate more stable estimates of the baseline rate of transmission over time and predict the number of new cases over a short horizon with substantially less error.
Conclusions
Results suggest that A/H1N1 had an innate transmission potential greater than previously thought but this was masked by behavioral responses. Observed differences in behavioral response across demographic groups indicate a potential benefit from targeting social distancing outreach efforts.
Background
The series of flulike outbreaks over the past decade illustrates the ongoing need for refinement of strategies to control and mitigate the impact of infectious diseases, including SARS in 2003 [1], the 2009 A/H1N1 (swine) influenza pandemic [2,3] and the emergence of a novel A/H7N9 (avian) influenza virus in 2013 [4]. In parallel to standard vaccination efforts, nonpharmaceutical interventions (NPIs) are a critical part of the management toolkit [57]. In particular, NPIs become even more relevant in the context of emerging infectious diseases when the availability of a vaccine may be substantially delayed. Chief among NPIs are strategies for enhancing social distancing, whether privately initiated or policydirected (e.g., closing of schools, businesses and public events) [8]. While behavioral NPIs appear promising, it is important to evaluate empirically their efficacy since they can be costly [9] and could have unintended consequences, such as leading to a net increase in the longrun number of cases or increasing the total cost of the epidemic and policy response [10,11]. The potential for individual response to disease risk and policy presents a challenge for the measurement of the infectivity of a pathogen and design of policy directed social distancing [12,13]. Ferguson [14] argues that despite the need for a holistic approach, current models essentially ignore the feedback between epidemics and behavior.
Empirical analysis of the effect of social distancing behavior on epidemiological dynamics is of clear interest, but it has proven difficult to obtain representative data on actual behavioral responses to epidemics. Empirical investigation of the influence of behavior on flulike transmission dynamics has been largely limited to binary proxies for behavior, specifically prescheduled [6,15] and epidemiologically driven [16] school closings and patterns of weekdays and weekends [17]. Though policy interventions are often coarse, individuals’ responses to policy and their own private decisions about risk are likely more nuanced [8]. Fenichel et al. [18] show that private risk reduction may have changed in subtle ways during the 2009 A/H1N1 epidemic. Caley et al. [19] estimate the change in infectious contact rates in Sydney, Australia from the 1918 influenza pandemic but do so indirectly by inferring changes in contacts based on the estimated reproduction number and proportion susceptible conditional on a given value for the reproduction number, R_{0}.
We use novel data on variation in home television viewing behavior as a proxy for changes in the level of daily social interaction. We find a strong viewing behavior response in Central Mexico associated with the A/H1N1 influenza virus in April and May of 2009. The data reveal that proxy behavioral responses were greatest among children and wealthier socioeconomic groups. Furthermore, we couple the behavioral response with an epidemiological model, and show that the A/H1N1 influenza virus was likely more transmissible than previously believed because the transmission potential was masked by behavioral responses.
To leverage the television viewing data for exploring the role of behavior during an epidemic, we extend the binary proxy for time varying infectivity in [20], where behavior can change at only one point in time, to allow for daily variation in behavior. Following [17], we decompose a standard model of the transmission rate into the two components of a contact rate and average transmission rate per contact. To inform changes in the contact rate, we use a daily proxy for changes in time spent by individuals in the home, namely variation in home television viewing. While viewing is an imperfect proxy for social distancing behavior, this data has several appealing attributes. The data are collected consistently prior to, during, and after epidemics in all major media markets worldwide. The sample is representative of the local population (by design) and can be disaggregated into various demographic subgroups. Typically the data is collected automatically and electronically (as in our sample) and do not rely on selfreporting. The viewing data in our application were obtained from IBOPE International netAGB Nielsen Media Research, the largest private research and audience measurement firm in Latin America.
We contribute to the literature by examining variation in the behavioral response across time and demographic subgroups and by calibrating and analyzing dynamic behavioral disease transmission models. First, we quantify the dynamic nature of the behavioral response to the 2009 A/H1N1 influenza pandemic and public intervention in Central Mexico. We show that the aggregate response is not constant and describe how it varies systematically over time. Next, we unpack the aggregate dynamic into demographic subgroups and show how certain age groups and/or socioeconomic groups respond more strongly than others. Turning to the modeling of disease transmission dynamics, we assess whether accounting for daily changes in contacts better accounts for the variation in new cases. We then explore the potential for bias in the standard model from ignoring underlying changes in behavior. Previous simulation analysis has shown that intervention focused on children is particularly effective in reducing the attack rate of influenza [21]. We examine how accounting for heterogeneity between adults and children alters conclusions. In the next section we first show how the basic transmission model can be extended to incorporate dynamic behavior and then describe the data and model estimation approach in detail.
Methods
Standard epidemiological model
We model the 2009 A/H1N1 epidemic in Central Mexico using an SEIR epidemiological model [2224]. We define three different model formulations: one that does not account for any behavioral changes, one that assumes that behavioral change is constant throughout the governmentimposed health interventions, and one that assumes that behavioral change can be estimated by daily television viewing data. For each model, individuals in the population, of size N, are classified by health status of individuals in into four states in each period, t: susceptible (S_{t}), exposed (infected but not yet infectious), (E_{t}), infectious (I_{t}), and recovered (R_{t}). The transition dynamics between health states are described by a system of difference equations:
where β_{ t } is the transmission rate, κ is the rate at which incubating individuals progress from the exposed to the infectious health status (or the inverse of the latent period) and γ is the recovery rate (or the inverse of the recovery period).
In the standard (SD) model β_{t} is becomes a constant scalar. This confounds the combined effect of contacts and the probability of transmission from a contact [12]. In the classical transmission model, the behavior governing contacts is assumed to be fixed. Yet for many human diseases, including influenza, behavioral shifts and NPI likely play an important role in the transmission process.
Behavioral epidemiological model
To generalize the classical model we decompose β_{t} into the likelihood of transmission conditional on a contact (ρ_{0}) and the average number of contacts experienced by individuals \( \left(\overline{\mathrm{C}}\right) \):
The parameters ρ_{0} and \( \overline{\mathrm{C}} \) are not uniquely identified since they enter the model as a product. Nevertheless, ρ_{0} can be estimated following [17] and using population estimates from the literature for \( \overline{C} \).^{a}
Despite differentiating between the likelihood of transmission from a contact and the number of contacts, \( {\beta}_t^{SD} \) is assumed to be constant. We explore two alternatives that relax the assumption of a constant transmission rate. The first extension to facilitate a timevarying transmission rate is to allow for two different, but otherwise constant, levels in β_{ t } over time. Following [20], we model the behavioral response as a fixed effect (FE) (i.e. using a dummy variable) for the duration of a time period given by τ, for example during a particular public health intervention,
where ρ_{0} is a baseline marginal transmission rate (per contact), ρ_{1} is a shift in the marginal baseline transmission rate during the window τ, and 1_{τ}(t) is the indicator function, equal to one when t ∈ τ, and zero otherwise.
Second, we propose a flexible response model that allows for daily variation in behavior. Given the availability of an empirical proxy for changes in contact rates, we relax the assumption of fixed contact rates. Let Δ_{t} represent the percentage deviation from the average \( \overline{\left(\mathrm{C}\right)} \) for a given period t. A dynamic behavioral (DB) transmission function that is similar in form the Equations (2) and (3) but accounts for variation in the contact rate is:
Relative to the SD model in Equation (2), the DB transmission rate model includes an additional term \( \left({\rho}_1{\Delta}_t\overline{C}\right) \) capturing an additive effect of any behavioral response. The SD model (2) is nested within both the FE model (3) and the DB model (4): \( {\beta}_t^{SD}={\beta}_t^{FE}\left({\rho}_1=0\right)={\beta}_t^{DB}\left({\rho}_1=0\right) \). Under all three models, the subset of the population N in each of the health states changes over time. The only other potentially dynamic component is the transmission rate β_{ t }, which is either fixed (SD model), takes one of two constant values over time (FE model), or varies daily (DB model).
Epidemiological data
To examine the implications of social distancing we focus on the initial outbreak of A/H1N1 in Central Mexico, in the spring of 2009.^{b} We obtained laboratory confirmed pandemic A/H1N1 influenza cases from April 1 to May 20 in Central Mexico from a prospective epidemiological surveillance system that was established in response to the 2009 influenza pandemic by the Mexican Institute for Social Security (IMSS) [25]. These data are presented in Table 3 in Appendix A. IMSS is a tripartite Mexican health system that relies on a network of over 1,000 primary healthcare units and 259 hospitals nationwide, and covers ~40% of the Mexican population. Importantly, testing rates for novel A/H1N1 influenza remained stable at ~33% [20]. Chowell et al. [20] show that the age distribution of the population affiliated with IMSS is generally representative of the general population of Mexico, rejecting the hypothesis that the distributions are significantly different. Furthermore they note that the maletofemale ratio among the population affiliated with IMSS (47:53) is similar to that of the general population (49:51).
On April 15th 2009, the Mexico Ministry of Health began receiving informal indications of a severe pneumonia in metropolitan Mexico City [3,26]. The novel influenza A/H1N1 virus was confirmed by U.S. and Canadian labs for multiple Mexican patients from April 22–24. On Friday, April 24^{th}, the federal government announced the closure of public schools for metropolitan Mexico City, and a public awareness campaign was initiated by the Ministry of Health. Further “social distancing measures” involved closing restaurants and entertainment venues and cancelling large public events [26]. After May 9, the infection rate declined dramatically and large public health interventions were lifted [20]. Students resumed school on Monday, May 11. The window τ = {April 24, …, May 10} is used in the FE model for the subperiod over which we might expect to observe an effect due to social distancing. We also considered alternative dates for the start of this window, from April 10^{th} through April 23rd, but none were statistically preferred as explained further in the results. A graphical timeline of events related to the outbreak is provided by Chowell et al. [20] (Table 1).
Ethics Committee approval was not necessary according to local regulations. All the data were deidentified. Data employed in this study are routinely collected for epidemiological surveillance purposes.
Behavioral data
We use data on home television viewing in metropolitan Mexico City as a proxy measure for dynamic behavioral response in Central Mexico during the influenza outbreak. The logic of this approach relies on two key assumptions. First, we assume that time spent watching television increases in time spent in the home, and that a linear approximation is sufficient to capture this behavior.^{c} With respect to an individual’s daily time allocation, since we are mainly concerned with time spent at home or not at home, an increase in the former subtracts from the latter. Second, we assume that the number of contacts an individual makes is proportional to the time spent outside the home.
Viewership data for Mexico City were obtained from IBOPE International netAGB Nielsen Media Research, the largest private research and audience measurement firm in Latin America.^{d} The specific measure used was individual daily average time viewed (ATV), which is given by the aggregate number of hours viewed by everyone in the sample divided by the number of individuals in the sample (including those with no viewing in a given period). The data reflect aggregate observations for individuals (not households) in a given demographic group. IBOPE’s sample is composed of an ongoing panel of individuals, balanced across demographic characteristics to be representative of the population of Mexico City. Daily data were obtained for the months of April and May in 2009. With respect to data on daily confirmed cases of influenza and average TV viewership, ethics committee review was not relevant since all data were deidentified, aggregated before acquisition and collected under existing conditions (i.e. there were no experimental treatments). Similarly, since the data were gathered through existing mechanisms and not for our study, obtaining written informed consent from participants was not relevant.
We used the percentage deviation in average television viewership (relative to the nonintervention period) as a proxy for the percentage deviation in contacts. We choose this simple form for the proxy since a parameterized model of raw contacts as a function of television viewing is not available. Let \( \overline{ATV} \) represent the baseline (nonintervention period) mean of ATV_{t} over an extended time horizon from both before and after the public response to the outbreak, but not during. The baseline period used to determine \( \overline{ATV} \) is April 1April 23 and May 10May 31, which includes April and May of 2009, excluding the period τ. \( \overline{ATV} \) for our sample is 1.7 hours per day (with a minimum and maximum ATV_{t} over the baseline period of (1.5, 1.9)). The timevarying deviation from the baseline mean ATV_{t} is given by \( {\varDelta}_t=\left(AT{V}_t\overline{ATV}\right)/\overline{ATV} \).
We considered both a single homogenous population and a heterogeneous population divided into two groups: adults (age 18 and above, denoted A) and children (individuals below the age of 18, denoted K). For the heterogeneous population model, the disaggregated viewership data allowed for inference on how the behavior of adults and children varied over time. The extension of the homogenous population transmission model in (1) to the heterogeneous subgroup setting is presented in Appendix B. Information is not available to characterize how changes in contacts made by one group (e.g. adults) might differ between contacts they make within the same group (e.g. adultadult contact) versus another group (e.g. adultchild contact). Therefore, we make the simplifying assumption that deviation in the contact rate for a member of group i is uniform across the different groups they may come in contact with; we used a single time series to inform deviations in children’s contacts with either adults or children (Δ_{t, K → A} = Δ_{t, K → K} = Δ_{t,K}) and another single time series similarly for adults (Δ_{t,A → K} = Δ_{t, A → A} = Δ_{t,A}).
We modeled the agespecific contact rates for schoolage children and adults for central Mexico based on survey contact data collected from several European countries [27]:
The average contact rate for the homogenously mixing population, \( \overline{C}=6.1 \), is given by the populationweighted average of C.
Model estimation
We set the population of Central Mexico to N = 5.3*10^{7} individuals [28] and follow [17] in setting the mean probability of an infection being laboratoryconfirmed A/H1N1 influenza at \( \overline{\upvarphi}=0.0015 \). This estimate of is constructed as the product of the symptomatic rate (65% [29,30]), the hospitalization rate (0.45% [31]), and the probability of an infected, hospitalized individual being identified as having A/H1N1 (50%). We control for observed variation in the rate that hospitalized cases were tested by scaling the mean probability of confirmation by the observed deviation from the mean testing rate: \( {\phi}_{\mathrm{t}}=\overline{\upvarphi}\left({\mathrm{TR}}_{\mathrm{t}}/\overline{\mathrm{TR}}\right) \). Testing rate data were obtained from IMSS (the same source as described above for the case data). We set the fraction initially infected on day 1 of the time period (April 1) at π = 1.9 × 10^{− 5}, such that given the population and the probability of confirmation, one case is confirmed on the first day. Consistent with [5,32,33], the daily rate of progression from latent to infected health status and the recovery rate are set to κ = 0.67 and γ = 0.5, respectively.
The main coefficients of interest for estimation are the parameters of the transmission rate functions for each of the three models. Let ρ represent the vector of marginal transmission rate parameters, given by the scalar [ρ_{0}] for the SD model and the vector [ρ_{0}, ρ_{1}] for the FE and DB models. Model parameters were estimated by maximum likelihood. We assumed that the observed number of confirmed new infections each day, \( {I}_t^c \), follows a Poisson process with a mean arrival rate λ_{ t }(ρ) given by the number of new observed infections predicted by the disease model, ϕ_{ t }κE_{ t }. The loglikelihood function is:
Development of the loglikelihood function is explained in further detail in Appendix C.
Because maximum likelihood estimates can be sensitive to the choice of initial values provided to the numerical optimization algorithm, we used a multiple starting point solver in Matlab (version R2013a) designed to identify the global optimum. For each model, the solver was run for each of M different randomly drawn starting vectors for the unknown parameters in ρ. We set M equal to 50 for the standard model (one parameter) and 100 for the alternative models (two parameters). From this set of local maxima, the solution with the greatest likelihood was selected as the estimate for the global maximum. We estimated 95% confidence intervals for the parameters using the likelihood ratio method [34]. To test for statistically significant differences in performance, when comparing the SD model against the FE and DB models we used a likelihood ratio test, since the SD model is nested within both of the alternatives (FE and DB). Since the FE and DB models are not nested, the standard likelihood ratio test is not feasible. Following [35], we used a Cox nonnested test with a parametric bootstrap (see Appendix D for details).
Results and discussion
Dynamic behavioral response
In Figure 1 we present the dynamic behavioral response time series for Δ_{ t } (percentage deviation from mean ATV) in Mexico City during April and May 2009 in aggregate (Figure 1A) and for various demographic and time subgroups (Figure 1BD). The range and mean for this variable over the limited intervention period (τ) is presented in Table 1. A positive deviation (Δ_{ t } > 0) indicates that an above average amount of time was spent in home TV viewing and, by inference, in the home. The mean level of Δ_{ t } over the period τ is positive and, as shown by a onesample ttest, significantly different from zero at the 1% level for the aggregate population and each subgroup considered here (see Table 1).
The dynamic path of Δ_{ t } for the aggregate population is presented in Figure 1A. Outside of the shaded intervention window (τ), this measure has a mean of zero (by construction) and typically falls within a range of +/− 5%. During the period τ, Δ_{ t } shifts demonstrably upwards. This behavioral response is strongest in the first week (approximately 20%) before gradually tapering off to near zero by the end of the intervention period. This pattern suggests that the population’s capacity for social distancing might be limited in duration; before the public health intervention concluded, there was a substantial decline in the behavioral response relative to the peak in the first week. (Alternatively, it may be that the level of viewing per unit of time spent in the home fell as individuals switched to other inhome activities.) After the NPI concluded there was a period of reduced viewing activity in the home (Δ_{ t } < 0). Specifically, Δ_{ t } reached its most negative point on May 10^{th} at −10.5%. Outside of the postintervention dip, Δ_{ t } dropped below −10% on only one other day. As further evidence that the dip was likely not a coincident random event, we find that this dip persisted at 5% below the nonNPI period mean for four consecutive days—there are no other instances in the data when Δ_{ t } falls below 95% of the mean for more than a single day. While the causal mechanism behind these dynamics is not known with certainty, one possibility is that this multiday period of suppressed inhome activity compensated for forgone social and commercial activities from earlier in the intervention period. The observation of reallocation of risky activities in time is common in the public health literature. Following the introduction of antiretroviral treatment for HIV/AIDS [28,36] find empirical evidence of increased sexual risk taking. Boyes and Faith [2] show that when alcohol consumption is banned at college football games that total alcohol consumption may rise through substitution effects in periods sandwiching the game. Finally, Graff Zivin and Neidell [37] find that while Southern California residents curtail outdoor activity on days with poor air quality, if the episode is prolonged the behavioral response dissipates rapidly.
The age class breakdown for Δ_{ t } presented in Figure 1B shows a substantial difference in response between children and adult subgroups during the intervention period. The mean (23.7%) and the maximum (46.2%) behavioral response of children is more than twice as large as the response observed for adults (see Table 1). The difference in responses is statistically significant at the 1% level as indicated by a two sample ttest.
The data from IBOPE are disaggregated into three socioeconomic levels (SELs) based on a set of household characteristics, including the size and amenities of the home, appliance ownership, automobile ownership, and level of education (Figure 1C). During the intervention period, on average the high SEL group shows a response that is over 50% greater than that of the low SEL group. This difference is significant at the 5% level. The medium SEL class displays an intermediate response (Table 1).
Finally, we consider variation in the response by time of day, specifically daytime (6 am6 pm) versus nighttime (6 pm6 am) (Figure 1D). The mean daytime response is approximately twice as strong as the nighttime response (Table 1). This is not surprising given that time spent in the home is lower during the daytime to begin with and thus presents a larger opportunity for adjustment.
The time path for each of the subgroups discussed above follows a path that is qualitatively similar to that of the aggregate population, showing a strong initial positive response that largely or entirely decays before the end of the intervention. For each subgroup comparison considered here, there was a significant difference in the average level of the behavioral response.
Transmission model estimation
The maximum likelihood parameter estimates for each model are based on T = 41 days of observations, stretching from April 1 through the end of the intervention period on May 11 (Table 2). Figures illustrating the loglikelihood profile for each model are presented in Appendix E. The time frame used corresponds to the period of time considered in [20]. After this period, additional cases attenuate substantially as shown in the time series of \( {I}_t^c \) (Figure 2). We focus on this initial 41 day period since the performance of each model (in terms of loglikelihood values and residuals) becomes increasingly poor as more of the postintervention period is included
.
The degree to which accounting for changes in contacts better accounts for the variation in new cases is one of our core research questions. Results show that the standard model is indeed incomplete—we reject the SD model in favor of both the DB model (p < 0.01) and FE model (p < 0.01). However, we do not find that the DB model outperforms the FE model. In fact we reject the DB model in favor of the FE model (p < 0.01). To see why it might be the case that a simple fixed effect is preferred in this case to the dynamic, datadriven behavioral model, consider the time series for \( {I}_t^c \) and Δ_{ t } presented in Figure 2. Consistent with expectations under the DB model, when the social distancing proxy Δ_{ t } begins to surge on April 24^{th} (day 24) the number of new confirmed cases plateaus. However, when Δ_{ t } declines in early May while infections are still common, the number of new confirmed cases \( \left({I}_t^c\right) \) does not grow in a sustained fashion but rather, after a slight delay, begins to fall. Thus the dynamics of initial and early intervention period of the outbreak are consistent with the DB model but the late intervention period is not.
Given that both the FE and DB models outperform the SD model, we explored the potential for biased estimates of the transmission parameter in the SD model as a potential shortcoming of ignoring behavioral change. Estimates of the baseline transmission rate (ρ_{0}) in Table 2 show that while the DB and FE models are in essential agreement, the SD estimate is 12% lower. To explore whether this difference is idiosyncratic or systematic we reestimate each of the three models starting with only the first M days of data for M ∈ [15, 41]. We exclude the FE model for M ∈ [15, 24] since this model is not differentiated from the SD model until the intervention begins on April 24^{th}. In Figure 3 we present the resulting estimates of ρ_{0}. We find that estimates are variable but roughly consistent across models through April 24^{th}. This is not surprising given that before the public health intervention began on April 24^{th} our proxy suggests that behavior had yet to shift discernibly. After this point, estimates of ρ_{0} for the DB and FE models remain roughly stable near 0.064 while the baseline transmission coefficient for the SD model declines monotonically. Thus over the intervention period when behavioral response is strong, the SD estimate of ρ_{0} falls each day to account for the new factor. In contrast, models that allow for a behavioral shift result in estimates for baseline transmission that are essentially level over time.
As a practical matter, this bias in the SD model has important implications for public health and forecast error. First, the SD model provides an estimate of ρ_{0} substantially lower than models with behavior. This suggests that A/H1N1 virus is more infectious, but this infectiousness is masked by behavioral shifts. Second, the SD model results in substantial forecast error, a result shown using simulation in [13] to emerge when human adaptive behavior is important in epidemiological systems.
Forecasting error comparison
In Figure 4 we present forecast error over a fourday horizon for time series of increasing length from M ∈ [15, 41]. The exercise is meant to capture the public health official’s problem of estimating the current state of an outbreak based on observed cases to date. We assume that there is a fourday lag between the date of testing and reporting of all confirmed cases, a typical lag for reporting infectious disease outbreaks. Thus forecast error appearing in the figure for day M = 15 represents error made on day 19 conditional on case data that is complete through day 15. We assume that behavioral data (Δ_{ t }) is available across this four day lag. From the raw forecast error in Figure 4A, it is clear that prediction performance for the SD model becomes poor relative to the alternatives shortly after the intervention on day 24. From this point on, the SD model leads to systematic overprediction of the number of new cases. DB model performance deteriorates next towards the end of the intervention period. Finally, by the time the intervention concludes, all three models systematically overpredict new cases. This suggests that factors absent from the models considered here are important for capturing post intervention dynamics (e.g. personal protective measures to reduce risks per contact).
We estimated the transmission model results above assuming a single homogenous population. However, differences in the behavioral response (Δ_{ t }) for children versus adults presented above motivate exploration of ageclass heterogeneity. When we modeled children and adults as separate populations (with separate time series for Δ_{ t } in the behavioral model), but constrained transmission parameters to be the same for both populations, estimates were not significantly changed. We further tested an extended model in which transmission parameters (ρ_{0}, ρ_{1}) were free to vary between the two groups. This model was not statistically significantly different for either the SD (p = 0.31), DB model (p = 0.41), or FE model (p = 0.12) at the 10% level. For this FE model, relative to the homogeneous (baseline) case, the coefficients ρ_{0} and ρ_{1} were roughly 50% larger in magnitude for children and 90% smaller in magnitude for adults. This evidence is not conclusive, but hints that infections between children and from children to adults might have been a leading driver of disease dynamics—and also most sensitive to intervention. However, this effect is too small and imprecisely estimated to assert with statistical significance.
While we failed to find a significant difference in the transmission coefficients between children and adults, this does not mean that there were not significant differences in these populations. Recall that we controlled for differences between children and adults in the baseline contact rate as specified in the matrix C. When this matrix was replaced with the average \( \left(\overline{C}\right) \) a significant difference emerged between the homogeneous and heterogeneous coefficient specification for both the SD (p < 0.01) and DB models (p = 0.08) but not for the FE model.
Sensitivity analysis
We examined the sensitivity of transmission model results to several alternative assumptions. First, given the temporal mismatch between the case and behavioral time series in Figure 2, we explored whether the relative preference for the FE model continued to hold under extensions in the latent period, i.e. the number of days individuals were infected but not infectious. In the baseline model the latent period was set to 1/κ = 1.5. The performance of the DB model relative to the FE model was robust to alternative assumptions on the latent period, including 2, 3 or 4 days. We also considered whether idiosyncratic variation or “noise” in the ATV variable might hinder the DB model. As a simple test we set a +/−5% threshold for the Δ_{t} measure—any variation that did not exceed this band was set to zero. This did not qualitatively change results. Qualitative results were also not sensitive to a nonlinear quadratic form for the DB model.
Convergence in the performance of the DB and FE models was found when the number of days included in the estimation was limited. For all time series that included 38 days or less, we failed to reject one model in favor of the other. However, after this time frame the FE model emerges as the preferred model (e.g. p < 0.01 at 39 days).
For the FE model, we also considered alternative dates for the start of the intervention window, from April 10^{th} through our baseline window start date of April 24^{th}. For each of these alternative specifications we found that the associated parameter ρ_{1} was statistically significantly different from zero. However, we also found that the loglikelihood was greatest for the FE window beginning on April 24^{th} (our baseline specification) illustrating that none of the alternative start dates was statistically preferred.
The final parameter examined in our sensitivity analysis was the mean probability of confirmation. Our baseline level for \( \overline{\upvarphi} \) implies that 1.2% of the population was infected by the end of the spring wave (conditional on the observed number of cases and total population). We examined sensitivity to an alternative scenario in which 10% of the population contracts the disease, which implied a mean probability of confirmation of \( \overline{\upvarphi}=8.1\times {10}^{5} \). Results from this alternative low probability of confirmation scenario were not qualitatively different.
Counterfactual behavioral response
We explore two alternative scenarios in which the behavioral response to the epidemic is either nonexistent or enhanced. We present the path of new confirmed cases under these alternatives, along with fitted curves from the baseline models in Figure 5A. Under the first alternative, to eliminate the behavioral response, we multiply the ρ_{0} term by zero (0ρ_{0}, thin lines). Under the second alternative, to enhance the behavioral response, we multiply the ρ_{0} term by two (2ρ_{0}, thick lines). Fitted curves from the unaltered baseline models (1ρ_{0}, medium lines) and \( {I}_t^c \) are provided for comparison. For the baseline models, the fit of the DB and FE models is similar until the final few periods in which the DB fit diverges from the observed path \( \left({I}_t^c\right) \). The importance of the behavioral response is evident. With no behavioral response, the projected path of new cases increased sharply, more than quadrupling (Figure 5B) for both models by day 41. Alternatively, with a doubling of response, attenuation of new cases occurs approximately two weeks earlier and cumulative cases by day 41 are cut in half.
Conclusion
We used novel data on variation in home television viewing behavior as a proxy for changes in the level of daily social interaction in Central Mexico during the 2009 A/H1N1 influenza pandemic. Results from both behavioral models (FE and DB) suggested that social distancing was a key factor in constraining the initial wave of A/H1N1 in Central Mexico. In the absence of a behavioral response, the estimated counterfactual path of new cases escalated rapidly in initial weeks rather than stabilizing and eventually falling as was observed. The assumption of fixed behavior in the standard (SD) model led to shortcomings in estimation and prediction. Estimates of the baseline rate of transmission systematically shifted over time. If the baseline rate of transmission is interpreted as a measure of biological infectivity in the standard model, this is likely to lead to an underestimate of this parameter, as in our setting, given confounding effects of behavioral responses. This suggests that A/H1N1 had an innate transmission potential much greater than previously thought but this was masked by behavioral responses. This has implications for management advice including the allocation of resources between pharmaceutical and nonpharmaceutical interventions. Furthermore, the error in near term predictions of new cases through time was also substantially greater under the standard model compared to the behavioral models. This error was also systematic—the standard model consistently led to overprediction in the number of new cases.
Comparing the behavioral models, we found that that the dynamic behavioral model was not preferred to the simpler fixed effect model. One explanation may be the imperfect nature of variation in viewership as a proxy for changes in public contact rate. For example, it is possible that during the public health intervention the observed increase in ATV_{t} was due to a greater share of home time allocated to TV viewing, rather than an increase in time spent at home. Or it could be the case that viewing per unit of time spent at home may be declining in time spent at home. Another explanation might be the inability at this time to empirically capture changes in behavior outside the home to reduce contacts or transmission (e.g. washing hands, wearing facemasks, and avoidance of coughing into open air). Bell [5] notes that while policies promoting social distancing may be effective against pandemic influenza, other individual behavioral measures should be either routine (e.g. hand and respiratory hygiene and disinfection of contaminated household surfaces) or considered for certain settings and risk levels (e.g. mask use).
We found that the home viewership response was stronger in the high (versus low) socioeconomic level (SEL) subgroup. This finding is suggestive but should be interpreted with care. On the one hand, individuals in the high SEL subgroup are arguably less constrained in adjusting contacts than those in the low SEL subgroup. For example, Kumar et al. [38] suggested that workplace policies can impinge on distancing measures and such workplace policies may be more binding on lower SELs. If this hypothesis were tested and verified, it would suggest the potential for targeting of social distancing polices to facilitate selfprotective measures for low SEL individuals. On the other hand, it may be that the difference in response is an artifact of the behavioral proxy which might emerge, for example, if the relationship between home viewership and time spent at home differed systematically between SEL subgroups (e.g., if high SEL individuals respond more strongly because ownership of more televisions provides more opportunities to view).
In addition to varied responses across groups, we also found differences over time, namely attenuation in the behavioral response before the conclusion of the public health intervention. Furthermore, we found evidence of a rebound effect in which, after a prolonged period of elevated inhome activity there appeared to be period of suppressed activity. This is consistent with the historical analysis of Caley et al. [19] who found that as the perceived risk of the 1918 swine flu decreased in Australia, the public appeared to revert to normal behavior. Similarly, Fenichel et al. [18] found that air travelers’ adaptive to A/H1N1 dissipated after an initially strong response. Further studies of the 2009 A/H1N1 influenza pandemic in other regions with similar intervention measures (e.g. Hong Kong, [39]) could help to confirm and generalize the insights gleaned here.
While the dynamic behavioral model based on the home viewership proxy did not outperform the simple fixed effect model, the results represent progress in identifying and unpacking the drivers behind this fixed effect. Going forward, further detailed data on private and public behavior during outbreaks would serve to identify behavioral effects on transmission with greater precision. For example, we did not model the effect of antiviral treatment. Capturing additional behavioral adjustments made outside of the home to reduce effective contacts is likely be important for explicit modeling of the behavior underlying disease transmission. To this end, there is value in allocating resources during an outbreak to consistently gather data on public and private protective actions, such as antiviral use or the use of face masks. Although transitioning from empirical analysis based on fixed effect measures of behavior to fully dynamic responses at finer time scales will require additional investment in data collection, potential benefits include the promise of informing more finely tuned and less costly public health interventions.
References
 1.
Ksiazek TG, Erdman D, Goldsmith CS, Zaki SR, Peret T, Emery S, Tong S, Urbani C, Comer JA, Lim W, Rollin PE, Dowell S, Ling AE, Humphrey C, Shieh WJ, Guarner J, Paddock CD, Rota P, Fields B, DeRisi J, Yang JY, Cox N, Hughes J, LeDuc JW, Bellini W, Anderson LJ, and the SARS Working Group. A novel coronavirus associated with severe acute respiratory syndrome. N Engl J Med. 2003; 348(20):1953–66.
 2.
Boyes WJ, Faith RL. Temporal regulation and intertemporal substitution: the effect of banning alcohol at college football games. Public Choice. 1993; 77(3):595–609.
 3.
Chowell G, Bertozzi SM, Colchero MA, LopezGatell H, AlpucheAranda C, Hernandez M, Miller MA. Severe respiratory disease concurrent with the circulation of H1N1 influenza. N Engl J Med. 2009; 361(7):674–79.
 4.
Zhu H, Wang D, Kelvin DJ, Li L, Zheng Z, Yoon SW, Wong SS, Farooqui A, Wang J, Banner D, Chen R, Zheng R, Zhou J, Zhang Y, Hong W, Dong W, Cai Q, Roehrl MHA, Huang SSH, Kelvin AA, Yao T, Zhou B, Chen X, Leung GM, Poon LLM, Webster RG, Webby RJ, Peiris JSM, Guan Y, Shu Y. Infectivity, transmission, and pathology of humanisolated H7N9 influenza virus in ferrets and pigs. Science. 2013; 341(6142):183–86.
 5.
Bell D, Nicoll A, Fukuda K, Horby P, Monto A, Hayden F, Wylks C, Sanders L, Van Tam J. Nonpharmaceutical interventions for pandemic influenza, international measures. Emerg Infect Dis. 2006; 12(1):81–7.
 6.
Cauchemez S, Valleron AJ, Boelle PY, Flahault A, Ferguson NM. Estimating the impact of school closure on influenza transmission from Sentinel data. Nature. 2008; 452(7188):750–54.
 7.
Stern A, Markel H. What mexico taught the world about pandemic influenza preparedness and community mitigation strategies. JAMA. 2009; 302(11):1221–22.
 8.
Aiello AE, Coulborn RM, Aragon TJ, Baker MG, Burrus BB, Cowling BJ, Duncan A, Enanoria W, Fabian MP, Ferng YH, Larson EL, Leung GM, Markel H, Milton DK, Monto AS, Morse SS, Navarro JA, Park SY, Priest P, Stebbins S, Stern AM, Uddin M, Wetterhall SF, Vukotich CJ. Research findings from nonpharmaceutical intervention studies for pandemic influenza and current gaps in the research. Am J Infect Control. 2010; 38(4):251–58.
 9.
Smith RD, KeoghBrown MR, Barnett T, Tait J. The economywide impact of pandemic influenza on the UK: a computable general equilibrium modelling experiment. BMJ (Clinical research ed). 2009; 339:b4571.
 10.
Maharaj S, Kleczkowski A. Controlling epidemic spread by social distancing: Do it well or not at all. BMC Public Health. 2012; 12(1):679.
 11.
Fenichel EP. Economic considerations for social distancing and behavioral based policies during an epidemic. J Health Econ. 2013; 32(2):440–51.
 12.
Fenichel EP, CastilloChavez C, Ceddia MG, Chowell G, Parra PAG, Hickling GJ, Holloway G, Horan R, Morin B, Perrings C, Springborn M, Velazquez L, Villalobos C. Adaptive human behavior in epidemiological models. Proc Natl Acad Sci. 2011; 108(15):6306–11.
 13.
Fenichel E, Wang X. The mechanism and phenomena of adaptive human behavior during an epidemic and the role of information. In: Manfredi P, D'Onofrio A, editors. Modeling the Interplay Between Human Behavior and the Spread of Infectious Diseases. New York: Springer; 2013: p. 153–68.
 14.
Ferguson N. Capturing human behaviour. Nature. 2007; 446(7137):733.
 15.
Hens N, Ayele G, Goeyvaerts N, Aerts M, Mossong J, Edmunds J, Beutels P. Estimating the impact of school closure on social mixing behaviour and the transmission of close contact infections in eight European countries. BMC Infect Dis. 2009; 9(1):187.
 16.
Copeland DL, BasurtoDavila R, Chung W, Kurian A, Fishbein DB, Szymanowski P, Zipprich J, Lipman H, Cetron MS, Meltzer MI, Averhoff F. Effectiveness of a school district closure for pandemic influenza a (H1N1) on acute respiratory illnesses in the community: a natural experiment. Clin Infect Dis. 2013; 56(4):509–16.
 17.
Towers S, Chowell G. Impact of weekday social contact patterns on the modeling of influenza transmission, and determination of the influenza latent period. J Theor Biol. 2012; 312:87–95.
 18.
Fenichel EP, Kuminoff NV, Chowell G. Skip the trip: Air Travelers' behavioral responses to pandemic influenza. PLoS One. 2013; 8(3):e58249.
 19.
Caley P, Philp DJ, McCracken K. Quantifying social distancing arising from pandemic influenza. J R Soc Interface. 2008; 5(23):631–39.
 20.
Chowell G, EchevarríaZuno S, Viboud C, Simonsen L, Tamerius J, Miller MA, BorjaAburto VH. Characterizing the epidemiology of the 2009 influenza A/H1N1 pandemic in Mexico. PLoS Med. 2011; 8(5):e1000436.
 21.
Glass RJ, Glass LM, Beyeler WE, Min HJ. Targeted social distancing design for pandemic influenza. Emerg Infect Dis. 2006; 12(11):1671–81.
 22.
Hethcote HW. Qualitative analyses of communicable disease models. Math Biosci. 1976; 28(3–4):335–56.
 23.
Diekmann O, Heesterbeek. Mathematical Epidemiology of Infectious Diseases: Model Building, Analysis and Interpretation. New York: Wiley \& Sons; 2000.
 24.
Anderson RM, May RM. Infectious Diseases of Humans: Dynamics and Control. Oxford: Oxford University Press; 1991.
 25.
EchevarriaZuno S, MejiaArangure JM, MarObeso AJ, GrajalesMuniz C, RoblesPerez E, GonzalezLeon M, OrtegaAlvarez MC, GonzalezBonilla C, RasconPacheco RA, BorjaAburto VH. Infection and death from influenza A H1N1 virus in Mexico: a retrospective analysis. Lancet. 2009; 374(9707):2072–79.
 26.
Córdova J, Hernández M, LópezGatell H, Bojorquez I, Palacios E, Rodríguez G, Rosa B, Ocampo R, Alpuche C, Flores R. Update: novel influenza A (H1N1) virus infectionMexico, MarchMay 2009. Morb Mortal Wkly Rep. 2009; 58(21):585–89.
 27.
Mossong J, Hens N, Jit M, Beutels P, Auranen K, Mikolajczyk R, Massari M, Salmaso S, Tomba GS, Wallinga J, Heijne J, SadkowskaTodys M, Rosinska M, Edmunds WJ. Social contacts and mixing patterns relevant to the spread of infectious diseases. PLoS Med. 2008; 5(3):e74.
 28.
Lakdawalla D, Sood N, Goldman D. HIV breakthroughs and risky sexual behavior. Q J Econ. 2006; 121(3):1063–102.
 29.
Elder AG, O'Donnell B, McCruden EAB, Symington IS, Carman WF. Incidence and recall of influenza in a cohort of Glasgow healthcare workers during the 1993–4 epidemic: results of serum testing and questionnaire. BMJ. 1996; 313(7067):1241–42.
 30.
King JC, Haugh CJ, Dupont WD, Thompson JM, Wright PF, Edwards KM. Laboratory and epidemiologic assessment of a recent influenza B outbreak. J Med Virol. 1988; 25(3):361–68.
 31.
Reed C, Angulo FJ, Swerdlow DL, Lipsitch M, Meltzer MI, Jernigan D, Finelli L. Estimates of the prevalence of pandemic (H1N1) 2009, United States, AprilJuly 2009. Emerg Infect Dis. 2009; 15(12):2004–07.
 32.
Cowling BJ, Chan KH, Fang VJ, Lau LL, So HC, Fung RO, Ma ES, Kwong AS, Chan CW, Tsui WW. Comparative epidemiology of pandemic and seasonal influenza A in households. N Engl J Med. 2010; 362(23):2175–84.
 33.
Cauchemez S, Donnelly CA, Reed C, Ghani AC, Fraser C, Kent CK, Finelli L, Ferguson NM. Household transmission of 2009 pandemic influenza A (H1N1) virus in the United States. N Engl J Med. 2009; 361(27):2619–27.
 34.
Davidson R, MacKinnon JG. Econometric Theory and Methods, Volume 21. New York: Oxford University Press; 2004.
 35.
Dameus A, Richter FGC, Brorsen BW, Sukhdial KP. AIDS versus the Rotterdam demand system: a Cox test with parametric bootstrap. J Agric Resour Econ. 2002; 27(2):335–47.
 36.
Mechoulan S. Risky sexual behavior, testing, and HIV treatments. In: Forum for Health Economics & Policy: 2007. 2007.
 37.
Zivin JSG, Neidell MJ. The impact of pollution on worker productivity. In: National Bureau of Economic Research. 2011.
 38.
Kumar S, Quinn SC, Kim KH, Daniel LH, Freimuth VS. The impact of workplace policies and other social factors on selfreported influenzalike illness incidence during the 2009 H1N1 pandemic. Am J Public Health. 2011; 102(1):134–40.
 39.
Wu JT, Cowling BJ, Lau EHY, Ip DKM, Ho LM, Tsang T, Chuang SK, Leung PY, Lo SV, Liu SH, Riley S. School closure and mitigation of pandemic (H1N1) 2009, Hong Kong. Emerg Infect Dis. 2010; 16(3):538–41.
 40.
Coulibaly N, Wade Brorsen B. Monte carlo sampling approach to testing nonnested hypothesis: monte carlo results. Econ Rev. 1999; 18(2):195–209.
Acknowledgements
This publication was made possible by grant number 1R01GM10047101 from the National Institute of General Medical Sciences (NIGMS) at the National Institutes of Health. Its contents are solely the responsibility of the authors and do not necessarily represent the official views of NIGMS.
Author information
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
MS, EF, and GC contributed to concept, design, and model development. MS and MM analyzed the data. All authors contributed to, read and approved the final manuscript.
An erratum to this article is available at http://dx.doi.org/10.1186/s1287901617955.
Appendices
Appendix

A.
Epidemiological data

B.
Multiple age class transmission model
All three base models (SD, FE and DB) can be generalized to allow for age structure within the population. Social interactions may vary across demographic groups, for example children attending school versus working adults. We follow [17] in generalizing the system of differential equations for a homogenously mixing population in (1) to allow for variation in the transmission rate between demographic groups in the set G. Dynamics for each subgroup i ∈ G are given by:
The model in (5) captures heterogeneous mixing within the population model. The groupspecific transmission function (β_{t,i → g}) is the same as in the homogenous case, except \( \overline{C} \) and Δ_{ t } are replaced by \( {\overline{C}}_{i\to g} \) and Δ_{t,i → g}, respectively. The parameter \( {\overline{\mathrm{C}}}_{\mathrm{i}}{{}_{\to}}_{\mathrm{g}} \) reflects the average number of contacts that members of group i experience with members of group g, and Δ_{t,i → g} is the percent deviation from that average at time t.

C.
Derivation of the loglikelihood function
We assumed that the observed number of confirmed new infections on any given day, \( {I}_t^c \), follows a Poisson process with a mean arrival rate λ_{ t }(ρ):
The likelihood function for all observations from t = 1, …, T is given by the product:
Taking the log of this expression provides the loglikelihood function:
Finally, to connect the likelihood model with the SEIR transmission model, we assume that the mean Poisson arrival rate of newly confirmed cases is given by the number of new observed infections predicted by the disease model, λ_{ t }(ρ) = ϕ_{ t }κE_{ t }.

D.
Cox nonnested test with a parametric bootstrap
Under a given null model (e.g. either FE or DB), each bootstrapped sample of the data (new infections) was generated by simulating draws from the Poisson process governing arrivals of new infections based on the fitted estimates of the mean arrival rate for new infections, λ_{ t } ∀ t = 1, …, 50. This process was repeated to create M = 500 bootstrapped samples. The likelihood estimates from each of the bootstrapped samples were used to construct the following pvalue [40] for the test of a given alternative model (a) against the null (0):
where \( {I}_m^{obs} \) is the bootstrapped data sample for each iteration m = 1, …, M; \( {\widehat{\theta}}_{jm} \) represents the ML estimates for model j ∈ {FE, DB} given sample m; L_{j} is the maximum loglikelihood for the model j; \( {\mathrm{L}}_{0\mathrm{a}}={\mathrm{L}}_0\left({\widehat{\uptheta}}_0\right){\mathrm{L}}_{\mathrm{a}}\left({\widehat{\uptheta}}_{\mathrm{a}}\right) \) is the difference between the maximum loglikelihood estimates under H_{0} and H_{a} given the original data; and numb counts the number of times the condition is true for each of M iterations. A small sample correction is implemented by adding a 1 to the numerator and denominator. Because the FE and DB models are nonnested, selection of a unique null model is not feasible. Instead, the Cox test is conducted twice, with each of the models serving as the null in turn.

E.
Likelihood profiles
In Figures 6, 7, 8 we present loglikelihood profiles underlying the maximum likelihood estimates in Table 2. In each case the loglikelihood value excludes the additive constant term which is not a function of the parameters to be estimated (i.e. the final term in Equation (10)). For each profile the maximum likelihood estimates from Table 2 are indicated with a triangle.
Endnotes
^{a}Towers and Chowell [17] allow the number of contacts experienced on weekends and weekdays to differ but these levels are taken from the literature and are otherwise constant. They also allow the transmission rate to vary over time according to a first order harmonic process to capture seasonality over a large portion of the year. We do not explore this structure since our period of interest is two months long.
^{b}Central Mexico includes the Federal District (Mexico City) and states of Guerrero, Hidalgo, Jalisco, Mexico (includes greater Mexico City), Puebla, San Luis Potosi, and Tlaxcala.
^{c}This assumption is difficult to test for Mexico. However, data from the American Time Use Survey (http://www.bls.gov/tus/) suggest that Americans do watch more television as they spend more time in the house, though the relationship may be nonlinear [37].
^{d}The data are collected and stored by the regional division IBOPE AGP Mexico (http://www.agbnielsen.net/whereweare/whereweare.asp).
Rights and permissions
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Received
Accepted
Published
DOI
Keywords
 Epidemic model
 Social distancing
 A/H1N1
 Influenza
 SIR