Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Application of the screening method to monitor influenza vaccine effectiveness among the elderly in Germany

  • Cornelius Remschmidt1Email author,
  • Thorsten Rieck1, 2,
  • Birte Bödeker1 and
  • Ole Wichmann1
BMC Infectious Diseases201515:137

https://doi.org/10.1186/s12879-015-0882-3

Received: 17 July 2014

Accepted: 12 March 2015

Published: 20 March 2015

Abstract

Background

Elderly people are at increased risk for severe influenza illness and constitute therefore a major target-group for seasonal influenza vaccination in most industrialized countries. The aim of this study was to estimate influenza vaccine effectiveness (VE) among individuals aged 60+ years over three seasons and to assess if the screening method is a suitable tool to monitor influenza VE in this particular target-group in Germany.

Methods

We identified laboratory-confirmed influenza cases aged 60+ years through the national communicable disease reporting system for seasons 2010/11, 2011/12 and 2012/13. Vaccination coverage (VC) data were retrieved from a database of health insurance claims representing ~85% of the total German population. We applied the screening method to calculate influenza subtype-specific VE and compared our results with VE estimates from other observational studies in Europe.

Results

In total, 7,156 laboratory-confirmed influenza cases were included. VE against all influenza types ranged between 49% (95% confidence interval [CI]: 39–56) in 2011/12 and 80% (95% CI: 76-83%) in 2010/11. In 2010/11 subtype-specific VE against influenza A(H1N1)pdm and B was 76% and 84%, respectively. In the following seasons, VE against influenza A(H1N1)pdm, A(H3N2) and B was 87%, -9% , 74% (2011/12), and 74%, 39%, 73% (2012/13). VE was higher among hospitalized compared to non-hospitalized influenza A cases. Seventeen observational studies from Europe reporting subtype-specific VE among the elderly were identified for the respective seasons (all applying the test-negative design) and showed comparable subtype-specific VE estimates.

Conclusions

According to our study, influenza vaccination provided moderate protection against laboratory-confirmed influenza A(H1N1)pdm and B in individuals aged 60+ but no or only little protection against A(H3N2). Higher VE among hospitalized cases might indicate higher protection against severe influenza disease. Based on the available data, the screening method allowed us to assess subtype-specific VE in hospitalized and non-hospitalized elderly persons. Since controlling for several important confounders was not possible, the applied method only provided crude VE estimates. However, given the precise VC-data and the large number of cases, the screening method provided results being in line with VE estimates from other observational studies in Europe that applied a different study design.

Keywords

Influenza Vaccine effectiveness Screening method Elderly

Background

Elderly people are at increased risk for severe influenza disease or influenza-associated complications [1]. Therefore, the World Health Organization (WHO) and National Immunization Technical Advisory Groups (NITAGs) in most industrialized countries recommend seasonal influenza vaccination for this particular at-risk group [2-5]. The European Union aims to achieve a vaccination coverage of >75% in this age-group to reduce influenza-associated morbidity and mortality [6]. However, due to progressive deterioration in both innate and adaptive immune function, aging is associated with a reduced immune response to influenza vaccines [7]. Although it seems plausible that this also translates into reduced vaccine effectiveness (VE) in this age-group, there are still conflicting conclusions drawn by authors in respect to influenza VE among the elderly [8]. While some authors concluded that evidence on influenza VE in this age-group is poor [8] or even lacking [9], others found – based on results from post-marketing observational studies – evidence for a substantial reduction in influenza-related morbidity and mortality among the elderly [10].

To guide national immunization strategies and research into the development of improved influenza vaccines, annual estimates of influenza VE in vaccination target-groups are important [11]. In fact, suboptimal effectiveness of seasonal influenza vaccines has recently led researchers and policy makers to advocate for better vaccines [9,12]. Since VE varies not only by characteristics of the vaccinees (e.g., age or underlying medical conditions), but also by influenza season and subtype, many countries have established annual assessments of influenza VE. An increasingly applied method to assess influenza VE is the test-negative design (TND) [13-17]. Patients with medically attended acute respiratory illness (ARI) constitute the study population, and participants are considered as cases if they are tested positive for influenza and as controls if tested negative in a specific time-period after symptom onset [18,19]. In addition to the TND, the screening method has been used to estimate seasonal and pandemic VE in various settings [20-24]. This method estimates VE by comparing vaccination coverage (VC) in influenza-positive cases with VC in the population where the cases derived from (e.g., the same age-group) [25]. If representative data on influenza cases and influenza VC are available, the screening method provides an inexpensive and ready-to-use method that can be useful in providing early VE estimates [26] or in identifying changes in VE over time when conducted repeatedly [14,20]. However, compared to TND the screening method seems more prone to selection bias, and controlling for important confounders, such as comorbidities, might not be possible due to lack of availability of these data [25]. Nonetheless, when applying stratified analyses or limiting the analysis to a more homogeneous population (such as elderly persons) the risk of bias can be reduced.

With this study we aimed to (i) estimate VE against laboratory-confirmed influenza for the seasons 2010/11- 2012/13 among persons aged 60+ years, (ii) compare VE in preventing hospitalized and non-hospitalized influenza, and (iii) assess if the screening methods is a suitable tool for the monitoring of influenza VE among the elderly in Germany.

Methods

Database for determining population vaccination coverage

The source for seasonal influenza VC was the central database of health insurance claims of the Associations of Statutory Health Insurance Physicians (ASHIPs) in Germany. ASHIPs administrative regions are identical to the geographic regions of the 16 federal states, except for one federal state that is divided into two ASHIP regions. ASHIPs regularly receive claims data from all ASHIP-associated physicians for ambulatory services, covering more than 85% of the total population in Germany. Within the ASHIP vaccination monitoring project, anonymous data of ASHIPs are transferred to the Robert Koch Institute (RKI) on a quarterly basis and include information on age (month/year), date of patient contact, as well as date and type of vaccination [27]. We extracted information on seasonal influenza vaccination for seasons 2010/11, 2011/12 and 2012/13 among all individuals aged 60+ years and calculated VC for the total elderly population and by age-strata. Data were available from 16 of the 17 ASHIP regions.

Identification of influenza cases

In Germany, laboratory-confirmed influenza infections are notifiable according to the German Protection against Infection Act since 2001 [28]. We identified influenza cases through the national communicable disease reporting system. Within this system, case-based data of patients with laboratory-confirmed influenza infection are collected by local public health authorities and transmitted electronically via state health departments to RKI. Cases reports include information on age (month/year), place of residence, date of disease onset, date of notification, receipt of influenza vaccine, laboratory confirmation of disease, influenza type and subtype, and hospitalization. Additional information, such as type or name of the influenza vaccine is rarely reported and information on comorbidities is almost never provided.

For our analysis, notified cases aged 60 years and older were included if infection was laboratory-confirmed (i.e., detection of influenza antigens using enzyme immunoassays, polymerase chain reaction, or virus culture), and if information on cases’ vaccination status was available. A case was defined as vaccinated, if classified as “vaccinated in this current season” in the electronic surveillance system. An exact date of vaccination was provided for 66% of all vaccinated influenza cases between 2010/11-2012/13, of whom only 9 had a symptom onset <14 days post vaccination. These cases were considered as “non-vaccinated”. For the remaining 34% of vaccinated cases, for whom the date of vaccination was missing, the number of persons with disease onset within 14 days after vaccination was regarded as unlikely. Since this assumption can potentially increase the numbers of vaccine failures and decrease VE thereby, we conducted a sensitivity analysis by excluding people from the analysis who were vaccinated <14 days prior to symptom onset (results are presented in Additional file 1: Table S1). For each season, proportion of laboratory confirmed influenza cases vaccinated with 95% CIs stratified by age-group (60+, 60–69, 70–79, 80+ years), influenza subtype and hospitalization status (yes/no) were calculated.

The data on influenza cases reported under the German Protection against Infection Act are freely available from the national surveillance database at https://survstat.rki.de.

Definition of influenza seasons

We included cases with disease onset during the study period that was defined from week 40 of the previous to week 20 of the following year for each of the three seasons under investigation. In a sensitivity analysis, we restricted VE calculation to cases with disease onset during the respective influenza season as defined by RKI’s Working Group for Influenza. According to the Working Group, which collects syndromic and laboratory data within a sentinel system of primary care physicians in Germany, influenza seasons were defined from weeks 50/2010-14/2011, 6/2012-16/2012 and 50/2012-16/2013, respectively [29,30].

Statistical analysis

We used descriptive analysis for seasonal influenza VC. In brief, VCs and 95% CIs were calculated as proportion of patients having received claimed influenza vaccinations among the total statutory health insured population by region, age-group, and season.

Calculation of vaccine effectiveness (VE)

VE and 95% CIs were calculated using the screening method according to Farrington [25] with the following formula:
$$ VE=\frac{PV-PCV}{PV\left(1-PCV\right)} $$

where PV is the proportion population vaccinated (i.e. VC) in the respective age-group and where PCV is the proportion of cases vaccinated. We calculated VE by season, age-group, hospitalization status, and influenza subtype.

Identification of factors associated with vaccine failure

We defined vaccine failure as a laboratory-confirmed influenza infection in a person vaccinated against influenza in the respective season. To examine independent predictors of breakthrough infections (leading to vaccine failure) for each influenza season and by influenza subtype, we used a logistic regression model including potential confounding factors (age, sex, hospitalization, week since start of influenza season) and calculated odds ratios (OR) and 95% CI.

Two-sided hypothesis tests were performed and a p-value of ≤0.05 was considered statistically significant. The statistical software package STATA®, version 11 (STATA Corp., College Station, TX, USA) was used.

Identification of observational VE studies from Europe

To compare our study results with influenza VE estimates among the elderly in other observational studies in Europe, we conducted a systematic literature search in PubMed using the following search strategy: (((influenza) AND vaccine) AND effectiveness) AND Europe (restrictions: publication year 2010 to 2015; language: English; species: human). Date of last search was 17 February 2015. In addition, we complemented our search strategy by comparing identified studies with those identified by a recently published meta-analysis by Darvishian et al. [31]. Only studies were included that reported subtype-specific VE estimates in at least one of the seasons 2010/11-2012/13. We extracted (subtype-specific) VE estimates and compared these results with ours. We excluded studies which used other designs than the TND and studies providing “early”, “mid-season”, or “interim estimates”.

Ethical considerations and data protection

Since we analyzed (i) anonymous VC-data from ASHIP and (ii) anonymous data on influenza cases that are collected routinely within the German surveillance system for notifiable diseases, ethical approval was not obtained. The Federal Commissioner for Data Protection and Freedom of Information in Germany has approved the ASHIP vaccination monitoring project.

Standards of reporting

We followed the STROBE guidelines in reporting this study [32].

Results

Influenza vaccination coverage among the elderly 2010/11-2012/13

VC by age-group and season is shown in Table 1. Over the three seasons, VC decreased slightly in all age-groups. In the age-group 60+ years, the VC assessment based on data from an average 18 million (i.e. ~85% of the total 22 million) individuals of this age-group living in Germany. VC in this age-group ranged between 37% and 44% and increased with age (Table 1).
Table 1

Seasonal influenza vaccination coverage by age group estimated from health insurance claims data, influenza seasons 2010/11-2012/13, Germany*

Age-group or place of residence

2010/11 %

2011/12 %

2012/13 %

≥18 years

21.0

19.8

17.4

≥60 years

44.0

42.1

37.4

60-69 years

35.9

33.0

28.2

70-79 years

48.3

46.7

42.1

≥80 years

51.4

50.6

45.6

*Upper and lower bounds of the 95% CIs were 0.2% points above or below the point estimates and are not shown in the tables.

Notified influenza cases aged ≥60 years, 2010/11-2012/13

In total 1,371 (2010/11), 1,034 (2011/12) and 6,803 (2012/13) laboratory-confirmed influenza cases aged 60+ were notified to the RKI during the study period, respectively. The high number of laboratory-confirmed cases in the season 2012/13 reflected the severity of the influenza wave in this particular season in Germany [29]. Among all notified cases, information on laboratory confirmation was available in more than 96%, and information on vaccination status was available in more than 75%. In the final analysis we included 1,174 (85.6%) cases in the season 2010/11, 767 (74.1%) cases in the season 2011/12, and 5,217 (76.7%) cases in the season 2012/13, respectively. In two seasons (2011/12 and 2012/13), excluded cases were older than included cases and in the season 2012/13, excluded cases were more likely to be hospitalized (40% vs 44%, p = 0.01; for details see online Additional file 1: Table S2).

Characteristics of included influenza cases aged ≥60 years

Characteristics of included influenza cases are shown in Table 2. Proportions of cases vaccinated ranged from 14% in season 2010/11 to 27% in season 2011/12. In two seasons (2010/11 and 2012/13), subtype A(H1N1)pdm was the dominant influenza A virus. The season 2011/12 was dominated by subtype A(H3N2).
Table 2

Characteristics of laboratory-confirmed influenza cases aged 60+ years included in the analysis, influenza seasons 2010/11-2012/13, Germany

 

2010/11 n (%)

2011/12 n (%)

2012/13 n (%)

Total

1,174 (100)

767 (100)

5,217 (100)

Cases vaccinated

162 (14.0)

208 (27.1)

921 (17.7)

Influenza subtypes

   

   Influenza type A

774 (65.9)

537 (70.0)

3,069 (58.8)

   Influenza type B

251 (21.4)

97 (12.7)

1,267 (24.3)

   Influenza A/B1

137 (11.7)

89 (11.6)

806 (15.5)

   No data

12 (1.0)

44 (5.8)

75 (1.4)

Influenza strains

   

   A(H1N1)pdm

582 (49.6)

12 (1.6)

859 (16.5)

   A(H3N2)

1 (0.1)

118 (15.4)

168 (3.2)

   B

251 (21.4)

97 (12.7)

1267 (24.3)

   Not genotyped

137 (11.7)

89 (11.6)

806 (15.5)

   Missing data on strains

203 (17.3)

451 (58.8)

2117 (40.6)

Men (%)

589 (50.2)

306 (40.0)

2440 (46.8)

Age in years (mean ± SD)

67.2 (±6.9)

74.7 (±9.9)

71.2 (±8.9)

Age-group (years)

   

   60-69

797 (67.9)

263 (34.3)

2485 (47.6)

   70-79

307 (26.2)

267 (34.8)

1736 (33.3)

   ≥80

70 (6.0)

237 (30.9)

996 (19.1)

Hospitalization status

   

   Hospitalized

455 (38.8)

317 (41.5)

2060 (39.5)

   Not hospitalized

709 (60.4)

446 (58.5)

3087 (59.2)

Data may not add up to 100% due to missing data.

1Reported as influenza, type A/B, not specified.

Overall, for 66.2% of cases information on the date of vaccination was available. Among these vaccinated cases, only four (2.4%), one (0.5%) and four (0.4%) in the season 2010/11, 2011/12 and 2012/13, respectively, were considered as non-vaccinated, since onset of disease occurred within 14 days after vaccination. Excluding these nine cases from analysis did not affect VE estimates (for details see online Additional file 1: Table S1). Approximately 40% of cases were notified as hospitalized in each season.

Vaccine effectiveness

Table 3 provides data on VE estimates in individuals aged 60+ stratified by influenza subtypes, age-group and hospitalization status for all seasons. In the season 2010/11, VE was 76% (95% CI, 70-81%) for the predominantly circulating influenza A(H1N1)pdm and 84% (95% CI, 76-90%) for influenza B. VE increased with age for both subtypes and were higher in hospitalized compared to non-hospitalized patients. In the season 2011/12, VE was 87% (95% CI, 14-100%) for A(H1N1)pdm, −9% (95% CI, −59-26%) for influenza A(H3N2) and 74% (95% CI, 55-86%) for influenza B. VE estimates against influenza A(H3N2) decreased with age, and were higher among hospitalized compared to non-hospitalized cases. However, a statistically significant protective effect against laboratory confirmed A(H3N2) infection was not observed. In the season 2012/13, VE was 74% (95% CI, 69–79) for influenza A(H1N1)pdm, 39% (95% CI, 13-58%) for influenza A(H3N2) and 73% (95% CI, 68-77%) for influenza B. In this season, VE estimates against influenza A(H3N2) decreased with age and showed no protective effect in individuals aged 80 and older and among non-hospitalized cases. For the sensitivity analysis, in total 1,168 (99.4%), 664 (86.6%) and 5,182 (99.3%) cases were included when applying a narrower definition for the influenza seasons. In none of the seasons did VE estimates differed by more than 3% from those calculated in the primary analysis (data not shown). Further sensitivity analyses, e.g., assuming that influenza vaccination coverage (VC) among excluded cases was 50% or 200% of VC among included cases, or assuming that 50% of cases with missing information on the exact date of vaccination were regarded as non-vaccinated are shown in the online supplement (Additional file 1: Tables S3–S5).
Table 3

Vaccine effectiveness (VE in %) against laboratory-confirmed influenza stratified by influenza-subtype, age-groups and hospitalization status, season 2010/11-2012/13, Germany

Age-group (years)

Season 2010/11

Season 2011/2012

Season 2012/2013

VE against influenza (all types)

n = 1,174

n = 767

n = 5,217

60-69

72 (65–77)

59 (43–71)

65 (61–69)

70-79

82 (75–87)

56 (43–67)

63 (58–67)

≥80

86 (71–94)

40 (22–55)

60 (54–66)

≥60

80 (76–83)

49 (39–57)

64 (63–67)

≥60 non-hospitalized

77 (72–81)1

37 (22–49)2

63 (59–66)1

≥60 hospitalized

83 (78–88)1

62 (51–72)2

67 (63–71)1

VE against influenza A

n = 774

n = 537

n = 3,069

60-79

75 (69–80)

55 (43–65)

62 (58–66)

≥80

86 (64–96)

36 (11–54)

54 (44–62)

≥60

77 (72–81)

46 (35–56)

60 (57–64)

≥60 non-hospitalized

72 (64–79)2

32 (14–47)2

57 (52–62)2

≥60 hospitalized

82 (75–88)2

63 (49–74)2

66 (61–71)2

VE against influenza A (H1N1)pdm

n = 582

n = 12

n = 859

60-79

74 (67–79)

85 (−6-100)

74 (68–79)

≥80

91 (63–99)

NA3

64 (39–80)

≥60

76 (70–81)

87 (14–100)

74 (69–79)

≥60 non-hospitalized

68 (58–76)2

NA3

70 (62–77)1

≥60 hospitalized

83 (76–89)2

NA3

80 (72–86)1

VE against influenza A (H3N2)

n = 1

n = 118

n = 168

60-79

NA3

33 (−16-63)

47 (18–66)

≥80

NA3

−49 (−171-17)

22 (−49-60)

≥60

NA3

−9 (−59-26)

39 (13–58)

≥60 non-hospitalized

NA3

−48 (−132-5)2

27 (−8-51)2

≥60 hospitalized

NA3

56 (−1-83)2

73 (30–92)2

VE against influenza B

n = 251

n = 97

n = 1,267

60-79

83 (74–89)

73 (49–86)

74 (69–79)

≥80

89 (55–99)

80 (8–98)

66 (52–75)

≥60

84 (76–90)

73 (54–85)

73 (68–77)

≥60 non-hospitalized

82 (72–89)1

73 (42–89)1

75 (69–80)1

≥60 hospitalized

87 (73–95)1

72 (39–89)1

69 (61–77)1

1Not-hospitalized vs. hospitalized statistically not significant (p > 0.05).

2Not-hospitalized vs. hospitalized statistically significant (p ≤ 0.05).

3No/low number of cases.

Factors associated with vaccine failure

In all three seasons, factors independently associated with vaccine failure were identified among influenza A cases only (Table 4). The odds for a breakthrough disease increased with age (p ≤0.05 for all three seasons). In addition, in all seasons vaccine failures was significantly less common among hospitalized compared to non-hospitalized influenza A cases. Finally, a longer time period since start of the influenza season increased the odds of a A(H3N2) breakthrough infection, but only in the season 2011/12.
Table 4

Factors independently associated with seasonal influenza vaccine failures among cases aged 60 years and older, Germany, seasons 2010/11-2012/13

Season

Influenza-type

Variable/Category

Adjusted OR (95% CI)

p-value

2010/11

A(H1N1)

Age in years

1.03 (1.00-1.07)

0.04

  

Weeks since begin influenza season1

1.02 (0.94-1.11)

0.672

  

Hospitalization

0.45 (0.28-0.73)

<0.01

2011/12

A(H3N2)

Age in years

1.07 (1.03-1.12)

<0.01

  

Weeks since begin influenza season1

1.12 (1.01-1.26)

0.03

  

Hospitalization

0.23 (0.09-0.62)

<0.01

2012/13

A(H1N1)

Age in years

1.05 (1.02-1.08)

<0.01

  

Weeks since begin influenza season1

1.02 (0.95-1.11)

0.492

  

Hospitalization

0.51 (0.33-0.80)

<0.01

 

A(H3N2)

Age in years

1.06 (1.02-1.11)

<0.01

  

Weeks since begin influenza season1

1.11 (0.98-1.26)

0.082

  

Hospitalization

0.35 (0.12-1.00)

0.05

OR, Odds ratio; 95% CI, 95% confidence interval; ns, not statistically significant.

1Influenza season defined as from week 40 of the previous year to week 20 in the following year.

2Removing this (non-significant) variable did not influence the final model.

Comparison of study results with results from other observational studies

Our literature search yielded 141 records in PubMed. Of twenty-two potentially relevant studies, 15 met the inclusion criteria and an additional 2 studies [33,34] were identified through the meta-analysis of Darvishian et al. Finally, data from 17 studies provided enough data and were extracted (seven in 2010/11, four in 2011/12, and six in 2012/13) [17,33-48]. In all seasons and for all influenza-subtypes, VE estimates from our study were close or within the 95% CI of almost all identified TND studies (Table 5). Of particular interest, the included studies did not identify a protective effect against laboratory-confirmed influenza A(H3N2) infection in the 2011/12 season [39,41,49] and no or low VE for the 2012/13 season [35,37,44], similar to what we have observed in our analysis.
Table 5

Vaccine effectiveness (VE) against influenza subtypes among the elderly: comparison of results from this present study with results from observational studies in Europe using the test-negative design, seasons 2010/11-2012/13

Country [ref]

Age-group

 

VE§in % (95% CI)

VE§in % (95% CI)

VE§in % (95% CI)

 

(Years)

VE-analysis

A(H1N1)pdm

A(H3N2)

B

Season 2010/11

   

This study

≥60

Crude

76 (70–81)

-

84 (76–90)

  

Adjusted

-

-

-

Europe (I-MOVE)1 [38]

≥60

Crude

73 (48–86)

-

48 (−2-73)

  

Adjusted

72 (27–90)

-

56 (−38-86)

UK [42]

≥65

Crude

-

-

-

  

Adjusted

70 (0–85)2

-

65 (20–80)2

Spain I [40]

≥50

Crude

67 (27–85)3

-

-

  

Adjusted

69 (0–91)3

-

-

Spain II [43]

≥60

Crude

60 (20–80)4

-

-

  

Adjusted

59 (16–76)4

-

-

Spain III [45]

≥65

Crude

41 (−36-74)5

-

-

  

Adjusted

-

-

-

Spain IV [46]

≥65

Crude

54 (−18-82)6

  
  

Adjusted

-

  

Germany [17]

≥60

Crude

89 (1–99)3

-

-

  

Adjusted

92 (−67-100)3

-

-

Season 2011/12

   

This study

≥60

Crude

87 (14–100)

−9 (−59-26)

74 (55–86)

  

Adjusted

-

-

-

Europe (I-MOVE)1 [39]

≥60

Crude

-

6 (−41-38)

-

  

Adjusted

-

15 (−33-46)

-

UK [41]

≥65

Crude

-

-

-

  

Adjusted

-

48 (−50-82)

-

Spain I [49]

≥65

Crude

-

4 (−106-55)7

-

  

Adjusted

-

19 (−146-73)7

-

Spain II8 [47]

≥65

Crude

-

26 (−69-78)

-

  

Adjusted

-

-

-

Season 2012/13

    

This study

≥60

Crude

74 (69–79)

39 (13–58)

73 (68–77)

  

Adjusted

-

-

-

Europe (I-MOVE)1 [37]

≥60

Crude

59 (14–80)

37 (−13-65)

44 (9–66)

  

Adjusted

-

-

-

UK [44]

≥65

Crude

-

-

-

  

Adjusted

 

−14 (−206-57)

65 (18–85)

Denmark [35]

≥65

Crude

-

−19 (−52-6)

64 (17–84)

  

Adjusted

-

−11 (−41-14)

69 (26–87)

Lithuania8 [48]

≥60

Crude

92 (−55-100)9

  
  

Adjusted

-

  

Portugal8 [33]

≥60

Crude

80 (19–95)10

-

-

  

Adjusted

-

-

-

Multicenter11 [34]

≥65

Crude12

34 (−22-64)

46 (−16-75)

46 (23–63)

  

Adjusted

13 (−68-55)

39 (−40-73)

41 (12–61)

VE, vaccine effectiveness.

§VE point estimates were rounded off to whole numbers.

1I-MOVE pooled data from other European countries; therefore, overlapping with some of the individual studies from the same season is likely.

2approx. VE since data for this age group were presented as figures only.

3VE against all influenza types; >80% of all subtypes identified were H1N1.

4VE against all-type influenza hospitalization; 76% of all subtypes identified were H1N1.

5VE against all-type hospitalization; 95% of all subtypes identified were H1N1.

6VE against all influenza types; 56% of all subtypes identified were H1N1, 41% were B.

7VE against all influenza cases; 92% of all subtypes identified were H3N2.

8Data extracted from the study of Darvishian et al. [31].

9VE against all influenza types; distribution among the whole study population: 41% H1N1, 40% B, 19% H3N2.

10VE against all influenza types; distribution among the whole study population: 53% H1N1, 43% B.

11VE against hospitalization; data collected in Spain, France and in the Russian Federation.

12adjusted for study site.

Discussion

In this study we were able to show that among the elderly VE against influenza A(H1N1)pdm and B was moderate in all three seasons 2010/11-2012/13, whereas VE against influenza A(H3N2) was low in two consecutive seasons. These VE estimates were comparable to results provided by other observational studies in Europe that used the TND, suggesting that the screening method can be a suitable tool to generate useful influenza VE estimates at least for this particular age-group.

In studies applying the TND, patients with medically attended acute respiratory illness are recruited into the study and –if performed in an appropriate way- systematically tested for influenza virus. Those with laboratory-confirmed influenza infection are defined as cases and otherwise as controls. Since both groups are recruited in one process and both derived from the same population the TND has been found to be less susceptible to bias [19]. In the absence of RCTs, the TND has been advocated as a valid method to calculate almost unbiased influenza VE estimates [18,50] under a wide range of assumptions [51]. As with all observational studies adjusting for important confounders has still to be performed [18]. However, in particular for the age-group 60+ there are often only small differences between crude and adjusted point estimates as shown in most of the observational studies identified in our study [17,35,38,40,43].

The screening method has been described as a rapid and cheap tool to survey vaccine effectiveness, particularly when denominator data on individuals are not available [25,26]. For the screening method, only a random sample of cases is needed. However, accurate and age-group specific VC rates are crucial to produce valid VE estimates [25,52]. In our study, the random sample derived from the national communicable disease reporting system. Although this system collects data on laboratory-confirmed influenza infections nationwide, selection bias (e.g., enhanced testing for influenza among chronically ill patients), observer bias (e.g., vaccinated cases are less likely to be swabbed for influenza) or reporting bias (e.g., differences in notification behavior among physicians) cannot completely be ruled out. In addition, data on important confounders are not systematically reported in the system and adjusting for these variables was not possible. However, we probably reduced the impact of these shortcomings since we calculated VE for small age strata among elderly patients, for whom annual influenza vaccination is generally recommended in Germany. Since our results were rather similar to those from studies using the TND, it can be hypothesized that in this particular age-group adjustment for underlying medical conditions might not play such an important role. Furthermore, age-group specific VC rates were calculated in our study from a large database of health insurance claims covering the majority of the German population. The database has been shown to be a valid and representative instrument to describe VC in various age-groups in Germany [27,53] - a prerequisite for valid VE estimates when the screening method is applied [25].

Due to the large sample size we were able to assess subtype-specific VE even in different age-strata within the elderly population. In contrast, in observational studies using the TND estimation of strain-specific VE in the elderly is often not possible or limited by large CIs [17,35,36,42,54]. Furthermore, the assessment of VE against severe influenza using the TND is possible but would require additional study sites in hospitals and is often logistically challenging and resource-demanding. In view of these strengths and limitations, the screening method can be regarded as an useful method for the rapid assessment of crude influenza VE in the elderly when data on laboratory-confirmed influenza cases are available.

In our study, one of the major findings was that VE against influenza A(H3N2) was low in two consecutive seasons. This finding confirms the results from previous studies where no or only little protective effect against influenza A(H3N2) was observed [35,37,39,41,44,49]. Since antigenetic changes of the A/Victoria/361/2011(H3N2)-like vaccine during the manufacturing process has been reported, the WHO has recommended that the influenza A(H3N2) vaccine component for use in the 2013/14 season should be updated [55].

In addition to older age, the probability of vaccine failure increased over time during season 2011/12 among cases infected with influenza A(H3N2). The same effect has been observed in other settings and it was discussed that this may be due to virus changes or waning immunity after vaccination [39,41,49]. Due to the higher mutation rate of influenza A compared to B viruses [56] it is plausible that these effects are mainly identified among patients infected with influenza A.

Interestingly, we found that vaccine failure was negatively associated with hospitalization. This was true in all seasons among cases infected with influenza A viruses. A recently conducted study in Spain suggested that VE may be greater in preventing severe than in preventing mild cases, and that the benefits of vaccination may be greater than suggested [57]. However, in our study we cannot fully exclude that this effect was due to bias, e.g. the healthy vaccinee effect or different testing behavior for influenza in vaccinated inpatients and vaccinated outpatients. Further studies exploring these potential VE differences by clinical outcome would be important to better estimate the true effect of influenza vaccination in preventing severe influenza and influenza-related mortality.

Strengths and limitations

Our study benefits from its large sample size. During three consecutive influenza seasons we were able to include more than 7,000 laboratory-confirmed influenza cases aged 60+ both from the outpatient and inpatient sector. Due to this large size we were able to assess subtype-specific VE even in age-strata of those aged 80+. In addition, since we used age-specific VC data for each single season derived from a large database representing ~85% of the German population, VC can be regarded as representative. Finally, by limiting the studies to individuals aged 60+ we were probably able to reduce the risk of biases to at least some extent, which was reflected by similar VE estimates when comparing to studies using the TND.

However, some limitations have to be acknowledged. First, cases were identified by the mandatory disease surveillance system and the quality of our analysis depends on the quality of the reported data transmitted to the RKI. Since only laboratory-confirmed infections are notifiable in Germany and since it is the decision of the physician whether or not to swab patients for influenza, we cannot exclude that vaccinated persons were less likely be tested for influenza virus infection, which might have led to an overestimation of VE. However, this would not explain differences in VE between hospitalized and non-hospitalized cases. Second, cases were defined as vaccinated if they were notified as “currently vaccinated” and considered as non-vaccinated if disease onset occurred within 14 days after vaccination. Since date of vaccination was provided by 66% of all cases only, it is possible that in cases with unknown vaccination date disease occurred within 14 days after receipt of the vaccine leading to an underestimation of VE. However, since the proportion among cases with information on vaccination date with disease onset prior 14 days after receipt of vaccine was less than 1%, it seems rather unlikely that this proportion was significantly higher among those without information on vaccination date. Third, we were not able to control for some important confounders such as comorbidities, but limiting our study population to persons aged 60+ might have accounted for this. Fourth, although >85% of all cases were laboratory confirmed using PCR or cell-culture, subtyping was only performed in 70% of cases. Finally, since vaccine types are not reported systematically for notified influenza cases, vaccine type or product specific VE cannot be calculated. Overall, optimizing the completeness of the data regarding hospitalization status, vaccination status, and date of vaccination as well as additional information on comorbidities could improve the validity of our VE estimates.

Conclusions

In conclusion, the screening method can be used to rapidly assess influenza subtype-specific VE among the elderly in Germany. Due to high numbers of cases, VE can be estimated even for rather narrow age-ranges and non-dominating influenza subtypes within the elderly population as well as for hospitalized and non-hospitalized patients. Since adjusting for important confounders and the assessment of product-specific VE is not possible, the screening method can be regarded as an important but only supplementary tool for assessing crude VE, in addition to more precise but also more resource-demanding TND-studies for the post-marketing evaluation of influenza vaccines.

Abbreviations

ARI: 

Acute respiratory illness

ASHIP: 

Association of Statutory Health Insurance Physicians

CI: 

Confidence interval

NITAG: 

National Immunization Technical Advisory Group

PCV: 

Proportion cases vaccinated

PV: 

Proportion population vaccinated

OR: 

Odds ratio

RCT: 

Randomized controlled trial

RKI: 

Robert Koch Institute

TND: 

Test-negative design

VC: 

Vaccine coverage

VE: 

Vaccine effectiveness

Declarations

Acknowledgments

The authors are grateful to all colleagues at local and federal health departments in Germany for the collection and reporting of relevant data.

Authors’ Affiliations

(1)
Immunization Unit, Robert Koch Institute
(2)
Charité – University Medicine Berlin

References

  1. Mertz D, Kim TH, Johnstone J, Lam PP, Science M, Kuster SP, et al. Populations at risk for severe or complicated influenza illness: systematic review and meta-analysis. BMJ. 2013;347:f5061.View ArticlePubMedPubMed CentralGoogle Scholar
  2. Centers for Disease Control and Prevention (CDC). Prevention and control of seasonal influenza with vaccines. Recommendations of the Advisory Committee on Immunization Practices--United States, 2013–2014. MMWR Recomm Rep. 2013;62:1–43.Google Scholar
  3. Public Health England. Chapter 19: Influenza. The green book. Updated 11 September 2013. 2013. Available at: https://www.gov.uk/government/publications/influenza-the-green-book-chapter-19. Accessed on 20 March 2014.Google Scholar
  4. German Standing Committee on Vaccination (STIKO). [Empfehlungen der Ständigen Impfkommission (STIKO) am Robert Koch-Institut/Stand: August 2013]. Epidemiologisches Bulletin 34/2013. 2013. Available at: https://www.rki.de/DE/Content/Infekt/EpidBull/Archiv/2013/Ausgaben/34_13.pdf;jsessionid=7DE55B422304CC5842CE18900F8E43A1.2_cid372?__blob=publicationFile. Accessed on 19 March 2014.Google Scholar
  5. World Health Organization, Strategic Advisory Group of Expertes (SAGE) Working Group. Background Paper on Influenza Vaccines and Immunization. 2012. Available at: http://www.who.int/entity/immunization/sage/meetings/2012/april/1_Background_Paper_Mar26_v13_cleaned.pdf?ua=1. Accessed on 19 March, 2014.Google Scholar
  6. European Union. Council recommendation of 22-12-2009 on seasonal influenza vaccination 2009/1019/EU. Official Journal of the European Union, 29/12/2009. 2009. Available at: http://www.epha.org/IMG/pdf/Council_Reccomendation_on_seasonal_flu_vaccine.pdf. Accessed on 12 June 2014.Google Scholar
  7. Targonski PV, Jacobson RM, Poland GA. Immunosenescence: role and measurement in influenza vaccine response among the elderly. Vaccine. 2007;25:3066–9.View ArticlePubMedGoogle Scholar
  8. Jefferson T, Di Pietrantonj C, Al-Ansary LA, Ferroni E, Thorning S, Thomas RE. Vaccines for preventing influenza in the elderly. Cochrane Database Syst RevI. 2010;17(2):CD004876. pub3.Google Scholar
  9. Osterholm MT, Kelley NS, Sommer A, Belongia EA. Efficacy and effectiveness of influenza vaccines: a systematic review and meta-analysis. Lancet Infect Dis. 2012;12:36–44.View ArticlePubMedGoogle Scholar
  10. Beyer WE, McElhaney J, Smith DJ, Monto AS, Nguyen-Van-Tam JS, Osterhaus AD. Cochrane re-arranged: support for policies to vaccinate elderly people against influenza. Vaccine. 2013;31:6030–3.View ArticlePubMedGoogle Scholar
  11. Neuzil KM, Victor JC. Editorial commentary: annual studies of influenza vaccine effectiveness: evaluating performance, informing policy, and generating new questions. Clin Infect Dis. 2014;58:328–9.View ArticlePubMedGoogle Scholar
  12. Girard MP, Tam JS, Pervikov Y, Katz JM. Report on the first WHO integrated meeting on development and clinical trials of influenza vaccines that induce broadly protective and long-lasting immune responses: Hong Kong SAR, China, 24–26 January 2013. Vaccine. 2013;31:3766–71.View ArticlePubMedGoogle Scholar
  13. Skowronski DM, Janjua NZ, De Serres G, Winter AL, Dickinson JA, Gardy JL, et al. A sentinel platform to evaluate influenza vaccine effectiveness and new variant circulation, Canada 2010–2011 season. Clin Infect Dis. 2012;55:332–42.View ArticlePubMedGoogle Scholar
  14. Valenciano M, Ciancio B, team IMs. I-MOVE: a European network to measure the effectiveness of influenza vaccines. Euro Surveill. 2012;17.Google Scholar
  15. Treanor JJ, Talbot HK, Ohmit SE, Coleman LA, Thompson MG, Cheng PY, et al. Effectiveness of seasonal influenza vaccines in the United States during a season with circulation of all three vaccine strains. Clin Infect Dis. 2012;55:951–9.View ArticlePubMedPubMed CentralGoogle Scholar
  16. Fielding JE, Grant KA, Papadakis G, Kelly HA. Estimation of type- and subtype-specific influenza vaccine effectiveness in Victoria, Australia using a test negative case control method, 2007–2008. BMC Infect Dis. 2011;11:170.View ArticlePubMedPubMed CentralGoogle Scholar
  17. Englund H, Campe H, Hautmann W. Effectiveness of trivalent and monovalent influenza vaccines against laboratory-confirmed influenza infection in persons with medically attended influenza-like illness in Bavaria, Germany, 2010/2011 season. Epidemiol Infect. 2013;141:1807–15.View ArticlePubMedGoogle Scholar
  18. De Serres G, Skowronski DM, Wu XW, Ambrose CS. The test-negative design: validity, accuracy and precision of vaccine efficacy estimates compared to the gold standard of randomised placebo-controlled clinical trials. Euro Surveill 2013;18(37).Google Scholar
  19. Jackson ML, Nelson JC. The test-negative design for estimating influenza vaccine effectiveness. Vaccine. 2013;31:2165–8.View ArticlePubMedGoogle Scholar
  20. Valenciano M, Kissling E, Ciancio BC, Moren A. Study designs for timely estimation of influenza vaccine effectiveness using European sentinel practitioner networks. Vaccine. 2010;28:7381–8.View ArticlePubMedGoogle Scholar
  21. Falchi A, Souty C, Grisoni ML, Mosnier A, Hanslik T, Daviaud I, et al. Field seasonal influenza vaccine effectiveness: Evaluation of the screening method using different sources of data during the 2010/2011 French influenza season. Hum Vaccin Immunother. 2013;9(11):2453–9.View ArticlePubMedPubMed CentralGoogle Scholar
  22. Thomas HL, Andrews N, Green HK, Boddington NL, Zhao H, Reynolds A, et al. Estimating vaccine effectiveness against severe influenza in England and Scotland 2011/2012: applying the screening method to data from intensive care surveillance systems. Epidemiol Infect. 2014;142:126–33.PubMedGoogle Scholar
  23. Seyler T, Bella A, Puzelli S, Donatelli I, Rizzo C, screening method working g. Estimating pandemic vaccine effectiveness in two Italian regions using the screening method, 2009–2010. Vaccine. 2012;30:109–11.View ArticlePubMedGoogle Scholar
  24. Wichmann O, Stocker P, Poggensee G, Altmann D, Walter D, Hellenbrand W, et al. Pandemic influenza A(H1N1) 2009 breakthrough infections and estimates of vaccine effectiveness in Germany 2009–2010. Euro Surveill. 2010;15.Google Scholar
  25. Farrington CP. Estimation of vaccine effectiveness using the screening method. Int J Epidemiol. 1993;22:742–6.View ArticlePubMedGoogle Scholar
  26. Minodier L, Blanchon T, Souty C, Turbelin C, Leccia F, Varesi L, et al. Influenza vaccine effectiveness: best practice and current limitations of the screening method and their implications for the clinic. Expert Rev Vaccines. 2014;1–10.Google Scholar
  27. Rieck T, Feig M, Eckmanns T, Benzler J, Siedler A, Wichmann O. Vaccination coverage among children in Germany estimated by analysis of health insurance claims data. Hum Vaccin Immunother. 2013;10(2):476–84.View ArticlePubMedPubMed CentralGoogle Scholar
  28. Krause G, Altmann D, Faensen D, Porten K, Benzler J, Pfoch T, et al. SurvNet electronic surveillance system for infectious disease outbreaks, Germany. Emerg Infect Dis. 2007;13:1548–55.View ArticlePubMedPubMed CentralGoogle Scholar
  29. Robert Koch-Institut (RKI). Bericht zur Epidemiologie der Influenza in Deutschland Saison 2012/13. [Report - the epidemiology of influenza in Germany, season 2012/13]. Berlin: RKI; 2013. Available from https://influenza.rki.de/Saisonberichte/2012.pdf.Google Scholar
  30. Robert Koch-Institut (RKI). Bericht zur Epidemiologie der Influenza in Deutschland Saison 2010/11. [Report - the epidemiology of influenza in Germany, season 2010/11]. Berlin: RKI; 2011. Available from https://influenza.rki.de/Saisonberichte/2010.pdf.Google Scholar
  31. Darvishian M, Bijlsma MJ, Hak E, van den Heuvel ER. Effectiveness of seasonal influenza vaccine in community-dwelling elderly people: a meta-analysis of test-negative design case–control studies. Lancet Infect Dis. 2014;14:1228–39.View ArticlePubMedGoogle Scholar
  32. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. J Clin Epidemiol. 2008;61:344–9.View ArticleGoogle Scholar
  33. Nunes B, Machado A, Guiomar R, Pechirra P, Conde P, Cristovao P, et al. Estimates of 2012/13 influenza vaccine effectiveness using the case test-negative control design with different influenza negative control groups. Vaccine. 2014;32:4443–9.View ArticlePubMedGoogle Scholar
  34. Puig-Barbera J, Natividad-Sancho A, Launay O, Burtseva E, Ciblak MA, Tormos A, et al. 2012–2013 Seasonal Influenza Vaccine Effectiveness against Influenza Hospitalizations: Results from the Global Influenza Hospital Surveillance Network. PLoS One. 2014;9:e100497.View ArticlePubMedPubMed CentralGoogle Scholar
  35. Bragstad K, Emborg H, Fischer TK, Voldstedlund M, Gubbels S, Andersen B, et al. Low vaccine effectiveness against influenza A(H3N2) virus among elderly people in Denmark in 2012/13--a rapid epidemiological and virological assessment. Euro Surveill. 2013;18.Google Scholar
  36. Castilla J, Martinez-Baz I, Martinez-Artola V, Fernandez-Alonso M, Reina G, Guevara M, et al. Early estimates of influenza vaccine effectiveness in Navarre, Spain: 2012/13 mid-season analysis. Euro Surveill. 2013;18:2.PubMedGoogle Scholar
  37. Kissling E, Valenciano M, Buchholz U, Larrauri A, Cohen J, Nunes B, et al. Influenza vaccine effectiveness estimates in Europe in a season with three influenza type/subtypes circulating: the I-MOVE multicentre case–control study, influenza season 2012/13. Euro Surveill 2014;19(6).Google Scholar
  38. Kissling E, Valenciano M, Cohen JM, Oroszi B, Barret AS, Rizzo C, et al. I-MOVE multi-centre case control study 2010–11: overall and stratified estimates of influenza vaccine effectiveness in Europe. PLoS One. 2011;6:e27622.View ArticlePubMedPubMed CentralGoogle Scholar
  39. Kissling E, Valenciano M, Larrauri A, Oroszi B, Cohen JM, Nunes B, et al. Low and decreasing vaccine effectiveness against influenza A(H3) in 2011/12 among vaccination target groups in Europe: results from the I-MOVE multicentre case–control study. Euro Surveill. 2013;18(5).Google Scholar
  40. Martinez-Baz I, Martinez-Artola V, Reina G, Guevara M, Cenoz MG, Moran J, et al. Effectiveness of the trivalent influenza vaccine in Navarre, Spain, 2010–2011: a population-based test-negative case–control study. BMC Public Health. 2013;13:191.View ArticlePubMedPubMed CentralGoogle Scholar
  41. Pebody R, Andrews N, McMenamin J, Durnall H, Ellis J, Thompson CI, et al. Vaccine effectiveness of 2011/12 trivalent seasonal influenza vaccine in preventing laboratory-confirmed influenza in primary care in the United Kingdom: evidence of waning intra-seasonal protection. Euro Surveill. 2013;18(5).Google Scholar
  42. Pebody RG, Andrews N, Fleming DM, McMenamin J, Cottrell S, Smyth B, et al. Age-specific vaccine effectiveness of seasonal 2010/2011 and pandemic influenza A(H1N1) 2009 vaccines in preventing influenza in the United Kingdom. Epidemiol Infect. 2013;141(3):620–30.View ArticlePubMedGoogle Scholar
  43. Puig-Barbera J, Diez-Domingo J, Arnedo-Pena A, Ruiz-Garcia M, Perez-Vilar S, Mico-Esparza JL, et al. Effectiveness of the 2010–2011 seasonal influenza vaccine in preventing confirmed influenza hospitalizations in adults: a case-case comparison, case–control study. Vaccine. 2012;30:5714–20.View ArticlePubMedGoogle Scholar
  44. Andrews N, McMenamin J, Durnall H, Ellis J, Lackenby A, Robertson C, et al. Effectiveness of trivalent seasonal influenza vaccine in preventing laboratory-confirmed influenza in primary care in the United Kingdom: 2012/13 end of season results. Euro Surveill. 2014;19(27). Available at: http://www.eurosurveillance.org/ViewArticle.aspx?ArticleId=20851. Accessed on 12 July 2014.
  45. Castilla J, Martinez-Artola V, Salcedo E, Martinez-Baz I, Cenoz MG, Guevara M, et al. Vaccine effectiveness in preventing influenza hospitalizations in Navarre, Spain, 2010–2011: cohort and case–control study. Vaccine. 2012;30:195–200.View ArticlePubMedGoogle Scholar
  46. Jimenez-Jorge S, Savulescu C, Pozo F, de Mateo S, Casas I, Ledesma J, et al. Effectiveness of the 2010–11 seasonal trivalent influenza vaccine in Spain: cycEVA study. Vaccine. 2012;30:3595–602.View ArticlePubMedGoogle Scholar
  47. Jimenez-Jorge S, de Mateo S, Delgado-Sanz C, Pozo F, Casas I, Garcia-Cenoz M, et al. Effectiveness of influenza vaccine against laboratory-confirmed influenza, in the late 2011–2012 season in Spain, among population targeted for vaccination. BMC Infect Dis. 2013;13:441.View ArticlePubMedPubMed CentralGoogle Scholar
  48. Gefenaite G, Rahamat-Langendoen J, Ambrozaitis A, Mickiene A, Jancoriene L, Kuliese M, et al. Seasonal influenza vaccine effectiveness against influenza in 2012–2013: a hospital-based case–control study in Lithuania. Vaccine. 2014;32:857–63.View ArticlePubMedGoogle Scholar
  49. Castilla J, Martinez-Baz I, Martinez-Artola V, Reina G, Pozo F, Garcia Cenoz M, et al. Decline in influenza vaccine effectiveness with time after vaccination, Navarre, Spain, season 2011/12. Euro Surveill. 2013;18(5).Google Scholar
  50. Kissling E, Valenciano M, Falcao J, Larrauri A, Widgren K, Pitigoi D, et al. "I-MOVE" towards monitoring seasonal and pandemic influenza vaccine effectiveness: lessons learnt from a pilot multi-centric case–control study in Europe, 2008–9. Euro Surveill. 2009;14(44).Google Scholar
  51. Foppa IM, Haber M, Ferdinands JM, Shay DK. The case test-negative design for studies of the effectiveness of influenza vaccine. Vaccine. 2013;31:3104–9.View ArticlePubMedGoogle Scholar
  52. Orenstein WA, Bernier RH, Hinman AR. Assessing vaccine efficacy in the field. Further observations Epidemiol Rev. 1988;10:212–41.PubMedGoogle Scholar
  53. Reuss AM, Walter D, Feig M, Kappelmayer L, Buchholz U, Eckmanns T, et al. Influenza vaccination coverage in the 2004/05, 2005/06, and 2006/07 seasons: a secondary data analysis based on billing data of the German associations of statutory health insurance physicians. Dtsch Arztebl Int. 2010;107:845–50.PubMedPubMed CentralGoogle Scholar
  54. Skowronski DM, Janjua NZ, Sabaiduc S, De Serres G, Winter AL, Gubbay JB, et al. Influenza A/subtype and B/lineage effectiveness estimates for the 2011–12 trivalent vaccine: cross-season and cross-lineage protection with unchanged vaccine. J Infect Dis. 2014;210(1):126–37.View ArticlePubMedGoogle Scholar
  55. World Health Organization. Recommended composition of influenza virus vaccines for use in the 2013–14 northern hemisphere influenza season. 2013. Available at http://www.who.int/influenza/vaccines/virus/recommendations/2013_14_north/en/. Accessed on 10 July 2014.
  56. Nobusawa E, Sato K. Comparison of the mutation rates of human influenza A and B viruses. J Virol. 2006;80:3675–8.View ArticlePubMedPubMed CentralGoogle Scholar
  57. Castilla J, Godoy P, Dominguez A, Martinez-Baz I, Astray J, Martin V, et al. Influenza vaccine effectiveness in preventing outpatient, inpatient, and severe cases of laboratory-confirmed influenza. Clin Infect Dis. 2013;57:167–75.View ArticlePubMedGoogle Scholar

Copyright

© Remschmidt et al.; licensee BioMed Central. 2015

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Advertisement