Several assays are used to measure type-specific serological responses to human papillomavirus (HPV), including the bead-based glutathione S-transferase (GST)-L1 multiplex serology assay and virus-like particle (VLP)-based ELISA. We evaluated the high-throughput GST-L1, which is increasingly used in epidemiologic research, as a measure of cumulative HPV infection and future immune protection among HPV-unvaccinated women.
Methods
We tested enrollment sera from participants in the control arm of the Costa Rica Vaccine Trial (n = 488) for HPV16 and HPV18 using GST-L1, VLP-ELISA, and two assays that measure neutralizing antibodies (cLIA and SEAP-NA). With statistical adjustment for sampling, we compared GST-L1 serostatus to established HPV seropositivity correlates and incident cervical HPV infection using odds ratios. We further compared GST-L1 to VLP-ELISA using pair-wise agreement statistics and by defining alternate assay cutoffs.
Results
Odds of HPV16 GST-L1 seropositivity increased with enrollment age (OR = 1.20 per year, 95%CI 1.03-1.40) and lifetime number of sexual partners (OR = 2.06 per partner, 95%CI 1.49-2.83), with similar results for HPV18. GST-L1 seropositivity did not indicate protection from incident infection over 4 years of follow-up (HPV16 adjusted OR = 1.72, 95%CI 0.95-3.13; HPV18 adjusted OR = 0.38, 95%CI 0.12-1.23). Seroprevalence by GST-L1 (HPV16 and HPV18, respectively) was 5.0% and 5.2%, compared to 19.4% and 23.8% by VLP-ELISA, giving positive agreement of 39.2% and 20.8%. Lowering GST-L1 seropositivity cutoffs improved GST-L1/VLP-ELISA positive agreement to 68.6% (HPV16) and 61.5% (HPV18).
Conclusions
Our data support GST-L1 as a marker of cumulative HPV infection, but not immune protection. At lower seropositivity cutoffs, GST-L1 better approximates VLP-ELISA.
Background
Persistent infection with oncogenic types of human papillomavirus (HPV) is a necessary cause of virtually all cervical cancers [1] and some anogenital and oropharyngeal cancers. Together, HPV types 16 and 18 cause 70% of cervical cancers and 90% of HPV-associated anogenital and oropharyngeal cancers [2].
Measurement of HPV infection is complex. HPV DNA testing using exfoliated cervical cells is the reference standard for identifying current cervical infection, but most infections revert to DNA negativity within 1–2 years [3]. Thus, HPV DNA testing does not reflect past infections that have cleared. Cell mediated, particularly local mucosal, immune responses and generation of serum neutralizing antibodies to the L1 major capsid protein are often detected after infection [4]. These L1 antibodies better reflect both past and present HPV infection (here termed “cumulative infection”), but L1 antibodies are detectable in only about half of women within 18 months of a positive HPV DNA test [5]. Naturally acquired immunity is partially protective against newly detected type-specific HPV infection, though protection by vaccination is much more complete [6–8].
Serological responses to HPV L1 commonly feature as exposures and stratifying variables in epidemiological studies, and are measures of immunogenicity that serve as presumptive correlates of protection in vaccine trials [9]. Several biologically and technically different assays are used to measure type-specific humoral immune responses to HPV L1 capsids. The virus-like particle (VLP)-based enzyme-linked immunosorbent assay (VLP-ELISA) is an established marker of cumulative HPV infection that detects neutralizing and non-neutralizing binding antibodies [10, 11]; the competitive Luminex-based immunoassay (cLIA) measures antibodies that compete for binding by pseudovirion-neutralizing monoclonal antibodies (V5 epitope for HPV16-L1; J4 for HPV18-L1) [12]; and the secreted alkaline phosphatase L1/L2 pseudovirion neutralization assay (SEAP-NA) measures overall neutralizing potential against HPV infection [13]. In 2001, a glutathione S-transferase (GST)-L1 fusion protein-based ELISA was developed [14], which was subsequently transferred to a fluorescent bead-based multiplex format [15]. The GST-L1 assay measures both neutralizing and non-neutralizing antibodies to HPV L1 [16], most probably assembled to pentamers [14].
The GST-L1 assay can detect antibodies to up to 100 different antigens simultaneously, has been scaled up for large studies, requires a small specimen volume, and offers a low cost alternative to other assays [15]. Increasingly, the GST-L1 is being used in epidemiology to measure seropositivity to various HPV types and proteins, including L1 of HPV16 and HPV18. These studies largely focus on cancer etiology [17–20] and HPV natural history [21–24]. It is believed that the GST-L1 assay measures cumulative HPV infection and not immune protection, as it does not distinguish between neutralizing and non-neutralizing antibodies. Only an early ELISA-based version of the GST-L1 has been directly compared to the VLP-ELISA [14], while the multiplex GST-L1 has been compared to a VLP multiplex immunoassay [25]. Published data allowing comparison of GST-L1 with neutralization assays and cLIA are few [25–27].
In this study, in the context of naturally acquired HPV infection and immunity, we evaluated whether the GST-L1 assay measures cumulative HPV16/18 infection and/or future immune protection, and directly compared GST-L1 to VLP-ELISA, cLIA, and SEAP-NA.
Methods
Study population
Our study population was sampled from the control (HPV-unvaccinated) arm of the Costa Rica Vaccine Trial (CVT), which has been described in detail [28]. The control arm comprised 3,736 women aged 18–25 in Guanacaste, Costa Rica who were followed annually for 4 years, providing a serum sample at each visit. For sexually experienced women, exfoliated cervical cells were also collected during a pelvic exam and used to test for HPV DNA infection at each visit. The CVT protocol was approved by the institutional review boards of the U.S. National Cancer Institute and the Costa Rican INCIENSA, and all participants signed IRB-approved informed consent forms.
All women in the CVT control arm were tested at enrollment for HPV16/18 DNA infection at the cervix and for HPV16/18 serum antibodies using VLP-ELISA. Using these results, we sampled 500 women from the CVT control arm using a two-stage stratified random sampling scheme (Figure 1). Stage 1 selected for the HPV16 analysis, which required HPV16 DNA negativity at enrollment, and Stage 2 augmented the sample for the HPV18 analysis, which required HPV18 DNA negativity at enrollment. In Stage 1, we selected 388 of the 2,814 women who were HPV16 DNA negative at enrollment as previously described [29]. Briefly, sampling was stratified by enrollment HPV16 VLP-ELISA serology result (i.e., seropositive or seronegative) and HPV16 incident infection status over 4 years of follow-up, and was designed to ensure sufficient representation from women with positive serology and incident infections. In Stage 2, sampling was stratified by the equivalent variables for HPV18, and with a similar strategy we further sampled 112 women from the 2,582 women who were HPV18 DNA negative at enrollment and not selected in Stage 1.
Figure 1
Two-stage stratified random sampling scheme detailing selection of 500 women from the control (HPV-unvaccinated) arm of the Costa Rica Vaccine Trial (CVT). Legend: Stage 1 selected 388 women who were HPV16 DNA-negative at the cervix at enrollment, with sampling stratified by HPV16 serostatus at enrollment and HPV16 incident infection status over 4 years of follow-up. Stage 2 augmented the sample using analogous variables for HPV18, selecting 112 women who were HPV18 DNA-negative at enrollment. Twelve women for whom an assay failed were then excluded for analysis. The combined (Stage 1 + Stage 2) sample was weighted to represent all women in the CVT control arm who were HPV16 DNA-negative, HPV18 DNA-negative, or both at enrollment. *For Sampling Stage 2, the women selected in Stage 1 were not eligible to be selected again. Thus, 369 women were removed from the pool of eligible women in Stage 2; this group includes all women selected in Stage 1 who were not HPV18 DNA positive at enrollment (N = 388 selected in Stage 1 – 19 HPV18 DNA-positives = 369).
We performed the GST-L1, VLP-ELISA, and cLIA for HPV16 and HPV18 using enrollment serum samples from the total (N = 500) sample, and the more laborious and costly SEAP-NA for HPV16 on the Stage 1 sample only (N = 388). We assessed assay reproducibility as measured by the intraclass correlation coefficient (ICC) and coefficient of variation among seropositives (CV) for GST-L1, cLIA, and SEAP-NA using 25 blind duplicate specimens included in each batch. We excluded twelve women with failed assays, giving a final sample of 488 women.
We tested cervical samples collected annually from each woman for 4 years for HPV16/18 DNA, and used the results to determine HPV16/18 incident infection status. Detection of HPV16 DNA at any visit for a woman who was HPV16 DNA negative at enrollment constituted an incident infection, and the analogous HPV18 variable was similarly constructed. Though we refer to newly detected infections as incident, we cannot distinguish between a true incident infection, a reactivated latent infection, and a missed prevalent infection.
GST-L1 multiplex serology
Antibodies to L1 proteins of HPV16 and HPV18 were detected simultaneously by the GST-L1 multiplex assay as previously described [15, 30]. Diluted sera were incubated with sets of glutathione casein-coated, fluorescence-labeled, spectrally distinct polystyrene beads, which were loaded with GST-L1-tag fusion proteins. Bound antibodies were detected with anti-human IgG secondary antibody and streptavidin-R-phycoerythrin. Antibody levels for each serum sample are thus expressed as median fluorescence intensity (MFI) of at least 100 beads per color (i.e., antigen) per serum, calculated by subtracting the background fluorescence as determined by a negative control (i.e., no serum) from the raw MFI, then subtracting the MFI of GST-L1-tag (i.e., the fusion protein domains without viral antigen) from the MFI of the specific antigen. Seropositivity cutoffs were determined as previously described [31, 32], giving 400 MFI for HPV16 and HPV18.
VLP-ELISA
The VLP-ELISA was performed at GSK Biologicals as previously described [10]. Briefly, serial dilutions of serum samples and standards were added to ELISA microtiter plates coated with HPV VLPs. A peroxidase-conjugated anti-human polyclonal antibody was added, followed by enzyme substrate and chromogen. Reactions were stopped, and optical density (OD) at 620 nm (background) was subtracted from OD at 450 nm. Antibody levels in ELISA units (EU)/mL were calculated by interpolating OD values from the standard curve, averaging the calculated concentrations from all dilutions that fell within the working range of the reference curve. Seropositivity cutoffs were calculated as 3 standard deviations above the geometric mean titers taken from two groups of known HPV-negative individuals [10, 33], giving 8 EU/mL for HPV16 and 7 EU/mL for HPV18.
cLIA
The multiplex cLIA was performed and cutoffs were determined at PPD Vaccines and Biologicals as previously described [12, 33]. Laboratory suggested seropositivity cutoffs were 20 and 24 mMU/mL for HPV16 and HPV18, respectively.
SEAP-NA
The HPV16 SEAP-NA was performed in duplicate as previously described at the HPV Immunology Laboratory, SAIC-Frederick, Inc. [13, 34]. The seropositivity cutoff was set as 3 standard deviations over HPV DNA and seronegatives, giving 25.1 (titer).
HPV DNA testing
Detection of HPV DNA at the cervix and genotyping was conducted at DDL Diagnostic Laboratory as previously described [35, 36]. Briefly, SPF10 primer sets were used to PCR-amplify extracted DNA, then to identify the HPV genotype of SPF10-DEIA-positive samples by reverse hybridization on a line probe assay (LiPA; SPF10-DEIA/HPVLiPA25, version 1; Labo Bio-Medical Products), which detects 25 HPV genotypes. The sensitivity of HPV detection for HPV16 and HPV18 was improved via PCR with type-specific primer sets for specimens testing SPF10-DEIA positive but LiPA25 HPV16 and/or HPV18 negative.
Statistical methods
We developed a method to calculate sampling weights, which has been described in detail by Li et al. (under revision). Briefly, we first calculated standard inverse probability weights (IPWs) for women selected in both stages by dividing the eligible population in each cell by the number of individuals selected (Figure 1). We then applied two adjustments to make the sample correctly represent the population of women who were both HPV16 and HPV18 DNA negative at enrollment (denoted by P16/18). First, we increased the weights for the 369 women selected in Stage 1 who were part of P16/18, as they were not eligible for selection in Stage 2. Second, we decreased the weights for women selected in either stage who were part of P16/18, as their IPWs were calculated to represent the same population. In other words, without this adjustment, the population P16/18 is represented twice. Our final weights allow the sample of 488 women to represent the 3,058 women in the CVT control arm who were HPV16 DNA negative, HPV18 DNA negative, or both at enrollment. We used these weights in all analyses with the exception of HPV16 SEAP-NA analyses, which included only the Stage 1 sample and therefore required standard IPWs.
We performed each analysis separately for HPV16 and HPV18. Type-specific DNA negativity at enrollment was required for inclusion in the analysis for each HPV type, resulting in inclusion of 467 women in the HPV16 analysis (weighted N = 2,786) and 477 women in the HPV18 analysis (weighted N = 2,979). We first examined distributions of GST-L1 antibody reactivity (minimum, maximum, geometric mean, and quartiles) among all subjects, among GST-L1 seropositives, and among women with and without an incident type-specific infection over follow-up.
To assess the utility of GST-L1 as a marker of cumulative HPV infection, we calculated odds ratios for GST-L1 seropositivity based on two established correlates of HPV seropositivity, age at enrollment (an HPV seropositivity correlate among younger women) and lifetime number of sexual partners at enrollment (hereafter referred to as “number of partners”) [37, 38]. To depict these relationships, we plotted seroprevalence by age and number of partners for a) GST-L1 at the laboratory cutoff, b) VLP-ELISA at the laboratory cutoff, c) GST-L1 at alternate cutoffs that maximized agreement with VLP-ELISA as described below, d) cLIA at the laboratory cutoff, and e) SEAP-NA at the laboratory cutoff.
To address whether GST-L1 indicates immune protection from future HPV infection, we calculated odds ratios for incident cervical HPV infection based on GST-L1 seropositivity at the laboratory cutoff and quintiles of GST-L1 antibody reactivity, with adjustment for number of partners.
We examined agreement between GST-L1 and VLP-ELISA, cLIA, and SEAP-NA using percent agreement, positive agreement [39], and kappa statistics. For pair-wise agreement statistics, we used both laboratory suggested and “alternate” seropositivity cutoffs, which were calculated to assess the degree to which pair-wise discordance between GST-L1 and VLP-ELISA is due to non-calibration of seropositivity cutoffs. Using VLP-ELISA as the alloy standard, we defined alternate GST-L1 and VLP-ELISA seropositivity cutoffs to maximize positive agreement and separately Youden index (sensitivity + specificity-1). Specifically, we calculated the statistic of interest (e.g. positive agreement) based on each possible cutoff for the assay in question, and identified the cutoff that gave the highest value of the statistic. We present data using alternate GST-L1 cutoffs only, as these gave better results.
We conducted analyses in R version 2.15.1 (generation of weights and calculation of odds ratios) and Stata 11 (College Station, TX, all others). Statistical significance was assessed at α = 0.05.
Results
Assay reproducibility
For GST-L1, ICCs based on our data were 99.3% for HPV16 and 96.9% for HPV18, and internal laboratory data gave CVs of 13.4% for HPV16 and 13.7% for HPV18. For VLP-ELISA, extensive testing was performed for the CVT and overall reproducibility data were calculated; the VLP-ELISA has a mean CV of 12.3% in the CVT [10]. For cLIA, ICCs based on our data were 93.1% and 92.2%, and CVs were 10.3% and 10.0%. For HPV16 SEAP-NA, the ICC and CV based on our data were 95.4% and 12.9%, respectively.
HPV16
For HPV16, GST-L1 antibody reactivity ranged from 0 to 5979 MFI; ranges among subgroups defined by seropositivity and incident infection status are shown in Table 1. Overall seroprevalence was 5.0% by GST-L1 at the laboratory cutoff, 19.4% by VLP-ELISA, 5.8% by cLIA, and 13.8% by SEAP-NA. Stratified by lifetime number of sexual partners at enrollment, seroprevalence by GST-L1 ranged from 0.5% among self-reported virgins to 17.2% among women with 3 partners (Figure 2A), and odds of seropositivity increased significantly with number of partners (OR 2.06 per partner, 95% CI 1.49-2.83). Similarly, GST-L1 seroprevalence ranged from 2.6% among 18-year-olds to 9.8% among 24-year-olds (Figure 2B), and odds of seropositivity increased significantly with age (OR 1.20 per year, 95% CI 1.03-1.40). Within categories of number of partners and age, GST-L1 seroprevalence at the 400 MFI (laboratory suggested) cutoff was very similar to cLIA but lower than VLP-ELISA and SEAP-NA (Figure 2A-B).
Table 1
Sampling-adjusted data describing antibody levels measured by the GST-L1 assay among HPV-unvaccinated women in the Costa Rica Vaccine Trial
HPV type
Min (MFI)
Max (MFI)
Geometric mean (MFI)
Q1* (MFI)
Q2*, median (MFI)
Q3* (MFI)
HPV 16
All women (N = 2,786)
0
5979
19
5
30
67
Seropositive women (N = 140)
415
5979
902
570
777
1329
HPV16 infection (N = 211)
0
1709
28
8
40
104
No HPV16 infection (N = 2575)
0
5979
18
5
30
66
HPV18
All women (N = 2,979)
0
2849
17
3
26
57
Seropositive women (N = 155)
416
2849
677
528
528
930
HPV18 infection (N = 196)
0
2696
17
9
24
33
No HPV18 infection (N = 2783)
0
2849
17
3
26
57
*Q1, Q2, and Q3 refer to the first, second, and third quartiles, respectively, of the sampling-adjusted distribution of antibody levels.
“Infection” refers to incident infection over 4 years of follow-up. Analyses are based on 467 women for HPV16 and 477 women for HPV18; displayed sample sizes are sampling-adjusted.
Figure 2
Sampling-adjusted seroprevalence measured by different assays, stratified by lifetime number of sexual partners and age at enrollment. Legend: Seroprevalence vs. number of partners (Panels A and C) and age (Panels B and D) is shown for HPV16 (Panels A-B) and HPV18 (Panels C-D). Lines represent seroprevalence by GST-L1 at the laboratory suggested seropositivity cutoff (solid line), GST-L1 at alternate cutoffs (dashed line), VLP-ELISA (solid line with diamond markers), cLIA (dashed line with triangle markers), and SEAP-NA (solid line with circle markers, HPV16 only). Alternate GST-L1 cutoffs were calculated to maximize agreement with VLP-ELISA (see Statistical Methods). Odds of GST-L1 seropositivity at the laboratory cutoff increased with each year of age for HPV16 (OR 1.20, 95% CI 1.03-1.40) and HPV18 (OR 1.20, 95% CI 1.04-1.38). Similarly, odds increased with each sexual partner for HPV16 (OR 2.06, 95% CI 1.49-2.83) and HPV18 (OR 1.59, 95% CI 1.18-2.15). For HPV18, one observation with a large weight was excluded for figure only.
Seropositivity by GST-L1 at enrollment did not indicate lower risk of incident HPV16 infection over follow-up with adjustment for number of partners (adjusted OR 1.72, 95% CI 0.95-3.13, Table 2). Similarly, higher quintiles of GST-L1 antibody reactivity did not indicate immune protection (data not shown).
Table 2
Sampling-adjusted odds of incident infection based on GST-L1 seropositivity
HPV type
Incident type-specific HPV infection
aOR* (95% CI)
No, N (%)
Yes, N (%)
HPV16
GST-L1 –
2,455 (92.8)
191 (7.2)
Reference
GST-L1 +
120 (85.7)
20 (14.3)
1.72 (0.95-3.13)
HPV18
GST-L1 –
2,633 (93.2)
191 (6.8)
Reference
GST-L1 +
151 (97.1)
5 (2.9)
0.38 (0.12-1.23)
*Odds ratio adjusted for lifetime number of sexual partners at enrollment, in categories of 0, 1, 2, 3, and ≥4.
Analyses are based on 467 women for HPV16 and 477 women for HPV18; displayed sample sizes are sampling-adjusted.
At the laboratory suggested cutoffs, overall agreement between GST-L1 and VLP-ELISA was 85.1%, and positive agreement was 39.2% (Table 3). Discordance was largely due to a substantial proportion (14.6%) of women who were seropositive by VLP-ELISA but seronegative by GST-L1 (Table 3 and Figure 3A). To assess how much GST-L1/VLP-ELISA pair-wise discordance was related to differences in seropositivity cutoffs, we examined alternate cutoffs to maximize positive agreement and, separately, Youden index. Lowering the GST-L1 cutoff from 400 to 72 MFI maximized both of these and reduced the overall percentage of discordant samples, increasing overall agreement to 88.7% and positive agreement to 68.6% (Table 3 and Figure 3A). At this cutoff, overall seroprevalence by GST-L1 increased to 16.6%, and estimates of seroprevalence stratified by age and number of partners were more similar to those by VLP-ELISA and SEAP-NA (Figure 2A-B). The proportion of samples negative by GST-L1 but positive by VLP-ELISA decreased, while inevitably the proportion of samples positive by GST-L1 but negative by VLP-ELISA increased (Table 3 and Figure 3A).
Table 3
Sampling-adjusted agreement between GST-L1 and VLP-ELISA at GST-L1 laboratory suggested (400 MFI) and alternate cutoffs
HPV type
GST-L1 cutoff (MFI)
GST-L1 + (N)
GST-L1 – (N)
Percent agreement
Positive agreement
Kappa
HPV 16
400
VLP-ELISA +
133
407
85.1%
39.2%
0.34
VLP-ELISA –
7
2,239
72
VLP-ELISA +
344
197
88.7%
68.6%
0.62
VLP-ELISA –
118
2,128
400
cLIA +
64
98
93.7%
42.1%
0.39
cLIA –
76
2,547
72
cLIA +
122
40
86.4%
39.1%
0.33
cLIA –
339
2,284
400
SEAP-NA +
92
296
86.8%
33.1%
0.27
SEAP-NA –
77
2,349
72
SEAP-NA +
199
189
79.9%
41.3%
0.30
SEAP-NA –
377
2,049
HPV 18
400
VLP-ELISA +
90
618
77.1%
20.8%
0.13
VLP-ELISA –
65
2,206
65
VLP-ELISA +
403
305
83.1%
61.5%
0.51
VLP-ELISA –
199
2,072
400
cLIA +
43
67
94.0%
32.1%
0.29
cLIA –
113
2,757
65
cLIA +
100
9
82.8%
28.2%
0.23
cLIA –
502
2,367
Analyses are based on 467 women for HPV16 and 477 women for HPV18; displayed sample sizes are sampling-adjusted. Alternate GST-L1 cutoffs were calculated to maximize agreement with VLP-ELISA (see Statistical Methods).
Figure 3
Antibody levels as measured by GST-L1 vs. VLP-ELISA among HPV-unvaccinated women. Legend: Antibody levels are displayed on a logarithmic scale for HPV16 (Panel A) and HPV18 (Panel B). Dashed lines represent laboratory suggested seropositivity cutoffs, and dotted lines represent alternate GST-L1 cutoffs calculated to maximize agreement with VLP-ELISA (see Statistical Methods). K refers to the kappa statistic, calculated separately at the laboratory (lab.) and alternate (alt.) cutoffs. Points that appear to form a line reflect assay limits of detection. Percentages displayed are sampling-adjusted and are based on laboratory cutoffs.
Positive agreement was relatively low between GST-L1 and cLIA (42.1%, Table 3) and between GST-L1 and SEAP-NA (33.1%). At the 72 MFI cutoff for GST-L1, which maximized agreement with ELISA, positive agreement with cLIA was slightly lower (39.1%) and with SEAP-NA was marginally higher (41.3%).
HPV18
For HPV18, GST-L1 antibody reactivity ranged from 0 to 2849 MFI; ranges among subgroups are shown in Table 1. Overall seroprevalence was 5.2% by GST-L1, 23.8% by VLP-ELISA, and 3.7% by cLIA. Stratified GST-L1 seroprevalence estimates ranged from 0.2% among self-reported virgins to 7.2% among women with 3 partners (Figure 2C), and odds of seropositivity increased with number of partners (OR 1.59 per partner, 95% CI 1.18-2.15). By age, seroprevalence was lowest among 20-year-olds (1.4%, Figure 2D) and highest among 22-year-olds (9.5%), and odds of seropositivity increased with age (OR 1.20 per year, 95% CI 1.04-1.38). Within categories of number of partners and age, GST-L1 seroprevalence at the 400 MFI cutoff was similar to cLIA but lower than VLP-ELISA (Figure 2C-D).
Enrollment seropositivity by GST-L1 was not significantly associated with lower risk of incident infection (adjusted OR 0.38, 95% CI 0.12-1.23). Examining quintiles of GST-L1 antibody reactivity did not alter (data not shown).
At the laboratory suggested cutoffs, overall agreement between GST-L1 and VLP-ELISA was 77.1%, and positive agreement was 20.8% (Table 3). About one-fifth of women were seropositive by VLP-ELISA but seronegative by GST-L1 (Table 3 and Figure 3B). Lowering the GST-L1 cutoff from 400 to 65 MFI maximized both positive agreement and Youden index; positive agreement nearly tripled to reach 61.5% and overall agreement increased marginally to 83.1% (Table 3 and Figure 3B). At this cutoff, overall seroprevalence by GST-L1 was 20.2%, and stratified estimates of seroprevalence were similar to those by VLP-ELISA (Figure 2C-D). As expected, the proportion of samples positive by GST-L1 but negative by VLP-ELISA increased at the lower cutoff (Table 3 and Figure 3B).
Positive agreement between GST-L1 and cLIA was low (32.1%, Table 3) and slightly lower at the 65 MFI cutoff that maximized agreement with ELISA (28.2%).
Discussion
GST-L1 multiplex serology measures antibodies to many HPV types at high-throughput and low cost, and is increasingly being used in HPV seroepidemiology. Our results support the GST-L1 assay as a marker of cumulative HPV16/18 infection, but not of future immune protection. Direct comparison between the bead-based GST-L1 and VLP-ELISA suggested only modest correlation between these two tests designed to measure cumulative HPV infection, but much of the observed lack of agreement was explained by differences between the seropositivity cutoffs for each assay.
Seroprevalence of HPV is known to increase with lifetime number of sexual partners and with age among young women [37, 38]. We noted increasing odds of GST-L1 seropositivity with each, supporting GST-L1 as a marker of cumulative HPV infection. This is consistent with documented associations between GST-L1 seropositivity and ever/never sexual activity, age at sexual debut, and lifetime number of sexual partners [22, 31, 40]. VLP-ELISA is an established HPV exposure marker [11], and we observed moderate concordance between GST-L1 and VLP-ELISA. A previous study compared GST-L1 to a VLP multiplex immunoassay, which is biologically similar but technically different from our VLP-ELISA. The authors found percent agreement of 66% and 62% between the assays for HPV16 and HPV18, respectively [25], lower than our figures of 85% and 77%.
In contrast, we found that GST-L1 serology is not a good measure of immune protection from future HPV infection; this result differs from findings for other assays. Our group previously found that HPV16 cLIA seropositivity is associated with a lower risk of incident infection, while for VLP-ELISA and SEAP-NA, the highest seropositive tertile of antibody levels indicates protection [7, 41]. Further, positive agreement between GST-L1 and both cLIA and SEAP-NA, which measure neutralizing antibodies that are believed to confer immune protection, was poor. This occurred despite similar seroprevalence estimates by GST-L1 and cLIA. Though one previous study found no difference in type-specific GST-L1 seropositivity between women with and without an incident HPV DNA infection [23], these authors and another group found associations suggesting immune protection measured by GST-L1 when using extreme or stringently defined viral outcomes [23, 42].
We do not always expect different HPV serological assays to have high pair-wise concordance, because they do not measure equivalent aspects of the immune response and their seropositivity cutoffs are not calibrated to one another. Both GST-L1 and VLP-ELISA are capable of measuring polyclonal responses, and neither is restricted to measuring neutralizing antibodies. Though the assays are similar biologically, our results demonstrate that differences in seropositivity cutoffs between GST-L1 and ELISA produce substantial pair-wise discordance. Our group previously found positive agreement for HPV16 among unvaccinated women to be 45% for VLP-ELISA/cLIA, 55% for VLP-ELISA/SEAP-NA, and 68% for cLIA/SEAP-NA [29]. In the present study, positive agreement between GST-L1 and other assays at laboratory cutoffs did not exceed 42%. One study of the early GST-based ELISA found substantial (kappa = 0.62) agreement with the VLP-based ELISA [14]. This is higher than our result (kappa = 0.34), likely because the study included a high proportion of VLP-ELISA seropositives and used a GST-L1 cutoff that gave equal numbers of seropositive samples by the two assays.
The laboratory suggested seropositivity cutoff is lower for VLP-ELISA than GST-L1 compared to their respective overall distributions over the entire range of antibody levels. The higher GST-L1 cutoff gives high specificity and seroprevalence estimates that are robust to small cutoff adjustments [43], but it produces pair-wise discordance with VLP-ELISA. In our study, lack of correspondence between cutoffs explained a large portion of pair-wise discordance between GST-L1 and VLP-ELISA, as positive agreement improved from 20-40% to 60-70% with adjustment of GST-L1 cutoffs. However, use of a lower GST-L1 cutoff increases the proportion of samples positive by GST-L1 but negative by VLP-ELISA; the samples that enter this category are visible between the reference lines for the laboratory and alternate cutoffs in the upper-left quadrants of Figure 3A-B. These discordant samples at a lower cutoff may result from nonspecific background in the GST-L1 assay [25], which complicates distinction between seronegative and low positive results. For most serologic assays, including GST-L1, seroprevalence estimates and assay sensitivity and specificity depend strongly on the seropositivity cutoff. Therefore, population studies of naturally acquired cumulative HPV infection that use GST-L1 should be interpreted in light of the cutoff employed.
Our results aid interpretation and design of research involving HPV seroepidemiology. For example, HPV16 seroprevalence has been reported as 13.0% and 7.1% in the United States and German general populations, respectively [21, 44]. However, as VLP-ELISA was used in the U.S. study and GST-L1 in the German study, the discrepancy could reflect assay differences in addition to differences in study design or true population level differences in HPV16 exposure. When choosing an assay, investigators should consider implications for comparability to other studies, specify whether they aim to measure HPV cumulative infection or immune protection, and address discrepancies that may arise due to lack of calibration between assay cutoffs. While using laboratory suggested cutoffs is important for consistency across studies using the same assay, additional analyses using alternate cutoffs may enable approximate comparison across studies using different assays. Importantly, however, comparisons are hampered by issues beyond non-calibration of seropositivity cutoffs, and would be aided by use of quality control panels and development of a universal reference standard with a known antibody concentration for many HPV types.
Strengths of our study include a well-defined source population, complete follow-up data, validated laboratory techniques, and assay reproducibility data. One limitation is that we were unable to assess the association of GST-L1 with current cervical infection, because type-specific DNA negativity was required for inclusion in each analysis. The utility of GST-L1 as a cumulative infection marker would be supported by a finding of higher GST-L1 seroprevalence among women with a current cervical infection. This has been reported by some studies [24, 31, 40] though results have not been entirely consistent [22, 23]. Finally, it is unknown whether the same alternate cutoffs calculated in our study would be obtained using other ELISA reagents, such as VLPs, or in other laboratories.
Conclusions
Our data suggest that the GST-L1 assay is a measure of cumulative HPV infection, but not future immune protection, and that a portion of pair-wise discordance between GST-L1 and VLP-ELISA is explained by lack of calibration between assay seropositivity cutoffs.
Each of the assays studied here has important advantages and disadvantages for use in seroepidemiologic research. When neutralizing responses and immune protection are of interest, SEAP-NA is the most comprehensive measure of neutralization potential but is laborious and costly; cLIA is more efficient but measures only a subset of neutralizing antibodies (i.e., antibodies that bind to one neutralizing epitope).
As a marker of cumulative HPV infection, the GST-L1 assay measures many different HPV types in a high-throughput manner at relatively low cost. However, our data suggest GST-L1 is not appropriate for use as a marker of immune protection from future cervical HPV infection, and that its comparability to cLIA and SEAP-NA is limited. The GST-L1 more closely approximates the commonly used VLP-ELISA at a lower cutoff, and may be an appropriate choice for studies aiming to assess population-level patterns in the epidemiology of cumulative infection with many HPV types.
The Costa Rica HPV Vaccine Trial is a long-standing collaboration between investigators in Costa Rica and the National Cancer Institute (NCI). The trial is sponsored and funded by the NCI (contract N01-CP-11005), with funding support from the National Institutes of Health Office of Research on Women’s Health, and done with support from the Ministry of Health of Costa Rica. Vaccine was provided for our trial by GlaxoSmithKline Biologicals, under a Clinical Trials Agreement with the NCI. GlaxoSmithKline also provided support for aspects of the trial associated with regulatory submission needs of the company under US Food and Drug Administration BB-IND 7920. This study was designed, conducted, and written by NCI investigators with input from investigators at GlaxoSmithKline.
Investigators in the Costa Rica Vaccine Trial (CVT) group.
Proyecto Epidemiológico Guanacaste, Fundación INCIENSA, San José, Costa Rica—Mario Alfaro (cytopathologist), Manuel Barrantes (field supervisor), M. Concepción Bratti (co-investigator), Fernando Cárdenas (general field supervisor), Bernal Cortés (specimen and repository manager), Albert Espinoza (head, coding and data entry), Yenory Estrada (pharmacist), Paula González (co-investigator), Diego Guillén (pathologist), Roland Herrero (co-principal investigator), Silvia E. Jiménez (trial coordinator), Jorge Morales (colposcopist), Luis Villegas (colposcopist), Lidia Ana Morera (head study nurse), Elmer Pérez (field supervisor), Carolina Porras (co-investigator), Ana Cecilia Rodríguez (co-investigator), Libia Rivas (clinical coordinator).
University of Costa Rica, San José, Costa Rica—Enrique Freer (director, HPV diagnostics laboratory), José Bonilla (head, HPV immunology laboratory), Alfanso García-Piñeres (immunologist), Sandra Silva (head microbiologist, HPV diagnostics laboratory), Ivannia Atmella (microbiologist, immunology laboratory), Margarita Ramírez (microbiologist, immunology laboratory).
United States National Cancer Institute, Bethesda, MD, USA—Allan Hildesheim (co-principal investigator & NCI co-project officer), Hormuzd Katki (stastitician), Aimée R. Kreimer (co-investigator), Douglas R. Lowy (HPV virologist), Nora Macklin (trial coordinator), Mark Schiffman (medical monitor & NCI co-project officer), John T. Schiller (HPV virologist), Mark Sherman (QC pathologist), Diane Solomon (medical monitor & QC pathologist), Sholom Wacholder (statistician).
HPV Immunology Laboratory, SAIC-Frederick Inc., Frederick National Laboratory for Cancer Research
(7)
International Agency for Research on Cancer
(8)
Center for Cancer Research, National Cancer Institute, NIH
(9)
MedImmune
(10)
PPD Vaccines and Biologics Center of Excellence
(11)
DDL Diagnostic Laboratory
References
Walboomers JM, Jacobs MV, Manos MM, Bosch FX, Kummer JA, Shah KV, Snijders PJ, Peto J, Meijer CJ, Munoz N: Human papillomavirus is a necessary cause of invasive cervical cancer worldwide. J Pathol. 1999, 189: 12-19. 10.1002/(SICI)1096-9896(199909)189:1<12::AID-PATH431>3.0.CO;2-F.View ArticlePubMedGoogle Scholar
Lowy DR, Schiller JT: Reducing HPV-associated cancer globally. Cancer Prev Res (Phila). 2012, 5: 18-23. 10.1158/1940-6207.CAPR-11-0542.View ArticleGoogle Scholar
Rodriguez AC, Schiffman M, Herrero R, Wacholder S, Hildesheim A, Castle PE, Solomon D, Burk R: Rapid clearance of human papillomavirus and implications for clinical focus on persistent infections. J Natl Cancer Inst. 2008, 100: 513-517. 10.1093/jnci/djn044.View ArticlePubMedPubMed CentralGoogle Scholar
Carter JJ, Koutsky LA, Hughes JP, Lee SK, Kuypers J, Kiviat N, Galloway DA: Comparison of human papillomavirus types 16, 18, and 6 capsid antibody responses following incident infection. J Infect Dis. 2000, 181: 1911-1919. 10.1086/315498.View ArticlePubMedGoogle Scholar
Wentzensen N, Rodriguez AC, Viscidi R, Herrero R, Hildesheim A, Ghosh A, Morales J, Wacholder S, Guillen D, Alfaro M, Safaeian M, Burk RD, Schiffman M: A competitive serological assay shows naturally acquired immunity to human papillomavirus infections in the Guanacaste Natural History Study. J Infect Dis. 2011, 204: 94-102. 10.1093/infdis/jir209.View ArticlePubMedPubMed CentralGoogle Scholar
Safaeian M, Porras C, Schiffman M, Rodriguez AC, Wacholder S, Gonzalez P, Quint W, van Doorn LJ, Sherman ME, Xhenseval V, Herrero R, Hildesheim A: Epidemiological study of anti-HPV16/18 seropositivity and subsequent risk of HPV16 and -18 infections. J Natl Cancer Inst. 2010, 102: 1653-1662. 10.1093/jnci/djq384.View ArticlePubMedPubMed CentralGoogle Scholar
Harper DM, Franco EL, Wheeler C, Ferris DG, Jenkins D, Schuind A, Zahaf T, Innis B, Naud P, De Carvalho NS, Roteli-Martins CM, Teixeira J, Blatter MM, Korn AP, Quint W, Dubin G: Efficacy of a bivalent L1 virus-like particle vaccine in prevention of infection with human papillomavirus types 16 and 18 in young women: a randomised controlled trial. Lancet. 2004, 364: 1757-1765. 10.1016/S0140-6736(04)17398-4.View ArticlePubMedGoogle Scholar
Dessy FJ, Giannini SL, Bougelet CA, Kemp TJ, David MP, Poncelet SM, Pinto LA, Wettendorff MA: Correlation between direct ELISA, single epitope-based inhibition ELISA and pseudovirion-based neutralization assay for measuring anti-HPV-16 and anti-HPV-18 antibody response after vaccination with the AS04-adjuvanted HPV-16/18 cervical cancer vaccine. Hum Vaccin. 2008, 4: 425-434. 10.4161/hv.4.6.6912.View ArticlePubMedGoogle Scholar
Coseo SE, Porras C, Dodd LE, Hildesheim A, Rodriguez AC, Schiffman M, Herrero R, Wacholder S, Gonzalez P, Sherman ME, Jimenez S, Solomon D, Bougelet C, van Doorn LJ, Quint W, Safaeian M: Evaluation of the polyclonal ELISA HPV serology assay as a biomarker for human papillomavirus exposure. Sex Transm Dis. 2011, 38: 976-982. 10.1097/OLQ.0b013e31822545c0.View ArticlePubMedPubMed CentralGoogle Scholar
Opalka D, Lachman CE, MacMullen SA, Jansen KU, Smith JF, Chirmule N, Esser MT: Simultaneous quantitation of antibodies to neutralizing epitopes on virus-like particles for human papillomavirus types 6, 11, 16, and 18 by a multiplexed luminex assay. Clin Diagn Lab Immunol. 2003, 10: 108-115.PubMedPubMed CentralGoogle Scholar
Pastrana DV, Buck CB, Pang YY, Thompson CD, Castle PE, FitzGerald PC, Kruger KS, Lowy DR, Schiller JT: Reactivity of human sera in a sensitive, high-throughput pseudovirus-based papillomavirus neutralization assay for HPV16 and HPV18. Virology. 2004, 321: 205-216. 10.1016/j.virol.2003.12.027.View ArticlePubMedGoogle Scholar
Sehr P, Muller M, Hopfl R, Widschwendter A, Pawlita M: HPV antibody detection by ELISA with capsid protein L1 fused to glutathione S-transferase. J Virol Methods. 2002, 106: 61-70. 10.1016/S0166-0934(02)00134-9.View ArticlePubMedGoogle Scholar
Waterboer T, Sehr P, Michael KM, Franceschi S, Nieland JD, Joos TO, Templin MF, Pawlita M: Multiplex human papillomavirus serology based on in situ-purified glutathione s-transferase fusion proteins. Clin Chem. 2005, 51: 1845-1853. 10.1373/clinchem.2005.052381.View ArticlePubMedGoogle Scholar
Rizk RZ, Christensen ND, Michael KM, Muller M, Sehr P, Waterboer T, Pawlita M: Reactivity pattern of 92 monoclonal antibodies with 15 human papillomavirus types. J Gen Virol. 2008, 89: 117-129. 10.1099/vir.0.83145-0.View ArticlePubMedGoogle Scholar
Sitas F, Egger S, Urban MI, Taylor PR, Abnet CC, Boffetta P, O’Connell DL, Whiteman DC, Brennan P, Malekzadeh R, Pawlita M, Dawsey SM, Waterboer T: InterSCOPE study: associations between esophageal squamous cell carcinoma and human papillomavirus serological markers. J Natl Cancer Inst. 2012, 104: 147-158. 10.1093/jnci/djr499.View ArticlePubMedPubMed CentralGoogle Scholar
Farzan SF, Waterboer T, Gui J, Nelson HH, Li Z, Michael KM, Perry AE, Spencer SK, Demidenko E, Green AC, Pawlita M, Karagas MR: Cutaneous alpha, beta and gamma human papillomaviruses in relation to squamous cell carcinoma of the skin: a population-based study. Int J Cancer. 2013, 133 (7): 1713-1720. 10.1002/ijc.28176.View ArticlePubMedPubMed CentralGoogle Scholar
Anantharaman D, Gheit T, Waterboer T, Abedi-Ardekani B, Carreira C, McKay-Chopin S, Gaborieau V, Marron M, Lagiou P, Ahrens W, Holcatova I, Merletti F, Kjaerheim K, Talamini R, Simonato L, Castellsague X, Macfarlane TV, Biggs AM, Thakker N, Znaor A, Thomson P, Canova C, Conway DI, Healy CM, Tommasino M, Pawlita M, Brennan P: Human papillomavirus infections and upper aero-digestive tract cancers: the ARCAGE study. J Natl Cancer Inst. 2013, 105: 536-545. 10.1093/jnci/djt053.View ArticlePubMedGoogle Scholar
Kreimer AR, Johansson M, Waterboer T, Kaaks R, Chang-Claude J, Drogen D, Tjonneland A, Overvad K, Quiros JR, Gonzalez CA, Sanchez MJ, Larranaga N, Navarro C, Barricarte A, Travis RC, Khaw KT, Wareham N, Trichopoulou A, Lagiou P, Trichopoulos D, Peeters PH, Panico S, Masala G, Grioni S, Tumino R, Vineis P, Bueno-de-Mesquita HB, Laurell G, Hallmans G, Manjer J, et al: Evaluation of human papillomavirus antibodies and risk of subsequent head and neck cancer. J Clin Oncol. 2013, 31: 2708-2715. 10.1200/JCO.2012.47.2738.View ArticlePubMedPubMed CentralGoogle Scholar
Michael KM, Waterboer T, Sehr P, Rother A, Reidel U, Boeing H, Bravo IG, Schlehofer J, Gartner BC, Pawlita M: Seroprevalence of 34 human papillomavirus types in the German general population. PLoS Pathog. 2008, 4: e1000091-10.1371/journal.ppat.1000091.View ArticlePubMedPubMed CentralGoogle Scholar
Dondog B, Clifford GM, Vaccarella S, Waterboer T, Unurjargal D, Avirmed D, Enkhtuya S, Kommoss F, Wentzensen N, Snijders PJ, Meijer CJ, Franceschi S, Pawlita M: Human papillomavirus infection in Ulaanbaatar, Mongolia: a population-based study. Cancer Epidemiol Biomarkers Prev. 2008, 17: 1731-1738. 10.1158/1055-9965.EPI-07-2796.View ArticlePubMedGoogle Scholar
Paaso AE, Louvanto K, Syrjanen KJ, Waterboer T, Grenman SE, Pawlita M, Syrjanen SM: Lack of type-specific concordance between human papillomavirus (HPV) serology and HPV DNA detection in the uterine cervix and oral mucosa. J Gen Virol. 2011, 92: 2034-2046. 10.1099/vir.0.032011-0.View ArticlePubMedGoogle Scholar
Wilson LE, Pawlita M, Castle PE, Waterboer T, Sahasrabuddhe V, Gravitt PE, Schiffman M, Wentzensen N: Natural immune responses against eight oncogenic human papillomaviruses in the ASCUS-LSIL triage study. Int J Cancer. 2013, 133 (9): 2172-2181. 10.1002/ijc.28215.View ArticlePubMedPubMed CentralGoogle Scholar
Scherpenisse M, Schepp RM, Mollers M, Mooij SH, Meijer CJ, Berbers GA, van der Klis FR: A comparison of different assays to assess HPV16 and 18-specific antibodies after HPV infection and vaccination. Clin Vaccine Immunol. 2013, 20 (8): 1329-1332. 10.1128/CVI.00153-13.View ArticlePubMedPubMed CentralGoogle Scholar
Sehr P, Rubio I, Seitz H, Putzker K, Ribeiro-Muller L, Pawlita M, Muller M: High-throughput pseudovirion-based neutralization assay for analysis of natural and vaccine-induced antibodies against human papillomaviruses. PLoS One. 2013, 8: e75677-10.1371/journal.pone.0075677.View ArticlePubMedPubMed CentralGoogle Scholar
Liang C, Marsit CJ, McClean MD, Nelson HH, Christensen BC, Haddad RI, Clark JR, Wein RO, Grillone GA, Houseman EA, Halec G, Waterboer T, Pawlita M, Krane JF, Kelsey KT: Biomarkers of HPV in head and neck squamous cell carcinoma. Cancer Res. 2012, 72: 5004-5013. 10.1158/0008-5472.CAN-11-3277.View ArticlePubMedPubMed CentralGoogle Scholar
Herrero R, Hildesheim A, Rodriguez AC, Wacholder S, Bratti C, Solomon D, Gonzalez P, Porras C, Jimenez S, Guillen D, Morales J, Alfaro M, Cyr J, Morrisey K, Estrada Y, Cortes B, Morera LA, Freer E, Schussler J, Schiller J, Lowy D, Schiffman M: Rationale and design of a community-based double-blind randomized clinical trial of an HPV 16 and 18 vaccine in Guanacaste, Costa Rica. Vaccine. 2008, 26: 4795-4808. 10.1016/j.vaccine.2008.07.002.View ArticlePubMedPubMed CentralGoogle Scholar
Safaeian M, Ghosh A, Porras C, Lin SW, Rodriguez AC, Schiffman M, Wacholder S, Kemp T, Gonzalez P, Wentzensen N, Esser M, Meuree A, Matys K, Quint W, van Doorn LJ, Sherman ME, Herrero R, Pinto LA, Hildesheim A: Direct comparison of HPV16 serological assays used to define HPV-naive women in HPV vaccine trials. Cancer Epidemiol Biomarkers Prev. 2012, 21: 1547-1554. 10.1158/1055-9965.EPI-12-0558.View ArticlePubMedGoogle Scholar
Waterboer T, Sehr P, Pawlita M: Suppression of non-specific binding in serological Luminex assays. J Immunol Methods. 2006, 309: 200-204. 10.1016/j.jim.2005.11.008.View ArticlePubMedGoogle Scholar
Clifford GM, Shin HR, Oh JK, Waterboer T, Ju YH, Vaccarella S, Quint W, Pawlita M, Franceschi S: Serologic response to oncogenic human papillomavirus types in male and female university students in Busan, South Korea. Cancer Epidemiol Biomarkers Prev. 2007, 16: 1874-1879. 10.1158/1055-9965.EPI-07-0349.View ArticlePubMedGoogle Scholar
Waterboer T, Dondog B, Michael KM, Michel A, Schmitt M, Vaccarella S, Franceschi S, Clifford G, Pawlita M: Dried blood spot samples for seroepidemiology of infections with human papillomaviruses, Helicobacter pylori, Hepatitis C Virus, and JC Virus. Cancer Epidemiol Biomarkers Prev. 2012, 21: 287-293. 10.1158/1055-9965.EPI-11-1001.View ArticlePubMedGoogle Scholar
Dias D, Van DJ, Schlottmann S, Kelly S, Puchalski D, Ruiz W, Boerckel P, Kessler J, Antonello JM, Green T, Brown M, Smith J, Chirmule N, Barr E, Jansen KU, Esser MT: Optimization and validation of a multiplexed luminex assay to quantify antibodies to neutralizing epitopes on human papillomaviruses 6, 11, 16, and 18. Clin Diagn Lab Immunol. 2005, 12: 959-969.PubMedPubMed CentralGoogle Scholar
Kemp TJ, Garcia-Pineres A, Falk RT, Poncelet S, Dessy F, Giannini SL, Rodriguez AC, Porras C, Herrero R, Hildesheim A, Pinto LA: Evaluation of systemic and mucosal anti-HPV16 and anti-HPV18 antibody responses from vaccinated women. Vaccine. 2008, 26: 3608-3616. 10.1016/j.vaccine.2008.04.074.View ArticlePubMedPubMed CentralGoogle Scholar
Kleter B, van Doorn LJ, ter SJ, Schrauwen L, van KK, Burger M, ter HB, Quint W: Novel short-fragment PCR assay for highly sensitive broad-spectrum detection of anogenital human papillomaviruses. Am J Pathol. 1998, 153: 1731-1739. 10.1016/S0002-9440(10)65688-X.View ArticlePubMedPubMed CentralGoogle Scholar
Kleter B, van Doorn LJ, Schrauwen L, Molijn A, Sastrowijoto S, ter SJ, Lindeman J, ter HB, Burger M, Quint W: Development and clinical evaluation of a highly sensitive PCR-reverse hybridization line probe assay for detection and identification of anogenital human papillomavirus. J Clin Microbiol. 1999, 37: 2508-2517.PubMedPubMed CentralGoogle Scholar
Coseo S, Porras C, Hildesheim A, Rodriguez AC, Schiffman M, Herrero R, Wacholder S, Gonzalez P, Wang SS, Sherman ME, Jimenez S, Solomon D, Bougelet C, van Doorn LJ, Quint W, Safaeian M: Seroprevalence and correlates of human papillomavirus 16/18 seropositivity among young women in Costa Rica. Sex Transm Dis. 2010, 37: 706-714. 10.1097/OLQ.0b013e3181e1a2c5.View ArticlePubMedGoogle Scholar
Silins I, Kallings I, Dillner J: Correlates of the spread of human papillomavirus infection. Cancer Epidemiol Biomarkers Prev. 2000, 9: 953-959.PubMedGoogle Scholar
Szklo M, Nieto FJ: Quality Assurance and Control. Epidemiology: Beyond the Basics. 2000, Gaithersburg, MD: Aspen Publishers, Inc, 375-376.Google Scholar
Syrjanen S, Waterboer T, Sarkola M, Michael K, Rintala M, Syrjanen K, Grenman S, Pawlita M: Dynamics of human papillomavirus serology in women followed up for 36 months after pregnancy. J Gen Virol. 2009, 90: 1515-1526. 10.1099/vir.0.007823-0.View ArticlePubMedGoogle Scholar
Lin SW, Ghosh A, Porras C, Markt SC, Rodriguez AC, Schiffman M, Wacholder S, Kemp TJ, Pinto LA, Gonzalez P, Wentzensen N, Esser MT, Matys K, Meuree A, Quint W, van Doorn LJ, Herrero R, Hildesheim A, Safaeian M: HPV16 Seropositivity and subsequent HPV16 infection risk in a naturally infected population: comparison of serological assays. PLoS One. 2013, 8: e53067-10.1371/journal.pone.0053067.View ArticlePubMedPubMed CentralGoogle Scholar
Wilson L, Pawlita M, Castle PE, Waterboer T, Sahasrabuddhe V, Gravitt PE, Schiffman M, Wentzensen N: Seroprevalence of eight oncogenic human papillomaviruses and acquired immunity against re-infection. J Infect Dis. 2014, in pressGoogle Scholar
Antonsson A, Pawlita M, Feltkamp MC, Bouwes Bavinck JN, Euvrard S, Harwood CA, Naldi L, Nindl I, Proby CM, Neale RE, Waterboer T: Longitudinal study of seroprevalence and serostability of the human polyomaviruses JCV and BKV in organ transplant recipients. J Med Virol. 2013, 85: 327-335. 10.1002/jmv.23472.View ArticlePubMedGoogle Scholar
Stone KM, Karem KL, Sternberg MR, McQuillan GM, Poon AD, Unger ER, Reeves WC: Seroprevalence of human papillomavirus type 16 infection in the United States. J Infect Dis. 2002, 186: 1396-1402. 10.1086/344354.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
