Skip to main content
Download PDF

Glutathione S-transferase L1 multiplex serology as a measure of cumulative infection with human papillomavirus

BMC Infectious Diseases volume 14, Article number: 120 (2014) Cite this article

Abstract

Background

Several assays are used to measure type-specific serological responses to human papillomavirus (HPV), including the bead-based glutathione S-transferase (GST)-L1 multiplex serology assay and virus-like particle (VLP)-based ELISA. We evaluated the high-throughput GST-L1, which is increasingly used in epidemiologic research, as a measure of cumulative HPV infection and future immune protection among HPV-unvaccinated women.

Methods

We tested enrollment sera from participants in the control arm of the Costa Rica Vaccine Trial (n = 488) for HPV16 and HPV18 using GST-L1, VLP-ELISA, and two assays that measure neutralizing antibodies (cLIA and SEAP-NA). With statistical adjustment for sampling, we compared GST-L1 serostatus to established HPV seropositivity correlates and incident cervical HPV infection using odds ratios. We further compared GST-L1 to VLP-ELISA using pair-wise agreement statistics and by defining alternate assay cutoffs.

Results

Odds of HPV16 GST-L1 seropositivity increased with enrollment age (OR = 1.20 per year, 95%CI 1.03-1.40) and lifetime number of sexual partners (OR = 2.06 per partner, 95%CI 1.49-2.83), with similar results for HPV18. GST-L1 seropositivity did not indicate protection from incident infection over 4 years of follow-up (HPV16 adjusted OR = 1.72, 95%CI 0.95-3.13; HPV18 adjusted OR = 0.38, 95%CI 0.12-1.23). Seroprevalence by GST-L1 (HPV16 and HPV18, respectively) was 5.0% and 5.2%, compared to 19.4% and 23.8% by VLP-ELISA, giving positive agreement of 39.2% and 20.8%. Lowering GST-L1 seropositivity cutoffs improved GST-L1/VLP-ELISA positive agreement to 68.6% (HPV16) and 61.5% (HPV18).

Conclusions

Our data support GST-L1 as a marker of cumulative HPV infection, but not immune protection. At lower seropositivity cutoffs, GST-L1 better approximates VLP-ELISA.

Peer Review reports

Background

Persistent infection with oncogenic types of human papillomavirus (HPV) is a necessary cause of virtually all cervical cancers [1] and some anogenital and oropharyngeal cancers. Together, HPV types 16 and 18 cause 70% of cervical cancers and 90% of HPV-associated anogenital and oropharyngeal cancers [2].

Measurement of HPV infection is complex. HPV DNA testing using exfoliated cervical cells is the reference standard for identifying current cervical infection, but most infections revert to DNA negativity within 1–2 years [3]. Thus, HPV DNA testing does not reflect past infections that have cleared. Cell mediated, particularly local mucosal, immune responses and generation of serum neutralizing antibodies to the L1 major capsid protein are often detected after infection [4]. These L1 antibodies better reflect both past and present HPV infection (here termed “cumulative infection”), but L1 antibodies are detectable in only about half of women within 18 months of a positive HPV DNA test [5]. Naturally acquired immunity is partially protective against newly detected type-specific HPV infection, though protection by vaccination is much more complete [6–8].

Serological responses to HPV L1 commonly feature as exposures and stratifying variables in epidemiological studies, and are measures of immunogenicity that serve as presumptive correlates of protection in vaccine trials [9]. Several biologically and technically different assays are used to measure type-specific humoral immune responses to HPV L1 capsids. The virus-like particle (VLP)-based enzyme-linked immunosorbent assay (VLP-ELISA) is an established marker of cumulative HPV infection that detects neutralizing and non-neutralizing binding antibodies [10, 11]; the competitive Luminex-based immunoassay (cLIA) measures antibodies that compete for binding by pseudovirion-neutralizing monoclonal antibodies (V5 epitope for HPV16-L1; J4 for HPV18-L1) [12]; and the secreted alkaline phosphatase L1/L2 pseudovirion neutralization assay (SEAP-NA) measures overall neutralizing potential against HPV infection [13]. In 2001, a glutathione S-transferase (GST)-L1 fusion protein-based ELISA was developed [14], which was subsequently transferred to a fluorescent bead-based multiplex format [15]. The GST-L1 assay measures both neutralizing and non-neutralizing antibodies to HPV L1 [16], most probably assembled to pentamers [14].

The GST-L1 assay can detect antibodies to up to 100 different antigens simultaneously, has been scaled up for large studies, requires a small specimen volume, and offers a low cost alternative to other assays [15]. Increasingly, the GST-L1 is being used in epidemiology to measure seropositivity to various HPV types and proteins, including L1 of HPV16 and HPV18. These studies largely focus on cancer etiology [17–20] and HPV natural history [21–24]. It is believed that the GST-L1 assay measures cumulative HPV infection and not immune protection, as it does not distinguish between neutralizing and non-neutralizing antibodies. Only an early ELISA-based version of the GST-L1 has been directly compared to the VLP-ELISA [14], while the multiplex GST-L1 has been compared to a VLP multiplex immunoassay [25]. Published data allowing comparison of GST-L1 with neutralization assays and cLIA are few [25–27].

In this study, in the context of naturally acquired HPV infection and immunity, we evaluated whether the GST-L1 assay measures cumulative HPV16/18 infection and/or future immune protection, and directly compared GST-L1 to VLP-ELISA, cLIA, and SEAP-NA.

Methods

Study population

Our study population was sampled from the control (HPV-unvaccinated) arm of the Costa Rica Vaccine Trial (CVT), which has been described in detail [28]. The control arm comprised 3,736 women aged 18–25 in Guanacaste, Costa Rica who were followed annually for 4 years, providing a serum sample at each visit. For sexually experienced women, exfoliated cervical cells were also collected during a pelvic exam and used to test for HPV DNA infection at each visit. The CVT protocol was approved by the institutional review boards of the U.S. National Cancer Institute and the Costa Rican INCIENSA, and all participants signed IRB-approved informed consent forms.

All women in the CVT control arm were tested at enrollment for HPV16/18 DNA infection at the cervix and for HPV16/18 serum antibodies using VLP-ELISA. Using these results, we sampled 500 women from the CVT control arm using a two-stage stratified random sampling scheme (Figure 1). Stage 1 selected for the HPV16 analysis, which required HPV16 DNA negativity at enrollment, and Stage 2 augmented the sample for the HPV18 analysis, which required HPV18 DNA negativity at enrollment. In Stage 1, we selected 388 of the 2,814 women who were HPV16 DNA negative at enrollment as previously described [29]. Briefly, sampling was stratified by enrollment HPV16 VLP-ELISA serology result (i.e., seropositive or seronegative) and HPV16 incident infection status over 4 years of follow-up, and was designed to ensure sufficient representation from women with positive serology and incident infections. In Stage 2, sampling was stratified by the equivalent variables for HPV18, and with a similar strategy we further sampled 112 women from the 2,582 women who were HPV18 DNA negative at enrollment and not selected in Stage 1.

Figure 1
figure 1

Two-stage stratified random sampling scheme detailing selection of 500 women from the control (HPV-unvaccinated) arm of the Costa Rica Vaccine Trial (CVT). Legend: Stage 1 selected 388 women who were HPV16 DNA-negative at the cervix at enrollment, with sampling stratified by HPV16 serostatus at enrollment and HPV16 incident infection status over 4 years of follow-up. Stage 2 augmented the sample using analogous variables for HPV18, selecting 112 women who were HPV18 DNA-negative at enrollment. Twelve women for whom an assay failed were then excluded for analysis. The combined (Stage 1 + Stage 2) sample was weighted to represent all women in the CVT control arm who were HPV16 DNA-negative, HPV18 DNA-negative, or both at enrollment. *For Sampling Stage 2, the women selected in Stage 1 were not eligible to be selected again. Thus, 369 women were removed from the pool of eligible women in Stage 2; this group includes all women selected in Stage 1 who were not HPV18 DNA positive at enrollment (N = 388 selected in Stage 1 – 19 HPV18 DNA-positives = 369).

Full size image

We performed the GST-L1, VLP-ELISA, and cLIA for HPV16 and HPV18 using enrollment serum samples from the total (N = 500) sample, and the more laborious and costly SEAP-NA for HPV16 on the Stage 1 sample only (N = 388). We assessed assay reproducibility as measured by the intraclass correlation coefficient (ICC) and coefficient of variation among seropositives (CV) for GST-L1, cLIA, and SEAP-NA using 25 blind duplicate specimens included in each batch. We excluded twelve women with failed assays, giving a final sample of 488 women.

We tested cervical samples collected annually from each woman for 4 years for HPV16/18 DNA, and used the results to determine HPV16/18 incident infection status. Detection of HPV16 DNA at any visit for a woman who was HPV16 DNA negative at enrollment constituted an incident infection, and the analogous HPV18 variable was similarly constructed. Though we refer to newly detected infections as incident, we cannot distinguish between a true incident infection, a reactivated latent infection, and a missed prevalent infection.

GST-L1 multiplex serology

Antibodies to L1 proteins of HPV16 and HPV18 were detected simultaneously by the GST-L1 multiplex assay as previously described [15, 30]. Diluted sera were incubated with sets of glutathione casein-coated, fluorescence-labeled, spectrally distinct polystyrene beads, which were loaded with GST-L1-tag fusion proteins. Bound antibodies were detected with anti-human IgG secondary antibody and streptavidin-R-phycoerythrin. Antibody levels for each serum sample are thus expressed as median fluorescence intensity (MFI) of at least 100 beads per color (i.e., antigen) per serum, calculated by subtracting the background fluorescence as determined by a negative control (i.e., no serum) from the raw MFI, then subtracting the MFI of GST-L1-tag (i.e., the fusion protein domains without viral antigen) from the MFI of the specific antigen. Seropositivity cutoffs were determined as previously described [31, 32], giving 400 MFI for HPV16 and HPV18.

VLP-ELISA

The VLP-ELISA was performed at GSK Biologicals as previously described [10]. Briefly, serial dilutions of serum samples and standards were added to ELISA microtiter plates coated with HPV VLPs. A peroxidase-conjugated anti-human polyclonal antibody was added, followed by enzyme substrate and chromogen. Reactions were stopped, and optical density (OD) at 620 nm (background) was subtracted from OD at 450 nm. Antibody levels in ELISA units (EU)/mL were calculated by interpolating OD values from the standard curve, averaging the calculated concentrations from all dilutions that fell within the working range of the reference curve. Seropositivity cutoffs were calculated as 3 standard deviations above the geometric mean titers taken from two groups of known HPV-negative individuals [10, 33], giving 8 EU/mL for HPV16 and 7 EU/mL for HPV18.

cLIA

The multiplex cLIA was performed and cutoffs were determined at PPD Vaccines and Biologicals as previously described [12, 33]. Laboratory suggested seropositivity cutoffs were 20 and 24 mMU/mL for HPV16 and HPV18, respectively.

SEAP-NA

The HPV16 SEAP-NA was performed in duplicate as previously described at the HPV Immunology Laboratory, SAIC-Frederick, Inc. [13, 34]. The seropositivity cutoff was set as 3 standard deviations over HPV DNA and seronegatives, giving 25.1 (titer).

HPV DNA testing

Detection of HPV DNA at the cervix and genotyping was conducted at DDL Diagnostic Laboratory as previously described [35, 36]. Briefly, SPF10 primer sets were used to PCR-amplify extracted DNA, then to identify the HPV genotype of SPF10-DEIA-positive samples by reverse hybridization on a line probe assay (LiPA; SPF10-DEIA/HPVLiPA25, version 1; Labo Bio-Medical Products), which detects 25 HPV genotypes. The sensitivity of HPV detection for HPV16 and HPV18 was improved via PCR with type-specific primer sets for specimens testing SPF10-DEIA positive but LiPA25 HPV16 and/or HPV18 negative.

Statistical methods

We developed a method to calculate sampling weights, which has been described in detail by Li et al. (under revision). Briefly, we first calculated standard inverse probability weights (IPWs) for women selected in both stages by dividing the eligible population in each cell by the number of individuals selected (Figure 1). We then applied two adjustments to make the sample correctly represent the population of women who were both HPV16 and HPV18 DNA negative at enrollment (denoted by P16/18). First, we increased the weights for the 369 women selected in Stage 1 who were part of P16/18, as they were not eligible for selection in Stage 2. Second, we decreased the weights for women selected in either stage who were part of P16/18, as their IPWs were calculated to represent the same population. In other words, without this adjustment, the population P16/18 is represented twice. Our final weights allow the sample of 488 women to represent the 3,058 women in the CVT control arm who were HPV16 DNA negative, HPV18 DNA negative, or both at enrollment. We used these weights in all analyses with the exception of HPV16 SEAP-NA analyses, which included only the Stage 1 sample and therefore required standard IPWs.

We performed each analysis separately for HPV16 and HPV18. Type-specific DNA negativity at enrollment was required for inclusion in the analysis for each HPV type, resulting in inclusion of 467 women in the HPV16 analysis (weighted N = 2,786) and 477 women in the HPV18 analysis (weighted N = 2,979). We first examined distributions of GST-L1 antibody reactivity (minimum, maximum, geometric mean, and quartiles) among all subjects, among GST-L1 seropositives, and among women with and without an incident type-specific infection over follow-up.

To assess the utility of GST-L1 as a marker of cumulative HPV infection, we calculated odds ratios for GST-L1 seropositivity based on two established correlates of HPV seropositivity, age at enrollment (an HPV seropositivity correlate among younger women) and lifetime number of sexual partners at enrollment (hereafter referred to as “number of partners”) [37, 38]. To depict these relationships, we plotted seroprevalence by age and number of partners for a) GST-L1 at the laboratory cutoff, b) VLP-ELISA at the laboratory cutoff, c) GST-L1 at alternate cutoffs that maximized agreement with VLP-ELISA as described below, d) cLIA at the laboratory cutoff, and e) SEAP-NA at the laboratory cutoff.

To address whether GST-L1 indicates immune protection from future HPV infection, we calculated odds ratios for incident cervical HPV infection based on GST-L1 seropositivity at the laboratory cutoff and quintiles of GST-L1 antibody reactivity, with adjustment for number of partners.

We examined agreement between GST-L1 and VLP-ELISA, cLIA, and SEAP-NA using percent agreement, positive agreement [39], and kappa statistics. For pair-wise agreement statistics, we used both laboratory suggested and “alternate” seropositivity cutoffs, which were calculated to assess the degree to which pair-wise discordance between GST-L1 and VLP-ELISA is due to non-calibration of seropositivity cutoffs. Using VLP-ELISA as the alloy standard, we defined alternate GST-L1 and VLP-ELISA seropositivity cutoffs to maximize positive agreement and separately Youden index (sensitivity + specificity-1). Specifically, we calculated the statistic of interest (e.g. positive agreement) based on each possible cutoff for the assay in question, and identified the cutoff that gave the highest value of the statistic. We present data using alternate GST-L1 cutoffs only, as these gave better results.

We conducted analyses in R version 2.15.1 (generation of weights and calculation of odds ratios) and Stata 11 (College Station, TX, all others). Statistical significance was assessed at α = 0.05.

Results

Assay reproducibility

For GST-L1, ICCs based on our data were 99.3% for HPV16 and 96.9% for HPV18, and internal laboratory data gave CVs of 13.4% for HPV16 and 13.7% for HPV18. For VLP-ELISA, extensive testing was performed for the CVT and overall reproducibility data were calculated; the VLP-ELISA has a mean CV of 12.3% in the CVT [10]. For cLIA, ICCs based on our data were 93.1% and 92.2%, and CVs were 10.3% and 10.0%. For HPV16 SEAP-NA, the ICC and CV based on our data were 95.4% and 12.9%, respectively.

HPV16

For HPV16, GST-L1 antibody reactivity ranged from 0 to 5979 MFI; ranges among subgroups defined by seropositivity and incident infection status are shown in Table 1. Overall seroprevalence was 5.0% by GST-L1 at the laboratory cutoff, 19.4% by VLP-ELISA, 5.8% by cLIA, and 13.8% by SEAP-NA. Stratified by lifetime number of sexual partners at enrollment, seroprevalence by GST-L1 ranged from 0.5% among self-reported virgins to 17.2% among women with 3 partners (Figure 2A), and odds of seropositivity increased significantly with number of partners (OR 2.06 per partner, 95% CI 1.49-2.83). Similarly, GST-L1 seroprevalence ranged from 2.6% among 18-year-olds to 9.8% among 24-year-olds (Figure 2B), and odds of seropositivity increased significantly with age (OR 1.20 per year, 95% CI 1.03-1.40). Within categories of number of partners and age, GST-L1 seroprevalence at the 400 MFI (laboratory suggested) cutoff was very similar to cLIA but lower than VLP-ELISA and SEAP-NA (Figure 2A-B).

Table 1 Sampling-adjusted data describing antibody levels measured by the GST-L1 assay among HPV-unvaccinated women in the Costa Rica Vaccine Trial
Full size table
Figure 2
figure 2

Sampling-adjusted seroprevalence measured by different assays, stratified by lifetime number of sexual partners and age at enrollment. Legend: Seroprevalence vs. number of partners (Panels A and C) and age (Panels B and D) is shown for HPV16 (Panels A-B) and HPV18 (Panels C-D). Lines represent seroprevalence by GST-L1 at the laboratory suggested seropositivity cutoff (solid line), GST-L1 at alternate cutoffs (dashed line), VLP-ELISA (solid line with diamond markers), cLIA (dashed line with triangle markers), and SEAP-NA (solid line with circle markers, HPV16 only). Alternate GST-L1 cutoffs were calculated to maximize agreement with VLP-ELISA (see Statistical Methods). Odds of GST-L1 seropositivity at the laboratory cutoff increased with each year of age for HPV16 (OR 1.20, 95% CI 1.03-1.40) and HPV18 (OR 1.20, 95% CI 1.04-1.38). Similarly, odds increased with each sexual partner for HPV16 (OR 2.06, 95% CI 1.49-2.83) and HPV18 (OR 1.59, 95% CI 1.18-2.15). For HPV18, one observation with a large weight was excluded for figure only.

Full size image

Seropositivity by GST-L1 at enrollment did not indicate lower risk of incident HPV16 infection over follow-up with adjustment for number of partners (adjusted OR 1.72, 95% CI 0.95-3.13, Table 2). Similarly, higher quintiles of GST-L1 antibody reactivity did not indicate immune protection (data not shown).

Table 2 Sampling-adjusted odds of incident infection based on GST-L1 seropositivity
Full size table

At the laboratory suggested cutoffs, overall agreement between GST-L1 and VLP-ELISA was 85.1%, and positive agreement was 39.2% (Table 3). Discordance was largely due to a substantial proportion (14.6%) of women who were seropositive by VLP-ELISA but seronegative by GST-L1 (Table 3 and Figure 3A). To assess how much GST-L1/VLP-ELISA pair-wise discordance was related to differences in seropositivity cutoffs, we examined alternate cutoffs to maximize positive agreement and, separately, Youden index. Lowering the GST-L1 cutoff from 400 to 72 MFI maximized both of these and reduced the overall percentage of discordant samples, increasing overall agreement to 88.7% and positive agreement to 68.6% (Table 3 and Figure 3A). At this cutoff, overall seroprevalence by GST-L1 increased to 16.6%, and estimates of seroprevalence stratified by age and number of partners were more similar to those by VLP-ELISA and SEAP-NA (Figure 2A-B). The proportion of samples negative by GST-L1 but positive by VLP-ELISA decreased, while inevitably the proportion of samples positive by GST-L1 but negative by VLP-ELISA increased (Table 3 and Figure 3A).

Table 3 Sampling-adjusted agreement between GST-L1 and VLP-ELISA at GST-L1 laboratory suggested (400 MFI) and alternate cutoffs
Full size table
Figure 3
figure 3

Antibody levels as measured by GST-L1 vs. VLP-ELISA among HPV-unvaccinated women. Legend: Antibody levels are displayed on a logarithmic scale for HPV16 (Panel A) and HPV18 (Panel B). Dashed lines represent laboratory suggested seropositivity cutoffs, and dotted lines represent alternate GST-L1 cutoffs calculated to maximize agreement with VLP-ELISA (see Statistical Methods). K refers to the kappa statistic, calculated separately at the laboratory (lab.) and alternate (alt.) cutoffs. Points that appear to form a line reflect assay limits of detection. Percentages displayed are sampling-adjusted and are based on laboratory cutoffs.

Full size image

Positive agreement was relatively low between GST-L1 and cLIA (42.1%, Table 3) and between GST-L1 and SEAP-NA (33.1%). At the 72 MFI cutoff for GST-L1, which maximized agreement with ELISA, positive agreement with cLIA was slightly lower (39.1%) and with SEAP-NA was marginally higher (41.3%).

HPV18

For HPV18, GST-L1 antibody reactivity ranged from 0 to 2849 MFI; ranges among subgroups are shown in Table 1. Overall seroprevalence was 5.2% by GST-L1, 23.8% by VLP-ELISA, and 3.7% by cLIA. Stratified GST-L1 seroprevalence estimates ranged from 0.2% among self-reported virgins to 7.2% among women with 3 partners (Figure 2C), and odds of seropositivity increased with number of partners (OR 1.59 per partner, 95% CI 1.18-2.15). By age, seroprevalence was lowest among 20-year-olds (1.4%, Figure 2D) and highest among 22-year-olds (9.5%), and odds of seropositivity increased with age (OR 1.20 per year, 95% CI 1.04-1.38). Within categories of number of partners and age, GST-L1 seroprevalence at the 400 MFI cutoff was similar to cLIA but lower than VLP-ELISA (Figure 2C-D).

Enrollment seropositivity by GST-L1 was not significantly associated with lower risk of incident infection (adjusted OR 0.38, 95% CI 0.12-1.23). Examining quintiles of GST-L1 antibody reactivity did not alter (data not shown).

At the laboratory suggested cutoffs, overall agreement between GST-L1 and VLP-ELISA was 77.1%, and positive agreement was 20.8% (Table 3). About one-fifth of women were seropositive by VLP-ELISA but seronegative by GST-L1 (Table 3 and Figure 3B). Lowering the GST-L1 cutoff from 400 to 65 MFI maximized both positive agreement and Youden index; positive agreement nearly tripled to reach 61.5% and overall agreement increased marginally to 83.1% (Table 3 and Figure 3B). At this cutoff, overall seroprevalence by GST-L1 was 20.2%, and stratified estimates of seroprevalence were similar to those by VLP-ELISA (Figure 2C-D). As expected, the proportion of samples positive by GST-L1 but negative by VLP-ELISA increased at the lower cutoff (Table 3 and Figure 3B).

Positive agreement between GST-L1 and cLIA was low (32.1%, Table 3) and slightly lower at the 65 MFI cutoff that maximized agreement with ELISA (28.2%).

Discussion

GST-L1 multiplex serology measures antibodies to many HPV types at high-throughput and low cost, and is increasingly being used in HPV seroepidemiology. Our results support the GST-L1 assay as a marker of cumulative HPV16/18 infection, but not of future immune protection. Direct comparison between the bead-based GST-L1 and VLP-ELISA suggested only modest correlation between these two tests designed to measure cumulative HPV infection, but much of the observed lack of agreement was explained by differences between the seropositivity cutoffs for each assay.

Seroprevalence of HPV is known to increase with lifetime number of sexual partners and with age among young women [37, 38]. We noted increasing odds of GST-L1 seropositivity with each, supporting GST-L1 as a marker of cumulative HPV infection. This is consistent with documented associations between GST-L1 seropositivity and ever/never sexual activity, age at sexual debut, and lifetime number of sexual partners [22, 31, 40]. VLP-ELISA is an established HPV exposure marker [11], and we observed moderate concordance between GST-L1 and VLP-ELISA. A previous study compared GST-L1 to a VLP multiplex immunoassay, which is biologically similar but technically different from our VLP-ELISA. The authors found percent agreement of 66% and 62% between the assays for HPV16 and HPV18, respectively [25], lower than our figures of 85% and 77%.

In contrast, we found that GST-L1 serology is not a good measure of immune protection from future HPV infection; this result differs from findings for other assays. Our group previously found that HPV16 cLIA seropositivity is associated with a lower risk of incident infection, while for VLP-ELISA and SEAP-NA, the highest seropositive tertile of antibody levels indicates protection [7, 41]. Further, positive agreement between GST-L1 and both cLIA and SEAP-NA, which measure neutralizing antibodies that are believed to confer immune protection, was poor. This occurred despite similar seroprevalence estimates by GST-L1 and cLIA. Though one previous study found no difference in type-specific GST-L1 seropositivity between women with and without an incident HPV DNA infection [23], these authors and another group found associations suggesting immune protection measured by GST-L1 when using extreme or stringently defined viral outcomes [23, 42].

We do not always expect different HPV serological assays to have high pair-wise concordance, because they do not measure equivalent aspects of the immune response and their seropositivity cutoffs are not calibrated to one another. Both GST-L1 and VLP-ELISA are capable of measuring polyclonal responses, and neither is restricted to measuring neutralizing antibodies. Though the assays are similar biologically, our results demonstrate that differences in seropositivity cutoffs between GST-L1 and ELISA produce substantial pair-wise discordance. Our group previously found positive agreement for HPV16 among unvaccinated women to be 45% for VLP-ELISA/cLIA, 55% for VLP-ELISA/SEAP-NA, and 68% for cLIA/SEAP-NA [29]. In the present study, positive agreement between GST-L1 and other assays at laboratory cutoffs did not exceed 42%. One study of the early GST-based ELISA found substantial (kappa = 0.62) agreement with the VLP-based ELISA [14]. This is higher than our result (kappa = 0.34), likely because the study included a high proportion of VLP-ELISA seropositives and used a GST-L1 cutoff that gave equal numbers of seropositive samples by the two assays.

The laboratory suggested seropositivity cutoff is lower for VLP-ELISA than GST-L1 compared to their respective overall distributions over the entire range of antibody levels. The higher GST-L1 cutoff gives high specificity and seroprevalence estimates that are robust to small cutoff adjustments [43], but it produces pair-wise discordance with VLP-ELISA. In our study, lack of correspondence between cutoffs explained a large portion of pair-wise discordance between GST-L1 and VLP-ELISA, as positive agreement improved from 20-40% to 60-70% with adjustment of GST-L1 cutoffs. However, use of a lower GST-L1 cutoff increases the proportion of samples positive by GST-L1 but negative by VLP-ELISA; the samples that enter this category are visible between the reference lines for the laboratory and alternate cutoffs in the upper-left quadrants of Figure 3A-B. These discordant samples at a lower cutoff may result from nonspecific background in the GST-L1 assay [25], which complicates distinction between seronegative and low positive results. For most serologic assays, including GST-L1, seroprevalence estimates and assay sensitivity and specificity depend strongly on the seropositivity cutoff. Therefore, population studies of naturally acquired cumulative HPV infection that use GST-L1 should be interpreted in light of the cutoff employed.

Our results aid interpretation and design of research involving HPV seroepidemiology. For example, HPV16 seroprevalence has been reported as 13.0% and 7.1% in the United States and German general populations, respectively [21, 44]. However, as VLP-ELISA was used in the U.S. study and GST-L1 in the German study, the discrepancy could reflect assay differences in addition to differences in study design or true population level differences in HPV16 exposure. When choosing an assay, investigators should consider implications for comparability to other studies, specify whether they aim to measure HPV cumulative infection or immune protection, and address discrepancies that may arise due to lack of calibration between assay cutoffs. While using laboratory suggested cutoffs is important for consistency across studies using the same assay, additional analyses using alternate cutoffs may enable approximate comparison across studies using different assays. Importantly, however, comparisons are hampered by issues beyond non-calibration of seropositivity cutoffs, and would be aided by use of quality control panels and development of a universal reference standard with a known antibody concentration for many HPV types.

Strengths of our study include a well-defined source population, complete follow-up data, validated laboratory techniques, and assay reproducibility data. One limitation is that we were unable to assess the association of GST-L1 with current cervical infection, because type-specific DNA negativity was required for inclusion in each analysis. The utility of GST-L1 as a cumulative infection marker would be supported by a finding of higher GST-L1 seroprevalence among women with a current cervical infection. This has been reported by some studies [24, 31, 40] though results have not been entirely consistent [22, 23]. Finally, it is unknown whether the same alternate cutoffs calculated in our study would be obtained using other ELISA reagents, such as VLPs, or in other laboratories.

Conclusions

Our data suggest that the GST-L1 assay is a measure of cumulative HPV infection, but not future immune protection, and that a portion of pair-wise discordance between GST-L1 and VLP-ELISA is explained by lack of calibration between assay seropositivity cutoffs.

Each of the assays studied here has important advantages and disadvantages for use in seroepidemiologic research. When neutralizing responses and immune protection are of interest, SEAP-NA is the most comprehensive measure of neutralization potential but is laborious and costly; cLIA is more efficient but measures only a subset of neutralizing antibodies (i.e., antibodies that bind to one neutralizing epitope).

As a marker of cumulative HPV infection, the GST-L1 assay measures many different HPV types in a high-throughput manner at relatively low cost. However, our data suggest GST-L1 is not appropriate for use as a marker of immune protection from future cervical HPV infection, and that its comparability to cLIA and SEAP-NA is limited. The GST-L1 more closely approximates the commonly used VLP-ELISA at a lower cutoff, and may be an appropriate choice for studies aiming to assess population-level patterns in the epidemiology of cumulative infection with many HPV types.

Abbreviations

cLIA:

Competitive Luminex immunoassay

CV:

Coefficient of variation

CVT:

Costa Rica Vaccine Trial

ELISA:

Enzyme-linked immunosorbent assay

GST:

Glutathione S-transferase

HPV:

Human papillomavirus

ICC:

Intraclass correlation coefficient

MFI:

Median fluorescence intensity

OD:

Optical density

SEAP-NA:

Secreted alkaline phosphatase neutralization assay

VLP:

Virus-like particle.

References

  1. Walboomers JM, Jacobs MV, Manos MM, Bosch FX, Kummer JA, Shah KV, Snijders PJ, Peto J, Meijer CJ, Munoz N: Human papillomavirus is a necessary cause of invasive cervical cancer worldwide. J Pathol. 1999, 189: 12-19. 10.1002/(SICI)1096-9896(199909)189:1<12::AID-PATH431>3.0.CO;2-F.

    Article  CAS  PubMed  Google Scholar 

  2. Lowy DR, Schiller JT: Reducing HPV-associated cancer globally. Cancer Prev Res (Phila). 2012, 5: 18-23. 10.1158/1940-6207.CAPR-11-0542.

    Article  Google Scholar 

  3. Rodriguez AC, Schiffman M, Herrero R, Wacholder S, Hildesheim A, Castle PE, Solomon D, Burk R: Rapid clearance of human papillomavirus and implications for clinical focus on persistent infections. J Natl Cancer Inst. 2008, 100: 513-517. 10.1093/jnci/djn044.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Stanley M: Immune responses to human papillomavirus. Vaccine. 2006, 24 (Suppl 1): S16-S22.

    Article  PubMed  Google Scholar 

  5. Carter JJ, Koutsky LA, Hughes JP, Lee SK, Kuypers J, Kiviat N, Galloway DA: Comparison of human papillomavirus types 16, 18, and 6 capsid antibody responses following incident infection. J Infect Dis. 2000, 181: 1911-1919. 10.1086/315498.

    Article  CAS  PubMed  Google Scholar 

  6. Wentzensen N, Rodriguez AC, Viscidi R, Herrero R, Hildesheim A, Ghosh A, Morales J, Wacholder S, Guillen D, Alfaro M, Safaeian M, Burk RD, Schiffman M: A competitive serological assay shows naturally acquired immunity to human papillomavirus infections in the Guanacaste Natural History Study. J Infect Dis. 2011, 204: 94-102. 10.1093/infdis/jir209.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Safaeian M, Porras C, Schiffman M, Rodriguez AC, Wacholder S, Gonzalez P, Quint W, van Doorn LJ, Sherman ME, Xhenseval V, Herrero R, Hildesheim A: Epidemiological study of anti-HPV16/18 seropositivity and subsequent risk of HPV16 and -18 infections. J Natl Cancer Inst. 2010, 102: 1653-1662. 10.1093/jnci/djq384.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Harper DM, Franco EL, Wheeler C, Ferris DG, Jenkins D, Schuind A, Zahaf T, Innis B, Naud P, De Carvalho NS, Roteli-Martins CM, Teixeira J, Blatter MM, Korn AP, Quint W, Dubin G: Efficacy of a bivalent L1 virus-like particle vaccine in prevention of infection with human papillomavirus types 16 and 18 in young women: a randomised controlled trial. Lancet. 2004, 364: 1757-1765. 10.1016/S0140-6736(04)17398-4.

    Article  CAS  PubMed  Google Scholar 

  9. Schiller JT, Lowy DR: Immunogenicity testing in human papillomavirus virus-like-particle vaccine trials. J Infect Dis. 2009, 200: 166-171. 10.1086/599988.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Dessy FJ, Giannini SL, Bougelet CA, Kemp TJ, David MP, Poncelet SM, Pinto LA, Wettendorff MA: Correlation between direct ELISA, single epitope-based inhibition ELISA and pseudovirion-based neutralization assay for measuring anti-HPV-16 and anti-HPV-18 antibody response after vaccination with the AS04-adjuvanted HPV-16/18 cervical cancer vaccine. Hum Vaccin. 2008, 4: 425-434. 10.4161/hv.4.6.6912.

    Article  CAS  PubMed  Google Scholar 

  11. Coseo SE, Porras C, Dodd LE, Hildesheim A, Rodriguez AC, Schiffman M, Herrero R, Wacholder S, Gonzalez P, Sherman ME, Jimenez S, Solomon D, Bougelet C, van Doorn LJ, Quint W, Safaeian M: Evaluation of the polyclonal ELISA HPV serology assay as a biomarker for human papillomavirus exposure. Sex Transm Dis. 2011, 38: 976-982. 10.1097/OLQ.0b013e31822545c0.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Opalka D, Lachman CE, MacMullen SA, Jansen KU, Smith JF, Chirmule N, Esser MT: Simultaneous quantitation of antibodies to neutralizing epitopes on virus-like particles for human papillomavirus types 6, 11, 16, and 18 by a multiplexed luminex assay. Clin Diagn Lab Immunol. 2003, 10: 108-115.

    CAS  PubMed  PubMed Central  Google Scholar 

  13. Pastrana DV, Buck CB, Pang YY, Thompson CD, Castle PE, FitzGerald PC, Kruger KS, Lowy DR, Schiller JT: Reactivity of human sera in a sensitive, high-throughput pseudovirus-based papillomavirus neutralization assay for HPV16 and HPV18. Virology. 2004, 321: 205-216. 10.1016/j.virol.2003.12.027.

    Article  CAS  PubMed  Google Scholar 

  14. Sehr P, Muller M, Hopfl R, Widschwendter A, Pawlita M: HPV antibody detection by ELISA with capsid protein L1 fused to glutathione S-transferase. J Virol Methods. 2002, 106: 61-70. 10.1016/S0166-0934(02)00134-9.

    Article  CAS  PubMed  Google Scholar 

  15. Waterboer T, Sehr P, Michael KM, Franceschi S, Nieland JD, Joos TO, Templin MF, Pawlita M: Multiplex human papillomavirus serology based on in situ-purified glutathione s-transferase fusion proteins. Clin Chem. 2005, 51: 1845-1853. 10.1373/clinchem.2005.052381.

    Article  CAS  PubMed  Google Scholar 

  16. Rizk RZ, Christensen ND, Michael KM, Muller M, Sehr P, Waterboer T, Pawlita M: Reactivity pattern of 92 monoclonal antibodies with 15 human papillomavirus types. J Gen Virol. 2008, 89: 117-129. 10.1099/vir.0.83145-0.

    Article  CAS  PubMed  Google Scholar 

  17. Sitas F, Egger S, Urban MI, Taylor PR, Abnet CC, Boffetta P, O’Connell DL, Whiteman DC, Brennan P, Malekzadeh R, Pawlita M, Dawsey SM, Waterboer T: InterSCOPE study: associations between esophageal squamous cell carcinoma and human papillomavirus serological markers. J Natl Cancer Inst. 2012, 104: 147-158. 10.1093/jnci/djr499.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Farzan SF, Waterboer T, Gui J, Nelson HH, Li Z, Michael KM, Perry AE, Spencer SK, Demidenko E, Green AC, Pawlita M, Karagas MR: Cutaneous alpha, beta and gamma human papillomaviruses in relation to squamous cell carcinoma of the skin: a population-based study. Int J Cancer. 2013, 133 (7): 1713-1720. 10.1002/ijc.28176.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Anantharaman D, Gheit T, Waterboer T, Abedi-Ardekani B, Carreira C, McKay-Chopin S, Gaborieau V, Marron M, Lagiou P, Ahrens W, Holcatova I, Merletti F, Kjaerheim K, Talamini R, Simonato L, Castellsague X, Macfarlane TV, Biggs AM, Thakker N, Znaor A, Thomson P, Canova C, Conway DI, Healy CM, Tommasino M, Pawlita M, Brennan P: Human papillomavirus infections and upper aero-digestive tract cancers: the ARCAGE study. J Natl Cancer Inst. 2013, 105: 536-545. 10.1093/jnci/djt053.

    Article  CAS  PubMed  Google Scholar 

  20. Kreimer AR, Johansson M, Waterboer T, Kaaks R, Chang-Claude J, Drogen D, Tjonneland A, Overvad K, Quiros JR, Gonzalez CA, Sanchez MJ, Larranaga N, Navarro C, Barricarte A, Travis RC, Khaw KT, Wareham N, Trichopoulou A, Lagiou P, Trichopoulos D, Peeters PH, Panico S, Masala G, Grioni S, Tumino R, Vineis P, Bueno-de-Mesquita HB, Laurell G, Hallmans G, Manjer J, et al: Evaluation of human papillomavirus antibodies and risk of subsequent head and neck cancer. J Clin Oncol. 2013, 31: 2708-2715. 10.1200/JCO.2012.47.2738.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Michael KM, Waterboer T, Sehr P, Rother A, Reidel U, Boeing H, Bravo IG, Schlehofer J, Gartner BC, Pawlita M: Seroprevalence of 34 human papillomavirus types in the German general population. PLoS Pathog. 2008, 4: e1000091-10.1371/journal.ppat.1000091.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Dondog B, Clifford GM, Vaccarella S, Waterboer T, Unurjargal D, Avirmed D, Enkhtuya S, Kommoss F, Wentzensen N, Snijders PJ, Meijer CJ, Franceschi S, Pawlita M: Human papillomavirus infection in Ulaanbaatar, Mongolia: a population-based study. Cancer Epidemiol Biomarkers Prev. 2008, 17: 1731-1738. 10.1158/1055-9965.EPI-07-2796.

    Article  CAS  PubMed  Google Scholar 

  23. Paaso AE, Louvanto K, Syrjanen KJ, Waterboer T, Grenman SE, Pawlita M, Syrjanen SM: Lack of type-specific concordance between human papillomavirus (HPV) serology and HPV DNA detection in the uterine cervix and oral mucosa. J Gen Virol. 2011, 92: 2034-2046. 10.1099/vir.0.032011-0.

    Article  CAS  PubMed  Google Scholar 

  24. Wilson LE, Pawlita M, Castle PE, Waterboer T, Sahasrabuddhe V, Gravitt PE, Schiffman M, Wentzensen N: Natural immune responses against eight oncogenic human papillomaviruses in the ASCUS-LSIL triage study. Int J Cancer. 2013, 133 (9): 2172-2181. 10.1002/ijc.28215.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Scherpenisse M, Schepp RM, Mollers M, Mooij SH, Meijer CJ, Berbers GA, van der Klis FR: A comparison of different assays to assess HPV16 and 18-specific antibodies after HPV infection and vaccination. Clin Vaccine Immunol. 2013, 20 (8): 1329-1332. 10.1128/CVI.00153-13.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. Sehr P, Rubio I, Seitz H, Putzker K, Ribeiro-Muller L, Pawlita M, Muller M: High-throughput pseudovirion-based neutralization assay for analysis of natural and vaccine-induced antibodies against human papillomaviruses. PLoS One. 2013, 8: e75677-10.1371/journal.pone.0075677.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Liang C, Marsit CJ, McClean MD, Nelson HH, Christensen BC, Haddad RI, Clark JR, Wein RO, Grillone GA, Houseman EA, Halec G, Waterboer T, Pawlita M, Krane JF, Kelsey KT: Biomarkers of HPV in head and neck squamous cell carcinoma. Cancer Res. 2012, 72: 5004-5013. 10.1158/0008-5472.CAN-11-3277.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Herrero R, Hildesheim A, Rodriguez AC, Wacholder S, Bratti C, Solomon D, Gonzalez P, Porras C, Jimenez S, Guillen D, Morales J, Alfaro M, Cyr J, Morrisey K, Estrada Y, Cortes B, Morera LA, Freer E, Schussler J, Schiller J, Lowy D, Schiffman M: Rationale and design of a community-based double-blind randomized clinical trial of an HPV 16 and 18 vaccine in Guanacaste, Costa Rica. Vaccine. 2008, 26: 4795-4808. 10.1016/j.vaccine.2008.07.002.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Safaeian M, Ghosh A, Porras C, Lin SW, Rodriguez AC, Schiffman M, Wacholder S, Kemp T, Gonzalez P, Wentzensen N, Esser M, Meuree A, Matys K, Quint W, van Doorn LJ, Sherman ME, Herrero R, Pinto LA, Hildesheim A: Direct comparison of HPV16 serological assays used to define HPV-naive women in HPV vaccine trials. Cancer Epidemiol Biomarkers Prev. 2012, 21: 1547-1554. 10.1158/1055-9965.EPI-12-0558.

    Article  CAS  PubMed  Google Scholar 

  30. Waterboer T, Sehr P, Pawlita M: Suppression of non-specific binding in serological Luminex assays. J Immunol Methods. 2006, 309: 200-204. 10.1016/j.jim.2005.11.008.

    Article  CAS  PubMed  Google Scholar 

  31. Clifford GM, Shin HR, Oh JK, Waterboer T, Ju YH, Vaccarella S, Quint W, Pawlita M, Franceschi S: Serologic response to oncogenic human papillomavirus types in male and female university students in Busan, South Korea. Cancer Epidemiol Biomarkers Prev. 2007, 16: 1874-1879. 10.1158/1055-9965.EPI-07-0349.

    Article  CAS  PubMed  Google Scholar 

  32. Waterboer T, Dondog B, Michael KM, Michel A, Schmitt M, Vaccarella S, Franceschi S, Clifford G, Pawlita M: Dried blood spot samples for seroepidemiology of infections with human papillomaviruses, Helicobacter pylori, Hepatitis C Virus, and JC Virus. Cancer Epidemiol Biomarkers Prev. 2012, 21: 287-293. 10.1158/1055-9965.EPI-11-1001.

    Article  CAS  PubMed  Google Scholar 

  33. Dias D, Van DJ, Schlottmann S, Kelly S, Puchalski D, Ruiz W, Boerckel P, Kessler J, Antonello JM, Green T, Brown M, Smith J, Chirmule N, Barr E, Jansen KU, Esser MT: Optimization and validation of a multiplexed luminex assay to quantify antibodies to neutralizing epitopes on human papillomaviruses 6, 11, 16, and 18. Clin Diagn Lab Immunol. 2005, 12: 959-969.

    CAS  PubMed  PubMed Central  Google Scholar 

  34. Kemp TJ, Garcia-Pineres A, Falk RT, Poncelet S, Dessy F, Giannini SL, Rodriguez AC, Porras C, Herrero R, Hildesheim A, Pinto LA: Evaluation of systemic and mucosal anti-HPV16 and anti-HPV18 antibody responses from vaccinated women. Vaccine. 2008, 26: 3608-3616. 10.1016/j.vaccine.2008.04.074.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  35. Kleter B, van Doorn LJ, ter SJ, Schrauwen L, van KK, Burger M, ter HB, Quint W: Novel short-fragment PCR assay for highly sensitive broad-spectrum detection of anogenital human papillomaviruses. Am J Pathol. 1998, 153: 1731-1739. 10.1016/S0002-9440(10)65688-X.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Kleter B, van Doorn LJ, Schrauwen L, Molijn A, Sastrowijoto S, ter SJ, Lindeman J, ter HB, Burger M, Quint W: Development and clinical evaluation of a highly sensitive PCR-reverse hybridization line probe assay for detection and identification of anogenital human papillomavirus. J Clin Microbiol. 1999, 37: 2508-2517.

    CAS  PubMed  PubMed Central  Google Scholar 

  37. Coseo S, Porras C, Hildesheim A, Rodriguez AC, Schiffman M, Herrero R, Wacholder S, Gonzalez P, Wang SS, Sherman ME, Jimenez S, Solomon D, Bougelet C, van Doorn LJ, Quint W, Safaeian M: Seroprevalence and correlates of human papillomavirus 16/18 seropositivity among young women in Costa Rica. Sex Transm Dis. 2010, 37: 706-714. 10.1097/OLQ.0b013e3181e1a2c5.

    Article  CAS  PubMed  Google Scholar 

  38. Silins I, Kallings I, Dillner J: Correlates of the spread of human papillomavirus infection. Cancer Epidemiol Biomarkers Prev. 2000, 9: 953-959.

    CAS  PubMed  Google Scholar 

  39. Szklo M, Nieto FJ: Quality Assurance and Control. Epidemiology: Beyond the Basics. 2000, Gaithersburg, MD: Aspen Publishers, Inc, 375-376.

    Google Scholar 

  40. Syrjanen S, Waterboer T, Sarkola M, Michael K, Rintala M, Syrjanen K, Grenman S, Pawlita M: Dynamics of human papillomavirus serology in women followed up for 36 months after pregnancy. J Gen Virol. 2009, 90: 1515-1526. 10.1099/vir.0.007823-0.

    Article  CAS  PubMed  Google Scholar 

  41. Lin SW, Ghosh A, Porras C, Markt SC, Rodriguez AC, Schiffman M, Wacholder S, Kemp TJ, Pinto LA, Gonzalez P, Wentzensen N, Esser MT, Matys K, Meuree A, Quint W, van Doorn LJ, Herrero R, Hildesheim A, Safaeian M: HPV16 Seropositivity and subsequent HPV16 infection risk in a naturally infected population: comparison of serological assays. PLoS One. 2013, 8: e53067-10.1371/journal.pone.0053067.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Wilson L, Pawlita M, Castle PE, Waterboer T, Sahasrabuddhe V, Gravitt PE, Schiffman M, Wentzensen N: Seroprevalence of eight oncogenic human papillomaviruses and acquired immunity against re-infection. J Infect Dis. 2014, in press

    Google Scholar 

  43. Antonsson A, Pawlita M, Feltkamp MC, Bouwes Bavinck JN, Euvrard S, Harwood CA, Naldi L, Nindl I, Proby CM, Neale RE, Waterboer T: Longitudinal study of seroprevalence and serostability of the human polyomaviruses JCV and BKV in organ transplant recipients. J Med Virol. 2013, 85: 327-335. 10.1002/jmv.23472.

    Article  PubMed  Google Scholar 

  44. Stone KM, Karem KL, Sternberg MR, McQuillan GM, Poon AD, Unger ER, Reeves WC: Seroprevalence of human papillomavirus type 16 infection in the United States. J Infect Dis. 2002, 186: 1396-1402. 10.1086/344354.

    Article  PubMed  Google Scholar 

Pre-publication history

Download references

Funding

The Costa Rica HPV Vaccine Trial is a long-standing collaboration between investigators in Costa Rica and the National Cancer Institute (NCI). The trial is sponsored and funded by the NCI (contract N01-CP-11005), with funding support from the National Institutes of Health Office of Research on Women’s Health, and done with support from the Ministry of Health of Costa Rica. Vaccine was provided for our trial by GlaxoSmithKline Biologicals, under a Clinical Trials Agreement with the NCI. GlaxoSmithKline also provided support for aspects of the trial associated with regulatory submission needs of the company under US Food and Drug Administration BB-IND 7920. This study was designed, conducted, and written by NCI investigators with input from investigators at GlaxoSmithKline.

Investigators in the Costa Rica Vaccine Trial (CVT) group.

Proyecto Epidemiológico Guanacaste, Fundación INCIENSA, San José, Costa Rica—Mario Alfaro (cytopathologist), Manuel Barrantes (field supervisor), M. Concepción Bratti (co-investigator), Fernando Cárdenas (general field supervisor), Bernal Cortés (specimen and repository manager), Albert Espinoza (head, coding and data entry), Yenory Estrada (pharmacist), Paula González (co-investigator), Diego Guillén (pathologist), Roland Herrero (co-principal investigator), Silvia E. Jiménez (trial coordinator), Jorge Morales (colposcopist), Luis Villegas (colposcopist), Lidia Ana Morera (head study nurse), Elmer Pérez (field supervisor), Carolina Porras (co-investigator), Ana Cecilia Rodríguez (co-investigator), Libia Rivas (clinical coordinator).

University of Costa Rica, San José, Costa Rica—Enrique Freer (director, HPV diagnostics laboratory), José Bonilla (head, HPV immunology laboratory), Alfanso García-Piñeres (immunologist), Sandra Silva (head microbiologist, HPV diagnostics laboratory), Ivannia Atmella (microbiologist, immunology laboratory), Margarita Ramírez (microbiologist, immunology laboratory).

United States National Cancer Institute, Bethesda, MD, USA—Allan Hildesheim (co-principal investigator & NCI co-project officer), Hormuzd Katki (stastitician), Aimée R. Kreimer (co-investigator), Douglas R. Lowy (HPV virologist), Nora Macklin (trial coordinator), Mark Schiffman (medical monitor & NCI co-project officer), John T. Schiller (HPV virologist), Mark Sherman (QC pathologist), Diane Solomon (medical monitor & QC pathologist), Sholom Wacholder (statistician).

SAIC, NCI-Frederick, Frederick, MD, UDA—Ligia Pinto (head, HPV immunology laboratory), Troy Kemp (immunologist).

Women’s and Infants’ Hospital, Providence, RI, USA—Claire Eklund (QC cytology), Martha Hutchinson (QC cytology).

Georgetown University, Washington, DC, USA—Mary Sidawy (histopathologist),

DDL Diagnostic Laboratory, Netherlands—Wim Quint (virologist, HPV DNA testing), Leen-Jan van Doorn (HPV DNA testing).

Investigators at GlaxoSmithKline.

Sylviane Poncelet, Bénédicte Brasseur.

Information Management Services.

Brian Befano.

Author information

Authors and Affiliations

  1. Division of Cancer Epidemiology and Genetics, National Cancer Institute, NIH, Rockville, Maryland, USA

    Hilary A Robbins, Yan Li, Mark Schiffman, Sholom Wacholder, Allan Hildesheim & Mahboobeh Safaeian

  2. Joint Program for Survey Methodology, University of Maryland, College Park, Maryland, USA

    Yan Li

  3. Proyecto Epidemiológico Guanacaste, Fundación INCIENSA, Guanacaste, Costa Rica

    Carolina Porras, Ana Cecilia Rodriguez, Paula Gonzalez & Rolando Herrero

  4. German Cancer Research Center (DKFZ), Heidelberg, Germany

    Michael Pawlita & Tim Waterboer

  5. Public Health Foundation of India, New Delhi, India

    Arpita Ghosh

  6. HPV Immunology Laboratory, SAIC-Frederick Inc., Frederick National Laboratory for Cancer Research, Frederick, Maryland, USA

    Troy J Kemp & Ligia A Pinto

  7. International Agency for Research on Cancer, Lyon, France

    Paula Gonzalez & Rolando Herrero

  8. Center for Cancer Research, National Cancer Institute, NIH, Bethesda, Maryland, USA

    John Schiller & Douglas Lowy

  9. MedImmune, Gaithersburg, Maryland, USA

    Mark Esser

  10. PPD Vaccines and Biologics Center of Excellence, Wayne, Pennsylvania, USA

    Katie Matys

  11. DDL Diagnostic Laboratory, Rijswijk, The Netherlands

    Wim Quint & Leen-Jan van Doorn

Authors
  1. Hilary A Robbins
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Carolina Porras
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Michael Pawlita
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Arpita Ghosh
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ana Cecilia Rodriguez
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Mark Schiffman
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Sholom Wacholder
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Troy J Kemp
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Paula Gonzalez
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. John Schiller
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Douglas Lowy
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Mark Esser
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Katie Matys
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Wim Quint
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Leen-Jan van Doorn
    View author publications

    You can also search for this author in PubMed Google Scholar

  17. Rolando Herrero
    View author publications

    You can also search for this author in PubMed Google Scholar

  18. Ligia A Pinto
    View author publications

    You can also search for this author in PubMed Google Scholar

  19. Allan Hildesheim
    View author publications

    You can also search for this author in PubMed Google Scholar

  20. Tim Waterboer
    View author publications

    You can also search for this author in PubMed Google Scholar

  21. Mahboobeh Safaeian
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hilary A Robbins.

Additional information

Competing interests

One or more of the authors is employed by a commercial company. These include: Mark Esser, MedImmune; Katie Matys, PPD Vaccines and Biologics; Wim Quint and Leen-Jan van Doorn, DDL Diagnostic Laboratory. John Schiller and Douglas Lowy report that they are named inventors on U.S. Government-owned HPV vaccine patents that are licensed to GlaxoSmithKline and Merck and for which the National Cancer Institute receives licensing fees. They are entitled to limited royalties as specified by federal law. The other authors declare that they have no conflicts of interest.

Authors’ contributions

Conception and design: HAR, YL, MP, AG, M. Schiffman, SW, RH, AH, TW, M. Safaeian. Acquisition of data: CP, AG, ACR, M. Schiffman, SW, PG, JS, DL, RH, LAP, AH, M. Safaeian. Serological assays: MP, TJK, ME, KM, WQ, LJvD, LAP, TW. Statistical analysis: HAR, YL, AG, M. Safaeian. Interpretation of data: HAR, YL, MP, M. Schiffman, SW, TJK, DL, LAP, AH, TW, M. Safaeian. Drafting and revision of manuscript: HAR, YL, CP, MP, AG, ACR, M. Schiffman, SW, TJK, PG, JS, DL, ME, KM, WQ, LJvD, RH, LAP, AH, TW, M. Safaeian. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Cite this article

Robbins, H.A., Li, Y., Porras, C. et al. Glutathione S-transferase L1 multiplex serology as a measure of cumulative infection with human papillomavirus. BMC Infect Dis 14, 120 (2014). https://doi.org/10.1186/1471-2334-14-120

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2334-14-120

Keywords

  • Median Fluorescence Intensity
  • Incident Infection
  • Lifetime Number
  • Positive Agreement
  • Alternate Cutoff

BMC Infectious Diseases

ISSN: 1471-2334

Contact us