Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Comparison of DNA testing strategies in monitoring human papillomavirus infection prevalence through simulation

BMC Infectious Diseases volume 16, Article number: 642 (2016) Cite this article

Abstract

Background

HPV DNA diagnostic tests for epidemiology monitoring (research purpose) or cervical cancer screening (clinical purpose) have often been considered separately. Women with positive Linear Array (LA) polymerase chain reaction (PCR) research test results typically are neither informed nor referred for colposcopy. Recently, a sequential testing by using Hybrid Capture 2 (HC2) HPV clinical test as a triage before genotype by LA has been adopted for monitoring HPV infections. Also, HC2 has been reported as a more feasible screening approach for cervical cancer in low-resource countries. Thus, knowing the performance of testing strategies incorporating HPV clinical test (i.e., HC2-only or using HC2 as a triage before genotype by LA) compared with LA-only testing in measuring HPV prevalence will be informative for public health practice.

Method

We conducted a Monte Carlo simulation study. Data were generated using mathematical algorithms. We designated the reported HPV infection prevalence in the U.S. and Latin America as the “true” underlying type-specific HPV prevalence. Analytical sensitivity of HC2 for detecting 14 high-risk (oncogenic) types was considered to be less than LA. Estimated-to-true prevalence ratios and percentage reductions were calculated.

Results

When the “true” HPV prevalence was designated as the reported prevalence in the U.S., with LA genotyping sensitivity and specificity of (0.95, 0.95), estimated-to-true prevalence ratios of 14 high-risk types were 2.132, 1.056, 0.958 for LA-only, HC2-only, and sequential testing, respectively. Estimated-to-true prevalence ratios of two vaccine-associated high-risk types were 2.359 and 1.063 for LA-only and sequential testing, respectively. When designated type-specific prevalence of HPV16 and 18 were reduced by 50 %, using either LA-only or sequential testing, prevalence estimates were reduced by 18 %.

Conclusion

Estimated-to-true HPV infection prevalence ratios using LA-only testing strategy are generally higher than using HC2-only or using HC2 as a triage before genotype by LA. HPV clinical testing can be incorporated to monitor HPV prevalence or vaccine effectiveness. Caution is needed when comparing apparent prevalence from different testing strategies.

Peer Review reports

Background

Cervical cancer is the third most common cancer among women and the second most frequent cause of cancer-related deaths, accounting for approximately 300,000 deaths annually worldwide [1]. More than 80 % of these cervical cancer related deaths occurs in low-resource countries [2]. Human papillomavirus (HPV) infections have been identified as a necessary cause of cervical cancer [3–5]. Screening and vaccination are the best strategies for reducing cervical cancer incidence. HPV-clinical DNA testing has been considered as a more cost- effective and feasible approach [3]. Since HPV vaccination was introduced in 2006, many developed countries also have initiated HPV immunization programs for adolescents [6–8]. While the high cost of HPV vaccination remains a barrier, HPV vaccine has been introduced in some developing countries successfully [9]. Because cervical cancer outcomes take years to observe, monitoring HPV infections has served as an early indication of vaccine effectiveness [7, 10–13]. In this study, we compare three HPV DNA testing strategies for monitoring HPV infection prevalence.

Molecular testing methods are available for detecting HPV infections for research or for clinical purposes. Polymerase chain reaction (PCR)-based DNA genotyping tests using target amplification technique can detect the existence of minute amounts of virus and have been considered as the “gold standard” for detecting infectious organisms [14, 15]. Linear Array (LA) genotyping assay is the commercialized version of PCR genotyping testing designed to standardize the PCR process for detecting existence of HPV DNA for research purposes. The LA genotyping assay is based on PCR amplification of a 450-bp sequence of the L1 region by using PGMY09/11 primer, hybridization of the amplified product to oligonucleotide probes, and their detection by colorimetric reaction [16]. LA can detect 37 HPV genotypes simultaneously. The test has been used in epidemiological and clinical research studies to detect HPV infections and is also the most widely used assay by HPV LabNet laboratories to monitor HPV infection prevalence for HPV vaccine effectiveness [17]. By comparison, commercially available Digene Hybrid Capture 2 (HC2) clinical-HPV assay uses the signal amplified hybridization microplate-based technique to detect HPV DNA presence. The HC2 clinical HPV test is an aggregate test that detects 13 high-risk (oncogenic) types (HPV16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, and 68), and because of cross-reactivity, it can also detect HPV66. HC2 is designed to detect high enough viral loads (i.e., clinically relevant viral loads), and it has been used as a co-test with the Papanicolaou smear test or a clinical test alone for screening women likely to develop or who have already developed cervical cancer. The HC2 assay has also been used as a reference test in studies evaluating newly developed clinical-HPV assays [18, 19].

PCR genotyping test has been used to monitor HPV infection prevalence and vaccine effectiveness for research purposes because of its high analytical sensitivity. Women with positive PCR genotyping test results typically are neither informed nor referred for colposcopy, and the PCR processing procedures can be complex and labor-intensive. Recently, a sequential testing strategy using HC2 as a triage and genotype only those HC2 positive specimens by LA PCR has been used to monitor HPV infections in China and England [20, 21]. Using PCR genotyping assays to monitor HPV infections is also not feasible in low-resource countries [22–24]. Alternatively, HC2 has been reported as a more feasible screening approach in low-resource countries [3, 23] because HC2 (particularly, careHPV, the developed countries version of HC2) does not require special facilities and is less labor-intensive than PCR-based methods [22, 25, 26]. Thus, knowing the performance of testing strategies incorporating HPV-clinical HC2, compared with using LA-only PCR testing, in measuring HPV infection prevalence will be informative for public health practice.

Since sensitivities and specificities of these testing strategies may not be easily obtained and the true HPV infection prevalence is normally not known, we use Monte Carlo simulation approach to compare different testing strategies. Simulation methods have been used for answering “what-if” questions. For example, IF the “true” prevalence level is “a” and IF the sensitivity/specificity of the test is “b”/”c”, the simulation will provide information on what we expect to measure as the apparent prevalence (estimate) and thus the difference (bias) between the “true” and apparent prevalence (estimate). In this study, we use the reported HPV prevalence from the US and Latin America as the “true” HPV prevalence level. What we try to answer is, if the “true” prevalence is at the level as the reported prevalence in the US and Latin America and we use the test with sensitivity and specificity as specified, what is the apparent prevalence based on the testing strategy (i.e., LA-only, HC2-only, and sequential testing by using HC2 as a triage and genotyped by LA for HC2-positive specimens)? What is the ratio of the apparent prevalence to the “true” prevalence?

Methods

Simulation setup

The Monte Carlo simulation approach similar to Lin et al. [27, 28] was extended to incorporate various testing strategies. Analytical sensitivity is the probability of truly infected subjects with a positive test result; analytical specificity is the probability of truly uninfected subjects with a negative result. Mathematical algorithms with designated values of “true” underlying type-specific prevalence, genotyping assay analytical sensitivity and specificity, and correlations among HPV types were used to generate data.” True” type-specific infectious statuses were determined on the basis of the designated type-specific prevalence. The genotyping test results were determined based on the basis of type-specific infection status and genotyping test performance (i.e., analytical sensitivity and specificity). Without loss of generalizability, the total number of subjects in each data set was set at 4,000, and correlations between HPV types were set at 0.06. For each simulated data set, there are “true” type-specific infectious status of 14 high-risk (oncogenic) types, the LA genotyping test results of 14 high-risk types and the HC2 result for each of the 4000 subject. Five hundred data sets were generated for each scenario. Mean and standard deviation of the “true” and apparent prevalence (estimates) of 500 data sets were calculated. Mathematical algorithms related to our simulation setup were given in the literature [27, 28].

To simulate scenarios on the basis of both high- and low-resource regions, the reported prevalence of the 14 high-risk HPV types for the United States and Latin America were designated as the known “true” underlying type-specific prevalence (Fig. 1) [29, 30]. HPV type-specific prevalence in Latin America was lower than in the United States, and the relative HPV infection prevalence was also different.

Fig. 1
figure 1

The reported type-specific prevalence of the 14 high-risk (oncogenic) types of the United States and Latin America

Full size image

LA genotyping assay (type-specific) analytical sensitivity and specificity were initially set as (0.95, 0.95) to reflect the scenarios where specimens were carefully handled and PCR procedures were conducted adequately. Since various factors (i.e., precisely executing processing procedures, number and quality of virus genomes presented in the samples, etc.) could affect the performance of LA, LA genotyping assay analytical sensitivity and specificity were subsequently varied from (0.95, 0.95) to (0.95, 0.90), (0.95, 0.85), (0.90, 0.90), (0.90, 0.85), (0.85, 0.85), (0.80, 0.80). The idealistic scenario, LA genotyping assay analytical performance reached (1.00, 1.00), was also considered.

To obtain HC2 results, we based our study on the test results of 8,403 women participating in the U.S. NHANES (2003–2010) study with both LA and HC2 test conducted [9]. Forty-five percent of subjects with at least one LA-positive test among 14 high-risk HPV types also tested positive by HC2, and 93 % of subjects with all LA type-specific negative results also tested negative by HC2. This was equivalent to that the analytical sensitivity of HC2 in detecting any of the 14 high-risk HPV types was approximately 50 % lower than LA, but the analytical specificity was similar.

For each simulated data set, the data included the “true” type-specific infectious status of 14 high-risk types, the LA genotyping test results of 14 high-risk types and the HC2 result of the 4,000 subject. Using the simulated data, the “true” prevalence, estimated prevalence and estimated-to-“true” prevalence ratios from various testing strategies based on the following definition were calculated.

“True” and estimated infection prevalence

Four outcome measures: 14 oncogenic high-risk types, 2 vaccine-associated high-risk types (HPV16 or HPV18 based on bivalent and quadrivalent HPV vaccine), type-specific HPV16, and type-specific HPV 18 were considered. HPV 16 and HPV 18 infections account for approximately 70 % of invasive cervical cancer globally [31, 32]. The “true” prevalence of each outcome measure was defined as the proportion of subjects having HPV infections. The “true” infection status of the four outcome measures were defined as follows: for each subject, the “true” positive infection status of the 14 high-risk types or the 2 vaccine-associated high-risk types was defined as having at least one of the 14 high-risk or the 2 vaccine-associated high-risk types, respectively. The “true” positive type-specific infection status of HPV16/HPV18 was defined as having type-specific infection of HPV16/HPV18.

Apparent prevalence (estimates) of each outcome measure was defined as a proportion of subjects with positive test results from different testing strategies. For the LA-only testing strategy, specimens taken from all subjects were genotyped by LA, therefore, the type-specific results of 14 HPV type were available. A positive LA test outcome of the 14 high-risk types and the 2 vaccine-associated high-risk types was defined as having at least one positive LA type-specific result of the 14 high-risk types and two positive vaccine-associated high-risk types, respectively. A positive test outcome of individual type-specific HPV16 or HPV18 was defined as having a positive HPV16 or HPV18 LA genotyping result, respectively.

For the HC2 clinical HPV testing-only strategy, specimens of all subjects were tested by HC2, therefore, HC2 results were available for all subjects. A positive HC2 test result was defined as subjects with at least one of the 14 high-risk HPV types. Since HC2 test result was an aggregate result, no type-specific result was available.

For the sequential testing strategy, specimens of all subjects were tested by HC2 first, and only those specimens with positive HC2 results were genotyped by LA. Therefore, for HC2 negative subjects, the LA type-specific results were not available. A positive sequential test outcome of the 14 high-risk types was defined as having both HC2-positive and at least one positive LA type-specific result of the 14 high-risk types. Similarly, a positive sequential test outcome of the two vaccine-associated high-risk types was defined as having a positive HC2 result and at least one positive LA type-specific result of two vaccine-associated high-risk types. A positive sequential test outcome of HPV16/HPV18 was defined as having positive HC2 and HPV16/HPV18 type-specific LA results.

The estimated-to-true prevalence ratio was calculated to examine how well prevalence estimates that were based on different testing strategies measured the designated “true” prevalence. A ratio >1 indicated the prevalence estimate overestimated the designated “true” prevalence. A ratio <1 indicated the prevalence estimate underestimated the designated “true” prevalence. To examine vaccine effectiveness, for demonstration purpose, the designated “true” type-specific prevalence of vaccine-associated high-risk types (i.e., HPV16 and HPV18) were reduced by 50 %. Percentage reductions of prevalence estimates of the 14 high-risk types, two vaccine-associated high-risk types, HPV16, and HPV18 that were based on different testing strategies were calculated.

Results

Apparent prevalence (estimates) of the 14 high-risk HPV types by various testing strategies are given in Table 1. In the idealistic scenario, when the analytic sensitivity and specificity of LA genotyping assay reach (1.00, 1.00), as expected, the LA-only testing strategy performs the best. When LA genotyping assay sensitivity and specificity are ≤0.95 and ≤0.95, respectively, prevalence estimates from all three testing strategies generally overestimat designated infection prevalence of the 14 high-risk types. The prevalence estimate from the LA-only testing strategy is higher than the HC2-only or sequential testing strategies.

Table 1 Designated and estimated prevalence of the 14 high-risk virus types by Linear Array (LA)-only, Hybrid Capture (HC2)-only, and sequential testing strategies in the United States and Latin America
Full size table

Estimated-to-true prevalence ratios are larger in the Latin America scenarios than in the U.S. scenarios because the designated “true” type-specific infections are lower in Latin America. When LA genotyping assay sensitivity and specificity are equal to (0.95,0.95) and the designated individual type-specific infection prevalence rates of HPV16 and HPV18 are reduced by 50 %, the designated “true” composite infection prevalence of 14 high-risk types is decreased by 7.6 % in the United States and 19.2 % in Latin America. The estimated reductions of 14 high-risk types from the LA-only, HC2-only, and sequential testing strategies are similar (1.6 %, 1.3 %, and 1.5 % for the United States and 1.7 %, 1.1 %, and 1.7 % for Latin America) and much lower than the designated “true” percentage reduction.

When LA genotyping assay sensitivity and specificity are ≤0.95 and ≤0.95, respectively, using either the LA-only or the sequential testing strategy overestimates the designated “true” prevalence of the two vaccine-associated high-risk types (Table 2). The prevalence estimates using the LA-only testing strategy are higher than using the sequential testing strategy. Similarly, compared with the U.S. scenarios, estimated-to-true prevalence ratios are higher when the “true” prevalence is designated as the reported prevalence in Latin America. When the designated “true” type-specific prevalence of HPV16 and HPV18 are reduced by 50 %, composite prevalence estimates calculated on the basis of either the LA-only or the sequential testing strategy underestimate the designated reduction.

Table 2 Designated and estimated prevalence of two vaccine-associated high-risk types by Linear Array (LA)-only and sequential testing strategies in the United States and Latin America
Full size table

Designated “true” and estimated type-specific prevalence for HPV16 are displayed in Table 3 and for HPV18 in Table 4. When LA genotyping sensitivity and specificity reach (1.00 1.00), LA-only performs best. The sequential testing strategy typically underestimates the designated underlying prevalence. When LA genotyping assay sensitivity and specificity are ≤0.95 and ≤0.95, respectively, the prevalence estimates from the LA-only testing strategy generally overestimate the designated “true” infection prevalence of HPV16 or HPV18. For HPV16, in certain scenarios, the prevalence estimates from sequential testing strategies underestimate the designated prevalence. Similarly, reducing the designated individual type-specific prevalence of HPV16 and HPV18 by 50 % when using either the LA-only or the sequential testing strategy underestimates the designated reduction.

Table 3 Designated and estimated prevalence of HPV16 by Linear Array (LA)-only and sequential testing strategies in the United States and Latin America
Full size table
Table 4 Designated and estimated prevalence of HPV18 by Linear Assay (LA)-only and sequential testing strategies in the United States and Latin America
Full size table

Discussion

With >80 % of the cervical cancer-related deaths occurring in low-resource countries where women in most of these countries typically do not have access to effective screening or treatment before, successful introduction of using HPV-clinical test to screen cervical cancer is substantially beneficial in identifying women at risk of developing severe cervical cell abnormalities for cervical cancer prevention [3]. Availability of using HPV-clinical testing to screen cervical cancer in low-resource countries might allow public health officials to use the data to monitor HPV infection in ways not previously possible. Since HPV diagnostic testing strategies for epidemiological monitoring and cervical cancer screening have been considered separately, we have used a Monte Carlo simulation approach to investigate how well the apparent prevalence based on HC2-only and sequential testing strategies compared to LA-only measures the designated “true” prevalence. The results suggest that HPV clinical testing can be incorporated to monitor HPV prevalence or vaccine effectiveness and the apparent prevalence based on different testing strategies can be different.

Our simulation study is based on the assumption that analytical sensitivity of HC2 for detecting existence of the 14 high-risk HPV types is lower than LA-only but the analytical specificity is similar between the two. The HC2 clinical test is designed to detect high enough viral loads (i.e., clinically relevant viral loads). Analytical sensitivity of the LA is at the sub-picogram level of HPV DNA and analytical sensitivity of HC2 is at the picogram level [33–36]. Therefore, among infected subjects, the number of subjects who test LA positive is higher than the number of subjects who test HC2 positive. The magnitude of difference between analytical sensitivities of LA and HC2 depends on the distribution of the viral load of the infected subjects. When a large portion of the HPV infected subjects are with lower viral load (i.e., lower than the HC2 detection limit of 5,000 genomes), the analytical sensitivity of LA is much higher than HC2. When a smaller portion of the HPV infected subjects is with lower viral load, the analytical sensitivity of LA is closer to the analytical sensitivity of HC2. In our study, the association between HC2 and LA test results is based on samples from 8,403 women in the U.S. NHANES (2003 to 2010) studies for whom both LA and HC2 test results collected. It is equivalent to the scenario of analytical sensitivity of HC2 being approximately 50 % lower than LA, but specificity being similar. We further investigate the scenario, HC2 and LA results are more agreeable, which is based on the pap cohort Study [37]. Among 1,849 women, 83 % of LA test-positive subjects were tested positive by using HC2, and 84 % of LA test-negative subjects were also tested negative by using HC2. This is equivalent to analytical sensitivity of HC2 for detecting the 14 high-risk types is approximately 15 % lower than LA, but analytical specificity is similar. As expected, the conclusions are similar (simulation results not shown).

For demonstration purpose, the 50 % reduction of type 16 and 18 prevalence is chosen in this simulation study. The estimated vaccine effectiveness (reduction in prevalence) in the literature [9] is much lower than 50 % because of low coverage rate. Since the objective is to examine three testing strategies when infection prevalence is reduced, the 50 % reduction serves the purpose.

We consider type-specific infections to be correlated because the risk factors of getting infected by various virus types are similar and subjects with weaker immune system are more likely to get infected and stay infected. The correlations between HPV types in this simulation study were set to be 0.06 which was based on the average value of 91 pairwise correlations of the LA genotyping results of the 14 high-risk HPV types in the 2003–2006 National Health and Nutrition Examination Surveys (NHANES).

Discussion of using PCR genotyping assay to monitor HPV is given elsewhere [27]. Estimated-to-true prevalence ratios using the LA-only testing strategy are high. It is because we still get enough false-positives in a low-prevalence setting even when specificity is as high as 0.95, therefore, overestimate the “true” prevalence substantially. Taking a type-specific HPV infection as an example, this result can be easily seen from the following equation:

Apparent prevalence = sensitivity*true prevalence + (1-specificity) * (1- true prevalence).

The influence of the “true” prevalence level on the magnitude of overestimation can also be seen by comparing results from the US with those form the Latin America. The magnitude of over-estimation is more severe in Latin America. This is because the “true” type-specific infection prevalence is generally lower in Latin America.

The simulation results suggest that clinical-HC2 can be used as a triage before genotype to monitor HPV prevalence. Compared with LA-only testing strategy, that estimated-to-true prevalence ratios using the sequential testing strategy are closer to 1. In addition, the sequential testing strategy might be more compatible with cervical cancer screening programs. HC2 results for women aged ≥30 years can be used to screen for cervical cancer. In contrast, subjects with positive LA results are neither informed nor referred for colposcopy. Also, sequential testing strategy might reduce costs by greatly reducing the number of genotyping tests [38].

The simulation results also reveal that HC2-only can be used to monitor HPV prevalence of the 14 high-risk types, despite HC2 having lower analytical sensitivity than LA. The estimated-to-true prevalence ratios of the 14 high-risk HPV types from an HC2-only testing strategy are closer to 1 than the LA-only testing strategy. When the designated “true” underlying vaccine-associated high-risk types (HPV16 and HPV18) are reduced by 50 %, similar to using the LA-only testing strategy, prevalence estimates of the 14 high-risk types from HC2-only testing strategy also decline. Either using the LA-only or the HC2-only testing strategy underestimates the designated “true” reduction.

Other possible benefits exist to incorporating the HC2 clinical test for monitoring HPV infections. HC2 (particularly, careHPV, the developed countries version of HC2) procedures are less complex and less labor-intensive, therefore, less subject to human error. HC2 testing using the automation provided by a rapid capture system can achieve high-volume throughput [39]. Also, performance (sensitivities and specificities) of commercially manufactured HC2 has been reported to be highly reliable and reproducible in cervical cancer screening setting [22, 40]. High repeatability and consistent performance of HC2 testing allows public health professionals to compare HPV prevalence estimates of the 14 high-risk types across different geographic areas.

The simulations were conducted on the basis of an assumption that analytical sensitivity of LA-only testing is higher than sensitivity of HC2-only testing. When PCR procedures are performed incorrectly according to standard protocols, performance of LA might be worse than the performance of HC2, which was not considered in our study. Additionally, we did not consider the scenarios of cross-protection or type replacement attributable to vaccination in this simulation study because evidence of cross-protection and type replacement is inconclusive [41]. Conducting a cost-benefit analysis to compare LA-only testing strategy with HC2 as a triage before LA for monitoring HPV prevalence among specific age groups or within regions might be beneficial. Bias introduced because of study design (e.g., sampling strategy), confounders (e.g., demographic characteristics or sexual behaviors), or missing data are also beyond the scope of this paper. Future studies are needed to investigate the impact of those factors. Future study can also be extended to incorporate the newly approved Cobas HPV-clinical test and nine-valent HPV vaccine.

Conclusion

Estimated-to-true HPV infection prevalence ratios using LA-only testing strategy are generally higher than using HC2-only or using HC2 as a triage before genotype by LA. Clinical HPV test can be incorporated to monitor HPV infection prevalence. Data from screening through HPV-clinical test may be utilized for epidemiological monitoring. Caution is needed since the intervention effectiveness can be underestimated and the apparent prevalence from different testing strategies can be different.

Abbreviations

DNA:

Deoxyribonucleic acid

HC2:

Hybrid Capture 2

HPV:

Human papillomavirus

LA:

Linear Array

PCR:

Polymerase chain reaction

References

  1. Termrusnfrunglert W, Havanond P, Khemapech N, et al. Cost and effectiveness evaluation of prophylactic HPV vaccine in developing countries. Value Health. 2012;15(1 Suppl):S29–34.

    Article  Google Scholar 

  2. Agosti JM, Goldie SJ. Introducing HPV vaccine in developing countries-key challenges and issues. N Engl J Med. 2007;356:1908–10.

    Article  CAS  PubMed  Google Scholar 

  3. Flores YN, Bishai DM, Lorincz A, et al. HPV testing for cervical cancer screening appears more cost-effective than Papanicolau cytology in Mexico. Cancer Cause Control. 2011;22:261–72.

    Article  Google Scholar 

  4. Jit M, Demarteau N, Elbasha E, Ginsberg G, Kim J, Praditsitthikorn N, Sinanovic E, Hutubessy R. Human papillomavirus vaccine introduction in low-income and middle-income countries: guidance on the use of cost-effectiveness models. BMC Med. 2011;9:54.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Tsiodras S, Georgoulakis J, Chranioti A, Voulgaris Z, Psyrri A, Tsivilika A, Panayiotides J, Karakitsos P. Hybrid capture vs PCR screening of cervical human papilloma virus infections. Cytological and histological associations in 1270 women. BMC Cancer. 2010;10:53.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Kok I, Rosmalen J, Dillner J, Arbyn M, Sasieni P, Iftner T, Ballegooijen M. Primary screening for human papillomavirus compared with cytology screening for cervical cancer in European settings: cost effectiveness analysis based on a Dutch microsimulation model. BMJ. 2012;344:e670.

  7. Tabrizi SN, Brotherton JM, Kaldor JM, Skinner SR, Cummins E, Liu B, Bateson D, McNamee K, Garefalakis M, Garland SM. Fall in human papillomavirus prevalence following a national vaccination program. J Infectious Diseases. 2012;206(11):1645–51.

    Article  Google Scholar 

  8. Markowitz LE, Tsu V, Deeks SL, Cubie H, Wang SA, Vicari AS, Brotherton JM. Human papillomavirus vaccine introduction –the first five years. Vaccine. 2012;S5:F139–48.

    Article  Google Scholar 

  9. Markowitz LE, Hariri S, Lin CY, Dunne EF, Steinau M, McQuillan G, Unger ER. Reduction in Human Papillomavirus (HPV) Prevalence Among Young Women Following HPV Vaccine Introduction in the United States, National Health and Nutrition Examination Surveys, 2003–2010. J Infectious Diseases. 2013;208(3):385–93.

    Article  CAS  Google Scholar 

  10. Simard EP, Jemal A. Commentary: Infection-related cancers in low- and middle-income countries: challenges and opportunities. Int J Epidemiol. 2013;42(1):228–9.

    Article  PubMed  Google Scholar 

  11. Wong CA, Saraiya M, Hariri S, Echert L, Howlett R I, Markowitz L, Brotherton JMI, Sinka K, Martinez-Montazez OG, Kjaer SK, Dunne EF, Approaches to monitoring biological outcomes for HPV vaccination: challenges of early adopter countries. Vaccine. 2011;29(5):878–885.

  12. Gaffga NH, Flagg EW, Weinstock HS, Shlay JC, Ghanem KG, Koutsky LA, Kerndt PR, Hsu KK, Unger ER, Datta SD. Monitoring HPV type-specific prevalence over time through clinic-based surveillance: A perspective on vaccine effectiveness. Vaccine. 2012;30:1959–64.

    Article  CAS  PubMed  Google Scholar 

  13. Kahn J, Brown D, Ding L, Widdice L, Shew M, Susan S, Bernstein D, Glynn M, Bernstein D. Vaccine-type human papillomavirus and evidence of herd protection after vaccine introduction. Pediatrics. 2012;130(2):e249–56.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Sandri MT, Lentati P, Benini E, Dell’Orto P, Zorzino L, Carozzi FM, Maisonneuve P, Passerini R, Salvatici M, Casadio C, Boveri S, Sideri M. Comparison of the Digene HC2 assay and the Roche AMPLICOR human Papillomavirus (HPV) Test for detection of high-risk HPV genotypes in cervical samples. J Clin Microbiol. 2006;44(6):2141–6.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Kulmala SM, Syrjanen S, Shabalova I, Petrovichev N, Kozachenko V, Podistov J, Ivanchenko O, Zakarenko S, Nerovjna R, Kljukina L, Branovskaja M, Grunberga V, Juschenko A, tosi P, Santopietro R, Syrjanen and NIS Cohort Study Group. Human Papillomavirus Testing with the Hybrid Capture 2 Assay and PCR as screening tools. J. Clin. Microbiol. 2004;42(6):2470–2475.

  16. Sabol I, Salakova M, Smahelova J, Pawlita M, Schmitt M, Gasperov NM, Grce M, Tachezy R. Evaluation of Different techniques for identification of human papillomavirus types of low prevalence. J Clin Microbiol. 2008;46(5):1606.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Human Papillomavirus Laboratory Manual. Geneva, Switzerland: World Health Organization. http://whqlibdoc.who.int/hq/2010/WHO_IVB_10.12_eng.pdf. Accessed 2010.

  18. Cuzick J, Clavel C, Petry KU, et al. Overview of the European and North American studies on HPV testing in primary cervical cancer screening. Int J Cancer. 2006;119:1095–101.

    Article  CAS  PubMed  Google Scholar 

  19. Park Y, Lee E, Choi J, Jeong S, Kim HS. Comparison of the Abbott Real Time High-Risk Human Papillomavirus (HPV), Roche Cobas HPV, and Hybrid Capture 2 assays to direct sequencing and genotyping of HPV DNA. J Clin Microbiol. 2012;50(7):2359–65.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Howell-Jones R, Silva N, Akpan M, Oakeshott P, Carder C, Coupland L, Sillis S, Mallinson H, Ellis V, Frodsham D, Robinson TI, Gill ON, Beddows S, Soldan K. Prevalence of human papillomavirus (HPV) infections in sexually active adolescents and young women in England, prior to widespread HPV immunization. Vaccine. 2012;30:3867–75.

    Article  PubMed  Google Scholar 

  21. Wu EQ, Liu B, Cui JF, Chen W, Wang JB, Lu L, Niyazi M, Zhao C, Ren SD, Li CQ, Gong XZ, Smith JS, Belinson JL, Liaw KL, Velicer C, Qiao YL. Prevalence of type-specific human papillomavirus and pap results in Chinese women: a multi-center, population-based cross-sectional study. Cancer Causes Control. 2013;24:795–803.

    Article  PubMed  Google Scholar 

  22. Villa LL, Denny L. Methods for detection of HPV infection and its clinical utility. Int J Gynecol Obstetrics. 2006;94:571–80.

    Google Scholar 

  23. Iftner T, Villa LL. Human Papillomavirus Technologies. J Natl Cancer Inst Monogr. 2003;31:80–8.

    Article  Google Scholar 

  24. Zhao FH, Lin MJ, Chen F, Hu SY, Zhang R, Belinson JL, Sellors JW, Franceschi S, Qiao YL, Castle PE. Cervical Cancer Screening Group in China. Performance of high-risk human papillomavirus DNA testing as a primary screen for cervical cancer: a pooled analysis of individual patient data from 17 population-based studies from China. Lancet Oncol. 2010;11(12):1160–71.

    Article  CAS  PubMed  Google Scholar 

  25. Qiao YL, Sellors JW, Eder PS, Bao YP, Lim JM, Zhao FH, Weigl B, Zhang WH, Peck RB, Li L, Chen F, Pan QJ, Lorincz AT. A new HPV-DNA test for cervical-cancer screening in developing regions: a cross-sectional study of clinical accuracy in rural China. Lancet Oncol. 2008;9(10):929–36.

    Article  PubMed  Google Scholar 

  26. Jeronimo J, Bansil P, Lim J, Peck R, Paul P, Amador JJ, Mirembe F, Byamugisha J, Poli UR, Satyanarayana L, Asthana S, START-UP Study Group. A multicountry evaluation of careHPV testing, visual inspection with acetic acid, and papanicolaou testing for the detection of cervical cancer. Int J Gynecol Cancer. 2014;24(3):576–85.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Lin CY. Evaluation of using composite HPV genotyping assay results to monitor human papillomavirus infection burden through simulation. BMC Infect Dis. 2015;15:123.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Lin CY, Barnhart XH, Kosinski AS. The weighted generalized estimating equations approach for the evaluation of medical diagnostic test at subunit level. Biom J. 2006;5:758–71.

    Article  Google Scholar 

  29. Hariri S, Unger E, Sternberg M, Dunne E, Swan D, Patel S, Markowitz L. Prevalence of genital human papillomavirus among females in the United States, the National Health and Nutrition Examination Survey, 2003–2006. J Infectious Disease. 2011;204(4):566–73.

    Article  Google Scholar 

  30. Bruni L, Diaz M, Gastellsague X, Ferrer E, Bosch X, Sanjose S. Cervical human papillomavirus prevalence in 5 continents: meta-analysis of 1 million women with normal cytological findings. J Infectious Disease. 2010;202:1789–99.

    Article  Google Scholar 

  31. Stoler MH, Wright T, Sharma A, Apple R, Gutekunst K, Wright T, et al. High-Risk Human Papillomavirus Testing in Women with ASC-US cytology. Am Soc Clin Path. 2011;135:468–75.

    Article  Google Scholar 

  32. de Sanjose S, Quint WG, Alemany L, Geraets DT, Klaustermeier JE, Lloveras B, et al. Human papillomavirus genotype attribution in invasive cervical cancer: a retrospective cross-sectional worldwide study. Lancet Oncol. 2010;11:1048–56.

    Article  PubMed  Google Scholar 

  33. Molijin A, Kleter B, Quint W, Doorn LV. Molecular diagnosis of human papillomavirus (HPV) infections. J Clin Virol. 2005;32suppl1:s43–51.

  34. Cope JU, Hildesheim A, Schiffman MH, Manos MM, Lorincz AT, Burk RD, et al. The viral origin of cervical cancer in Rabat, Morocco. Int J Cancer. 1998;75:546–55.

    Article  Google Scholar 

  35. Smits HL, Bollen LJ, Tjong-A-Hung SP, Vonk J, van der Velden J, ten Kate FJ, et al. Intermethod variation in detection of human papillomavirus DNA in cervical smears. J Clin Microbiol. 1995;33:2631–6.

    CAS  PubMed  PubMed Central  Google Scholar 

  36. Snijders PJF, van den Brule AJC, Meijer CJLM. The clinical relevance of human papillomavirus testing: relationship between analytical and clinical sensitivity. J Pathology. 2003;201:1–6.

    Article  Google Scholar 

  37. Gage JC, Sadorra M, LaMere BJ, Kail R, Aldrich C, Kinney W, Fetterman B, Lorey T, Schiffman M, Catles P, the PaP Cohort Study Group. Comparison of the cobas Human Papillomavirus (HPV) Test with the Hybrid Capture 2 and Linear Array HPV DNA Tests. J Clin Microbiol. 2012;50(1):61–5.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Meites E, Lin C, Unger E, Steinau M, Patel S, Markowitz L, Hariri S. Can clinical tests help monitor human papillomavirus vaccine impact?. International Journal of Cancer. 2013;1103–1106

  39. Gravitte P, Schiffman M, Solomon D, Wheeler CM, Castle PE. A comparison of linear array and hybrid capture 2 for detection of carcinogenic human papillomavirus and cervical precancer in ASCUS-LSIL Triage study. Cancer Epidemiology Biomarkers Prevention. 2008;17:1248–54.

    Article  Google Scholar 

  40. Carozzi FM, Mistro AD, Confortini M, Sani C, Puliti D, Trevisan R, Marco LD, Tos G, Girlando S, Paolo DP. Pellegrini, Schiboni ML, Crucitti P, Pierotti P, MD, Vignato A, Ronco G, Reproducibility of HPV DNA Testing by Hybrid Capture 2 in a Screening Setting: Intralaboratory and Interlaboratory Quality Control in Seven Laboratories Participating in the Same Clinical Trial. Am J Clin Pathol. 2005;124(5):716–21.

    Article  CAS  PubMed  Google Scholar 

  41. Pons-Salort M, Thiébaut A, Guillemot D, Favre M, Delarocque-Astagneau E. HPV genotype replacement: too early to tell”. Lancet Infections. 2013;12(12):1012.

    Article  Google Scholar 

Download references

Acknowledgment

The authors are grateful to Dr. Timothy Green for clarifying the simulation method in the introduction and Dr. Alula Hadgu for independently reproducing and verifying the simulation results. The authors also thank Drs. Timothy Green, Alula Hadgu, Joseph Gastwirth, Kyle Bernstein and Kim Miller for their constructive comments and/or support. The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the U.S. Centers for Disease Control and Prevention.

Funding

No funding was obtained for this study.

Availability of data and materials

The 14,000 datasets generated for this study are not publicly available but the mathematical algorithms used to generate the data sets are available in the Appendix of the article [27] https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4362818/.

Authors’ contributions

CL, LL participated in designing the study and drafting the manuscript. CL performed and executed the simulation. All authors read and approved the final manuscript.

Competing of interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Not applicable.

Disclaimer

The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

Author information

Authors and Affiliations

  1. Centers for Disease Control and Prevention, Atlanta, GA, USA

    Carol Y. Lin

  2. United Arab Emirates University, Al Ain, UAE

    Ling Li

Authors
  1. Carol Y. Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ling Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Carol Y. Lin.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lin, C.Y., Li, L. Comparison of DNA testing strategies in monitoring human papillomavirus infection prevalence through simulation. BMC Infect Dis 16, 642 (2016). https://doi.org/10.1186/s12879-016-1969-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12879-016-1969-1

Keywords

BMC Infectious Diseases

ISSN: 1471-2334

Contact us