HIV-1 low-level viraemia assessed with 3 commercial real-time PCR assays show high variability
© Ruelle et al; licensee BioMed Central Ltd. 2012
Received: 5 January 2012
Accepted: 24 April 2012
Published: 24 April 2012
Skip to main content
© Ruelle et al; licensee BioMed Central Ltd. 2012
Received: 5 January 2012
Accepted: 24 April 2012
Published: 24 April 2012
Current real-time PCR-based HIV-1 viral load (VL) assays allow the detection of residual viraemia in antiretroviral-treated patients. The clinical outcome of HIV1 patients experiencing low-level replication (<50 cop/mL) in comparison with fully suppressed patients is currently debated. We analysed variability of 3 VL assays <50 cop/mL, and evaluated the reproducibility of viral blips <100 cop/mL.
Three commercial VL assays were tested: Versant HIV-1 RNA 1.0 kPCR (Siemens), Abbott Realtime HIV-1, and Cobas Ampliprep/Cobas Taqman HIV-1 v2.0 (Roche). Ten replicates of a reference sample at 4 low target dilutions were tested to evaluate assay variability. Prospective collection of 181 clinical samples with detectable VL <50 cop/mL was used to evaluate intra-and inter-assay variability by triplicate testing. Samples from 26 patients experiencing a viral blip were retested.
All assays showed substantial variability at low VL level: the coefficient of variation at 100, 50, 25 and 12 cop/mL ranged respectively from 32 to 44%, 35 to 68%, 41 to 83% and 33 to 77%. In the intra-assay evaluation of repeatability, 52.5 to 57.5% of detectable VL <50 cop/mL tested in triplicate showed at least one fully undetected result. Variability was similar in the inter-assay arm. The VL blips could only be reproduced in 19% of cases.
The most recent versions of widespread commercial VL assays showed substantial variability at low levels and residual viraemia could not be consistently reproduced. Patient outcome studies comparing residual VL to full suppression are therefore biased when using commercial assays.
Plasma viral load (VL) measurements are part of the routine follow-up for patients infected with HIV [1, 2]. Antiretroviral therapy (ART) aims to block viral replication, leading to plasma viraemia below the clinically validated threshold of 50 copies per millilitre (cop/mL) of plasma. Below this limit, the patient has the lowest morbidity and mortality probabilities . However, this threshold of 50 cop/mL reflects the performance characteristics of VL assays available before the launch of real-time PCR-based assays, which allow the detection of low numbers of RNA copies present in the sample.
The limit of detection (LoD) does not usually equal the lower limit of quantification (LLoQ) at which the error meets the requirements for reproducibility and linearity . Under the linear range, variability is unacceptably high and accurate quantification remains elusive [5, 6]. Nonetheless, recent VL assays report qualitative results below LLoQ as detected or not detected, suggesting the presence or absence of residual viraemia.
The cause and the consequence of low VL are currently investigated : HIV RNA can originate from the release of virus from the reservoirs or from residual replication . Using modified protocols of commercial assays or in-house assays to monitor VL, intensification of ART in patients with incompletely suppressed VL bore no result , and low-level viraemia was not associated with suboptimal CD4 gains during therapy . Comparisons of drug efficacy on residual viraemia showed favourable profile for fixed-dose combinations including efavirenz , although others showed superior outcome when using nevirapine instead of efavirenz . Some studies suggest that residual viraemia is predictive of future treatment failure , whilst some suggest no further effect . We hypothesised that those results could not be translated to routine settings because they exceed the technical abilities of current commercial real-time PCR assays. We evaluated the variability of 3 commercial real-time HIV-1 VL assays on samples with detectable VL but <50 cop/mL, and analysed the repeatability of low-level viraemia in clinical routine settings in order to demonstrate the hypothesis.
Descriptive statistics related to 10 replicates of a reference sample at four target dilutions
The variability was tested on 181 clinical samples obtained from patients experiencing residual viraemia <50 cop/mL. As samples had been selected prospectively and consecutively, with the only criterion defined as a detectable VL <50 cop/mL, we checked if the viral subtype was representative for our population. A genotype was available for 61.2% of the patients. The clade prevalence in our cohort was similar to the Belgian HIV-1 population, the most abundant ones being subtype B, CRF02, A1 and C: respectively 47, 14, 14 and 10% of the patients.
Intra- and inter-assay evaluation of repeatability with clinical samples from patients experiencing residual viraemia
% of samples where at least one replicate is not detected
% of samples where only one triplicate is detected
% of samples where at least one replicate was higher than 50 cop/mL
% of samples where at least one replicate was higher than 100 cop/mL
% of samples where at least one replicate was higher than 200 cop/mL
Intra-assay Siemens (N=40)
Medical records were examined and 26 cases corresponding to our blip definition (between 50 and 100 cop/mL) were re-analysed. Patients experiencing those blips represented between 1 and 1.5% of the population followed in the participating centres. The VL sequence of the blips, i.e. a VL <50 cop/mL followed by a value between 50 and 100 cop/mL going back afterwards <50, could only be reproduced in 5 cases (19.2%). In the remaining 21 cases, 16 were detected below 50 cop/mL and 5 were not detected. All samples preceding and following the putative blip gave a <50 cop/mL result again, except for one case where the value before the blip and the blip itself were respectively 62 and 64 cop/mL.
Variability of three commercial HIV-1 VL assays was investigated at low values below the clinical cut-off of 50 cop/mL.
As all the assays tested used automated platforms for viral RNA extraction and PCR reactive handling, no discrepancies due to human interference are to be considered. Moreover, the samples underwent no additional thaw and freeze cycle. Depending on the assay, variability at 50 cop/mL rose from 34 to 68% (CV) when a reference sample was diluted in human HIV-negative plasma: results round that cut-off are therefore uncertain, making a precise estimation of values just above 50 cop/mL difficult. Even at the 100 cop/mL target, 30% of samples were quantified<LLoQ with the kPCR assay. When focussing on lower values, variability was the highest with the CAP/CTM v2.0 assay. The latter missed 1 out of 10 replicates above its LLoQ. The Abbott Realtime HIV-1 assay seemed less sensitive than the others at the 12 cop/mL level, although the LoDs inferred from our results are similar with the 3 assays, ranging from 15 to 23 cop/mL.
Repeatability of RNA detection <50 cop/mL was evaluated on 181 triplicates, either intra- or inter-assay: more than 50% of results cannot be reproduced on the 3 aliquots.
Those observations are in line with the PCR limits, as well as with the limits given by the assay manufacturers: every PCR will lead to stochastic results when targets introduced in the reaction mixture lie between the limit of blank and the limit of detection , and companies define their own assay lowest LLoQ level below which the results cannot be treated in a quantitative manner. Extreme values cannot be reproduced quantitatively and are therefore considered as lower than LLoQ in clinical practice.
The results below the LLoQ are reported as detected or not detected by the assays software, and such information should not be reported to the clinician because of uncertainty. This distinction between the presence and absence of PCR signal, together with the launch of assays with LoQ below 50 cop/mL, led to the notion that some patients previously considered as therapy-controlled undergo low-level viraemia, and that others are fully suppressed, i.e. no viral genome can be detected in the plasma. Studies investigating patient outcome when residual viraemia is detected were published, as well as intensification trials exploring the effect of an additional antiretroviral drug on full viral suppression. Some authors used methodology enabling to concentrate the HIV-1 RNA by extracting from 4mL up to 30mL of plasma following ultracentrifugation [15–17], or repeat the test 3 times , lowering the detection limits of PCR and reducing the variability in the low copy number range. Those modified assays may be useful to answer scientific questions about low-level viraemia, but cannot be translated into clinical practice because the variability of most recent versions of widespread commercial VL assays is too high.
Our study was not designed to study the assays specificities. Previous studies showed that HIV-negative samples do not lead to false positive signal, as confirmed here with 10 negative samples. Low values can indeed be considered as true viraemia  but negative ones cannot be considered as proof of full viral suppression. RNA viral genomes can originate from long-living infected cells producing viral particles in the absence of replication, or reflect a residual replication. Strategies aiming at viral eradication need to target the source of circulating viruses . Whether this residual viraemia is the beginning of virological failure is subject to debate [7, 13, 14]. We would suggest that current commercial real-time PCR assays do not have sufficient precision to answer this burning question. Variability in the low copy number range has also implications both for the classification of elite controllers as well as for diagnosis strategies using molecular assays.
In the same way, outcome comparisons of different ART regimens regarding full suppression must be powered enough to take into account assay variability. Although the samples used in this study were taken from patients on suppressive ART, the population was not big enough to detail the drug classes used in the subgroup of reproducible low VL versus the others.
Viral blips between 50 and 100 cop/mL were not reproduced in 80% of the 26 cases. As analytical assay variability is high around 50 cop/mL (Figure 1), it is therefore useful in clinical practice to confirm the result on a new sample to assess if viral replication is really increasing: the samples following the blips tested here were all repeatedly <50 cop/mL. Our results are in line with the 2011 revision of the DHHS guidelines which define the virological failure threshold as 200 cop/mL . Consequently, a single value between 50 and 200 cop/mL should not be a reason enough for dropping a case out of clinical studies.
In conclusion, state of the art VL assays tested here showed poor reproducibility of HIV-1 low-level viraemia results. When used in clinical routine settings with single measurements, they introduce biases in patient outcome studies comparing very low VL to full viral suppression.
Three AIDS reference laboratories in Brussels accredited by national legal bodies to either the EN-ISO 15189 or the EN-ISO 17025 standard performed the analyses, one assay running per site. The assays tested were Versant HIV-1 RNA 1.0 kPCR (Siemens, performed at UCLouvain, using 0.5mL of plasma), Realtime HIV-1 (Abbott, performed at Erasme using the 0.6mL plasma volume protocol), and Cobas Ampliprep/Cobas Taqman HIV-1 v2.0 (CAP/CTM, Roche Diagnostics, perfomed at UZ Brussel, using 0.85mL of plasma). The manufacturers respectively report the LLoQs as 37, 40 and 20 cop/mL. The volumes of plasma mentioned are those actually extracted by the platforms, excluding the dead volume linked to the pipetting steps. Only a part of the RNA is introduced in the RT-PCR reaction: respectively 79%, 56% and 67% of the total elution volume, corresponding to 0.39, 0.33 and 0.57mL of plasma.
The manufacturers recommendations were strictly followed and the same reagent lot was used throughout the study, except for the re-evaluation of blips.
We did obtain quantitative results beyond the assays LLoQs using the Cq and the calibration curve and the manufacturing companies offered some help when the assay software did not produce a value in IVD conditions.
A reference HIV-1 sample, i.e. a culture supernatant dilution of a subtype B isolate, is routinely used in all of the Belgian centres as an internal control in each VL run. We assigned a true value to that reference sample based on the results obtained in the last 25 VL runs per assay: the mean VL SD was 3.13 0.12 (Siemens), 3.18 0.07 (Abbott) and 3.37 0.08 log10 cop/mL (Roche). The average value of 3.23 log10 cop/mL was used to prepare aliquots of 100, 50, 25 and 12 cop/mL (2, 1.7, 1.4 and 1.1 log cop/mL) in commercial HIV-negative human plasma (A&E Scientific, Belgium). Participating laboratories blind tested 10 aliquots of each dilution as well as 10 aliquots of the negative plasma used to prepare the samples. The LoD was inferred by probit analysis using the IBM SPSS Statistics 20 software.
The variability in clinical settings with patients experiencing residual viraemia below 50 cop/mL was assessed with 181 samples. Each laboratory selected prospectively and consecutively 62 plasma samples: when a fresh whole EDTA blood sample was received for HIV-1 VL testing, 3 aliquots were frozen and stored below 70C. If the first aliquot used for routine analysis gave a detectable result <50 cop/mL, the sample was included. Apart from this condition and the availability of sufficient sample volume, no selection for the inclusion of samples was made. Only one sample per patient was included. The maximal duration of storage was limited to 6weeks and no additional freeze/thaw cycles were allowed. Forty samples were tested in triplicate on the same platform during different runs to assess the intra-assay variability, and 22 others were shared with the 2 other laboratories for an inter-assay evaluation. If one replicate gave an invalid result, the sample was excluded from the analysis: 61 samples were finally analysed in the inter-assay evaluation whilst 5 were excluded because of failure of 1 replicate. The TRUGENE HIV-1 genotyping kit (Siemens, Tarrytown, NY) determined the HIV-1 subtype based on the reverse transcriptase sequence.
Laboratories searched their records to identify patients who experienced a blip, i.e. a VL between 50 and 100 cop/mL during the follow-up and their previous and next sample was <50 cop/mL, during the last 15months. The median time between the first and the second analysis was 7months (ranging from 3 to 15), plasma samples being stored at 80C. Twenty-six blips, together with the previous and next sample from that patient, were retested with the same assay and without additional thaw and freeze cycle.
limit of detection
lower limit of quantification
cycle of quantification
Cobas Ampliprep/Cobas Taqman HIV-1 v2.0
coefficient of variation
in vitro diagnostic.
The authors would like to acknowledge laboratory technicians Anita Wyns, Veerle Bastiaensen and Linda Godau at the UZ Brussel, Isabelle Lefvre, Najet Lamarti and Philippe de Sany at the UCLouvain, and Maria-Helena Jurion, Karin Miller and Nadine Gijbels at the Erasme Hospital.
The 3 companies involved in the present evaluation provided free kits, while Abbott and Roche provided support to infer quantitative results under their respective LLOQs.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.