Skip to main content

Comparison of measles IgG enzyme immunoassays (EIA) versus plaque reduction neutralization test (PRNT) for measuring measles serostatus: a systematic review of head-to-head analyses of measles IgG EIA and PRNT

Abstract

Background

As countries move towards or achieve measles elimination status, serosurveillance is an important public health tool. However, a major challenge of serosurveillance is finding a feasible, accurate, cost-effective, and high throughput assay to measure measles antibody concentrations and estimate susceptibility in a population. We conducted a systematic review to assess, characterize, and – to the extent possible – quantify the performance of measles IgG enzyme-linked assays (EIAs) compared to the gold standard, plaque reduction neutralization tests (PRNT).

Methods

We followed the PRISMA statement for a systematic literature search and methods for conducting and reporting systematic reviews and meta-analyses recommended by the Cochrane Screening and Diagnostic Tests Methods Group. We identified studies through PubMed and Embase electronic databases and included serologic studies detecting measles virus IgG antibodies among participants of any age from the same source population that reported an index (any EIA or multiple bead-based assays, MBA) and reference test (PRNT) using sera, whole blood, or plasma. Measures of diagnostic accuracy with 95% confidence intervals (CI) were abstracted for each study result, where reported.

Results

We identified 550 unique publications and identified 36 eligible studies for analysis. We classified studies as high, medium, or low quality; results from high quality studies are reported. Because most high quality studies used the Siemens Enzygnost EIA kit, we generate individual and pooled diagnostic accuracy estimates for this assay separately. Median sensitivity of the Enzygnost EIA was 92.1% [IQR = 82.3, 95.7]; median specificity was 96.9 [93.0, 100.0]. Pooled sensitivity and specificity from studies using the Enzygnost kit were 91.6 (95%CI: 80.7,96.6) and 96.0 (95%CI: 90.9,98.3), respectively. The sensitivity of all other EIA kits across high quality studies ranged from 0% to 98.9% with median (IQR) = 90.6 [86.6, 95.2]; specificity ranged from 58.8% to 100.0% with median (IQR) = 100.0 [88.7, 100.0].

Conclusions

Evidence on the diagnostic accuracy of currently available measles IgG EIAs is variable, insufficient, and may not be fit for purpose for serosurveillance goals. Additional studies evaluating the diagnostic accuracy of measles EIAs, including MBAs, should be conducted among diverse populations and settings (e.g., vaccination status, elimination/endemic status, age groups).

Peer Review reports

Introduction

Measles is a highly infectious, acute systemic viral infection, estimated to cause over 100,000 deaths annually, despite widespread use of a safe and effective vaccine [1]. Between 2000 and 2020, an estimated 31.7 million deaths were averted because of measles vaccination and estimated global measles deaths declined by 94% [2]. In 2020, global coverage of the first dose of measles containing vaccine (MCV1) was estimated at 84% [3]. Coverage of a second measles-containing dose (MCV2) has accelerated in the last decade: as of 2020, 179 countries introduced MCV2 and global coverage was 70% [3, 4]. However, this level of coverage is inadequate to control measles, and progress has been stymied by persistent gaps in measles vaccination coverage, with wide variations within and across populations. Global cases resurged since 2016, with lapses in coverage contributing to high numbers of cases and deaths in 2018 and 2019 [5, 6]. In 2019, there were almost 870,000 cases and over 200,000 deaths – the greatest number of cases since 1996 [7, 8]. Since the COVID-19 pandemic, the measles vaccination coverage has declined and, as of 2021, 40 million children have missed a measles vaccine dose [9].

High quality vaccination programs routinely rely on two sources of data to identify measles outbreaks and populations at highest risk: 1) vaccination coverage monitoring; and 2) measles case surveillance. However, many countries lack high-quality vaccine coverage and/or disease incidence data. Serosurveillance for immunoglobulin G (IgG) antibodies to measles virus can account for waning vaccine-induced immunity, inaccurate recordkeeping, and immunity from natural infection, and is therefore potentially a more direct tool to identify susceptible populations and intervene prior to an outbreak [10]. Between 1996 and 2004, 17 European countries and Australia used serosurveillance to classify progress towards elimination status, including gaps in coverage and risk of localized outbreaks and epidemics [11]. In principle, serosurveillance, which allows the assessment of vaccine failure as well as infection, can also be used to assess the impact of vaccination programs, vaccine effectiveness, transmission dynamics, and predict risk of future epidemics [12].

A challenge of serosurveillance is finding a feasible, accurate, and high throughput assay to measure measles antibody level and estimate susceptibility in a population. The plaque reduction neutralization test (PRNT) is a functional antibody assay that measures the neutralization activity of measles antibodies regardless of isotype. A neutralizing antibody (NAb) is an antibody that defends a cell from a pathogen or infectious particle by neutralizing any effect it has biologically. Neutralization renders the particle no longer infectious or pathogenic [13]. Neutralization assays are considered the “gold standard” for determining protective immunity [12, 14,15,16]. A threshold of measles neutralizing antibody levels of 120 mIU/mL is often considered the correlate of protection although other thresholds, such as 200 mIU/mL, are used depending on which international reference sera was used to calibrate the assay and the objective of the test [17,18,19]. Quantitative values from PRNT show good correlation with immune status and predict protection against infection and disease [20]. However, using PRNT in large serological studies is impractical because it is technically demanding, expensive, conducted in a limited number of laboratories around the world, labor-intensive, time-consuming, and the procedures and interpretation of PRNTs are difficult to standardize between laboratories [20, 21]. Enzyme immunosorbent assays (EIA) are rapid, relatively inexpensive, higher throughput assays that can be performed in most laboratories with basic equipment using commercially available assays [22]. However, EIAs are not functional assays and measure IgG isotype-specific epitopes regardless of neutralization capacity [23]. Multiple studies have reported that EIA results are less sensitive than PRNT, especially in the context of low antibody levels [14, 21, 24,25,26,27]. This may lead to individuals being misclassified by EIA as susceptible to measles in populations with low antibody levels from vaccination as a result of immunological immaturity, interference by passively acquired maternal antibodies, or with waning antibody levels after prolonged periods since vaccination, especially in the absence of boosting from exposure to wild-type virus [22]. Uniquely for measles, minor reductions in EIA sensitivity can have substantial consequences for estimating population immunity due to its high herd immunity threshold, which could result in a misallocation of resources to increase vaccination coverage.

As the use of serosurveillance to evaluate population susceptibility to and seroprotection against measles increases, understanding the diagnostic accuracy of EIAs compared to the gold standard is critical to select an appropriate assay for the target population that can achieve the research or programmatic goals [28, 29]. Although direct comparisons of measles IgG EIA results with PRNTs have been periodically reported in the literature, such comparisons are often not the main objective of the analyses [30] and lack sufficient information about assays and procedures to assess the EIA validity. This systematic review was conducted to assess, characterize, and – to the extent possible – quantify the performance of measles IgG EIAs compared to PRNT.

Methods

We followed the PRISMA statement for a systematic literature search (Supplementary Table 1) [31, 32] and followed methods for conducting and reporting systematic reviews and meta-analyses recommended by the Cochrane Screening and Diagnostic Tests Methods Group (SDTM) [33].

Registration and protocol

We documented methods of the analysis and inclusion criteria in a protocol registered with PROSPERO (registration ID: CRD42020170464).

Eligibility criteria

We included serologic studies with participants of any age from the same source population that reported an index and reference test of measles antibodies using sera, whole blood, or plasma. The index test was any EIA (in-house or commercial, including single or multiple bead-based assays [MBA]) detecting measles virus IgG antibodies. The reference test for the primary analysis was PRNT. Studies that included neutralizing tests (NT) only as the reference test were included in the review but excluded from the primary analysis.

Information sources

We identified studies through PubMed and Embase electronic databases. The original search was conducted on 28 January 2020 and updated twice on 8 June 2020 and 25 August 2021. After full text screening, we attempted to acquire missing information on results from the primary investigator of studies of potential relevance.

Search strategy and selection criteria

The search strategies used terms such as “measles”, “measles vaccine”, “enzyme immunoassay”, “EIA”, “viral plaque assay”, and “PRNT”. Full PubMed and Embase search strategies are detailed in supplemental materials, S2. We included studies if the subjects were human, measured measles IgG antibodies using both an EIA and PRNT, and were published from 1946 to the most recent search (25 August 2021). The literature search was not limited by language and non-English studies were included if an English translation could be obtained. We excluded duplicate studies, basic science literature (e.g., vaccine development), conference abstracts, studies with no abstracts, reviews, and meta-analyses. In addition, we conducted snowball search strategies to identify relevant studies that may have been missed by our database searches, including reviewing the reference lists of included studies.

Study selection

We used Covidence Review Software [34] to maintain search results and conduct all screening processes. Two investigators independently assessed titles and abstracts for eligibility based on the PICOS criteria (Population = participants with and without previous measles infection from all settings, tested for measles virus IgG; Index test = EIA; Comparator = PRNT; Outcomes = EIA vs. PRNT performance, measured by sensitivity, specificity, positive predictive value, negative predictive value, c-statistic, R2, kappa, and/or percent agreement; Study design = immunologic studies). Two investigators then screened full-text studies for inclusion using the same criteria. We analyzed outcomes from the remaining relevant research studies. Disagreements between reviewers at all stages were resolved by consensus or involving a third investigator when consensus could not be reached.

Data abstraction

We developed a data abstraction tool using the Standards for Reporting of Diagnostic Accuracy Studies (STARD) 2015 guidelines [35] and guidance from similarly-focused reviews [36]. We pilot tested the abstraction tool on studies representative of different study designs and data quality and refined it accordingly. All authors commented on the abstraction tool and approved the final version. Four investigators abstracted data from included studies.

We abstracted the following information from each study: 1) study design and setting, e.g., country in which the study was conducted, age of the population, specimen type; 2) EIA results including qualitative and quantitative IgG antibody results, assay type (in-house, commercial); 3) PRNT results including qualitative result, antibody levels, methods for conversion to international units; 4) EIA performance compared to PRN, e.g., sensitivity, specificity, positive predictive value, negative predictive value. We used thresholds as reported in the papers. Each comparison from papers reporting more than one EIA vs. PRNT comparison (eg., multiple EIA or PRNT thresholds, multiple EIA kits, multiple age groups or populations etc.) was reported as separate results. After the data were abstracted, measles elimination status at the time of the study and time since elimination in elimination settings was determined using peer-reviewed and grey literature, based on country and year of specimen collection (or publication year if date of specimen collection was not reported). Elimination status included endemic (the existence of continuous indigenous or imported measles virus transmission that persists for ≥ 12 months in any defined geographical area), interruption (absence of endemic measles virus transmission in a defined geographical area for < 12 months), or elimination (the interruption of endemic measles transmission in a defined geographical area for ≥ 12 months in the presence of a well-performing surveillance system).

Assessment of methodological quality and data quality classifications

We classified studies as high, medium, or low quality in terms of the metrics reported and the reproducibility of study findings (Table 1).

Table 1 Data quality classification definitions for publication abstracted and included in analysis

Medium and low quality studies are described in Supplemental Tables 2A and 2B, but are not included in the main analysis. Papers were excluded from analysis if they did not report data relevant to the study objectives or did not classify the quality of these data. We also assessed the risk of bias for individual studies using a modified version of the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) revised tool for Cochrane reviews [37].

Table 2 Descriptive characteristics of studies evaluating EIA assays compared to PRNT (high quality)

Data analysis

Measures of diagnostic accuracy with 95% confidence intervals (CI) were abstracted for each study result, where reported. Data were also abstracted to generate the four cell values of a two-by-two table, where available, and used to recalculate the sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) with 95% CIs for each index-reference test comparison. Recalculated metrics were used in the main analysis. If recalculated metrics were not available (e.g., medium quality studies in the supplementary materials), the reported measures were used to calculate metrics. Indeterminate or equivocal EIA results were handled in the same way as reported by authors in the study (i.e., excluded or treated as positives or negative) in the primary analysis. If the data reported by authors or methods for treating equivocals were unclear, authors were contacted for additional information or to verify calculations. If no information could be obtained from the authors, investigators came to a consensus regarding whether to include the study (n = 1). We conducted sensitivity analysis by reclassifying equivocal or indeterminant EIA results (e.g., treating as negative, as positive, or excluding from analysis).

Diagnostic accuracy measures were presented for high (main text) and medium (supplementary materials) quality studies only. Differences between studies was assessed by visual examination of forest plots using Stata/IC (version 16.1) [38]. The diagnostic accuracy measures for high quality comparisons that used the Enzynost kits were also presented in a hierarchical summary receiver operating characteristic (HSROC) curve, indicating pooled sensitivity and specificity with 95% confidence regions around the summary estimates. This was used to explain observed differences in accuracy between EIA kits.

We generated a QUADAS figure for all studies using R (version 3.6.1) (Supplementary Fig. 1). For studies with multiple groups (e.g., multiple age groups or multiple EIA kits), we reassigned QUADAS-2 assessments so that a single result was presented per domain for each study. This was done by following an algorithm that compared multiple results within each QUADAS-2 domain and assigned the worst rating as the final, overall assessment per study.

Results

Search results

A total of 549 results were identified through the literature searches after removing duplicates, of which 463 studies were excluded at title and abstract screening, and 41 were excluded at full-text review (Fig. 1). Of the 45 studies included for abstraction, ten were excluded after detailed assessment because a PRNT or comparable test was not used (n = 8) or relevant results were not reported (n = 2). One additional study was included through a snowball search. Thirty-six studies were included for review and 26 for analysis [19, 21, 25,26,27, 30, 39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68]. Thirteen were classified as high quality, 13 as medium quality, and 10 as low quality.

Fig. 1
figure 1

PRISMA flow diagram for database searches and study inclusion, Studies evaluating EIA assays compared to PRNT (high quality)

Characteristics of reviewed studies

For the following sections, characteristics described are not mutually exclusive (i.e., studies may have used more than one age group, specimen source, or EIA kit).

Study populations

Nine of thirteen high quality studies were conducted in high- or upper-middle-income countries (Brazil, Canada, China, England, Portugal, The Netherlands, United States, and United Kingdom), three in lower-middle- or low-income countries (Kenya, Malawi, and Uganda; Table 2), and one study analyzed specimens from both high and lower-middle income countries (United States, Tajikistan, and Bangladesh). Ten of 13 high quality studies used data from measles endemic settings, two from measles elimination settings, and one from a mix of endemic and elimination settings. Nearly all medium and low quality papers were conducted in high- or upper-middle-income countries.

The number of specimens ranged substantially from 43 to 2344 specimens per study (Table 2). Across all high quality studies, one study used specimens from adults, five from children (< 18 years), two from a mix of adults and children, and five did not report the age range. Five of the seven studies with pediatric specimens included children younger than 12 months of age. The original purpose of the analysis varied by study (e.g., diagnostic accuracy evaluation, serosurveillance, Table 2).

Types of EIA kits used

In high quality studies, ten commercial EIAs and two in-house EIAs were compared to PRNT (Table 3). Siemens Enzygnost/Dade Behring (“Enzygnost”) EIA was used most often (n = 14 results in 6 studies), followed by the VIDAS® (bioMerieux; “VIDAS”) assay (n = 3), and other in-house EIAs (n = 2) (Tables 3 and 4). MBAs were used in three studies: one commercial MBA and two studies using in-house MBAs. Medium- and low-quality studies used a wider variety of commercial EIAs as well as in-house EIAs and MBAs (Supplementary Table 2A and 2B).

Table 3 High quality studies diagnostic accuracy measures (Siemens Enzygnost/Dade Behring only)
Table 4 High quality studies diagnostic accuracy measures (non-Siemens Enzygnost/Dade Behring only)

Methodological quality assessment

Based on the QUADAS-2 tool assessment, we concluded there was no bias evident in any of the included studies to justify exclusion (Supplementary Fig. 1). Overall, the intent of the QUADAS-2 tool did not suit the objective of the present review [37] and we used a modified version for methodological quality assessments. However, challenges with applicability of the tool’s domains remained, including inability of reviewers to assess domains when study authors did not report needed information in the text.

Diagnostic accuracy of EIA assays compared to PRNT

The original intent of this review was to provide a quantitative pooled summary of sensitivity and specificity of EIA results compared to PRNT and evaluate hypothesized risk factors for variability in diagnostic accuracy such as assay type, thresholds used, age of study population, and measles elimination. However, there was an insufficient number of studies per category to identify generalizable patterns.

Since most high quality studies used Enzygnost, we assessed the sensitivity and specificity of this assay separately and generated pooled diagnostic accuracy estimates. The sensitivity of the Enzygnost EIA ranged from 66.3% to 100.0% with median (IQR) = 92.1 [82.3, 95.7] (Fig. 2A, Table 3A, Supplementary Table 3). Specificity ranged from 68.8% to 100.0% and median (IQR) = 96.9 [93.0, 100.0]. Confidence intervals on specificity were much wider compared to the sensitivity estimates. Seven comparisons reported sensitivities ≥ 90.0%, ten reported specificities ≥ 90.0%, and six reported both sensitivity and specificity of ≥ 90.0% (Fig. 2A and Supplementary Table 3). When high quality studies using the Enzygnost kit were combined in an HSROC curve, the pooled sensitivity and specificity were 91.6% (95%CI: 80.7, 96.6) and 96.0 (95%CI: 90.9, 98.3), respectively (Supplementary Fig. 2).

Fig. 2
figure 2

A Diagnostic accuracy of Siemens Enzygnost EIA kit compared to PRN reported in high quality studies. % sensitivity and specificity presented. CI, confidence interval. EIA, enzyme immunoassay. FN, false negatives. FP, false positives. NE, not estimable. NR, not reported. TN, true negatives. TP, true positives. *Study classified EIA equivocals as EIA negative. **Study excluded EIA equivocals. All other studies classified EIA equivocals as EIA positive. All studies used the Enzygnost EIA kit with a threshold of < 0.1 O.D (except Warrener where the threshold was not reported). All PRNT tests reported to used a threshold of ≥ 120 mIU/mL except Cohen 2008 which used a batch-specific thresholds and Tischer et al. which reported to use “40 ± 20mIU/mL”. We do not report any comparisons that used EIA thresholds from eg., 8mIU/mL. Cohen 2008 authors reported weighted estimates, unweighted estimates displayed. All papers tested samples by both index and reference tests except Cohen 2008 (both these all samples by PRNT and selected a subset of those samples for EIA testing).” B Diagnostic accuracy of non-Siemens Enzygnost EIA kits compared to PRN reported in high quality studies. % sensitivity and specificity presented. CI, confidence interval. EIA, enzyme immunoassay. FN, false negatives. FP, false positives. MBA, Multiplex bead assay. MIA, Multiplex immunoassay. MeV N, recombinant measles virus nucleoprotein. MeV WVAL, Laboratory-produced purified measles whole-virus antigen. MeV WVAc, Commercially produced whole-virus antigen. NE, not estimable. NR, not reported. TN, true negatives. TP, true positives. *Study classified EIA equivocals as EIA negative. **Study excluded EIA equivocals. ***How EIA equivocal were treated was not reported. All other studies classified EIA equivocals as EIA positive. 1)EIA threshold of < 40mIU/mL and PRNT threshold of ≥ 40mIU/mL 2) EIA threshold of < 100mIU/mL and PRNT threshold of ≥ 100mIU/mL. All samples were tested by both index and reference tests but the small number of PRN positive samples by EIA threshold of < 100mIU/mL and PRNT threshold of ≥ 100mIU/mL limited our ability to estimate sensitivity. All PRNT tests reported to used a threshold of ≥ 120 mIU/mL except Goncalves 1999 et al. (at birth age group) used a threshold of 40mIU/mL, Mao 2009 et al. used threshold 1:4 titer, Cohen 2006 et al. used a batch-specific threshold, Lee 1999 et al. used a threshold of > 200mIU/ml, Hatchette 2017 et al. used a threshold of > 192mIU/mL and deSouza 1991 et al. did not report a threshold. EIA equivocals were grouped differently depending on the study. All papers tested samples by index and reference tests except Fowlkes 2011(tested random subset of EIA tested samples by PRNT), Lee 1999 (both these all samples by PRNT and selected a subset of those samples for EIA testing). BioPlex 2200 MMRV IgG is reported as “BioPlex 2200””

The sensitivity of all other EIA kits across high quality studies ranged from 0% to 98.9% with median (IQR) = 90.6 [86.6, 95.2] (Fig. 2B, Table 4, Supplementary Table 3). The specificity of all other EIA kits across high quality studies ranged from 58.8% to 100.0% with median (IQR) = 100.0 [88.7, 100.0]. When studies with fewer than five PRNT seropositive individuals[48] were excluded (n = 1), the sensitivity of all other EIA kits ranged from 58.8% to 98.9% (Fig. 2B). Ten comparisons reported sensitivities ≥ 90.0%, fourteen reported specificities ≥ 90.0%, and six reported both sensitivity and specificity ≥ 90.0% (Fig. 2B and Supplementary Table 3). There were no observed differences in median sensitivity or specificity by study quality (Supplementary Table 3).

In addition to Enzygnost, the VIDAS, DiaSorin LIAISON®, and commercial MBA EIA kits were used in at least three comparisons, allowing general assessments of within-kit performance across studies without stratifying by quality classification (Supplementary Fig. 4 and Supplementary Table 3). The three sensitivity estimates for the Diasorin assay were overall slightly lower than Enzygnost, ranging from 87.2% to 90.2%, with variable specificity (75.0% to 100%). Sensitivity estimates from three of the four studies using the VIDAS assay were comparable to Enzygnost (87.2% to 90.6%) with less variability in specificity (86.4% to 100%). Although in-house EIAs are all different, each study except one reported high sensitivity (86.8% to 100%) and specificity (80% for one study, 100% for all others). Calculated sensitivity was more variable for MBAs compared to Enzygnost, VIDAS, and DiaSorin. Insufficient information on MBA assays was available to assess reasons for variability.

Sensitivity analysis when reclassifying equivocal results

For studies that provided sufficient information regarding how equivocal EIA results were classified, we regrouped equivocal results to assess how this classification affected the sensitivity and specificity. Five high quality studies and one medium quality study included sufficient information for reclassification (Supplementary Fig. 5), in which 2% to 30% of samples tested had equivocal results. Equivocal EIA results were analyzed in the primary analyses as they were reported in the original publication: three studies grouped equivocal results as positive, one grouped equivocal results as negative, one reported results treating equivocal results as both positive and negative, and one excluded equivocal results from the analysis. As expected, sensitivity metrics increased when EIA equivocal results were grouped with positives. Compared to when equivocal results were excluded or grouped with negatives, sensitivity increased by up to 35.3 percentage points when grouped with positives. Conversely, specificity metrics increased when EIA equivocal results were grouped with negative. Compared to when equivocal results were excluded or grouped with positives, specificity was increased up to 36.5 percentage points when grouped with negatives.

Discussion

Serosurveillance has the potential to be a powerful tool for informing vaccination program design and monitoring. Historically, cross-sectional seroprevalence studies have contributed to epidemiological understanding of poliomyelitis, rubella, and hepatitis A and B virus infections [69]. More recently, serosurveillance has been used globally as a method for monitoring population immunity against HIV [70, 71] and SARS-CoV-2 [72,73,74,75], and biomarkers are increasingly included in country-level household surveys such as the Demographic and Health Surveys (DHS) and the National Health and Nutrition Examination survey (NHANES) [76,77,78]. As countries continue to work towards measles elimination, if antibody prevalence can be accurately measured and subsequently correlates with immunity, then serosurveillance can contribute to monitoring progress, identifying gaps in population immunity and susceptible segments of the population, understanding reasons for apparent increases in incidence and resurgence of disease, and evaluating vaccine impact [12, 69, 79, 80]. This is particularly important after declines in routine immunization rates globally during the COVID pandemic. EIA assays are less resource-intensive and require less technical expertise than the current gold standard PRNTs and are widely used in laboratories around the world including low-income countries, and as such can be deployed on the larger scale. Given the relative ease of these assays, establishing their diagnostic accuracy is important for broader use in research and surveillance.

This analysis summarized and, to the extent possible, compared the diagnostic accuracy of measles IgG EIA assays to gold standard PRNT. Overall, the sensitivity of measles IgG antibody EIAs were moderate to excellent, but highly variable. Specificity tended to be lower and estimates were often imprecise due to the small number of seronegative individuals. With the exception of studies evaluating the Enzygnost EIA, there were an insufficient number of comparable studies to generalize on the diagnostic accuracy of other EIAs compared to PRNT. Studies were too diverse in terms of age groups, population characteristics (e.g., vaccination status, measles endemicity), EIA kits used, EIA and PRNT threshold(s) used, treatment of EIA equivocal results, and inclusion/exclusion of samples for testing to allow a meta-analysis or a more systematic analysis of factors associated with diagnostic accuracy. Measles vaccination status of the mother was not available for studies with young children. Furthermore, the lack of standardization of methods and reporting of results, even among studies that explicitly sought to assess diagnostic accuracy, limited our ability to make meaningful inferences regarding the performance of EIA kits.

Optimal diagnostic accuracy characteristics depend on the objective of the activity, risk of misclassification, and consequences and cost of the subsequent intervention. For example, diagnostic testing at the individual level (e.g., HIV testing) or case detection early in outbreaks settings aim to minimize false negatives by maximizing sensitivity. For seroprevalence studies, misclassification in either direction could result in important public health consequences and should be considered. The general priority for measles serosurveillance is to identify susceptible populations to assess progress toward elimination or trigger supplemental activities to fill immunity gaps. Assays that are inadequately specific could result in overestimates of population immunity, leaving susceptible individuals at risk and may result in large, unexpected measles outbreaks that could have been prevented. On the other hand, assays that are inadequately sensitive would underestimate population immunity, which could lead to unnecessary and costly supplementary immunization activities [30]. Hence, an important limitation to consider is that EIAs are designed for determining individual immunity. As such, they err on the side of high specificity (i.e., minimizing false positives, the lesser risk to the individual being to classify someone who is immune as susceptible, rather than classifying someone who is susceptible as immune) and may not be fit for purposes related to population-level serosurveillance. It would therefore be useful to better characterize acceptable diagnostic accuracy thresholds for EIAs when adapted for use in such contexts.

Our results revealed substantial variability in test performance of measles EIAs and may help to contextualize the results of recent large scale measles serosurveys in Laos [81], Bhutan [30], Zambia [82], Madagascar [83], Canada [41], and the Democratic Republic of Congo (DRC) [76, 84]. Results from some of these studies were unexpected and speak to the importance of validating the diagnostic accuracy of measles IgG antibody EIA kits. The serosurveys from Canada (2019) and Bhutan (2017) conducted validation testing via PRNT on a subset of EIA seronegative and equivocal results, which demonstrated a non-negligible proportion were positive by PRNT (33.3% and 10%, respectively). A serosurvey in Laos reported relatively low seroprevalence among children ages one to two years (48.6%), which was substantially lower than expected based on estimated vaccination coverage of 69% to 72% and was also lower than in persons aged 5–21 years (86.8%). Validation of a random sample of results, or a subset of seronegative results using PRNT would have helped to understand the discrepancies.

Evaluation and interpretation of measles EIA results can be complex, particularly in measles elimination settings where antibody levels are not boosted by exposure to wild-type measles virus. False negative results and over-estimation of population susceptibility are risks with EIAs in elimination settings. Average antibody concentrations are likely to have waned, but individuals could still mount an anamnestic antibody response if exposed to measles, which has important consequences for the working definition of “susceptible”. Twelve studies included in this analysis, most of which were population-based seroprevalences studies, attempted to better characterize EIA accuracy near the threshold by testing all or a sample of EIA negative, equivocal, or low-positive samples by PRNT.

An in-depth head-to-head analysis of commercially available measles IgG assays would help to build confidence in large-scale measles serosurveys and surveillance programs. A recent study conducted in the United States performed head-to-head comparisons of five commercial EIAs with PRN and found discrepant results for samples in the low-positive ranges of even the most sensitive EIAs [53]. This study was included in this review but was classified as medium-quality because information needed to generate two-by-two tables were not included. False negative EIA test results occurred in approximately 11% of sera, which generally had low levels of neutralizing antibody. The study demonstrated that lowering the PRN threshold (i.e., rather than the EIA threshold) from 120 to 40 mIU/mL increased specificity of EIA assays at the expense of sensitivity. Although there is debate on the 120 PRN correlate of protection, lowering the threshold to 40 mIU/mL is unlikely to be clinically meaningful [85].

In addition, systematic analyses of diagnostic accuracy among vaccinated populations, of varying ages, in elimination settings, where average antibody levels are generally low, would help to fill evidence gaps identified in this review. Alternatives to traditional EIAs, such as MBAs, have demonstrated excellent diagnostic accuracy and analytic sensitivity for other disease-specific antibodies and are promising for measles serosurveillance [86, 87]. However, limitations in access to multiplex machines, availability of commercially available regents with measles antigens, and cost limit their used in low- and lower-middle income settings. Promising microneutralization assays may also overcome challenges of evaluating functional responses in surveillance settings [88, 89].

Strengths and limitations

This review included studies conducted between 1984 and 2020, over which time diagnostic and analytic methods have changed, limiting conclusions we can draw about EIAs in contemporary use. For example, Enzgynost EIA was the most common assay used in included studies, but was recently discontinued [90]. The EUROIMMUN Anti-Measles Virus IgG ELISA is used frequently in seroprevalence studies at present [91, 92], but was not assessed in any studies returned from the searches and therefore not included in this review.

This review contributes to the existing literature on EIA and PRNT diagnostic accuracy for the identification of measles IgG and is the first to systematically review their comparative test performance. It identified critical gaps regarding systematic reporting and use of standardized methodologies. The literature search was not limited by language but translated full-texts were not available for three publications and may have limited the analysis.

Conclusions

To expand the utility of measles serological surveillance, robust, feasible, high-throughput, and accurate assays are needed to identify susceptible and protection populations. Evidence on the diagnostic accuracy of currently available measles IgG EIAs is variable, insufficient, and may not be fit for purpose for serosurveillance goals. Additional studies evaluating the diagnostic accuracy of measles EIAs, including MBAs, should be conducted among diverse populations and settings (e.g., vaccination status, elimination/endemic status, age groups). Analyses of serosurveys would be strengthened if PRNT validation were conducted on a random subsample or on samples near the EIA threshold.

Availability of data and materials

All data is available publicly via PubMed and Embase search engines; search strategies have been preserved on searchRxiv (https://searchrxiv.org/). Abstraction tools, generated datasets, and programs and code used for statistical analyses can be made available upon reasonable request to the corresponding author.

Abbreviations

CI:

95% Confidence interval

EIA:

Enzyme immunosorbent assay

HSROC:

Hierarchical summary receiver operating characteristic

IgG:

Immunoglobulin G

MCV1:

Measles-containing vaccine, dose 1

MCV2:

Measles-containing vaccine, dose 2

MBA:

Multiplexed bead assay

NPV:

Negative predictive value

NT:

Neutralizing test

PRNT:

Plaque reduction neutralization test

PPV:

Positive predictive value

QUADAS:

Quality Assessment of Diagnostic Accuracy Studies

SDTM:

Cochrane Screening and Diagnostic Tests Methods Group

STARD:

Standards for Reporting of Diagnostic Accuracy Studies

References

  1. Moss WJ. Measles. Lancet. 2017;390(10111):2490–502.

    Article  PubMed  Google Scholar 

  2. Dixon MG, Ferrari M, Antoni S, Li X, Portnoy A, Lambert B, et al. Progress Toward Regional Measles Elimination - Worldwide, 2000–2020. MMWR Morb Mortal Wkly Rep. 2021;70(45):1563–9.

    Article  PubMed  PubMed Central  Google Scholar 

  3. World Health Organization. Measles vaccination coverage 2021 [Available from: https://immunizationdata.who.int/pages/coverage/mcv.html?CODE=Global&ANTIGEN=MCV2&YEAR=.

  4. World Health Organization. Introduction of Measles-containing vaccine 2nd dose 2021 [Available from: https://immunizationdata.who.int/pages/vaccine-intro-by-antigen/mcv2.html?ISO_3_CODE=&YEAR=.

  5. World Health Organization. Measles: fighting a global resurgence 2019 [Available from: https://www.who.int/news-room/feature-stories/detail/measles-fighting-a-global-resurgence.

  6. Measles cases spike globally due to gaps in vaccination coverage [press release]. https://www.who.int/news/item/29-11-2018-measles-cases-spike-globally-due-to-gaps-in-vaccination-coverage.  Accessed 23 May 2023.

  7. World Health Organization. Measles reported cases and incidence 2021 [Available from: https://immunizationdata.who.int/pages/incidence/measles.html?CODE=Global&YEAR=.

  8. Patel MK, Goodson JL, Alexander JP Jr, Kretsinger K, Sodha SV, Steulet C, et al. Progress Toward Regional Measles Elimination - Worldwide, 2000–2019. MMWR Morb Mortal Wkly Rep. 2020;69(45):1700–5.

    Article  PubMed  PubMed Central  Google Scholar 

  9. World Health Organization. Nearly 40 million children are dangerously susceptible to growing measles threat 2022 Nov 23 [Available from: https://www.who.int/news/item/23-11-2022-nearly-40-million-children-are-dangerously-susceptible-to-growing-measles-threat.

  10. Lessler J, Metcalf CJ, Cutts FT, Grenfell BT. Impact on Epidemic Measles of Vaccination Campaigns Triggered by Disease Outbreaks or Serosurveys: A Modeling Study. PLoS Med. 2016;13(10):e1002144.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Andrews N, Tischer A, Siedler A, Pebody RG, Barbara C, Cotter S, et al. Towards elimination: measles susceptibility in Australia and 17 European countries. Bull World Health Organ. 2008;86(3):197–204.

    Article  PubMed  Google Scholar 

  12. Cutts FT, Hanson M. Seroepidemiology: an underused tool for designing and monitoring vaccination programmes in low- and middle-income countries. Trop Med Int Health. 2016;21(9):1086–98.

    Article  PubMed  Google Scholar 

  13. Klasse PJ. Neutralization of Virus Infectivity by Antibodies: Old Problems in New Perspectives. Adv Biol. 2014;2014:157895.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Albrecht P, Herrmann K, Burns GR. Role of virus strain in conventional and enhanced measles plaque neutralization test. J Virol Methods. 1981;3(5):251–60.

    Article  CAS  PubMed  Google Scholar 

  15. Griffin DE. Measles virus. In: Knipe DM, Howley PM, editors. Fields virology. Philadelphia: Lippincott Williams & Wilkins; 2001. p. 1401–41.

    Google Scholar 

  16. Science M, Savage R, Severini A, McLachlan E, Hughes SL, Arnold C, et al. Measles Antibody Levels in Young Infants. Pediatrics. 2019;144(6):e20190630.

    Article  PubMed  Google Scholar 

  17. Chen RT, Markowitz LE, Albrecht P, Stewart JA, Mofenson LM, Preblud SR, et al. Measles antibody: reevaluation of protective titers. J Infect Dis. 1990;162(5):1036–42.

    Article  CAS  PubMed  Google Scholar 

  18. Plotkin SA. Vaccines: correlates of vaccine-induced immunity. Clin Infect Dis. 2008;47(3):401–9.

    Article  PubMed  Google Scholar 

  19. Coughlin MM, Matson Z, Sowers SB, Priest JW, Smits GP, van der Klis FRM, et al. Development of a Measles and Rubella Multiplex Bead Serological Assay for Assessing Population Immunity. J Clin Microbiol. 2021;59(6):e02716-e2720.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  20. Cohen BJ, Audet S, Andrews N, Beeler J, test WHOwgomprn. Plaque reduction neutralization test for measles antibodies: Description of a standardised laboratory method for use in immunogenicity studies of aerosol vaccination. Vaccine. 2007;26(1):59–66.

    Article  CAS  PubMed  Google Scholar 

  21. Cohen BJ, Doblas D, Andrews N. Comparison of plaque reduction neutralisation test (PRNT) and measles virus-specific IgG ELISA for assessing immunogenicity of measles vaccination. Vaccine. 2008;26(50):6392–7.

    Article  CAS  PubMed  Google Scholar 

  22. Coughlin MM, Beck AS, Bankamp B, Rota PA. Perspective on Global Measles Epidemiology and Control and the Role of Novel Vaccination Strategies. Viruses. 2017;9(1):11.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Immunological Basis for Immunization Series. Measles - Update 2009. Geneva: Switzerland; 2009.

    Google Scholar 

  24. Cho HK, Lee H, Kim HW, Kim SS, Kang HJ, Kim IT, et al. Seroprevalences of Specific IgG Antibodies to Measles, Mumps, and Rubella in Korean Infants. J Korean Med Sci. 2016;31(12):1957–62.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Cohen BJ, Parry RP, Doblas D, Samuel D, Warrener L, Andrews N, et al. Measles immunity testing: comparison of two measles IgG ELISAs with plaque reduction neutralisation assay. J Virol Methods. 2006;131(2):209–12.

    Article  CAS  PubMed  Google Scholar 

  26. Hatchette TF, Scholz H, Bolotin S, Crowcroft NS, Jackson C, McLachlan E, et al. Calibration and Evaluation of Quantitative Antibody Titers for Measles Virus by Using the BioPlex 2200. Clin Vaccine Immunol. 2017;24(1):e00269-e316.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  27. Tischer A, Gassner M, Richard JL, Suter-Riniker F, Mankertz A, Heininger U. Vaccinated students with negative enzyme immunoassay results show positive measles virus-specific antibody levels by immunofluorescence and plaque neutralisation tests. J Clin Virol. 2007;38(3):204–9.

    Article  CAS  PubMed  Google Scholar 

  28. World Health Organization. Africa Regional Guidelines for Measles and Rubella Surveillance. WHO Regional Office for Africa: WHO Regional Office for Africa; 2015.

  29. World Health Organization. Guidance on Conducting Serosurveys in Support of Measles and Rubella Elimination in the WHO European Region. WHO Regional Office for Europe: WHO Regional Office for Europe; 2013. https://apps.who.int/iris/handle/10665/350485.

  30. Wangchuk S, Nogareda F, Tshering N, Khandu L, Pelden S, Wannemuehler K, et al. Measles and rubella immunity in the population of Bhutan, 2017. Vaccine. 2019;37(43):6463–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009;339:b2700.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71.

    Article  PubMed  PubMed Central  Google Scholar 

  33. The Cochrane Library. Cochrane screening and diagnostic tests methods group (SDTM) 2020 [Available from: https://methods.cochrane.org/sdt/welcome.

  34. Covidence systematic review software, Veritas Health Innovation, Melbourne, Australia. [Available from: www.covidence.org.

  35. Cohen JF, Korevaar DA, Altman DG, Bruns DE, Gatsonis CA, Hooft L, et al. STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration. BMJ Open. 2016;6(11):e012799.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Smit PW, Elliott I, Peeling RW, Mabey D, Newton PN. An overview of the clinical use of filter paper in the diagnosis of tropical diseases. Am J Trop Med Hyg. 2014;90(2):195–210.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529–36.

    Article  PubMed  Google Scholar 

  38. StataCorp. Stata Statistical Software: Release 16. College Station, TX: StataCorp LLC; 2019.

    Google Scholar 

  39. Al-Mazrou YY, Khalil MK, Tischer A, Al-Jeffri MH, Al-Ghamdi YS, Bakhsh MM, et al. Serosurvey of measles, mumps and rubella antibodies in Saudi children. Saudi Med J. 2005;26(10):1551–4.

    PubMed  Google Scholar 

  40. Al-Mazrou YY, Khalil MK, Tumsah S, Al-Ghamdi YS, Al-Jeffri MH, Tischer AB, et al. Sero-response to measles-mumps-rubella vaccine campaign in Saudi Arabia. Saudi Med J. 2002;23(6):680–3.

    PubMed  Google Scholar 

  41. Bolotin S, Severini A, Hatchette T, McLachlan E, Savage R, Hughes SL, et al. Assessment of population immunity to measles in Ontario, Canada: a Canadian Immunization Research Network (CIRN) study. Hum Vaccin Immunother. 2019;15(12):2856–64.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Castro-Silva R, Camacho LA, Amorim L, Medeiros AD, Ferreira DA, Oliveira SA, et al. Serological surveillance of measles in blood donors in Rio de Janeiro. Brazil Rev Panam Salud Publica. 2003;14(5):334–40.

    Article  PubMed  Google Scholar 

  43. Cremer NE, Cossen CK, Shell G, Diggs J, Gallo D, Schmidt NJ. Enzyme immunoassay versus plaque neutralization and other methods for determination of immune status to measles and varicella-zoster viruses and versus complement fixation for serodiagnosis of infections with those viruses. J Clin Microbiol. 1985;21(6):869–74.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  44. de Souza VA, Pannuti CS, Sumita LM, Albrecht P. Enzyme-linked immunosorbent assay (ELISA) for measles antibody. A comparison with haemagglutination inhibition, immunofluorescence and plaque neutralization tests. Rev Inst Med Trop Sao Paulo. 1991;33(1):32–6.

    Article  PubMed  Google Scholar 

  45. Dorigo-Zetsma JW, Leverstein-van Hall MA, Vreeswijk J, de Vries JJ, Vossen AC, Ten Hulscher HI, et al. Immune status of health care workers to measles virus: evaluation of protective titers in four measles IgG EIAs. J Clin Virol. 2015;69:214–8.

    Article  CAS  PubMed  Google Scholar 

  46. Erdman DD, Anderson LJ, Adams DR, Stewart JA, Markowitz LE, Bellini WJ. Evaluation of monoclonal antibody-based capture enzyme immunoassays for detection of specific antibodies to measles virus. J Clin Microbiol. 1991;29(7):1466–71.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  47. Fowlkes A, Witte D, Beeler J, Audet S, Garcia P, Curns A, et al. Persistence of vaccine-induced measles antibody beyond age 12 months: a comparison of response to one and two doses of Edmonston-Zagreb measles vaccine among HIV-infected and uninfected children in Malawi. J Infect Dis. 2011;204(Suppl 1):S149–57.

    Article  PubMed  Google Scholar 

  48. Gonçalves G, Cutts F, Forsey T, Andrade HR. Comparison of a commercial enzyme immunoassay with plaque reduction neutralization for maternal and infant measles antibody measurement. Rev Inst Med Trop Sao Paulo. 1999;41(1):21–6.

    Article  PubMed  Google Scholar 

  49. Hesketh L, Charlett A, Farrington P, Miller E, Forsey T, Morgan-Capner P. An evaluation of nine commercial EIA kits for the detection of measles specific IgG. J Virol Methods. 1997;66(1):51–9.

    Article  CAS  PubMed  Google Scholar 

  50. Job JS, Halsey NA, Boulos R, Holt E, Farrell D, Albrecht P, et al. Successful immunization of infants at 6 months of age with high dose Edmonston-Zagreb measles vaccine. Cite Soleil/JHU Project Team. Pediatr Infect Dis J. 1991;10(4):303–11.

    Article  CAS  PubMed  Google Scholar 

  51. Kang HJ, Han YW, Kim SJ, Kim YJ, Kim AR, Kim JA, et al. An increasing, potentially measles-susceptible population over time after vaccination in Korea. Vaccine. 2017;35(33):4126–32.

    Article  PubMed  Google Scholar 

  52. Kidokoro M, Aoki A, Horiuchi K, Shida H. Large-scale preparation of biologically active measles virus haemagglutinin expressed by attenuated vaccinia virus vectors. Microbes Infect. 2002;4(10):1035–44.

    Article  CAS  PubMed  Google Scholar 

  53. Latner DR, Sowers SB, Anthony K, Colley H, Badeau C, Coates J, et al. Qualitative Variation among Commercial Immunoassays for Detection of Measles-Specific IgG. J Clin Microbiol. 2020;58(6):e00265-e320.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Lee MS, Cohen B, Hand J, Nokes DJ. A simplified and standardized neutralization enzyme immunoassay for the quantification of measles neutralizing antibody. J Virol Methods. 1999;78(1–2):209–17.

    Article  CAS  PubMed  Google Scholar 

  55. Mancuso JD, Krauss MR, Audet S, Beeler JA. ELISA underestimates measles antibody seroprevalence in US military recruits. Vaccine. 2008;26(38):4877–8.

    Article  CAS  PubMed  Google Scholar 

  56. Mao NY, Zhu Z, Jiang XH. Comparison and evaluation of enzyme-linked immunization assay kits with plague reduction neutralization test for detection of measles IgG antibody. Zhongguo Yi Miao He Mian Yi. 2009;15(3):215–8.

    PubMed  Google Scholar 

  57. Matson DO, Byington C, Canfield M, Albrecht P, Feigin RD. Investigation of a measles outbreak in a fully vaccinated school population including serum studies before and after revaccination. Pediatr Infect Dis J. 1993;12(4):292–9.

    Article  CAS  PubMed  Google Scholar 

  58. Morris LE, Posada R, Hickman CJ, Latner DR, Singh TA, Rautenberg A, et al. Susceptibility to Measles Among Perinatally HIV-Infected Adolescents and Young Adults. J Pediatric Infect Dis Soc. 2015;4(1):63–6.

    Article  PubMed  Google Scholar 

  59. Ng Y, Chua LAV, Cui L, Ang LW, Tee NWS, Lin RTP, et al. Seroprevalence of vaccine-preventable diseases among children and adolescents in Singapore: Results from the National Paediatric Seroprevalence Survey 2018. Int J Infect Dis. 2020;92:234–40.

    Article  PubMed  Google Scholar 

  60. Oliveira SA, Siqueira MM, Mann GF, Costa AJ, Almeida MT, Stavola MS, et al. Measles antibody prevalence after mass immunization campaign in Niterói, state of Rio de Janeiro, Brazil. Rev Inst Med Trop Sao Paulo. 1996;38(5):355–8.

    Article  CAS  PubMed  Google Scholar 

  61. Pabst HF, Spady DW, Carson MM, Krezolek MP, Barreto L, Wittes RC. Cell-mediated and antibody immune responses to AIK-C and Connaught monovalent measles vaccine given to 6 month old infants. Vaccine. 1999;17(15–16):1910–8.

    Article  CAS  PubMed  Google Scholar 

  62. Pourabbas B, Ziyaeyan M, Alborzi A, Mardaneh J. Efficacy of measles and rubella vaccination one year after the nationwide campaign in Shiraz. Iran Int J Infect Dis. 2008;12(1):43–6.

    Article  PubMed  Google Scholar 

  63. Ratnam S, Gadag V, West R, Burris J, Oates E, Stead F, et al. Comparison of commercial enzyme immunoassay kits with plaque reduction neutralization test for detection of measles virus antibody. J Clin Microbiol. 1995;33(4):811–5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  64. Siennicka J, Częścik A, Trzcińska A. The significance for epidemiological studies anti-measles antibody detection examined by enzyme immunoassay (EIA) and plaque reduction neutralization test (PRNT). Przegl Epidemiol. 2014;68(3):417 20-45279.

    PubMed  Google Scholar 

  65. Tapia MD, Sow SO, Medina-Moreno S, Lim Y, Pasetti MF, Kotloff K, et al. A serosurvey to identify the window of vulnerability to wild-type measles among infants in rural Mali. Am J Trop Med Hyg. 2005;73(1):26–31.

    Article  PubMed  Google Scholar 

  66. Tischer A, Andrews N, Kafatos G, Nardone A, Berbers G, Davidkin I, et al. Standardization of measles, mumps and rubella assays to enable comparisons of seroprevalence data across 21 European countries and Australia. Epidemiol Infect. 2007;135(5):787–97.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  67. Warrener L, Bwogi J, Andrews N, Samuel D, Kabaliisa T, Bukenya H, et al. Serum anti-tetanus and measles antibody titres in Ugandan children aged 4 months to 6 years: implications for vaccine programme. Epidemiol Infect. 2018;146(9):1151–6.

    Article  CAS  PubMed  Google Scholar 

  68. Weigle KA, Murphy MD, Brunell PA. Enzyme-linked immunosorbent assay for evaluation of immunity to measles virus. J Clin Microbiol. 1984;19(3):376–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  69. Osborne K, Gay N, Hesketh L, Morgan-Capner P, Miller E. Ten years of serological surveillance in England and Wales: methods, results, implications and action. Int J Epidemiol. 2000;29(2):362–8.

    Article  CAS  PubMed  Google Scholar 

  70. Endres-Dighe S, Farris T, Courtney L. Lessons learned from twelve years of HIV Seroprevalence and Behavioral Epidemiology Risk Survey (SABERS) development and implementation among foreign militaries. PLoS ONE. 2018;13(9):e0203718.

    Article  PubMed  PubMed Central  Google Scholar 

  71. National Bureau of Statistics - Nigeria. National HIV Sero-Prevalence Sentinel Survey 2008, Eight rond. Federal Ministry of Health - Federal Government of Nigeria: Federal Ministry of Health - Federal Government of Nigeria; 2020 Jul 11.

  72. Aziz NA, Corman VM, Echterhoff AKC, Muller MA, Richter A, Schmandke A, et al. Seroprevalence and correlates of SARS-CoV-2 neutralizing antibodies from a population-based study in Bonn, Germany. Nat Commun. 2021;12(1):2117.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  73. Kindgen-Milles D, Brandenburger T, Braun JFW, Cleff C, Moussazadeh K, Mrosewski I, et al. Prevalence of SARS-COV-2 positivity in 516 German intensive care and emergency physicians studied by seroprevalence of antibodies National Covid Survey Germany (NAT-COV-SURV). PLoS ONE. 2021;16(4):e0248813.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  74. Pasqualotto AC, Pereira PC, Lana DFD, Schwarzbold AV, Ribeiro MS, Riche CVW, et al. COVID-19 seroprevalence in military police force, Southern Brazil. PLoS ONE. 2021;16(4):e0249672.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  75. Mulenga LB, Hines JZ, Fwoloshi S, Chirwa L, Siwingwa M, Yingst S, et al. Prevalence of SARS-CoV-2 in six districts in Zambia in July, 2020: a cross-sectional cluster sample survey. Lancet Glob Health. 2021;9(6):e773–81.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  76. Ashbaugh HR, Cherry JD, Hoff NA, Doshi RH, Alfonso VH, Gadoth A, et al. Measles antibody levels among vaccinated and unvaccinated children 6–59months of age in the Democratic Republic of the Congo, 2013–2014. Vaccine. 2020;38(9):2258–65.

    Article  PubMed  PubMed Central  Google Scholar 

  77. McQuillan GM, Kruszon-Moran D, Granade T, Feldman JW. Seroprevalence of HIV in the US Household Population Aged 18–49 Years: The National Health and Nutrition Examination Surveys, 1999–2006. J Acquir Immune Defic Syndr. 2010;53(1):117–23.

    Article  PubMed  Google Scholar 

  78. Mishra V, Medley A, Hong R, Gu Y, Robey B. Levels and spread of HIV seroprevalence and associated factors: evidence from national household surveys. New York: DHS Comparative Reports 22: United States Agency for International Development (USAID); 2009.

  79. Wilson SE, Deeks SL, Hatchette TF, Crowcroft NS. The role of seroepidemiology in the comprehensive surveillance of vaccine-preventable diseases. CMAJ. 2012;184(1):E70–6.

    Article  PubMed  PubMed Central  Google Scholar 

  80. Winter AK, Martinez ME, Cutts FT, Moss WJ, Ferrari MJ, McKee A, et al. Benefits and Challenges in Using Seroprevalence Data to Inform Models for Measles and Rubella Elimination. J Infect Dis. 2018;218(3):355–64.

    Article  PubMed  PubMed Central  Google Scholar 

  81. Hachiya M, Miyano S, Mori Y, Vynnycky E, Keungsaneth P, Vongphrachanh P, et al. Evaluation of nationwide supplementary immunization in Lao People’s Democratic Republic: Population-based seroprevalence survey of anti-measles and anti-rubella IgG in children and adults, mathematical modelling and a stability testing of the vaccine. PLoS One. 2018;13(3):e0194931.

    Article  PubMed  PubMed Central  Google Scholar 

  82. Hayford K, Mutembo S, Carcelen A, Matakala HK, Munachoonga P, Winter A, et al. Measles and rubella serosurvey identifies rubella immunity gap in young adults of childbearing age in Zambia: The added value of nesting a serological survey within a post-campaign coverage evaluation survey. Vaccine. 2019;37(17):2387–93.

    Article  PubMed  PubMed Central  Google Scholar 

  83. Winter AK, Wesolowski AP, Mensah KJ, Ramamonjiharisoa MB, Randriamanantena AH, Razafindratsimandresy R, et al. Revealing Measles Outbreak Risk With a Nested Immunoglobulin G Serosurvey in Madagascar. Am J Epidemiol. 2018;187(10):2219–26.

    Article  PubMed  PubMed Central  Google Scholar 

  84. Keating P, Carrion Martin AI, Blake A, Lechevalier P, Uzzeni F, Gignoux E, et al. Measles seroprevalence after reactive vaccination campaigns during the 2015 measles outbreak in four health zones of the former Katanga Province, Democratic Republic of Congo. BMC Public Health. 2019;19(1):1153.

    Article  PubMed  PubMed Central  Google Scholar 

  85. Bolotin S, Hughes SL, Gul N, Khan S, Rota PA, Severini A, et al. What Is the Evidence to Support a Correlate of Protection for Measles? A Systematic Review. J Infect Dis. 2020;221(10):1576–83.

    Article  CAS  PubMed  Google Scholar 

  86. Binnicker MJ, Jespersen DJ, Harring JA, Rollins LO, Beito EM. Evaluation of a multiplex flow immunoassay for detection of epstein-barr virus-specific antibodies. Clin Vaccine Immunol. 2008;15(9):1410–3.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  87. Fonseca BP, Marques CF, Nascimento LD, Mello MB, Silva LB, Rubim NM, et al. Development of a multiplex bead-based assay for detection of hepatitis C virus. Clin Vaccine Immunol. 2011;18(5):802–6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  88. Alvarado-Facundo E, Audet S, Moss WJ, Beeler JA. Development of a high-throughput assay to measure measles neutralizing antibodies. PLoS ONE. 2019;14(8):e0220780.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  89. Knipes AK, Summers A, Sklavounos AA, Lamanna J, de Campos RPS, Narahari T, et al. Use of a rapid digital microfluidics-powered immunoassay for assessing measles and rubella infection and immunity in outbreak settings in the Democratic Republic of the Congo. PLoS ONE. 2022;17(12):e0278749.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  90. DiaSorin. 25 July 2017. Press release: DiaSorin to acquire ELISA immunodiagnostic business portfolio and associated assets from Siemens Healthineers. https://diasoringroup.com/sites/diasorincorp/files/allegati_pressrel/pr_diasorin_-_acquisition_of_siemens_elisa_eng_1.pdf. Accessed 2021 Nov 22 [press release].

  91. Doornekamp L, Comvalius AD, GeurtsvanKessel CH, Slobbe L, Scherbeijn SMJ, van Genderen PJJ, et al. Measles seroprevalence among Dutch travelling families. Travel Med Infect Dis. 2021;44:102194.

    Article  PubMed  Google Scholar 

  92. Meng QH, Liu Y, Yu JQ, Li LJ, Shi W, Shen YJ, et al. Seroprevalence of Maternal and Cord Antibodies Specific for Diphtheria, Tetanus, Pertussis, Measles, Mumps and Rubella in Shunyi, Beijing. Sci Rep. 2018;8(1):13021.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the Informationists at Johns Hopkins Welch Library for their assistance developing and finalizing the search strategies.

Funding

This study was supported by the Strengthening Immunization Systems through Serosurveillance grant (grant number 1094816) from The Bill & Melinda Gates Foundation to the International Vaccine Access Center, Department of International Health, Johns Hopkins Bloomberg School of Public Health.

The funder did not have a role in the design of the study, data collection, analysis, and interpretation, manuscript preparation, or decision to publish.

Author information

Authors and Affiliations

Authors

Contributions

WJM and KH contributed to funding acquisition. SB, NSC, FTC, WJM, and KH contributed to study concept and design. CSL, AZH, and KH contributed to study administration. CSL, AZH, EJ, SL, and SO contributed to data acquisition. CSL and AZH contributed to data analysis. CSL and KH contributed to initial manuscript drafting. CSL, AZH, SB, NSC, FTC, WJM, and KH contributed to data interpretation and to the discussion of the results. All authors contributed to finals revisions of the manuscript. All authors had final responsibility for the decision to submit for publication. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to Kyla Hayford.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

KH conducted the study while working at the Johns Hopkins School of Public Health but is an employee at Pfizer, Inc. as of 26 October 2020. CSL conducted the study while enrolled as a student at Johns Hopkins School of Public Health but was a temporary contracted employee at Pfizer, Inc. from April 8, 2022 through June 8, 2022. AZH, SB, NSC, FTC, EJ, SL, WJM, and SO report no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

Supplemental Table 1. PRISMA statement for a systematic literature search checklist. Supplemental Table 2A. Studies evaluating EIA compared to PRNT. Supplemental Table 2B. Studies evaluating EIA compared to PRNT. Supplementary Table 3. Mediandiagnostic accuracy of EIA compared to PRNT by assay type and study quality. Supplementary Table 4. Diagnostic accuracy measures reported in medium quality studies. Supplementary Figure 1. Summary of Quality Assessment of Diagnostic Accuracy Studiesresults. Supplementary Figure 2. HSROC curves for measles EIA acompared to PRNT for high quality studies evaluating Siemens Enzygnost EIA kits. Supplementary Figure 3. Diagnostic accuracy of EIA compared to PRN reported in medium quality studies. Supplementary Figure 4. Diagnostic accuracy of EIA assays compared to PRN by assay type. Supplementary Figure 5. Diagnostic accuracy of EIA compared to PRNT when EIA equivocals are re-classified, compared to results reported in high quality studies.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lutz, C.S., Hasan, A.Z., Bolotin, S. et al. Comparison of measles IgG enzyme immunoassays (EIA) versus plaque reduction neutralization test (PRNT) for measuring measles serostatus: a systematic review of head-to-head analyses of measles IgG EIA and PRNT. BMC Infect Dis 23, 367 (2023). https://doi.org/10.1186/s12879-023-08199-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12879-023-08199-8

Keywords