Skip to main content

A comparison of two multiplex-PCR assays for the diagnosis of traveller’s diarrhoea

This article has been updated

Abstract

Background

Numerous multiplex-PCR assays are now available in routine diagnostics but their clinical value is controversial if a clear association between clinical symptoms and the detection of a particular pathogen is missing. The objective of this work was to evaluate a multiplex-PCR assay for the diagnosis of traveller’s diarrhoea (TD) in a case-control study and to assess the concordance with the BioFire® FilmArray® Gastrointestinal Panel.

Methods

Stool samples from cases (n = 61) and controls (n = 30) were collected during travel and analysed by the GI-EB Screening assay (Seegene) in a case-control study. The concordance with the BioFire® FilmArray® Gastrointestinal Panel was expressed as the proportion of participants in which both tests agreed in the category “detected” and “not detected”.

Results

None of the test-target organisms (Campylobacter spp., Clostridioides difficile toxin A/B, Salmonella spp., Shigella spp./enteroinvasive Escherichia coli, E. coli O157, Shiga toxin-producing E. coli, Yersinia enterocolitica) was significantly associated with TD GI-EB Screening assay. The GI-EB Screening assay had an agreement with the BioFire® FilmArray® of 86.8–100%.

Conclusion

The selection of test-target organisms included in the GI-EB Screening assay appears inappropriate for the diagnostic work-up of TD as none of the detected pathogens was associated with TD. The GI-EB Screening assay had a good concordance with BioFire® FilmArray®.

Peer Review reports

Background

The World Health Organization (WHO) defines diarrhoea as “the passage of three or more loose or liquid stools per day, or more frequently than is normal for the individual” [1]. Among travel related morbidity, traveller’s diarrhoea (TD) is in first place [2]. The causative agents of TD are manifold (e.g. virus, bacteria, parasites) and often remain unidentified in culture-based routine microbiological analysis. Recently, various culture-independent syndromic multiplex assays were developed for the laboratory detection of a broad range of TD pathogens. Although these tests are more sensitive, their interpretation can become a challenge, if numerous pathogens are detected [3]. In addition, some pathogens have a weak association with disease or low attributable fractions among TD cases (e.g. Aeromonas sp., Plesiomonas shigelloides) [4, 5]. Finally, the presence of amplifiable DNA does not always correlate with the presence of viable pathogens.

As molecular tests for gastrointestinal infections become more and more part of routine diagnostics [6], there is a need to assess their clinical value for the diagnosis of TD. Therefore, the objective of this study was to evaluate the GI-EB Screening assay (Allplex™, Seegene, Düsseldorf, Germany) in a case-control study.

Methods

Stool samples

This study made use of an already existing collection of samples from international travellers with (n = 61) and without TD (n = 30) that were collected between 2016 and 2018 [5]. Age ≥ 18 years was the only inclusion criterion; no exclusion criteria were applied. Cases were defined according to the WHO-definition of diarrhoea [1]. Samples were collected and stored during travel in Cary-Blair medium (Faecal Transwab® Check Diagnostics, Westerau, Germany) and the first diarrheagenic sample from cases was included in the study [7]. Controls were randomly selected from asymptomatic travellers.

The samples were originally analysed for the acquisition dynamics of antimicrobial resistant bacteria (e.g. ESBL-producing Enterobacterales, vancomycin-resistant enterococci, carbapenem- or colistin-resistant Gram-negative bacteria) during international travel [7]. This set was also screened by culture for Clostridioides difficile (not detected), but not for any other enteropathogen.

Multiplex-PCR assay

DNA was extracted using GenoXtract (Hain, Nehren, Germany). The GI-EB Screening multiplex real-time PCR was performed on a CFX96 thermal cycler (Biorad, Feldkirchen, Germany) to detect Campylobacter spp., Clostridioides difficile toxin A/B, Salmonella spp., Shigella spp./enteroinvasive Escherichia coli (EIEC), E. coli O157, Shiga toxin-producing E. coli (STEC) and Yersinia enterocolitica according to the manufacturer’s instruction. Amplification curves were evaluated with Seegene viewer (V3.18.003). The same set of stool samples was already tested using the BioFire® FilmArray® Gastrointestinal Panel (bioMérieux, Marcy l’Étoile, France) [5].

Statistics

We compared categorical variables (e.g. the proportions of positive test results) between both groups (with and without TD) using Chi2-Test or Fisher’s exact test when appropriate and calculated the Odds-ratios (OR) and 95% confidence interval (95% CI). The OR was used to compute the attributable fraction (AF = proportion of a pathogen in the case group • [1 − (1/OR)]) [4]. The concordance between results from the GI-EB Screening assay and BioFire® FilmArray® Gastrointestinal Panel was calculated as the proportion of participants in which both tests agreed in the category “detected” and “not detected”.

Cost calculation

The overall costs of the GI-EB Screening assay and BioFire® FilmArray® Gastrointestinal Panel were calculated considering both costs for consumables and work force. Cost for work force were based on the sum of hands-on-time and the salary scale of laboratory technicians in the public service in Germany (4.250 €/month). In contrast to the GI-EB Screening assay, the BioFire® FilmArray® Gastrointestinal Panel does not require additional consumables for controls. Costs for controls were not included in this calculation as it depends on how many samples were processed in parallel.

Results

A detailed description of the study population (n = 91), the cases (n = 61) and controls (n = 30) is published elsewhere [5]. Briefly, the TD cases were younger (mean age 24 vs. 39, p < 0.001) and more likely female (66 vs. 33%, p = 0.004) than controls. The majority of participants travelled to Africa (36%), Asia (34%) and North America (15%). The travel destinations were unbalanced between cases and controls as more cases travelled to Africa (OR = 2.5, 95%CI: 0.9–5, p = 0.07) while a travel destination in South America was overrepresented in the control group (OR = 5, 95%CI: 1.4–25, p = 0.01).

The average duration of signs and symptoms of TD was 4 days. Stool samples were stored at ambient temperature during travel and at − 20 °C after travel until analysis (storage time at − 20° was approx. 2 years).

In total, 29% of participants (26/91) were tested positive in the GI-EB Screening assay. The majority had only one pathogen (20/91), followed by two pathogens (4/91) and three or four pathogens (each 1/91).

Overall, E. coli O157 was predominant (13/91), followed by STEC (9/91), Shigella spp./EIEC (5/91), Y. enterocolitica (5/91) and Salmonella spp. (3/91). Noteworthy, three travellers (2 cases, 1 control) had a co-detection of E. coli O157/STEC. Although Salmonella spp. was only detected in cases, none of the pathogens included in the GI-EB Screening assay was significantly associated with TD cases. All AFs were 0–3.5 (Table 1).

Table 1 Evaluation of the GI-EB Screening assay (Seegene) in travellers with and without traveller’s diarrhoea (TD)

A higher pathogen load corresponds to a lower Ct-value (threshold cycle, i.e. number of cycles required for a positive result) and could be used to distinguish between asymptomatic colonization and TD (e.g. ETEC, Campylobacter) assuming that pathogen concentration is higher in cases compared to controls [4]. The mean Ct-values were significantly higher in cases compared to controls for E. coli O157 (37.7 vs. 32.9, p = 0.03). Cases and controls had comparable Ct-values for Y. enterocolitica (34.3 vs. 33.6, p = 0.9) and STEC (35.6 vs. 34.9, p = 0.8). No comparison of Ct-values was done for Salmonella spp. and Shigella spp./EIEC as none or only one participant, respectively, was detected in the control group (Table 1).

The samples were also analysed by the BioFire® FilmArray® Gastrointestinal Panel for comparison [5] and the majority of pathogens were enteropathogenic E. coli (36/91, Table S1).

The concordance between the GI-EB Screening assay and BioFire® FilmArray® Gastrointestinal Panel was 86.8–100% depending on the target pathogen (Table 2).

Table 2 Concordance between GI-EB Screening assay (Seegene) and BioFire® FilmArray® Gastrointestinal Panel (bioMérieux [5])

Total costs for one analysis using the BioFire® FilmArray® Gastrointestinal Panel were 118.15 € (work force costs for 10 min: 3.15 €; consumable costs: 115.00€). One test with the GI-EB Screening assay costs 25.43 € (work force costs for 20 min: 6.30 €; consumable costs [incl. DNA extraction]: 19.13 €).

Discussion

We tested a selection of TD stool samples with the GI-EB Screening assay and found a low proportion of positive samples and a weak association with TD (Table 1). This weak test performance is most likely due to unsuitable target organisms of the test for the diagnosis of TD (Table 1). In general, ETEC (7–45%), enteropathogenic E. coli (EPEC, 26–47%) and enteroaggregative E. coli (EAEC, 5–46%) are predominant in TD in many countries [2, 8].

Ct-values were significantly higher in cases compared to controls for E. coli O157 suggesting a higher pathogen load in controls. The reason for this finding is, however, unclear and in contradiction with a larger study showing that the association with TD increases with lower Ct-values for STEC [4].

The good concordance (86.8–100%) of the GI-EB Screening assay with BioFire® FilmArray® Gastrointestinal Panel is in line with another report that showed a concordance of 82.6–100% for bacterial pathogens between GI-EB Screening assay and other multiplex platforms that are currently used (e.g. BioFire®, Luminex xTAG®) [9].

Syndromic multiplex tests are currently very much in vogue but their clinical value is often blurred due to the lack of asymptomatic control groups in the majority of studies [10, 11]. Without this control group, one cannot calculate the AF, which is a benchmark in the evaluation of these multiplex tests as it “indicates the proportion of cases that can be attributed to a particular pathogen” [2, 4]. Increasing detection rates or sensitivity does not imply an additional clinical value [11]. We therefore suggest that future studies must include an asymptomatic control group to shed light on the question, which detected pathogen is truly of clinical relevance.

The total costs (personnel and reagents) were markedly lower for the GI-EB Screening assay (25.43 €) than the BioFire® FilmArray® Gastrointestinal Panel (118.15 €) and comparable to other commercial PCR-kits covering similar bacterial species (e.g. RIDA®GENE: 20–25 € without DNA extraction) [12]. The more affordable PCR-kits, however, require a more sophisticated infrastructure (e.g. DNA extraction, test-platforms) and are suitable for processes in laboratories. In contrast, the more expensive BioFire® FilmArray® Gastrointestinal Panel has its strength as a point-of-care diagnostics.

Our study has limitations: First, the small sample size that does not allow for any conclusions on an association between the detection of rare pathogens and TD (e.g. Salmonella, Campylobacter). Second, we were unable to compare the multiplex-approaches with classical culture-based microbiological analyses, which was not done right after the return of the travellers. A post-hoc culture for enteropathogens more than two years after collection would lead to an unacceptably high rate of false-negative results by culture, particularly for fastidious pathogens such as Campylobacter sp. Third, we initially tested if sufficient controls are in our dataset to match them with the travel region of TD cases to rule out geographic confounders. Since we were unable to include matched controls for each case, we decided to select controls randomly. Therefore, the absence of an association between the detection of pathogens and TD might be confounded.

Conclusion

The GI-EB Screening assay is not suitable for the analyses of TD, as relevant target bacteria are not included in the assay and those included in the assay show very poor association with TD cases. The concordance between the GI-EB Screening assay and BioFire® FilmArray® Gastrointestinal Panel is good.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Change history

  • 14 April 2021

    In the original article an OA funding note was missing. An amendment to this paper has been published and can be accessed via the original article.

Abbreviations

AF:

Attributable fraction

EAEC:

Enteroaggregative Escherichia coli

EPEC:

Enteropathogenic Escherichia coli

ESBL:

Extended-spectrum betalactamases

EIEC:

enteroinvasive Escherichia coli

OR:

Odds-ratios

STEC:

Shiga toxin-producing Escherichia coli

TD:

Ttraveller’s diarrhoea

WHO:

World Health Organization

95% CI:

95% confidence interval

References

  1. 1.

    World Health Organization. Health topics Geneva, Switzerland: World Health Organization,; [Available from: https://www.who.int/topics/diarrhoea/en/.

  2. 2.

    Eckbo EJ, Yansouni CP, Pernica JM, Goldfarb DM. New tools to test stool: managing Travelers' diarrhea in the era of molecular diagnostics. Infect Dis Clin N Am. 2019;33(1):197–212.

    Article  Google Scholar 

  3. 3.

    Connor BA, Martin GJ, Riddle MS. Use of the multiplex diagnostic PCR panel in diarrheal disease: expert guidance on the interpretation of results with a focus on Travelers' diarrhea. Am J Gastroenterol. 2020:1553-5.

  4. 4.

    Lertsethtakarn P, Silapong S, Sakpaisal P, Serichantalergs O, Ruamsap N, Lurchachaiwong W, et al. Travelers' diarrhea in Thailand: a quantitative analysis using TaqMan Array card. Clin Infect Dis. 2018;67(1):120–7.

    CAS  Article  Google Scholar 

  5. 5.

    Schaumburg F, Correa-Martinez CL, Niemann S, Köck R, Becker K. Aetiology of traveller's diarrhea: a nested case-control study. Travel Med Infect Dis. 2020;101696.

  6. 6.

    Zimmermann S, Horner S, Altwegg M, Dalpke AH. Workflow optimization for syndromic diarrhea diagnosis using the molecular Seegene Allplex™ GI-Bacteria(I) assay. Eur J Clin Microbiol Infect Dis. 2020;39(7):1245–50.

    CAS  Article  Google Scholar 

  7. 7.

    Schaumburg F, Sertic SM, Correa-Martinez C, Mellmann A, Kock R, Becker K. Acquisition and colonization dynamics of antimicrobial-resistant bacteria during international travel: a prospective cohort study. Clin Microbiol Infect. 2019;25(10):1287 e1-.e7.

    Article  Google Scholar 

  8. 8.

    Hill DR, Beeching NJ. Travelers' diarrhea. Curr Opin Infect Dis. 2010;23(5):481–7.

    Article  Google Scholar 

  9. 9.

    Huang RSP, Johnson CL, Pritchard L, Hepler R, Ton TT, Dunn JJ. Performance of the Verigene® enteric pathogens test, Biofire FilmArray™ gastrointestinal panel and Luminex xTAG® gastrointestinal pathogen panel for detection of common enteric pathogens. Diagn Microbiol Infect Dis. 2016;86(4):336–9.

    CAS  Article  Google Scholar 

  10. 10.

    Schweitzer L, Singh B, Rupali P, Libman M. Emerging concepts in the diagnosis, treatment, and prevention of travelers' diarrhea. Curr Opin Infect Dis. 2019;32(5):468–74.

    Article  Google Scholar 

  11. 11.

    Coupland LJ, McElarney I, Meader E, Cowley K, Alcock L, Naunton J, et al. Simultaneous detection of viral and bacterial enteric pathogens using the Seeplex® diarrhea ACE detection system. Epidemiol Infect. 2013;141(10):2111–21.

    CAS  Article  Google Scholar 

  12. 12.

    Hahn A, Luetgehetmann M, Landt O, Schwarz NG, Frickmann H. Comparison of one commercial and two in-house TaqMan multiplex real-time PCR assays for detection of enteropathogenic, enterotoxigenic and enteroaggregative Escherichia coli. Tropical Med Int Health. 2017;22(11):1371–6.

    CAS  Article  Google Scholar 

Download references

Acknowledgements

We thank Martina Schulte and Anja Hassing for their excellent technical assistance.

Funding

The work was supported in part by the INTERREG Va program of the European Union (project EurHealth-1Health, grant number EU/INTERREG VA-681377). Open Access funding enabled and organized by Projekt DEAL.

Author information

Affiliations

Authors

Contributions

Conceptualization: FS, RK; Methodology: FS, NJF; Formal analysis and investigation: FS, NJF; Writing - original draft preparation: FS, NJF; Writing - review and editing: RK; Funding acquisition: FS, RK; Resources: FS; Supervision: FS; all authors read and approved the final version of the manuscript.

Corresponding author

Correspondence to Frieder Schaumburg.

Ethics declarations

Ethics approval and consent to participate

The Institutional Review Board of the University of Münster (2014–013-f-S) granted ethical approval for this study. All subjects gave a written informed consent in accordance with the Declaration of Helsinki.

Consent for publication

Not applicable.

Competing interests

F. Schaumburg is an awardee of the bioMérieux diagnostics prize of the German Society for Hygiene and Microbiology (2014). All other authors declare no conflict of interest to report.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Table S1

: Test results of the BioFire® FilmArray® Gastrointestinal Panel as reported elsewhere [1].

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Schaumburg, F., Froböse, N. & Köck, R. A comparison of two multiplex-PCR assays for the diagnosis of traveller’s diarrhoea. BMC Infect Dis 21, 181 (2021). https://doi.org/10.1186/s12879-021-05885-3

Download citation

Keywords

  • Diarrhoea
  • Travel medicine
  • Multiplex polymerase chain reaction
\