Skip to main content

Advertisement

Impact of matrix-assisted laser desorption/ionization time of flight mass spectrometric evaluation on the clinical outcomes of patients with bacteremia and fungemia in clinical settings lacking an antimicrobial stewardship program: a pre-post quasi experimental study

BMC Infectious Diseasesvolume 18, Article number: 385 (2018) | Download Citation

Abstract

Backgrounds

Several studies have evaluated the impact of matrix-assisted laser desorption/ionization time-of-flight (MALDI-TOF) mass spectrometry (MS) combined with antimicrobial stewardship in patients with positive blood cultures; clinical outcomes improved. However, in many hospitals, antimicrobial stewardship is not available because of restricted medical resources. Thus, we investigated the impact of evaluation by MALDI-TOF MS on the clinical outcomes of patients with bacteremia and fungemia treated in a clinical setting lacking an antimicrobial stewardship program (ASP).

Methods

We designed a pre–post quasi experimental study and retrospectively reviewed the medical records of patients aged > 18 years old with bacteremia and fungemia during two periods: October–December 2012 and October–December 2013. Conventional methods were used to detect microbial pathogens in 2012, and MALDI-TOF MS was employed in 2013. Clinical outcomes compared between periods were the time to pathogen identification, time to effective therapy, 30-day all-cause mortality, time to microbiological clearance, length of ICU stay, and rate of recurrence of the same bloodstream infection (BSI).

Results

A total of 556 patients were enrolled; 302 patients in 2012, and 254 in 2013. The use of MALDI-TOF MS without an ASP reduced the time to pathogen identification (86.4 vs. 63.5 h, P < 0.001) but did not significantly reduce the time to effective therapy (27.4 vs. 23.2 h, P = 0.187). Also, none of the following differed significantly between the two periods: mortality (17.5 vs. 15.7%, P = 0.571), the time to microbiological clearance (3.6 vs. 3.7 days, P = 0.675), the length of ICU stay (16.8 vs. 14.7 days, P = 0.706), and the recurrence rate of the same BSI (5.0 vs. 2.8%, P = 0.183).

Conclusions

The use of MALDI-TOF MS alone in a setting lacking an ASP did not afford clinical benefits. An ASP combined with MALDI-TOF MS is necessary to improve clinical outcomes.

Open Peer Review reports

Background

Despite considerable advances in medical technology and antibiotics, bloodstream infections (BSIs) are still associated with high-level mortality and morbidity [1]. The early administration of effective antibiotics is associated with improved clinical outcomes in patients with severe sepsis [2,3,4,5]. Similarly, early pathogen detection combined with appropriate therapeutic intervention improves the time to effective antimicrobial therapy and good clinical outcomes [6].

Matrix-assisted laser desorption/ionization time-of-flight (MALDI-TOF) mass spectrometry (MS) identifies microorganisms rapidly and accurately [7]. In clinical settings, MALDI-TOF MS reduces the time to identification by more than 24 h compared to conventional methods [8, 9].

Along with improvements in medical technology, antimicrobial stewardship programs (ASPs) have been introduced to care for septic patients and to optimize the use of antimicrobial agents [10]. However, in many hospitals around the world, ASPs are not in place because of restricted medical resources [11].

Several studies have shown that MALDI-TOF MS combined with an ASP improved clinical outcomes in patients with positive blood cultures [12,13,14,15,16,17,18]. Huang et al. [13] reported that the use of MALDI-TOF MS combined with an ASP in patients with bacteremia and candidemia was associated with improved clinical outcomes, including the time to effective therapy (30.1 vs. 20.4 h, P = 0.021), 30-day all-cause mortality (20.3% vs. 12.7%, P = 0.021), and length of intensive care unit (ICU) stay (14.9 vs. 8.3 days, P = 0.014) in univariate analyses, and that ASP introduction was related to a nonsignificant trend toward reduced mortality (odds ratio, 0.55; P = 0.075) in multivariate analysis.

However, the clinical responses afforded by MALDI-TOF MS-based evaluations alone have not been investigated. Thus, we explored the impact of MALDI-TOF MS on clinical outcomes (time to pathogen identification, time to effective therapy, 30-day all-cause mortality, time to microbiological clearance, length of ICU stay, and rate of recurrence of the same BSI) in patients with bacteremia and fungemia treated in a setting lacking an ASP. Because previous studies that evaluated the clinical impacts of other rapid diagnostic tests in the absence of an ASP failed to document the desired clinical outcomes [19, 20], we hypothesized that the introduction of MALDI-TOF MS alone would not improve clinical outcomes.

Methods

Study population and design

This retrospective, single-center, pre-post quasi-experimental study was conducted at Severance Hospital, a 2000-bed tertiary care hospital in Seoul, Korea. The electronic medical records of patients aged > 18 years old with positive blood cultures during two periods (October–December 2012 and October–December 2013) were reviewed. The conventional method (employing the ATB 32 GN system) was used to identify microorganisms in 2012, and MALDI-TOF MS was used in 2013. No ASP was in place during either period. Patients admitted to the institution for < 2 days after blood culture were excluded. The clinical outcomes were compared between the two periods. Our Institutional Review Board and local Ethics Committee approved the study.

Definitions

Community-acquired BSI was defined as a BSI that developed within 48 h of hospitalization, and a hospital-acquired BSI was defined as a BSI developing ≥48 h after hospitalization [21]. A polymicrobial BSI was defined as a BSI associated with more than one microorganism.

Patients with cultures positive for coagulase-negative Staphylococcus and normal skin flora were screened as contaminants [13]. Contamination was considered present if coagulase-negative Staphylococcus was detected in only one of multiple blood cultures from the same patient, except when patients were suspected to have been infected via central venous catheters or foreign devices. We excluded patients with positive blood cultures, defined as contaminants.

The clinical outcomes compared were the time to pathogen identification, time to effective therapy, 30-day all-cause mortality, time to microbiological clearance, length of ICU stay, and 30-day rate of recurrence of the same BSI. The time to effective therapy was defined as the time from blood collection for culture to the time of administration of the first antimicrobial agent to which the pathogen was susceptible in vitro [13]. The time to microbiological clearance was defined as the time from the first positive blood culture to the first negative blood culture.

Species identification and antimicrobial susceptibility testing

The microorganisms were identified using the ATB 32 GN system (bioMérieux, Marcy l’Etoile, France) in conventional period. In MALDI-TOF period, blood culture bottles were subcultured to the appropriate media and incubated aerobically and anaerobically for 18 to 24 h. Bacteria were applied as a thin film onto the plate and allowed to dry at room temperature. Subsequently, 2 μl of MALDI matrix was applied onto the colony and allowed to dry before testing. Analysis was done using MALDI Biotyper (Bruker Daltonics, Bremen, Germany). According to the criteria proposed by the manufacturer, an identification was considered reliable at the species level when the score was x ≥ 2 and at the genus level when the score was 1.7 ≤ x < 2 [21]. Antimicrobial susceptibility tests were performed using the disk-diffusion method or a VITEK-2 N131 card (bioMerieux, Hazelwood, MO, USA). The results were interpreted based on the Clinical and Laboratory Standards Institute (CLSI) guidelines.

Statistical analysis

A statistical analysis was performed using SPSS for Windows (ver. 20.0; SPSS Inc., Chicago, IL, USA). Patient baseline characteristics, microorganism distributions, and clinical outcomes were compared between the conventional evaluation and MALDI-TOF periods. Continuous variables were compared using Student’s t-test; categorical variables were compared with the aid of the chi-squared or Fisher’s exact test. A two-sided P-value < 0.05 was considered to reflect statistical significance.

A subgroup analysis of infectious disease (ID) intervention was performed to evaluate the impact of MALDI-TOF MS combined with such intervention. ID intervention was defined as admission to the ID division, or ID consultation, within 3 days after blood cultures were drawn. The clinical outcomes of the two evaluation periods were compared between the ID intervention subgroups.

Results

In total, 837 patients with positive blood cultures were identified during both study periods, and 556 were included in the final analysis (Fig. 1). The conventional period and MALDI-TOF MS period included 302 and 254 patients, respectively.

Fig. 1
figure1

Flowchart of selected patients. *Abbreviations; MALDI-TOF, matrix-assisted laser desorption/ionization time-of-flight; ID, infectious disease

Full size image

The baseline characteristics were similar between the two periods, except for the male: female ratio (Table 1). The patients in the MALDI-TOF group tended to be female (53.5 vs. 37.7% in the conventional period, P < 0.001), but no other demographic factor, including age, underlying disease, clinical condition, BSI acquisition (community- or hospital-acquired), or BSI source, differed significantly between the two periods. Sepsis-related organ failure assessment scores were calculated for all patients and did not differ significantly between the two periods (3.7 vs. 4.2, P = 0.110).

Table 1 Patient baseline characteristics
Full size table

The microorganism distributions were also generally similar between the two periods (Table 2). The polymicrobial BSI frequencies were 11.9% in the conventional period and 10.2% in the MALDI-TOF MS period (P = 0.530). The prevalence of Gram-positive bacteria (33.1 vs. 32.3%, P = 0.821), Gram-negative bacteria (61.5 vs. 60.4%, P = 0.762), and yeasts (5.3 vs. 7.4%, P = 0.294), did not differ significantly between the two periods.

Table 2 Microorganism distribution
Full size table

Compared to the conventional approach, MALDI-TOF MS performed in the absence of an ASP reduced the time to pathogen identification (86.4 vs. 63.5 h, P < 0.001) but did not significantly reduce the time to effective therapy (27.4 vs. 23.2 h, P = 0.187; Table 3), 30-day all-cause mortality (17.5% vs. 15.7%, P = 0.571), time to microbiological clearance (3.6 vs. 3.7 days, P = 0.675), length of ICU stay (16.8 vs. 14.7 days, P = 0.706), or 30-day rate of recurrence of the same BSI (5.0% vs. 2.8%, P = 0.183). The clinical outcomes did not differ significantly between the two periods.

Table 3 Clinical outcomes
Full size table

Of the 556 study patients, 89 were hospitalized in the ID division and 65 were referred for ID consultation within 3 days after blood cultures were drawn. A total of 154 patients were thus included in the ID intervention subgroup; 79 and 75 in the conventional and MALDI-TOF MS periods, respectively. Subgroup analysis revealed that MALDI-TOF MS combined with the ID intervention significantly improved not only the time to pathogen identification (86.9 vs. 62.5 h, P < 0.001) but also the time to effective therapy (27.8 vs. 17.1 h, P = 0.031), compared to the conventional approach (Table 4). No other outcome, including 30-day all-cause mortality (8.9 vs. 6.7%, P = 0.612), the time to microbiological clearance (4.1 vs. 3.4 days, P = 0.081), the length of ICU stay (14.1 vs. 11.7 days, P = 0.719), and the 30-day recurrence rate of the same BSI (2.0 vs. 0.0%, P = 0.183), differed significantly during either period in the ID intervention subgroup.

Table 4 Clinical outcomes in Infectious disease Intervention subgroup
Full size table

Discussion

Most studies of the effects of MALDI-TOF mass spectrometric evaluation have been conducted in clinical settings featuring ASPs [12,13,14,15,16,17,18]. Of the hospitals included in one international survey, 58% had ASPs, but the rates were low in Africa (14%), South and Central America (46%), and Oceania (47%) [11]. Many hospitals do not adopt ASPs because of a lack of funds, personnel, and/or information technology, or prescriber opposition. However, few studies have explored the clinical outcomes afforded by MALDI-TOF MS in clinical settings lacking ASPs. In an observational study, Clerc et al. [21] explored the utility of the MALDI-TOF MS-based identification of Gram-negative pathogens in patients with BSIs who were not enrolled in an ASP, but included only patients who underwent ID consultations. We studied bacteremic and fungemic patients regardless of ID consultation status; this may reflect the real clinical situation in hospitals lacking ASPs.

We found that evaluation by MALDI-TOF MS in a setting lacking an ASP did not improve clinical outcomes. MALDI-TOF MS reduced the time to pathogen identification (86.4 vs. 63.5 h, P < 0.001), but the time to effective therapy did not significantly differ from that achieved with the conventional approach (23.2 vs. 27.4 h). Other outcomes, including 30-day all-cause mortality, the time to microbiological clearance, the length of ICU stay, and the 30-day recurrence rate of the same BSI, did not differ significantly between the two periods. Another study showed that MALDI-TOF MS used with an ASP reduced the time to pathogen identification (84 vs. 55.9 h, P = 0.001), leading to improved clinical outcomes [13]. These findings are consistent with those of previous studies evaluating the clinical impacts of other rapid diagnostic tests in the absence of ASPs [19, 20]. Trep et al. [19] evaluated the impact of rapid methicillin-resistant Staphylococcus aureus polymerase chain reaction testing in patients with purulent skin infections. Clinical outcomes did not improve; the introduction of a rapid diagnostic test in the absence of an effective implementation strategy failed to produce the desired results. Another study investigated the impact of peptide nucleic acid fluorescence in situ hybridization evaluation in patients with coagulase-negative Staphylococcus bacteremia [20]. Again, no clinical benefit in terms of the length of hospital stay or vancomycin use was apparent in the absence of an ASP.

The use of MALDI-TOF MS significantly reduced the time to effective therapy in the ID intervention subgroup; the time was 27.8 h in the conventional period, and 17.1 h in the MALDI-TOF MS period (P = 0.031). This finding suggests that the ID intervention helped to reduce the time to effective therapy, in line with the findings of other reports showing that MALDI-TOF MS combined with antimicrobial stewardship improves clinical outcomes [12,13,14,15,16,17,18]. Our findings thus support the importance of the role of the ID specialist and an ASP.

Huang et al. [13] reported that MALDI-TOF with ASP in patients with bacteremia and candidemia reduced not only time to effective therapy (30.1 vs 20.4 h, P = 0.021) but also 30-day all-cause mortality (20.3% vs 12.7%, P = 0.021) and length of ICU stay (14.9 vs 8.3 days, P = 0.014) in univariate analysis. In the present study, ID subgroup analysis revealed no significant reductions in 30-day all-cause mortality (8.9% vs. 6.7%, P = 0.612) or length of ICU stay (14.1 vs. 11.7 days, P = 0.719). However, the ID intervention of our study was not equivalent to an ASP. The principal focus of our study was on whether evaluation by MALDI-TOF MS in a setting lacking an ASP improved clinical outcomes; we found that it did not.

Our study has several limitations. First, this was a single-center retrospective cohort study. It may thus be difficult to generalize our results. Also, any retrospective study may be subject to selection or information bias. Second, we did not calculate the appropriate sample size, which may have contributed to the non-significance of the difference in time to effective therapy (27.4 vs. 23.2 h, P = 0.187) in the total group. Third, we censored data from patients who did not receive effective antibiotics with in vitro activity, but we used no other technique to handle censored data. Fourth, follow-up blood culture was not the same for all patients because this was a retrospective cohort study. Differences among clinicians in the approach to follow-up blood culture may have resulted in ascertainment bias.

Conclusions

Our results suggest that the use of MALDI-TOF MS alone (thus, in a setting lacking an ASP) did not improve the clinical benefits afforded to patients with bacteremia and fungemia. Our study strengthens the suggestion that an ASP is important when seeking to enhance clinical outcomes.

References

  1. 1.

    Goto M, Al-Hasan MN. Overall burden of bloodstream infection and nosocomial bloodstream infection in North America and Europe. Clin Microbiol Infect. 2013;19(6):501–9.

  2. 2.

    Barie PS, Hydo LJ, Shou J, Larone DH, Eachempati SR. Influence of antibiotic therapy on mortality of critical surgical illness caused or complicated by infection. Surg Infect. 2005;6(1):41–54.

  3. 3.

    Ferrer R, Artigas A, Suarez D, Palencia E, Levy MM, Arenzana A, Perez XL, Sirvent JM. Effectiveness of treatments for severe sepsis: a prospective, multicenter, observational study. Am J Respir Crit Care Med. 2009;180(9):861–6.

  4. 4.

    Kumar A, Roberts D, Wood KE, Light B, Parrillo JE, Sharma S, Suppes R, Feinstein D, Zanotti S, Taiberg L, et al. Duration of hypotension before initiation of effective antimicrobial therapy is the critical determinant of survival in human septic shock. Crit Care Med. 2006;34(6):1589–96.

  5. 5.

    Puskarich MA, Trzeciak S, Shapiro NI, Arnold RC, Horton JM, Studnek JR, Kline JA, Jones AE. Association between timing of antibiotic administration and mortality from septic shock in patients treated with a quantitative resuscitation protocol. Crit Care Med. 2011;39(9):2066–71.

  6. 6.

    Riedel S, Carroll KC. Early identification and treatment of pathogens in sepsis: molecular diagnostics and antibiotic choice. Clin Chest Med. 2016;37(2):191–207.

  7. 7.

    Bizzini A, Greub G. Matrix-assisted laser desorption ionization time-of-flight mass spectrometry, a revolution in clinical microbial identification. Clin Microbiol Infect. 2010;16(11):1614–9.

  8. 8.

    Tan KE, Ellis BC, Lee R, Stamper PD, Zhang SX, Carroll KC. Prospective evaluation of a matrix-assisted laser desorption ionization-time of flight mass spectrometry system in a hospital clinical microbiology laboratory for identification of bacteria and yeasts: a bench-by-bench study for assessing the impact on time to identification and cost-effectiveness. J Clin Microbiol. 2012;50(10):3301–8.

  9. 9.

    Vlek AL, Bonten MJ, Boel CH. Direct matrix-assisted laser desorption ionization time-of-flight mass spectrometry improves appropriateness of antibiotic treatment of bacteremia. PLoS One. 2012;7(3):e32589.

  10. 10.

    Dellit TH, Owens RC, McGowan JE Jr, Gerding DN, Weinstein RA, Burke JP, Huskins WC, Paterson DL, Fishman NO, Carpenter CF, et al. Infectious diseases society of America and the Society for Healthcare Epidemiology of America guidelines for developing an institutional program to enhance antimicrobial stewardship. Clin Infect Dis. 2007;44(2):159–77.

  11. 11.

    Howard P, Pulcini C, Levy Hara G, West RM, Gould IM, Harbarth S, Nathwani D. An international cross-sectional survey of antimicrobial stewardship programmes in hospitals. J Antimicrob Chemother. 2015;70(4):1245–55.

  12. 12.

    Carreno JJ, Lomaestro BM, Jacobs AL, Meyer RE, Evans A, Montero CI. Assessment of time to clinical response in patients with sepsis treated before and after implementation of a matrix-assisted laser desorption ionization time-of-flight blood culture identification algorithm. Infect Control Hosp Epidemiol. 2016;37(8):916–23.

  13. 13.

    Huang AM, Newton D, Kunapuli A, Gandhi TN, Washer LL, Isip J, Collins CD, Nagel JL. Impact of rapid organism identification via matrix-assisted laser desorption/ionization time-of-flight combined with antimicrobial stewardship team intervention in adult patients with bacteremia and candidemia. Clin Infect Dis. 2013;57(9):1237–45.

  14. 14.

    Osthoff M, Gurtler N, Bassetti S, et al. Impact of MALDI-TOF-MS-based identification directly from positive blood cultures on patient management: a controlled clinical trial. Clin Microbiol Infect. 2017;23(2):78–85.

  15. 15.

    Patel TS, Kaakeh R, Nagel JL, Newton DW, Stevenson JG. Cost Analysis of Implementing Matrix-Assisted Laser Desorption Ionization-Time of Flight Mass Spectrometry Plus Real-Time Antimicrobial Stewardship Intervention for Bloodstream Infections. J Clin Microbiol. 2017;55(1):60–7.

  16. 16.

    Verroken A, Defourny L, le Polain de Waroux O, Belkhir L, Laterre PF, Delmee M, Glupczynski Y. Clinical impact of MALDI-TOF MS identification and rapid susceptibility testing on adequate antimicrobial treatment in sepsis with positive blood cultures. PLoS One. 2016;11(5):e0156299.

  17. 17.

    Wenzler E, Goff DA, Mangino JE, Reed EE, Wehr A, Bauer KA. Impact of rapid identification of Acinetobacter Baumannii via matrix-assisted laser desorption ionization time-of-flight mass spectrometry combined with antimicrobial stewardship in patients with pneumonia and/or bacteremia. Diagn Microbiol Infect Dis. 2016;84(1):63–8.

  18. 18.

    Perez KK, Olsen RJ, Musick WL, Cernoch PL, Davis JR, Peterson LE, Musser JM. Integrating rapid diagnostics and antimicrobial stewardship improves outcomes in patients with antibiotic-resistant gram-negative bacteremia. J Inf Secur. 2014;69(3):216–25.

  19. 19.

    Terp S, Krishnadasan A, Bowen W, Joo J, Furoy D, Chan J, Moran G, Talan D. Introduction of rapid methicillin-resistant Staphylococcus aureus polymerase chain reaction testing and antibiotic selection among hospitalized patients with purulent skin infections. Clin Infect Dis. 2014;58(8):e129–32.

  20. 20.

    Holtzman C, Whitney D, Barlam T, Miller NS. Assessment of impact of peptide nucleic acid fluorescence in situ hybridization for rapid identification of coagulase-negative staphylococci in the absence of antimicrobial stewardship intervention. J Clin Microbiol. 2011;49(4):1581–2.

  21. 21.

    Clerc O, Prod'hom G, Vogne C, Bizzini A, Calandra T, Greub G. Impact of matrix-assisted laser desorption ionization time-of-flight mass spectrometry on the clinical management of patients with gram-negative bacteremia: a prospective observational study. Clin Infect Dis. 2013;56(8):1101–7.

Download references

Funding

This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT) (2017R1C1B5017875).

Availability of data and materials

The datasets used and/or analyzed during the current study available from the corresponding author on reasonable request.

Author information

Affiliations

  1. Department of Internal Medicine, Severance Hospital, Yonsei University College of Medicine, 50-1 Yonsei-ro, Seodaemun-gu, Seoul, 120-752, Republic of Korea

    • Yong Duk Jeon
    • , Hye Seong
    • , Mi Young Ahn
    • , In Young Jung
    • , Su Jin Jeong
    • , Jun Yong Choi
    • , Young Goo Song
    • , June Myung Kim
    •  & Nam Su Ku

  2. AIDS Research Institute, Yonsei University College of Medicine, Seoul, South Korea

    • Yong Duk Jeon
    • , Mi Young Ahn
    • , In Young Jung
    • , Su Jin Jeong
    • , Jun Yong Choi
    • , Young Goo Song
    • , June Myung Kim
    •  & Nam Su Ku

  3. Department of Laboratory Medicine, Yonsei University College of Medicine, Seoul, South Korea

    • Dokyun Kim
    • , Dongeun Yong
    •  & Kyungwon Lee

Authors

  1. Search for Yong Duk Jeon in:

  2. Search for Hye Seong in:

  3. Search for Dokyun Kim in:

  4. Search for Mi Young Ahn in:

  5. Search for In Young Jung in:

  6. Search for Su Jin Jeong in:

  7. Search for Jun Yong Choi in:

  8. Search for Young Goo Song in:

  9. Search for Dongeun Yong in:

  10. Search for Kyungwon Lee in:

  11. Search for June Myung Kim in:

  12. Search for Nam Su Ku in:

Contributions

Conception and design of study: YDJ and NSK. Data collection: HS, MYA, IYJ. Data analysis and interpretation: YDJ, HS, DK, MYA, IYJ, SJJ, JYC, YGS, DY, KL, JMK, NSK. Drafting of the manuscript: YDJ and NSK. Approval final version of manuscript: YDJ, HS, DK, MYA, IYJ, SJJ, JYC, YGS, DY, KL, JMK, NSK.

Corresponding author

Correspondence to Nam Su Ku.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the institutional review board (IRB) of the Yonsei University Health System Clinical Trial Center. The IRB waived the requirement for informed consent because we retrospectively reviewed the medical records.

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Keywords

  • Matrix-assisted laser desorption/ionization time-of-flight
  • Antimicrobial stewardship program
  • Bacteremia
  • Fungemia
  • Clinical outcome

BMC Infectious Diseases

ISSN: 1471-2334

Contact us