Skip to main content

Evaluation of antibody-based preventive alternatives for respiratory syncytial virus: a novel multi-criteria decision analysis framework and assessment of nirsevimab in Spain

Abstract

Background

Respiratory syncytial virus (RSV) is a highly infectious disease that poses a significant clinical and medical burden, as well as social disruption and economic costs, recognized by the World Health Organization as a public health issue. After several failed attempts to find preventive candidates (compounds, products, including vaccines), new alternatives might be available, one being nirsevimab, the first and only option approved for RSV prevention in neonates and infants during their first RSV season. The objective of this study was to develop a novel multi-criteria decision analysis (MCDA) framework for RSV antibody-based preventive alternatives and to use it to assess the value of nirsevimab vs. placebo as a systematic immunization approach to prevent RSV in neonates and infants during their first RSV season in Spain.

Methods

Based on a pre-established model called Vaccinex, an ad-hoc MCDA framework was created to reflect relevant attributes for the assessment of current and future antibody-based preventive measures for RSV. The estimated value of nirsevimab was obtained by means of an additive linear model combining weights and scores assigned by a multidisciplinary committee of 9 experts. A retest and three sensitivity analyses were conducted.

Results

Nirsevimab was evaluated through a novel framework with 26 criteria by the committee as a measure that adds value (positive final estimated value: 0.56 ± 0.11) to the current RSV scenario in Spain, by providing a high efficacy for prevention of neonates and infants. In addition, its implementation might generate cost savings in hospitalizations and to the healthcare system and increase the level of public health awareness among the general population, while reducing health inequities.

Conclusions

Under a methodology with increasing use in the health field, nirsevimab has been evaluated as a measure which adds value for RSV prevention in neonates and infants during their first RSV season in Spain.

Peer Review reports

Introduction

RSV is a highly infectious disease, with an unpredictable course and a significant clinical and medical burden, as well as social disruption and economic costs. Approximately 70% of children ≤ 12 months and 90% of children ≤ 2 years [1] became infected by this virus, asserting that a significant portion of the infant population faces a high risk of contracting this infectious agent. Clinic evolution of infant cases is difficult to predict, and can include lower respiratory tract infection (LRTI), such as pneumonia and bronchiolitis, entailing hospitalization, use of pediatric care units, oxygen support, palliative care or, in some cases, leading to death [2]. Furthermore, a significant proportion of cases occur in previously healthy infants, without underlying pathologies or at risk [3]. It is estimated that 43.2 out of every 1,000 children aged ≤ 1 are hospitalized with RSV (data from September 2017 until June 2018, in Spain) [4].

Over the past 60 years there have been several unsuccessful attempts to find candidates for RSV prevention or effective antiviral treatment for infants [5,6,7,8]. Thereby, RSV infections are a public health problem recognized by the World Health Organization (WHO), which advocates for a comprehensive RSV prevention strategy, preferably during the initial 15 months of life [9].

Decisions on the allocation of public health resources are complex, as they must incorporate patient access to innovations whilst safeguarding the financial sustainability of the system, in an environment of prominent demographic, technological, social, and budgetary challenges. Healthcare decision-makers use manifold tools to guide the decision-making process, such as economic evaluation and budget impact analysis. However, other factors are often also considered, such as severity of disease, availability of preventive and treatment alternatives, size of population affected, equity, social impact, quality of available evidence or degree of technological innovation.

In light of the aforementioned factors, the multi-criteria decision analysis (MCDA) is an instrument that yields ways of informing the preferences inherent to the decisions, in a consistent, explicit and transparent manner [10]. Despite the recent use of MCDA in health (it has been applied in other areas such as environment/waste, logistics/transportation, management, agriculture), this methodology has been implemented in practice in decision-making in many countries, including Spain [11,12,13].

In Spain, a new preventive measure for RSV (nirsevimab) has been recently approved [14]. Nirsevimab (Beyfortus®, Sanofi, Paris, France, and AstraZeneca AB, Södertälje, Sweden) is a recombinant human IgG1 kappa engineered monoclonal antibody that binds the F1 and F2 subunits of the RSV fusion (F) protein (antigenic site 0 of the protein in its pre-F form) to block viral entry into the host cell. It has been authorized by the European Medicines Agency (EMA) for the prevention of RSV LRTI in neonates and infants during their first RSV season, in October 2022 [14]. Moreover, other preventive measures (monoclonal antibodies, vaccines for infants, etc.) are expected to be introduced in the future [15]. All these interventions will require a specific evaluation framework.

MCDA assessments often necessitate the inclusion of a comparator for analysis. Presently, the prevention of RSV has only one available alternative, palivizumab, which is utilized in a mere 1.4% of the population in Spain [16, 17]. Palivizumab is authorized for preventing severe lower respiratory tract disease caused by RSV in children at high risk [18]. Consequently, opting for “placebo” as the comparator in this MCDA is the most appropriate choice, as it accurately represents the current standard of care in Spain. Thus, in the context of the ongoing MCDA in RSV, the term “placebo” should be understood as indicating no intervention.

The central objective of this research was to develop a novel MCDA framework for RSV antibody-based preventive alternatives and to assess the value of nirsevimab vs. placebo as a systematic immunization approach to prevent RSV in neonates and infants during their first RSV season in Spain.

To accomplish these objectives, we opted for Vaccinex [19] as the reference model, given its comprehensive nature in comparison to other identified frameworks used for evaluating preventive measures, such as vaccines [19,20,21,22]. Building upon this framework, we developed a tailored set of criteria adhering to the ISPOR guidelines on good practices [23]. These guidelines highlight the significance of selecting criteria that meet specific requirements, including completeness, non-redundancy, non-overlap, and preferential independence [23].

Methods

Study design

The following steps were undertaken in order to carry out this MCDA (Fig. 1): (1) a multidisciplinary committee of experts was constituted; (2) a first narrative review of the literature was performed, and as a result, a pre read document was elaborated (supplementary file 1); (3) experts were trained in the MCDA methodology; (4) based on the aforementioned pre-established framework (Vaccinex [19]) experts defined the framework for RSV, i.e. the set of criteria which should be used when evaluating any current or future antibody-based preventive measures in RSV; (5) experts weighted the selected criteria using the 1–5 scale method, thus making explicit their preferences on the relative importance of each one of them (where 1 means that the criterion is not very relevant in the evaluation of any preventive measure in this pathology, and 5, very relevant), regardless of the preventive measure to be evaluated; (6) a second narrative review of the literature was undertaken, resulting in an evidence summary document (supplementary file 2); (7) experts scored, online, individually, and blinded, aspects related to the pathology and the value contribution of nirsevimab vs. placebo in the prevention of RSV. For the absolute criteria (which do not compare the alternatives), the score ranged on a scale from 0 to 5, with 0 being the lowest value and 5 being the highest. For the relative criteria (which compare nirsevimab vs. placebo), the scale ranged from − 5 to 5 to reflect the full range of comparative effects; (8) an analysis of the results and the calculation of the final estimated value was realized; (9) the results of the scores and the final estimated value of nirsevimab vs. placebo were presented and discussed; (10) a retest of the weights and scores was performed; 11) three sensitivity analysis were conducted.

Fig. 1
figure 1

Study design

Main results derive from the test (Sect. 3.13.5), whilst the retest and sensitivity analyses are portrayed in a specific Sect. (3.6).

Expert panel

This study was developed through a multidisciplinary committee of experts (MCE) formed by 9 members with different academic profiles. The choice of the MCE considered a balance between geographical representation (5 Autonomous Communities of Spain), the presence of different academic background (professionals in the field of pediatric, virology, preventive medicine, public health, epidemiology, government affairs and health economics), and the experience of the committee members in the management and prevention of respiratory virus and healthcare decision-making. Finally, an additional criterion for inclusion was the absence of conflict of interest from the MCE experts.

Literature review

The information obtained by the two comprehensive non-systematic literature reviews were assembled into a pre read document (supplementary file 1) and an evidence summary (supplementary file 2), which were reviewed and validated by the clinicians from the MCE. The search was carried out in the main biomedical databases, such as PubMed, clinical trial registries, clinical practice guidelines, web pages of the official European and Spanish health assessment bodies, such as EMA, the Spanish Agency for Medicines and Health Products (AEMPS) or the health technology assessment agencies, as well as in grey literature sources. Publications in English and Spanish were included.

Framework

The final framework consists of a set of selected criteria (see results section). Details such as how criteria were selected, the names of each criterion, the domains to which they belong, their definitions and their scoring scales, can be found in the supplementary files 3 and 4.

Data analysis

An overall estimated value (ranging from − 1 to 1) was obtained for the comparison between nirsevimab and placebo, through an additive linear model of all individual criteria value contributions, which were calculated as the product of normalized weights and scores:

$$ V = \sum\limits_{x = 1}^n {{V_x}}= \sum\limits_{x = 1}^n {\left( {\frac{{{w_x}}}{{\sum {{W_n}} }}{S_x}} \right)}$$
(1)

where V is the total estimated value, Vx the value contribution of the criterion x, Wx the weighting of the criterion x, ∑Wn the sum of all weights, and Sx the normalized score of the criterion x (Sx = score / 5).

Retest and sensitivity analysis

A retest and three sensitivity analysis were performed. Firstly, to evaluate the consistency, replicability, and internal validity of the results, a final estimated value was calculated with the results obtained by the retest and was contrasted with the base case value. The degree of agreement between the responses given at the two time points (test and retest) was evaluated by means of intra-rater correlation coefficients (ICC 3.1) using STATA® version 14 (STATA Corp., LP, College Station, TX, USA). Secondly, to assess the extent to which a change in the expert weights would affect the final estimated value of this MCDA, the expert weights were replaced with the original weights from the Vaccinex framework [19], and the impact on the final estimated result was analyzed. Thirdly, an outlier (measured by more than 1.5 times the central quartiles of the final estimated results) was excluded from the analysis, and this result was compared with the one from the base case. Finally, an evaluation of nirsevimab vs. palivizumab (a monoclonal antibody authorized for the prevention of serious lower respiratory tract disease requiring hospitalization caused by RSV in children at high risk for RSV disease [18, 24]) was also performed.

Results

Framework

Sixteen criteria were excluded from the Vaccinex framework (eradication potential, mode of transmission, image and goodwill, resistance offered by anti-vaccination groups, impact on the population of pregnant women, impact on school activities, time to development of symptoms, costs related to the production platform, productivity costs [presenteeism], generation of jobs in the country, impact on migrant population, impact on fertility, impact on the Lesbian, Gay, Bisexual, Transgender, and Intersex (LGTBI) population, impact on the female population, perception and fear, legal liability), and two criteria which were not present in Vaccinex were included (burden of disease – incidence on the outpatient setting; burden of disease – incidence on the inpatient setting). In addition, the disease prevalence criterion was renamed as “population in which the prevention strategy would be indicated”. The final framework for RSV assessment consists of 26 criteria (Tables 1 and supplementary files 3 and 4).

Table 1 Multi-criteria decision analysis framework for the evaluation of antibody-based preventive measures for respiratory syncytial virus infections

Weights

Based on the mean weights given by the experts, the five criteria considered as most relevant to any evaluation of antibody-based preventive measures in RSV were efficacy of the preventive measure (4.6 ± 0.7 out of 5.0), severity of symptoms (4.4 ± 0.7), incidence on the inpatient setting (4.4 ± 0.9), lethality risk (4.2 ± 1.2) and serious adverse events (4.2 ± 1.3), while those of lesser relevance were innovation stimulus (2.3 ± 1.1), impact on productivity cost (2.6 ± 0.9), impact on caregivers (2.6 ± 1.0), public health awareness (2.7 ± 1.1) and cost of the disease on the patient (out of pocket expenses) [2.7 ± 0.5] (Fig. 2). See supplementary file 5 for detailed weights, overall and by subgroups.

Fig. 2
figure 2

Relevance of each individual criterion in the assessment of any antibody-based preventive measures for respiratory syncytial virus (mean, min, max and median weights, and standard deviations). The 1–5 scale method was applied, where 1 means that the criterion is not very relevant in the evaluation of any preventive measure in this pathology, and 5 means that it is a very relevant criterion

Absolute scores

The examination of the absolute scores (Fig. 3 and Table 2) suggests that RSV is a disease with no effective alternative treatment and with a prevention alternative which is very limited (mean scores, availability of treatment: 4.4 ± 0.7 out of 5.0; prevention alternatives: 4.2 ± 0.7). The only antiviral treatment available (ribavirin®) can only be administered in severe cases, requires aerosolization in specific devices and its routine use is not recommended [25, 26]. The only prevention alternative, palivizumab®, is only indicated for high-risk premature infants and in a hospital setting [18, 27].

Fig. 3
figure 3

Scores assigned per absolute criterion (mean, standard deviations, min, max, median scores, and weights). Scale from 0 to 5

Table 2 Mean scores and key comments from the multidisciplinary committee of experts or based on evidence, for each absolute criterion

Furthermore, children with a disease caused by an infection by RSV are at high risk of developing comorbidities in the short, medium, and long term (mean score comorbidity risk: 3.6 ± 0.9). Additionally, the incidence of RSV is very high (mean score incidence of RSV cases: 4.0 ± 0.7), with infections occurring in 90% of children within their first 2 years of life [1, 28]. This translates into a very high burden of disease, inappropriate consumption of antibiotics and healthcare resources, as reflected by its inpatient and outpatient incidence (39,690 RSV cases/100,000 children ≤ 1 years, 9 medical visits per infected patient [4]) vs. (2,520 hospitalizations for RSV/100,000 children ≤ 2 years [29]), respectively (mean scores: incidence on the inpatient setting: 3.3 ± 1.3; incidence on the outpatient setting: 4.1 ± 0.8).

Moreover, it is a highly transmissible pathology (R0 = 4.5 [30], mean score transmissibility: 3.7 ± 1.0), with a high impact on the population of children (mean score: 4.2 ± 1.0), who present losses in quality of life after diagnosis and stress levels after hospital discharge of 39% and 79%, respectively [31, 32].

Finally, bronchiolitis (one of the main diseases caused by RSV) has a rate of 82 deaths per every 100,000 children ≤ 2 years hospitalized [33], which is not considered as very high by the experts (mean score lethality risk: 2.1 ± 1.2). In addition, it presents moderate symptoms (mean score severity of symptoms: 3.0 ± 1.1) that usually last for three to seven days, which is regarded as not very long lasting by the MCE (mean score time of duration of acute symptoms: 2.7 ± 1.0). See supplementary files 5 and 6 for detailed absolute scores.

Relative scores

Overall, relative scores (Fig. 4 and Table 3) indicate that nirsevimab was considered by the MCE as a preventive measure with clinical benefits, as it is much more effective than placebo (80% efficacy in preventing medically attended RSV-associated LRTI [34]; mean score efficacy of the preventive measure: 4.3 ± 0.5 out of 5.0), with a robust safety profile (safety outcomes associated with nirsevimab are comparable to those observed with placebo) (mean score serious adverse events: -0.1 ± 0.3).

Fig. 4
figure 4

Scores assigned per relative criterion (mean, standard deviations, and weights). Scale from − 5 to 5

Table 3 Mean scores and key comments from the multidisciplinary committee of experts or based on evidence, for each relative criterion, nirsevimab vs. placebo

This clinical benefit, added to the fact that nirsevimab is indicated for neonates and infants during their first RSV season (mean score population in which the prevention strategy would be indicated: 4.2 ± 1.6), is also associated with several economic and social benefits.

To assess the economic benefits, since the price of nirsevimab was unknown at the time of the study, and for the purpose of this exercise, it was benchmarked with the price of innovative vaccines in Spain. Thereby, experts granted a negative score on the monetary cost of the preventive measure, in relation to placebo (-3.7 ± 1.8).

Furthermore, there was consensus (> 85% positive scores) that the implementation of nirsevimab vs. placebo would generate savings in other health system costs, such as hospitalizations, outpatient consultations, or emergency room care (mean score cost of the disease on the health system: 3.3 ± 1.5); that it would improve the labor productivity of caregivers, generating savings in costs related to absenteeism (mean score productivity cost – absenteeism: 2.6 ± 1.4); and in patients’ out-of-pocket expenses (mean score cost of the disease on the patient: 1.8 ± 1.8).

Moreover, the social benefits of using nirsevimab in comparison to placebo would translate, on the one hand, into an increase in public health awareness through greater social debate and greater parental attention in the case of introducing this preventive measure in the children childhood immunization schedule (mean score public health awareness: 2.3 ± 1.6). On the other hand, its universal recommendation would result in the elimination of health inequity (mean score impact on health inequity: 2.8 ± 1.6), contributing to avoiding RSV infections in the most disadvantaged populations, for whom RSV represents a greater burden in terms of comorbidity and mortality (see supplementary files 5 and 6 for detailed relative scores).

Final estimated value

The final estimated value (overall means, n = 9) obtained in this MCDA in RSV was 0.56 ± 0.11 (0.32–0.67) for the comparison between nirsevimab and placebo (Fig. 5), meaning that the introduction of nirsevimab would provide positive value in the view of the MCE.

Fig. 5
figure 5

Value contribution of nirsevimab compared to placebo according to the multi-criteria decision analysis framework for the assessment of antibody-based preventive measures for respiratory syncytial virus (mean, standard deviation, min, max)

Out of this total, 0.43 was related to the absolute criteria, whilst 0.13 was associated with the relative criteria. Individually, the criteria with the highest contribution to the final estimated value were efficacy of the preventive measure (7.5% of total value), availability of treatment (6.7%), impact on the population of children (6.5%), incidence on the outpatient setting (6.5%), and incidence of RSV cases (6.1%). See supplementary file 5 for detailed results.

Retest and sensitivity analysis

The consistency of the weights between test and retest was high, with an average intra-rater correlation coefficient (ICC) of 0.8366. Likewise, the retest scores and value estimates were very similar to the test, with average ICCs of 0.9189 and 0.9196, respectively. The retest value estimate was 4.2% higher than the test´s.

When replacing the original weights of this MCDA in RSV with the weights assigned in the Vaccinex study, the impact on outcomes was close to none, with final estimated values ranging from 0.55 to 0.56 (vs. 0.56 in the MCDA in RSV).

By excluding the outlier, the final estimated value increased 5.4%, resulting in 0.59. See supplementary file 7 for more details.

An alternative evaluation comparing nirsevimab vs. palivizumab was also undertaken in the context of RSV prevention in neonates and infants during their first RSV season, obtaining very similar results (final estimated value of 0.58). The criteria which mark the distinction between these two comparisons were the efficacy of the preventive measure (nirsevimab has an estimated value of 0.04 vs. placebo and 0.02 vs. palivizumab) and its monetary cost (nirsevimab obtained an estimated value of -0.03 vs. placebo, and 0.02 vs. palivizumab) (see supplementary file 8).

Discussion

Complex decision contexts, such as evaluations of new preventive measures for diseases with many important unmet needs, require evaluators and decision makers to balance multiple needs and ways to address them. The main methodological approaches currently used to support evaluations are budget impact and efficiency analysis models [35].

However, the MCDA methodology can be particularly useful as a complement to this approach, as it consists of a structured (stepwise validated methodology), multidimensional (participation of experts from different professional fields), transparent (criteria, weights and scores are explicit) and systematic (replicable) approach, which incorporates several criteria and their individual value contribution to the decision or resource allocation problem [36]. Its popularity has been evident in the healthcare field in recent years, both nationally and internationally [36,37,38,39], in various areas, such as oncology [40,41,42], rare diseases [43,44,45], dermatology [46,47,48], and in the field of decisions related to the implementation of vaccines [19, 20, 22, 49,50,51,52].

This MCDA has adopted a holistic and transparent methodological approach in the evaluation of the value contribution of nirsevimab compared to placebo for the prevention of RSV in neonates and infants during their first RSV season in Spain, through a multidisciplinary panel of experts involved in the clinical, management and decision-making aspects of the pathology.

Preventive measures have some characteristics that are different from most drugs and health technologies, such as the ability to eradicate disease and more holistic social effects; therefore, it is essential to evaluate them according to other broader criteria [19,20,21,22, 49,50,51,52]. To this end, the Vaccinex framework [19] was adapted into a set of 26 criteria relevant to the context of evaluating new (present or future) antibody-based preventive measures for RSV. Based on the mean weights assigned to each criterion in the current exercise, the importance of applying a broader list of attributes became clear, as criteria related to the disease, unmet needs and social impacts represented a total weight of 58% in the current MCDA framework.

Other MCDA have been carried out in the field of vaccine evaluation and prioritization [19, 20, 22, 49,50,51,52]. However, these studies are carried out in different contexts (other countries, such as Bangladesh and Indonesia; evaluation of vaccines and not preventive measures, etc.) and using methodologies different from that applied in this MCDA in RSV (fewer criteria, and some of them interrelated, such as quality-adjusted life years [QALYs] and cost per QALY; different weighting methods [100-point distribution, rank-order centroid method], scoring [100% objective]), so they are not comparable.

The exercise performed in this MCDA in RSV found that nirsevimab adds value to the prevention of RSV in neonates and infants during their first RSV season in Spain, compared to placebo. The final estimated value in this MCDA was 0.56. This value is higher when compared to several other MCDA focused on the value of innovative drugs [43, 53,54,55,56,57,58]. Conjointly with the positive final estimated value obtained, the importance of this MCDA lies in understanding the value drivers of the preventive measure evaluated. In this sense, the multidisciplinary debate generated was key to understanding the strengths and weaknesses of nirsevimab compared to placebo in each of the elements considered.

Nirsevimab was perceived as an effective measure in the prevention of medically attended RSV infections (> 80%, outpatient and inpatient setting [34]), with a remarkably robust safety profile (safety outcomes associated with nirsevimab are comparable to those observed with placebo [59]). In addition, nirsevimab would be indicated for a much larger number of infants (nirsevimab in neonates and infants during their first RSV season vs. placebo). Moreover, its implementation could generate savings in hospitalization costs in Spain (50% or 30 million euros [17]), and greater public health awareness (generating a debate in society and increased parental awareness in relation to RSV infections). This, in turn, would contribute to diminishing health disparities among newborns and infants in their initial RSV season, consequently lowering the prevalence of RSV infections in poor regions.

These effects would be given for a disease with currently no available treatments or prevention alternatives, of high incidence (90% <2 years are infected [1]), very contagious [30] and with an important risk of hospitalization [60]. Moreover, despite the short duration of the acute symptoms of RSV infections, according to the MCE, there is a considerable percentage of mid-long-term consequences of bronchial hyperreactivity (bronchial wheezing, asthma) caused by this infection. Finally, RSV has a great impact in the quality of life and stress levels of the affected infants and their carers [31, 32].

This study has some limitations, inherent to all MCDA, which should be pointed out. The first comes from the composition of the expert committee itself, as other important stakeholders are not represented (e.g., mother, pregnant women). Similarly, it should be borne in mind that the final assessment of the MCDA comes largely from the experience, training, and value judgments of the committee members, so this type of tool is associated with a certain subjectivity. However, this is intrinsic to most decision-making processes in healthcare, and the development and use of MCDA is not intended to provide an objective ratio or a single answer to a problem requiring a decision but should be used as a complementary tool to the existing set of tools and frameworks.

In this context, it is crucial to underscore that certain criteria, such as “Costs related to the production platform,” were excluded based on expert evaluations. This specific criterion fell below the predefined threshold for inclusion in the framework, as only a minority of experts advocated for its integration. The decision to exclude it is underpinned by its connection to implementation feasibility, particularly in the context of integrating with existing vaccinations. The framework prioritizes criteria that garner broader consensus, ensuring a robust and widely accepted assessment.

Similarly, the criterion “Perception and fear of RSV” elicited diverse opinions within the expert panel and failed to meet the inclusion threshold. Subsequent discussions provided clarity on the interpretation of this criterion, ultimately leading to the decision not to incorporate it into the MCDA framework. The committee justified this exclusion based on the absence of consensus and the varied interpretations among experts.

Furthermore, the analysis entails some cognitive complexity, especially considering that this MCDA was performed with 26 criteria. Moreover, systematic literature reviews were not carried out for the creation of the pre read and evidence summary documents. Nonetheless, a comprehensive narrative review was undertaken, and all material was validated by the clinicians of the MCE, hence reducing the probabilities of any gap or inconsistency in the information set used as a base for the assessment. Finally, the evidence summary document gathered publicly available information at the time of the study: some evidence were not available (i.e., price of nirsevimab) and some were scarce (i.e., impact on other direct and indirect costs). Hence, results could show differences in light of additional information and evidence.

The strengths of this study lie in several aspects. First, it should be noted that, to our knowledge, this is the first MCDA to develop an ad hoc framework that can be applied in the assessment of any antibody-based preventive measures (present and future) for RSV infections, and to evaluate nirsevimab against placebo for those infections. Additionally, the scoring was preceded by a thorough explanation of the MCDA methodology, the assumptions made and the interpretation of the values, and the exercise was followed by the implementation of a retest to assess the consistency of the results. Finally, the evidence summary was based on a thorough review of the available information, which is fundamental for this type of exercise.

Conclusions

Unmet needs in the prevention of RSV infections and severe disease in neonates and infants during their first RSV season in Spain are still substantial. Moreover, the burden of disease (ambulatory, emergency room and hospital incidence) is very high, and there are no effective treatments or preventive alternatives available. Under a methodology of increasing use in the healthcare setting such as MCDA, nirsevimab has been evaluated by a MCE as a measure that brings added value to the current scenario of RSV prevention in Spain, by providing efficacy, with a robust safety profile (safety outcomes associated with nirsevimab are comparable to those observed with placebo) and being indicated for a much wider infant population. This might generate several economic and social benefits, such as cost savings in hospitalizations and to the healthcare system in general, an increase in the level of public health awareness towards RSV infections, and a reduction in health inequities which are inherent to respiratory infections. This type of exercise allows us to understand where the value of preventive measures lies for the different agents, encourages communication between them and can serve as a reference in decision-making on evaluation, financing, and reimbursement. In the future, it would be desirable to continue advancing in the development of the MCDA methodology and to extend its use, so that health care decision-making is carried out in a framework of greater transparency, consistency, and efficiency.

Data Availability

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

AEMPS:

Spanish Agency for Medicines and Health Products

EMA:

European Medicines Agency

ICC:

Intra-rater correlation coefficients

LGBTI:

Lesbian, Gay, Bisexual, Transgender, and Intersex

LRTI:

Lower respiratory tract infections

MCDA:

Multi-criteria decision analysis

MCE:

Multidisciplinary committee of experts

QALY:

Quality-adjusted life year

RSV:

Respiratory syncytial virus

WHO:

World Health Organization

References

  1. Glezen WP, Taber LH, Frank AL et al. Risk of primary infection and reinfection with respiratory syncytial virus. Am J Dis Child. 1960. 1986;140:543–546.

  2. Bianchini S, Silvestri E, Argentiero A, et al. Role of respiratory syncytial virus in pediatric pneumonia. Microorganisms. 2020;8:E2048.

    Article  Google Scholar 

  3. Sanchez-Luna M, Elola FJ, Fernandez-Perez C, et al. Trends in respiratory syncytial virus bronchiolitis hospitalizations in children less than 1 year: 2004–2012. Curr Med Res Opin. 2016;32:693–8.

    Article  PubMed  Google Scholar 

  4. Martinón-Torres F, Carmo M, Platero L, et al. Clinical and economic burden of respiratory syncytial virus in Spanish children: the BARI study. BMC Infect Dis. 2022;22:759.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Jares Baglivo S, Polack FP. The long road to protect infants against severe RSV lower respiratory tract illness. F1000Research. 2019;8:F1000 Faculty Rev-610.

  6. Mazur NI, Higgins D, Nunes MC, et al. The respiratory syncytial virus vaccine landscape: lessons from the graveyard and promising candidates. Lancet Infect Dis. 2018;18:e295–e311.

    Article  PubMed  Google Scholar 

  7. Simões EAF, Bont L, Manzoni P, et al. Past, present and future approaches to the prevention and treatment of respiratory syncytial virus infection in children. Infect Dis Ther. 2018;7:87–120.

    Article  PubMed  PubMed Central  Google Scholar 

  8. GSK provides update on phase III RSV maternal. vaccine candidate programme. [cited 2022 Apr 18]. Available from: https://www.gsk.com/en-gb/media/press-releases/gsk-provides-update-on-phase-iii-rsv-maternal-vaccine-candidate-programme/

  9. WHO. WHO preferred product characteristics of monoclonal antibodies for passive immunization against respiratory syncytial virus (RSV) disease. 2021 [cited 2021 Aug 24]. Available from: https://www.who.int/publications-detail-redirect/9789240021853

  10. Multi-Criteria Decision Analasys in Healthcare.: its usefulness and limitations for decision making. Weber. [cited 2022 Oct 18]. Available from: https://weber.org.es/publicacion/multi-criteria-decision-analasys-in-healthcare-its-usefulness-and-limitations-for-decision-making/

  11. Gilabert-Perramon A, Torrent-Farnell J, Catalan A, et al. Drug evaluation and decision making in catalonia: development and validation of a methodological framework based on multi-criteria decision analysis (MCDA) for orphan drugs. Int J Technol Assess Health Care. 2017;33:111–20.

    Article  PubMed  Google Scholar 

  12. ORPHAR-SEFH. Manual para el desarrollo de un informe de evaluación de medicamentos huérfanos por parte del grupo ORPHAR-SEFH usando metodología de Análisis de decisión multicriterio. 2020.

  13. AETSA. Guía para la elaboración de recomendaciones basadas en Análisis de decisión multicriterio (MCDA). Serv. Eval. Tecnol. Sanit. Andal. AETSA. 2020. Available from: https://www.aetsa.org/publicacion/guia-para-la-elaboracion-de-recomendaciones-basadas-en-analisis-de-decision-multicriterio-mcda/

  14. EMA. Beyfortus marketing authorisation. Eur. Med. Agency. 2022. Available from: https://www.ema.europa.eu/en/medicines/human/EPAR/beyfortus

  15. Mazur NI, Terstappen J, Baral R, et al. Respiratory syncytial virus prevention within reach: the vaccine and monoclonal antibody landscape. Lancet Infect Dis. 2023;23:e2–e21.

    Article  CAS  PubMed  Google Scholar 

  16. Agència d’informació, Avaluació i Qualitat en Salut. Recomanacions d’ús de palivizumab per a la prevenció de les hospitalitzacions per infecció greu per virus sincític respiratori. 2012;32.

  17. Drago G, Roiz J, Kazmierska P et al. Modeled impact of nirsevimab against respiratory syncytial virus (RSV) AMONG Spanish infants experiencing their first RSV season [oral presentation O024 / #1329]. ESPID Athens 9-13th May. 2022; Available from: https://keneswp.azureedge.net/wp-content/uploads/sites/162/2022/05/ESPID22-Abstracts-Book.pdf

  18. Agencia Española de Medicamentos y Productos Sanitarios (AEMPS). Ficha técnica de palivizumab (Synagis®). 2022. Available from: https://cima.aemps.es/cima/dochtml/ft/199117004/FT_199117004.html

  19. Luyten J, Kessels R, Vandermeulen C, et al. Value frameworks for vaccines: which dimensions are most relevant? Vaccines. 2020;8:E628.

    Article  Google Scholar 

  20. Bell E, Neri M, Steuten L. Towards a broader assessment of value in vaccines: the brave way forward. Appl Health Econ Health Policy. 2022;20:105–17.

    Article  PubMed  Google Scholar 

  21. Knobler S, Bok K, Gellin B. Informing vaccine decision-making: a strategic multi-attribute ranking tool for vaccines-SMART vaccines 2.0. Vaccine. 2017;35(Suppl 1):A43–5.

    Article  PubMed  Google Scholar 

  22. The National Academies of Engineering Medicine. Ranking vaccines: a prioritization software tool: Phase II: prototype of a decision-support system. 2013 [cited 2022 Mar 24]. Available from: https://www.nap.edu/read/13531/chapter/2

  23. Thokala P, Devlin N, Marsh K, et al. Multiple criteria decision analysis for health care decision making—an introduction: report 1 of the ISPOR MCDA emerging good practices task force. Value Health. 2016;19:1–13.

    Article  PubMed  Google Scholar 

  24. EMA. Synagis. Eur. Med. Agency. 2018 [cited 2021 Jul 26]. Available from: https://www.ema.europa.eu/en/medicines/human/EPAR/synagis

  25. AEP y NEUMOPED. Protocolos diagnósticos y terapéuticos en Neumología pediátrica. 2017. Available from: https://neumoped.org/wp-content/uploads/2019/02/Protocolos-Diagn%C3%B3sticos-y-terap%C3%A9uticos-en-Neumolog%C3%ADa-Pedi%C3%A1trica.pdf

  26. Barr R, Green CA, Sande CJ et al. Respiratory syncytial virus: diagnosis, prevention and management. Ther Adv Infect Dis. 2019;9.

  27. Sánchez Luna M, Pérez Muñuzuri A, Leante Castellanos JL, et al. Recomendaciones de la sociedad Española de neonatología para la utilización de palivizumab como profilaxis de las infecciones graves por el virus respiratorio sincitial en lactantes de alto riesgo, actualización. An Pediatría. 2019;91:348–50.

    Article  Google Scholar 

  28. Simoes EA. Respiratory syncytial virus infection. The Lancet. 1999;354:847–52.

    Article  CAS  Google Scholar 

  29. Martinón-Torres F, Carmo M, Platero L, et al. Clinical and economic hospital burden of acute respiratory infection (BARI) due to respiratory syncytial virus in Spanish children, 2015–2018. BMC Infect Dis. 2023;23:385.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Reis J, Shaman J. Simulation of four respiratory viruses and inference of epidemiological parameters. Infect Dis Model. 2018;3:23–34.

    PubMed  PubMed Central  Google Scholar 

  31. Orrico-Sánchez A, Gómez-Álvarez C, López-Lacort M, et al. Pérdida de calidad de vida por virus respiratorio sincitial (VRS) en lactantes en España. Vacunas. 2019;20:24.

    Article  Google Scholar 

  32. Pokrzywinski RM, Swett LL, Pannaraj PS, et al. Impact of respiratory syncytial virus–confirmed hospitalizations on caregivers of US preterm infants. Clin Pediatr (Phila). 2019;58:837–50.

    Article  PubMed  Google Scholar 

  33. Heppe Montero M, Gil-Prieto R, Walter S et al. Burden of severe bronchiolitis in children up to 2 years of age in Spain from 2012 to 2017. Hum Vaccines Immunother. 2021;1–7.

  34. Simões EAF, Madhi SA, Muller WJ, et al. Efficacy of nirsevimab against respiratory syncytial virus lower respiratory tract infections in preterm and term infants, and pharmacokinetic extrapolation to infants with congenital heart disease and chronic lung disease: a pooled analysis of randomised controlled trials. Lancet Child Adolesc Health. 2023;7:180–9.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Angelis A, Lange A, Kanavos P. Using health technology assessment to assess the value of new medicines: results of a systematic review and expert consultation across eight European countries. Eur J Health Econ. 2017; Available from: http://link.springer.com/https://doi.org/10.1007/s10198-017-0871-0

  36. Drake JI, de Hart JCT, Monleón C et al. Utilization of multiple-criteria decision analysis (MCDA) to support healthcare decision-making. J Mark Access Health Policy. 2017 [cited 2017 Nov 21];5. Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5645903/

  37. Bayón Yusta J, Gutiérrez Iglesias A, Galnares-Cordero L et al. Proyecto metodológico. Síntesis de información relevante de apoyo a los MCDA (análisis de decisión multicriterio) para la toma de decisiones. Ministerio de Sanidad, Servicios Sociales e Igualdad. Servicio de Tecnologías Sanitarias del País Vasco; 2019 [cited 2019 Apr 26]. Available from: http://www.ogasun.ejgv.euskadi.eus/r51-catpub/es/k75aWebPublicacionesWar/k75aObtenerPublicacionDigitalServlet?R01HNoPortal=true&N_LIBR=052312&N_EDIC=0001&C_IDIOM=es&FORMATO=.pdf.

  38. Marsh K, Lanitis T, Neasham D, et al. Assessing the value of healthcare interventions using multi-criteria decision analysis: a review of the literature. PharmacoEconomics. 2014;32:345–65.

    Article  PubMed  Google Scholar 

  39. Gilabert-Perramon A, Lens C, Betolaza JI, et al. Multi-criteria decision analysis (MCDA): common tools for different needs supporting healthcare decision making in Spain. Value Health. 2016;19:A489–90.

    Article  Google Scholar 

  40. Hsu JC, Lin J-Y, Lin P-C, et al. Comprehensive value assessment of drugs using a multi-criteria decision analysis: an example of targeted therapies for metastatic colorectal cancer treatment. PLoS ONE. 2019;14:e0225938.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  41. Wagner M, Samaha D, Khoury H, et al. Development of a framework based on reflective MCDA to support patient-clinician shared decision-making: the case of the management of gastroenteropancreatic neuroendocrine tumors (GEP-NET) in the United States. Adv Ther. 2018;35:81–99.

    Article  PubMed  Google Scholar 

  42. Camps C, Badia X, García-Campelo R, et al. Development of a Multicriteria Decision Analysis Framework for evaluating and positioning oncologic treatments in clinical practice. JCO Oncol Pract. 2020;16:e298–e305.

    Article  PubMed  Google Scholar 

  43. Zozaya N, Basterrechea MIA, Bollo E, et al. A multi-criteria decision analysis on the value of nintedanib for interstitial lung diseases. Int J Technol Assess Health Care. 2022;38:e64.

    Article  PubMed  Google Scholar 

  44. Kolasa K, Zwolinski KM, Zah V, et al. Revealed preferences towards the appraisal of orphan drugs in Poland - multi criteria decision analysis. Orphanet J Rare Dis. 2018;13:67.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Schey C, Krabbe PFM, Postma MJ et al. Multi-criteria decision analysis (MCDA): testing a proposed MCDA framework for orphan drugs. Orphanet J Rare Dis. 2017 [cited 2017 Feb 20];12. Available from: http://ojrd.biomedcentral.com/articles/https://doi.org/10.1186/s13023-016-0555-3

  46. Zozaya N, Abdalla F, Alfonso Zamora S, et al. Assessing the value contribution of bimekizumab for the treatment of moderate-to-severe psoriasis using a multidisciplinary reflective multi-criteria decision analysis. Expert Rev Pharmacoecon Outcomes Res. 2022;0:1–13.

    Google Scholar 

  47. Badia X, Cueva P, de la, Moreda FR, et al. Application of multi-criteria decision analysis (MCDA) to determine the value of treatments for the moderate to severe plaque psoriasis in Spain. Value Health. 2017;20:A564.

    Article  Google Scholar 

  48. Zozaya N, Martínez-Galdeano L, Alcalá B, et al. Determining the value of two biologic drugs for chronic inflammatory skin diseases: results of a multi-criteria decision analysis. BioDrugs Clin Immunother Biopharm Gene Ther. 2018;32:281–91.

    CAS  Google Scholar 

  49. McCormick BJJ, Waiswa P, Nalwadda C, et al. SMART vaccines 2.0 decision-support platform: a tool to facilitate and promote priority setting for sustainable vaccination in resource-limited settings. BMJ Glob Health. 2020;5:e003587.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Suwantika AA, Purwadi FV, Zakiyah N, et al. Multi-criteria decision analysis to prioritize the introduction of new vaccines in Indonesia by using the framework of the strategic multi-attribute ranking tool for vaccines (SMART vaccines). Expert Rev Vaccines. 2021;20:83–91.

    Article  CAS  PubMed  Google Scholar 

  51. Marcelon L, Verstraeten T, Dominiak-Felden G, et al. Quantitative benefit-risk assessment by MCDA of the quadrivalent HPV vaccine for preventing anal cancer in males. Expert Rev Vaccines. 2015;15:139–48.

    Article  PubMed  Google Scholar 

  52. Haider MS, Youngkong S, Thavorncharoensap M, et al. Priority setting of vaccine introduction in Bangladesh: a multicriteria decision analysis study. BMJ Open. 2022;12:e054219.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Goetghebeur MM, Wagner M, Khoury H, et al. Combining multicriteria decision analysis, ethics and health technology assessment: applying the EVIDEM decision-making framework to growth hormone for Turner syndrome patients. Cost Eff Resour Alloc CE. 2010;8:4.

    Article  Google Scholar 

  54. Tony M, Wagner M, Khoury H, et al. Bridging health technology assessment (HTA) with multicriteria decision analyses (MCDA): field testing of the EVIDEM framework for coverage decisions by a public payer in Canada. BMC Health Serv Res. 2011;11:329.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Wagner M, Khoury H, Bennetts L et al. Appraising the holistic value of lenvatinib for radio-iodine refractory differentiated thyroid cancer: A multi-country study applying pragmatic MCDA. BMC Cancer. 2017;17. Available from: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5393009/

  56. Garau M, Hampson G, Devlin N, et al. Applying a multicriteria decision analysis (MCDA) approach to elicit stakeholders’ preferences in Italy: the case of obinutuzumab for rituximab-refractory indolent non-hodgkin lymphoma (iNHL). PharmacoEconomics - Open. 2018;2:153–63.

    Article  PubMed  Google Scholar 

  57. Jiménez A, Ais A, Beaudet A, et al. Determining the value contribution of selexipag for the treatment of pulmonary arterial hypertension (PAH) in Spain using reflective multi-criteria decision analysis (MCDA). Orphanet J Rare Dis. 2018;13:220.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Guarga L, Badia X, Obach M, et al. Implementing reflective multicriteria decision analysis (MCDA) to assess orphan drugs value in the Catalan health service (CatSalut). Orphanet J Rare Dis. 2019;14:157.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Hammitt LL, Dagan R, Yuan Y, et al. Nirsevimab for prevention of RSV in healthy late-preterm and term infants. N Engl J Med. 2022;386:837–46.

    Article  CAS  PubMed  Google Scholar 

  60. Garcés Sánchez M, Martinón Torres F, Platero L et al. Carga clínica y económica del virus respiratorio sincitial en el entorno ambulatorio. Rev Pediatr Aten Primaria Supl. 2022; Available from: https://pap.es/articulo/13581/carga-clinica-y-economica-del-virus-respiratorio-sincitial-en-el-entorno-ambulatorio

Download references

Acknowledgements

Not applicable.

Funding

This project was funded by Sanofi and AstraZeneca.

Author information

Authors and Affiliations

Authors

Contributions

NZ and AH participated in the conception and design of the work. FA, NZ, AR, AOS, IM, JA, JMF, MG, MCP, MGS and ROL have contributed to the acquisition of data. FA and NZ have analyzed and interpreted the data. FA has drafted the manuscript. NZ, AOS and ROL have substantively reviewed it. All authors have approved the manuscript and have agreed both to be personally accountable for the author´s contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the author was not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature.

Corresponding author

Correspondence to Fernando Abdalla.

Ethics declarations

Ethics approvals and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

NZ, AH, and FA are employed by Vivactis Weber, a research institution that has received funding for managing, coordinating, and executing this research project. JMF, AR, AOS, IM, JA, MGC, MGS, and ROL have received advisory fees from Vivactis Weber for their involvement as experts in this research project. MCP has not received any form of support for her participation as expert in this research project. Within the last 3 years, the authors declare the following support outside the current work. JMF has received consultation or advisory fees, speaking and lecture fees and travel reimbursement from Sanofi and other companies not related to this project. AOS has received consultation or advisory fees, non-financial support, speaking and lecture fees and travel reimbursement from Sanofi and other companies not related to this project. IM and AR declare they have not received any fee or support in the last 3 years. JA has collaborated in counseling or teaching activities subsidized by Sanofi and other companies not related to this project. MGC has received consultation or advisory fees, and travel reimbursement from Sanofi and other companies not related to this project. MCP has received travel reimbursement from Sanofi and other companies not related to this project. MGS has received consultation or advisory fees, speaking and lecture fees and travel reimbursement from Sanofi and other companies not related to this project. ROL has received fees for conferences or academic advice from Sanofi and other companies not related to this project. AH, NZ and FA are employed by Vivactis Weber, and have received funding from Sanofi and other companies nor related to this project, for managing and executing research projects in the past 3 years. All authors have disclosed their conflicts of interest as aforementioned, and this does not influence the objectivity or integrity of the research presented in this manuscript.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1:

Pre read

Supplementary Material 2:

Evidence summary

Supplementary Material 3:

Criteria selection

Supplementary Material 4:

Framework

Supplementary Material 5:

Weights, scores and value estimates

Supplementary Material 6:

Detailed scores per criterion

Supplementary Material 7:

Retest and sensitivity analysis

Supplementary Material 8:

Nirsevimab vs. Palivizumab

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mestre-Ferrándiz, J., Rivero, A., Orrico-Sánchez, A. et al. Evaluation of antibody-based preventive alternatives for respiratory syncytial virus: a novel multi-criteria decision analysis framework and assessment of nirsevimab in Spain. BMC Infect Dis 24, 99 (2024). https://doi.org/10.1186/s12879-024-08988-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12879-024-08988-9

Keywords