- Research article
- Open Access
- Open Peer Review
The cost-effectiveness of the WINGS intervention: a program to prevent HIV and sexually transmitted diseases among high-risk urban women
BMC Infectious Diseasesvolume 2, Article number: 24 (2002)
We evaluated the cost-effectiveness of the WINGS project, an intervention to prevent HIV and other sexually transmitted diseases among urban women at high risk for sexual acquisition of HIV.
We used standard methods of cost-effectiveness analysis. We conducted a retrospective analysis of the intervention's cost and we used a simplified model of HIV transmission to estimate the number of HIV infections averted by the intervention. We calculated cost-effectiveness ratios for the complete intervention and for the condom use skills component of the intervention.
Under base case assumptions, the intervention prevented an estimated 0.2195 new cases of HIV at a cost of $215,690 per case of HIV averted. When indirect costs of HIV were excluded from the analysis, the intervention's cost-effectiveness ratios were $357,690 per case of HIV averted and $31,851 per quality-adjusted life year (QALY) saved. Under base case assumptions, the condom use skills component of the intervention prevented an estimated 0.1756 HIV infections and was cost-saving. When indirect HIV costs were excluded, the cost-effectiveness ratios for the condom use skills component of the intervention were $97,404 per case of HIV averted and $8,674 per QALY saved.
The WINGS intervention, particularly the two sessions of the intervention which focussed on condom use skills, could be cost-effective in preventing HIV among women.
HIV infection among women in the United States has increased significantly over the last fifteen years, and recent estimates suggest that as many as 160,000 adult and adolescent women are living with HIV infection and/or AIDS . Women accounted for almost one fourth of the new AIDS cases reported in 1999, and most of these women were infected with HIV through heterosexual contact.
HIV prevention interventions can reduce risky sexual behaviour of women , and numerous studies have documented the effectiveness of various cognitive-behavioural group intervention models [3–10]. For example, persons who participated in a 30-minute condom use skills educational session in a Los Angeles waiting room were less likely to return to the sexually transmitted disease (STD) clinic with a new STD than those who did not participate in the educational session .
Many interventions have been successful in increasing condom usage by supplementing condom use education and/or general HIV/AIDS education with training in other areas, such as negotiation skills (how to suggest condom use with a new partner), assertiveness skills (how to resist unwanted sexual advances) and cognitive coping skills (such as sexual self-control) and by improving self-esteem [4–6, 9, 12]. Policy- and decision-makers who plan HIV prevention programs need information about the cost-effectiveness of these programs in order to maximize the benefits of limited HIV prevention resources [7, 13].
Here, we evaluated the cost-effectiveness of the Women in Group Support (WINGS) project, a six-session group-based intervention that offered training in condom use skills (using condoms correctly) and in communication skills (such as talking to sex partners about condom usage) for urban heterosexual women at high risk of acquiring HIV and other STDs.
Intervention content, delivery, and efficacy
The methods of the WINGS intervention trial have been described previously [10, 14, 15]. A total of 604 HIV-uninfected women at high risk for STD/HIV were recruited from Baltimore, New York, and Seattle from May 1995 through July 1997. After completing baseline interviews, the women were randomly assigned to the intervention or to the control group. The intervention group sessions included components on reducing HIV and STD risk identified by Fisher and Fisher , specifically training in the proper use of male and female condoms and building skills in communication to sex partners to encourage condom use (Table 1). Participants in the control group attended a 1-hour session on nutrition.
Condom usage by the women in the WINGS intervention increased substantially, and at least part of this increase was attributable to intervention's effect on condom use skills and communication skills [10, 15]. A model-based evaluation of the efficacy of the WINGS intervention  demonstrated that most of the intervention's effect on increasing condom usage was attributable to the condom use skills component of the intervention.
This analysis focussed on the cost-effectiveness of the intervention. We evaluated the cost-effectiveness of the complete six-session intervention and the two sessions of the intervention that addressed condom use skills. For brevity, we refer to the complete, six-session WINGS intervention as the "complete intervention" and we refer to the two sessions that addressed condom skills training as the "condom use skills component" of the intervention. The condom use skills component was part of (not an alternative to) the complete intervention. To evaluate the cost-effectiveness of the condom use skills component of the intervention, we estimated the increase in condom usage attributable to the condom use skills component.
We examined cost-effectiveness from the societal perspective, in which relevant costs and benefits were included in the analysis without regard to who might actually pay the costs or receive the benefits . We calculated intervention costs for the period during which the intervention was delivered. Benefits of the intervention (averted HIV infections) were assumed to accrue in the 6 months following the intervention. The societal cost per HIV infection included the future medical care costs and indirect costs such as lost productivity, discounted at 3% annually.
The cost-effectiveness analysis comprised four main steps: (1) retrospective analysis of the intervention's cost, (2) estimation of the number of HIV infections averted by the intervention, (3) calculation of the cost-effectiveness ratios, and (4) sensitivity analyses to examine how the cost-effectiveness ratios would change over a range of assumptions about cost and effectiveness. We present the methods to evaluate the cost-effectiveness of the complete intervention. Except where noted, the methods to evaluate the "condom use skills component" were identical.
Estimating the intervention's cost
Cost estimates (in 1996 dollars) were based primarily on cost information provided by the WINGS principal investigators, who estimated the various resources required to deliver the intervention. We obtained additional information from budget proposals of the WINGS project and from cost estimates of an earlier intervention of similar duration and intensity . Because women attended sessions in small groups, costs were calculated per group of six women. Our assessment of intervention costs included the cost of rent for participant meeting spaces (including overhead and miscellaneous costs), facilitator wages and training, senior staff time for quality assurance, recruitment, client costs (incentive payments, child care and transportation compensation, and meals), and materials (such as condoms, anatomic models, and information pamphlets).
The child care compensation, travel compensation, and incentive payments were assumed to cover all costs (direct and indirect) borne by the participants, such as travel expenses and foregone time for work or leisure. In calculating recruitment costs, we assumed that 75% of the total recruitment costs could be attributed to the randomized control nature of the study and not to the intervention itself.
In assessing the cost of the condom use skills component of the intervention, we divided each cost item included in the complete intervention (except recruitment and materials) by three, as the condom use skills component had one-third the number of sessions as the complete intervention. Recruitment and materials costs in the condom use skills component were assumed to be the same as the complete intervention, since recruitment would still be necessary regardless of the duration of the intervention and since most of the materials cost in the complete intervention were attributable to the two sessions of the intervention focussing on condom use skills.
HIV cases averted
The number of HIV infections averted (A) by the intervention was estimated according to Equation 1:
where the intervention is assumed to increase the percentage of sexual encounters protected by condoms from ρb to ρi, ε is condom effectiveness per act of intercourse, R is the probability of acquiring HIV in the absence of the intervention, and N is the number of women in the intervention.
This approximation is derived from a model-based evaluation of the benefits of increases in occasional condom usage, which suggested that under conditions that prevail in many at-risk heterosexual populations the relationship between increased condom usage and HIV risk reduction is essentially linear . For example, if condoms were 95% effective in preventing HIV transmission, then an increase in condom usage from 0% to 100% would reduce the risk of acquiring HIV by about 95%. Smaller increases in condom usage would yield smaller reductions in risk.
Parameter values for equation 1 are summarized in Table 2. Values for ρb and ρi were obtained from the structural equation model estimates in a previous study of the efficacy of the WINGS intervention . Based on these model estimates (see appendix), we applied the following base case values for condom usage following the intervention: 53.2% for the control group, 57.7% for the complete intervention, and 56.8% for the condom use skills component.
Based on data from several sources, we assumed 0.019 as the base case annual probability of acquiring HIV in the absence of the intervention. Recent studies of high-risk urban women from several cities in the United States suggest HIV incidence rates in the range of 0.018 to more than 7 new infections per 100 person-years [19–24], with the highest rates observed among women who reported exchanging sex for money or drugs and women with a recent history of acquiring other STDs such as syphilis. Of the women initially recruited for the WINGS trial, about one-fourth reported trading sex for money or drugs and almost one-third reported having an STD in the previous year .
Condom effectiveness (ε), the reduction in the per-act probability of HIV transmission when a condom is used, was set to 95% . We assumed the increase in condom usage attributable to the intervention would last 6 months (range: 3 to 9) as the increases in condom usage attributable to the intervention were found to diminish by the six-month follow-up interviews .
The value of R was calculated from the annual probability of HIV infection (P) and the assumed duration of the intervention in months (D) as follows: R = 1 - (1 - P)D/12. Thus R represents the base case probability of acquiring HIV (in the absence of the intervention) during the D months following the intervention.
Using standard methods of cost-effectiveness analysis, we calculated the average cost per HIV case averted as the net cost of the intervention divided by the estimated number of HIV infections averted, where net cost refers to the intervention's cost minus the societal costs of HIV averted by the intervention . Averted HIV costs were calculated by multiplying the estimated number of averted HIV cases by the cost per case of HIV.
Our baseline estimate of the societal cost of HIV was $337,000 per case, which includes the lifetime medical care costs ($195,000, with future costs discounted at 3% annually) and indirect costs ($142,000) such as lost economic productivity [27, 28]. This estimate of the indirect costs per case of HIV was based on a recent report that indirect costs of HIV in England comprised between 45% to 102% of the direct treatment costs of HIV . We used the midpoint of this range and assumed that indirect costs would be 73% of the direct medical costs ($195,000 × 73% = $142,000). This estimate of the indirect costs is quite conservative compared to other studies which suggest the indirect costs of HIV exceed the direct medical care costs [29, 30].
We did not calculate the cost per quality-adjusted life year (QALY) gained when indirect costs of HIV were included in the cost per case of HIV, because these indirect costs might be "double counted" if included in the numerator (as averted HIV costs) and the denominator (as part of the QALY measure) [31, 32]. For completeness, we repeated the analysis excluding the indirect costs of HIV from the numerator, focussing solely on the direct medical care costs ($195,000). The cost per QALY saved was calculated as the net cost of the intervention (the intervention's cost minus the direct medical care costs of HIV averted) divided by the number of QALYs saved. The number of QALYs saved was calculated by multiplying the estimated number of averted HIV cases by published estimates of the number of QALYs saved per HIV case averted .
To assess the cost-effectiveness of the complete intervention and the condom use skills component, we compared these interventions to the alternative of no intervention, which we assumed would have $0 in program cost and would not avert any new cases of HIV. For the complete intervention, we also calculated the incremental cost-effectiveness ratios, which compare the complete intervention to the condom use skills component. The incremental cost per case averted was calculated as difference in net cost (the net cost of the complete intervention minus that of the condom use skills component) divided by the difference in HIV cases averted (HIV cases averted by the complete intervention minus the HIV cases averted by the condom use skills component) . The incremental cost per QALY saved was calculated in an analogous manner.
We conducted univariate and multivariate sensitivity analyses. In the univariate analysis, we examined how the estimated cost per case averted changed when we varied one parameter at a time, holding other parameters at their base case values. The parameters we varied were the cost of the intervention, the effectiveness of the intervention (as measured by condom usage after the intervention), condom efficacy, the annual probability of acquiring HIV, the duration of the effectiveness of the intervention, and the cost per case of HIV.
In the multivariate analysis we varied all of the parameters listed above simultaneously. Specifically, we chose values for each parameter under the assumption that these values were uniformly distributed between their respective lower and upper bounds. We then estimated the cost per case averted using these random values. We repeated this procedure 20,000 times (a "Monte Carlo" simulation ) to obtain a distribution of the estimated cost-effectiveness ratios.
Ranges (upper and lower bounds) of all of the parameters (except condom use, condom effectiveness, and the number of QALYs saved per HIV case averted) were chosen as ± 50% of the parameter's base case value to allow for a wide variance in the values we applied in our sensitivity analyses. The selection of ranges for condom usage among intervention participants is described in the appendix. An analysis of HIV seroconversion studies indicated that condom usage decrease the per-act risk of HIV infection by 90% to 95% . We applied a slightly wider range (85% to 98%) of possible values for condom effectiveness. The range for the number of QALYs saved per HIV case averted was obtained from a previously published study .
The intervention costs are summarized in Table 3. The complete intervention cost an estimated $456 per participant, while the condom use skills component cost an estimated $193 per participant.
The complete intervention averted an estimated 0.2195 new infections (Table 4) at a cost of $215,690 per case averted, while the condom use skills component averted an estimated 0.1756 and was cost-saving. Compared to the condom use skills component, the incremental cost-effectiveness ratio of the complete intervention was more than $1 million per case averted.
When we excluded the indirect costs of HIV, the cost per case averted was $357,690 for the complete intervention and $97,404 for the condom use skills component. The cost per QALY saved was $31,851 for the complete intervention and $8,674 for the condom use skills component.
In the univariate sensitivity analysis (Table 5), the cost per case averted for the complete intervention ranged from cost-saving (a negative cost per case averted) to more than $750,000. The cost per case averted for the condom use skills component ranged from cost-saving to almost $250,000. The results were most sensitive to changes in the annual probability of acquiring HIV, the effectiveness of the intervention (as measured by condom use among intervention participants), the duration of the intervention's effect on condom usage, and the cost of the intervention. When indirect costs of HIV were excluded, the cost per case averted ranged from $81,345 to more than $900,000 for the complete intervention and from cost-saving to almost $400,000 for the condom use skills component.
In the multivariate sensitivity analysis (Table 6), the cost per case averted for the complete intervention ranged from cost-saving to more than $1.5 million, with a median value of $302,254. The cost per case averted for the condom use skills component ranged from cost-saving to more than $600,000 per case of HIV averted, with a median value of $13,504. When considering only the direct medical care costs of HIV, the median cost per case averted was $444,409 (range: $27,506 to $1.6 million) for the complete intervention and $150,201 (range: cost-saving to $783,820) for the condom use skills component.
This analysis supports the findings of previous studies that demonstrate that multi-session behavioural interventions in group settings can be cost-effective tools in the prevention of HIV . Our analysis indicated that the complete intervention prevented an estimated 0.2195 new cases of HIV at a cost of $215,690 per case of HIV averted. The condom use skills component prevented an estimated 0.1756 HIV infections and was cost-saving.
The cost-effectiveness ratios appear less favourable when the indirect costs of HIV are not included in the analysis. When excluding indirect costs of HIV, the cost per case of HIV averted was $357,690 for the complete intervention and $97,404 for the condom use skills component. The cost per QALY saved was $31,851 for the complete intervention and $8,674 for the condom use skills component.
To put these estimates into perspective, a recent review of HIV prevention interventions in the USA suggested that an HIV prevention intervention can be considered cost-effective if the cost per QALY saved is less than $50,000 . The base case estimates of the cost per QALY averted for the complete intervention and the condom use skills component fell below this $50,000 threshold.
Although the WINGS intervention (particularly the condom use skills component) appeared to be cost-effective in the base case analysis, the estimated cost-effectiveness of the WINGS intervention is less favourable than that of two other small group HIV prevention programs for at risk women [13, 35]. Furthermore, the incremental cost per QALY saved ($124,562) exceeded the $50,000 threshold, suggesting that the additional benefits of the complete intervention (as compared to the condom use skills component) might not be worth the additional costs of the complete intervention.
Improving the cost-effectiveness of HIV prevention interventions
The finding that the condom use skills component was more cost-effective than the complete intervention is consistent with previous studies demonstrating the effectiveness of brief STD/HIV counselling sessions for persons at high risk for HIV and STDs [8, 36]. These findings suggest the possibility that for a given budget, more HIV infections could be prevented by providing brief interventions to a larger number of people at risk for HIV rather than providing more intensive and lengthy interventions to a smaller number of people at risk for HIV.
Our analysis also illustrated the importance of targeting the intervention to those at the highest risk for HIV. The cost-effectiveness ratios improved substantially when we assumed an annual probability of acquiring HIV of 3% per year (Table 5), a probability consistent with HIV incidence rates in some populations of high-risk urban women [19–22].
Reductions in the cost of the intervention would improve the program's cost-effectiveness (Table 5). The WINGS intervention might be delivered in a more cost-effective manner in other settings. For example, if incorporated into existing programs such as drug treatment or into corrections settings, additional recruitment expenses, incentive payments, transportation, meals, and child care would not be required.
Our analysis is subject to at least four main limitations, the most important of which is the uncertainty in quantifying the effectiveness of the WINGS intervention. Intervention participants showed a significant increase in use of the female condom as compared to the control group . Condom usage, as measured by the odds of condom use (male and female condoms), increased substantially for women in the intervention and for women in the control group . Although this increase in condom usage for women in the intervention was not statistically different from the (lesser) increase shown by women in the control group, the WINGS intervention did increase condom use skills and communication skills, and these improved skills were linked to increases in the probability of condom usage  (see appendix).
A second limitation is that the condom use skills component was not actually offered as separate, brief intervention, but was part of the six-session intervention required of all of the WINGS participants. As a result, we based our analysis of the effectiveness of the condom use skills component and the complete intervention on estimates of the efficacy of individual components of the intervention suggested by a structural equation model of the complete intervention's efficacy (see appendix). If we incorrectly attributed some of the effect of the complete intervention to the condom use skills component, our estimates will understate the incremental cost-effectiveness of the complete intervention and overstate the average cost-effectiveness of the condom use skills component. Further, because the effects of the condom use skills component may be different when provided alone than when provided in the context of a longer, multifaceted intervention, the estimated cost-effectiveness of the condom use skills component may be biased.
A third limitation is the uncertainty in estimating the number of HIV infections averted by the increase in condom use. Our simple approximation was based on an application  of a Bernoulli model of HIV transmission which found that the relationship between increased condom usage and HIV risk reduction is essentially linear for most heterosexuals at risk for HIV.
In our simplified model we applied the estimated annual probability of acquiring HIV among high-risk urban women. This average annual probability reflects an average of the various epidemiological and behavioural factors which affect the annual probability of acquiring HIV, such as per-act HIV transmission probabilities, number of sex partners, and HIV prevalence rates in the sex partners. The annual probability of acquiring HIV was the only key input required for our model to provide an estimate of the number of HIV cases averted through an increase in condom usage. Precise values for annual probability of acquiring HIV were difficult to obtain. Our base case probability of acquiring HIV for the WINGSparticipants (0.019) was higher than suggested by the incidence rates reported in some studies of women at high risk for acquiring HIV (0.018 to 1.2 new infections per 100 person-years [23, 24]), but substantially lower than others (3 or more new infections per 100 person-years [19–22]).
A fourth limitation is that we collected cost information retrospectively from the WINGS intervention principal investigators. The cost estimates they provided, however, were reasonably consistent with the detailed budget proposals they submitted prior to the delivery of the intervention. Furthermore, the estimated cost of the WINGS intervention ($456 per participant) is consistent with that of other small-group HIV prevention interventions for women ($450 per participant in a seven-session intervention  and $300 per participant in a five-session intervention ).
Potential underestimation of cost-effectiveness
Unlike the WINGS intervention, many HIV interventions have been found to be cost-saving [7, 34], which occurs when the costs of HIV averted by the intervention outweighs the cost of implementing the intervention. We note that the condom skills component of the intervention, however, did appear to be cost-saving when indirect costs of HIV were included in the analysis. Under many scenarios explored in the sensitivity analyses the WINGS intervention and the condom use skills component were cost-saving.
Furthermore, additional limitations of our analysis may have caused a substantial underestimation of the cost-effectiveness of the WINGS intervention. First, our analysis focussed on the prevention of the acquisition of HIV among women in the intervention and ignored the possibility of preventing HIV infection among the women's sex partners. Second, in focussing only on HIV prevention we ignored other potential benefits of the intervention such as reductions in STDs and unintended pregnancies.
Third, although the intervention participants reported a substantial increase in condom usage, we only attributed a small part of this increase to the effects of the intervention. The increase in condom usage we did attribute to the intervention was the increase above and beyond the increase in condom usage reported by the control group, and it is possible that part of the increase in condom usage by the control group was attributable to participation in the WINGS trial. For example, measures of condom use skills were obtained for women in the control group on several occasions, requiring the women to perform such tasks as opening the condom package, unrolling the condom, and placing the condom on an anatomical model. If participation in these tasks contributed to the increase in condom usage by the women in the control group, then the actual effectiveness of the WINGS intervention would be understated in our analysis.
In sum, both the complete intervention and the two-session condom use skills component appeared to be at least moderately cost-effective in preventing HIV among at-risk urban women, using published cost-effectiveness standards for HIV prevention interventions. Our analysis indicated that group interventions consisting of two sessions may be more cost-effective than six sessions and suggested that, for a given HIV prevention budget, offering brief interventions for a large number of at-risk women may be more cost-effective in some cases than longer, more intensive and multifaceted interventions for a smaller number of at-risk women.
The efficacy of the WINGS intervention was based on a previously published evaluation which used a structural equation model . To estimate ρb, the probability of condom use without the intervention, we used the probability of condom use for the control group. At three month followup, the (log) odds ratio of protected sex in the control group was 0.13. Thus, log(ρb / 1 - ρb) = .13, or ρb / (1 - ρb) = 1.1388, or ρb = 0.5324.
To estimate ρi, the probability of condom use with the intervention, we estimated the increase in condom usage associated with the intervention. The structural equation model estimates suggested that the intervention increased the log (odds) of condom use by 0.1818.
This value was estimated as the appropriate product of the unstandardized path coefficients connecting the intervention variable to the odds ratio of condom use outcome. A simplified version of the model at 3 months after the intervention is provided in Figure 1.
Through recursive substitutions , it can be shown that the regression coefficient linking the Treatment or Control Group Status variable and the Odds of Condom Usage is: (A*B)+(C*E*F)+(A*D*F), where A,B,C,D,E, and F are all coefficients to be estimated. Applying the published estimates (Table 3 in Greenberg et al. 2000 ) of these coefficients yielded an estimated 0.1818 increase in the (log) odds of condom usage attributable to the intervention. Thus, for the complete intervention, log (ρi / 1 - ρi) = 0.13 + 0.1818, or ρi / (1 - ρi) = 1.3659, or ρi = 0.5773.
Similarly, we calculated the effect of increased condom use skills by calculating (A*B) + (A*D*F), which yielded an estimated 0.1436 increase in the log (odds) of condom usage attributable to the condom use skills component. Thus, for the condom use skills component, log (ρi / 1 - ρi) = 0.13 + 0.1436, or ρi / (1 - ρi) = 1.3147, or ρi = 0.5680.
In sum, the estimated probability of condom usage for a given act of sexual intercourse is 53.2% without the intervention, 57.7% for the complete intervention and 56.8% for the condom use skills component. Using these baseline probabilities, condom usage is increased by 4.5 percentage points (in absolute terms) among women in the complete intervention, of which 3.6 percentage points could be attributed to the condom use skills component. To generate ranges (to be used in the sensitivity analysis) for the estimated condom usage among intervention participants, we varied these increases by ± 50%.
Centers for Disease Control and Prevention.: HIV/AIDS among US women: Minority and young women at continuing risk. Atlanta: Centers for Disease Control and Prevention. 2000
Exner TM, Seal DW, Ehrhardt AA: A review of HIV interventions for at-risk women. AIDS Behav. 1997, 1: 93-124. 10.1023/B:AIBE.0000002972.61606.99.
Kelly JA, St Lawrence JS, Hood HV, Brasfield TL: Behavioral intervention to reduce AIDS risk activities. J Consult Clin Psychol. 1989, 57: 60-67. 10.1037//0022-006X.57.1.60.
Hobfoll SE, Jackson AP, Lavin J, Britton PJ, Shepherd JB: Reducing inner-city women's AIDS risk activities: a study of single, pregnant women. Health Psychol. 1994, 13: 397-403. 10.1037//0278-6126.96.36.1997.
Kelly JA, Murphy DA, Washington CD, Wilson TS, Koob JJ, Davis DR, et al: The effects of HIV/AIDS intervention groups for high-risk women in urban clinics. Am J Public Health. 1994, 84: 1918-1922.
DiClemente RJ, Wingood GM: A randomized controlled trial of an HIV sexual risk-reduction intervention for young African-American women. JAMA. 1995, 274: 1271-1276. 10.1001/jama.274.16.1271.
Holtgrave DR, Qualls NL, Curran JW, Valdiserri RO, Guinan ME, Parra WC: An overview of the effectiveness and efficiency of HIV preventionprograms. Public Health Rep. 1995, 110: 134-146.
Branson BM, Peterman TA, Cannon RO, Ransom R, Zaidi AA: Group counseling to prevent sexually transmitted disease and HIV: a randomized controlled trial. Sex Transm Dis. 1998, 25: 553-560.
Celentano DD, Dilorio C, Hartwell T, Kelly J, Magana R, Maibach E, et al: The NIMH multisite HIV prevention trial: Reducing HIV sexual risk behavior. Science. 1998, 280: 1889-1894. 10.1126/science.280.5371.1889.
Greenberg J, Hennessy M, MacGowan R, Celentano D, Gonzales V, Van Devanter N, et al: Modeling intervention efficacy for high-risk women – The WINGS Project. Eval Health Prof. 2000, 23: 123-148.
Cohen D, Dent C, MacKinnon D: Condom skills education and sexually transmitted disease reinfection. J Sex Res. 1991, 28: 139-144.
Cohen DA, Mackinnon DP, Dent C, Mason HR, Sullivan E: Group counselling at STD clinics to promote use of condoms. Public Health Rep. 1992, 107: 727-731.
Holtgrave DR, Kelly JA: Preventing HIV/AIDS among high-risk urban women: the cost-effectiveness of a behavioral group intervention. Am J Public Health. 1996, 86: 1442-1445.
Greenberg J, Lifshay J, Van Devanter N, Gonzales V, Celentano D: Preventing HIV infection: The effects of community linkages, time, and money on recruiting and retaining women in intervention groups. J Womens Health. 1998, 7: 587-596.
Van Devanter N, Gonzales V, Merzel C, Parikh NS, Celantano D, Greenberg J: Effect of an STD/HIV behavioral intervention on women's use of the female condom. Am J Public Health. 2002, 92: 109-115.
Fisher JD, Fisher WA: Changing AIDS-risk behavior. Psychol Bull. 1992, 111: 455-474. 10.1037//0033-2909.111.3.455.
Farnham PG, Ackerman SP, Haddix AC: Study design. In Prevention effectiveness: A guide to decision analysis and economic evaluation. Edited by: Haddix AC, Teutsch SM, Shaffer PA, Duñet DO. 1996, New York, Oxford University Press, 12-26.
Pinkerton SD, Abramson PR: Occasional condom use and HIV risk reduction. J Acquir Immune Defic Syndr Hum Retrovirol. 1996, 13: 456-460.
Otten MW, Zaidi AA, Peterman TA, Rolfs RT, Witte JJ: High rate of HIV seroconversion among patients attending urban sexually transmitted disease clinics. AIDS. 1994, 8: 549-553.
Edlin BR, Word CO, McCoy CB, Faruque S, Dushku JC, Holmberg SD: HIV incidence among young urban street-recruited crack cocaine smokers. Natl Conf Hum Retroviruses Relat Infect (2nd). 1995
Onorato IM, Klaskala W, Morgan WM, Withum D: Prevalence, incidence, and risks for HIV-1 infection in female sex workers in Miami, Florida. J Acquir Immune Defic Syndr Hum Retrovirol. 1995, 9: 395-400.
Peterman TA, Zaidi AA, Wroten J: Decreasing prevalence hides a high HIV incidence: Miami. AIDS. 1995, 9: 965-970.
Weinstock H, Sweeney S, Satten GA, Gwinn M: HIV seroincidence and risk factors among patients repeatedly tested for HIV attending sexually transmitted disease clinics in the United States, 1991 to 1996. STD clinic HIV seroincidence study group. J Acquir Immune Defic Syndr Hum Retrovirol. 1998, 19: 506-512.
Chirgwin KD, Feldman J, Dehovitz JA, Minkoff H, Landesman SH: Incidence and risk factors for heterosexually acquired HIV in an inner-city cohort of women: temporal association with pregnancy. J Acquir Immune Defic Syndr Hum Retrovirol. 1999, 20: 295-299.
Pinkerton SD, Abramson PR: Effectiveness of condoms in preventing HIV transmission. Soc Sci Med. 1997, 44: 1303-1312. 10.1016/S0277-9536(96)00258-4.
Haddix AC, Shaffer PA: Cost-effectiveness analysis. In Prevention Effectiveness: A guide to decision analysis and economic evaluation. Edited by: Haddix AC, Teutsch SM, Shaffer PA, Duñet DO. 1996, New York, Oxford University Press, 12-26.
Holtgrave DR, Pinkerton SD: Updates of cost of illness and quality of life estimates for use in economic evaluations of HIV prevention programs. J Acquir Immune Defic Syndr Hum Retrovirol. 1997, 16: 54-62.
Mullins CD, Whitelaw G, Cooke JL, Beck EJ: Indirect cost of HIV infection in England. Clin Ther. 2000, 22: 1333-1345. 10.1016/S0149-2918(00)83030-1.
McKay NL, Phillips KM: An economic evaluation of mandatory premarital testing for HIV. Inquiry. 1991, 28: 236-248.
Holtgrave DR, Valdiserri RO, Gerber AR, Hinman AR: Human immunodeficiency virus counseling, testing, referral, and partner notification services. A cost-benefit analysis. Arch Intern Med. 1993, 153: 1225-1230. 10.1001/archinte.153.10.1225.
Prevention effectiveness: A guide to decision analysis and economic evaluation. Edited by: Haddix AC, Teutsch SM, Shaffer PA, Duñet DO. 1996, New York, Oxford University Press, 12-26.
Cost-effectiveness in health and medicine. Edited by: Gold MR, Siegel JE, Russell LB, Weinstein MC. 1996, New York, Oxford University Press
Doubilet P, Begg CB, Weinstein MC, Braun P, McNeil BJ: Probabilistic sensitivity analysis using Monte Carlo simulation. A practical approach. Med Decis Making. 1985, 5: 157-177.
Pinkerton SD, Johnson-Masotti AP, Holtgrave DR, Farnham PG: Using cost-effectiveness league tables to compare interventions to prevent sexual transmission of HIV. AIDS. 2001, 15: 917-928. 10.1097/00002030-200105040-00012.
Pinkerton SD, Holtgrave DR, Johnson-Masotti AP, Turk ME, Hackl KL, DiFranceisco W, et al: Cost-effectiveness of the NIMH multisite HIV prevention intervention. AIDS Behav. 2002, 6: 83-96. 10.1023/A:1014532713594.
Kamb ML, Fishbein M, Douglas JMJ, Rhodes F, Rogers J, Bolan G, et al: Efficacy of risk-reduction counseling to prevent human immunodeficiency virus and sexually transmitted diseases: a randomized controlled trial. Project RESPECT Study Group. JAMA. 1998, 280: 1161-1167. 10.1001/jama.280.13.1161.
Short L, Hennessy M: Using structural equations to estimate the effects of behavioral interventions. Struct Equation Model. 1994, 1: 68-81.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2334/2/24/prepub
We thank the following WINGS principal investigators for their assistance in our cost analysis: David Celentano, ScD, The Johns Hopkins University; Ann Downer, EdD, and Virginia Gonzales, EdD, University of Washington, Seattle; and Nancy Van Devanter, DrPH, Columbia University. We also thank Kathleen Irwin, MD, Centers for Disease Control and Prevention, for helpful comments and suggestions.
HWC conducted the cost and cost-effectiveness analyses and drafted the manuscript. JBG initiated the study and contributed to the cost and cost-effectiveness analyses. MH contributed to the cost-effectiveness analysis and drafted the appendix. All authors contributed to the writing and reviewing of the manuscript and have read and approved the final version.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.