- Research article
- Open access
- Published:
Development and reliability of metrics to characterize types and sources of stigma among men who have sex with men and female sex workers in Togo and Burkina Faso
BMC Infectious Diseases volume 19, Article number: 208 (2019)
Abstract
Background
Stigma is a multifaceted concept that potentiates Human Immunodeficiency Virus and sexually transmitted infection acquisition and transmission risks among key populations, including men who have sex with men (MSM) and female sex workers (FSW). Despite extensive stigma literature, limited research has characterized the types and sources of stigma reported by key populations in Sub-Saharan Africa.
Methods
This study leveraged data collected from 1356 MSM and 1383 FSW in Togo and Burkina Faso, recruited via respondent-driven sampling. Participants completed a survey instrument including stigma items developed through systematic reviews and synthesis of existing metrics. Using exploratory factor analysis with promax oblique rotation, 16 items were retained in a stigma metric for MSM and 20 in an FSW stigma metric. To assess the measures’ convergent validity, their correlations with expected variables were examined through bivariate logistic regression models.
Results
One factor, experienced stigma, included actions that were carried out by multiple types of perpetrators and included being arrested, verbally harassed, blackmailed, physically abused, tortured, or forced to have sex. Other factors were differentiated by source of stigma including healthcare workers, family and friends, or police. Specifically, stigma from healthcare workers loaded on two factors: experienced healthcare stigma included being denied care, not treated well, or gossiped about by healthcare workers and anticipated healthcare stigma included fear of or avoiding seeking healthcare. Stigma from family and friends included feeling excluded from family gatherings, gossiped about by family, or rejected by friends. Stigma from police included being refused police protection and items related to police confiscation of condoms. The Cronbach’s alpha ranged from 0.71–0.82. Median stigma scores, created for each participant by summing the number of affirmative responses to each stigma item, among MSM were highest in Ouagadougou and among FSW were highest in both Ouagadougou and Bobo-Dioulasso. Validation analyses demonstrated higher stigma was generally significantly associated with suicidal ideation, disclosure of involvement in sex work or same-sex practices, and involvement in organizations for MSM or FSW.
Conclusions
Taken together, these data suggest promising reliability and validity of metrics for measuring stigma affecting MSM and FSW in multiple urban centers across West Africa.
Background
Stigma has been defined as processes of labeling, stereotyping, separation, status loss, and discrimination of individuals or groups [1]. Some theories include both psychological and social dimensions of stigma but exclude discrimination from the definition [2]. Structural conceptualizations of stigma recognize that macro-level forces also compound marginalization by placing constraints on affected groups themselves as well as influencing social interactions with affected populations [3]. Several stigma types have been characterized and studied [4, 5]. Perceived (also called felt [6], or felt-normative [7]) stigma refers to the impression or belief that individuals or societies treat people differently due to stigmatized characteristics. Enacted or experienced stigma [8, 9] represents the explicit experience of poor treatment on the basis of specific characteristics. Internalized or self-stigma is the acceptance of one’s perceived lesser status within society and manifests in low self-esteem, self-isolation, and social withdrawal [10, 11]. Finally, anticipated stigma [12] is the fear or expectation of discrimination. This is distinct from stigma toward oneself and involves worry by the stigmatized individual, which may or may not be based on others’ actual actions. Secondary [13] or courtesy stigma [5] occurs when people associated with the person being stigmatized are also exposed to stigma. Finally, intersecting or compounded stigmas is the experience or perception of multiple forms of stigmas, such as that stigma often experienced related to identifying as gay or openly living with Human Immunodeficiency Virus (HIV) [4].
After years of consistent data, there is consensus that social and structural factors, including stigma, potentiate HIV risks by limiting the provision and uptake of evidence-based HIV prevention, treatment, and care services [14]. Stigma affecting populations with disproportionate HIV burden has consistently been associated with negative health outcomes throughout the world. In Uganda, experiencing homophobic abuse was positively associated with HIV infection among men who have sex with men (MSM) [15]. Occupational stigma among female sex workers (FSW) in Canada was correlated with experiencing barriers to healthcare access [16]. In The Gambia, internal and experienced stigma toward people living with HIV were associated with poorer self-reported health [17]. At the public policy level, stigma may be related to criminalization of key populations’ practices and lower levels of funding of specific health services for key populations because they are deemed unworthy of assistance [18,19,20].
Reliable and valid stigma metrics are needed to assess correlates of stigma and changes in stigma over time [21] in order to evaluate stigma mitigation interventions [22] and assess dose-response associations of stigma with health outcomes. However, there are several gaps in the research literature on measuring stigma specifically among key populations. This is especially the case across Sub-Saharan Africa (SSA) [23,24,25,26,27,28]. Previous studies have often focused on investigating stigma from others’ perspectives rather than from MSM and FSW themselves [29, 30]. Additionally, many existing studies using or evaluating metrics have focused on assessing HIV-related stigma among key populations [31], though fewer in these contexts have focused on stigma related to selling sex or same-sex sexual practices, identities, relationships or communities [32,33,34,35,36,37]. Existing studies have often been completed in high or upper middle income countries [35, 38,39,40,41]. In a recent systematic review on stigma measures, only three articles included both MSM and FSW participants [42]. Of seven articles measuring stigma reported by FSW study participants, five were about perceived stigma, one was about internalized stigma, and one was about experienced stigma. These surveys did not ask the source of this stigma (e.g., family, friends, healthcare workers, or police). None of these studies took place in Sub-Saharan Africa. While more measures of stigma toward MSM were identified, only four were from Sub-Saharan Africa (all from South Africa).While the HIV epidemics, especially in Southern and Eastern Africa, are more broadly generalized, key populations have consistently been shown to have higher burdens of HIV than other reproductive aged men [43, 44] and women [45].
In West and Central Africa, the most populous region of SSA, HIV is more concentrated among key populations including MSM and FSW compared to what has historically been observed in Southern and Eastern Africa [43]. Across the countries of West Africa, enforcement of punitive laws related to MSM and FSW varies significantly. In Burkina Faso, same-sex practices are not mentioned in the law. Selling sex is tolerated and not prohibited; soliciting and facilitating sex work are criminalized [46, 47]. However, stigma related to HIV [48, 49], sex work [50] and same-sex practices [51] is common. Socially and in the media there are strong expressions against same-sex sexual practices and relationships. For example, 95% of participants from Burkina Faso in the Afrobarometer said they would dislike living next to gay or lesbian neighbors [52]. A bill was introduced (and later rejected) to criminalize same-sex practices. There have been public marches against same-sex sexual practices and relationships [53]. Sex work and same-sex practices are both criminalized in Togo. Specifically, same-sex practices may be punished with fines between 100,000–500,000 XOF ($200–1000) and 1 to 3 years imprisonment [54]. Selling sex in specific sex work venues is prohibited, with a maximum fine of 1,000,000 XOF ($2000); however compensated or transactional sex is not specifically prohibited [55].
In these settings, it remains vital to characterize appropriate tools to measure stigma and inform evaluating the impact of stigma mitigation interventions. Consequently, this study aims to characterize the reliability and convergent validity of stigma metrics for MSM and FSW in two West African countries.
Methods
Settings of the study/study sites
Data were collected from January–August 2013 using respondent-driven sampling of 1356 MSM and 1383 FSW in Ouagadougou, and Bobo-Dioulasso, Burkina Faso and Lomé, and Kara, Togo, West Africa.
Type of study
Details of the study procedures have been previously reported [56,57,58,59,60,61,62,63,64,65,66]. Briefly, the original purposes of these studies were to develop population-based estimates of HIV prevalence and determinants of those living with HIV at the individual, network, community and policy levels.
Participants
Inclusion criteria for FSW included being assigned the female gender at birth and reporting most of their income came from selling sex in the past year. Eligible MSM participants were assigned the male gender at birth and had anal sex with a man in the past year. All participants were 18 years old or older and lived in the respective city for at least the past 3 months. Respondent-driven sampling coupons were required for all participants (except for seeds). Participants in Burkina Faso provided written informed consent in French, Mooré, or Dioula. In Togo, participants provided oral informed consent in French, Ewe or Kabiye.
Data collection
Trained interviewers administered structured questionnaires including modules on demographics, stigma, HIV-related knowledge and behaviors, mental health, social capital, access to services, and reproductive health.
Stigma measurement
Questions related to stigma were initially informed through literature reviews, consultations with key stakeholders including social scientists and nongovernmental organizations, and have been adapted over a decade of studies with key populations across SSA [9, 67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82]. Listwise deletion was used to handle missing data, including “don’t know” and “refusal” responses.
Analyses
The analytic approach chosen was exploratory factor analysis [83] given the lack of prior studies with factor analysis of these items. Despite the rich body of prior stigma scale development, this inductive method was used because most of stigma measurement research with key populations [42] has been conducted with Western, Educated, Industrialized, Rich, or Democratic (WEIRD) [84] samples or societies. Other psychometric instruments, such as personality measures, have been found to have different factor structures outside of these WEIRD settings [85]. A recent study comparing reports of stigma from surveys administered to MSM in the United States and Western and Southern Africa found differences between settings in prevalence of family exclusion, poor health care treatment, and blackmail but did not use factor analysis to compare the structure of stigma measures [86].
Principal factor analysis (or common factor analysis) was used because the goal was not data reduction but rather to describe the underlying latent stigma variables [87]. Promax oblique rotation [88] was used because the factors were hypothesized to be correlated [89]. Data from each city and population were analyzed separately using Stata 13.1 (College Station, Texas) because the respondent-driven sampling networks were different by city and because of the potential value of metrics that can be used with multiple populations in multiple geographic areas. Results using combined data were similar to those reported below. The sample size in each dataset was sufficient to allow for greater than the recommended ten participants per variable [87]. The Kaiser-Meyer-Olkin [90] measure of sampling adequacy was used with the Bartlett’s test of sphericity [91] to assess the correlation matrices’ suitability for factor analysis. The factors retained were based on Kaiser’s criterion [92], eigenvalues over one, scree plots, Horn’s test [93], and interpretability. Items considered for the final metrics had factor loadings greater than 0.3 [94] in at least one city for each population. This was done to allow for comparisons across groups. Questions were excluded if they loaded on more than one factor [95] or variability in the distributions of responses was under 10% [96]. Questions were also excluded if greater than 20% of participants had missing data, as this may indicate they were misunderstood or particularly sensitive [97, 98]. These questions, shown in Table 1 with the rationales for excluding them, were about discrimination in employment and education, being forced to test for HIV, being scared to walk in public places, difficulties accessing healthcare for FSW, and hearing discriminatory remarks about same-sex sexual practices and relationships for MSM. Stigma scores were categorized by parceling [99], adding the remaining questions such that participants who answered “yes” to one included question were assigned a score of 1, participants who answered “yes” to two questions were assigned a score of 2, and so on. This technique was chosen because of its simplicity and practical use for community organization staff who may not have the skills or software to compute factor scores [100].
While some other stigma metrics are comprised of Likert items [101], which may increase internal consistency and capture more fine-grained differences in frequency of exposure to stigma, the metrics in the present study are based on dichotomous items. This approach enables assessment of the prevalence and correlates of lifetime experiences of stigma, can be faster to administer (which is important in the context of a long questionnaire that includes multiple topics in addition to stigma), and may not result in reduced validity or test-retest reliability [102]. The present study’s measures’ reliability was assessed using Cronbach’s alpha [103] and the Kuder-Richardson coefficient [104]. The overall metrics’ reliability was acceptable, with Cronbach’s alpha coefficients ranging from 0.71 among MSM in Ouagadougou to 0.82 among FSW in Ouagadougou. The Kuder-Richardson coefficients were the same as the Cronbach’s alpha except in Lomé, Togo where for the FSW metric the alpha was 0.73 and the Kuder-Richardson coefficient was 0.70.
To assess the measures’ convergent validity, their correlations with expected HIV-related determinants were examined. This was done to evaluate whether the stigma metrics are useful not only for assessing levels of stigma but also within models with other HIV-related risk determinants. The literature suggests stigma would be associated with increased purposeful or inadvertent disclosure represented by family members or health workers knowing about the participant’s sex work or same-sex practices [75, 105]. This study also tested whether higher stigma is related to having suicidal ideation [32, 106]. Among participants recruited into the study as MSM, it was further hypothesized that those who identified as men would have lower stigma scores than those who identified as transgender, female or intersex [107]. It was expected that higher stigma would be inversely associated with HIV testing and condom use [26, 108]. Stigma scores were used as continuous independent variables in all models. Separate bivariate logistic regression models were used to estimate the relationship between stigma and dichotomous dependent variables (disclosure to family or health workers of selling sex for FSW and having sex with men or being attracted to men for MSM, suicidal ideation, participating in MSM/FSW/HIV organizations, and gender identity). Results were considered statistically significant at p < 0.05 using two-sided tests.
The Johns Hopkins School of Public Health Institutional Review Board, Burkina Faso Ethics Committee for Health Research, and Togo National Ethics Committee approved the study.
Results
The median age of FSW participants ranged from 23 years old in Kara and Ouagadougou to 30 in Bobo-Dioulasso (see Table 2). Fewer than half of FSW in Burkina Faso and over 70% in Togo completed primary school or higher. The proportion employed outside of selling sex ranged from 7.1% in Bobo-Dioulasso to 53.4% in Lomé. Under 15% were married or cohabitating. Over half had at least one biological child. One third said a family member knew about their involvement in sex work. One fifth voluntarily disclosed. Over one quarter disclosed to a health worker, and 10% reported a health worker found out some other way. Over one fifth ever had suicidal ideation. Less than half had condomless vaginal sex in the past 12 months. Most had tested for HIV more than once ever.
Across all the cities, the median age of participants in the MSM study was under 25 years old (see Table 3). Over 90% completed primary school or higher. Most (> 50%) were unemployed (including students). Under 10% were married or cohabitating with a woman or had a biological child. The majority reported their sexual orientation as gay. One fifth said a family member knew about their sexual practices. One quarter disclosed to them. Under 5% reported a health worker found out about their sexual practices. One fifth voluntarily disclosed. Over 10% reported suicidal ideation. Over one quarter identified their gender as transgender, female or intersex. Most had ever had condomless anal sex. Over half had tested for HIV more than once ever.
The Bartlett’s test of sphericity was significant (p < 0.05), indicating the data were suitable for factor analysis. The Kaiser-Meyer-Olkin index was greater than the minimum acceptable value of 0.5 in all datasets. A five-factor solution was identified for the FSW metric (20 questions total) and a four-factor solution for the MSM metric (16 questions total). Two to seven variables loaded on each factor (Tables 4 and 5). The factors were each significantly correlated with one another (p < 0.001).
One factor, experienced stigma, included actions that were carried out by multiple types of perpetrators. Other factors were differentiated by source of stigma (healthcare workers, family and friends, or police). Stigma from healthcare workers loaded on two factors. The factors common to both populations were: stigma from family and friends; experienced stigma; experienced healthcare stigma; and anticipated healthcare stigma. The fifth factor in the FSW metric was stigma from police (Tables 6 and 7).
For both populations, experienced stigma included items for being arrested, verbally harassed, blackmailed, physically abused, tortured, or forced to have sex. The most common perpetrators of forced sex among MSM were current or past male sexual partners or other MSM (data not shown). Police harassing the participant loaded on the experienced stigma factor for FSW.
Experienced healthcare stigma for both populations included being denied care, not treated well, or gossiped about by healthcare workers. Among MSM, difficulties accessing healthcare also loaded on the experienced healthcare stigma factor. Anticipated healthcare stigma included fear of or avoiding seeking healthcare. Stigma from family and friends included feeling excluded from family gatherings, gossiped about by family, or rejected by friends. Stigma from police among FSW included being refused police protection or experiencing, fearing, witnessing or hearing about police confiscation of condoms.
Convergent validity
In both populations, higher stigma was generally significantly and positively associated with a family member or health worker knowing about involvement in sex work or same-sex practices, regardless of whether the disclosure was voluntary or involuntary (Table 8). The exception was among MSM in Lomé, who reported less stigma if they voluntarily disclosed to a health worker. Participants with greater cumulative reports of stigma had a greater likelihood of suicidal ideation, though this was not significant among MSM in Kara or FSW in Bobo-Dioulasso. FSW in Ouagadougou and both populations in Bobo-Dioulasso reported higher stigma if they participated in FSW, MSM or HIV-related organizations. Study participants in the MSM sample who identified as male had lower stigma scores than those who identified as female, transgender or intersex. The relationships between stigma and HIV testing and condom use were not consistent across cities and populations. Final items retained in each stigma metric are reported in Tables 9 and 10.
Discussion
The results of this multi-country study illustrate the potential for brief tools to measure stigma among key populations that work well across country contexts and languages. These measures include items related to perceived, anticipated and enacted types of stigma. The sources of stigma represent multiple levels of the social ecological model of HIV risk among key populations, including social (family and friends), community (healthcare workers), and policy (police) [14]. Though many factors were common to both populations, additional questions asked of FSW about interactions with police constituted a separate factor relevant to the overall construct of stigma within this population. The metrics were significantly related to disclosure of sex work or same-sex practices to family or a health worker, suicidal ideation, organization participation, and gender identity.
These analyses build on earlier studies using some of the same questionnaire items. Previous studies have used these indicators individually in models as independent variables [75, 109], or reported dichotomous aggregate stigma measures such as any social stigma [73, 75, 79]. Dichotomized measures may not fully capture the granularity of dose-response relationships between the number of stigma events reported and health outcomes.
In this study experienced stigma included both physically violent and emotionally abusive experiences, demonstrating a wide range of severity for this factor. Sexual violence related to being MSM loaded on the same factor as blackmail. Perpetrators (including other MSM) may believe they will not be prosecuted because the police will not take action, or the person will not report the rape due to being MSM.
Among FSW, being arrested for selling sex loaded on the experienced stigma factor rather than the stigma from police factor. In countries where aspects of sex work are criminalized, arrests may indicate structural stigma from the government or society rather than from police doing their job. The items that loaded on the stigma from police factor included some that could be categorized as anticipated stigma (Have you ever avoided carrying condoms because you were afraid that they might get you in trouble with the police?), some that could be categorized as perceived stigma (Have you ever felt that the police refused to protect you because you sell sex?), and some that could be categorized as enacted stigma (police confiscation of condoms). Studies in the United States and human rights reports have provided some indications of police confiscation of condoms as evidence of sex work [110,111,112]. This study presented quantitative data from a diverse sample of FSW on the prevalence of experiencing, witnessing, hearing about, and avoiding carrying condoms due to police confiscation. Given the emergence of stigma from police as one components of stigma in the metric for FSW specifically, using research and evaluation to identify effective approaches in these countries’ contexts to prevent harmful policing practices through education, policy, or increased accountability appears to be warranted [113, 114].
The stigma metrics showed promising convergent validity in that in bivariate models they generally performed as had been theorized based on conceptual models and existing literature. The findings that higher stigma scores were positively associated with a family member or health worker knowing about participants’ involvement in sex work or same-sex practices is consistent with prior studies in The Gambia and the United States [75, 105]. Similarly, stigma was positively associated with suicidal ideation, as other researchers have reported in China [32] and the United States [106]. Transgender participants accrued into the studies focused on MSM reported higher stigma than cisgender MSM, which may be due to intersecting stigma associated with sexual practices and gender identity. MSM who are more masculine or hide their sexual orientation or practices may even reject those who are more open about their sexual orientation or practices or considered more feminine. Given the unique needs of transgender and cisgender populations, valid and reliable stigma measures are needed specifically for transgender women [110, 111].
This study has several limitations. Findings may not be generalizable to settings outside the cities in West Africa included in this study. This is a secondary analysis of data collected for a study measuring HIV prevalence among key populations. For MSM, the inclusion criteria of having anal sex with a man in the past year was chosen due to its relationship with potential HIV acquisition or transmission risk. Items in this stigma metric may not capture stigma targeted toward MSM communities or identities rather than sexual practices. Individuals who did not meet the inclusion criteria but are in same-sex relationships or identify as sexually diverse, sexually attracted to the same gender, gay or bisexual may face similar or different types of stigma compared to those included in this study.
All self-reported variables may be subject to social desirability bias and inaccurate recall. In the context of limited disclosure of sex work or same-sex practices, stigma may be lower than expected because participants’ families, friends, healthcare providers or others are not aware of these practices. However, MSM may also experience stigma because of their relationships, gender non-conformity, mannerisms, or friends who are also sexual minorities. For example, others may know that the participant is not dating a woman, getting married, acting “masculine”, or fulfilling other heteronormative expectations, and this may be another source of stigma. This study investigated stigma from the perspective of MSM and FSW, which may differ from stigma toward these groups reported by others. Future research measuring stigma from both perspectives of those within and outside the population of interest may inform stigma reduction programs. If, for instance, MSM or FSW report experiencing stigma from healthcare workers but healthcare providers do not report stigmatizing attitudes, making these providers aware of actions that may be unintentionally stigmatizing could result in improved services.
Because of the question wording, it is not possible to determine whether issues related to stigma from family and friends were experienced (e.g., the participant actually heard the discriminatory remarks) or perceived (e.g., the participant heard a family member whispering to another and assumed it was about the participant selling sex). Other items potentially assessing felt normative or perceived stigma (e.g., Have you ever felt scared to walk around in public places because you sell sex?) were excluded for the reasons mentioned above. Some studies have shown that perceived stigma is more commonly reported than other types of stigma [115] and is significantly and negatively associated with quality of life [116]. Questionnaire items excluded from these metrics may be important stigma indicators that should be assessed in studies in different contexts. These metrics do not specifically measure secondary stigma, with mental health being measured in lieu of internalized stigma. Internalized stigma is often preceded by experienced stigma [117] and has been shown to be less closely correlated with avoiding or delaying seeking healthcare than experienced stigma [17]. Future analyses could leverage these developed metrics to explore intersectionality through intra- and inter-categorical approaches.
Potential confounding variables were not included in these analyses because the primary purpose was the development of the metrics. Stratified analyses by age, HIV status, and socioeconomic status will enable comparisons to better understand the effects of privilege and marginalization and the distribution of the burden of stigma [113]. Future studies should use confirmatory factor analysis to assess whether the metrics’ structure is applicable in other samples of key populations across SSA. Moreover, additional approaches for validating and assessing the metrics’ psychometric properties including assessing predictive validity and test-retest reliability would add strength to the conclusions.
Conclusions
There are ongoing and planned stigma mitigation interventions in SSA that would benefit by the ability to consistently measure stigma across key populations and over time using these reliable and valid stigma measures [22, 114]. Stigma may be addressed through implementing nondiscrimination policies and increasing police protection of vulnerable populations to hold perpetrators of violence and blackmail accountable. Comprehensive stigma reduction interventions should also work directly with MSM and FSW individuals and community groups to address stigma, given the level of anticipated stigma found in this study and association between stigma and suicidal ideation. Continued stigma measurement and evaluation of stigma reduction interventions must urgently be addressed in order to realize the goals of achieving an AIDS-Free generation in our lifetimes.
Abbreviations
- AIDS:
-
Acquired Immune Deficiency Syndrome
- FSW:
-
Female sex workers
- HIV:
-
Human Immunodeficiency Virus
- MSM:
-
Men who have sex with men
- SSA:
-
Sub-Saharan Africa
- WEIRD:
-
Western, Educated, Industrialized, Rich, or Democratic
References
Link BG, Phelan JC. Conceptualizing stigma. Annu Rev Sociol. 2001;27:363–85.
Deacon H. Towards a sustainable theory of health-related stigma: lessons from the HIV/AIDS literature. J Community Appl Soc Psychol. 2006;16:418–25.
Yang LH, Kleinman A, Link BG, Phelan JC, Lee S, Good B. Culture and stigma: adding moral experience to stigma theory. Soc Sci Med. 2007;64:1524–35.
Logie CH, James L, Tharao W, Loutfy MR. HIV, gender, race, sexual orientation, and sex work: a qualitative study of intersectional stigma experienced by HIV-positive women in Ontario, Canada. PLoS Med. 2011;8:e1001124.
Goffman E. Stigma: notes on the management of spoiled identity. New York: Simon and Schuster; 2009.
Green G. Attitudes towards people with HIV: are they as stigmatizing as people with HIV perceive them to be? Soc Sci Med. 1995;41:557–68.
Scambler G. Health-related stigma. Sociol Health Illn. 2009;31:441–55.
Nyblade LC. Measuring HIV stigma: existing knowledge and gaps. Psychol Health Med. 2006;11:335–45.
Fay H, Baral SD, Trapence G, Motimedi F, Umar E, Iipinge S, et al. Stigma, health care access, and HIV knowledge among men who have sex with men in Malawi, Namibia, and Botswana. AIDS Behav. 2011;15:1088–97.
Mak WWS, Cheung RYM, Law RW, Woo J, Li PCK, Chung RWY. Examining attribution model of self-stigma on social support and psychological well-being among people with HIV+/AIDS. Soc Sci Med. 2007;64:1549–59.
Meyer IH. Minority stress and mental health in gay men. J Health Soc Behav. 1995;36:38–56.
Turan JM, Bukusi EA, Onono M, Holzemer WL, Miller S, Cohen CR. HIV/AIDS stigma and refusal of HIV testing among pregnant women in rural Kenya: results from the MAMAS study. AIDS Behav. 2011;15:1111–20.
Ogunmefun C, Gilbert L, Schatz E. Older female caregivers and HIV/AIDS-related secondary stigma in rural South Africa. J Cross Cult Gerontol. 2011;26:85–102.
Baral S, Logie CH, Grosso A, Wirtz AL, Beyrer C. Modified social ecological model: a tool to guide the assessment of the risks and risk contexts of HIV epidemics. BMC Public Health. 2013;13:482.
Hladik W, Barker J, Ssenkusu JM, Opio A, Tappero JW, Hakim A, et al. HIV infection among men who have sex with men in Kampala, Uganda–a respondent driven sampling survey. PLoS One. 2012;7:e38143.
Lazarus L, Deering KN, Nabess R, Gibson K, Tyndall MW, Shannon K. Occupational stigma as a primary barrier to health care for street-based sex workers in Canada. Cult Health Sex. 2012;14:139–50.
Peitzmeier SM, Grosso A, Bowes A, Ceesay N, Baral SD. Associations of stigma with negative health outcomes for people living with HIV in the Gambia: implications for key populations. J Acquir Immune Defic Syndr. 2015;68:S146.
Ryan O, Macom J, Moses-Eisenstein M. Demand for programs for key populations in Africa from countries receiving international donor assistance. SAHARA J. 2012;9:131–6.
Grosso AL, Tram KH, Ryan O, Baral S. Countries where HIV is concentrated among most-at-risk populations get disproportionally lower funding from PEPFAR. Health Aff. 2012;31:1519.
Grosso A, Ryan O, Tram KH, Baral S. Financing the response to HIV among gay men and other men who have sex with men: case studies from eight diverse countries. Glob Public Health. 2015;10:1172.
Stangl AL, Lloyd JK, Brady LM, Holland CE, Baral S. A systematic review of interventions to reduce HIV-related stigma and discrimination from 2002 to 2013: how far have we come? J Int AIDS Soc. 2013;16:18734.
Lyons CE, Ketende S, Diouf D, Drame FM, Liestman B, Coly K, et al. Potential impact of integrated stigma mitigation interventions in improving HIV/AIDS service delivery and uptake for key populations in Senegal. J Acquir Immune Defic Syndr. 2017;74(Suppl 1):S52.
McAdams-Mahmoud A, Stephenson R, Rentsch C, Cooper H, Arriola KJ, Jobson G, et al. Minority stress in the lives of men who have sex with men in Cape Town, South Africa. J Homosex. 2014;61:847–67.
Van der Elst EM, Smith AD, Gichuru E, Wahome E, Musyoki H, Muraguri N, et al. Men who have sex with men sensitivity training reduces homoprejudice and increases knowledge among Kenyan healthcare providers in coastal Kenya. J Int AIDS Soc. 2013;16:18748.
Ross MW, Smolenski DJ, Kajubi P, Mandel JS, McFarland W, Raymond FH. Measurement of internalized homonegativity in gay and bisexual men in Uganda: cross-cultural properties of the internalized Homonegativity scale. Psychol Health Med. 2010;15:159–65.
Tucker A, Liht J, de Swardt G, Jobson G, Rebe K, McIntyre J, et al. Homophobic stigma, depression, self-efficacy and unprotected anal intercourse for peri-urban township men who have sex with men in Cape Town, South Africa: a cross-sectional association model. AIDS Care. 2014;26:882–9.
Vu L, Tun W, Sheehy M, Nel D. Levels and correlates of internalized homophobia among men who have sex with men in Pretoria, South Africa. AIDS Behav. 2012;16:717–23.
Arndt M, De Bruin K. Measurement of attitudes toward bisexual men and women among South African university students: the validation of an instrument. J Homosex. 2011;58:497–520.
Chan KY, Yang Y, Zhang K-L, Reidpath DD. Disentangling the stigma of HIV/AIDS from the stigmas of drugs use, commercial sex and commercial blood donation–a factorial survey of medical students in China. BMC Public Health. 2007;7:280.
Crandall CS. Multiple stigma and AIDS: illness stigma and attitudes toward homosexuals and IV drug users in AIDS-related stigmatization. J Community Appl Soc Psychol. 1991;1:165–72.
Logie C, Gadalla TM. Meta-analysis of health and demographic correlates of stigma towards people living with HIV. AIDS Care. 2009;21:742–53.
Hong Y, Fang X, Li X, Liu Y, Li M, Tai-Seale T. Self-perceived stigma, depressive symptoms, and suicidal behaviors among female sex workers in China. J Transcult Nurs. 2010;21:29–34.
Pitpitan EV, Strathdee SA, Semple SJ, Wagner KD, Chavarin CV, Earnshaw VA, et al. Perceived stigma of purchasing sex among Latino and non-Latino male clients of female sex workers in Tijuana, Mexico. J Immigr Minor Health. 2015;17:172–80.
Kamise Y. Occupational stigma and coping strategies of women engaged in the commercial sex industry: a study on the perception of “Kyaba-Cula Hostesses” in Japan. Sex Roles. 2013;69:42–57.
Baker LM, Wilson FL, Winebarger AL. An exploratory study of the health problems, stigmatization, life satisfaction, and literacy skills of urban, street-level sex workers. Women Health. 2004;39:83–96.
Long SL, Mollen D, Smith NG. College women’s attitudes toward sex workers. Sex Roles. 2012;66:117–27.
Liu S-H, Srikrishnan AK, Zelaya CE, Solomon S, Celentano DD, Sherman SG. Measuring perceived stigma in female sex workers in Chennai, India. AIDS Care. 2011;23:619–27.
Ross MW, Rosser BRS. Measurement and correlates of internalized homophobia: a factor analytic study. J Clin Psychol. 1996;52:15–21.
Raymond HF, Chen Y-H, Stall RD, McFarland W. Adolescent experiences of discrimination, harassment, connectedness to community and comfort with sexual orientation reported by adult men who have sex with men as a predictor of adult HIV status. AIDS Behav. 2011;15:550–6.
Morrison MA. Psychological health correlates of perceived discrimination among Canadian gay men and lesbian women. Can J Community Ment Heal. 2012;30:81–98.
Brown J, Trevethan R. Shame, internalized homophobia, identity formation, attachment style, and the connection to relationship status in gay men. Am J Mens Health. 2010;4:267–76.
Fitzgerald-Husek A, Van Wert MJ, Ewing WF, Grosso AL, Holland CE, Katterl R, et al. Measuring stigma affecting sex workers (SW) and men who have sex with men (MSM): a systematic review. PLoS One. 2017;12:e0188393.
Papworth E, Ceesay N, An L, Thiam-Niangoin M, Ky-Zerbo O, Holland C, et al. Epidemiology of HIV among female sex workers, their clients, men who have sex with men and people who inject drugs in West and Central Africa. J Int AIDS Soc. 2013;16(Suppl 3):18751.
Baral SD, Grosso A, Holland C, Papworth E. The epidemiology of HIV among men who have sex with men in countries with generalized HIV epidemics. Curr Opin HIV AIDS. 2014;9:156.
Baral S, Beyrer C, Muessig K, Poteat T, Wirtz AL, Decker MR, et al. Burden of HIV among female sex workers in low-income and middle-income countries: a systematic review and meta-analysis. Lancet Infect Dis. 2012;12:538–49.
United States Department of State. 2009 Human Rights Report: Burkina Faso. Washington, DC: Bureau of Democracy, Human Rights, and Labor; 2010.
United States Department of State. Burkina Faso 2012 Human Rights Report. Washington, DC: Bureau of Democracy, Human Rights, and Labor; 2013.
Stephenson R. Community factors shaping HIV-related stigma among young people in three African countries. AIDS Care. 2009;21:403–10.
Neuman M, Obermeyer CM, Group MS. Experiences of stigma, discrimination, care and support among people living with HIV: a four country study. AIDS Behav. 2013;17:1796–808.
Berthé A, Huygens P, Ouattara C, Sanon A, Ouédraogo A, Nagot N. Understanding and reaching young clandestine sex workers in Burkina Faso to improve response to HIV. Cah d’études Rech Francoph. 2008;18:163–73.
Niang CI, Moreau A, Bop C, Compaore C, Diagne M. Targeting Vulnerable Groups in National HV/AIDS Programs: The Case of Men Who Have Sex with Men-Senegal, Burkina Faso, The Gambia. Washington, DC: World Bank (African Reg Hum Dev Work Pap Ser No 82); 2004.
Dulani B, Sambo G, Dionne KY. Good Neighbours? African express high levels of tolerance for many but not for all; 2016.
Immigration and Refugee Board of Canada. Burkina Faso: Treatment of sexual minorities, including legislation, state protection and support services. 2016. http://www.refworld.org/docid/5729a8d74.html. Accessed 8 Aug 2018.
United States Department of State. Togo 2012 Human Rights Report. Washington, DC: Bureau of Democracy, Human Rights, and Labor; 2013.
United States Department of State. Country Report on Human Rights Practices 2006 - Togo. Washington, DC: Bureau of Democracy, Human Rights, and Labor; 2007.
Wirtz AL, Schwartz S, Ketende S, Anato S, Nadedjo FD, Ouedraogo HG, et al. Sexual violence, condom negotiation, and condom use in the context of sex work: results from two West African countries. J Acquir Immune Defic Syndr. 2015;68:S171.
Grosso AL, Ketende S, Dam K, Papworth E, Ouedraogo HG, Ky-Zerbo O, et al. Structural determinants of health among women who started selling sex as minors in Burkina Faso. J Acquir Immune Defic Syndr. 2015;68:S162.
Schwartz SR, Papworth E, Ky-Zerbo O, Sithole B, Anato S, Grosso A, et al. Reproductive health needs of female sex workers and opportunities for enhanced prevention of mother-to-child transmission efforts in sub-Saharan Africa. J Fam Plan Reprod Heal Care. 2017;43:50.
Papworth E, Schwartz S, Ky-Zerbo O, Leistman B, Ouedraogo G, Samadoulougou C, et al. Mothers who sell sex: a potential paradigm for integrated HIV, sexual, and reproductive health interventions among women at high risk of HIV in Burkina Faso. J Acquir Immune Defic Syndr. 2015;68:S154.
Papworth E, Grosso A, Ketende S, Wirtz A, Cange C, Kennedy C, et al. Examining risk factors for HIV and access to services among female sex workers (FSW) and men who have sex with men (MSM) in Burkina Faso, Togo and Cameroon. Baltimore: Johns Hopkins University; 2014.
Schwartz SR, Papworth E, Ky-Zerbo O, Anato S, Grosso A, Ouedraogo HG, et al. Safer conception needs for HIV prevention among female sex workers in Burkina Faso and Togo. Infect Dis Obstet Gynecol. 2014;2014:296245.
Ruiseñor-Escudero H, Grosso A, Ketende S, Pitche V, Simplice A, Tchalla J, et al. Using a social ecological framework to characterize the correlates of HIV among men who have sex with men in Lomé, Togo. AIDS Care. 2017;29:1169.
Goodman SH, Grosso AL, Ketende SC, Ouedraogo GH, Kouanda S, Ky-Zerbo O, et al. Examining the correlates of sexually transmitted infection testing among men who have sex with men in Ouagadougou and Bobo-Dioulasso, Burkina Faso. Sex Transm Dis. 2016;43:302.
Kim H-Y, Grosso A, Ky-Zerbo O, Lougue M, Stahlman S, Samadoulougou C, et al. Stigma as a barrier to health care utilization among female sex workers and men who have sex with men in Burkina Faso. Ann Epidemiol. 2018;28:13.
Stahlman S, Grosso A, Ketende S, Pitche V, Kouanda S, Ceesay N, et al. Suicidal ideation among MSM in three West African countries: associations with stigma and social capital. Int J Soc Psychiatry. 2016;62:522.
Ouedraogo HG, Ky-Zerbo O, Baguiya A, Grosso A, Goodman S, Samadoulougou BC, et al. HIV among female sex Workers in Five Cities in Burkina Faso: a cross-sectional baseline survey to inform HIV/AIDS programs. AIDS Res Treat. 2017;2017:9580548.
Baral S, Trapence G, Motimedi F, Umar E, Iipinge S, Dausab F, et al. HIV prevalence, risks for HIV infection, and human rights among men who have sex with men (MSM) in Malawi, Namibia, and Botswana. PLoS One. 2009;4:e4997.
Risher K, Adams D, Sithole B, Ketende S, Kennedy C, Mnisi Z, et al. Sexual stigma and discrimination as barriers to seeking appropriate healthcare among men who have sex with men in Swaziland. J Int AIDS Soc. 2013;16:18715.
Baral SD, Ketende S, Mnisi Z, Mabuza X, Grosso A, Sithole B, et al. A cross-sectional assessment of the burden of HIV and associated individual- and structural-level characteristics among men who have sex with men in Swaziland. J Int AIDS Soc. 2013;16(Suppl 3):18768.
Fonner VA, Kerrigan D, Mnisi Z, Ketende S, Kennedy CE, Baral S. Social cohesion, social participation, and HIV related risk among female sex workers in Swaziland. PLoS One. 2014;9:e87527.
Beyrer C, Trapence G, Motimedi F, Umar E, Iipinge S, Dausab F, et al. Bisexual concurrency, bisexual partnerships, and HIV among Southern African men who have sex with men. Sex Transm Infect. 2010;86:323–7.
Baral S, Burrell E, Scheibe A, Brown B, Beyrer C, Bekker L-G. HIV risk and associations of HIV infection among men who have sex with men in peri-urban Cape Town, South Africa. BMC Public Health. 2011;11:766.
Baral S, Adams D, Lebona J, Kaibe B, Letsie P, Tshehlo R, et al. A cross-sectional assessment of population demographics, HIV risks and human rights contexts among men who have sex with men in Lesotho. J Int AIDS Soc. 2011;14:36.
Wirtz AL, Jumbe V, Trapence G, Kamba D, Umar E, Ketende S, et al. HIV among men who have sex with men in Malawi: elucidating HIV prevalence and correlates of infection to inform HIV prevention. J Int AIDS Soc. 2013;16:18742.
Mason K, Ketende S, Peitzmeier S, Ceesay N, Logie C, Diouf D, et al. Stigma, human rights violations, health care access, and disclosure among men who have sex with men in the Gambia. J Hum Rights Pract. 2015;7:139.
Sherwood JA, Grosso A, Decker MR, Peitzmeier S, Papworth E, Diouf D, et al. Sexual violence against female sex workers in the Gambia: a cross-sectional examination of the associations between victimization and reproductive, sexual and mental health. BMC Public Health. 2015;15:270.
Mason K, Ketende S, Peitzmeier S, Ceesay N, Diouf D, Loum J, et al. A cross-sectional analysis of population demographics, HIV knowledge and risk behaviors, and prevalence and associations of HIV among men who have sex with men in the Gambia. AIDS Res Hum Retrovir. 2013;29:1547–52.
Grosso AL, Lei EL, Ketende SC, Peitzmeier S, Mason K, Ceesay N, et al. Correlates of condom use among female sex workers in the Gambia: results of a cross-sectional survey. PeerJ. 2015;3:e1076.
Baral S, Ketende S, Green JL, Chen P-A, Grosso A, Sithole B, et al. Reconceptualizing the HIV epidemiology and prevention needs of female sex workers (FSW) in Swaziland. PLoS One. 2014;9:e115465.
Yam EA, Mnisi Z, Maziya S, Kennedy C, Baral S. Use of emergency contraceptive pills among female sex workers in Swaziland. J Fam Plann Reprod Heal Care. 2013. https://doi.org/10.1136/jfprhc-2012-100527.
Peitzmeier S, Mason K, Ceesay N, Diouf D, Drame F, Loum J, et al. A cross-sectional evaluation of the prevalence and associations of HIV among female sex workers in the Gambia. Int J STD AIDS. 2014;25:244–52.
Yam EA, Mnisi Z, Sithole B, Kennedy C, Kerrigan DL, Tsui AO, et al. Association between condom use and use of other contraceptive methods among female sex workers in Swaziland: a relationship-level analysis of condom and contraceptive use. Sex Transm Dis. 2013;40:406–12.
Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ. Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods. 1999;4:272.
Henrich J, Heine SJ, Norenzayan A. The weirdest people in the world? Behav Brain Sci. 2010;33:61–83.
Cheung FM, van de Vijver FJR, Leong FTL. Toward a new approach to the study of personality in culture. Am Psychol. 2011;66:593.
Stahlman S, Sanchez TH, Sullivan PS, Ketende S, Lyons C, Charurat ME, et al. The prevalence of sexual behavior stigma affecting gay men and other men who have sex with men across sub-Saharan Africa and in the United States. JMIR public Heal Surveill. 2016;2:e35.
Floyd FJ, Widaman KF. Factor analysis in the development and refinement of clinical assessment instruments. Psychol Assess. 1995;7:286.
Nunnally JC, Bernstein IH. Psychometric theory (McGraw-hill series in psychology). New York: McGraw-Hill; 1994.
Uys LR, Holzemer WL, Chirwa ML, Dlamini PS, Greeff M, Kohi TW, et al. The development and validation of the HIV/AIDS stigma instrument–nurse (HASI-N). AIDS Care. 2009;21:150–9.
Kaiser HF. A second generation little jiffy. Psychometrika. 1970;35:401–15.
Bartlett MS. Tests of significance in factor analysis. Br J Stat Psychol. 1950;3:77–85.
Kaiser HF. The application of electronic computers to factor analysis. Educ Psychol Meas. 1960;20:141–51.
Horn JL. A rationale and test for the number of factors in factor analysis. Psychometrika. 1965;30:179–85.
Kim J-O, Mueller CW. Introduction to factor analysis: what it is and how to do it. Newbury Park, CA: Sage; 1978.
Costello AB, Osborne JW. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assess Res Eval. 2005;10:1–9.
Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. USA: Oxford University Press; 2015.
Putnam SP, Rothbart MK. Development of short and very short forms of the Children’s behavior questionnaire. J Pers Assess. 2006;87:102–12.
Marlow LAV, Wardle J. Development of a scale to assess cancer stigma in the non-patient population. BMC Cancer. 2014;14:285.
Little TD, Cunningham WA, Shahar G, Widaman KF. To parcel or not to parcel: exploring the question, weighing the merits. Struct Equ Model. 2002;9:151–73.
Acock AC. A gentle introduction to Stata. College Station, TX: Stata press; 2008.
Brohan E, Slade M, Clement S, Thornicroft G. Experiences of mental illness stigma, prejudice and discrimination: a review of measures. BMC Health Serv Res. 2010;10:80.
Matell MS, Jacoby J. Is there an optimal number of alternatives for Likert scale items? Study I: reliability and validity. Educ Psychol Meas. 1971;31:657–74.
Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.
Kuder GF, Richardson MW. The theory of the estimation of test reliability. Psychometrika. 1937;2:151–60.
Cohan D, Lutnick A, Davidson P, Cloniger C, Herlyn A, Breyer J, et al. Sex worker health: San Francisco style. Sex Transm Infect. 2006;82:418–22.
Ryan C, Huebner D, Diaz RM, Sanchez J. Family rejection as a predictor of negative health outcomes in white and Latino lesbian, gay, and bisexual young adults. Pediatrics. 2009;123:346–52.
Clements-Nolle K, Marx R, Katz M. Attempted suicide among transgender persons: the influence of gender-based discrimination and victimization. J Homosex. 2006;51:53–69.
Wei C, Cheung DH, Yan H, Li J, Shi L, Raymond HF. The impact of homophobia and HIV stigma on HIV testing uptake among Chinese men who have sex with men: a mediation analysis. J Acquir Immune Defic Syndr. 2016;71:87.
Stahlman S, Grosso A, Ketende S, Mothopeng T, Taruberekera N, Nkonyana J, et al. Characteristics of men who have sex with men in southern Africa who seek sex online: a cross-sectional study. J Med Internet Res. 2015;17:e129.
Dewey S, Zheng T, Orchard T. Systematic collusion: criminalization’s health and safety consequences. In: Sex workers and criminalization in North America and China. New York: Springer; 2016. p. 27–50.
Amon JJ, Wurth M, McLemore M. Evaluating human rights advocacy on criminal justice and sex work. Heal Hum Rights An Int J. 2015;17:E91.
Mgbako C. To live freely in this world: sex worker activism in Africa. New York: NYU Press; 2016.
Bauer GR. Incorporating intersectionality theory into population health research methodology: challenges and the potential to advance health equity. Soc Sci Med. 2014;110:10–7.
CARE. CHAMP: Reducing HIV/AIDS to Benefit the Socioeconomic Development of Cameroon. 2015. https://www.care.org/sites/default/files/documents/CHAMP-Brief.pdf. Accessed 8 Aug 2018.
Thomas BE, Rehman F, Suryanarayanan D, Josephine K, Dilip M, Dorairaj VS, et al. How stigmatizing is stigma in the life of people living with HIV: a study on HIV positive individuals from Chennai, South India. AIDS Care. 2005;17:795–801.
Wu X, Chen J, Huang H, Liu Z, Li X, Wang H. Perceived stigma, medical social support and quality of life among people living with HIV/AIDS in Hunan, China. Appl Nurs Res. 2015;28:169–74.
Quinn DM, Williams MK, Weisz BM. From discrimination to internalized mental illness stigma: the mediating roles of anticipated discrimination and anticipated stigma. Psychiatr Rehabil J. 2015;38:103.
Acknowledgements
The authors thank the women and men who participated in the studies, the research staff, and the community who collaborated on this project. These include AIDSETI, Association African Solidarity, Alternative Burkina, Reponsabilité, Espoir, Vie, Solidarité (REVS+) and Association Laafi la Viim (ALAVI). We also thank the Burkina Faso Ministry of Health for approving the study. We thank the team from USAID and USAID West Africa for their help in the overall success of this study. We also acknowledge Erin Papworth and Benjamin Liestman for their support in implementing these studies.
Funding
This work was supported by the USAID and Project SEARCH, Task Order No. 2, is funded by the US Agency for International Development under Contract No. GHH-I-00-0700,032-00, beginning September 30, 2008, and supported by the President’s Emergency Plan for AIDS Relief. The Research to Prevention (R2P) Project is led by the Johns Hopkins Center for Global Health and managed by the Johns Hopkins Bloomberg School of Public Health Center for Communication Programs (CCP). SDB is supported by a grant from the National Institute of Mental Health (R01 MH110358-02). The funding body had no role in the design of the study or collection, analysis, and interpretation of data or in writing the manuscript.
Availability of data and materials
The data that support the findings of this study can be requested by contacting the principal investigator, Dr. Stefan Baral, at sbaral@jhu.edu. Availability of the data is contingent upon Institutional Review Board approval.
Author information
Authors and Affiliations
Contributions
ALG led the analysis and writing of the manuscript. SCK created data entry and data management systems for each of the sites, contributed to the questionnaire development and provided input for the analysis. SS provided input for the analysis and supported the manuscript development. OK-Z was the principal investigator from the Programme d’Appui au Monde Associatif et Communautaire (PAMAC) for the Burkina Faso study. HGO supported implementation of the study in Burkina Faso. SK served as principal investigator from the Institut de Recherche en Sciences de la Santé for the Burkina Faso site. CS supported implementation of the study in Burkina Faso. ML was a co-investigator from PAMAC in Burkina Faso and supported the manuscript development by providing important guidance. JT was responsible for the supervision of data entry and management in Togo. SA was the local principal investigator and study coordinator in Togo. SD and FDN supported the implementation of the study in Togo. VP provided input and guidance on the study in Togo. SDB conceptualized the study designs and monitored study stages in all countries, as well as giving guidance on the analysis and being involved throughout the manuscript development. All authors contributed substantially to either the study design, data collection or analysis or interpretation of data; participated in drafting the article or revising it for intellectual content; and approved the final version to be published, as outlined by the ICMJE authorship criteria.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The Johns Hopkins School of Public Health Institutional Review Board, Burkina Faso Ethics Committee for Health Research, and Togo National Ethics Committee approved the study. Participants in Burkina Faso provided written informed consent in French, Mooré, or Dioula. In Togo, participants provided oral informed consent in French, Ewe or Kabiye.
Consent for publication
Not applicable
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Grosso, A.L., Ketende, S.C., Stahlman, S. et al. Development and reliability of metrics to characterize types and sources of stigma among men who have sex with men and female sex workers in Togo and Burkina Faso. BMC Infect Dis 19, 208 (2019). https://doi.org/10.1186/s12879-019-3693-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12879-019-3693-0