- Research article
- Open Access
- Open Peer Review
Quantitative evaluation of an innovation contest to enhance a sexual health campaign in China
- Received: 10 October 2017
- Accepted: 25 January 2019
- Published: 4 February 2019
Abstract
Background
Crowdsourcing method is an excellent tool for developing tailored interventions to improve sexual health. We evaluated the implementation of an innovation contest for sexual health promotion in China.
Methods
We organized an innovation contest over three months in 2014 for Chinese individuals < 30 years old to submit images for a sexual health promotion campaign. We solicited entries via social media and in-person events. The winning entry was adapted into a poster and distributed to STD clinics across Guangdong Province. In this study, we evaluated factors associated with images that received higher scores, described the themes of the top five finalists, and evaluated the acceptability of the winning entry using an online survey tool.
Results
We received 96 image submissions from 76 participants in 10 Chinese provinces. Most participants were youth (< 25 years, 85%) and non-professionals (without expertise in medicine, public health, or media, 88%). Youth were more likely to submit high-scoring entries. Images from professionals in medicine, public health, or media did not have higher scores compared to images from non-professionals. Participants were twice as likely to have learned about the contest through in-person events compared to social media. We adapted and distributed the winning entry to 300 STD clinics in 22 cities over 2 weeks. A total of 8338 people responded to an acceptability survey of the finalist entry. Among them, 79.8% endorsed or strongly endorsed being more willing to undergo STD testing after seeing the poster.
Conclusions
Innovation contests may be useful for soliciting images as a part of comprehensive sexual health campaigns in low- and middle-income countries.
Keywords
- Innovation contest
- Crowdsourcing
- Public health campaign
- Sexual health
Background
Sexual health has become an increasingly relevant and controversial topic among youth in China. More and more Chinese, particularly Chinese youth, have adopted more open attitudes toward sex and are engaging in premarital sex [1, 2]. However, sexual education in China has not evolved to meet their needs, and many young people have limited knowledge of safe sex. Surveys of adolescents and college students have shown high rates of condomless sex and limited knowledge about STD transmission and reproductive health [3–8].
Recently, researchers have implemented community outreach programs that have shown success in improving sexual health knowledge [9–11]. However, these programs can be expensive. Further, they are typically designed in a top-down approach by public health organizations or media companies without input from the community. As a result, young people may not feel comfortable or motivated to engage with them due to social stigma and differences in cultural understanding.
Innovation contests may be an effective approach to limit costs while improving engagement with sexual health campaigns. Innovation contests call upon crowd or non-expert wisdom to accomplish a task or generate new ideas [12, 13]. These contests have been used in business and computer science [14–17], as well as in public health [12, 13, 16, 18–23]. Health-focused innovation contests have increased knowledge [18, 24], reduced intervention costs [23], and improved access to health information in high-income countries [25].
However, very few studies have rigorously evaluated innovation contests in low and middle-income countries [12, 26]. Our previous research showed that an innovation contest was as effective as a social marketing approach in designing an HIV testing campaign [27]. The innovation contest also significantly decreased campaign cost and effectively engaged local communities [24].
We conducted an image contest in 201 which has described in detail elsewhere. [12]. The purpose of this contest was to solicit image submissions to promote sexual health. This study aims to evaluate the themes of the top five entries, examine correlates of higher quality images, and assess the acceptability of the winning image produced by the contest.
Methods
The crowdsourcing contest described in this study was conducted in 2014, while the online survey mentioned in this study was conducted in 2015.
Innovation contest
The overall contest last for 3 months, including the promoting campaign and 7 weeks the effective time for sending the entries. Our target audience for contest participation consisted of people in the community younger than 30 years old. First, we started and promoted the contest through an open call for images promoting sexual health on social media platforms. This included a series of posts on WeChat (a mobile text and voice messaging communication service in China, which is a Chinese hybrid between Facebook and Twitter) and Weibo (a China-based social networking and microblogging service websites, similar to Twitter). Posts were included on social media feeds of organizations focused on sexual health (e.g., lesbian, gay, bisexual, and transgender (LGBT) organizations, HIV community groups). Next, to further reach the target population, we hosted in-person events on college and high school campuses as well as the US Consulate in Guangzhou. Guangdong provincial is one of the biggest province in China with 109.7 million residents in 2017, and among of them 81.5 million people is around 18–60 years old. These included classroom presentations at universities in Guangzhou, interactive feedback sessions at the US Consulate in Guangzhou, and outreach at community-led activities.
Classroom presentations were instructional sessions led by contest organizers to present the contest mission and criteria as well as to answer sexual health questions. Interactive feedback sessions were activities implemented by contest organizers along with community-based organizations and student groups to provide feedback about potential entries prior to submission. Outreach at community-led activities consisted of a brief announcement and call for submissions given by contest organizers at events held by local community-based organizations, such as speed dating or matchmaking (see Additional file 1: Table S1).
The incentives to promote contest participation included a range of prizes (First prize: 750 USD in cash, second prize: a Kindle (about 150 USD), third prize: a camera (about 60 USD)). Furthermore, final entries would be displayed in an open entry photograph gallery in Guangzhou.
Judging was conducted in two phases. The main criteria were 1) relevance to sexual health promotion and 2) capacity to interest youth in China. First, each eligible image was independently assessed by three non-expert voluntaries which were recruited through WeChat. Then, we recruited 18 expert judges in the fields of medicine, public health, and media through local contacts and community-based organizations. The remaining images were independently evaluated on a scale of 0–10 by three of the expert judges. Personal identifiers were removed from all images to prevent bias. The mean score from the three judges was used to rank the submissions. Finally, we celebrated the submissions and community contributions through an interactive award ceremony on World AIDS Day in 2014 [12].
Participant demographics and data collection
Individuals living in China aged 30 and under were eligible to participate in the image contest. All participants submitted demographic details upon submission, including age, the province of residence, means of learning about the contest (i.e., through social media or in-person events), whether or not they were experts in public health, medicine, media, or related fields.
Campaign implementation
Following the conclusion of the contest, we obtained permission from winner to use the winning submission. This submission was adapted for local intervention campaigns for promoting sexual health in Shandong and Guangdong provinces. Additionally, the winner also redesigned the finalist entry as a poster which was displayed in 300 STD clinics in 22 cities in Guangdong province over the course of two weeks. The poster was also displayed on the SESH website and SESH WeChat moment.
Online poster evaluation survey
Each poster of the winning entry contained a QR code which led to an online acceptability survey, which was open for one month. Anyone who saw a poster could scan the QR code and participate in the survey. Each participant’s IP address and WeChat ID was recorded, so that each person could only submit the survey once. To be eligible for the survey, the participants had to be at least 15 years of age. At the end of the survey, each participant could play an online raffle game to earn 0 to 1 USD, which served as an incentive for survey participation.
The goal of the survey was to evaluate the acceptability of the single finalist entry and to collect feedback on the poster from the viewers. The survey contained questions about the demographic information of participants, their attitudes toward the poster, and their willingness to have more STD/HIV related knowledge, and their willingness to have an STD/HIV test after seeing the poster. The response options consisted of a 5-point Likert Scale, where 1 was indicated as strong disagreement and 5 was defined as strong agreement. Participants could also forward the survey to their friends.
Analysis
Data were cleaned and recoded using Microsoft Excel 2008 and analyses were performed using SPSS 21.0. We coded several characteristics of the submissions: multi-panel (consisting of multiple images in a single submission) or not, photography or not, drawn image or not, language used (Chinese, English, or both), and timing of submission. We then used descriptive analysis to analyze socio-demographic characteristics of the contest submitters and characteristics of the submissions, including the language used, drawn images versus photography, and a presence of text. We also described the themes, messages, and images on the top five contest submissions.
Multivariable linear generalized estimating equation (GEE) with unstructured correlation matrix was used in order to evaluate the correlates associated with higher image scores [28]. We used a mixed-effects linear regression model to adjust the non-zero-image scores by accounting for heterogeneity of scores among judges. Then we used the paired Wilcoxon signed-rank test to compare the difference between median adjusted and unadjusted scores. Lastly, we used descriptive analysis to evaluate the attitudes of the STD clinics attendees towards the poster as well as the effectiveness of the poster in improving their knowledge of STDs and their willingness to pursue future STD/HIV testing.
Results
Characteristics of image contest participants and entries
Social and Demographic Characteristics of Contest Participants and Characteristics of Images from Sexual Health Image Contest, China 2014
Variables | No. of Individuals/images | (%) |
|---|---|---|
Social and Demographic Characteristics of Contest Participants(n = 76) | ||
Age | ||
Mean ± SD [Range] | 20.0 ± 3.5 [16–30] | |
Location | ||
Guangdong Province | 65 | (85.5) |
Outside Guangdong Province | 11 | (14.5) |
Sexual health expert or nota | ||
Yes | 9 | (11.8) |
No | 67 | (88.2) |
Attended in-person eventb | ||
Yes | 57 | (75.0) |
No | 19 | (25.0) |
Aware of contest through | ||
5 | (6.6) | |
10 | (13.2) | |
Friend | 18 | (23.7) |
In-person events | 40 | (52.6) |
Others | 3 | (3.9) |
Willing to hear about future contests | ||
Yes | 51 | (67.1) |
No | 25 | (32.9) |
Characteristics of Images (n = 96) | ||
Average score | ||
Mean ± SD | 4.53 ± 2.44 | |
Language used | ||
Chinese | 49 | (51.0) |
English | 30 | (31.3) |
English +Chinese | 17 | (17.7) |
Photo image | ||
Yes | 20 | (20.8) |
No | 76 | (79.2) |
Multiple panels | ||
Yes | 80 | (83.3) |
No | 16 | (16.7) |
Drawn images | ||
Yes | 45 | (46.9) |
No | 51 | (53.1) |
Words included or not | ||
Yes | 67 | (69.8) |
No | 29 | (30.2) |
Seventy-five percent of participants attended in-person events hosted by our team or a community partner (Table 1). Participants most often heard about the contest through in-person events (n = 40, 52.6%), followed by friends (n = 18, 23.7%), WeChat postings (n = 10, 13.2%), Weibo (n = 5, 6.6%), and other methods (n = 3, 3.9%) (Table 1).
The mean overall score of the entries was 4.5 with a standard deviation of 2.4 and a range of 0 to 8.9. Of the 96 images, 49 (51.0%) used only Chinese language, 30 (31.3%) used English only and 17 (17.7%) used both. Sixty-seven (69.8%) submissions used a combination of words with images. Forty-five (46.9%) submissions contained a drawn image. Overall, around four-fifths (83.3%) of images contained multiple panels (a single entry with a series of two or more images). 65 images (67.7%) were submitted during the final week of the contest.
Description of the top five entries of the image contest
Themes developed by Images from Sexual Health Image Contest, China 2014
Correlates of image quality
Summary of Multivariate GEE Analyses: Final Score by Socio-demographics Characteristics of Submitters and Characteristics of Images, China 2014 (n = 96)
Wald Chi-square | B (95% CI) | P value | |
|---|---|---|---|
Age | 5.769 | − 0.16 (− 0.26, − 0.027) | 0.016 |
Attended in-person event | |||
No | Ref | Ref | Ref |
Yes | 6.389 | 1.29 (0.29, 2.29) | 0.01 |
Sexual health experts or not | |||
Yes | Ref | Ref | Ref |
No | 1.809 | 1.23 (0.56, 3.03) | 0.179 |
Photo image | |||
Yes | Ref | Ref | Ref |
No | 28.181 | 3.15 (1.99, 4.32) | < 0.001 |
Drawn image | |||
No | Ref | Ref | Ref |
Yes | 4.565 | 0.96 (0.079, 1.84) | 0.033 |
Acceptability of the single finalist entry from an online survey
Overall, 8343 respondents participated in the online evaluation survey. The ages of participants ranged from 16 to 80 years, with a mean age of 28.0 ± 3.5. Among them, 2665/8343 (31.9%) of respondents saw the finalist poster in an STD clinic and the remaining (68.1%) saw the finalist poster online. The single finalist entry is shown in Table 2 (first figure).
Summary of Likert Scale evaluation from an online survey in China, 2016 (N = 8338)
Variables | Strongly endorse | Endorse | I don’t know | Do not endorse | Strongly do not endorse |
|---|---|---|---|---|---|
Attitude towards the poster | 3585(43.0%) | 3622(43.4%) | 876(10.5%) | 186(2.2%) | 69(0.8%) |
Willingness of knowing more STD related knowledge | 4003(48.0%) | 3028(36.3%) | 932(11.2%) | 270(3.2%) | 105(1.3%) |
Willingness of doing STD/HIV test | 3598(43.2%) | 3052(36.6%) | 1062(12.7%) | 410(4.9%) | 216(2.6%) |
The online survey also collected open-ended feedback from participants. Recurrent themes in feedback included: 1) the graphic on the poster was innovative, attractive at first glance, and interesting; 2) the poster was thought provoking; 3) the poster could be improved through using fewer words; 4) the subject of the poster was too general; and 5) the poster could be put in public places rather than only in STD clinics.
Discussion
Our study evaluated the quality, characteristics, and acceptability of sexual health campaign images solicited by an innovation contest. Previous literature has shown that innovation contests may be useful in promoting sexual health campaigns. [18, 24] Previous work from our group has shown that implementing an innovation contest for a sexual health campaign effectively improved community engagement and resulted in a more patient-focused campaign 17. Our work confirms the utility and effectiveness of innovation contests in sexual health campaigns, and expands the existing literature by examining qualities of the finalist entries, quantitatively exploring correlates of high-quality entries, and evaluating the acceptability of the winning entry through an online public survey.
Our study found that youth under age 25 were more likely to submit high-quality entries compared to older individuals (age 25–30) in this our contest. This finding is consistent with other contest literature showing high-quality youth participation [29]. Previous research has examined youth participation in business contests [29] and assessed the impact of youth as peer counselors for HIV/STD interventions [30–34]. Our research further supports the importance of engaging youth in sexual health efforts. We also found that youth who actively attended in-person events were more likely to submit high-quality images and join our celebratory activities. This highlights the importance of holding in-person events in future innovation contests.
Importantly, we found that there was no difference between scores of experts (i.e. employed in the fields of medicine, public health, or media) and non-expert entries. Nine out of the top ten entries were submitted by non-experts. This is consistent with the concept of crowd wisdom [35, 36] and a broader business literature showing how non-expert work can generate innovative, useful ideas [17, 21]. This finding supports the use of innovation contests to engage non-experts in sexual health campaigns [37–40]. Future qualitative research would be helpful in understanding how to distribute campaign responsibilities between experts and non-experts.
The winning image from our contest was successfully scaled up and displayed in 121 public STI clinics as part of a province-wide sexual health campaign over the course of two weeks. The majority of the survey respondents found the winning image acceptable and engaging, with 43% of respondents strongly endorsing and 43.4% of respondents endorsing approval of the image. Additionally, 43.2% of respondents strongly endorsed and 36.6% of patients endorsed a greater likelihood to seek out STD testing after seeing the winning image. One potential explanation for high acceptability of the final image is that the use of a community-based crowdsourcing approach solicits inclusion of different perspectives, and may often be more in tune with the perspectives of lay persons. Sexual health campaigns are inherently difficult to carry out due to associated cultural stigma and fear of discrimination, and innovation contests can help solicit campaign messages that are culturally sensitive and acceptable. The feedback given on the survey further supported this notion, as many viewers indicated that the crowdsourced images made a sensitive topic more approachable [41].
Our study also supports the existing literature on the efficiency of innovation contests. Previous studies have indicated that innovation contests can generate cost-effective solutions for interventions with quick turn-around times [23]. In this image-generation contest, we successfully crowd-sourced around 100 images from participants in a one-month period, and we implemented the winning entry throughout STD clinics in Guangdong province within 2 weeks. This ability to generate multiple campaign options on an expedited schedule is highly advantageous for the development of effective and timely outreach campaigns for public health. Partnering with community organizations also allows knowledge of the campaigns to spread throughout the community, thereby enhancing the campaign’s reach both before and after implementation. Finally, innovation contests are easy to organize and modify for applications in multiple health campaigns, and they require much fewer resources than traditional social marketing or social media campaigns [23].
There were several limitations to our study. First, all in-person events were held in urban centers in Guangdong province. Generally, young people in urban centers are technologically savvy and eager to engage with community campaigns. We received much fewer submissions from rural areas, and while increasing in-person events in rural settings may improve engagement, it is also possible that young people living in rural areas may not have comparable resources or interest in participating in an innovation contest. Secondly, Guangdong also has a high burden of STDs [42]. Despite limited sexual health education for young people, its residents generally hold more liberal views of sex than residents of other provinces [43]. Thus, young people might feel more comfortable and motivated to engage with an innovation contest in Guangdong as compared to other provinces. Third, the results of our acceptability survey are only descriptive. We did not evaluate the response to the winning campaign images against a campaign image developed by a traditional social marketing company. And finally, the results of our acceptability survey provide only the opinions of the respondents, and not their behaviors. We did not measure the rate of STD testing to evaluate if the campaign materials influenced their viewers’ decisions to proceed with STD testing. Future work should compare the campaign solicited by an innovation contest with a campaign designed by a traditional social marketing agency, as well as evaluate any behavioral changes (i.e. increase in STD testing) after exposure to an innovation contest-produced sexual health campaign.
Conclusions
Our study raises several policy and public health implications for HIV/STD prevention and awareness campaigns. It advocates for engaging youth in the community. Further, our study showed that in-person events, in addition to social media events, are important facilitators for generating higher-quality solutions. Future sexual health campaigns should incorporate face-to-face interactions where participants can ask questions and solicit feedback about their submission ideas. Importantly, submissions from non-experts accounted for the majority of the top ten entries, highlighting the utility of engaging non-expert audiences. Our survey of the winning campaign image also showed high acceptability of the campaign and a high self-reported rate of increased likelihood to pursue STD testing after viewing the campaign. Additional research comparing outcomes from the campaigns from innovation contests and traditional social marketing is needed to demonstrate the effectiveness of innovation contests. These studies would bolster confidence on the application of innovation contests to future sexual health campaigns.
Abbreviations
- HIV:
-
Human Immunodeficiency virus
- LGBT:
-
Lesbian, gay, bisexual, and transgender
- STD:
-
Sexually transmitted diseases
- USD:
-
US dollars
Declarations
Acknowledgements
We thank all those who judged and participated in our contest. We also thank staff members at SESH Global, and the Guangdong Provincial Centers for Skin Diseases and STI Control for their respective contributions.
Ethical approval and consent to participate
This study was approved by the University of North Carolina Chapel Hill School of Medicine institutional review board (IRB No. 14–1865) and Guangdong Provincial Center for Skin Diseases and STI control institutional review board (IRB No. 5100477). Online informed consent was obtained from all individual participants in the study.
Funding
This work was supported by National Institutes of Health [National Institute of Allergy and Infectious Diseases 1R01AI114310–01 and P30AI050410]; UNC-South China STD Research Training Centre [Fogarty International Centre 1D43TW009532–01 to JT], the UNC Chapel Hill, Johns Hopkins University, Morehead School of Medicine and Tulane University (UJMT) Fogarty Fellowship [FIC R25TW0093 to WT], and the Bill & Melinda Gates Foundation to the MeSH Consortium (BMGF-OPP1120138). The grant funders played no role in any step of this study.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Authors’ contributions
YZ, ST, LT and WT drafted this manuscript, KL, BB, DG, BY, HZ, CW and JT collected the data, helped the data analysis and reviewed this manuscript, and JT concepted this study.
Consent for publication
Not Applicable.
Competing interests
The authors declare that they have no conflict of interest. Dr. Weiming Tang is an associate editor of BMC Infectious Diseases; and Dr. Joseph D. Tucker is a section editor of BMC Infectious Diseases.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Authors’ Affiliations
References
- Wang H, Chen B, Xu Y, Miao Q, Wu Z, Ju Q, Huang Y. View changes and educational demands on sexual/reproductive health of students at Shanghai Jiaotong University. Int J Clin Exp Med. 2015;8(9):16414–23.PubMedPubMed CentralGoogle Scholar
- Yu J. An overview of the sexual behaviour of adolescents and young people in contemporary China. Australasian Medical Journal. 2010;3(7):397–403.View ArticleGoogle Scholar
- Ma Q, Ono-Kihara M, Cong L, Xu G, Zamani S, Ravari SM, Kihara M. Sexual behavior and awareness of Chinese university students in transition with implied risk of sexually transmitted diseases and HIV infection: a cross-sectional study. BMC Public Health. 2006;6:232–2.Google Scholar
- Li S, Chen R, Cao Y, Li J, Zuo D, Yan H. Sexual knowledge, attitudes and practices of female undergraduate students in Wuhan, China: the only-child versus students with siblings. PLoS One. 2013;8(9):e73797.View ArticleGoogle Scholar
- Chen M, Liao Y, Liu J, Fang W, Hong N, Ye X, Li J, Tang Q, Pan W, Liao W. Comparison of sexual knowledge, attitude, and behavior between female Chinese college students from urban areas and rural areas: a hidden challenge for HIV/AIDS control in China. Biomed Res Int. 2016;2016:10.Google Scholar
- Chen Y, Lei X, Yi J, Yao S. Increasing high-risk sexual behavior among adolescents in 10 Cities of China. Annals of Psychiatry and Mental Health. 2017;5(3):1100–06.Google Scholar
- China NHaFPCo: 2015 China AIDS Response Progress Report 2015.Google Scholar
- Zou H, Hu N, Xin Q, Beck J. HIV testing among men who have sex with men in China: a systematic review and meta-analysis. AIDS Behav. 2012;16(7):1717–28.View ArticleGoogle Scholar
- Chi X, Hawk ST, Winter S, Meeus W. The effect of comprehensive sexual education program on sexual health knowledge and sexual attitude among college students in Southwest China. Asia Pacific Journal of Public Health. 2015;27(2):NP2049–66.View ArticleGoogle Scholar
- C-h L, Zhao Q, Gao E-S, Shah IH. Can the internet be used effectively to provide sex education to young people in China? J Adolesc Health. 2006;39(5):720–8.View ArticleGoogle Scholar
- Wang B, Hertog S, Meier A, Lou C, Gao E. The potential of comprehensive sex education in China: findings from suburban Shanghai. Int Fam Plan Perspect. 2005;31(2):63–72.View ArticleGoogle Scholar
- Zhang Y, Kim JA, Liu F, Tso LS, Tang W, Wei C, Bayus BL, Tucker JD. Creative contributory contests to spur innovation in sexual health: 2 cases and a guide for implementation. Sex Transm Dis. 2015;42(11):625–8.View ArticleGoogle Scholar
- Bayus BL. Crowdsourcing new product ideas over time: an analysis of the Dell IdeaStorm community. Manag Sci. 2013;59(1):226–44.View ArticleGoogle Scholar
- Shao B, Shi L, Xu B, Liu L. Factors affecting participation of solvers in crowdsourcing: an empirical study from China. Electron Mark. 2012;22(2):73–82.View ArticleGoogle Scholar
- Terwiesch C, Xu Y. Innovation contests, open innovation, and multiagent problem solving. Manag Sci. 2008;54(9):1529–43.View ArticleGoogle Scholar
- Digmayer C, Jakobs E-M. Help features in community-based open innovation contests. Multimodal video tutorials for the elderly. Proceedings of the 30th ACM international conference on Design of communication: 2012: ACM. 2012:79–88.Google Scholar
- Füller J, Hutter K, Hautz J, Matzler K. User roles and contributions in innovation-contest communities. J Manag Inf Syst. 2014;31(1):273–308.View ArticleGoogle Scholar
- Woods M, Anderson L, Rosenberg M. Inspiring innovation in medical education. Minn Med. 2014;97(9):47–8.PubMedGoogle Scholar
- Mick J. Promoting clinical inquiry and evidence-based practice: the sacred cow contest strategy. J Nurs Adm. 2011;41(6):280–4.View ArticleGoogle Scholar
- Lozano dHM, Armalé CM, Risco OM, Martes LC: [Education by participating in a diabetic food contest]. Revista de enfermeria (Barcelona, Spain) 2000, 23(9):570–574.Google Scholar
- Bullinger AC, Neyer AK, Rass M, Moeslein KM. Community-based innovation contests: where competition meets cooperation. Creat Innov Manag. 2010;19(3):290–303.View ArticleGoogle Scholar
- Brabham DC, Ribisl KM, Kirchner TR, Bernhardt JM. Crowdsourcing applications for public health. Am J Prev Med. 2014;46(2):179–87.View ArticleGoogle Scholar
- Tang W, Han L, Best J, Zhang Y, Mollan K, Kim J, Liu F, Hudgens M, Bayus B, Terris-Prestholt F, et al. Crowdsourcing HIV test promotion videos: a noninferiority randomized controlled trial in China. Clin Infect Dis. 2016;62(11):1436–42.View ArticleGoogle Scholar
- Merchant RM, Griffis HM, Ha YP, Kilaru AS, Sellers AM, Hershey JC, Hill SS, Kramer-Golinkoff E, Nadkarni L, Debski MM. Hidden in plain sight: a crowdsourced public art contest to make automated external defibrillators more visible. Am J Public Health. 2014;104(12):2306–12.View ArticleGoogle Scholar
- Social Innovations for Health Equity [www.vichealth.vic.gov.au/funding/social-innovations-for-health-equity].
- Zhang W, Schaffer D, Tso LS, Tang S, Tang W, Huang S, Yang B, Tucker JD. Innovation contests to promote sexual health in China: a qualitative evaluation. BMC Public Health. 2017;17(1):78.View ArticleGoogle Scholar
- Das A, Li J, Zhong F, Ouyang L, Mahapatra T, Tang W, Fu G, Zhao J, Detels R. Factors associated with HIV and syphilis co-infection among men who have sex with men in seven Chinese cities. Int J STD AIDS. 2015;26(3):145–55.View ArticleGoogle Scholar
- Hanley JA, Negassa A, Forrester JE. Statistical analysis of correlated data using generalized estimating equations: an orientation. Am J Epidemiol. 2003;157(4):364–75.View ArticleGoogle Scholar
- Ideas for Action Youth Competition 2015 by World Bank Group and the Wharton School [http://opportunitydesk.org/2015/01/06/ideas-for-action-youth-competition-2015-by-world-bank-group-and-the-wharton-school/].
- Bull SS, Levine DK, Black SR, Schmiege SJ, Santelli J. Social media–delivered sexual health intervention: a cluster randomized controlled trial. Am J Prev Med. 2012;43(5):467–74.View ArticleGoogle Scholar
- Danielson CK, McCauley JL, Jones A, Borkman AO, Miller S, Ruggiero KJ. Feasibility of delivering evidence-based HIV/STI prevention programming to a community sample of African-American teen girls via the internet. AIDS education and prevention: official publication of the International Society for AIDS Education. 2013;25(5):394–404.View ArticleGoogle Scholar
- DiClemente RJ, Wingood GM, Harrington KF, Lang DL, Davies SL, Hook EW III, Oh MK, Crosby RA, Hertzberg VS, Gordon AB. Efficacy of an HIV prevention intervention for African American adolescent girls: a randomized controlled trial. Jama. 2004;292(2):171–9.View ArticleGoogle Scholar
- Black SR, Schmiege S, Bull S. Actual versus perceived peer sexual risk behavior in online youth social networks. Translational behavioral medicine. 2013;3(3):312–9.View ArticleGoogle Scholar
- Hightow-Weidman LB, Muessig KE, Pike EC, LeGrand S, Baltierra N, Rucker AJ, Wilson P. HealthMpowerment. Org building community through a Mobile-optimized, online health promotion intervention. Health Educ Behav. 2015;42(4):493–9.View ArticleGoogle Scholar
- Galton F. Vox populi. Nature. 1907;75:450–1.View ArticleGoogle Scholar
- Suroweicki J. The wisdom of crowds. New York, USA: Anchor Books; 2005.Google Scholar
- Yang Y, Chen P, Banker R. Impact of past performance and strategic bidding on winner determination of open innovation contest. Workshop on Information Systems and Economics (WISE 2010): 2010. 2010:11–2.Google Scholar
- Yang Y, P-y C, Pavlou P. Managing open innovation contests in online market: Working paper, Temple University; 2010.Google Scholar
- Gong J, Li L, Wang H, Tang W, Yang H, Zhang Y. Correlated factors of hepatitis C virus infection among injection drug users. Pharm Biotechnol. 2011;1:61–5.Google Scholar
- Wooten JO: Innovation Tournaments: Improving Ideas through Process Models. dissertation. University of Pennsylvania; 2013.Google Scholar
- Cao H, He N, Jiang Q, Yang M, Liu Z, Gao M, Ding P, Chen L, Detels R. Stigma against HIV-infected persons among migrant women living in Shanghai, China. AIDS Educ Prev. 2010;22(5):445–54.View ArticleGoogle Scholar
- HS-j CL, Xuan H, Hong-cheng S, Li-gang T W-m Y, He-ping Z, Bin Y. Epidemiological situation of sexually transmitted diseases in Guangdong Province in. Journal of Diagnosis and Therapy on Dermato-venereology 2015. 2013;1(1):62–6.Google Scholar
- Cheng W, Cai Y, Tang W, Zhong F, Meng G, Gu J, Hao C, Han Z, Li J, Das A. Providing HIV-related services in China for men who have sex with men. Bull World Health Organ. 2016;2016(94):222–7.View ArticleGoogle Scholar
