Robin Stevens
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Robin Stevens has a total of 63 co-authors. Here are the top co-authors by number of shared publications:
- Stephen Bonett
School of Nursing, University of Pennsylvania, Philadelphia, Pennsylvania, USA
7 shared publications - Jose Artruro Bauermeister
School of Nursing, University of Pennsylvania, Philadelphia, USA
5 shared publications - Bridgette M. Brawner
M. Louise Fitzpatrick College of Nursing, Villanova University, Villanova, Pennsylvania, USA
4 shared publications - Graciela Gonzalez-Hernandez
Department of Computational Biomedicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA
4 shared publications - Jacqueline Bannon
Division of Infetious Disease, Northwestern University, 645 N Michigan Avenue, Chicago, IL, 60611, United States, +1 312-695-2373
4 shared publications - Karen O'COnnor
Perelman School of Medicine, University of Pennsylvania
4 shared publications
Latest Publications
- 1 October 2025
- Published by American Psychological Association (APA) in Cultural Diversity & Ethnic Minority Psychology
- Vol. 31 (4) , 699-710
Multilevel sources of strength and school-based racial discrimination: Competing factors associated with mental health among African American college students.
Despite increasing diversity on predominantly White college campuses, African American college students remain subject to racial discrimination, creating a complex array of mental health stressors. In this study, we adopted a strengths-based approach to mental health in this population and investigated (a) whether school-based discrimination contributes to negative mental health outcomes; (b) whether internal, interpersonal, and campus sources of strength contribute to positive mental health outcomes; and (c) whether internal sources of strength moderate the mental health effects of discrimination. Secondary analysis was performed on public data from African American college students (N = 1,444; Mage = 24.67, SDage = 7.87) who participated in the Healthy Minds Study between 2017 and 2020. Healthy Minds Study is a cross-sectional survey examining mental health factors in U.S. university student populations. School-based racial discrimination was negatively associated with flourishing and positively associated with depression. Flourishing was positively associated with all sources of strength, including academic persistence, religiosity, racial identity, race-based affinity space involvement, and campus climate for diversity. Depression was inversely associated with persistence, religiosity, and affinity space involvement. Except for persistence, internal sources of strength did not mitigate the negative effects of discrimination on mental health outcomes. Policies are needed that hold accountable campus members who perpetrate race-based aggressions, tangible support systems involving African American mentors and cultural affinity groups, and strengths-based audits of students seeking mental health care. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
- 1 October 2025
- Published by American Psychological Association (APA) in Cultural Diversity & Ethnic Minority Psychology
- Vol. 31 (4) , 699-710
Multilevel sources of strength and school-based racial discrimination: Competing factors associated with mental health among African American college students.
Despite increasing diversity on predominantly White college campuses, African American college students remain subject to racial discrimination, creating a complex array of mental health stressors. In this study, we adopted a strengths-based approach to mental health in this population and investigated (a) whether school-based discrimination contributes to negative mental health outcomes; (b) whether internal, interpersonal, and campus sources of strength contribute to positive mental health outcomes; and (c) whether internal sources of strength moderate the mental health effects of discrimination. Secondary analysis was performed on public data from African American college students (N = 1,444; Mage = 24.67, SDage = 7.87) who participated in the Healthy Minds Study between 2017 and 2020. Healthy Minds Study is a cross-sectional survey examining mental health factors in U.S. university student populations. School-based racial discrimination was negatively associated with flourishing and positively associated with depression. Flourishing was positively associated with all sources of strength, including academic persistence, religiosity, racial identity, race-based affinity space involvement, and campus climate for diversity. Depression was inversely associated with persistence, religiosity, and affinity space involvement. Except for persistence, internal sources of strength did not mitigate the negative effects of discrimination on mental health outcomes. Policies are needed that hold accountable campus members who perpetrate race-based aggressions, tangible support systems involving African American mentors and cultural affinity groups, and strengths-based audits of students seeking mental health care. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-10
Building a Better Social Media Platform: Can We Codesign With Equity in Mind?
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-10
Open AccessBuilding a Better Social Media Platform: Can We Codesign With Equity in Mind?
- Open Access
- 13 August 2024
- Published by JMIR Publications Inc. in JMIR Public Health and Surveillance
- Vol. 10 (1) , e59193
Mpox Discourse on Twitter by Sexual Minority Men and Gender-Diverse Individuals: Infodemiological Study Using BERTopic
Background: The mpox outbreak resulted in 32,063 cases and 58 deaths in the United States and 95,912 cases worldwide from May 2022 to March 2024 according to the US Centers for Disease Control and Prevention (CDC). Like other disease outbreaks (eg, HIV) with perceived community associations, mpox can create the risk of stigma, exacerbate homophobia, and potentially hinder health care access and social equity. However, the existing literature on mpox has limited representation of the perspective of sexual minority men and gender-diverse (SMMGD) individuals. Objective: To fill this gap, this study aimed to synthesize themes of discussions among SMMGD individuals and listen to SMMGD voices for identifying problems in current public health communication surrounding mpox to improve inclusivity, equity, and justice. Methods: We analyzed mpox-related posts (N=8688) posted between October 2020 and September 2022 by 2326 users who self-identified on Twitter/X as SMMGD and were geolocated in the United States. We applied BERTopic (a topic-modeling technique) on the tweets, validated the machine-generated topics through human labeling and annotations, and conducted content analysis of the tweets in each topic. Geographic analysis was performed on the size of the most prominent topic across US states in relation to the University of California, Los Angeles (UCLA) lesbian, gay, and bisexual (LGB) social climate index. Results: BERTopic identified 11 topics, which annotators labeled as mpox health activism (n=2590, 29.81%), mpox vaccination (n=2242, 25.81%), and adverse events (n=85, 0.98%); sarcasm, jokes, and emotional expressions (n=1220, 14.04%); COVID-19 and mpox (n=636, 7.32%); government or public health response (n=532, 6.12%); mpox symptoms (n=238, 2.74%); case reports (n=192, 2.21%); puns on the naming of the virus (ie, mpox; n=75, 0.86%); media publicity (n=59, 0.68%); and mpox in children (n=58, 0.67%). Spearman rank correlation indicated significant negative correlation (ρ=–0.322, P=.03) between the topic size of health activism and the UCLA LGB social climate index at the US state level. Conclusions: Discussions among SMMGD individuals on mpox encompass both utilitarian (eg, vaccine access, case reports, and mpox symptoms) and emotionally charged (ie, promoting awareness, advocating against homophobia, misinformation/disinformation, and health stigma) themes. Mpox health activism is more prevalent in US states with lower LGB social acceptance, suggesting a resilient communicative pattern among SMMGD individuals in the face of public health oppression. Our method for social listening could facilitate future public health efforts, providing a cost-effective way to capture the perspective of impacted populations. This study illuminates SMMGD engagement with the mpox discourse, underscoring the need for more inclusive public health programming. Findings also highlight the social impact of mpox: health stigma. Our findings could inform interventions to optimize the delivery of informational and tangible health resources leveraging computational mixed-method analyses (eg, BERTopic) and big data.
- 13 August 2024
- Published by JMIR Publications Inc. in JMIR Public Health and Surveillance
- Vol. 10 (1) , e59193
Open AccessMpox Discourse on Twitter by Sexual Minority Men and Gender-Diverse Individuals: Infodemiological Study Using BERTopic
Background: The mpox outbreak resulted in 32,063 cases and 58 deaths in the United States and 95,912 cases worldwide from May 2022 to March 2024 according to the US Centers for Disease Control and Prevention (CDC). Like other disease outbreaks (eg, HIV) with perceived community associations, mpox can create the risk of stigma, exacerbate homophobia, and potentially hinder health care access and social equity. However, the existing literature on mpox has limited representation of the perspective of sexual minority men and gender-diverse (SMMGD) individuals. Objective: To fill this gap, this study aimed to synthesize themes of discussions among SMMGD individuals and listen to SMMGD voices for identifying problems in current public health communication surrounding mpox to improve inclusivity, equity, and justice. Methods: We analyzed mpox-related posts (N=8688) posted between October 2020 and September 2022 by 2326 users who self-identified on Twitter/X as SMMGD and were geolocated in the United States. We applied BERTopic (a topic-modeling technique) on the tweets, validated the machine-generated topics through human labeling and annotations, and conducted content analysis of the tweets in each topic. Geographic analysis was performed on the size of the most prominent topic across US states in relation to the University of California, Los Angeles (UCLA) lesbian, gay, and bisexual (LGB) social climate index. Results: BERTopic identified 11 topics, which annotators labeled as mpox health activism (n=2590, 29.81%), mpox vaccination (n=2242, 25.81%), and adverse events (n=85, 0.98%); sarcasm, jokes, and emotional expressions (n=1220, 14.04%); COVID-19 and mpox (n=636, 7.32%); government or public health response (n=532, 6.12%); mpox symptoms (n=238, 2.74%); case reports (n=192, 2.21%); puns on the naming of the virus (ie, mpox; n=75, 0.86%); media publicity (n=59, 0.68%); and mpox in children (n=58, 0.67%). Spearman rank correlation indicated significant negative correlation (ρ=–0.322, P=.03) between the topic size of health activism and the UCLA LGB social climate index at the US state level. Conclusions: Discussions among SMMGD individuals on mpox encompass both utilitarian (eg, vaccine access, case reports, and mpox symptoms) and emotionally charged (ie, promoting awareness, advocating against homophobia, misinformation/disinformation, and health stigma) themes. Mpox health activism is more prevalent in US states with lower LGB social acceptance, suggesting a resilient communicative pattern among SMMGD individuals in the face of public health oppression. Our method for social listening could facilitate future public health efforts, providing a cost-effective way to capture the perspective of impacted populations. This study illuminates SMMGD engagement with the mpox discourse, underscoring the need for more inclusive public health programming. Findings also highlight the social impact of mpox: health stigma. Our findings could inform interventions to optimize the delivery of informational and tangible health resources leveraging computational mixed-method analyses (eg, BERTopic) and big data.
- Open Access
- 30 July 2024
- Published by Springer Nature in BMC Digital Health
- Vol. 2 (1) , 1-10
From virus to viral: content analysis of HIV-related Twitter messages among young men in the U.S.
Background: Adolescents and young adults account for over 21% of new HIV infections in the U.S. with most new cases among young men. As an important information source for this group, social media can uniquely reveal the perspectives and communicative patterns of this key population. We identified 6,439 young male Twitter users (ages 13–24) in the U.S. using an NLP pipeline with geolocations. From their Twitter timelines, we collected 24,600 HIV-related tweets, among which the most retweeted and favorited tweets (n = 472) were analyzed through a content analysis. Results: Three themes arose in this online viral discourse around HIV among young men: (i) othering, (ii) politics and activism, (iii) risk and wellness. Othering tweets contained stigmatizing jokes and insults alienating individuals who identify as lesbian, gay, bisexual, transgender, queer or questioning, intersex, asexual, or being elsewhere on the gender and sexuality spectrum (LGBTQIA +), and people with HIV. Politics and activism tweets discussed awareness, stigma, HIV criminalization, violence, LGBTQIA + , and women’s rights. Risk and wellness tweets discussed risk behaviors for sexually transmitted infections (STIs) (e.g., condomless sex, transactional sex, multiple sexual partners), or safer sex and preventive practices (e.g., pre-exposure prophylaxis [PrEP], condom use, achieving undetectable viral load, medication adherence, and STI testing). Conclusion: The social acceptability of high-risk sex behaviors is high among young male Twitter users. Given the double-edged nature of social media—health-promoting (e.g., awareness, health activism) as well as risk-promoting (e.g., risky behavior endorsement, identity attacks)— this population may benefit from targeted health communication intervention. Future HIV prevention efforts should counter the stigma, misinformation, and risk-promoting viral messages prevalent on social media.
- 30 July 2024
- Published by Springer Nature in BMC Digital Health
- Vol. 2 (1) , 1-10
Open AccessFrom virus to viral: content analysis of HIV-related Twitter messages among young men in the U.S.
Background: Adolescents and young adults account for over 21% of new HIV infections in the U.S. with most new cases among young men. As an important information source for this group, social media can uniquely reveal the perspectives and communicative patterns of this key population. We identified 6,439 young male Twitter users (ages 13–24) in the U.S. using an NLP pipeline with geolocations. From their Twitter timelines, we collected 24,600 HIV-related tweets, among which the most retweeted and favorited tweets (n = 472) were analyzed through a content analysis. Results: Three themes arose in this online viral discourse around HIV among young men: (i) othering, (ii) politics and activism, (iii) risk and wellness. Othering tweets contained stigmatizing jokes and insults alienating individuals who identify as lesbian, gay, bisexual, transgender, queer or questioning, intersex, asexual, or being elsewhere on the gender and sexuality spectrum (LGBTQIA +), and people with HIV. Politics and activism tweets discussed awareness, stigma, HIV criminalization, violence, LGBTQIA + , and women’s rights. Risk and wellness tweets discussed risk behaviors for sexually transmitted infections (STIs) (e.g., condomless sex, transactional sex, multiple sexual partners), or safer sex and preventive practices (e.g., pre-exposure prophylaxis [PrEP], condom use, achieving undetectable viral load, medication adherence, and STI testing). Conclusion: The social acceptability of high-risk sex behaviors is high among young male Twitter users. Given the double-edged nature of social media—health-promoting (e.g., awareness, health activism) as well as risk-promoting (e.g., risky behavior endorsement, identity attacks)— this population may benefit from targeted health communication intervention. Future HIV prevention efforts should counter the stigma, misinformation, and risk-promoting viral messages prevalent on social media.
- Open Access
- 31 May 2024
- Published by Universidad de Lima in Contratexto
- No. 41,p. 21-23
Explorando la comunicación para la salud desde Hispanoamérica en distintos contextos y plataformas
- 31 May 2024
- Published by Universidad de Lima in Contratexto
- No. 41,p. 21-23
Open AccessExplorando la comunicación para la salud desde Hispanoamérica en distintos contextos y plataformas
- Open Access
- 5 April 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Mpox Discourse on Twitter by Sexual Minority Men and Gender-Diverse Individuals: Infodemiological Study Using BERTopic (Preprint)
BACKGROUND The mpox outbreak resulted in 32,063 cases and 58 deaths in the United States and 95,912 cases worldwide from May 2022 to March 2024 according to the US Centers for Disease Control and Prevention (CDC). Like other disease outbreaks (eg, HIV) with perceived community associations, mpox can create the risk of stigma, exacerbate homophobia, and potentially hinder health care access and social equity. However, the existing literature on mpox has limited representation of the perspective of sexual minority men and gender-diverse (SMMGD) individuals. OBJECTIVE To fill this gap, this study aimed to synthesize themes of discussions among SMMGD individuals and listen to SMMGD voices for identifying problems in current public health communication surrounding mpox to improve inclusivity, equity, and justice. METHODS We analyzed mpox-related posts (N=8688) posted between October 2020 and September 2022 by 2326 users who self-identified on Twitter/X as SMMGD and were geolocated in the United States. We applied BERTopic (a topic-modeling technique) on the tweets, validated the machine-generated topics through human labeling and annotations, and conducted content analysis of the tweets in each topic. Geographic analysis was performed on the size of the most prominent topic across US states in relation to the University of California, Los Angeles (UCLA) lesbian, gay, and bisexual (LGB) social climate index. RESULTS BERTopic identified 11 topics, which annotators labeled as mpox health activism (n=2590, 29.81%), mpox vaccination (n=2242, 25.81%), and adverse events (n=85, 0.98%); sarcasm, jokes, and emotional expressions (n=1220, 14.04%); COVID-19 and mpox (n=636, 7.32%); government or public health response (n=532, 6.12%); mpox symptoms (n=238, 2.74%); case reports (n=192, 2.21%); puns on the naming of the virus (ie, mpox; n=75, 0.86%); media publicity (n=59, 0.68%); and mpox in children (n=58, 0.67%). Spearman rank correlation indicated significant negative correlation (ρ=–0.322, P=.03) between the topic size of health activism and the UCLA LGB social climate index at the US state level. CONCLUSIONS Discussions among SMMGD individuals on mpox encompass both utilitarian (eg, vaccine access, case reports, and mpox symptoms) and emotionally charged (ie, promoting awareness, advocating against homophobia, misinformation/disinformation, and health stigma) themes. Mpox health activism is more prevalent in US states with lower LGB social acceptance, suggesting a resilient communicative pattern among SMMGD individuals in the face of public health oppression. Our method for social listening could facilitate future public health efforts, providing a cost-effective way to capture the perspective of impacted populations. This study illuminates SMMGD engagement with the mpox discourse, underscoring the need for more inclusive public health programming. Findings also highlight the social impact of mpox: health stigma. Our findings could inform interventions to optimize the delivery of informational and tangible health resources leveraging computational mixed-method analyses (eg, BERTopic) and big data.
- 5 April 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessMpox Discourse on Twitter by Sexual Minority Men and Gender-Diverse Individuals: Infodemiological Study Using BERTopic (Preprint)
BACKGROUND The mpox outbreak resulted in 32,063 cases and 58 deaths in the United States and 95,912 cases worldwide from May 2022 to March 2024 according to the US Centers for Disease Control and Prevention (CDC). Like other disease outbreaks (eg, HIV) with perceived community associations, mpox can create the risk of stigma, exacerbate homophobia, and potentially hinder health care access and social equity. However, the existing literature on mpox has limited representation of the perspective of sexual minority men and gender-diverse (SMMGD) individuals. OBJECTIVE To fill this gap, this study aimed to synthesize themes of discussions among SMMGD individuals and listen to SMMGD voices for identifying problems in current public health communication surrounding mpox to improve inclusivity, equity, and justice. METHODS We analyzed mpox-related posts (N=8688) posted between October 2020 and September 2022 by 2326 users who self-identified on Twitter/X as SMMGD and were geolocated in the United States. We applied BERTopic (a topic-modeling technique) on the tweets, validated the machine-generated topics through human labeling and annotations, and conducted content analysis of the tweets in each topic. Geographic analysis was performed on the size of the most prominent topic across US states in relation to the University of California, Los Angeles (UCLA) lesbian, gay, and bisexual (LGB) social climate index. RESULTS BERTopic identified 11 topics, which annotators labeled as mpox health activism (n=2590, 29.81%), mpox vaccination (n=2242, 25.81%), and adverse events (n=85, 0.98%); sarcasm, jokes, and emotional expressions (n=1220, 14.04%); COVID-19 and mpox (n=636, 7.32%); government or public health response (n=532, 6.12%); mpox symptoms (n=238, 2.74%); case reports (n=192, 2.21%); puns on the naming of the virus (ie, mpox; n=75, 0.86%); media publicity (n=59, 0.68%); and mpox in children (n=58, 0.67%). Spearman rank correlation indicated significant negative correlation (ρ=–0.322, P=.03) between the topic size of health activism and the UCLA LGB social climate index at the US state level. CONCLUSIONS Discussions among SMMGD individuals on mpox encompass both utilitarian (eg, vaccine access, case reports, and mpox symptoms) and emotionally charged (ie, promoting awareness, advocating against homophobia, misinformation/disinformation, and health stigma) themes. Mpox health activism is more prevalent in US states with lower LGB social acceptance, suggesting a resilient communicative pattern among SMMGD individuals in the face of public health oppression. Our method for social listening could facilitate future public health efforts, providing a cost-effective way to capture the perspective of impacted populations. This study illuminates SMMGD engagement with the mpox discourse, underscoring the need for more inclusive public health programming. Findings also highlight the social impact of mpox: health stigma. Our findings could inform interventions to optimize the delivery of informational and tangible health resources leveraging computational mixed-method analyses (eg, BERTopic) and big data.
- Open Access
- 17 June 2022
- Published by JMIR Publications Inc. in JMIR Public Health and Surveillance
- Vol. 8 (6) , e32718
User- and Message-Level Correlates of Endorsement and Engagement for HIV-Related Messages on Twitter: Cross-sectional Study
Background: Youth and young adults continue to experience high rates of HIV and are also frequent users of social media. Social media platforms such as Twitter can bolster efforts to promote HIV prevention for these individuals, and while HIV-related messages exist on Twitter, little is known about the impact or reach of these messages for this population. Objective: This study aims to address this gap in the literature by identifying user and message characteristics that are associated with tweet endorsement (favorited) and engagement (retweeted) among youth and young men (aged 13-24 years). Methods: In a secondary analysis of data from a study of HIV-related messages posted by young men on Twitter, we used model selection techniques to examine user and tweet-level factors associated with tweet endorsement and engagement. Results: Tweets from personal user accounts garnered greater endorsement and engagement than tweets from institutional users (aOR 3.27, 95% CI 2.75-3.89; P<.001). High follower count was associated with increased endorsement and engagement (aOR 1.05, 95% CI 1.04-1.06; P<.001); tweets that discussed STIs garnered lower endorsement and engagement (aOR 0.59, 95% CI 0.47-1.74; P<.001). Conclusions: Findings suggest practitioners should partner with youth to design and disseminate HIV prevention messages on social media, incorporate content that resonates with youth audiences, and work to challenge stigma and foster social norms conducive to open conversation about sex, sexuality, and health.
- 17 June 2022
- Published by JMIR Publications Inc. in JMIR Public Health and Surveillance
- Vol. 8 (6) , e32718
Open AccessUser- and Message-Level Correlates of Endorsement and Engagement for HIV-Related Messages on Twitter: Cross-sectional Study
Background: Youth and young adults continue to experience high rates of HIV and are also frequent users of social media. Social media platforms such as Twitter can bolster efforts to promote HIV prevention for these individuals, and while HIV-related messages exist on Twitter, little is known about the impact or reach of these messages for this population. Objective: This study aims to address this gap in the literature by identifying user and message characteristics that are associated with tweet endorsement (favorited) and engagement (retweeted) among youth and young men (aged 13-24 years). Methods: In a secondary analysis of data from a study of HIV-related messages posted by young men on Twitter, we used model selection techniques to examine user and tweet-level factors associated with tweet endorsement and engagement. Results: Tweets from personal user accounts garnered greater endorsement and engagement than tweets from institutional users (aOR 3.27, 95% CI 2.75-3.89; P<.001). High follower count was associated with increased endorsement and engagement (aOR 1.05, 95% CI 1.04-1.06; P<.001); tweets that discussed STIs garnered lower endorsement and engagement (aOR 0.59, 95% CI 0.47-1.74; P<.001). Conclusions: Findings suggest practitioners should partner with youth to design and disseminate HIV prevention messages on social media, incorporate content that resonates with youth audiences, and work to challenge stigma and foster social norms conducive to open conversation about sex, sexuality, and health.
- Open Access
- 29 April 2022
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 24 (4) , e35788
Methods to Establish Race or Ethnicity of Twitter Users: Scoping Review
Background: A growing amount of health research uses social media data. Those critical of social media research often cite that it may be unrepresentative of the population; however, the suitability of social media data in digital epidemiology is more nuanced. Identifying the demographics of social media users can help establish representativeness.Objective: This study aims to identify the different approaches or combination of approaches to extract race or ethnicity from social media and report on the challenges of using these methods.Methods: We present a scoping review to identify methods used to extract the race or ethnicity of Twitter users from Twitter data sets. We searched 17 electronic databases from the date of inception to May 15, 2021, and carried out reference checking and hand searching to identify relevant studies. Sifting of each record was performed independently by at least two researchers, with any disagreement discussed. Studies were required to extract the race or ethnicity of Twitter users using either manual or computational methods or a combination of both.Results: Of the 1249 records sifted, we identified 67 (5.36%) that met our inclusion criteria. Most studies (51/67, 76%) have focused on US-based users and English language tweets (52/67, 78%). A range of data was used, including Twitter profile metadata, such as names, pictures, information from bios (including self-declarations), or location or content of the tweets. A range of methodologies was used, including manual inference, linkage to census data, commercial software, language or dialect recognition, or machine learning or natural language processing. However, not all studies have evaluated these methods. Those that evaluated these methods found accuracy to vary from 45% to 93% with significantly lower accuracy in identifying categories of people of color. The inference of race or ethnicity raises important ethical questions, which can be exacerbated by the data and methods used. The comparative accuracies of the different methods are also largely unknown.Conclusions: There is no standard accepted approach or current guidelines for extracting or inferring the race or ethnicity of Twitter users. Social media researchers must carefully interpret race or ethnicity and not overpromise what can be achieved, as even manual screening is a subjective, imperfect method. Future research should establish the accuracy of methods to inform evidence-based best practice guidelines for social media researchers and be guided by concerns of equity and social justice.
- 29 April 2022
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 24 (4) , e35788
Open AccessMethods to Establish Race or Ethnicity of Twitter Users: Scoping Review
Background: A growing amount of health research uses social media data. Those critical of social media research often cite that it may be unrepresentative of the population; however, the suitability of social media data in digital epidemiology is more nuanced. Identifying the demographics of social media users can help establish representativeness.Objective: This study aims to identify the different approaches or combination of approaches to extract race or ethnicity from social media and report on the challenges of using these methods.Methods: We present a scoping review to identify methods used to extract the race or ethnicity of Twitter users from Twitter data sets. We searched 17 electronic databases from the date of inception to May 15, 2021, and carried out reference checking and hand searching to identify relevant studies. Sifting of each record was performed independently by at least two researchers, with any disagreement discussed. Studies were required to extract the race or ethnicity of Twitter users using either manual or computational methods or a combination of both.Results: Of the 1249 records sifted, we identified 67 (5.36%) that met our inclusion criteria. Most studies (51/67, 76%) have focused on US-based users and English language tweets (52/67, 78%). A range of data was used, including Twitter profile metadata, such as names, pictures, information from bios (including self-declarations), or location or content of the tweets. A range of methodologies was used, including manual inference, linkage to census data, commercial software, language or dialect recognition, or machine learning or natural language processing. However, not all studies have evaluated these methods. Those that evaluated these methods found accuracy to vary from 45% to 93% with significantly lower accuracy in identifying categories of people of color. The inference of race or ethnicity raises important ethical questions, which can be exacerbated by the data and methods used. The comparative accuracies of the different methods are also largely unknown.Conclusions: There is no standard accepted approach or current guidelines for extracting or inferring the race or ethnicity of Twitter users. Social media researchers must carefully interpret race or ethnicity and not overpromise what can be achieved, as even manual screening is a subjective, imperfect method. Future research should establish the accuracy of methods to inform evidence-based best practice guidelines for social media researchers and be guided by concerns of equity and social justice.
- 6 April 2022
- Published by Taylor & Francis in Journal of Children and Media
- Vol. 16 (4) , 514-531
On sex, drugs, and alcohol: a mixed-method analysis of youth posts on social media in the United States
In the digital neighborhood, Black and Hispanic youth communicate about issues they face, including sex and substance use. This population of young people is also disproportionately burdened by negative consequences associated with sex and substance use behaviors even when their behavior is less risky. Given the increased likelihood of negative outcomes, we investigated how young people communicate about these behaviors in their digital social networks. This mixed-methods study integrates a behavioral survey with a machine learning-supported, qualitative content analysis of one year of Facebook and Twitter posts from 50 Black and Hispanic youth, with feedback from a youth advisory board. Participants who had previously had sex or drank alcohol were more likely to post about sex or alcohol, respectively. Moreover, compared to male youth , female youth posted significantly more about sex in general and about STIs, HIV, and pregnancy . Posts about sexual behavior often discussed trust in sexual partners and gendered views of sex. Posts linked alcohol and marijuana with stress relief and coping withgrief, community violence, and distress. Understanding how youth think and communicate about sexual risk and substance use can inform the design of effective prevention efforts.
- 6 April 2022
- Published by Taylor & Francis in Journal of Children and Media
- Vol. 16 (4) , 514-531
On sex, drugs, and alcohol: a mixed-method analysis of youth posts on social media in the United States
In the digital neighborhood, Black and Hispanic youth communicate about issues they face, including sex and substance use. This population of young people is also disproportionately burdened by negative consequences associated with sex and substance use behaviors even when their behavior is less risky. Given the increased likelihood of negative outcomes, we investigated how young people communicate about these behaviors in their digital social networks. This mixed-methods study integrates a behavioral survey with a machine learning-supported, qualitative content analysis of one year of Facebook and Twitter posts from 50 Black and Hispanic youth, with feedback from a youth advisory board. Participants who had previously had sex or drank alcohol were more likely to post about sex or alcohol, respectively. Moreover, compared to male youth , female youth posted significantly more about sex in general and about STIs, HIV, and pregnancy . Posts about sexual behavior often discussed trust in sexual partners and gendered views of sex. Posts linked alcohol and marijuana with stress relief and coping withgrief, community violence, and distress. Understanding how youth think and communicate about sexual risk and substance use can inform the design of effective prevention efforts.
- Open Access
- 17 December 2021
- Published by JMIR Publications Inc. in JMIR Preprints
Methods to Establish Race or Ethnicity of Twitter Users: Scoping Review (Preprint)
BACKGROUND A growing amount of health research uses social media data. Those critical of social media research often cite that it may be unrepresentative of the population; however, the suitability of social media data in digital epidemiology is more nuanced. Identifying the demographics of social media users can help establish representativeness. OBJECTIVE This study aims to identify the different approaches or combination of approaches to extract race or ethnicity from social media and report on the challenges of using these methods. METHODS We present a scoping review to identify methods used to extract the race or ethnicity of Twitter users from Twitter data sets. We searched 17 electronic databases from the date of inception to May 15, 2021, and carried out reference checking and hand searching to identify relevant studies. Sifting of each record was performed independently by at least two researchers, with any disagreement discussed. Studies were required to extract the race or ethnicity of Twitter users using either manual or computational methods or a combination of both. RESULTS Of the 1249 records sifted, we identified 67 (5.36%) that met our inclusion criteria. Most studies (51/67, 76%) have focused on US-based users and English language tweets (52/67, 78%). A range of data was used, including Twitter profile metadata, such as names, pictures, information from bios (including self-declarations), or location or content of the tweets. A range of methodologies was used, including manual inference, linkage to census data, commercial software, language or dialect recognition, or machine learning or natural language processing. However, not all studies have evaluated these methods. Those that evaluated these methods found accuracy to vary from 45% to 93% with significantly lower accuracy in identifying categories of people of color. The inference of race or ethnicity raises important ethical questions, which can be exacerbated by the data and methods used. The comparative accuracies of the different methods are also largely unknown. CONCLUSIONS There is no standard accepted approach or current guidelines for extracting or inferring the race or ethnicity of Twitter users. Social media researchers must carefully interpret race or ethnicity and not overpromise what can be achieved, as even manual screening is a subjective, imperfect method. Future research should establish the accuracy of methods to inform evidence-based best practice guidelines for social media researchers and be guided by concerns of equity and social justice.
- 17 December 2021
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessMethods to Establish Race or Ethnicity of Twitter Users: Scoping Review (Preprint)
BACKGROUND A growing amount of health research uses social media data. Those critical of social media research often cite that it may be unrepresentative of the population; however, the suitability of social media data in digital epidemiology is more nuanced. Identifying the demographics of social media users can help establish representativeness. OBJECTIVE This study aims to identify the different approaches or combination of approaches to extract race or ethnicity from social media and report on the challenges of using these methods. METHODS We present a scoping review to identify methods used to extract the race or ethnicity of Twitter users from Twitter data sets. We searched 17 electronic databases from the date of inception to May 15, 2021, and carried out reference checking and hand searching to identify relevant studies. Sifting of each record was performed independently by at least two researchers, with any disagreement discussed. Studies were required to extract the race or ethnicity of Twitter users using either manual or computational methods or a combination of both. RESULTS Of the 1249 records sifted, we identified 67 (5.36%) that met our inclusion criteria. Most studies (51/67, 76%) have focused on US-based users and English language tweets (52/67, 78%). A range of data was used, including Twitter profile metadata, such as names, pictures, information from bios (including self-declarations), or location or content of the tweets. A range of methodologies was used, including manual inference, linkage to census data, commercial software, language or dialect recognition, or machine learning or natural language processing. However, not all studies have evaluated these methods. Those that evaluated these methods found accuracy to vary from 45% to 93% with significantly lower accuracy in identifying categories of people of color. The inference of race or ethnicity raises important ethical questions, which can be exacerbated by the data and methods used. The comparative accuracies of the different methods are also largely unknown. CONCLUSIONS There is no standard accepted approach or current guidelines for extracting or inferring the race or ethnicity of Twitter users. Social media researchers must carefully interpret race or ethnicity and not overpromise what can be achieved, as even manual screening is a subjective, imperfect method. Future research should establish the accuracy of methods to inform evidence-based best practice guidelines for social media researchers and be guided by concerns of equity and social justice.