The role of networks in spreading hate speech on Twitter

Authors

  • Jari-Mikko Meriläinen Jyväskylä University School of Business and Economics

Keywords:

hate speech, networks, social media, online communication, Twitter

Abstract

The objective of this study is to investigate the role of networks in the distribution of hate speech on Twitter. Using a sample of participants engaging in hate speech on Twitter, we examine the influence of popular users and retweeting in the spread of hate speech. A manually annotated tweet sample is used for this purpose. We divide the sample of hate speech participants into two groups: the core and outer circle. The core refers to users who are frequently followed by other hate speech participants, while the outer circle includes users who engage in hate speech but are not regularly followed by other perpetrators. We programmatically investigate the dynamics of hate speech in this network. Our findings reveal that popular users play a dual role: actively sending hateful tweets on other users' threads and retweeting hateful tweets from outside the network to their followers. However, hate speech only represents a small portion of their overall Twitter activity, as they predominantly share neutral tweets. Consequently, their Twitter feeds remain, on average, primarily neutral.

References

Arango, A., Pérez, J., & Poblete, B. (2022). Hate speech detection is not as easy as you may think: A closer look at model validation (extended version). Information Systems, 105, 101584.

Ayo, F. E., Folorunso, O., Ibharalu, F. T., Osinuga, I. A., & Abayomi-Alli, A. (2021). A probabilistic clustering model for hate speech classification in twitter. Expert Systems with Applications, 173, 114762.

Balaji, T. K., Annavarapu, C. S. R., & Bablani, A. (2021). Machine learning algorithms for social media analysis: A survey. Computer Science Review, 40, 100395.

Blaya, C., & Audrin, C. (2019, June). Toward an understanding of the characteristics of secondary school cyberhate perpetrators. Frontiers in Education, Vol. 4, p. 46. Frontiers Media SA.

Bruns, A., & Highfield, T. (2015). Is Habermas on Twitter?: Social media and the public sphere. In The Routledge companion to social media and politics, 56–73. Routledge.

Burnap, P., & Williams, M. L. (2015). Cyber hate speech on twitter: An application of machine classification and statistical modeling for policy and decision making. Policy & internet, 7(2), 223–242.

Burnap, P., & Williams, M. L. (2016). Us and them: identifying cyber hate on Twitter across multiple protected characteristics. EPJ Data science, 5, 1–15.

Burnap, P., Sloan, L., & Williams, M. L. (2017). Towards an ethical framework for publishing Twitter data in social research: Taking into account users’ views, online context and algorithmic estimation. Sociology, 51(6), 1149–1168.

Castaño-Pulgarín, S. A., Suárez-Betancur, N., Vega, L. M. T., & López, H. M. H. (2021). Internet, social media and online hate speech. Systematic review. Aggression and Violent Behavior, 58, 101608.

Costello, M., & Hawdon, J. (2018). Who are the online extremists among us? Sociodemographic characteristics, social networking, and online experiences of those who produce online hate materials. Violence and gender, 5(1), 55–60.

Council of Europe (2016) Recommendations and declarations of the Committee of Ministers of the Council of Europe in the field of media and information society. Available at: https://go.coe.int/URzjs [last accessed 24 October 2023]

ElSherief, M., Nilizadeh, S., Nguyen, D., Vigna, G., & Belding, E. (2018, June). Peer to peer hate: Hate speech instigators and their targets. Proceedings of the International AAAI Conference on Web and Social Media, Vol. 12, No. 1.

Fiesler, C., & Proferes, N. (2018). “Participant” perceptions of Twitter research ethics. Social Media+ Society, 4(1), 2056305118763366.

Fortuna, P., & Nunes, S. (2018). A survey on automatic detection of hate speech in text. ACM Computing Surveys (CSUR), 51(4), 1–30.

Gorrell, G., Bakir, M. E., Roberts, I., Greenwood, M. A., & Bontcheva, K. (2020). Which politicians receive abuse? Four factors illuminated in the UK general election 2019. EPJ Data Science, 9(1), 18.

Himelboim, I., McCreery, S., & Smith, M. (2013). Birds of a feather tweet together: Integrating network and content analyses to examine cross-ideology exposure on Twitter. Journal of computer-mediated communication, 18(2), 154-174.

Himelboim, I., & Han, J. Y. (2014). Cancer talk on twitter: community structure and information sources in breast and prostate cancer social networks. Journal of health communication, 19(2), 210-225.

Himelboim, I., Smith, M. A., Rainie, L., Shneiderman, B., & Espina, C. (2017). Classifying Twitter topic-networks using social network analysis. Social media+ society, 3(1), 2056305117691545.

Isa, D., & Himelboim, I. (2018). A social networks approach to online social movement: Social mediators and mediated content in #FreeAJstaff twitter network. Social Media+ Society, 4(1), 2056305118760807.

Kettunen, L., & Paukkeri, M. S. (2021). Tekoälyn hyödyntäminen vihapuheen seurannassa [Utilising artificial intelligence for monitoring hate speech]. http://urn.fi/URN:ISBN:978-952-259-893-6 [last accessed 30 October 2023].

Kwarteng, J., Perfumi, S. C., Farrell, T., Third, A., & Fernandez, M. (2022). Misogynoir: challenges in detecting intersectional hate. Social Network Analysis and Mining, 12(1), 166.

Lingiardi, V., Carone, N., Semeraro, G., Musto, C., D’Amico, M., & Brena, S. (2020). Mapping Twitter hate speech towards social and sexual minorities: A lexicon-based approach to semantic content analysis. Behaviour & Information Technology, 39(7), 711–721.

MacAvaney, S., Yao, H. R., Yang, E., Russell, K., Goharian, N., & Frieder, O. (2019). Hate speech detection: Challenges and solutions. PloS one, 14(8), e0221152.

Mathew, B., Dutt, R., Goyal, P., & Mukherjee, A. (2019, June). Spread of hate speech in online social media. Proceedings of the 10th ACM conference on web science, 173–182.

Meriläinen (2022). Marinin hallituksen ministereihin Twitterissä suunnattu vihapuhe (Hate speech targeting the ministers of Sanna Marin’s cabinet in Twitter). Prologi 18(1). Direct link [accessed 9 Oct 2023]: https://doi.org/10.33352/prlg.122025

Papacharissi, Z. (2004). Democracy online: Civility, politeness, and the democratic potential of online political discussion groups. New media & society, 6(2), 259–283.

Recuero, R., Zago, G., & Soares, F. (2019). Using social network analysis and social capital to identify user roles on polarized political conversations on Twitter. Social media+ society, 5(2), 2056305119848745.

Ribeiro, M., Calais, P., Santos, Y., Almeida, V., & Meira Jr, W. (2018, June). Characterizing and detecting hateful users on twitter. Proceedings of the International AAAI Conference on Web and Social Media (Vol. 12, No. 1).

Rogers, R. (2020). Deplatforming: Following extreme Internet celebrities to Telegram and alternative social media. European Journal of Communication, 35(3), 213–229.

Siegel, A. (2020). Online Hate Speech. In N. Persily & J. Tucker (Eds.), Social Media and Democracy: The State of the Field, Prospects for Reform (SSRC Anxieties of Democracy, pp. 56-88). Cambridge: Cambridge University Press.

Southern, R., & Harmer, E. (2021). Twitter, incivility and “everyday” gendered othering: an analysis of tweets sent to UK members of Parliament. Social Science Computer Review, 39(2), s. 259–275.

Stewart, N. K., Al-Rawi, A., Celestini, C., & Worku, N. (2023). Hate Influencers’ Mediation of Hate on Telegram:“We Declare War Against the Anti-White System”. Social Media+ Society, 9(2), 20563051231177915.

Van Sant, K., Fredheim, R., & Bergmanis-Korats, G. (2021). Abuse of power: coordinated online harassment of Finnish government ministers. Riga: NATO Strategic Communications Centre of Excellence. Direct link (last accessed 11 Nov 2021): https://stratcomcoe.org/publications/abuse-of-power-coordinated-online-harassment-of-finnish-government-ministers/5

Vidgen, B., & Derczynski, L. (2020). Directions in abusive language training data, a systematic review: Garbage in, garbage out. Plos one, 15(12), e0243300.

Vidgen, B., & Yasseri, T. (2020). Detecting weak and strong Islamophobic hate speech on social media. Journal of Information Technology & Politics, 17(1), 66–78.

Zych, I., Kaakinen, M., Savolainen, I., Sirola, A., Paek, H. J., & Oksanen, A. (2023). The role of impulsivity, social relations online and offline, and compulsive Internet use in cyberaggression: A four-country study. New media & society, 25(1), 181–198.

Åkerlund, M. (2020). The importance of influential users in (re) producing Swedish far-right discourse on Twitter. European Journal of Communication, 35(6), 613–628.

Downloads

Published

2025-05-31