-
Diverse Perspectives Can Mitigate Political Bias in Crowdsourced Content Moderation
Authors:
Jacob Thebault-Spieker,
Sukrit Venkatagiri,
Naomi Mine,
Kurt Luther
Abstract:
In recent years, social media companies have grappled with defining and enforcing content moderation policies surrounding political content on their platforms, due in part to concerns about political bias, disinformation, and polarization. These policies have taken many forms, including disallowing political advertising, limiting the reach of political topics, fact-checking political claims, and e…
▽ More
In recent years, social media companies have grappled with defining and enforcing content moderation policies surrounding political content on their platforms, due in part to concerns about political bias, disinformation, and polarization. These policies have taken many forms, including disallowing political advertising, limiting the reach of political topics, fact-checking political claims, and enabling users to hide political content altogether. However, implementing these policies requires human judgement to label political content, and it is unclear how well human labelers perform at this task, or whether biases affect this process. Therefore, in this study we experimentally evaluate the feasibility and practicality of using crowd workers to identify political content, and we uncover biases that make it difficult to identify this content. Our results problematize crowds composed of seemingly interchangeable workers, and provide preliminary evidence that aggregating judgements from heterogeneous workers may help mitigate political biases. In light of these findings, we identify strategies to achieving fairer labeling outcomes, while also better supporting crowd workers at this task and potentially mitigating biases.
△ Less
Submitted 23 May, 2023;
originally announced May 2023.
-
The Geography of Pokémon GO: Beneficial and Problematic Effects on Places and Movement
Authors:
Ashley Colley,
Jacob Thebault-Spieker,
Allen Yilun Lin,
Donald Degraen,
Benjamin Fischman,
Jonna Häkkilä,
Kate Kuehl,
Valentina Nisi,
Nuno Jardim Nunes,
Nina Wenig,
Dirk Wenig,
Brent Hecht,
Johannes Schöning
Abstract:
The widespread popularity of Pokémon GO presents the first opportunity to observe the geographic effects of location-based gaming at scale. This paper reports the results of a mixed methods study of the geography of Pokémon GO that includes a five-country field survey of 375 Pokémon GO players and a large scale geostatistical analysis of game elements. Focusing on the key geographic themes of plac…
▽ More
The widespread popularity of Pokémon GO presents the first opportunity to observe the geographic effects of location-based gaming at scale. This paper reports the results of a mixed methods study of the geography of Pokémon GO that includes a five-country field survey of 375 Pokémon GO players and a large scale geostatistical analysis of game elements. Focusing on the key geographic themes of places and movement, we find that the design of Pokémon GO reinforces existing geographically-linked biases (e.g. the game advantages urban areas and neighborhoods with smaller minority populations), that Pokémon GO may have instigated a relatively rare large-scale shift in global human mobility patterns, and that Pokémon GO has geographically-linked safety risks, but not those typically emphasized by the media. Our results point to geographic design implications for future systems in this space such as a means through which the geographic biases present in Pokémon GO may be counteracted.
△ Less
Submitted 28 March, 2019;
originally announced March 2019.
-
User Session Identification Based on Strong Regularities in Inter-activity Time
Authors:
Aaron Halfaker,
Os Keyes,
Daniel Kluver,
Jacob Thebault-Spieker,
Tien Nguyen,
Kenneth Shores,
Anuradha Uduwage,
Morten Warncke-Wang
Abstract:
Session identification is a common strategy used to develop metrics for web analytics and behavioral analyses of user-facing systems. Past work has argued that session identification strategies based on an inactivity threshold is inherently arbitrary or advocated that thresholds be set at about 30 minutes. In this work, we demonstrate a strong regularity in the temporal rhythms of user initiated e…
▽ More
Session identification is a common strategy used to develop metrics for web analytics and behavioral analyses of user-facing systems. Past work has argued that session identification strategies based on an inactivity threshold is inherently arbitrary or advocated that thresholds be set at about 30 minutes. In this work, we demonstrate a strong regularity in the temporal rhythms of user initiated events across several different domains of online activity (incl. video gaming, search, page views and volunteer contributions). We describe a methodology for identifying clusters of user activity and argue that regularity with which these activity clusters appear implies a good rule-of-thumb inactivity threshold of about 1 hour. We conclude with implications that these temporal rhythms may have for system design based on our observations and theories of goal-directed human activity.
△ Less
Submitted 4 August, 2019; v1 submitted 11 November, 2014;
originally announced November 2014.
