-
Empirical evidence of Large Language Model's influence on human spoken communication
Authors:
Hiromu Yakura,
Ezequiel Lopez-Lopez,
Levin Brinkmann,
Ignacio Serna,
Prateek Gupta,
Iyad Rahwan
Abstract:
Artificial Intelligence (AI) agents now interact with billions of humans in natural language, thanks to advances in Large Language Models (LLMs) like ChatGPT. This raises the question of whether AI has the potential to shape a fundamental aspect of human culture: the way we speak. Recent analyses revealed that scientific publications already exhibit evidence of AI-specific language. But this evide…
▽ More
Artificial Intelligence (AI) agents now interact with billions of humans in natural language, thanks to advances in Large Language Models (LLMs) like ChatGPT. This raises the question of whether AI has the potential to shape a fundamental aspect of human culture: the way we speak. Recent analyses revealed that scientific publications already exhibit evidence of AI-specific language. But this evidence is inconclusive, since scientists may simply be using AI to copy-edit their writing. To explore whether AI has influenced human spoken communication, we transcribed and analyzed about 280,000 English-language videos of presentations, talks, and speeches from more than 20,000 YouTube channels of academic institutions. We find a significant shift in the trend of word usage specific to words distinctively associated with ChatGPT following its release. These findings provide the first empirical evidence that humans increasingly imitate LLMs in their spoken language. Our results raise societal and policy-relevant concerns about the potential of AI to unintentionally reduce linguistic diversity, or to be deliberately misused for mass manipulation. They also highlight the need for further investigation into the feedback loops between machine behavior and human culture.
△ Less
Submitted 3 September, 2024;
originally announced September 2024.
-
False consensus biases AI against vulnerable stakeholders
Authors:
Mengchen Dong,
Jean-François Bonnefon,
Iyad Rahwan
Abstract:
The deployment of AI systems for welfare benefit allocation allows for accelerated decision-making and faster provision of critical help, but has already led to an increase in unfair benefit denials and false fraud accusations. Collecting data in the US and the UK (N = 2449), we explore the public acceptability of such speed-accuracy trade-offs in populations of claimants and non-claimants. We obs…
▽ More
The deployment of AI systems for welfare benefit allocation allows for accelerated decision-making and faster provision of critical help, but has already led to an increase in unfair benefit denials and false fraud accusations. Collecting data in the US and the UK (N = 2449), we explore the public acceptability of such speed-accuracy trade-offs in populations of claimants and non-claimants. We observe a general willingness to trade off speed gains for modest accuracy losses, but this aggregate view masks notable divergences between claimants and non-claimants. Although welfare claimants comprise a relatively small proportion of the general population (e.g., 20% in the US representative sample), this vulnerable group is much less willing to accept AI deployed in welfare systems, raising concerns that solely using aggregate data for calibration could lead to policies misaligned with stakeholder preferences. Our study further uncovers asymmetric insights between claimants and non-claimants. The latter consistently overestimate claimant willingness to accept speed-accuracy trade-offs, even when financially incentivized for accurate perspective-taking. This suggests that policy decisions influenced by the dominant voice of non-claimants, however well-intentioned, may neglect the actual preferences of those directly affected by welfare AI systems. Our findings underline the need for stakeholder engagement and transparent communication in the design and deployment of these systems, particularly in contexts marked by power imbalances.
△ Less
Submitted 17 May, 2024;
originally announced July 2024.
-
The impact of generative artificial intelligence on socioeconomic inequalities and policy making
Authors:
Valerio Capraro,
Austin Lentsch,
Daron Acemoglu,
Selin Akgun,
Aisel Akhmedova,
Ennio Bilancini,
Jean-François Bonnefon,
Pablo Brañas-Garza,
Luigi Butera,
Karen M. Douglas,
Jim A. C. Everett,
Gerd Gigerenzer,
Christine Greenhow,
Daniel A. Hashimoto,
Julianne Holt-Lunstad,
Jolanda Jetten,
Simon Johnson,
Chiara Longoni,
Pete Lunn,
Simone Natale,
Iyad Rahwan,
Neil Selwyn,
Vivek Singh,
Siddharth Suri,
Jennifer Sutcliffe
, et al. (6 additional authors not shown)
Abstract:
Generative artificial intelligence has the potential to both exacerbate and ameliorate existing socioeconomic inequalities. In this article, we provide a state-of-the-art interdisciplinary overview of the potential impacts of generative AI on (mis)information and three information-intensive domains: work, education, and healthcare. Our goal is to highlight how generative AI could worsen existing i…
▽ More
Generative artificial intelligence has the potential to both exacerbate and ameliorate existing socioeconomic inequalities. In this article, we provide a state-of-the-art interdisciplinary overview of the potential impacts of generative AI on (mis)information and three information-intensive domains: work, education, and healthcare. Our goal is to highlight how generative AI could worsen existing inequalities while illuminating how AI may help mitigate pervasive social problems. In the information domain, generative AI can democratize content creation and access, but may dramatically expand the production and proliferation of misinformation. In the workplace, it can boost productivity and create new jobs, but the benefits will likely be distributed unevenly. In education, it offers personalized learning, but may widen the digital divide. In healthcare, it might improve diagnostics and accessibility, but could deepen pre-existing inequalities. In each section we cover a specific topic, evaluate existing research, identify critical gaps, and recommend research directions, including explicit trade-offs that complicate the derivation of a priori hypotheses. We conclude with a section highlighting the role of policymaking to maximize generative AI's potential to reduce inequalities while mitigating its harmful effects. We discuss strengths and weaknesses of existing policy frameworks in the European Union, the United States, and the United Kingdom, observing that each fails to fully confront the socioeconomic challenges we have identified. We propose several concrete policies that could promote shared prosperity through the advancement of generative AI. This article emphasizes the need for interdisciplinary collaborations to understand and address the complex challenges of generative AI.
△ Less
Submitted 6 May, 2024; v1 submitted 16 December, 2023;
originally announced January 2024.
-
Machine Culture
Authors:
Levin Brinkmann,
Fabian Baumann,
Jean-François Bonnefon,
Maxime Derex,
Thomas F. Müller,
Anne-Marie Nussberger,
Agnieszka Czaplicka,
Alberto Acerbi,
Thomas L. Griffiths,
Joseph Henrich,
Joel Z. Leibo,
Richard McElreath,
Pierre-Yves Oudeyer,
Jonathan Stray,
Iyad Rahwan
Abstract:
The ability of humans to create and disseminate culture is often credited as the single most important factor of our success as a species. In this Perspective, we explore the notion of machine culture, culture mediated or generated by machines. We argue that intelligent machines simultaneously transform the cultural evolutionary processes of variation, transmission, and selection. Recommender algo…
▽ More
The ability of humans to create and disseminate culture is often credited as the single most important factor of our success as a species. In this Perspective, we explore the notion of machine culture, culture mediated or generated by machines. We argue that intelligent machines simultaneously transform the cultural evolutionary processes of variation, transmission, and selection. Recommender algorithms are altering social learning dynamics. Chatbots are forming a new mode of cultural transmission, serving as cultural models. Furthermore, intelligent machines are evolving as contributors in generating cultural traits--from game strategies and visual art to scientific results. We provide a conceptual framework for studying the present and anticipated future impact of machines on cultural evolution, and present a research agenda for the study of machine culture.
△ Less
Submitted 22 November, 2023; v1 submitted 19 November, 2023;
originally announced November 2023.
-
Network Structure shapes the Impact of Diversity in Collective Learning
Authors:
Fabian Baumann,
Agnieszka Czaplicka,
Iyad Rahwan
Abstract:
It is widely believed that diversity arising from different skills enhances the performance of teams, and in particular, their ability to learn and innovate. However, diversity has also been associated with negative effects on the communication and coordination within collectives. Yet, despite the importance of diversity as a concept, we still lack a mechanistic understanding of how its impact is…
▽ More
It is widely believed that diversity arising from different skills enhances the performance of teams, and in particular, their ability to learn and innovate. However, diversity has also been associated with negative effects on the communication and coordination within collectives. Yet, despite the importance of diversity as a concept, we still lack a mechanistic understanding of how its impact is shaped by the underlying social network. To fill this gap, we model skill diversity within a simple model of collective learning and show that its effect on collective performance differs depending on the complexity of the task and the network density. In particular, we find that diversity consistently impairs performance in simple tasks. In contrast, in complex tasks, link density modifies the effect of diversity: while homogeneous populations outperform diverse ones in sparse networks, the opposite is true in dense networks, where diversity boosts collective performance. Our findings also provide insight on how to forge teams in an increasingly interconnected world: the more we are connected, the more we can benefit from diversity to solve complex problems.
△ Less
Submitted 30 June, 2023;
originally announced June 2023.
-
Artificial Intelligence can facilitate selfish decisions by altering the appearance of interaction partners
Authors:
Nils Köbis,
Philipp Lorenz-Spreen,
Tamer Ajaj,
Jean-Francois Bonnefon,
Ralph Hertwig,
Iyad Rahwan
Abstract:
The increasing prevalence of image-altering filters on social media and video conferencing technologies has raised concerns about the ethical and psychological implications of using Artificial Intelligence (AI) to manipulate our perception of others. In this study, we specifically investigate the potential impact of blur filters, a type of appearance-altering technology, on individuals' behavior t…
▽ More
The increasing prevalence of image-altering filters on social media and video conferencing technologies has raised concerns about the ethical and psychological implications of using Artificial Intelligence (AI) to manipulate our perception of others. In this study, we specifically investigate the potential impact of blur filters, a type of appearance-altering technology, on individuals' behavior towards others. Our findings consistently demonstrate a significant increase in selfish behavior directed towards individuals whose appearance is blurred, suggesting that blur filters can facilitate moral disengagement through depersonalization. These results emphasize the need for broader ethical discussions surrounding AI technologies that modify our perception of others, including issues of transparency, consent, and the awareness of being subject to appearance manipulation by others. We also emphasize the importance of anticipatory experiments in informing the development of responsible guidelines and policies prior to the widespread adoption of such technologies.
△ Less
Submitted 7 June, 2023;
originally announced June 2023.
-
Optimal Engagement-Diversity Tradeoffs in Social Media
Authors:
Fabian Baumann,
Daniel Halpern,
Ariel D. Procaccia,
Iyad Rahwan,
Itai Shapira,
Manuel Wuthrich
Abstract:
Social media platforms are known to optimize user engagement with the help of algorithms. It is widely understood that this practice gives rise to echo chambers\emdash users are mainly exposed to opinions that are similar to their own. In this paper, we ask whether echo chambers are an inevitable result of high engagement; we address this question in a novel model. Our main theoretical results est…
▽ More
Social media platforms are known to optimize user engagement with the help of algorithms. It is widely understood that this practice gives rise to echo chambers\emdash users are mainly exposed to opinions that are similar to their own. In this paper, we ask whether echo chambers are an inevitable result of high engagement; we address this question in a novel model. Our main theoretical results establish bounds on the maximum engagement achievable under a diversity constraint, for suitable measures of engagement and diversity; we can therefore quantify the worst-case tradeoff between these two objectives. Our empirical results, based on real data from Twitter, chart the Pareto frontier of the engagement-diversity tradeoff.
△ Less
Submitted 6 March, 2023;
originally announced March 2023.
-
Lie detection algorithms attract few users but vastly increase accusation rates
Authors:
Alicia von Schenk,
Victor Klockmann,
Jean-François Bonnefon,
Iyad Rahwan,
Nils Köbis
Abstract:
People are not very good at detecting lies, which may explain why they refrain from accusing others of lying, given the social costs attached to false accusations - both for the accuser and the accused. Here we consider how this social balance might be disrupted by the availability of lie-detection algorithms powered by Artificial Intelligence. Will people elect to use lie detection algorithms tha…
▽ More
People are not very good at detecting lies, which may explain why they refrain from accusing others of lying, given the social costs attached to false accusations - both for the accuser and the accused. Here we consider how this social balance might be disrupted by the availability of lie-detection algorithms powered by Artificial Intelligence. Will people elect to use lie detection algorithms that perform better than humans, and if so, will they show less restraint in their accusations? We built a machine learning classifier whose accuracy (67\%) was significantly better than human accuracy (50\%) in a lie-detection task and conducted an incentivized lie-detection experiment in which we measured participants' propensity to use the algorithm, as well as the impact of that use on accusation rates. We find that the few people (33\%) who elect to use the algorithm drastically increase their accusation rates (from 25\% in the baseline condition up to 86% when the algorithm flags a statement as a lie). They make more false accusations (18pp increase), but at the same time, the probability of a lie remaining undetected is much lower in this group (36pp decrease). We consider individual motivations for using lie detection algorithms and the social implications of these algorithms.
△ Less
Submitted 8 December, 2022;
originally announced December 2022.
-
Classes of Aggregation Rules for Ethical Decision Making in Automated Systems
Authors:
Federico Fioravanti,
Iyad Rahwan,
Fernando Abel Tohmé
Abstract:
We study a class of {\em aggregation rules} that could be applied to ethical AI decision-making. These rules yield the decisions to be made by automated systems based on the information of profiles of preferences over possible choices. We consider two different but very intuitive notions of preferences of an alternative over another one, namely {\it pairwise majority} and {\it position} dominance.…
▽ More
We study a class of {\em aggregation rules} that could be applied to ethical AI decision-making. These rules yield the decisions to be made by automated systems based on the information of profiles of preferences over possible choices. We consider two different but very intuitive notions of preferences of an alternative over another one, namely {\it pairwise majority} and {\it position} dominance. Preferences are represented by permutation processes over alternatives and aggregation rules are applied to obtain results that are socially considered to be ethically correct. In this setting, we find many aggregation rules that satisfy desirable properties for an autonomous system. We also address the problem of the stability of the aggregation process, which is important when the information is variable. These results are a contribution for an AI designer that wants to justify the decisions made by an autonomous system.\\ \textit{Keywords:} Aggregation Operators; Permutation Process; Decision Analysis.
△ Less
Submitted 28 June, 2023; v1 submitted 10 June, 2022;
originally announced June 2022.
-
Longitudinal Complex Dynamics of Labour Markets Reveal Increasing Polarisation
Authors:
Shahad Althobaiti,
Ahmad Alabdulkareem,
Judy Hanwen Shen,
Iyad Rahwan,
Morgan Frank,
Esteban Moro,
Alex Rutherford
Abstract:
In this paper we conduct a longitudinal analysis of the structure of labour markets in the US over 7 decades of technological, economic and policy change. We make use of network science, natural language processing and machine learning to uncover structural changes in the labour market over time. We find a steady rate of both disappearance of jobs and a shift in the required work tasks, despite mu…
▽ More
In this paper we conduct a longitudinal analysis of the structure of labour markets in the US over 7 decades of technological, economic and policy change. We make use of network science, natural language processing and machine learning to uncover structural changes in the labour market over time. We find a steady rate of both disappearance of jobs and a shift in the required work tasks, despite much technological and economic change over this time period. Machine learning is used to classify jobs as being predominantly cognitive or physical based on the textual description of the workplace tasks. We also measure increasing polarisation between these two classes of jobs, linked by the similarity of tasks, over time that could constrain workers wishing to move to different jobs.
△ Less
Submitted 14 April, 2022;
originally announced April 2022.
-
When Is It Acceptable to Break the Rules? Knowledge Representation of Moral Judgement Based on Empirical Data
Authors:
Edmond Awad,
Sydney Levine,
Andrea Loreggia,
Nicholas Mattei,
Iyad Rahwan,
Francesca Rossi,
Kartik Talamadupula,
Joshua Tenenbaum,
Max Kleiman-Weiner
Abstract:
One of the most remarkable things about the human moral mind is its flexibility. We can make moral judgments about cases we have never seen before. We can decide that pre-established rules should be broken. We can invent novel rules on the fly. Capturing this flexibility is one of the central challenges in developing AI systems that can interpret and produce human-like moral judgment. This paper d…
▽ More
One of the most remarkable things about the human moral mind is its flexibility. We can make moral judgments about cases we have never seen before. We can decide that pre-established rules should be broken. We can invent novel rules on the fly. Capturing this flexibility is one of the central challenges in developing AI systems that can interpret and produce human-like moral judgment. This paper details the results of a study of real-world decision makers who judge whether it is acceptable to break a well-established norm: ``no cutting in line.'' We gather data on how human participants judge the acceptability of line-cutting in a range of scenarios. Then, in order to effectively embed these reasoning capabilities into a machine, we propose a method for modeling them using a preference-based structure, which captures a novel modification to standard ``dual process'' theories of moral judgment.
△ Less
Submitted 19 January, 2022;
originally announced January 2022.
-
Artificial Intelligence as an Anti-Corruption Tool (AI-ACT) -- Potentials and Pitfalls for Top-down and Bottom-up Approaches
Authors:
Nils Köbis,
Christopher Starke,
Iyad Rahwan
Abstract:
Corruption continues to be one of the biggest societal challenges of our time. New hope is placed in Artificial Intelligence (AI) to serve as an unbiased anti-corruption agent. Ever more available (open) government data paired with unprecedented performance of such algorithms render AI the next frontier in anti-corruption. Summarizing existing efforts to use AI-based anti-corruption tools (AI-ACT)…
▽ More
Corruption continues to be one of the biggest societal challenges of our time. New hope is placed in Artificial Intelligence (AI) to serve as an unbiased anti-corruption agent. Ever more available (open) government data paired with unprecedented performance of such algorithms render AI the next frontier in anti-corruption. Summarizing existing efforts to use AI-based anti-corruption tools (AI-ACT), we introduce a conceptual framework to advance research and policy. It outlines why AI presents a unique tool for top-down and bottom-up anti-corruption approaches. For both approaches, we outline in detail how AI-ACT present different potentials and pitfalls for (a) input data, (b) algorithmic design, and (c) institutional implementation. Finally, we venture a look into the future and flesh out key questions that need to be addressed to develop AI-ACT while considering citizens' views, hence putting "society in the loop".
△ Less
Submitted 23 February, 2021;
originally announced February 2021.
-
Impossible by Conventional Means: Ten Years on from the DARPA Red Balloon Challenge
Authors:
Alex Rutherford,
Manuel Cebrian,
Inho Hong,
Iyad Rahwan
Abstract:
Ten years ago, DARPA launched the 'Network Challenge', more commonly known as the 'DARPA Red Balloon Challenge'. Ten red weather balloons were fixed at unknown locations in the US. An open challenge was launched to locate all ten, the first to do so would be declared the winner receiving a cash prize. A team from MIT Media Lab was able to locate them all within 9 hours using social media and a nov…
▽ More
Ten years ago, DARPA launched the 'Network Challenge', more commonly known as the 'DARPA Red Balloon Challenge'. Ten red weather balloons were fixed at unknown locations in the US. An open challenge was launched to locate all ten, the first to do so would be declared the winner receiving a cash prize. A team from MIT Media Lab was able to locate them all within 9 hours using social media and a novel reward scheme that rewarded viral recruitment. This achievement was rightly seen as proof of the remarkable ability of social media, then relatively nascent, to solve real world problems such as large-scale spatial search. Upon reflection, however, the challenge was also remarkable as it succeeded despite many efforts to provide false information on the location of the balloons. At the time the false reports were filtered based on manual inspection of visual proof and comparing the IP addresses of those reporting with the purported coordinates of the balloons. In the ten years since, misinformation on social media has grown in prevalence and sophistication to be one of the defining social issues of our time. Seen differently we can cast the misinformation observed in the Red Balloon Challenge, and unexpected adverse effects in other social mobilisation challenges subsequently, not as bugs but as essential features. We further investigate the role of the increasing levels of political polarisation in modulating social mobilisation. We confirm that polarisation not only impedes the overall success of mobilisation, but also leads to a low reachability to oppositely polarised states, significantly hampering recruitment. We find that diversifying geographic pathways of social influence are key to circumvent barriers of political mobilisation and can boost the success of new open challenges.
△ Less
Submitted 13 August, 2020;
originally announced August 2020.
-
SensitiveLoss: Improving Accuracy and Fairness of Face Representations with Discrimination-Aware Deep Learning
Authors:
Ignacio Serna,
Aythami Morales,
Julian Fierrez,
Manuel Cebrian,
Nick Obradovich,
Iyad Rahwan
Abstract:
We propose a discrimination-aware learning method to improve both accuracy and fairness of biased face recognition algorithms. The most popular face recognition benchmarks assume a distribution of subjects without paying much attention to their demographic attributes. In this work, we perform a comprehensive discrimination-aware experimentation of deep learning-based face recognition. We also prop…
▽ More
We propose a discrimination-aware learning method to improve both accuracy and fairness of biased face recognition algorithms. The most popular face recognition benchmarks assume a distribution of subjects without paying much attention to their demographic attributes. In this work, we perform a comprehensive discrimination-aware experimentation of deep learning-based face recognition. We also propose a general formulation of algorithmic discrimination with application to face biometrics. The experiments include tree popular face recognition models and three public databases composed of 64,000 identities from different demographic groups characterized by gender and ethnicity. We experimentally show that learning processes based on the most used face databases have led to popular pre-trained deep face models that present a strong algorithmic discrimination. We finally propose a discrimination-aware learning method, Sensitive Loss, based on the popular triplet loss function and a sensitive triplet generator. Our approach works as an add-on to pre-trained networks and is used to improve their performance in terms of average accuracy and fairness. The method shows results comparable to state-of-the-art de-biasing networks and represents a step forward to prevent discriminatory effects by automatic systems.
△ Less
Submitted 2 December, 2020; v1 submitted 22 April, 2020;
originally announced April 2020.
-
China's First Workforce Skill Taxonomy
Authors:
Weipan Xu,
Xiaozhen Qin,
Xun Li,
Haohui"Caron" Chen,
Morgan Frank,
Alex Rutherford,
Andrew Reeson,
Iyad Rahwan
Abstract:
China is the world's second largest economy. After four decades of economic miracles, China's economy is transitioning into an advanced, knowledge-based economy. Yet, we still lack a detailed understanding of the skills that underly the Chinese labor force, and the development and spatial distribution of these skills. For example, the US standardized skill taxonomy O*NET played an important role i…
▽ More
China is the world's second largest economy. After four decades of economic miracles, China's economy is transitioning into an advanced, knowledge-based economy. Yet, we still lack a detailed understanding of the skills that underly the Chinese labor force, and the development and spatial distribution of these skills. For example, the US standardized skill taxonomy O*NET played an important role in understanding the dynamics of manufacturing and knowledge-based work, as well as potential risks from automation and outsourcing. Here, we use Machine Learning techniques to bridge this gap, creating China's first workforce skill taxonomy, and map it to O*NET. This enables us to reveal workforce skill polarization into social-cognitive skills and sensory-physical skills, and to explore the China's regional inequality in light of workforce skills, and compare it to traditional metrics such as education. We build an online tool for the public and policy makers to explore the skill taxonomy: skills.sysu.edu.cn. We will also make the taxonomy dataset publicly available for other researchers upon publication.
△ Less
Submitted 9 January, 2020;
originally announced January 2020.
-
Algorithmic Discrimination: Formulation and Exploration in Deep Learning-based Face Biometrics
Authors:
Ignacio Serna,
Aythami Morales,
Julian Fierrez,
Manuel Cebrian,
Nick Obradovich,
Iyad Rahwan
Abstract:
The most popular face recognition benchmarks assume a distribution of subjects without much attention to their demographic attributes. In this work, we perform a comprehensive discrimination-aware experimentation of deep learning-based face recognition. The main aim of this study is focused on a better understanding of the feature space generated by deep models, and the performance achieved over d…
▽ More
The most popular face recognition benchmarks assume a distribution of subjects without much attention to their demographic attributes. In this work, we perform a comprehensive discrimination-aware experimentation of deep learning-based face recognition. The main aim of this study is focused on a better understanding of the feature space generated by deep models, and the performance achieved over different demographic groups. We also propose a general formulation of algorithmic discrimination with application to face biometrics. The experiments are conducted over the new DiveFace database composed of 24K identities from six different demographic groups. Two popular face recognition models are considered in the experimental framework: ResNet-50 and VGG-Face. We experimentally show that demographic groups highly represented in popular face databases have led to popular pre-trained deep face models presenting strong algorithmic discrimination. That discrimination can be observed both qualitatively at the feature space of the deep models and quantitatively in large performance differences when applying those models in different demographic groups, e.g. for face biometrics.
△ Less
Submitted 4 December, 2019;
originally announced December 2019.
-
Automation Impacts on China's Polarized Job Market
Authors:
Haohui 'Caron' Chen,
Xun Li,
Morgan Frank,
Xiaozhen Qin,
Weipan Xu,
Manuel Cebrian,
Iyad Rahwan
Abstract:
When facing threats from automation, a worker residing in a large Chinese city might not be as lucky as a worker in a large U.S. city, depending on the type of large city in which one resides. Empirical studies found that large U.S. cities exhibit resilience to automation impacts because of the increased occupational and skill specialization. However, in this study, we observe polarized responses…
▽ More
When facing threats from automation, a worker residing in a large Chinese city might not be as lucky as a worker in a large U.S. city, depending on the type of large city in which one resides. Empirical studies found that large U.S. cities exhibit resilience to automation impacts because of the increased occupational and skill specialization. However, in this study, we observe polarized responses in large Chinese cities to automation impacts. The polarization might be attributed to the elaborate master planning of the central government, through which cities are assigned with different industrial goals to achieve globally optimal economic success and, thus, a fast-growing economy. By dividing Chinese cities into two groups based on their administrative levels and premium resources allocated by the central government, we find that Chinese cities follow two distinct industrial development trajectories, one trajectory owning government support leads to a diversified industrial structure and, thus, a diversified job market, and the other leads to specialty cities and, thus, a specialized job market. By revisiting the automation impacts on a polarized job market, we observe a Simpson's paradox through which a larger city of a diversified job market results in greater resilience, whereas larger cities of specialized job markets are more susceptible. These findings inform policy makers to deploy appropriate policies to mitigate the polarized automation impacts.
△ Less
Submitted 15 August, 2019;
originally announced August 2019.
-
Human detection of machine manipulated media
Authors:
Matthew Groh,
Ziv Epstein,
Nick Obradovich,
Manuel Cebrian,
Iyad Rahwan
Abstract:
Recent advances in neural networks for content generation enable artificial intelligence (AI) models to generate high-quality media manipulations. Here we report on a randomized experiment designed to study the effect of exposure to media manipulations on over 15,000 individuals' ability to discern machine-manipulated media. We engineer a neural network to plausibly and automatically remove object…
▽ More
Recent advances in neural networks for content generation enable artificial intelligence (AI) models to generate high-quality media manipulations. Here we report on a randomized experiment designed to study the effect of exposure to media manipulations on over 15,000 individuals' ability to discern machine-manipulated media. We engineer a neural network to plausibly and automatically remove objects from images, and we deploy this neural network online with a randomized experiment where participants can guess which image out of a pair of images has been manipulated. The system provides participants feedback on the accuracy of each guess. In the experiment, we randomize the order in which images are presented, allowing causal identification of the learning curve surrounding participants' ability to detect fake content. We find sizable and robust evidence that individuals learn to detect fake content through exposure to manipulated media when provided iterative feedback on their detection attempts. Over a succession of only ten images, participants increase their rating accuracy by over ten percentage points. Our study provides initial evidence that human ability to detect fake, machine-generated content may increase alongside the prevalence of such media online.
△ Less
Submitted 8 November, 2019; v1 submitted 5 July, 2019;
originally announced July 2019.
-
Evaluating Style Transfer for Text
Authors:
Remi Mir,
Bjarke Felbo,
Nick Obradovich,
Iyad Rahwan
Abstract:
Research in the area of style transfer for text is currently bottlenecked by a lack of standard evaluation practices. This paper aims to alleviate this issue by experimentally identifying best practices with a Yelp sentiment dataset. We specify three aspects of interest (style transfer intensity, content preservation, and naturalness) and show how to obtain more reliable measures of them from huma…
▽ More
Research in the area of style transfer for text is currently bottlenecked by a lack of standard evaluation practices. This paper aims to alleviate this issue by experimentally identifying best practices with a Yelp sentiment dataset. We specify three aspects of interest (style transfer intensity, content preservation, and naturalness) and show how to obtain more reliable measures of them from human evaluation than in previous work. We propose a set of metrics for automated evaluation and demonstrate that they are more strongly correlated and in agreement with human judgment: direction-corrected Earth Mover's Distance, Word Mover's Distance on style-masked texts, and adversarial classification for the respective aspects. We also show that the three examined models exhibit tradeoffs between aspects of interest, demonstrating the importance of evaluating style transfer models at specific points of their tradeoff plots. We release software with our evaluation metrics to facilitate research.
△ Less
Submitted 3 April, 2019;
originally announced April 2019.
-
Towards a new social laboratory: An experimental study of search through community participation at Burning Man
Authors:
Ziv Epstein,
Micah Epstein,
Christian Almenar,
Matt Groh,
Niccolo Pescetelli,
Esteban Moro,
Nick Obradovich,
Manuel Cebrian,
Iyad Rahwan
Abstract:
The "small world phenomenon," popularized by Stanley Milgram, suggests that individuals from across a social network are connected via a short path of mutual friends and can leverage their local social information to efficiently traverse that network. Existing social search experiments are plagued by high rates of attrition, which prohibit comprehensive study of social search. We investigate this…
▽ More
The "small world phenomenon," popularized by Stanley Milgram, suggests that individuals from across a social network are connected via a short path of mutual friends and can leverage their local social information to efficiently traverse that network. Existing social search experiments are plagued by high rates of attrition, which prohibit comprehensive study of social search. We investigate this by conducting a small world experiment at Burning Man, an event located in the Black Rock Desert of Nevada, USA, known its unique social systems and community participation. We design location-tracking vessels that we routed through Burning Man towards the goal of finding a particular person. Along the way, the vessels logged individual information and GPS data. Two of fifteen vessels made it to their designated people, but a month after Burning Man. Our results suggest possible improvements to limit rates of attrition through community participation and a design methodology that emphasizes cultural practices to aid social experimentation.
△ Less
Submitted 11 March, 2019;
originally announced March 2019.
-
Price of Anarchy in Algorithmic Matching of Romantic Partners
Authors:
Andrés Abeliuk,
Khaled Elbassioni,
Talal Rahwan,
Manuel Cebrian,
Iyad Rahwan
Abstract:
Algorithmic-matching sites offer users access to an unprecedented number of potential mates. However, they also pose a principal-agent problem with a potential moral hazard. The agent's interest is to maximize usage of the Web site, while the principal's interest is to find the best possible romantic partners. This creates a conflict of interest: optimally matching users would lead to stable coupl…
▽ More
Algorithmic-matching sites offer users access to an unprecedented number of potential mates. However, they also pose a principal-agent problem with a potential moral hazard. The agent's interest is to maximize usage of the Web site, while the principal's interest is to find the best possible romantic partners. This creates a conflict of interest: optimally matching users would lead to stable couples and fewer singles using the site, which is detrimental for the online dating industry. Here, we borrow the notion of Price-of-Anarchy from game theory to quantify the decrease in social efficiency of online dating sites caused by the agent's self-interest. We derive theoretical bounds on the price-of-anarchy, showing it can be bounded by a constant that does not depend on the number of users of the dating site. This suggests that as online dating sites grow, their potential benefits scale up without sacrificing social efficiency. Further, we performed experiments involving human subjects in a matching market, and compared the social welfare achieved by an optimal matching service against a self-interest matching algorithm. We show that by introducing competition among dating sites, the selfish behavior of agents aligns with its users, and social efficiency increases.
△ Less
Submitted 15 February, 2019; v1 submitted 8 January, 2019;
originally announced January 2019.
-
A common trajectory recapitulated by urban economies
Authors:
Inho Hong,
Morgan R. Frank,
Iyad Rahwan,
Woo-Sung Jung,
Hyejin Youn
Abstract:
Is there a general economic pathway recapitulated by individual cities over and over? Identifying such evolution structure, if any, would inform models for the assessment, maintenance, and forecasting of urban sustainability and economic success as a quantitative baseline. This premise seems to contradict the existing body of empirical evidences for path-dependent growth shaping the unique history…
▽ More
Is there a general economic pathway recapitulated by individual cities over and over? Identifying such evolution structure, if any, would inform models for the assessment, maintenance, and forecasting of urban sustainability and economic success as a quantitative baseline. This premise seems to contradict the existing body of empirical evidences for path-dependent growth shaping the unique history of individual cities. And yet, recent empirical evidences and theoretical models have amounted to the universal patterns, mostly size-dependent, thereby expressing many of urban quantities as a set of simple scaling laws. Here, we provide a mathematical framework to integrate repeated cross-sectional data, each of which freezes in time dimension, into a frame of reference for longitudinal evolution of individual cities in time. Using data of over 100 millions employment in thousand business categories between 1998 and 2013, we decompose each city's evolution into a pre-factor and relative changes to eliminate national and global effects. In this way, we show the longitudinal dynamics of individual cities recapitulate the observed cross-sectional regularity. Larger cities are not only scaled-up versions of their smaller peers but also of their past. In addition, our model shows that both specialization and diversification are attributed to the distribution of industry's scaling exponents, resulting a critical population of 1.2 million at which a city makes an industrial transition into innovative economies.
△ Less
Submitted 18 October, 2018;
originally announced October 2018.
-
Closing the AI Knowledge Gap
Authors:
Ziv Epstein,
Blakeley H. Payne,
Judy Hanwen Shen,
Abhimanyu Dubey,
Bjarke Felbo,
Matthew Groh,
Nick Obradovich,
Manuel Cebrian,
Iyad Rahwan
Abstract:
AI researchers employ not only the scientific method, but also methodology from mathematics and engineering. However, the use of the scientific method - specifically hypothesis testing - in AI is typically conducted in service of engineering objectives. Growing interest in topics such as fairness and algorithmic bias show that engineering-focused questions only comprise a subset of the important q…
▽ More
AI researchers employ not only the scientific method, but also methodology from mathematics and engineering. However, the use of the scientific method - specifically hypothesis testing - in AI is typically conducted in service of engineering objectives. Growing interest in topics such as fairness and algorithmic bias show that engineering-focused questions only comprise a subset of the important questions about AI systems. This results in the AI Knowledge Gap: the number of unique AI systems grows faster than the number of studies that characterize these systems' behavior. To close this gap, we argue that the study of AI could benefit from the greater inclusion of researchers who are well positioned to formulate and test hypotheses about the behavior of AI systems. We examine the barriers preventing social and behavioral scientists from conducting such studies. Our diagnosis suggests that accelerating the scientific study of AI systems requires new incentives for academia and industry, mediated by new tools and institutions. To address these needs, we propose a two-sided marketplace called TuringBox. On one side, AI contributors upload existing and novel algorithms to be studied scientifically by others. On the other side, AI examiners develop and post machine intelligence tasks designed to evaluate and characterize algorithmic behavior. We discuss this market's potential to democratize the scientific study of AI behavior, and thus narrow the AI Knowledge Gap.
△ Less
Submitted 19 March, 2018;
originally announced March 2018.
-
Blaming humans in autonomous vehicle accidents: Shared responsibility across levels of automation
Authors:
Edmond Awad,
Sydney Levine,
Max Kleiman-Weiner,
Sohan Dsouza,
Joshua B. Tenenbaum,
Azim Shariff,
Jean-François Bonnefon,
Iyad Rahwan
Abstract:
When a semi-autonomous car crashes and harms someone, how are blame and causal responsibility distributed across the human and machine drivers? In this article, we consider cases in which a pedestrian was hit and killed by a car being operated under shared control of a primary and a secondary driver. We find that when only one driver makes an error, that driver receives the blame and is considered…
▽ More
When a semi-autonomous car crashes and harms someone, how are blame and causal responsibility distributed across the human and machine drivers? In this article, we consider cases in which a pedestrian was hit and killed by a car being operated under shared control of a primary and a secondary driver. We find that when only one driver makes an error, that driver receives the blame and is considered causally responsible for the harm, regardless of whether that driver is a machine or a human. However, when both drivers make errors in cases of shared control between a human and a machine, the blame and responsibility attributed to the machine is reduced. This finding portends a public under-reaction to the malfunctioning AI components of semi-autonomous cars and therefore has a direct policy implication: a bottom-up regulatory scheme (which operates through tort law that is adjudicated through the jury system) could fail to properly regulate the safety of shared-control vehicles; instead, a top-down scheme (enacted through federal laws) may be called for.
△ Less
Submitted 21 March, 2018; v1 submitted 19 March, 2018;
originally announced March 2018.
-
MemeSequencer: Sparse Matching for Embedding Image Macros
Authors:
Abhimanyu Dubey,
Esteban Moro,
Manuel Cebrian,
Iyad Rahwan
Abstract:
The analysis of the creation, mutation, and propagation of social media content on the Internet is an essential problem in computational social science, affecting areas ranging from marketing to political mobilization. A first step towards understanding the evolution of images online is the analysis of rapidly modifying and propagating memetic imagery or `memes'. However, a pitfall in proceeding w…
▽ More
The analysis of the creation, mutation, and propagation of social media content on the Internet is an essential problem in computational social science, affecting areas ranging from marketing to political mobilization. A first step towards understanding the evolution of images online is the analysis of rapidly modifying and propagating memetic imagery or `memes'. However, a pitfall in proceeding with such an investigation is the current incapability to produce a robust semantic space for such imagery, capable of understanding differences in Image Macros. In this study, we provide a first step in the systematic study of image evolution on the Internet, by proposing an algorithm based on sparse representations and deep learning to decouple various types of content in such images and produce a rich semantic embedding. We demonstrate the benefits of our approach on a variety of tasks pertaining to memes and Image Macros, such as image clustering, image retrieval, topic prediction and virality prediction, surpassing the existing methods on each. In addition to its utility on quantitative tasks, our method opens up the possibility of obtaining the first large-scale understanding of the evolution and propagation of memetic imagery.
△ Less
Submitted 13 February, 2018;
originally announced February 2018.
-
A Computational Model of Commonsense Moral Decision Making
Authors:
Richard Kim,
Max Kleiman-Weiner,
Andres Abeliuk,
Edmond Awad,
Sohan Dsouza,
Josh Tenenbaum,
Iyad Rahwan
Abstract:
We introduce a new computational model of moral decision making, drawing on a recent theory of commonsense moral learning via social dynamics. Our model describes moral dilemmas as a utility function that computes trade-offs in values over abstract moral dimensions, which provide interpretable parameter values when implemented in machine-led ethical decision-making. Moreover, characterizing the so…
▽ More
We introduce a new computational model of moral decision making, drawing on a recent theory of commonsense moral learning via social dynamics. Our model describes moral dilemmas as a utility function that computes trade-offs in values over abstract moral dimensions, which provide interpretable parameter values when implemented in machine-led ethical decision-making. Moreover, characterizing the social structures of individuals and groups as a hierarchical Bayesian model, we show that a useful description of an individual's moral values - as well as a group's shared values - can be inferred from a limited amount of observed data. Finally, we apply and evaluate our approach to data from the Moral Machine, a web application that collects human judgments on moral dilemmas involving autonomous vehicles.
△ Less
Submitted 12 January, 2018;
originally announced January 2018.
-
Analyzing gender inequality through large-scale Facebook advertising data
Authors:
David Garcia,
Yonas Mitike Kassa,
Angel Cuevas,
Manuel Cebrian,
Esteban Moro,
Iyad Rahwan,
Ruben Cuevas
Abstract:
Online social media are information resources that can have a transformative power in society. While the Web was envisioned as an equalizing force that allows everyone to access information, the digital divide prevents large amounts of people from being present online. Online social media in particular are prone to gender inequality, an important issue given the link between social media use and e…
▽ More
Online social media are information resources that can have a transformative power in society. While the Web was envisioned as an equalizing force that allows everyone to access information, the digital divide prevents large amounts of people from being present online. Online social media in particular are prone to gender inequality, an important issue given the link between social media use and employment. Understanding gender inequality in social media is a challenging task due to the necessity of data sources that can provide large-scale measurements across multiple countries. Here we show how the Facebook Gender Divide (FGD), a metric based on aggregated statistics of more than 1.4 Billion users in 217 countries, explains various aspects of worldwide gender inequality. Our analysis shows that the FGD encodes gender equality indices in education, health, and economic opportunity. We find gender differences in network externalities that suggest that using social media has an added value for women. Furthermore, we find that low values of the FGD are associated with increases in economic gender equality. Our results suggest that online social networks, while suffering evident gender imbalance, may lower the barriers that women have to access informational resources and help to narrow the economic gender gap.
△ Less
Submitted 24 March, 2019; v1 submitted 10 October, 2017;
originally announced October 2017.
-
A Voting-Based System for Ethical Decision Making
Authors:
Ritesh Noothigattu,
Snehalkumar 'Neil' S. Gaikwad,
Edmond Awad,
Sohan Dsouza,
Iyad Rahwan,
Pradeep Ravikumar,
Ariel D. Procaccia
Abstract:
We present a general approach to automating ethical decisions, drawing on machine learning and computational social choice. In a nutshell, we propose to learn a model of societal preferences, and, when faced with a specific ethical dilemma at runtime, efficiently aggregate those preferences to identify a desirable choice. We provide a concrete algorithm that instantiates our approach; some of its…
▽ More
We present a general approach to automating ethical decisions, drawing on machine learning and computational social choice. In a nutshell, we propose to learn a model of societal preferences, and, when faced with a specific ethical dilemma at runtime, efficiently aggregate those preferences to identify a desirable choice. We provide a concrete algorithm that instantiates our approach; some of its crucial steps are informed by a new theory of swap-dominance efficient voting rules. Finally, we implement and evaluate a system for ethical decision making in the autonomous vehicle domain, using preference data collected from 1.3 million people through the Moral Machine website.
△ Less
Submitted 18 December, 2018; v1 submitted 19 September, 2017;
originally announced September 2017.
-
Regulating Highly Automated Robot Ecologies: Insights from Three User Studies
Authors:
Wen Shen,
Alanoud Al Khemeiri,
Abdulla Almehrezi,
Wael Al Enezi,
Iyad Rahwan,
Jacob W. Crandall
Abstract:
Highly automated robot ecologies (HARE), or societies of independent autonomous robots or agents, are rapidly becoming an important part of much of the world's critical infrastructure. As with human societies, regulation, wherein a governing body designs rules and processes for the society, plays an important role in ensuring that HARE meet societal objectives. However, to date, a careful study of…
▽ More
Highly automated robot ecologies (HARE), or societies of independent autonomous robots or agents, are rapidly becoming an important part of much of the world's critical infrastructure. As with human societies, regulation, wherein a governing body designs rules and processes for the society, plays an important role in ensuring that HARE meet societal objectives. However, to date, a careful study of interactions between a regulator and HARE is lacking. In this paper, we report on three user studies which give insights into how to design systems that allow people, acting as the regulatory authority, to effectively interact with HARE. As in the study of political systems in which governments regulate human societies, our studies analyze how interactions between HARE and regulators are impacted by regulatory power and individual (robot or agent) autonomy. Our results show that regulator power, decision support, and adaptive autonomy can each diminish the social welfare of HARE, and hint at how these seemingly desirable mechanisms can be designed so that they become part of successful HARE.
△ Less
Submitted 7 August, 2017;
originally announced August 2017.
-
Using millions of emoji occurrences to learn any-domain representations for detecting sentiment, emotion and sarcasm
Authors:
Bjarke Felbo,
Alan Mislove,
Anders Søgaard,
Iyad Rahwan,
Sune Lehmann
Abstract:
NLP tasks are often limited by scarcity of manually annotated data. In social media sentiment analysis and related tasks, researchers have therefore used binarized emoticons and specific hashtags as forms of distant supervision. Our paper shows that by extending the distant supervision to a more diverse set of noisy labels, the models can learn richer representations. Through emoji prediction on a…
▽ More
NLP tasks are often limited by scarcity of manually annotated data. In social media sentiment analysis and related tasks, researchers have therefore used binarized emoticons and specific hashtags as forms of distant supervision. Our paper shows that by extending the distant supervision to a more diverse set of noisy labels, the models can learn richer representations. Through emoji prediction on a dataset of 1246 million tweets containing one of 64 common emojis we obtain state-of-the-art performance on 8 benchmark datasets within sentiment, emotion and sarcasm detection using a single pretrained model. Our analyses confirm that the diversity of our emotional labels yield a performance improvement over previous distant supervision approaches.
△ Less
Submitted 7 October, 2017; v1 submitted 1 August, 2017;
originally announced August 2017.
-
Society-in-the-Loop: Programming the Algorithmic Social Contract
Authors:
Iyad Rahwan
Abstract:
Recent rapid advances in Artificial Intelligence (AI) and Machine Learning have raised many questions about the regulatory and governance mechanisms for autonomous machines. Many commentators, scholars, and policy-makers now call for ensuring that algorithms governing our lives are transparent, fair, and accountable. Here, I propose a conceptual framework for the regulation of AI and algorithmic s…
▽ More
Recent rapid advances in Artificial Intelligence (AI) and Machine Learning have raised many questions about the regulatory and governance mechanisms for autonomous machines. Many commentators, scholars, and policy-makers now call for ensuring that algorithms governing our lives are transparent, fair, and accountable. Here, I propose a conceptual framework for the regulation of AI and algorithmic systems. I argue that we need tools to program, debug and maintain an algorithmic social contract, a pact between various human stakeholders, mediated by machines. To achieve this, we can adapt the concept of human-in-the-loop (HITL) from the fields of modeling and simulation, and interactive machine learning. In particular, I propose an agenda I call society-in-the-loop (SITL), which combines the HITL control paradigm with mechanisms for negotiating the values of various stakeholders affected by AI systems, and monitoring compliance with the agreement. In short, `SITL = HITL + Social Contract.'
△ Less
Submitted 25 July, 2017; v1 submitted 22 July, 2017;
originally announced July 2017.
-
Small cities face greater impact from automation
Authors:
Morgan R. Frank,
Lijun Sun,
Manuel Cebrian,
Hyejin Youn,
Iyad Rahwan
Abstract:
The city has proven to be the most successful form of human agglomeration and provides wide employment opportunities for its dwellers. As advances in robotics and artificial intelligence revive concerns about the impact of automation on jobs, a question looms: How will automation affect employment in cities? Here, we provide a comparative picture of the impact of automation across U.S. urban areas…
▽ More
The city has proven to be the most successful form of human agglomeration and provides wide employment opportunities for its dwellers. As advances in robotics and artificial intelligence revive concerns about the impact of automation on jobs, a question looms: How will automation affect employment in cities? Here, we provide a comparative picture of the impact of automation across U.S. urban areas. Small cities will undertake greater adjustments, such as worker displacement and job content substitutions. We demonstrate that large cities exhibit increased occupational and skill specialization due to increased abundance of managerial and technical professions. These occupations are not easily automatable, and, thus, reduce the potential impact of automation in large cities. Our results pass several robustness checks including potential errors in the estimation of occupational automation and sub-sampling of occupations. Our study provides the first empirical law connecting two societal forces: urban agglomeration and automation's impact on employment.
△ Less
Submitted 21 September, 2017; v1 submitted 16 May, 2017;
originally announced May 2017.
-
Cooperating with Machines
Authors:
Jacob W. Crandall,
Mayada Oudah,
Tennom,
Fatimah Ishowo-Oloko,
Sherief Abdallah,
Jean-François Bonnefon,
Manuel Cebrian,
Azim Shariff,
Michael A. Goodrich,
Iyad Rahwan
Abstract:
Since Alan Turing envisioned Artificial Intelligence (AI) [1], a major driving force behind technical progress has been competition with human cognition. Historical milestones have been frequently associated with computers matching or outperforming humans in difficult cognitive tasks (e.g. face recognition [2], personality classification [3], driving cars [4], or playing video games [5]), or defea…
▽ More
Since Alan Turing envisioned Artificial Intelligence (AI) [1], a major driving force behind technical progress has been competition with human cognition. Historical milestones have been frequently associated with computers matching or outperforming humans in difficult cognitive tasks (e.g. face recognition [2], personality classification [3], driving cars [4], or playing video games [5]), or defeating humans in strategic zero-sum encounters (e.g. Chess [6], Checkers [7], Jeopardy! [8], Poker [9], or Go [10]). In contrast, less attention has been given to developing autonomous machines that establish mutually cooperative relationships with people who may not share the machine's preferences. A main challenge has been that human cooperation does not require sheer computational power, but rather relies on intuition [11], cultural norms [12], emotions and signals [13, 14, 15, 16], and pre-evolved dispositions toward cooperation [17], common-sense mechanisms that are difficult to encode in machines for arbitrary contexts. Here, we combine a state-of-the-art machine-learning algorithm with novel mechanisms for generating and acting on signals to produce a new learning algorithm that cooperates with people and other machines at levels that rival human cooperation in a variety of two-player repeated stochastic games. This is the first general-purpose algorithm that is capable, given a description of a previously unseen game environment, of learning to cooperate with people within short timescales in scenarios previously unanticipated by algorithm designers. This is achieved without complex opponent modeling or higher-order theories of mind, thus showing that flexible, fast, and general human-machine cooperation is computationally achievable using a non-trivial, but ultimately simple, set of algorithmic mechanisms.
△ Less
Submitted 21 February, 2018; v1 submitted 17 March, 2017;
originally announced March 2017.
-
Superintelligence cannot be contained: Lessons from Computability Theory
Authors:
Manuel Alfonseca,
Manuel Cebrian,
Antonio Fernandez Anta,
Lorenzo Coviello,
Andres Abeliuk,
Iyad Rahwan
Abstract:
Superintelligence is a hypothetical agent that possesses intelligence far surpassing that of the brightest and most gifted human minds. In light of recent advances in machine intelligence, a number of scientists, philosophers and technologists have revived the discussion about the potential catastrophic risks entailed by such an entity. In this article, we trace the origins and development of the…
▽ More
Superintelligence is a hypothetical agent that possesses intelligence far surpassing that of the brightest and most gifted human minds. In light of recent advances in machine intelligence, a number of scientists, philosophers and technologists have revived the discussion about the potential catastrophic risks entailed by such an entity. In this article, we trace the origins and development of the neo-fear of superintelligence, and some of the major proposals for its containment. We argue that such containment is, in principle, impossible, due to fundamental limits inherent to computing itself. Assuming that a superintelligence will contain a program that includes all the programs that can be executed by a universal Turing machine on input potentially as complex as the state of the world, strict containment requires simulations of such a program, something theoretically (and practically) infeasible.
△ Less
Submitted 4 July, 2016;
originally announced July 2016.
-
Inferring Mechanisms for Global Constitutional Progress
Authors:
Alex Rutherford,
Yonatan Lupu,
Manuel Cebrian,
Iyad Rahwan,
Brad LeVeck,
Manuel Garcia-Herranz
Abstract:
Constitutions help define domestic political orders, but are known to be influenced by two international mechanisms: one that reflects global temporal trends in legal development, and another that reflects international network dynamics such as shared colonial history. We introduce the provision space; the growing set of all legal provisions existing in the world's constitutions over time. Through…
▽ More
Constitutions help define domestic political orders, but are known to be influenced by two international mechanisms: one that reflects global temporal trends in legal development, and another that reflects international network dynamics such as shared colonial history. We introduce the provision space; the growing set of all legal provisions existing in the world's constitutions over time. Through this we uncover a third mechanism influencing constitutional change: hierarchical dependencies between legal provisions, under which the adoption of essential, fundamental provisions precedes more advanced provisions. This third mechanism appears to play an especially important role in the emergence of new political rights, and may therefore provide a useful roadmap for advocates of those rights. We further characterise each legal provision in terms of the strength of these mechanisms.
△ Less
Submitted 13 July, 2017; v1 submitted 13 June, 2016;
originally announced June 2016.
-
Pareto Optimality and Strategy Proofness in Group Argument Evaluation (Extended Version)
Authors:
Edmond Awad,
Martin Caminada,
Gabriella Pigozzi,
Mikołaj Podlaszewski,
Iyad Rahwan
Abstract:
An inconsistent knowledge base can be abstracted as a set of arguments and a defeat relation among them. There can be more than one consistent way to evaluate such an argumentation graph. Collective argument evaluation is the problem of aggregating the opinions of multiple agents on how a given set of arguments should be evaluated. It is crucial not only to ensure that the outcome is logically con…
▽ More
An inconsistent knowledge base can be abstracted as a set of arguments and a defeat relation among them. There can be more than one consistent way to evaluate such an argumentation graph. Collective argument evaluation is the problem of aggregating the opinions of multiple agents on how a given set of arguments should be evaluated. It is crucial not only to ensure that the outcome is logically consistent, but also satisfies measures of social optimality and immunity to strategic manipulation. This is because agents have their individual preferences about what the outcome ought to be. In the current paper, we analyze three previously introduced argument-based aggregation operators with respect to Pareto optimality and strategy proofness under different general classes of agent preferences. We highlight fundamental trade-offs between strategic manipulability and social optimality on one hand, and classical logical criteria on the other. Our results motivate further investigation into the relationship between social choice and argumentation theory. The results are also relevant for choosing an appropriate aggregation operator given the criteria that are considered more important, as well as the nature of agents' preferences.
△ Less
Submitted 7 April, 2017; v1 submitted 3 April, 2016;
originally announced April 2016.
-
Experimental Assessment of Aggregation Principles in Argumentation-enabled Collective Intelligence
Authors:
Edmond Awad,
Jean-François Bonnefon,
Martin Caminada,
Thomas Malone,
Iyad Rahwan
Abstract:
On the Web, there is always a need to aggregate opinions from the crowd (as in posts, social networks, forums, etc.). Different mechanisms have been implemented to capture these opinions such as "Like" in Facebook, "Favorite" in Twitter, thumbs-up/down, flagging, and so on. However, in more contested domains (e.g. Wikipedia, political discussion, and climate change discussion) these mechanisms are…
▽ More
On the Web, there is always a need to aggregate opinions from the crowd (as in posts, social networks, forums, etc.). Different mechanisms have been implemented to capture these opinions such as "Like" in Facebook, "Favorite" in Twitter, thumbs-up/down, flagging, and so on. However, in more contested domains (e.g. Wikipedia, political discussion, and climate change discussion) these mechanisms are not sufficient since they only deal with each issue independently without considering the relationships between different claims. We can view a set of conflicting arguments as a graph in which the nodes represent arguments and the arcs between these nodes represent the defeat relation. A group of people can then collectively evaluate such graphs. To do this, the group must use a rule to aggregate their individual opinions about the entire argument graph. Here, we present the first experimental evaluation of different principles commonly employed by aggregation rules presented in the literature. We use randomized controlled experiments to investigate which principles people consider better at aggregating opinions under different conditions. Our analysis reveals a number of factors, not captured by traditional formal models, that play an important role in determining the efficacy of aggregation. These results help bring formal models of argumentation closer to real-world application.
△ Less
Submitted 12 February, 2017; v1 submitted 3 April, 2016;
originally announced April 2016.
-
The social dilemma of autonomous vehicles
Authors:
Jean-François Bonnefon,
Azim Shariff,
Iyad Rahwan
Abstract:
Autonomous Vehicles (AVs) should reduce traffic accidents, but they will sometimes have to choose between two evils-for example, running over pedestrians or sacrificing itself and its passenger to save them. Defining the algorithms that will help AVs make these moral decisions is a formidable challenge. We found that participants to six MTurk studies approved of utilitarian AVs (that sacrifice the…
▽ More
Autonomous Vehicles (AVs) should reduce traffic accidents, but they will sometimes have to choose between two evils-for example, running over pedestrians or sacrificing itself and its passenger to save them. Defining the algorithms that will help AVs make these moral decisions is a formidable challenge. We found that participants to six MTurk studies approved of utilitarian AVs (that sacrifice their passengers for the greater good), and would like others to buy them, but they would themselves prefer to ride in AVs that protect their passengers at all costs. They would disapprove of enforcing utilitarian AVs, and would be less willing to buy such a regulated AV. Accordingly, regulating for utilitarian algorithms may paradoxically increase casualties by postponing the adoption of a safer technology.
△ Less
Submitted 4 July, 2016; v1 submitted 12 October, 2015;
originally announced October 2015.
-
Limits of Friendship Networks in Predicting Epidemic Risk
Authors:
Lorenzo Coviello,
Massimo Franceschetti,
Manuel Garcia-Herranz,
Iyad Rahwan
Abstract:
The spread of an infection on a real-world social network is determined by the interplay of two processes: the dynamics of the network, whose structure changes over time according to the encounters between individuals, and the dynamics on the network, whose nodes can infect each other after an encounter. Physical encounter is the most common vehicle for the spread of infectious diseases, but detai…
▽ More
The spread of an infection on a real-world social network is determined by the interplay of two processes: the dynamics of the network, whose structure changes over time according to the encounters between individuals, and the dynamics on the network, whose nodes can infect each other after an encounter. Physical encounter is the most common vehicle for the spread of infectious diseases, but detailed information about encounters is often unavailable because expensive, unpractical to collect or privacy sensitive. We asks whether the friendship ties between the individuals in a social network successfully predict who is at risk. Using a dataset from a popular online review service, we build a time-varying network that is a proxy of physical encounter between users and a static network based on reported friendship. Through computer simulations, we compare infection processes on the resulting networks and show that, whereas distance on the friendship network is correlated to epidemic risk, friendship provides a poor identification of the individuals at risk if the infection is driven by physical encounter. Such limit is not due to the randomness of the infection, but to the structural differences of the two networks. In contrast to the macroscopic similarity between processes spreading on different networks, the differences in local connectivity determined by the two definitions of edges result in striking differences between the dynamics at a microscopic level. Despite the limits highlighted, we show that periodical and relatively infrequent monitoring of the real infection on the encounter network allows to correct the predicted infection on the friendship network and to achieve satisfactory prediction accuracy. In addition, the friendship network contains valuable information to effectively contain epidemic outbreaks when a limited budget is available for immunization.
△ Less
Submitted 27 October, 2015; v1 submitted 28 September, 2015;
originally announced September 2015.
-
Beyond Contagion: Reality Mining Reveals Complex Patterns of Social Influence
Authors:
Aamena Alshamsi,
Fabio Pianesi,
Bruno Lepri,
Alex Pentland,
Iyad Rahwan
Abstract:
Contagion, a concept from epidemiology, has long been used to characterize social influence on people's behavior and affective (emotional) states. While it has revealed many useful insights, it is not clear whether the contagion metaphor is sufficient to fully characterize the complex dynamics of psychological states in a social context. Using wearable sensors that capture daily face-to-face inter…
▽ More
Contagion, a concept from epidemiology, has long been used to characterize social influence on people's behavior and affective (emotional) states. While it has revealed many useful insights, it is not clear whether the contagion metaphor is sufficient to fully characterize the complex dynamics of psychological states in a social context. Using wearable sensors that capture daily face-to-face interaction, combined with three daily experience sampling surveys, we collected the most comprehensive data set of personality and emotion dynamics of an entire community of work. From this high-resolution data about actual (rather than self-reported) face-to-face interaction, a complex picture emerges where contagion (that can be seen as adaptation of behavioral responses to the behavior of other people) cannot fully capture the dynamics of transitory states. We found that social influence has two opposing effects on states: \emph{adaptation} effects that go beyond mere contagion, and \emph{complementarity} effects whereby individuals' behaviors tend to complement the behaviors of others. Surprisingly, these effects can exhibit completely different directions depending on the stable personality or emotional dispositions (stable traits) of target individuals. Our findings provide a foundation for richer models of social dynamics, and have implications on organizational engineering and workplace well-being.
△ Less
Submitted 15 July, 2015;
originally announced July 2015.
-
Analytical reasoning task reveals limits of social learning in networks
Authors:
Iyad Rahwan,
Dmytro Krasnoshtan,
Azim Shariff,
Jean-Francois Bonnefon
Abstract:
Social learning -by observing and copying others- is a highly successful cultural mechanism for adaptation, outperforming individual information acquisition and experience. Here, we investigate social learning in the context of the uniquely human capacity for reflective, analytical reasoning. A hallmark of the human mind is our ability to engage analytical reasoning, and suppress false associative…
▽ More
Social learning -by observing and copying others- is a highly successful cultural mechanism for adaptation, outperforming individual information acquisition and experience. Here, we investigate social learning in the context of the uniquely human capacity for reflective, analytical reasoning. A hallmark of the human mind is our ability to engage analytical reasoning, and suppress false associative intuitions. Through a set of lab-based network experiments, we find that social learning fails to propagate this cognitive strategy. When people make false intuitive conclusions, and are exposed to the analytic output of their peers, they recognize and adopt this correct output. But they fail to engage analytical reasoning in similar subsequent tasks. Thus, humans exhibit an 'unreflective copying bias,' which limits their social learning to the output, rather than the process, of their peers' reasoning -even when doing so requires minimal effort and no technical skill. In contrast to much recent work on observation-based social learning, which emphasizes the propagation of successful behavior through copying, our findings identify a limit on the power of social networks in situations that require analytical reasoning.
△ Less
Submitted 29 June, 2014;
originally announced June 2014.
-
Judgment Aggregation in Multi-Agent Argumentation
Authors:
Edmond Awad,
Richard Booth,
Fernando Tohme,
Iyad Rahwan
Abstract:
Given a set of conflicting arguments, there can exist multiple plausible opinions about which arguments should be accepted, rejected, or deemed undecided. We study the problem of how multiple such judgments can be aggregated. We define the problem by adapting various classical social-choice-theoretic properties for the argumentation domain. We show that while argument-wise plurality voting satisfi…
▽ More
Given a set of conflicting arguments, there can exist multiple plausible opinions about which arguments should be accepted, rejected, or deemed undecided. We study the problem of how multiple such judgments can be aggregated. We define the problem by adapting various classical social-choice-theoretic properties for the argumentation domain. We show that while argument-wise plurality voting satisfies many properties, it fails to guarantee the collective rationality of the outcome, and struggles with ties. We then present more general results, proving multiple impossibility results on the existence of any good aggregation operator. After characterising the sufficient and necessary conditions for satisfying collective rationality, we study whether restricting the domain of argument-wise plurality voting to classical semantics allows us to escape the impossibility result. We close by listing graph-theoretic restrictions under which argument-wise plurality rule does produce collectively rational outcomes. In addition to identifying fundamental barriers to collective argument evaluation, our results open up the door for a new research agenda for the argumentation and computational social choice communities.
△ Less
Submitted 19 July, 2015; v1 submitted 26 May, 2014;
originally announced May 2014.
-
Learning in Repeated Games: Human Versus Machine
Authors:
Fatimah Ishowo-Oloko,
Jacob Crandall,
Manuel Cebrian,
Sherief Abdallah,
Iyad Rahwan
Abstract:
While Artificial Intelligence has successfully outperformed humans in complex combinatorial games (such as chess and checkers), humans have retained their supremacy in social interactions that require intuition and adaptation, such as cooperation and coordination games. Despite significant advances in learning algorithms, most algorithms adapt at times scales which are not relevant for interaction…
▽ More
While Artificial Intelligence has successfully outperformed humans in complex combinatorial games (such as chess and checkers), humans have retained their supremacy in social interactions that require intuition and adaptation, such as cooperation and coordination games. Despite significant advances in learning algorithms, most algorithms adapt at times scales which are not relevant for interactions with humans, and therefore the advances in AI on this front have remained of a more theoretical nature. This has also hindered the experimental evaluation of how these algorithms perform against humans, as the length of experiments needed to evaluate them is beyond what humans are reasonably expected to endure (max 100 repetitions). This scenario is rapidly changing, as recent algorithms are able to converge to their functional regimes in shorter time-scales. Additionally, this shift opens up possibilities for experimental investigation: where do humans stand compared with these new algorithms? We evaluate humans experimentally against a representative element of these fast-converging algorithms. Our results indicate that the performance of at least one of these algorithms is comparable to, and even exceeds, the performance of people.
△ Less
Submitted 19 April, 2014;
originally announced April 2014.
-
Corruption Drives the Emergence of Civil Society
Authors:
Sherief Abdallah,
Rasha Sayed,
Iyad Rahwan,
Brad LeVeck,
Manuel Cebrian,
Alex Rutherford,
James Fowler
Abstract:
Peer punishment of free-riders (defectors) is a key mechanism for promoting cooperation in society. However, it is highly unstable since some cooperators may contribute to a common project but refuse to punish defectors. Centralized sanctioning institutions (for example, tax-funded police and criminal courts) can solve this problem by punishing both defectors and cooperators who refuse to punish.…
▽ More
Peer punishment of free-riders (defectors) is a key mechanism for promoting cooperation in society. However, it is highly unstable since some cooperators may contribute to a common project but refuse to punish defectors. Centralized sanctioning institutions (for example, tax-funded police and criminal courts) can solve this problem by punishing both defectors and cooperators who refuse to punish. These institutions have been shown to emerge naturally through social learning and then displace all other forms of punishment, including peer punishment. However, this result provokes a number of questions. If centralized sanctioning is so successful, then why do many highly authoritarian states suffer from low levels of cooperation? Why do states with high levels of public good provision tend to rely more on citizen-driven peer punishment? And what happens if centralized institutions can be circumvented by individual acts of bribery? Here, we consider how corruption influences the evolution of cooperation and punishment. Our model shows that the effectiveness of centralized punishment in promoting cooperation breaks down when some actors in the model are allowed to bribe centralized authorities. Counterintuitively, increasing the sanctioning power of the central institution makes things even worse, since this prevents peer punishers from playing a role in maintaining cooperation. As a result, a weaker centralized authority is actually more effective because it allows peer punishment to restore cooperation in the presence of corruption. Our results provide an evolutionary rationale for why public goods provision rarely flourishes in polities that rely only on strong centralized institutions. Instead, cooperation requires both decentralized and centralized enforcement. These results help to explain why citizen participation is a fundamental necessity for policing the commons.
△ Less
Submitted 1 September, 2013; v1 submitted 25 July, 2013;
originally announced July 2013.
-
Targeted Social Mobilisation in a Global Manhunt
Authors:
Alex Rutherford,
Manuel Cebrian,
Iyad Rahwan,
Sohan Dsouza,
James McInerney,
Victor Naroditskiy,
Matteo Venanzi,
Nicholas R. Jennings,
J. R. deLara,
Eero Wahlstedt,
Steven U. Miller
Abstract:
Social mobilization, the ability to mobilize large numbers of people via social networks to achieve highly distributed tasks, has received significant attention in recent times. This growing capability, facilitated by modern communication technology, is highly relevant to endeavors which require the search for individuals that posses rare information or skill, such as finding medical doctors durin…
▽ More
Social mobilization, the ability to mobilize large numbers of people via social networks to achieve highly distributed tasks, has received significant attention in recent times. This growing capability, facilitated by modern communication technology, is highly relevant to endeavors which require the search for individuals that posses rare information or skill, such as finding medical doctors during disasters, or searching for missing people. An open question remains, as to whether in time-critical situations, people are able to recruit in a targeted manner, or whether they resort to so-called blind search, recruiting as many acquaintances as possible via broadcast communication. To explore this question, we examine data from our recent success in the U.S. State Department's Tag Challenge, which required locating and photographing 5 target persons in 5 different cities in the United States and Europe in less than 12 hours, based only on a single mug-shot. We find that people are able to consistently route information in a targeted fashion even under increasing time pressure. We derive an analytical model for global mobilization and use it to quantify the extent to which people were targeting others during recruitment. Our model estimates that approximately 1 in 3 messages were of targeted fashion during the most time-sensitive period of the challenge.This is a novel observation at such short temporal scales, and calls for opportunities for devising viral incentive schemes that provide distance- or time-sensitive rewards to approach the target geography more rapidly, with applications in multiple areas from emergency preparedness, to political mobilization.
△ Less
Submitted 6 April, 2014; v1 submitted 18 April, 2013;
originally announced April 2013.
-
Time Critical Social Mobilization: The DARPA Network Challenge Winning Strategy
Authors:
Galen Pickard,
Iyad Rahwan,
Wei Pan,
Manuel Cebrian,
Riley Crane,
Anmol Madan,
Alex Pentland
Abstract:
It is now commonplace to see the Web as a platform that can harness the collective abilities of large numbers of people to accomplish tasks with unprecedented speed, accuracy and scale. To push this idea to its limit, DARPA launched its Network Challenge, which aimed to "explore the roles the Internet and social networking play in the timely communication, wide-area team-building, and urgent mobil…
▽ More
It is now commonplace to see the Web as a platform that can harness the collective abilities of large numbers of people to accomplish tasks with unprecedented speed, accuracy and scale. To push this idea to its limit, DARPA launched its Network Challenge, which aimed to "explore the roles the Internet and social networking play in the timely communication, wide-area team-building, and urgent mobilization required to solve broad-scope, time-critical problems." The challenge required teams to provide coordinates of ten red weather balloons placed at different locations in the continental United States. This large-scale mobilization required the ability to spread information about the tasks widely and quickly, and to incentivize individuals to act. We report on the winning team's strategy, which utilized a novel recursive incentive mechanism to find all balloons in under nine hours. We analyze the theoretical properties of the mechanism, and present data about its performance in the challenge.
△ Less
Submitted 18 August, 2010;
originally announced August 2010.