-
When LLMs Play the Telephone Game: Cumulative Changes and Attractors in Iterated Cultural Transmissions
Authors:
Jérémy Perez,
Corentin Léger,
Grgur Kovač,
Cédric Colas,
Gaia Molinaro,
Maxime Derex,
Pierre-Yves Oudeyer,
Clément Moulin-Frier
Abstract:
As large language models (LLMs) start interacting with each other and generating an increasing amount of text online, it becomes crucial to better understand how information is transformed as it passes from one LLM to the next. While significant research has examined individual LLM behaviors, existing studies have largely overlooked the collective behaviors and information distortions arising from…
▽ More
As large language models (LLMs) start interacting with each other and generating an increasing amount of text online, it becomes crucial to better understand how information is transformed as it passes from one LLM to the next. While significant research has examined individual LLM behaviors, existing studies have largely overlooked the collective behaviors and information distortions arising from iterated LLM interactions. Small biases, negligible at the single output level, risk being amplified in iterated interactions, potentially leading the content to evolve towards attractor states. In a series of telephone game experiments, we apply a transmission chain design borrowed from the human cultural evolution literature: LLM agents iteratively receive, produce, and transmit texts from the previous to the next agent in the chain. By tracking the evolution of text toxicity, positivity, difficulty, and length across transmission chains, we uncover the existence of biases and attractors, and study their dependence on the initial text, the instructions, language model, and model size. For instance, we find that more open-ended instructions lead to stronger attraction effects compared to more constrained tasks. We also find that different text properties display different sensitivity to attraction effects, with toxicity leading to stronger attractors than length. These findings highlight the importance of accounting for multi-step transmission dynamics and represent a first step towards a more comprehensive understanding of LLM cultural dynamics.
△ Less
Submitted 5 July, 2024;
originally announced July 2024.
-
Machine Culture
Authors:
Levin Brinkmann,
Fabian Baumann,
Jean-François Bonnefon,
Maxime Derex,
Thomas F. Müller,
Anne-Marie Nussberger,
Agnieszka Czaplicka,
Alberto Acerbi,
Thomas L. Griffiths,
Joseph Henrich,
Joel Z. Leibo,
Richard McElreath,
Pierre-Yves Oudeyer,
Jonathan Stray,
Iyad Rahwan
Abstract:
The ability of humans to create and disseminate culture is often credited as the single most important factor of our success as a species. In this Perspective, we explore the notion of machine culture, culture mediated or generated by machines. We argue that intelligent machines simultaneously transform the cultural evolutionary processes of variation, transmission, and selection. Recommender algo…
▽ More
The ability of humans to create and disseminate culture is often credited as the single most important factor of our success as a species. In this Perspective, we explore the notion of machine culture, culture mediated or generated by machines. We argue that intelligent machines simultaneously transform the cultural evolutionary processes of variation, transmission, and selection. Recommender algorithms are altering social learning dynamics. Chatbots are forming a new mode of cultural transmission, serving as cultural models. Furthermore, intelligent machines are evolving as contributors in generating cultural traits--from game strategies and visual art to scientific results. We provide a conceptual framework for studying the present and anticipated future impact of machines on cultural evolution, and present a research agenda for the study of machine culture.
△ Less
Submitted 22 November, 2023; v1 submitted 19 November, 2023;
originally announced November 2023.
-
Convergence of knowledge in a cultural evolution model with population structure, random social learning and credibility biases
Authors:
Sylvain Billiard,
Maxime Derex,
Ludovic Maisonneuve,
Thomas Rey
Abstract:
Understanding how knowledge is created and propagates within groups is crucial to explain how human populations have evolved through time. Anthropologists have relied on different theoretical models to address this question. In this work, we introduce a mathematically oriented model that shares properties with individual based approaches, inhomogeneous Markov chains and learning algorithms, such a…
▽ More
Understanding how knowledge is created and propagates within groups is crucial to explain how human populations have evolved through time. Anthropologists have relied on different theoretical models to address this question. In this work, we introduce a mathematically oriented model that shares properties with individual based approaches, inhomogeneous Markov chains and learning algorithms, such as those introduced in [F. Cucker, S. Smale, Bull. Amer. Math. Soc., 39 (1), 2002] and [F. Cucker, S. Smale and D.~X Zhou, Found. Comput. Math., 2004]. After deriving the model, we study some of its mathematical properties, and establish theoretical and quantitative results in a simplified case. Finally, we run numerical simulations to illustrate some properties of the model.
△ Less
Submitted 13 November, 2019;
originally announced November 2019.
