-
Beyond the Meta: Leveraging Game Design Parameters for Patch-Agnostic Esport Analytics
Authors:
Alan Pedrassoli Chitayat,
Florian Block,
James Walker,
Anders Drachen
Abstract:
Esport games comprise a sizeable fraction of the global games market, and is the fastest growing segment in games. This has given rise to the domain of esports analytics, which uses telemetry data from games to inform players, coaches, broadcasters and other stakeholders. Compared to traditional sports, esport titles change rapidly, in terms of mechanics as well as rules. Due to these frequent cha…
▽ More
Esport games comprise a sizeable fraction of the global games market, and is the fastest growing segment in games. This has given rise to the domain of esports analytics, which uses telemetry data from games to inform players, coaches, broadcasters and other stakeholders. Compared to traditional sports, esport titles change rapidly, in terms of mechanics as well as rules. Due to these frequent changes to the parameters of the game, esport analytics models can have a short life-spam, a problem which is largely ignored within the literature. This paper extracts information from game design (i.e. patch notes) and utilises clustering techniques to propose a new form of character representation. As a case study, a neural network model is trained to predict the number of kills in a Dota 2 match utilising this novel character representation technique. The performance of this model is then evaluated against two distinct baselines, including conventional techniques. Not only did the model significantly outperform the baselines in terms of accuracy (85% AUC), but the model also maintains the accuracy in two newer iterations of the game that introduced one new character and a brand new character type. These changes introduced to the design of the game would typically break conventional techniques that are commonly used within the literature. Therefore, the proposed methodology for representing characters can increase the life-spam of machine learning models as well as contribute to a higher performance when compared to traditional techniques typically employed within the literature.
△ Less
Submitted 16 August, 2023; v1 submitted 29 May, 2023;
originally announced May 2023.
-
Approximating the Manifold Structure of Attributed Incentive Salience from Large Scale Behavioural Data. A Representation Learning Approach Based on Artificial Neural Networks
Authors:
Valerio Bonometti,
Mathieu J. Ruiz,
Anders Drachen,
Alex Wade
Abstract:
Incentive salience attribution can be understood as a psychobiological mechanism ascribing relevance to potentially rewarding objects and actions. Despite being an important component of the motivational process guiding our everyday behaviour its study in naturalistic contexts is not straightforward. Here we propose a methodology based on artificial neural networks (ANNs) for approximating latent…
▽ More
Incentive salience attribution can be understood as a psychobiological mechanism ascribing relevance to potentially rewarding objects and actions. Despite being an important component of the motivational process guiding our everyday behaviour its study in naturalistic contexts is not straightforward. Here we propose a methodology based on artificial neural networks (ANNs) for approximating latent states produced by this process in situations where large volumes of behavioural data are available but no experimental control is possible. Leveraging knowledge derived from theoretical and computational accounts of incentive salience attribution we designed an ANN for estimating duration and intensity of future interactions between individuals and a series of video games in a large-scale ($N> 3 \times 10^6$) longitudinal dataset. We found video games to be the ideal context for developing such methodology due to their reliance on reward mechanics and their ability to provide ecologically robust behavioural measures at scale. When compared to competing approaches our methodology produces representations that are better suited for predicting the intensity future behaviour and approximating some functional properties of attributed incentive salience. We discuss our findings with reference to the adopted theoretical and computational frameworks and suggest how our methodology could be an initial step for estimating attributed incentive salience in large scale behavioural studies.
△ Less
Submitted 26 May, 2022; v1 submitted 3 August, 2021;
originally announced August 2021.
-
Do Influencers Influence? -- Analyzing Players' Activity in an Online Multiplayer Game
Authors:
Enrica Loria,
Johanna Pirker,
Anders Drachen,
Annapaola Marconi
Abstract:
In social and online media, influencers have traditionally been understood as highly visible individuals. Recent outcomes suggest that people are likely to mimic influencers' behavior, which can be exploited, for instance, in marketing strategies. Also in the Games User Research field, the interest in studying player social networks has emerged due to the heavy reliance on online influencers in ma…
▽ More
In social and online media, influencers have traditionally been understood as highly visible individuals. Recent outcomes suggest that people are likely to mimic influencers' behavior, which can be exploited, for instance, in marketing strategies. Also in the Games User Research field, the interest in studying player social networks has emerged due to the heavy reliance on online influencers in marketing campaigns for games, as well as in keeping players engaged. Despite the inherent value of those individuals, it is still difficult to identify influencers, as the definition of influencers is a debated topic. Thus, how can we identify influencers, and are they indeed the individuals impacting others' behavior? In this work, we focus on influence in retention to verify whether central players impacted others' permanence in the game. We identified the central players in the social network built from the competitive player-vs-player (PvP) multiplayer (Crucible) matches in the online shooter Destiny. Then, we computed influence scores for each player evaluating the increase in similarity over time between two connected individuals. In this paper, we were able to show the first indications that the traditional metrics for influencers do not necessarily apply for games. On the contrary, we found that the group of central players was distinct from the group of influential players, defined as the individuals with the highest influence scores. Then, we provide an analysis of the two groups.
△ Less
Submitted 1 June, 2020;
originally announced June 2020.
-
From Theory to Behaviour: Towards a General Model of Engagement
Authors:
Valerio Bonometti,
Charles Ringer,
Mathieu Ruiz,
Alex Wade,
Anders Drachen
Abstract:
Engagement is a fuzzy concept. In the present work we operationalize engagement mechanistically by linking it directly to human behaviour and show that the construct of engagement can be used for shaping and interpreting data-driven methods. First we outline a formal framework for engagement modelling. Second we expanded on our previous work on theory-inspired data-driven approaches to better mode…
▽ More
Engagement is a fuzzy concept. In the present work we operationalize engagement mechanistically by linking it directly to human behaviour and show that the construct of engagement can be used for shaping and interpreting data-driven methods. First we outline a formal framework for engagement modelling. Second we expanded on our previous work on theory-inspired data-driven approaches to better model the engagement process by proposing a new modelling technique, the Melchoir Model. Third, we illustrate how, through model comparison and inspection, we can link machine-learned models and underlying theoretical frameworks. Finally we discuss our results in light of a theory-driven hypothesis and highlight potential application of our work in industry.
△ Less
Submitted 27 April, 2020;
originally announced April 2020.
-
Time to Die: Death Prediction in Dota 2 using Deep Learning
Authors:
Adam Katona,
Ryan Spick,
Victoria Hodge,
Simon Demediuk,
Florian Block,
Anders Drachen,
James Alfred Walker
Abstract:
Esports have become major international sports with hundreds of millions of spectators. Esports games generate massive amounts of telemetry data. Using these to predict the outcome of esports matches has received considerable attention, but micro-predictions, which seek to predict events inside a match, is as yet unknown territory. Micro-predictions are however of perennial interest across esports…
▽ More
Esports have become major international sports with hundreds of millions of spectators. Esports games generate massive amounts of telemetry data. Using these to predict the outcome of esports matches has received considerable attention, but micro-predictions, which seek to predict events inside a match, is as yet unknown territory. Micro-predictions are however of perennial interest across esports commentators and audience, because they provide the ability to observe events that might otherwise be missed: esports games are highly complex with fast-moving action where the balance of a game can change in the span of seconds, and where events can happen in multiple areas of the playing field at the same time. Such events can happen rapidly, and it is easy for commentators and viewers alike to miss an event and only observe the following impact of events. In Dota 2, a player hero being killed by the opposing team is a key event of interest to commentators and audience. We present a deep learning network with shared weights which provides accurate death predictions within a five-second window. The network is trained on a vast selection of Dota 2 gameplay features and professional/semi-professional level match dataset. Even though death events are rare within a game (1\% of the data), the model achieves 0.377 precision with 0.725 recall on test data when prompted to predict which of any of the 10 players of either team will die within 5 seconds. An example of the system applied to a Dota 2 match is presented. This model enables real-time micro-predictions of kills in Dota 2, one of the most played esports titles in the world, giving commentators and viewers time to move their attention to these key events.
△ Less
Submitted 21 May, 2019;
originally announced June 2019.
-
Tweeting your Destiny: Profiling Users in the Twitter Landscape around an Online Game
Authors:
Günter Wallner,
Simone Kriglstein,
Anders Drachen
Abstract:
Social media has become a major communication channel for communities centered around video games. Consequently, social media offers a rich data source to study online communities and the discussions evolving around games. Towards this end, we explore a large-scale dataset consisting of over 1 million tweets related to the online multiplayer shooter Destiny and spanning a time period of about 14 m…
▽ More
Social media has become a major communication channel for communities centered around video games. Consequently, social media offers a rich data source to study online communities and the discussions evolving around games. Towards this end, we explore a large-scale dataset consisting of over 1 million tweets related to the online multiplayer shooter Destiny and spanning a time period of about 14 months using unsupervised clustering and topic modelling. Furthermore, we correlate Twitter activity of over 3,000 players with their playtime. Our results contribute to the understanding of online player communities by identifying distinct player groups with respect to their Twitter characteristics, describing subgroups within the Destiny community, and uncovering broad topics of community interest.
△ Less
Submitted 29 May, 2019;
originally announced May 2019.
-
Modelling Early User-Game Interactions for Joint Estimation of Survival Time and Churn Probability
Authors:
Valerio Bonometti,
Charles Ringer,
Mark Hall,
Alex R. Wade,
Anders Drachen
Abstract:
Data-driven approaches which aim to identify and predict player engagement are becoming increasingly popular in games industry contexts. This is due to the growing practice of tracking and storing large volumes of in-game telemetries coupled with a desire to tailor the gaming experience to the end-user's needs. These approaches are particularly useful not just for companies adopting Game-as-a-Serv…
▽ More
Data-driven approaches which aim to identify and predict player engagement are becoming increasingly popular in games industry contexts. This is due to the growing practice of tracking and storing large volumes of in-game telemetries coupled with a desire to tailor the gaming experience to the end-user's needs. These approaches are particularly useful not just for companies adopting Game-as-a-Service (GaaS) models (e.g. for re-engagement strategies) but also for those working under persistent content-delivery regimes (e.g. for better audience targeting). A major challenge for the latter is to build engagement models of the user which are data-efficient, holistic and can generalize across multiple game titles and genres with minimal adjustments. This work leverages a theoretical framework rooted in engagement and behavioural science research for building a model able to estimate engagement-related behaviours employing only a minimal set of game-agnostic metrics. Through a series of experiments we show how, by modelling early user-game interactions, this approach can make joint estimates of long-term survival time and churn probability across several single-player games in a range of genres. The model proposed is very suitable for industry applications since it relies on a minimal set of metrics and observations, scales well with the number of users and is explicitly designed to work across a diverse range of titles.
△ Less
Submitted 21 August, 2019; v1 submitted 27 May, 2019;
originally announced May 2019.
-
Win Prediction in Esports: Mixed-Rank Match Prediction in Multi-player Online Battle Arena Games
Authors:
Victoria Hodge,
Sam Devlin,
Nick Sephton,
Florian Block,
Anders Drachen,
Peter Cowling
Abstract:
Esports has emerged as a popular genre for players as well as spectators, supporting a global entertainment industry. Esports analytics has evolved to address the requirement for data-driven feedback, and is focused on cyber-athlete evaluation, strategy and prediction. Towards the latter, previous work has used match data from a variety of player ranks from hobbyist to professional players. Howeve…
▽ More
Esports has emerged as a popular genre for players as well as spectators, supporting a global entertainment industry. Esports analytics has evolved to address the requirement for data-driven feedback, and is focused on cyber-athlete evaluation, strategy and prediction. Towards the latter, previous work has used match data from a variety of player ranks from hobbyist to professional players. However, professional players have been shown to behave differently than lower ranked players. Given the comparatively limited supply of professional data, a key question is thus whether mixed-rank match datasets can be used to create data-driven models which predict winners in professional matches and provide a simple in-game statistic for viewers and broadcasters. Here we show that, although there is a slightly reduced accuracy, mixed-rank datasets can be used to predict the outcome of professional matches, with suitably optimized configurations.
△ Less
Submitted 17 November, 2017;
originally announced November 2017.
-
Play With Me? Understanding and Measuring the Social Aspect of Casual Gaming
Authors:
Adam Alsén,
Julian Runge,
Anders Drachen,
Daniel Klapper
Abstract:
Social gaming is today a pervasive phenomenon. Driven by the advent of social networks and the digitization of game distribution. In this paper the impact of digitization and so-cial networks such as Facebook on digital games is de-scribed and evaluated. This impact follows several vectors, including the introduction of new game formats and extend-ing the traditional audiences for games, which in…
▽ More
Social gaming is today a pervasive phenomenon. Driven by the advent of social networks and the digitization of game distribution. In this paper the impact of digitization and so-cial networks such as Facebook on digital games is de-scribed and evaluated. This impact follows several vectors, including the introduction of new game formats and extend-ing the traditional audiences for games, which in turn has increased industrial revenue. The industry is in turn shaped by new business model such as Free-to-Play, digital distri-bution and the use of viral social features. These changes do not only appear irreversible, but more importantly, play a part in shaping the future of digital game design, notably for mobile devices. The paper presents new knowledge from controlled live experiments from a casual social game across Facebook and mobile platforms, finding positive re-turns by adding social gameplay features. This suggests that not only social network games, but also casual mobile games can benefit from deeper social gameplay mechanics. Given the impact of social features on gameplay, Game An-alytics will need to evolve to be able to handle requirements that arise from the introduction of social features, e.g. how to measure engagement against social features and shaping organic and viral spreading of a game.
△ Less
Submitted 7 December, 2016;
originally announced December 2016.
-
Rapid Prediction of Player Retention in Free-to-Play Mobile Games
Authors:
Anders Drachen,
Eric Thurston Lundquist,
Yungjen Kung,
Pranav Simha Rao,
Diego Klabjan,
Rafet Sifa,
Julian Runge
Abstract:
Predicting and improving player retention is crucial to the success of mobile Free-to-Play games. This paper explores the problem of rapid retention prediction in this context. Heuristic modeling approaches are introduced as a way of building simple rules for predicting short-term retention. Compared to common classification algorithms, our heuristic-based approach achieves reasonable and comparab…
▽ More
Predicting and improving player retention is crucial to the success of mobile Free-to-Play games. This paper explores the problem of rapid retention prediction in this context. Heuristic modeling approaches are introduced as a way of building simple rules for predicting short-term retention. Compared to common classification algorithms, our heuristic-based approach achieves reasonable and comparable performance using information from the first session, day, and week of player activity.
△ Less
Submitted 11 July, 2016;
originally announced July 2016.
-
Going Out of Business: Auction House Behavior in the Massively Multi-Player Online Game
Authors:
Anders Drachen,
Joseph Riley,
Shawna Baskin,
Diego Klabjan
Abstract:
The in-game economies of massively multi-player online games (MMOGs) are complex systems that have to be carefully designed and managed. This paper presents the results of an analysis of auction house data from the MMOG Glitch, across a 14 month time period, the entire lifetime of the game. The data comprise almost 3 million data points, over 20,000 unique players and more than 650 products. Furth…
▽ More
The in-game economies of massively multi-player online games (MMOGs) are complex systems that have to be carefully designed and managed. This paper presents the results of an analysis of auction house data from the MMOG Glitch, across a 14 month time period, the entire lifetime of the game. The data comprise almost 3 million data points, over 20,000 unique players and more than 650 products. Furthermore, an interactive visualization, based on Sankey flow diagrams, is presented which shows the proportion of the different clusters across each time bin, as well as the flow of players between clusters. The diagram allows evaluation of migration of players between clusters as a function of time, as well as churn analysis. The presented work provides a template analysis and visualization model for progression-based or temporal-based analysis of player behavior broadly applicable to games.
△ Less
Submitted 24 March, 2016;
originally announced March 2016.
-
A Comparison of Methods for Player Clustering via Behavioral Telemetry
Authors:
Anders Drachen,
Christian Thurau,
Rafet Sifa,
Christian Bauckhage
Abstract:
The analysis of user behavior in digital games has been aided by the introduction of user telemetry in game development, which provides unprecedented access to quantitative data on user behavior from the installed game clients of the entire population of players. Player behavior telemetry datasets can be exceptionally complex, with features recorded for a varying population of users over a tempora…
▽ More
The analysis of user behavior in digital games has been aided by the introduction of user telemetry in game development, which provides unprecedented access to quantitative data on user behavior from the installed game clients of the entire population of players. Player behavior telemetry datasets can be exceptionally complex, with features recorded for a varying population of users over a temporal segment that can reach years in duration. Categorization of behaviors, whether through descriptive methods (e.g. segmention) or unsupervised/supervised learning techniques, is valuable for finding patterns in the behavioral data, and developing profiles that are actionable to game developers. There are numerous methods for unsupervised clustering of user behavior, e.g. k-means/c-means, Non-negative Matrix Factorization, or Principal Component Analysis. Although all yield behavior categorizations, interpretation of the resulting categories in terms of actual play behavior can be difficult if not impossible. In this paper, a range of unsupervised techniques are applied together with Archetypal Analysis to develop behavioral clusters from playtime data of 70,014 World of Warcraft players, covering a five year interval. The techniques are evaluated with respect to their ability to develop actionable behavioral profiles from the dataset.
△ Less
Submitted 15 July, 2014;
originally announced July 2014.
-
Psychophysiological Correlations with Gameplay Experience Dimensions
Authors:
Anders Drachen,
Lennart E. Nacke,
Georgios Yannakakis,
Anja Lee Pedersen
Abstract:
In this paper, we report a case study using two easy-to-deploy psychophysiological measures - electrodermal activity (EDA) and heart rate (HR) - and correlating them with a gameplay experience questionnaire (GEQ) in an attempt to establish this mixed-methods approach for rapid application in a commercial game development context. Results indicate that there is a statistically significant correlati…
▽ More
In this paper, we report a case study using two easy-to-deploy psychophysiological measures - electrodermal activity (EDA) and heart rate (HR) - and correlating them with a gameplay experience questionnaire (GEQ) in an attempt to establish this mixed-methods approach for rapid application in a commercial game development context. Results indicate that there is a statistically significant correlation (p < 0.01) between measures of psychophysiological arousal (HR, EDA) and self-reported UX in games (GEQ), with some variation between the EDA and HR measures. Results are consistent across three major commercial First-Person Shooter (FPS) games.
△ Less
Submitted 1 April, 2010;
originally announced April 2010.