-
Micro and macro facial expressions by driven animations in realistic Virtual Humans
Authors:
Rubens Halbig Montanha,
Giovana Nascimento Raupp,
Ana Carolina Policarpo Schmitt,
Victor Flávio de Andrade Araujo,
Soraia Raupp Musse
Abstract:
Computer Graphics (CG) advancements have allowed the creation of more realistic Virtual Humans (VH) through modern techniques for animating the VH body and face, thereby affecting perception. From traditional methods, including blend shapes, to driven animations using facial and body tracking, these advancements can potentially enhance the perception of comfort and realism in relation to VHs. Prev…
▽ More
Computer Graphics (CG) advancements have allowed the creation of more realistic Virtual Humans (VH) through modern techniques for animating the VH body and face, thereby affecting perception. From traditional methods, including blend shapes, to driven animations using facial and body tracking, these advancements can potentially enhance the perception of comfort and realism in relation to VHs. Previously, Psychology studied facial movements in humans, with some works separating expressions into macro and micro expressions. Also, some previous CG studies have analyzed how macro and micro expressions are perceived, replicating psychology studies in VHs, encompassing studies with realistic and cartoon VHs, and exploring different VH technologies. However, instead of using facial tracking animation methods, these previous studies animated the VHs using blendshapes interpolation. To understand how the facial tracking technique alters the perception of VHs, this paper extends the study to macro and micro expressions, employing two datasets to transfer real facial expressions to VHs and analyze how their expressions are perceived. Our findings suggest that transferring facial expressions from real actors to VHs significantly diminishes the accuracy of emotion perception compared to VH facial animations created by artists.
△ Less
Submitted 28 August, 2024;
originally announced August 2024.
-
Evaluating and Comparing Crowd Simulations: Perspectives from a Crowd Authoring Tool
Authors:
Gabriel Fonseca Silva,
Paulo Ricardo Knob,
Rubens Halbig Montanha,
Soraia Raupp Musse
Abstract:
Crowd simulation is a research area widely used in diverse fields, including gaming and security, assessing virtual agent movements through metrics like time to reach their goals, speed, trajectories, and densities. This is relevant for security applications, for instance, as different crowd configurations can determine the time people spend in environments trying to evacuate them. In this work, w…
▽ More
Crowd simulation is a research area widely used in diverse fields, including gaming and security, assessing virtual agent movements through metrics like time to reach their goals, speed, trajectories, and densities. This is relevant for security applications, for instance, as different crowd configurations can determine the time people spend in environments trying to evacuate them. In this work, we extend WebCrowds, an authoring tool for crowd simulation, to allow users to build scenarios and evaluate them through a set of metrics. The aim is to provide a quantitative metric that can, based on simulation data, select the best crowd configuration in a certain environment. We conduct experiments to validate our proposed metric in multiple crowd simulation scenarios and perform a comparison with another metric found in the literature. The results show that experts in the domain of crowd scenarios agree with our proposed quantitative metric.
△ Less
Submitted 28 August, 2024;
originally announced August 2024.
-
Evaluating the Uncanny Valley Effect in Dark Colored Skin Virtual Humans
Authors:
Victor Araujo,
Angelo Brandelli Costa,
Soraia Raupp Musse
Abstract:
With the rapid advancement of technology, the design of virtual humans has led to a very realistic user experience, such as in movies, video games, and simulations. As a result, virtual humans are becoming increasingly similar to real humans. However, following the Uncanny Valley (UV) theory, users tend to feel discomfort when watching entities with anthropomorphic traits that differ from real hum…
▽ More
With the rapid advancement of technology, the design of virtual humans has led to a very realistic user experience, such as in movies, video games, and simulations. As a result, virtual humans are becoming increasingly similar to real humans. However, following the Uncanny Valley (UV) theory, users tend to feel discomfort when watching entities with anthropomorphic traits that differ from real humans. This phenomenon is related to social identity theory, where the observer looks for something familiar. In Computer Graphics (CG), techniques used to create virtual humans with dark skin tones often rely on approaches initially developed for rendering characters with white skin tones. Furthermore, most CG characters portrayed in various media, including movies and games, predominantly exhibit white skin tones. Consequently, it is pertinent to explore people's perceptions regarding different groups of virtual humans. Thus, this paper aims to examine and evaluate the human perception of CG characters from different media, comparing two types of skin colors. The findings indicate that individuals felt more comfortable and perceived less realism when watching characters with dark colored skin than those with white colored skin. Our central hypothesis is that dark colored characters, rendered with classical developed algorithms, are considered more cartoon than realistic and placed on the left of the Valley in the UV chart.
△ Less
Submitted 11 December, 2023;
originally announced December 2023.
-
Exploring Crowd Dynamics: Simulating Structured Behaviors through Crowd Simulation Models
Authors:
Thiago Gomes Vidal de Mello,
Matheus Schreiner Homrich da Silva,
Gabriel Fonseca Silva,
Soraia Raupp Musse
Abstract:
This paper proposes the simulation of structured behaviors in a crowd of virtual agents by extending the BioCrowds simulation model.
Three behaviors were simulated and evaluated, a queue as a generic case and two specific behaviors observed at rock concerts. The extended model incorporates new parameters and modifications to replicate these behaviors accurately. Experiments were conducted to ana…
▽ More
This paper proposes the simulation of structured behaviors in a crowd of virtual agents by extending the BioCrowds simulation model.
Three behaviors were simulated and evaluated, a queue as a generic case and two specific behaviors observed at rock concerts. The extended model incorporates new parameters and modifications to replicate these behaviors accurately. Experiments were conducted to analyze the impact of parameters on simulation results, and computational performance was considered.
The results demonstrate the model's effectiveness in simulating structured behaviors and its potential for replicating complex social phenomena in diverse scenarios.
△ Less
Submitted 11 December, 2023;
originally announced December 2023.
-
Study of Non-Verbal Behavior in Conversational Agents
Authors:
Camila Vicari Maccari,
Gustavo Galle de Melo,
Paulo Ricardo Knob,
Soraia Raupp Musse
Abstract:
This paper studies the non-verbal behavior of a conversational agent named Arthur. We propose the development of body movements for this agent, which interacts solely through voice commands, chat, and videos with facial animations. This research aims to analyze users' perceptions regarding the gestures performed by Arthur. This study was conducted with participants who agreed to interact directly…
▽ More
This paper studies the non-verbal behavior of a conversational agent named Arthur. We propose the development of body movements for this agent, which interacts solely through voice commands, chat, and videos with facial animations. This research aims to analyze users' perceptions regarding the gestures performed by Arthur. This study was conducted with participants who agreed to interact directly or through video with the conversational agent. The main goal is to analyze whether including nonverbal movements alters users' perception so that they feel more comfortable watching the video or interacting in real-time.
△ Less
Submitted 11 December, 2023;
originally announced December 2023.
-
Detecting Events in Crowds Through Changes in Geometrical Dimensions of Pedestrians
Authors:
Matheus Schreiner Homrich da Silva,
Paulo Brossard de Souza Pinto Neto,
Rodolfo Migon Favaretto,
Soraia Raupp Musse
Abstract:
Security is an important topic in our contemporary world, and the ability to automate the detection of any events of interest that can take place in a crowd is of great interest to a population. We hypothesize that the detection of events in videos is correlated with significant changes in pedestrian behaviors. In this paper, we examine three different scenarios of crowd behavior, containing both…
▽ More
Security is an important topic in our contemporary world, and the ability to automate the detection of any events of interest that can take place in a crowd is of great interest to a population. We hypothesize that the detection of events in videos is correlated with significant changes in pedestrian behaviors. In this paper, we examine three different scenarios of crowd behavior, containing both the cases where an event triggers a change in the behavior of the crowd and two video sequences where the crowd and its motion remain mostly unchanged. With both the videos and the tracking of the individual pedestrians (performed in a pre-processed phase), we use Geomind, a software we developed to extract significant data about the scene, in particular, the geometrical features, personalities, and emotions of each person. We then examine the output, seeking a significant change in the way each person acts as a function of the time, that could be used as a basis to identify events or to model realistic crowd actions. When applied to the games area, our method can use the detected events to find some sort of pattern to be then used in agent simulation. Results indicate that our hypothesis seems valid in the sense that the visually observed events could be automatically detected using GeoMind.
△ Less
Submitted 11 December, 2023;
originally announced December 2023.
-
Crafting Realistic Virtual Humans: Unveiling Perspectives on Human Perception, Crowds, and Embodied Conversational Agents
Authors:
Rubens Montanha,
Victor Araujo,
Paulo Knob,
Greice Pinho,
Gabriel Fonseca,
Vitor Peres,
Soraia Raupp Musse
Abstract:
Virtual Humans (VHs) were first developed more than 50 years ago and have undergone significant advancements since then. In the past, creating and animating VHs was a complex task. However, contemporary commercial and freely available technology now empowers users, programmers, and designers to create and animate VHs with relative ease. These technologies have even reached a point where they can r…
▽ More
Virtual Humans (VHs) were first developed more than 50 years ago and have undergone significant advancements since then. In the past, creating and animating VHs was a complex task. However, contemporary commercial and freely available technology now empowers users, programmers, and designers to create and animate VHs with relative ease. These technologies have even reached a point where they can replicate the authentic characteristics and behaviors of real actors, resulting in VHs that are visually convincing and behaviorally lifelike. This paper explores three closely related research areas in the context of virtual humans and discusses the far-reaching implications of highly realistic characters within these domains.
△ Less
Submitted 6 December, 2023;
originally announced December 2023.
-
Can we truly transfer an actor's genuine happiness to avatars? An investigation into virtual, real, posed and spontaneous faces
Authors:
Vitor Miguel Xavier Peres,
Greice Pinho Dal Molin,
Soraia Raupp Musse
Abstract:
A look is worth a thousand words is a popular phrase. And why is a simple look enough to portray our feelings about something or someone? Behind this question are the theoretical foundations of the field of psychology regarding social cognition and the studies of psychologist Paul Ekman. Facial expressions, as a form of non-verbal communication, are the primary way to transmit emotions between hum…
▽ More
A look is worth a thousand words is a popular phrase. And why is a simple look enough to portray our feelings about something or someone? Behind this question are the theoretical foundations of the field of psychology regarding social cognition and the studies of psychologist Paul Ekman. Facial expressions, as a form of non-verbal communication, are the primary way to transmit emotions between human beings. The set of movements and expressions of facial muscles that convey some emotional state of the individual to their observers are targets of studies in many areas. Our research aims to evaluate Ekman's action units in datasets of real human faces, posed and spontaneous, and virtual human faces resulting from transferring real faces into Computer Graphics faces. In addition, we also conducted a case study with specific movie characters, such as SheHulk and Genius. We intend to find differences and similarities in facial expressions between real and CG datasets, posed and spontaneous faces, and also to consider the actors' genders in the videos. This investigation can help several areas of knowledge, whether using real or virtual human beings, in education, health, entertainment, games, security, and even legal matters. Our results indicate that AU intensities are greater for posed than spontaneous datasets, regardless of gender. Furthermore, there is a smoothing of intensity up to 80 percent for AU6 and 45 percent for AU12 when a real face is transformed into CG.
△ Less
Submitted 4 December, 2023;
originally announced December 2023.
-
Moving Virtual Agents Forward in Space and Time
Authors:
Gabriel F. Silva,
Paulo Knob,
Carlos G. Johansson,
Douglas A. Schlatter,
Soraia R. Musse
Abstract:
This article proposes an adaptation from the model of Bianco for fast-forwarding agents in crowd simulation, which enables us to accurately fast forward agents in time. Besides being able to jump from one position to another, agents are able to stay inside their track, it means, the new position is calculated taking into account the original global path the agent would follow, if not being fast-fo…
▽ More
This article proposes an adaptation from the model of Bianco for fast-forwarding agents in crowd simulation, which enables us to accurately fast forward agents in time. Besides being able to jump from one position to another, agents are able to stay inside their track, it means, the new position is calculated taking into account the original global path the agent would follow, if not being fast-forwarded. Obstacles and other agents around are also taken into account when calculating the new position. In addition, we included a personality aspect on agents, which affect their behaviors and, also, be taken into account when jumping to a future time and space. We conducted some experiments to validate our model, which shows that it was able to indeed fast forward agents from a position to another, in a coherent time, sticking to a given global path while avoiding collisions. Finally, we present a use case, showing that our method can fit inside a "Fog of War" system.
△ Less
Submitted 6 October, 2022;
originally announced October 2022.
-
LODUS: A Multi-Level Framework for Simulating Environment and Population -- A Contagion Experiment on a Pandemic World
Authors:
Gabriel Fonseca Silva,
Vinícius Cassol,
Amyr Borges Fortes Neto,
Andre Antonitsch,
Diogo Schaffer,
Soraia Raupp Musse,
Rodrigo de Marsillac Linn
Abstract:
Nowadays we are experiencing a way of life that never existed before. The pandemic has sharply changed our habits, customs, and behavior. In addition, a lot of work was suddenly requested for city managers challenging them to develop strategies to try stopping the pandemic progression. Urban environments must be dynamic and managers need fast decisions when working on crisis situations. In this pa…
▽ More
Nowadays we are experiencing a way of life that never existed before. The pandemic has sharply changed our habits, customs, and behavior. In addition, a lot of work was suddenly requested for city managers challenging them to develop strategies to try stopping the pandemic progression. Urban environments must be dynamic and managers need fast decisions when working on crisis situations. In this paper we present LODUS, a framework able to simulate urban environments on a multi-level approach, combining macro and micro simulation information in order to provide accurate information about population dynamics. Furthermore, the framework LODUS is a powerful tool when performing an urban viability study, since the simulation results are able to highlight and predict attention points prior to an urban environment to be built.
△ Less
Submitted 6 October, 2022;
originally announced October 2022.
-
Perception of Personality Traits in Crowds of Virtual Humans
Authors:
Lucas Nardino,
Enzo Krzmienszki,
Vinícius Jurinic Cassol,
Diogo Schaffer,
Victor Flávio de Andrade Araujo,
Rodolfo Migon Favaretto,
Felipe Elsner,
Gabriel Fonseca Silva,
Soraia Raupp Musse
Abstract:
This paper proposes a perceptual visual analysis regarding the personality of virtual humans. Many studies have presented findings regarding the way human beings perceive virtual humans with respect to their faces, body animation, motion in the virtual environment and etc. We are interested in investigating the way people perceive visual manifestations of virtual humans' personality traits when th…
▽ More
This paper proposes a perceptual visual analysis regarding the personality of virtual humans. Many studies have presented findings regarding the way human beings perceive virtual humans with respect to their faces, body animation, motion in the virtual environment and etc. We are interested in investigating the way people perceive visual manifestations of virtual humans' personality traits when they are interactive and organized in groups. Many applications in games and movies can benefit from the findings regarding the perceptual analysis with the main goal to provide more realistic characters and improve the users' experience. We provide experiments with subjects and obtained results indicate that, although is very subtle, people perceive more the extraversion (the personality trait that we measured), into the crowds of virtual humans, when interacting with virtual humans behaviors, than when just observing as a spectator camera.
△ Less
Submitted 6 October, 2022;
originally announced October 2022.
-
Gender Representation in Brazilian Computer Science Conferences
Authors:
Natália Dal Pizzol,
Eduardo Dos Santos Barbosa,
Soraia Raupp Musse
Abstract:
This study presents an automated bibliometric analysis of 6569 research papers published in thirteen Brazilian Computer Science Society (SBC) conferences from 1999 to 2021. Our primary goal was to gather data to understand the gender representation in publications in the field of Computer Science. We applied a systematic assignment of gender to 23.573 listed papers authorships, finding that the ge…
▽ More
This study presents an automated bibliometric analysis of 6569 research papers published in thirteen Brazilian Computer Science Society (SBC) conferences from 1999 to 2021. Our primary goal was to gather data to understand the gender representation in publications in the field of Computer Science. We applied a systematic assignment of gender to 23.573 listed papers authorships, finding that the gender gap for women is significant, with female authors being under-represented in all years of the study.
△ Less
Submitted 23 August, 2022;
originally announced August 2022.
-
Can gender categorization influence the perception of animated virtual humans?
Authors:
V. Araujo,
D. Schaffer,
A. B. Costa,
S. R. Musse
Abstract:
Animations have become increasingly realistic with the evolution of Computer Graphics (CG). In particular, human models and behaviors were represented through animated virtual humans, sometimes with a high level of realism. In particular, gender is a characteristic that is related to human identification, so that virtual humans assigned to a specific gender have, in general, stereotyped representa…
▽ More
Animations have become increasingly realistic with the evolution of Computer Graphics (CG). In particular, human models and behaviors were represented through animated virtual humans, sometimes with a high level of realism. In particular, gender is a characteristic that is related to human identification, so that virtual humans assigned to a specific gender have, in general, stereotyped representations through movements, clothes, hair and colors, in order to be understood by users as desired by designers. An important area of study is finding out whether participants' perceptions change depending on how a virtual human is visually presented. Findings in this area can help the industry to guide the modeling and animation of virtual humans to deliver the expected impact to the audience. In this paper, we reproduce, through CG, a perceptual study that aims to assess gender bias in relation to a simulated baby. In the original study, two groups of people watched the same video of a baby reacting to the same stimuli, but one group was told the baby was female and the other group was told the same baby was male, producing different perceptions. The results of our study with virtual babies were similar to the findings with real babies. First, it shows that people's emotional response change depending on the character gender attribute, in this case the only difference was the baby's name. Our research indicates that by just informing the name of a virtual human can be enough to create a gender perception that impact the participant emotional answer.
△ Less
Submitted 3 August, 2022;
originally announced August 2022.
-
Mitigating Bias in Facial Analysis Systems by Incorporating Label Diversity
Authors:
Camila Kolling,
Victor Araujo,
Adriano Veloso,
Soraia Raupp Musse
Abstract:
Facial analysis models are increasingly applied in real-world applications that have significant impact on peoples' lives. However, as literature has shown, models that automatically classify facial attributes might exhibit algorithmic discrimination behavior with respect to protected groups, potentially posing negative impacts on individuals and society. It is therefore critical to develop techni…
▽ More
Facial analysis models are increasingly applied in real-world applications that have significant impact on peoples' lives. However, as literature has shown, models that automatically classify facial attributes might exhibit algorithmic discrimination behavior with respect to protected groups, potentially posing negative impacts on individuals and society. It is therefore critical to develop techniques that can mitigate unintended biases in facial classifiers. Hence, in this work, we introduce a novel learning method that combines both subjective human-based labels and objective annotations based on mathematical definitions of facial traits. Specifically, we generate new objective annotations from two large-scale human-annotated dataset, each capturing a different perspective of the analyzed facial trait. We then propose an ensemble learning method, which combines individual models trained on different types of annotations. We provide an in-depth analysis of the annotation procedure as well as the datasets distribution. Moreover, we empirically demonstrate that, by incorporating label diversity, our method successfully mitigates unintended biases, while maintaining significant accuracy on the downstream tasks.
△ Less
Submitted 14 June, 2022; v1 submitted 13 April, 2022;
originally announced April 2022.
-
Is my agent good enough? Evaluating Embodied Conversational Agents with Long and Short-term interactions
Authors:
Juliane B. S. dos Santos,
Paulo Ricardo Knob,
Victor Putrich Scherer,
Soraia Raupp Musse
Abstract:
The use of digital resources has been increasing in every instance of todays society, being it in business or even ludic purposes. Despite such ever increasing use of technologies as interfaces, in all fields, it seems that it lacks the importance of users perception in this context. This work aims to present a case study about the evaluation of ECAs. We propose a Long-Term Interaction (LTI) to ev…
▽ More
The use of digital resources has been increasing in every instance of todays society, being it in business or even ludic purposes. Despite such ever increasing use of technologies as interfaces, in all fields, it seems that it lacks the importance of users perception in this context. This work aims to present a case study about the evaluation of ECAs. We propose a Long-Term Interaction (LTI) to evaluate our conversational agent effectiveness through the user perception and compare it with Short-Term Interactions (STIs), performed by three users. Results show that many different aspects of users perception about the chosen ECA (i.e. Arthur) could be evaluated in our case study, in particular that LTI and STI are both important in order to have a better understanding of ECA impact in UX.
△ Less
Submitted 30 September, 2021;
originally announced October 2021.
-
Arthur: a new ECA that uses Memory to improve Communication
Authors:
Paulo Knob,
Willian S. Dias,
Natanael Kuniechick,
Joao Moraes,
Soraia Raupp Musse
Abstract:
This article proposes an embodied conversational agent named Arthur. In addition to being able to talk to a person (using text and voice), he is also able to recognize the person he is talking to and detect his/her expressed emotion through facial expressions. Arthur uses these skills to improve communication with the user, also using his artificial memory, which stores and retrieves data about ev…
▽ More
This article proposes an embodied conversational agent named Arthur. In addition to being able to talk to a person (using text and voice), he is also able to recognize the person he is talking to and detect his/her expressed emotion through facial expressions. Arthur uses these skills to improve communication with the user, also using his artificial memory, which stores and retrieves data about events and facts, based on a human memory model. We conducted some experiments to collect quantitative and qualitative information, which show that our model provides a consistent impact on users.
△ Less
Submitted 27 April, 2021;
originally announced April 2021.
-
Detecting Personality and Emotion Traits in Crowds from Video Sequences
Authors:
Rodolfo Migon Favaretto,
Paulo Knob,
Soraia Raupp Musse,
Felipe Vilanova,
Ângelo Brandelli Costa
Abstract:
This paper presents a methodology to detect personality and basic emotion characteristics of crowds in video sequences. Firstly, individuals are detected and tracked, then groups are recognized and characterized. Such information is then mapped to OCEAN dimensions, used to find out personality and emotion in videos, based on OCC emotion models. Although it is a clear challenge to validate our resu…
▽ More
This paper presents a methodology to detect personality and basic emotion characteristics of crowds in video sequences. Firstly, individuals are detected and tracked, then groups are recognized and characterized. Such information is then mapped to OCEAN dimensions, used to find out personality and emotion in videos, based on OCC emotion models. Although it is a clear challenge to validate our results with real life experiments, we evaluate our method with the available literature information regarding OCEAN values of different Countries and also emergent Personal distance among people. Hence, such analysis refer to cultural differences of each country too. Our results indicate that this model generates coherent information when compared to data provided in available literature, as shown in qualitative and quantitative results.
△ Less
Submitted 26 April, 2021;
originally announced April 2021.
-
Investigating Cultural Aspects in the Fundamental Diagram using Convolutional Neural Networks and Simulation
Authors:
Rodolfo M. Favaretto,
Roberto R. Santos,
Marcio Ballotin,
Paulo Knob,
Soraia R. Musse,
Felipe Vilanova,
Angelo B. Costa
Abstract:
This paper presents a study regarding group behavior in a controlled experiment focused on differences in an important attribute that vary across cultures -- the personal spaces -- in two Countries: Brazil and Germany. In order to coherently compare Germany and Brazil evolutions with same population applying same task, we performed the pedestrian Fundamental Diagram experiment in Brazil, as perfor…
▽ More
This paper presents a study regarding group behavior in a controlled experiment focused on differences in an important attribute that vary across cultures -- the personal spaces -- in two Countries: Brazil and Germany. In order to coherently compare Germany and Brazil evolutions with same population applying same task, we performed the pedestrian Fundamental Diagram experiment in Brazil, as performed in Germany. We use CNNs to detect and track people in video sequences. With this data, we use Voronoi Diagrams to find out the neighbor relation among people and then compute the walking distances to find out the personal spaces. Based on personal spaces analyses, we found out that people behavior is more similar, in terms of their behaviours, in high dense populations and vary more in low and medium densities. So, we focused our study on cultural differences between the two Countries in low and medium densities. Results indicate that personal space analyses can be a relevant feature in order to understand cultural aspects in video sequences. In addition to the cultural differences, we also investigate the personality model in crowds, using OCEAN. We also proposed a way to simulate the FD experiment from other countries using the OCEAN psychological traits model as input. The simulated countries were consistent with the literature.
△ Less
Submitted 30 September, 2020;
originally announced October 2020.
-
CrowdEst: A Method for Estimating (and not Simulating) Crowd Evacuation Parameters in Generic Environments
Authors:
Estevso Testa,
Rodrigo C. Barros,
Soraia Raupp Musse
Abstract:
Evacuation plans have been historically used as a safety measure for the construction of buildings. The existing crowd simulators require fully-modeled 3D environments and enough time to prepare and simulate scenarios, where the distribution and behavior of the crowd needs to be controlled. In addition, its population, routes or even doors and passages may change, so the 3D model and configuration…
▽ More
Evacuation plans have been historically used as a safety measure for the construction of buildings. The existing crowd simulators require fully-modeled 3D environments and enough time to prepare and simulate scenarios, where the distribution and behavior of the crowd needs to be controlled. In addition, its population, routes or even doors and passages may change, so the 3D model and configurations have to be updated accordingly. This is a time-consuming task that commonly has to be addressed within the crowd simulators. With that in mind, we present a novel approach to estimate the resulting data of a given evacuation scenario without actually simulating it. For such, we divide the environment into smaller modular rooms with different configurations, in a divide-and-conquer fashion. Next, we train an artificial neural network to estimate all required data regarding the evacuation of a single room. After collecting the estimated data from each room, we develop a heuristic capable of aggregating per-room information so the full environment can be properly evaluated. Our method presents an average error of 5% when compared to evacuation time in a real-life environment. Our crowd estimator approach has several advantages, such as not requiring to model the 3D environment, nor learning how to use and configure a crowd simulator, which means any user can easily use it. Furthermore, the computational time to estimate evacuation data (inference time) is virtually zero, which is much better even when compared to the best-case scenario in a real-time crowd simulator.
△ Less
Submitted 30 September, 2020;
originally announced October 2020.
-
A Software to Detect OCC Emotion, Big-Five Personality and Hofstede Cultural Dimensions of Pedestrians from Video Sequences
Authors:
Rodolfo Migon Favaretto,
Victor Araujo,
Soraia Raupp Musse,
Felipe Vilanova,
Angelo Brandelli Costa
Abstract:
This paper presents a video analysis application to detect personality, emotion and cultural aspects from pedestrians in video sequences, along with a visualizer of features. The proposed model considers a series of characteristics of the pedestrians and the crowd, such as number and size of groups, distances, speeds, among others, and performs the mapping of these characteristics in personalities…
▽ More
This paper presents a video analysis application to detect personality, emotion and cultural aspects from pedestrians in video sequences, along with a visualizer of features. The proposed model considers a series of characteristics of the pedestrians and the crowd, such as number and size of groups, distances, speeds, among others, and performs the mapping of these characteristics in personalities, emotions and cultural aspects, considering the Cultural Dimensions of Hofstede (HCD), the Big-Five Personality Model (OCEAN) and the OCC Emotional Model. The main hypothesis is that there is a relationship between so-called intrinsic human variables (such as emotion) and the way people behave in space and time. The software was tested in a set of videos from different countries and results seem promising in order to identify these three different levels of psychological traits in the filmed sequences. In addition, the data of the people present in the videos can be seen in a crowd viewer.
△ Less
Submitted 18 August, 2019;
originally announced August 2019.
-
Automatic Dataset Augmentation Using Virtual Human Simulation
Authors:
Marcelo C. Ghilardi,
Leandro Dihl,
Estevão Testa,
Pedro Braga,
João P. Pianta,
Isabel H. Manssour,
Soraia R. Musse
Abstract:
Virtual Human Simulation has been widely used for different purposes, such as comfort or accessibility analysis. In this paper, we investigate the possibility of using this type of technique to extend the training datasets of pedestrians to be used with machine learning techniques. Our main goal is to verify if Computer Graphics (CG) images of virtual humans with a simplistic rendering can be effi…
▽ More
Virtual Human Simulation has been widely used for different purposes, such as comfort or accessibility analysis. In this paper, we investigate the possibility of using this type of technique to extend the training datasets of pedestrians to be used with machine learning techniques. Our main goal is to verify if Computer Graphics (CG) images of virtual humans with a simplistic rendering can be efficient in order to augment datasets used for training machine learning methods. In fact, from a machine learning point of view, there is a need to collect and label large datasets for ground truth, which sometimes demands manual annotation. In addition, find out images and videos with real people and also provide ground truth of people detection and counting is not trivial. If CG images, which can have a ground truth automatically generated, can also be used as training in machine learning techniques for pedestrian detection and counting, it can certainly facilitate and optimize the whole process of event detection. In particular, we propose to parametrize virtual humans using a data-driven approach. Results demonstrated that using the extended datasets with CG images outperforms the results when compared to only real images sequences.
△ Less
Submitted 1 May, 2019;
originally announced May 2019.
-
How much do you perceive this? An analysis on perceptions of geometric features, personalities and emotions in virtual humans (Extended Version)
Authors:
Victor Araujo,
Rodolfo Migon Favaretto,
Paulo Knob,
Soraia Raupp Musse,
Felipe Vilanova,
Angelo Brandelli Costa
Abstract:
This work aims to evaluate people's perception regarding geometric features, personalities and emotions characteristics in virtual humans. For this, we use as a basis, a dataset containing the tracking files of pedestrians captured from spontaneous videos and visualized them as identical virtual humans. The goal is to focus on their behavior and not being distracted by other features. In addition…
▽ More
This work aims to evaluate people's perception regarding geometric features, personalities and emotions characteristics in virtual humans. For this, we use as a basis, a dataset containing the tracking files of pedestrians captured from spontaneous videos and visualized them as identical virtual humans. The goal is to focus on their behavior and not being distracted by other features. In addition to tracking files containing their positions, the dataset also contains pedestrian emotions and personalities detected using Computer Vision and Pattern Recognition techniques. We proceed with our analysis in order to answer the question if subjects can perceive geometric features as distances/speeds as well as emotions and personalities in video sequences when pedestrians are represented by virtual humans. Regarding the participants, an amount of 73 people volunteered for the experiment. The analysis was divided in two parts: i) evaluation on perception of geometric characteristics, such as density, angular variation, distances and speeds, and ii) evaluation on personality and emotion perceptions. Results indicate that, even without explaining to the participants the concepts of each personality or emotion and how they were calculated (considering geometric characteristics), in most of the cases, participants perceived the personality and emotion expressed by the virtual agents, in accordance with the available ground truth.
△ Less
Submitted 24 April, 2019;
originally announced April 2019.
-
Predicting Future Pedestrian Motion in Video Sequences using Crowd Simulation
Authors:
Cliceres dal Bianco,
Soraia Raupp Musse
Abstract:
While human and group analysis have become an important area in last decades, some current and relevant applications involve to estimate future motion of pedestrians in real video sequences. This paper presents a method to provide motion estimation of real pedestrians in next seconds, using crowd simulation. Our method is based on Physics and heuristics and use BioCrowds as crowd simulation method…
▽ More
While human and group analysis have become an important area in last decades, some current and relevant applications involve to estimate future motion of pedestrians in real video sequences. This paper presents a method to provide motion estimation of real pedestrians in next seconds, using crowd simulation. Our method is based on Physics and heuristics and use BioCrowds as crowd simulation methodology to estimate future positions of people in video sequences. Results show that our method for estimation works well even for complex videos where events can happen. The maximum achieved average error is $2.72$cm when estimating the future motion of 32 pedestrians with more than 2 seconds in advance. This paper discusses this and other results.
△ Less
Submitted 10 April, 2019;
originally announced April 2019.
-
Using Big Five Personality Model to Detect Cultural Aspects in Crowds
Authors:
Rodolfo Migon Favaretto,
Leandro Dihl,
Soraia Raupp Musse,
Felipe Vilanova,
Angelo Brandelli Costa
Abstract:
The use of information technology in the study of human behavior is a subject of great scientific interest. Cultural and personality aspects are factors that influence how people interact with one another in a crowd. This paper presents a methodology to detect cultural characteristics of crowds in video sequences. Based on filmed sequences, pedestrians are detected, tracked and characterized. Such…
▽ More
The use of information technology in the study of human behavior is a subject of great scientific interest. Cultural and personality aspects are factors that influence how people interact with one another in a crowd. This paper presents a methodology to detect cultural characteristics of crowds in video sequences. Based on filmed sequences, pedestrians are detected, tracked and characterized. Such information is then used to find out cultural differences in those videos, based on the Big-five personality model. Regarding cultural differences of each country, results indicate that this model generates coherent information when compared to data provided in literature.
△ Less
Submitted 5 March, 2019;
originally announced March 2019.
