-
HyperSurf: Quadruped Robot Leg Capable of Surface Recognition with GRU and Real-to-Sim Transferring
Authors:
Sergei Satsevich,
Yaroslav Savotin,
Danil Belov,
Elizaveta Pestova,
Artem Erhov,
Batyr Khabibullin,
Artem Bazhenov,
Vyacheslav Kovalev,
Aleksey Fedoseev,
Dzmitry Tsetserukou
Abstract:
This paper introduces a system of data collection acceleration and real-to-sim transferring for surface recognition on a quadruped robot. The system features a mechanical single-leg setup capable of stepping on various easily interchangeable surfaces. Additionally, it incorporates a GRU-based Surface Recognition System, inspired by the system detailed in the Dog-Surf paper. This setup facilitates…
▽ More
This paper introduces a system of data collection acceleration and real-to-sim transferring for surface recognition on a quadruped robot. The system features a mechanical single-leg setup capable of stepping on various easily interchangeable surfaces. Additionally, it incorporates a GRU-based Surface Recognition System, inspired by the system detailed in the Dog-Surf paper. This setup facilitates the expansion of dataset collection for model training, enabling data acquisition from hard-to-reach surfaces in laboratory conditions. Furthermore, it opens avenues for transferring surface properties from reality to simulation, thereby allowing the training of optimal gaits for legged robots in simulation environments using a pre-prepared library of digital twins of surfaces. Moreover, enhancements have been made to the GRU-based Surface Recognition System, allowing for the integration of data from both the quadruped robot and the single-leg setup. The dataset and code have been made publicly available.
△ Less
Submitted 19 August, 2024; v1 submitted 22 July, 2024;
originally announced July 2024.
-
Sleep-Like Unsupervised Replay Improves Performance when Data are Limited or Unbalanced
Authors:
Anthony Bazhenov,
Pahan Dewasurendra,
Giri Krishnan,
Jean Erik Delanois
Abstract:
The performance of artificial neural networks (ANNs) degrades when training data are limited or imbalanced. In contrast, the human brain can learn quickly from just a few examples. Here, we investigated the role of sleep in improving the performance of ANNs trained with limited data on the MNIST and Fashion MNIST datasets. Sleep was implemented as an unsupervised phase with local Hebbian type lear…
▽ More
The performance of artificial neural networks (ANNs) degrades when training data are limited or imbalanced. In contrast, the human brain can learn quickly from just a few examples. Here, we investigated the role of sleep in improving the performance of ANNs trained with limited data on the MNIST and Fashion MNIST datasets. Sleep was implemented as an unsupervised phase with local Hebbian type learning rules. We found a significant boost in accuracy after the sleep phase for models trained with limited data in the range of 0.5-10% of total MNIST or Fashion MNIST datasets. When more than 10% of the total data was used, sleep alone had a slight negative impact on performance, but this was remedied by fine-tuning on the original data. This study sheds light on a potential synaptic weight dynamics strategy employed by the brain during sleep to enhance memory performance when training data are limited or imbalanced.
△ Less
Submitted 12 February, 2024;
originally announced February 2024.
-
DogSurf: Quadruped Robot Capable of GRU-based Surface Recognition for Blind Person Navigation
Authors:
Artem Bazhenov,
Vladimir Berman,
Sergei Satsevich,
Olga Shalopanova,
Miguel Altamirano Cabrera,
Artem Lykov,
Dzmitry Tsetserukou
Abstract:
This paper introduces DogSurf - a newapproach of using quadruped robots to help visually impaired people navigate in real world. The presented method allows the quadruped robot to detect slippery surfaces, and to use audio and haptic feedback to inform the user when to stop. A state-of-the-art GRU-based neural network architecture with mean accuracy of 99.925% was proposed for the task of multicla…
▽ More
This paper introduces DogSurf - a newapproach of using quadruped robots to help visually impaired people navigate in real world. The presented method allows the quadruped robot to detect slippery surfaces, and to use audio and haptic feedback to inform the user when to stop. A state-of-the-art GRU-based neural network architecture with mean accuracy of 99.925% was proposed for the task of multiclass surface classification for quadruped robots. A dataset was collected on a Unitree Go1 Edu robot. The dataset and code have been posted to the public domain.
△ Less
Submitted 5 February, 2024;
originally announced February 2024.
-
CognitiveDog: Large Multimodal Model Based System to Translate Vision and Language into Action of Quadruped Robot
Authors:
Artem Lykov,
Mikhail Litvinov,
Mikhail Konenkov,
Rinat Prochii,
Nikita Burtsev,
Ali Alridha Abdulkarim,
Artem Bazhenov,
Vladimir Berman,
Dzmitry Tsetserukou
Abstract:
This paper introduces CognitiveDog, a pioneering development of quadruped robot with Large Multi-modal Model (LMM) that is capable of not only communicating with humans verbally but also physically interacting with the environment through object manipulation. The system was realized on Unitree Go1 robot-dog equipped with a custom gripper and demonstrated autonomous decision-making capabilities, in…
▽ More
This paper introduces CognitiveDog, a pioneering development of quadruped robot with Large Multi-modal Model (LMM) that is capable of not only communicating with humans verbally but also physically interacting with the environment through object manipulation. The system was realized on Unitree Go1 robot-dog equipped with a custom gripper and demonstrated autonomous decision-making capabilities, independently determining the most appropriate actions and interactions with various objects to fulfill user-defined tasks. These tasks do not necessarily include direct instructions, challenging the robot to comprehend and execute them based on natural language input and environmental cues. The paper delves into the intricacies of this system, dataset characteristics, and the software architecture. Key to this development is the robot's proficiency in navigating space using Visual-SLAM, effectively manipulating and transporting objects, and providing insightful natural language commentary during task execution. Experimental results highlight the robot's advanced task comprehension and adaptability, underscoring its potential in real-world applications. The dataset used to fine-tune the robot-dog behavior generation model is provided at the following link: huggingface.co/datasets/ArtemLykov/CognitiveDog_dataset
△ Less
Submitted 17 January, 2024;
originally announced January 2024.
-
LLM-MARS: Large Language Model for Behavior Tree Generation and NLP-enhanced Dialogue in Multi-Agent Robot Systems
Authors:
Artem Lykov,
Maria Dronova,
Nikolay Naglov,
Mikhail Litvinov,
Sergei Satsevich,
Artem Bazhenov,
Vladimir Berman,
Aleksei Shcherbak,
Dzmitry Tsetserukou
Abstract:
This paper introduces LLM-MARS, first technology that utilizes a Large Language Model based Artificial Intelligence for Multi-Agent Robot Systems. LLM-MARS enables dynamic dialogues between humans and robots, allowing the latter to generate behavior based on operator commands and provide informative answers to questions about their actions. LLM-MARS is built on a transformer-based Large Language M…
▽ More
This paper introduces LLM-MARS, first technology that utilizes a Large Language Model based Artificial Intelligence for Multi-Agent Robot Systems. LLM-MARS enables dynamic dialogues between humans and robots, allowing the latter to generate behavior based on operator commands and provide informative answers to questions about their actions. LLM-MARS is built on a transformer-based Large Language Model, fine-tuned from the Falcon 7B model. We employ a multimodal approach using LoRa adapters for different tasks. The first LoRa adapter was developed by fine-tuning the base model on examples of Behavior Trees and their corresponding commands. The second LoRa adapter was developed by fine-tuning on question-answering examples. Practical trials on a multi-agent system of two robots within the Eurobot 2023 game rules demonstrate promising results. The robots achieve an average task execution accuracy of 79.28% in compound commands. With commands containing up to two tasks accuracy exceeded 90%. Evaluation confirms the system's answers on operators questions exhibit high accuracy, relevance, and informativeness. LLM-MARS and similar multi-agent robotic systems hold significant potential to revolutionize logistics, enabling autonomous exploration missions and advancing Industry 5.0.
△ Less
Submitted 14 December, 2023;
originally announced December 2023.
-
Indication of novel magnetoresistance mechanism in (Bi,Sb)$_2$(Te,Se)$_3$ 3D topological insulator thin films
Authors:
N. P. Stepina,
A. O. Bazhenov,
A. V. Shumilin,
A. Yu. Kuntsevich,
V. V. Kirienko,
E. S. Zhdanov,
D. V. Ishchenko,
O. E. Tereshchenko
Abstract:
Electron states with the spin-momentum-locked Dirac dispersion at the surface of a three-dimensional (3D) topological insulator are known to lead to weak antilocalization (WAL), i.e. low temperature and low-magnetic field quantum interference-induced positive magnetoresistance (MR). In this work we report on the MR measurements in (Bi,Sb)$_2$(Te,Se)$_3$ 3D topological insulator thin films epitaxia…
▽ More
Electron states with the spin-momentum-locked Dirac dispersion at the surface of a three-dimensional (3D) topological insulator are known to lead to weak antilocalization (WAL), i.e. low temperature and low-magnetic field quantum interference-induced positive magnetoresistance (MR). In this work we report on the MR measurements in (Bi,Sb)$_2$(Te,Se)$_3$ 3D topological insulator thin films epitaxially grown on Si(111), demonstrating an anomalous WAL amplitude. This anomalously high amplitude of WAL can not be explained by parabolic or linear MR and indicates the existence of an additional, MR mechanism. Another supporting observation is not linear in the classically weak magnetic field Hall effect in the same films. The increase of the low-field Hall coefficient, with respect to the higher-field value, reaches 10$\%$. We consistently explain both transport features within a two-liquid model, where the mobility of one of the components drops strongly in a weak magnetic field. We argue that this dependence may arise from the Zeeman field induced gap opening mechanism.
△ Less
Submitted 27 August, 2023;
originally announced August 2023.
-
Superradiant phase transition in complex networks
Authors:
Andrei Yu. Bazhenov,
Dmitriy V. Tsarev,
Alexander P. Alodjants
Abstract:
In this work we consider a superradiant phase transition problem for the Dicke-Ising model, which generalizes the Dicke and Ising models for annealed complex networks presuming spin-spin interaction. The model accounts the interaction between a spin (two-level) system and external classical (magnetic) and quantized (transverse) fields. We examine regular, random, and scale-free network structures…
▽ More
In this work we consider a superradiant phase transition problem for the Dicke-Ising model, which generalizes the Dicke and Ising models for annealed complex networks presuming spin-spin interaction. The model accounts the interaction between a spin (two-level) system and external classical (magnetic) and quantized (transverse) fields. We examine regular, random, and scale-free network structures characterized by the delta-function, random (Poisson), and power-law exponent degree distributions, respectively. To describe paramagnetic (PM) - ferromagnetic (FM) and superradiant (SR) phase transitions we introduce two order parameters: the total weighted spin z-component and the normalized transverse field amplitude, which correspond to the spontaneous magnetization in z and x directions, respectively. Due to the interplay between the spin interaction and the finite size effects in the networks we first elucidate novel features of the SR state in the presence of the PM-FM phase transition. We reveal that the critical temperature of the SR phase transition grows monotonically from some certain value that corresponds to the critical number of nodes. For the scale-free networks we find that this critical temperature rises with the degree exponent increase accompanied both by establishing spontaneous magnetization in a quantum transverse field and vanishing of the collective spin component in z direction. In addition, we establish the conditions for the network parameters to obtain a quantum phase transition in the spin system when the critical temperature approaches zero. The fundamental features, which involve critical values of the classical and quantum field parameters, are discussed for the occurrence of the superradiance phase in this limit.
△ Less
Submitted 8 August, 2021; v1 submitted 5 December, 2020;
originally announced December 2020.
-
Formation of metallic magnetic clusters in a Kondo-lattice metal: Evidence from an optical study
Authors:
N. N. Kovaleva,
K. I. Kugel,
A. V. Bazhenov,
T. N. Fursova,
W. Loeser,
Y. Xu,
G. Behr,
F. V. Kusmartsev
Abstract:
Magnetic materials are usually divided into two classes: those with localised magnetic moments, and those with itinerant charge carriers. We present a comprehensive experimental (spectroscopic ellipsomerty) and theoretical study to demonstrate that these two types of magnetism do not only coexist but complement each other in the Kondo-lattice metal, Tb2PdSi3. In this material the itinerant charge…
▽ More
Magnetic materials are usually divided into two classes: those with localised magnetic moments, and those with itinerant charge carriers. We present a comprehensive experimental (spectroscopic ellipsomerty) and theoretical study to demonstrate that these two types of magnetism do not only coexist but complement each other in the Kondo-lattice metal, Tb2PdSi3. In this material the itinerant charge carriers interact with large localised magnetic moments of Tb(4f) states, forming complex magnetic lattices at low temperatures, which we associate with self-organisation of magnetic clusters. The formation of magnetic clusters results in low-energy optical spectral weight shifts, which correspond to opening of the pseudogap in the conduction band of the itinerant charge carriers and development of the low- and high-spin intersite electronic transitions. This phenomenon, driven by self-trapping of electrons by magnetic fluctuations, could be common in correlated metals, including besides Kondo-lattice metals, Fe-based and cuprate superconductors.
△ Less
Submitted 27 July, 2013;
originally announced July 2013.
-
IR-active optical phonons in Pnma-1, Pnma-2 and R3c phases of LaMnO_{3+δ}
Authors:
I. S. Smirnova,
A. V. Bazhenov,
T. N. Fursova,
A. V. Dubovitskii,
L. S. Uspenskaya,
M. Yu. Maksimuk
Abstract:
Infrared-active phonons in LaMnO_{3+δ} were studied by means of the reflection and transmission spectroscopy from 50 to 800 cm^{-1} at room temperature. Powder and ceramic samples of the phases of Pnma-2 (δ=0.02), Pnma-1 (δ=0.08), and R3c (δ=0.15) were investigated. Besides, energies of the dipole-active phonons in Pnma-2, Pnma-1 phases were obtained by lattice-dynamics calculations. The transfo…
▽ More
Infrared-active phonons in LaMnO_{3+δ} were studied by means of the reflection and transmission spectroscopy from 50 to 800 cm^{-1} at room temperature. Powder and ceramic samples of the phases of Pnma-2 (δ=0.02), Pnma-1 (δ=0.08), and R3c (δ=0.15) were investigated. Besides, energies of the dipole-active phonons in Pnma-2, Pnma-1 phases were obtained by lattice-dynamics calculations. The transformations of IR-active phonons with the increase of δin the sequence of Pnma-2, Pnma-1, R3c are discussed.
△ Less
Submitted 23 April, 2007; v1 submitted 11 April, 2007;
originally announced April 2007.
-
Infrared Studies of a La_{0.67}Ca_{0.33}MnO_3 Single Crystal: Optical Magnetoconductivity in a Half-Metallic Ferromagnet
Authors:
A. V. Boris,
N. N. Kovaleva,
A. V. Bazhenov,
P. J. M. van Bentum,
Th. Rasing,
S-W. Cheong,
A. V. Samoilov,
N. -C. Yeh
Abstract:
The infrared reflectivity of a $\rm La_{0.67}Ca_{0.33}MnO_3$ single crystal is studied over a broad range of temperatures (78-340 K), magnetic fields (0-16 T), and wavenumbers (20-9000 cm$^{-1}$). The optical conductivity gradually changes from a Drude-like behavior to a broad peak feature near 5000 cm$^{-1}$ in the ferromagnetic state below the Curie temperature $T_C=307 K$. Various features of…
▽ More
The infrared reflectivity of a $\rm La_{0.67}Ca_{0.33}MnO_3$ single crystal is studied over a broad range of temperatures (78-340 K), magnetic fields (0-16 T), and wavenumbers (20-9000 cm$^{-1}$). The optical conductivity gradually changes from a Drude-like behavior to a broad peak feature near 5000 cm$^{-1}$ in the ferromagnetic state below the Curie temperature $T_C=307 K$. Various features of the optical conductivity bear striking resemblance to recent theoretical predictions based on the interplay between the double exchange interaction and the Jahn-Teller electron-phonon coupling. A large optical magnetoconductivity is observed near $T_C$.
△ Less
Submitted 5 August, 1998;
originally announced August 1998.