-
Real-time 6-DoF Pose Estimation by an Event-based Camera using Active LED Markers
Authors:
Gerald Ebmer,
Adam Loch,
Minh Nhat Vu,
Germain Haessig,
Roberto Mecca,
Markus Vincze,
Christian Hartl-Nesic,
Andreas Kugi
Abstract:
Real-time applications for autonomous operations depend largely on fast and robust vision-based localization systems. Since image processing tasks require processing large amounts of data, the computational resources often limit the performance of other processes. To overcome this limitation, traditional marker-based localization systems are widely used since they are easy to integrate and achieve…
▽ More
Real-time applications for autonomous operations depend largely on fast and robust vision-based localization systems. Since image processing tasks require processing large amounts of data, the computational resources often limit the performance of other processes. To overcome this limitation, traditional marker-based localization systems are widely used since they are easy to integrate and achieve reliable accuracy. However, classical marker-based localization systems significantly depend on standard cameras with low frame rates, which often lack accuracy due to motion blur. In contrast, event-based cameras provide high temporal resolution and a high dynamic range, which can be utilized for fast localization tasks, even under challenging visual conditions. This paper proposes a simple but effective event-based pose estimation system using active LED markers (ALM) for fast and accurate pose estimation. The proposed algorithm is able to operate in real time with a latency below \SI{0.5}{\milli\second} while maintaining output rates of \SI{3}{\kilo \hertz}. Experimental results in static and dynamic scenarios are presented to demonstrate the performance of the proposed approach in terms of computational speed and absolute accuracy, using the OptiTrack system as the basis for measurement.
△ Less
Submitted 25 October, 2023;
originally announced October 2023.
-
Event-Based high-speed low-latency fiducial marker tracking
Authors:
Adam Loch,
Germain Haessig,
Markus Vincze
Abstract:
Motion and dynamic environments, especially under challenging lighting conditions, are still an open issue for robust robotic applications. In this paper, we propose an end-to-end pipeline for real-time, low latency, 6 degrees-of-freedom pose estimation of fiducial markers. Instead of achieving a pose estimation through a conventional frame-based approach, we employ the high-speed abilities of eve…
▽ More
Motion and dynamic environments, especially under challenging lighting conditions, are still an open issue for robust robotic applications. In this paper, we propose an end-to-end pipeline for real-time, low latency, 6 degrees-of-freedom pose estimation of fiducial markers. Instead of achieving a pose estimation through a conventional frame-based approach, we employ the high-speed abilities of event-based sensors to directly refine the spatial transformation, using consecutive events. Furthermore, we introduce a novel two-way verification process for detecting tracking errors by backtracking the estimated pose, allowing us to evaluate the quality of our tracking. This approach allows us to achieve pose estimation at a rate up to 156~kHz, while only relying on CPU resources. The average end-to-end latency of our method is 3~ms. Experimental results demonstrate outstanding potential for robotic tasks, such as visual servoing in fast action-perception loops.
△ Less
Submitted 12 October, 2021;
originally announced October 2021.
-
AGAR a microbial colony dataset for deep learning detection
Authors:
Sylwia Majchrowska,
Jarosław Pawłowski,
Grzegorz Guła,
Tomasz Bonus,
Agata Hanas,
Adam Loch,
Agnieszka Pawlak,
Justyna Roszkowiak,
Tomasz Golan,
Zuzanna Drulis-Kawa
Abstract:
The Annotated Germs for Automated Recognition (AGAR) dataset is an image database of microbial colonies cultured on agar plates. It contains 18000 photos of five different microorganisms as single or mixed cultures, taken under diverse lighting conditions with two different cameras. All the images are classified into "countable", "uncountable", and "empty", with the "countable" class labeled by mi…
▽ More
The Annotated Germs for Automated Recognition (AGAR) dataset is an image database of microbial colonies cultured on agar plates. It contains 18000 photos of five different microorganisms as single or mixed cultures, taken under diverse lighting conditions with two different cameras. All the images are classified into "countable", "uncountable", and "empty", with the "countable" class labeled by microbiologists with colony location and species identification (336442 colonies in total). This study describes the dataset itself and the process of its development. In the second part, the performance of selected deep neural network architectures for object detection, namely Faster R-CNN and Cascade R-CNN, was evaluated on the AGAR dataset. The results confirmed the great potential of deep learning methods to automate the process of microbe localization and classification based on Petri dish photos. Moreover, AGAR is the first publicly available dataset of this kind and size and will facilitate the future development of machine learning models. The data used in these studies can be found at https://agar.neurosys.com/.
△ Less
Submitted 2 August, 2021;
originally announced August 2021.
-
A Channel Measurement Campaign for mmWave Communication in Industrial Settings
Authors:
Adrian Loch,
Cristina Cano,
Gek Hong,
Sim,
Arash Asadi,
Xavier Vilajosana
Abstract:
Industry 4.0 relies heavily on wireless technologies. Energy efficiency and device cost have played a significant role in the initial design of such wireless systems for industry automation. However, high reliability, high throughput, and low latency are also key for certain sectors such as the manufacturing industry. In this sense, existing wireless solutions for industrial settings are limited.…
▽ More
Industry 4.0 relies heavily on wireless technologies. Energy efficiency and device cost have played a significant role in the initial design of such wireless systems for industry automation. However, high reliability, high throughput, and low latency are also key for certain sectors such as the manufacturing industry. In this sense, existing wireless solutions for industrial settings are limited. Emerging technologies such as millimeter-wave (mmWave) communication are highly promising to address this bottleneck. Still, the propagation characteristics at such high frequencies in harsh industrial settings are not well understood. Related work in this area is limited to isolated measurements in specific scenarios. In this work, we carry out an extensive measurement campaign in highly representative industrial environments. Most importantly, we derive the statistical distributions of the channel parameters of widely accepted mmWave channel models that fit these environments. This is a highly valuable contribution, since researchers in this field can use our empirical model to understand the performance of their mmWave systems in typical industrial settings. Beyond analyzing and discussing our insights, with this paper we also shareoour extensive dataset with the research community.
△ Less
Submitted 25 March, 2019;
originally announced March 2019.
-
Potholes Ahead: Impact of Transient Link Blockage on Beam Steering in Practical mm-Wave Systems
Authors:
Adrian Loch,
Irene Tejado,
Joerg Widmer
Abstract:
The practical realization of beam steering mechanisms in millimeter wave communications has a large impact on performance. The key challenge is to find a pragmatic trade-off between throughput performance and the overhead of periodic beam sweeping required to improve link quality in case of transient link blockage. This is particularly critical in commercial off-the-shelf devices, which require si…
▽ More
The practical realization of beam steering mechanisms in millimeter wave communications has a large impact on performance. The key challenge is to find a pragmatic trade-off between throughput performance and the overhead of periodic beam sweeping required to improve link quality in case of transient link blockage. This is particularly critical in commercial off-the-shelf devices, which require simple yet efficient solutions. First, we analyze the operation of such a commercial device to understand the impact of link blockage in practice. To this end, we measure TCP throughput for different traffic loads while blocking the link at regular intervals. Second, we derive a Markov model based on our practical insights to compute throughput for the case of transient blockage. We use this model to evaluate the trade-off between throughput and periodic beam sweeping. Finally, we validate our results using throughput traces collected using the aforementioned commercial device. Both our model and our practical measurements show that transient blockage causes significant signal fluctuation due to suboptimal beam realignment. In particular, fluctuations increase with traffic load, limiting the achievable throughput. We show that choosing lower traffic loads allows us to reduce fluctuations by 41% while achieving the same net throughput than with higher traffic loads.
△ Less
Submitted 28 March, 2016;
originally announced March 2016.
