Showing 1–9 of 9 results for author: Ramos, J

Sim2Real Transfer for Audio-Visual Navigation with Frequency-Adaptive Acoustic Field Prediction

Authors: Changan Chen, Jordi Ramos, Anshul Tomar, Kristen Grauman

Abstract: Sim2real transfer has received increasing attention lately due to the success of learning robotic tasks in simulation end-to-end. While there has been a lot of progress in transferring vision-based navigation policies, the existing sim2real strategy for audio-visual navigation performs data augmentation empirically without measuring the acoustic gap. The sound differs from light in that it spans a… ▽ More Sim2real transfer has received increasing attention lately due to the success of learning robotic tasks in simulation end-to-end. While there has been a lot of progress in transferring vision-based navigation policies, the existing sim2real strategy for audio-visual navigation performs data augmentation empirically without measuring the acoustic gap. The sound differs from light in that it spans across much wider frequencies and thus requires a different solution for sim2real. We propose the first treatment of sim2real for audio-visual navigation by disentangling it into acoustic field prediction (AFP) and waypoint navigation. We first validate our design choice in the SoundSpaces simulator and show improvement on the Continuous AudioGoal navigation benchmark. We then collect real-world data to measure the spectral difference between the simulation and the real world by training AFP models that only take a specific frequency subband as input. We further propose a frequency-adaptive strategy that intelligently selects the best frequency band for prediction based on both the measured spectral difference and the energy distribution of the received audio, which improves the performance on the real data. Lastly, we build a real robot platform and show that the transferred policy can successfully navigate to sounding objects. This work demonstrates the potential of building intelligent agents that can see, hear, and act entirely from simulation, and transferring them to the real world. △ Less

Submitted 5 May, 2024; originally announced May 2024.

Technical description of the EPFL submission to the JPEG DNA CfP

Authors: Davi Lazzarotto, Jorge Encinas Ramos, Michela Testolina, Touradj Ebrahimi

Abstract: This document provides a technical description of the codec proposed by EPFL to the JPEG DNA Call for Proposals. The codec we refer to as V-DNA for its versatility, enables the encoding of raw images and already compressed JPEG 1 bitstreams, but the underlying algorithm could be used to encode and transcode any kind of data. The codec is composed of two main modules: the image compression module,… ▽ More This document provides a technical description of the codec proposed by EPFL to the JPEG DNA Call for Proposals. The codec we refer to as V-DNA for its versatility, enables the encoding of raw images and already compressed JPEG 1 bitstreams, but the underlying algorithm could be used to encode and transcode any kind of data. The codec is composed of two main modules: the image compression module, handled by the state-of-the-art JPEG XL codec, and the DNA encoding module, implemented using a modified Raptor Code implementation following the RU10 (Raptor Unsystematic) description. The code for encoding and decoding, as well as the objective metrics results, plots and biochemical constraints analysis are available on ISO Documents system with document number WG1M101013-ICQ-EPFL submission to the JPEG DNA CfP. △ Less

Submitted 1 December, 2023; originally announced December 2023.

Extending the practical applicability of the Kalman Filter

Authors: J Humberto Ramos

Abstract: A Schmidt filter is a modification of the Kalman filter that allows to append system parameters as states and considers their uncertainty effect in the filtering process without attempting to estimate such parameters. The states that are only considered but not estimated, are generally known as \textit{consider} or \textit{considered} states. The main contributions of this research are the formula… ▽ More A Schmidt filter is a modification of the Kalman filter that allows to append system parameters as states and considers their uncertainty effect in the filtering process without attempting to estimate such parameters. The states that are only considered but not estimated, are generally known as \textit{consider} or \textit{considered} states. The main contributions of this research are the formulations of a Schmidt-Kalman filter that incorporates the numerical robustness of the well-known square root and factorized filtering forms plus the capacity of actively attempting to update the \textit{considered} states. The filters formulations proposed in this research are a fundamental extension of the Kalman filter. Therefore, the formulations of this work also apply within the Extended Kalman filter framework. More importantly, they are shown to handle nonlinearities, larger initial uncertainties, and poorly conditioned systems better than a typical Extended or Schmidt Kalman filter. Because the new filters are directly based on the Schmidt filter, they offer a novel and straight-forward filtering framework, allowing the use of a more simple filter where a more advanced or elaborated technique could have been needed. △ Less

Submitted 25 August, 2022; originally announced August 2022.

Comments: PhD Thesis, Aerospace Engineering

Information-Aware Guidance for Magnetic Anomaly based Navigation

Authors: J. Humberto Ramos, Jaejeong Shin, Kyle Volle, Paul Buzaud, Kevin Brink, Prashant Ganesh

Abstract: In the absence of an absolute positioning system, such as GPS, autonomous vehicles are subject to accumulation of positional error which can interfere with reliable performance. Improved navigational accuracy without GPS enables vehicles to achieve a higher degree of autonomy and reliability, both in terms of decision making and safety. This paper details the use of two navigation systems for auto… ▽ More In the absence of an absolute positioning system, such as GPS, autonomous vehicles are subject to accumulation of positional error which can interfere with reliable performance. Improved navigational accuracy without GPS enables vehicles to achieve a higher degree of autonomy and reliability, both in terms of decision making and safety. This paper details the use of two navigation systems for autonomous agents using magnetic field anomalies to localize themselves within a map; both techniques use the information content in the environment in distinct ways and are aimed at reducing the localization uncertainty. The first method is based on a nonlinear observability metric of the vehicle model, while the second is an information theory based technique which minimizes the expected entropy of the system. These conditions are used to design guidance laws that minimize the localization uncertainty and are verified both in simulation and hardware experiments are presented for the observability approach. △ Less

Submitted 1 August, 2022; originally announced August 2022.

Comments: 2022 International Conference on Intelligent Robots and Systems October 23 to 27, 2022 Kyoto, Japan

A summary on the UD Kalman Filter

Authors: J. Humberto Ramos, Kevin Brink, Prashant Ganesh, John E. Hurtado

Abstract: This document contains a concise and unified reference for one of the existing mechanizations of the UD Kalman filter. The associated matrix algorithms are also included along with the corresponding references. This document contains a concise and unified reference for one of the existing mechanizations of the UD Kalman filter. The associated matrix algorithms are also included along with the corresponding references. △ Less

Submitted 29 June, 2022; v1 submitted 11 March, 2022; originally announced March 2022.

Comments: 12 pages, compendium of some key algorithms for UD Kalman filtering

3DBGrowth: volumetric vertebrae segmentation and reconstruction in magnetic resonance imaging

Authors: Jonathan S. Ramos, Mirela T. Cazzolato, Bruno S. Faiçal, Marcello H. Nogueira-Barbosa, Caetano Traina Jr., Agma J. M. Traina

Abstract: Segmentation of medical images is critical for making several processes of analysis and classification more reliable. With the growing number of people presenting back pain and related problems, the semi-automatic segmentation and 3D reconstruction of vertebral bodies became even more important to support decision making. A 3D reconstruction allows a fast and objective analysis of each vertebrae c… ▽ More Segmentation of medical images is critical for making several processes of analysis and classification more reliable. With the growing number of people presenting back pain and related problems, the semi-automatic segmentation and 3D reconstruction of vertebral bodies became even more important to support decision making. A 3D reconstruction allows a fast and objective analysis of each vertebrae condition, which may play a major role in surgical planning and evaluation of suitable treatments. In this paper, we propose 3DBGrowth, which develops a 3D reconstruction over the efficient Balanced Growth method for 2D images. We also take advantage of the slope coefficient from the annotation time to reduce the total number of annotated slices, reducing the time spent on manual annotation. We show experimental results on a representative dataset with 17 MRI exams demonstrating that our approach significantly outperforms the competitors and, on average, only 37% of the total slices with vertebral body content must be annotated without losing performance/accuracy. Compared to the state-of-the-art methods, we have achieved a Dice Score gain of over 5% with comparable processing time. Moreover, 3DBGrowth works well with imprecise seed points, which reduces the time spent on manual annotation by the specialist. △ Less

Submitted 8 July, 2019; v1 submitted 24 June, 2019; originally announced June 2019.

Comments: This is a pre-print of an article published in Computer-Based Medical Systems. The final authenticated version is available online at: https://doi.org/10.1109/CBMS.2019.00091

Journal ref: Computer-Based Medical Systems, 2019

Computation of the State Bias and Initial States for Stochastic State Space Systems in the General 2-D Roesser Model Form

Authors: José A. Ramos, Guillaume Mercère

Abstract: Recently \cite{Ramos2017a} presented a subspace system identification algorithm for 2-D purely stochastic state space models in the general Roesser form. However, since the exact problem requires an oblique projection of $Y_f^h$ projected onto $W_p^h$ along $\widehat{X}_f^{vh}$, where $W_p^h= \begin{bmatrix}\widehat{X}_p^{vh} \\ Y_p^h \end{bmatrix}$, this presents a problem since… ▽ More Recently \cite{Ramos2017a} presented a subspace system identification algorithm for 2-D purely stochastic state space models in the general Roesser form. However, since the exact problem requires an oblique projection of $Y_f^h$ projected onto $W_p^h$ along $\widehat{X}_f^{vh}$, where $W_p^h= \begin{bmatrix}\widehat{X}_p^{vh} \\ Y_p^h \end{bmatrix}$, this presents a problem since $\{\widehat{X}_p^{vh},\widehat{X}_f^{vh}\}$ are unknown. In the above mentioned paper, the authors found that by doing an orthogonal projection $Y_f^h/Y_p^h$, one can identify the future horizontal state matrix $\widehat{X}_f^{h}$ with a small bias due to the initial conditions that depend on $\{\widehat{X}_p^{vh},\widehat{X}_f^{vh}\}$. Nevertheless, the results on modeling 2-D images were very good despite lack of knowledge of $\{\widehat{X}_p^{vh},\widehat{X}_f^{vh}\}$. In this note we delve into the bias term and prove that it is insignificant, provided $i$ is chosen large enough and the vertical and horizontal states are uncorrelated. That is, the cross covariance of the state estimates $x_{r,s}^{h}$ and $x_{r,s}^{v}$ is zero, or $P_{hv}=0_{n_x\times n_x}$ and $P_{vh}=0_{n_x\times n_x}$. Our simulations use $i=30$. We also present a second iteration to improve the state estimates by including the vertical states computed from a vertical data processing step, i.e., by doing an orthogonal projection $Y_f^v/Y_p^v$. In this revised algorithm we include a step to compute the initial states. This new portion, in addition to the algorithm presented in \cite{Ramos2017a}, forms a complete 2-D stochastic subspace system identification algorithm. △ Less

Submitted 14 January, 2018; originally announced January 2018.

Comments: Companion paper of "A Stochastic Subspace System Identification Algorithm for State Space Systems in the General 2-D Roesser Model Form" published in International Journal of Control as a regular paper (https://doi.org/10.1080/00207179.2017.1418983)

Identification of parameterized gray-box state-space systems: from a black-box linear time-invariant representation to a structured one: detailed derivation of the gradients involved in the cost functions

Authors: Guillaume Mercère, José Ramos, Olivier Prot

Abstract: Estimating consistent parameters of a structured state-space representation requires a reliable initialization when the vector of parameters is computed by using a gradient-based algorithm. In the eponymous companion paper accepted for publication in IEEE Transactions on Automatic Control, the problem of supplying a reliable initial vector of parameters is tackled. More precisely, by assuming that… ▽ More Estimating consistent parameters of a structured state-space representation requires a reliable initialization when the vector of parameters is computed by using a gradient-based algorithm. In the eponymous companion paper accepted for publication in IEEE Transactions on Automatic Control, the problem of supplying a reliable initial vector of parameters is tackled. More precisely, by assuming that a reliable initial fully-parameterized state-space model of the system is available, the aforementioned paper addresses the challenging problem of transforming this initial fully-parameterized model into the structured state-space parameterization satisfied by the system to be identified. Two solutions to solve such a parameterization problem are more precisely introduced in the IEEE TAC paper. First, a solution based on a null-space-based reformulation of a set of equations arising from the aforementioned similarity transformation problem is considered. Second, an algorithm dedicated to non-convex optimization is presented in order to transform the initial fully-parameterized model into the structured state-space parameterization of the system to be identified. In this technical report, a specific attention is paid to the gradient computation required by the optimization algorithms used in aforementioned to solve the aforementioned problem. These gradient formulations are indeed necessary to apply the quasi-Newton Broyden-Fletcher-Goldfarb-Shanno (BFGS) methods used for the null-space based as well as the least-squares-formulated optimization techniques introduced in the IEEE TAC paper. For the sake of conciseness, we only focus on the smooth version of the optimization problem introduced in aforementioned paper. Interested readers can easily extend the following results by using the chain rule as well as the sub-gradient computation techniques. △ Less

Submitted 3 June, 2014; originally announced June 2014.

Comments: Companion paper of an eponymous article accepted for publication in IEEE Transactions on Automatic Control

Jointly Optimal Sensing and Resource Allocation for Multiuser Overlay Cognitive Radios

Authors: Luis M. Lopez-Ramos, Antonio G. Marques, Javier Ramos

Abstract: Successful deployment of cognitive radios requires efficient sensing of the spectrum and dynamic adaptation of the available resources according to the sensed (imperfect) information. While most works design these two tasks separately, in this paper we address them jointly. In particular, we investigate an overlay cognitive radio with multiple secondary users that access orthogonally a set of freq… ▽ More Successful deployment of cognitive radios requires efficient sensing of the spectrum and dynamic adaptation of the available resources according to the sensed (imperfect) information. While most works design these two tasks separately, in this paper we address them jointly. In particular, we investigate an overlay cognitive radio with multiple secondary users that access orthogonally a set of frequency bands originally devoted to primary users. The schemes are designed to minimize the cost of sensing, maximize the performance of the secondary users (weighted sum rate), and limit the probability of interfering the primary users. The joint design is addressed using dynamic programming and nonlinear optimization techniques. A two-step strategy that first finds the optimal resource allocation for any sensing scheme and then uses that solution as input to solve for the optimal sensing policy is implemented. The two-step strategy is optimal, gives rise to intuitive optimal policies, and entails a computational complexity much lower than that required to solve the original formulation. △ Less

Submitted 5 November, 2012; originally announced November 2012.

Comments: This work is supported by the Spanish Ministry of Science, under FPU Grant AP2010-1050. This paper has been submitted for publication to the IEEE Journal on Selected Areas in Communications. Parts of this paper were presented at CROWNCOM 2012