-
Non Holonomic Collision Avoidance of Dynamic Obstacles under Non-Parametric Uncertainty: A Hilbert Space Approach
Authors:
Unni Krishnan R Nair,
Anish Gupta,
D. A. Sasi Kiran,
Ajay Shrihari,
Vanshil Shah,
Arun Kumar Singh,
K. Madhava Krishna
Abstract:
We consider the problem of an agent/robot with non-holonomic kinematics avoiding many dynamic obstacles. State and velocity noise of both the robot and obstacles as well as the robot's control noise are modelled as non-parametric distributions as often the Gaussian assumptions of noise models are violated in real-world scenarios. Under these assumptions, we formulate a robust MPC that samples robo…
▽ More
We consider the problem of an agent/robot with non-holonomic kinematics avoiding many dynamic obstacles. State and velocity noise of both the robot and obstacles as well as the robot's control noise are modelled as non-parametric distributions as often the Gaussian assumptions of noise models are violated in real-world scenarios. Under these assumptions, we formulate a robust MPC that samples robotic controls effectively in a manner that aligns the robot to the goal state while avoiding obstacles under the duress of such non-parametric noise. In particular, the MPC incorporates a distribution matching cost that effectively aligns the distribution of the current collision cone to a certain desired distribution whose samples are collision-free. This cost is posed as a distance function in the Hilbert Space, whose minimization typically results in the collision cone samples becoming collision-free. We compare and show tangible performance gain with methods that model the collision cone distribution by linearizing the Gaussian approximations of the original non-parametric state and obstacle distributions. We also show superior performance with methods that pose a chance constraint formulation of the Gaussian approximations of non-parametric noise without subjecting such approximations to further linearizations. The performance gain is shown both in terms of trajectory length and control costs that vindicates the efficacy of the proposed method. To the best of our knowledge, this is the first presentation of non-holonomic collision avoidance of moving obstacles in the presence of non-parametric state, velocity and actuator noise models.
△ Less
Submitted 1 January, 2022; v1 submitted 24 December, 2021;
originally announced December 2021.
-
Grounding Linguistic Commands to Navigable Regions
Authors:
Nivedita Rufus,
Kanishk Jain,
Unni Krishnan R Nair,
Vineet Gandhi,
K Madhava Krishna
Abstract:
Humans have a natural ability to effortlessly comprehend linguistic commands such as "park next to the yellow sedan" and instinctively know which region of the road the vehicle should navigate. Extending this ability to autonomous vehicles is the next step towards creating fully autonomous agents that respond and act according to human commands. To this end, we propose the novel task of Referring…
▽ More
Humans have a natural ability to effortlessly comprehend linguistic commands such as "park next to the yellow sedan" and instinctively know which region of the road the vehicle should navigate. Extending this ability to autonomous vehicles is the next step towards creating fully autonomous agents that respond and act according to human commands. To this end, we propose the novel task of Referring Navigable Regions (RNR), i.e., grounding regions of interest for navigation based on the linguistic command. RNR is different from Referring Image Segmentation (RIS), which focuses on grounding an object referred to by the natural language expression instead of grounding a navigable region. For example, for a command "park next to the yellow sedan," RIS will aim to segment the referred sedan, and RNR aims to segment the suggested parking region on the road. We introduce a new dataset, Talk2Car-RegSeg, which extends the existing Talk2car dataset with segmentation masks for the regions described by the linguistic commands. A separate test split with concise manoeuvre-oriented commands is provided to assess the practicality of our dataset. We benchmark the proposed dataset using a novel transformer-based architecture. We present extensive ablations and show superior performance over baselines on multiple evaluation metrics. A downstream path planner generating trajectories based on RNR outputs confirms the efficacy of the proposed framework.
△ Less
Submitted 24 December, 2021;
originally announced December 2021.
-
Design And Analysis Of Three-Output Open Differential with 3-DOF
Authors:
Rama Vadapalli,
Nagamanikandan Govindan,
K Madhava Krishna
Abstract:
This paper presents a novel passive three-output differential with three degrees of freedom (3DOF), that translates motion and torque from a single input to three outputs. The proposed Three-Output Open Differential is designed such that its functioning is analogous to the functioning of a traditional two-output open differential. That is, the differential translates equal motion and torque to all…
▽ More
This paper presents a novel passive three-output differential with three degrees of freedom (3DOF), that translates motion and torque from a single input to three outputs. The proposed Three-Output Open Differential is designed such that its functioning is analogous to the functioning of a traditional two-output open differential. That is, the differential translates equal motion and torque to all its three outputs when the outputs are unconstrained or are subjected to equivalent load conditions. The introduced design is the first differential with three outputs to realise this outcome. The differential action between the three outputs is realised passively by a symmetric arrangement of three two-output open differentials and three two-input open differentials. The resulting differential mechanism achieves the novel result of equivalent input to output angular velocity and torque relations for all its three outputs. Furthermore, Three-Output Open Differential achieves the novel result for differentials with more than two outputs where each of its outputs shares equivalent angular velocity and torque relations with all the other outputs. The kinematics and dynamics of the Three-Output Open Differential are derived using the bond graph method. In addition, the merits of the differential mechanism along with its current and potential applications are presented.
△ Less
Submitted 21 December, 2021;
originally announced December 2021.
-
Modular Pipe Climber III with Three-Output Open Differential
Authors:
Rama Vadapalli,
Saharsh Agarwal,
Vishnu Kumar,
Kartik Suryavanshi,
Nagamanikandan,
K Madhava Krishna
Abstract:
The paper introduces the novel Modular Pipe Climber III with a Three-Output Open Differential (3-OOD) mechanism to eliminate slipping of the tracks due to the changing cross-sections of the pipe. This will be achieved in any orientation of the robot. Previous pipe climbers use three-wheel/track modules, each with an individual driving mechanism to achieve stable traversing. Slipping of tracks is p…
▽ More
The paper introduces the novel Modular Pipe Climber III with a Three-Output Open Differential (3-OOD) mechanism to eliminate slipping of the tracks due to the changing cross-sections of the pipe. This will be achieved in any orientation of the robot. Previous pipe climbers use three-wheel/track modules, each with an individual driving mechanism to achieve stable traversing. Slipping of tracks is prevalent in such robots when it encounters the pipe turns. Thus, active control of each module's speed is employed to mitigate the slip, thereby requiring substantial control effort. The proposed pipe climber implements the 3-OOD to address this issue by allowing the robot to mechanically modulate the track speeds as it encounters a turn. The proposed 3-OOD is the first three-output differential to realize the functional abilities of a traditional two-output differential.
△ Less
Submitted 8 January, 2022; v1 submitted 1 November, 2021;
originally announced December 2021.
-
Learning Actions for Drift-Free Navigation in Highly Dynamic Scenes
Authors:
Mohd Omama,
Sundar Sripada V. S.,
Sandeep Chinchali,
K. Madhava Krishna
Abstract:
We embark on a hitherto unreported problem of an autonomous robot (self-driving car) navigating in dynamic scenes in a manner that reduces its localization error and eventual cumulative drift or Absolute Trajectory Error, which is pronounced in such dynamic scenes. With the hugely popular Velodyne-16 3D LIDAR as the main sensing modality, and the accurate LIDAR-based Localization and Mapping algor…
▽ More
We embark on a hitherto unreported problem of an autonomous robot (self-driving car) navigating in dynamic scenes in a manner that reduces its localization error and eventual cumulative drift or Absolute Trajectory Error, which is pronounced in such dynamic scenes. With the hugely popular Velodyne-16 3D LIDAR as the main sensing modality, and the accurate LIDAR-based Localization and Mapping algorithm, LOAM, as the state estimation framework, we show that in the absence of a navigation policy, drift rapidly accumulates in the presence of moving objects. To overcome this, we learn actions that lead to drift-minimized navigation through a suitable set of reward and penalty functions. We use Proximal Policy Optimization, a class of Deep Reinforcement Learning methods, to learn the actions that result in drift-minimized trajectories. We show by extensive comparisons on a variety of synthetic, yet photo-realistic scenes made available through the CARLA Simulator the superior performance of the proposed framework vis-a-vis methods that do not adopt such policies.
△ Less
Submitted 31 March, 2022; v1 submitted 28 October, 2021;
originally announced October 2021.
-
Approximately Dual p-Approximate Schauder Frames
Authors:
K. Mahesh Krishna,
P. Sam Johnson
Abstract:
Difficulty in the construction of dual frames for a given Hilbert space led to the introduction of approximately dual frames in Hilbert spaces by Christensen and Laugesen. It becomes even more difficult in Banach spaces to construct duals. For this purpose, we introduce approximately dual frames for a class of approximate Schauder frames for Banach spaces and develop basic theory. Approximate dual…
▽ More
Difficulty in the construction of dual frames for a given Hilbert space led to the introduction of approximately dual frames in Hilbert spaces by Christensen and Laugesen. It becomes even more difficult in Banach spaces to construct duals. For this purpose, we introduce approximately dual frames for a class of approximate Schauder frames for Banach spaces and develop basic theory. Approximate duals for this subclass is completely characterized and its perturbation is also studied.
△ Less
Submitted 19 October, 2021;
originally announced October 2021.
-
CCO-VOXEL: Chance Constrained Optimization over Uncertain Voxel-Grid Representation for Safe Trajectory Planning
Authors:
Sudarshan S Harithas,
Rishabh Dev Yadav,
Deepak Singh,
Arun Kumar Singh,
K Madhava Krishna
Abstract:
We present CCO-VOXEL: the very first chance-constrained optimization (CCO) algorithm that can compute trajectory plans with probabilistic safety guarantees in real-time directly on the voxel-grid representation of the world. CCO-VOXEL maps the distribution over the distance to the closest obstacle to a distribution over collision-constraint violation and computes an optimal trajectory that minimiz…
▽ More
We present CCO-VOXEL: the very first chance-constrained optimization (CCO) algorithm that can compute trajectory plans with probabilistic safety guarantees in real-time directly on the voxel-grid representation of the world. CCO-VOXEL maps the distribution over the distance to the closest obstacle to a distribution over collision-constraint violation and computes an optimal trajectory that minimizes the violation probability. Importantly, unlike existing works, we never assume the nature of the sensor uncertainty or the probability distribution of the resulting collision-constraint violations. We leverage the notion of Hilbert Space embedding of distributions and Maximum Mean Discrepancy (MMD) to compute a tractable surrogate for the original chance-constrained optimization problem and employ a combination of A* based graph-search and Cross-Entropy Method for obtaining its minimum. We show tangible performance gain in terms of collision avoidance and trajectory smoothness as a consequence of our probabilistic formulation vis a vis state-of-the-art planning methods that do not account for such nonparametric noise. Finally, we also show how a combination of low-dimensional feature embedding and pre-caching of Kernel Matrices of MMD allows us to achieve real-time performance in simulations as well as in implementations on on-board commodity hardware that controls the quadrotor flight
△ Less
Submitted 5 April, 2022; v1 submitted 6 October, 2021;
originally announced October 2021.
-
Multi-Modal Model Predictive Control through Batch Non-Holonomic Trajectory Optimization: Application to Highway Driving
Authors:
Vivek K. Adajania,
Aditya Sharma,
Anish Gupta,
Houman Masnavi,
K Madhava Krishna,
Arun K. Singh
Abstract:
Standard Model Predictive Control (MPC) or trajectory optimization approaches perform only a local search to solve a complex non-convex optimization problem. As a result, they cannot capture the multi-modal characteristic of human driving. A global optimizer can be a potential solution but is computationally intractable in a real-time setting. In this paper, we present a real-time MPC capable of s…
▽ More
Standard Model Predictive Control (MPC) or trajectory optimization approaches perform only a local search to solve a complex non-convex optimization problem. As a result, they cannot capture the multi-modal characteristic of human driving. A global optimizer can be a potential solution but is computationally intractable in a real-time setting. In this paper, we present a real-time MPC capable of searching over different driving modalities. Our basic idea is simple: we run several goal-directed parallel trajectory optimizations and score the resulting trajectories based on user-defined meta cost functions. This allows us to perform a global search over several locally optimal motion plans. Although conceptually straightforward, realizing this idea in real-time with existing optimizers is highly challenging from technical and computational standpoints. With this motivation, we present a novel batch non-holonomic trajectory optimization whose underlying matrix algebra is easily parallelizable across problem instances and reduces to computing large batch matrix-vector products. This structure, in turn, is achieved by deriving a linearization-free multi-convex reformulation of the non-holonomic kinematics and collision avoidance constraints. We extensively validate our approach using both synthetic and real data sets (NGSIM) of traffic scenarios. We highlight how our algorithm automatically takes lane-change and overtaking decisions based on the defined meta cost function. Our batch optimizer achieves trajectories with lower meta cost, up to 6x faster than competing baselines.
△ Less
Submitted 14 March, 2022; v1 submitted 21 September, 2021;
originally announced September 2021.
-
Continuous Welch bounds with Applications
Authors:
K. Mahesh Krishna
Abstract:
Let $(Ω, μ)$ be a measure space and $\{τ_α\}_{α\in Ω}$ be a normalized continuous Bessel family for a finite dimensional Hilbert space $\mathcal{H}$ of dimension $d$. If the diagonal $Δ\coloneqq \{(α, α):α\in Ω\}$ is measurable in the measure space $Ω\times Ω$, then we show that
\begin{align*}
\sup _{α, β\in Ω, α\neq β}|\langle τ_α, τ_β\rangle |^{2m}\geq \frac{1}{(μ\timesμ)((Ω\timesΩ)\setminus…
▽ More
Let $(Ω, μ)$ be a measure space and $\{τ_α\}_{α\in Ω}$ be a normalized continuous Bessel family for a finite dimensional Hilbert space $\mathcal{H}$ of dimension $d$. If the diagonal $Δ\coloneqq \{(α, α):α\in Ω\}$ is measurable in the measure space $Ω\times Ω$, then we show that
\begin{align*}
\sup _{α, β\in Ω, α\neq β}|\langle τ_α, τ_β\rangle |^{2m}\geq \frac{1}{(μ\timesμ)((Ω\timesΩ)\setminusΔ)}\left[\frac{ μ(Ω)^2}{d+m-1 \choose m}-(μ\timesμ)(Δ)\right], \quad \forall m \in \mathbb{N}. \end{align*} This improves 47 years old celebrated result of Welch [\textit{IEEE Transactions on Information Theory, 1974}]. We introduce the notions of continuous cross correlation and frame potential of Bessel family and give applications of continuous Welch bounds to these concepts. We also introduce the notion of continuous Grassmannian frames.
△ Less
Submitted 20 September, 2021;
originally announced September 2021.
-
Improving Casazza-Kalton-Christensen-van Eijndhoven Perturbation with Applications
Authors:
K. Mahesh Krishna
Abstract:
Let $ \mathcal{X}$, $ \mathcal{Y}$ be Banach spaces and $S:\mathcal{X} \to \mathcal{Y} $ be an invertible Lipschitz map. Let $ T : \mathcal{X}\rightarrow \mathcal{Y}$ be a map and there exist $ λ_1,λ_2 \in \left [0, 1 \right )$ such that \begin{align*}
\|Tx-Ty-(Sx-Sy)\|\leqλ_1\|Sx-Sy\|+λ_2\|Tx-Ty\|,\quad \forall x,y \in \mathcal{X}. \end{align*} Then we prove that $T$ is an invertible Lipschitz…
▽ More
Let $ \mathcal{X}$, $ \mathcal{Y}$ be Banach spaces and $S:\mathcal{X} \to \mathcal{Y} $ be an invertible Lipschitz map. Let $ T : \mathcal{X}\rightarrow \mathcal{Y}$ be a map and there exist $ λ_1,λ_2 \in \left [0, 1 \right )$ such that \begin{align*}
\|Tx-Ty-(Sx-Sy)\|\leqλ_1\|Sx-Sy\|+λ_2\|Tx-Ty\|,\quad \forall x,y \in \mathcal{X}. \end{align*} Then we prove that $T$ is an invertible Lipschitz map. This improves 25 years old Casazza-Kalton-Christensen-van Eijndhoven perturbation. It also improves 28 years old Soderlind-Campanato perturbation and 2 years old Barbagallo-Ernst-Thera perturbation. We give applications to the theory of metric frames. The notion of Lipschitz atomic decomposition for Banach spaces is also introduced.
△ Less
Submitted 5 September, 2021;
originally announced September 2021.
-
AutoLay: Benchmarking amodal layout estimation for autonomous driving
Authors:
Kaustubh Mani,
N. Sai Shankar,
Krishna Murthy Jatavallabhula,
K. Madhava Krishna
Abstract:
Given an image or a video captured from a monocular camera, amodal layout estimation is the task of predicting semantics and occupancy in bird's eye view. The term amodal implies we also reason about entities in the scene that are occluded or truncated in image space. While several recent efforts have tackled this problem, there is a lack of standardization in task specification, datasets, and eva…
▽ More
Given an image or a video captured from a monocular camera, amodal layout estimation is the task of predicting semantics and occupancy in bird's eye view. The term amodal implies we also reason about entities in the scene that are occluded or truncated in image space. While several recent efforts have tackled this problem, there is a lack of standardization in task specification, datasets, and evaluation protocols. We address these gaps with AutoLay, a dataset and benchmark for amodal layout estimation from monocular images. AutoLay encompasses driving imagery from two popular datasets: KITTI and Argoverse. In addition to fine-grained attributes such as lanes, sidewalks, and vehicles, we also provide semantically annotated 3D point clouds. We implement several baselines and bleeding edge approaches, and release our data and code.
△ Less
Submitted 20 August, 2021;
originally announced August 2021.
-
Design and Analysis of Modular Pipe Climber-III with a Multi-Output Differential Mechanism
Authors:
Vishnu Kumar,
Saharsh Agarwal,
Rama Vadapalli,
Nagamanikandan Govindan,
Madhava Krishna
Abstract:
This paper presents the design of an in-pipe climbing robot that operates using a novel `Three-output open differential'(3-OOD) mechanism to traverse complex networks of pipes. Conventional wheeled/tracked in-pipe climbing robots are prone to slip and drag while traversing in pipe bends. The 3-OOD mechanism helps in achieving the novel result of eliminating slip and drag in the robot tracks during…
▽ More
This paper presents the design of an in-pipe climbing robot that operates using a novel `Three-output open differential'(3-OOD) mechanism to traverse complex networks of pipes. Conventional wheeled/tracked in-pipe climbing robots are prone to slip and drag while traversing in pipe bends. The 3-OOD mechanism helps in achieving the novel result of eliminating slip and drag in the robot tracks during motion. The proposed differential realizes the functional abilities of the traditional two-output differential, which is achieved the first time for a differential with three outputs. The 3-OOD mechanism mechanically modulates the track speeds of the robot based on the forces exerted on each track inside the pipe network, by eliminating the need for any active control. The simulation of the robot traversing in the pipe network in different orientations and in pipe-bends without slip shows the proposed design's effectiveness.
△ Less
Submitted 8 January, 2022; v1 submitted 11 July, 2021;
originally announced August 2021.
-
C*-algebraic Schur product theorem, Pólya-Szegő-Rudin question and Novak's conjecture
Authors:
K. Mahesh Krishna
Abstract:
Striking result of Vybíral [\textit{Adv. Math.} 2020] says that Schur product of positive matrices is bounded below by the size of the matrix and the row sums of Schur product. Vybíral used this result to prove the Novak's conjecture. In this paper, we define Schur product of matrices over arbitrary C*-algebras and derive the results of Schur and Vybíral. As an application, we state C*-algebraic v…
▽ More
Striking result of Vybíral [\textit{Adv. Math.} 2020] says that Schur product of positive matrices is bounded below by the size of the matrix and the row sums of Schur product. Vybíral used this result to prove the Novak's conjecture. In this paper, we define Schur product of matrices over arbitrary C*-algebras and derive the results of Schur and Vybíral. As an application, we state C*-algebraic version of Novak's conjecture and solve it for commutative unital C*-algebras. We formulate Pólya-Szegő-Rudin question for the C*-algebraic Schur product of positive matrices.
△ Less
Submitted 15 August, 2021;
originally announced August 2021.
-
On the local eigenvalue statistics for random band matrices in the localization regime
Authors:
Peter D. Hislop,
M. Krishna
Abstract:
We study the local eigenvalue statistics $ξ_{ω,E}^N$ associated with the eigenvalues of one-dimensional, $(2N+1) \times (2N+1)$ random band matrices with independent, identically distributed, real random variables and band width growing as $N^α$, for $0 < α< \frac{1}{2}$. We consider the limit points associated with the random variables $ξ_{ω,E}^N [I]$, for $I \subset \mathbb{R}$, and…
▽ More
We study the local eigenvalue statistics $ξ_{ω,E}^N$ associated with the eigenvalues of one-dimensional, $(2N+1) \times (2N+1)$ random band matrices with independent, identically distributed, real random variables and band width growing as $N^α$, for $0 < α< \frac{1}{2}$. We consider the limit points associated with the random variables $ξ_{ω,E}^N [I]$, for $I \subset \mathbb{R}$, and $E \in (-2,2)$. For Gaussian distributed random variables with $0 \leq α< \frac{1}{7}$, we prove that this family of random variables has nontrivial limit points for almost every $E \in (-2,2)$, and that these limit points are Poisson distributed with positive intensities. The proof is based on an analysis of the characteristic functions of the random variables $ξ_{ω,E}^N [I]$ and associated quantities related to the intensities, as $N$ tends towards infinity, and employs known localization bounds of \cite{schenker, peled, et. al.}, and the strong Wegner and Minami estimates \cite{peled, et. al.}. Our more general result applies to random band matrices with random variables having absolutely continuous distributions with bounded densities. Under the hypothesis that the localization bounds hold for $0 < α< \frac{1}{2}$, we prove that any nontrivial limit points of the random variables $ξ_{ω,E}^N [I]$ are distributed according to Poisson distributions.
△ Less
Submitted 30 July, 2021; v1 submitted 3 July, 2021;
originally announced July 2021.
-
Optimal Normal Bases Over Finite Fields
Authors:
Duggirala Meher Krishna,
Duggirala Ravi
Abstract:
In this paper, a method for constructing a near optimal normal basis for algebraic extensions of a finite field is described. In each extension, except for the squares of basis elements, the product of two distinct normal basis elements can be expressed as a linear combination of those two basis elements, with coefficients in a much smaller subfield.
In this paper, a method for constructing a near optimal normal basis for algebraic extensions of a finite field is described. In each extension, except for the squares of basis elements, the product of two distinct normal basis elements can be expressed as a linear combination of those two basis elements, with coefficients in a much smaller subfield.
△ Less
Submitted 26 June, 2021;
originally announced June 2021.
-
Complexity of Solution of Simultaneous Multivariate Polynomial Equations
Authors:
Duggirala Meher Krishna,
Duggirala Ravi
Abstract:
In this paper, an original reduction algorithm for solving simultaneous multivariate polynomial equations is presented. The algorithm is exponential in complexity, but the well-known algorithms, such as the extended Euclidean algorithm and Buchberger's algorithm, are superexponential. The superexponential complexity of the well-known algorithms is due to their not being "minimal" in a certain sens…
▽ More
In this paper, an original reduction algorithm for solving simultaneous multivariate polynomial equations is presented. The algorithm is exponential in complexity, but the well-known algorithms, such as the extended Euclidean algorithm and Buchberger's algorithm, are superexponential. The superexponential complexity of the well-known algorithms is due to their not being "minimal" in a certain sense. Buchberger's algorithm produces a Groebner basis. The proposed original reduction algorithm achieves the required task, via computation of determinants of parametric Sylvester matrices, and produces a Rabin basis, which is shown to be minimal, when two multivariate polynomials are reduced at a time. The minimality of Rabin basis allows us to prove exponential lower bounds for the space complexity of an algebraic proof of certification, for a specific computational problem in the computational complexity class PSPACE, showing that the complexity classes PSPACE and P cannot be the same. By the same reasoning, it follows that Co-NP is not the same as either of the complexity classes NP and P, and that the polynomial time hierarchy does not collapse. It is also shown that the class BPP of languages decidable by bounded error probabilistic algorithms with (probabilistic) polynomial time proofs for the membership of input words is not the same as any one of the complexity classes P, NP and Co-NP. It follows again, from the discussions, that the complexity classes NP and P are not the same, by relativization of BPP, with respect to P and NP.
△ Less
Submitted 31 May, 2021; v1 submitted 23 May, 2021;
originally announced May 2021.
-
Dilations of Linear Maps on Vector Spaces
Authors:
K. Mahesh Krishna,
P. Sam Johnson
Abstract:
We continue the study dilation of linear maps on vector spaces introduced by Bhat, De, and Rakshit. This notion is a variant of vector space dilation introduced by Han, Larson, Liu, and Liu. We derive vector space versions of Wold decomposition, Halmos dilation, N-dilation, inter-twining lifting theorem and a variant of Ando dilation. It is noted further that unlike a kind of uniqueness of Halmos…
▽ More
We continue the study dilation of linear maps on vector spaces introduced by Bhat, De, and Rakshit. This notion is a variant of vector space dilation introduced by Han, Larson, Liu, and Liu. We derive vector space versions of Wold decomposition, Halmos dilation, N-dilation, inter-twining lifting theorem and a variant of Ando dilation. It is noted further that unlike a kind of uniqueness of Halmos dilation of strict contractions on Hilbert spaces, vector space version of Halmos dilation can not be characterized.
△ Less
Submitted 14 April, 2021;
originally announced April 2021.
-
Commutators Close to the Identity in Unital C*-Algebras
Authors:
K. Mahesh Krishna,
P. Sam Johnson
Abstract:
Let $\mathcal{H}$ be an infinite dimensional Hilbert space and $\mathcal{B}(\mathcal{H})$ be the C*-algebra of all bounded linear operators on $\mathcal{H}$, equipped with the operator-norm. By improving the Brown-Pearcy construction, Terence Tao in 2018, extended the result of Popa [1981] which reads as : For each $0<\varepsilon\leq 1/2$, there exist $D,X \in \mathcal{B}(\mathcal{H})$ with…
▽ More
Let $\mathcal{H}$ be an infinite dimensional Hilbert space and $\mathcal{B}(\mathcal{H})$ be the C*-algebra of all bounded linear operators on $\mathcal{H}$, equipped with the operator-norm. By improving the Brown-Pearcy construction, Terence Tao in 2018, extended the result of Popa [1981] which reads as : For each $0<\varepsilon\leq 1/2$, there exist $D,X \in \mathcal{B}(\mathcal{H})$ with $\|[D,X]-1_{\mathcal{B}(\mathcal{H})}\|\leq \varepsilon$ such that $\|D\|\|X\|=O\left(\log^5\frac{1}{\varepsilon}\right)$, where $[D,X]:= DX-XD$. In this paper, we show that Tao's result still holds for certain class of unital C*-algebras which include $\mathcal{B}(\mathcal{H})$ as well as the Cuntz algebra $\mathcal{O}_2$.
△ Less
Submitted 5 April, 2021;
originally announced April 2021.
-
RP-VIO: Robust Plane-based Visual-Inertial Odometry for Dynamic Environments
Authors:
Karnik Ram,
Chaitanya Kharyal,
Sudarshan S. Harithas,
K. Madhava Krishna
Abstract:
Modern visual-inertial navigation systems (VINS) are faced with a critical challenge in real-world deployment: they need to operate reliably and robustly in highly dynamic environments. Current best solutions merely filter dynamic objects as outliers based on the semantics of the object category. Such an approach does not scale as it requires semantic classifiers to encompass all possibly-moving o…
▽ More
Modern visual-inertial navigation systems (VINS) are faced with a critical challenge in real-world deployment: they need to operate reliably and robustly in highly dynamic environments. Current best solutions merely filter dynamic objects as outliers based on the semantics of the object category. Such an approach does not scale as it requires semantic classifiers to encompass all possibly-moving object classes; this is hard to define, let alone deploy. On the other hand, many real-world environments exhibit strong structural regularities in the form of planes such as walls and ground surfaces, which are also crucially static. We present RP-VIO, a monocular visual-inertial odometry system that leverages the simple geometry of these planes for improved robustness and accuracy in challenging dynamic environments. Since existing datasets have a limited number of dynamic elements, we also present a highly-dynamic, photorealistic synthetic dataset for a more effective evaluation of the capabilities of modern VINS systems. We evaluate our approach on this dataset, and three diverse sequences from standard datasets including two real-world dynamic sequences and show a significant improvement in robustness and accuracy over a state-of-the-art monocular visual-inertial odometry system. We also show in simulation an improvement over a simple dynamic-features masking approach. Our code and dataset are publicly available.
△ Less
Submitted 5 December, 2021; v1 submitted 18 March, 2021;
originally announced March 2021.
-
Monocular Multi-Layer Layout Estimation for Warehouse Racks
Authors:
Meher Shashwat Nigam,
Avinash Prabhu,
Anurag Sahu,
Puru Gupta,
Tanvi Karandikar,
N. Sai Shankar,
Ravi Kiran Sarvadevabhatla,
K. Madhava Krishna
Abstract:
Given a monocular colour image of a warehouse rack, we aim to predict the bird's-eye view layout for each shelf in the rack, which we term as multi-layer layout prediction. To this end, we present RackLay, a deep neural network for real-time shelf layout estimation from a single image. Unlike previous layout estimation methods, which provide a single layout for the dominant ground plane alone, Rac…
▽ More
Given a monocular colour image of a warehouse rack, we aim to predict the bird's-eye view layout for each shelf in the rack, which we term as multi-layer layout prediction. To this end, we present RackLay, a deep neural network for real-time shelf layout estimation from a single image. Unlike previous layout estimation methods, which provide a single layout for the dominant ground plane alone, RackLay estimates the top-view and front-view layout for each shelf in the considered rack populated with objects. RackLay's architecture and its variants are versatile and estimate accurate layouts for diverse scenes characterized by varying number of visible shelves in an image, large range in shelf occupancy factor and varied background clutter. Given the extreme paucity of datasets in this space and the difficulty involved in acquiring real data from warehouses, we additionally release a flexible synthetic dataset generation pipeline WareSynth which allows users to control the generation process and tailor the dataset according to contingent application. The ablations across architectural variants and comparison with strong prior baselines vindicate the efficacy of RackLay as an apt architecture for the novel problem of multi-layered layout estimation. We also show that fusing the top-view and front-view enables 3D reasoning applications such as metric free space estimation for the considered rack.
△ Less
Submitted 28 October, 2021; v1 submitted 16 March, 2021;
originally announced March 2021.
-
RoRD: Rotation-Robust Descriptors and Orthographic Views for Local Feature Matching
Authors:
Udit Singh Parihar,
Aniket Gujarathi,
Kinal Mehta,
Satyajit Tourani,
Sourav Garg,
Michael Milford,
K. Madhava Krishna
Abstract:
The use of local detectors and descriptors in typical computer vision pipelines work well until variations in viewpoint and appearance change become extreme. Past research in this area has typically focused on one of two approaches to this challenge: the use of projections into spaces more suitable for feature matching under extreme viewpoint changes, and attempting to learn features that are inhe…
▽ More
The use of local detectors and descriptors in typical computer vision pipelines work well until variations in viewpoint and appearance change become extreme. Past research in this area has typically focused on one of two approaches to this challenge: the use of projections into spaces more suitable for feature matching under extreme viewpoint changes, and attempting to learn features that are inherently more robust to viewpoint change. In this paper, we present a novel framework that combines learning of invariant descriptors through data augmentation and orthographic viewpoint projection. We propose rotation-robust local descriptors, learnt through training data augmentation based on rotation homographies, and a correspondence ensemble technique that combines vanilla feature correspondences with those obtained through rotation-robust features. Using a range of benchmark datasets as well as contributing a new bespoke dataset for this research domain, we evaluate the effectiveness of the proposed approach on key tasks including pose estimation and visual place recognition. Our system outperforms a range of baseline and state-of-the-art techniques, including enabling higher levels of place recognition precision across opposing place viewpoints and achieves practically-useful performance levels even under extreme viewpoint changes.
△ Less
Submitted 24 March, 2022; v1 submitted 15 March, 2021;
originally announced March 2021.
-
Expansion of approximate Bessel sequences to approximate Schauder frames for Banach spaces
Authors:
K. Mahesh Krishna,
P. Sam Johnson
Abstract:
It is known in Hilbert space frame theory that a Bessel sequence can be expanded to a frame. Contrary to Hilbert space situation, using a result of Casazza and Christensen, we show that there are Banach spaces and approximate Bessel sequences which can not be expanded to approximate Schauder frames. We characterize Banach spaces in which one can expand approximate Bessel sequences to approximate S…
▽ More
It is known in Hilbert space frame theory that a Bessel sequence can be expanded to a frame. Contrary to Hilbert space situation, using a result of Casazza and Christensen, we show that there are Banach spaces and approximate Bessel sequences which can not be expanded to approximate Schauder frames. We characterize Banach spaces in which one can expand approximate Bessel sequences to approximate Schauder frames.
△ Less
Submitted 5 February, 2021;
originally announced February 2021.
-
Probability Analysis and Comparison of Well-Known Integer Factorization Algorithms
Authors:
Duggirala Meher Krishna,
Duggirala Ravi
Abstract:
Two prominent methods for integer factorization are those based on general integer sieve and elliptic curve. The general integer sieve method can be specialized to quadratic integer sieve method. In this paper, a probability analysis for the success of these methods is described, under some reasonable conditions. The estimates presented are specialized for the elliptic curve factorization. These m…
▽ More
Two prominent methods for integer factorization are those based on general integer sieve and elliptic curve. The general integer sieve method can be specialized to quadratic integer sieve method. In this paper, a probability analysis for the success of these methods is described, under some reasonable conditions. The estimates presented are specialized for the elliptic curve factorization. These methods are compared through heuristic estimates. It is shown that the elliptic curve method is a probabilistic polynomial time algorithm under the assumption of uniform probability distribution for the arising group orders and clearly more likely to succeed, faster asymptotically.
△ Less
Submitted 21 January, 2021;
originally announced January 2021.
-
New Identity on Parseval p-Approximate Schauder Frames and Applications
Authors:
K. Mahesh Krishna,
P. Sam Johnson
Abstract:
A very useful identity for Parseval frames for Hilbert spaces was obtained by Balan, Casazza, Edidin, and Kutyniok. In this paper, we obtain a similar identity for Parseval p-approximate Schauder frames for Banach spaces which admits a homogeneous semi-inner product in the sense of Lumer-Giles.
A very useful identity for Parseval frames for Hilbert spaces was obtained by Balan, Casazza, Edidin, and Kutyniok. In this paper, we obtain a similar identity for Parseval p-approximate Schauder frames for Banach spaces which admits a homogeneous semi-inner product in the sense of Lumer-Giles.
△ Less
Submitted 14 January, 2021;
originally announced January 2021.
-
ZnO Nanowire Arrays Decorated with Titanium Nitride Nanoparticles as Surface Enhanced Raman Scattering Substrates
Authors:
Y. Rajesh,
M. S. S. Bharati,
S. Venugopal Rao,
M. Ghanashyam Krishna
Abstract:
In this work, ZnO nanowire arrays decorated with titanium nitride (TiN) nanoparticles as surface enhanced Raman scattering (SERS) substrates is demonstrated. ZnO nanowires were grown by hydrothermal synthesis while ~100 nm TiN nanoparticles were obtained by grinding commercial powders for several hours. They were then decorated on the ZnO nanowire arrays using acetone as the medium. Scanning elect…
▽ More
In this work, ZnO nanowire arrays decorated with titanium nitride (TiN) nanoparticles as surface enhanced Raman scattering (SERS) substrates is demonstrated. ZnO nanowires were grown by hydrothermal synthesis while ~100 nm TiN nanoparticles were obtained by grinding commercial powders for several hours. They were then decorated on the ZnO nanowire arrays using acetone as the medium. Scanning electron microscopy confirmed the presence of TiN nanoparticles on the ZnO nanowires. TiN nanoparticles exhibited localized surface plasmon resonances at 430, 520 and 600 nm. SERS experiments using Nile Blue and Methylene Blue as the analyte molecules showed significant enhancement in the Raman signals. It is shown that the origin of the SERS effect is chemical in nature, due to charge transfer between the analyte molecule and the TiN nanoparticles. The current work, thus, represents a simple, cost-effective and facile method for the fabrication of TiN based surface enhanced Raman scattering substrates.
△ Less
Submitted 12 December, 2020;
originally announced December 2020.
-
Perturbation of p-approximate Schauder frames for separable Banach spaces
Authors:
K. Mahesh Krishna,
P. Sam Johnson
Abstract:
Paley-Wiener theorem for frames for Hilbert spaces, Banach frames, Schauder frames and atomic decompositions for Banach spaces are known. In this paper, we derive Paley-Wiener theorem for p-approximate Schauder frames for separable Banach spaces. We show that our results give Paley-Wiener theorem for frames for Hilbert spaces.
Paley-Wiener theorem for frames for Hilbert spaces, Banach frames, Schauder frames and atomic decompositions for Banach spaces are known. In this paper, we derive Paley-Wiener theorem for p-approximate Schauder frames for separable Banach spaces. We show that our results give Paley-Wiener theorem for frames for Hilbert spaces.
△ Less
Submitted 5 December, 2020;
originally announced December 2020.
-
DRACO: Weakly Supervised Dense Reconstruction And Canonicalization of Objects
Authors:
Rahul Sajnani,
AadilMehdi Sanchawala,
Krishna Murthy Jatavallabhula,
Srinath Sridhar,
K. Madhava Krishna
Abstract:
We present DRACO, a method for Dense Reconstruction And Canonicalization of Object shape from one or more RGB images. Canonical shape reconstruction, estimating 3D object shape in a coordinate space canonicalized for scale, rotation, and translation parameters, is an emerging paradigm that holds promise for a multitude of robotic applications. Prior approaches either rely on painstakingly gathered…
▽ More
We present DRACO, a method for Dense Reconstruction And Canonicalization of Object shape from one or more RGB images. Canonical shape reconstruction, estimating 3D object shape in a coordinate space canonicalized for scale, rotation, and translation parameters, is an emerging paradigm that holds promise for a multitude of robotic applications. Prior approaches either rely on painstakingly gathered dense 3D supervision, or produce only sparse canonical representations, limiting real-world applicability. DRACO performs dense canonicalization using only weak supervision in the form of camera poses and semantic keypoints at train time. During inference, DRACO predicts dense object-centric depth maps in a canonical coordinate-space, solely using one or more RGB images of an object. Extensive experiments on canonical shape reconstruction and pose estimation show that DRACO is competitive or superior to fully-supervised methods.
△ Less
Submitted 25 November, 2020;
originally announced November 2020.
-
Dilation theorem for p-approximate Schauder frames for separable Banach spaces
Authors:
K. Mahesh Krishna,
P. Sam Johnson
Abstract:
Famous Naimark-Han-Larson dilation theorem for frames in Hilbert spaces states that every frame for a separable Hilbert space $\mathcal{H}$ is image of a Riesz basis under an orthogonal projection from a separable Hilbert space $\mathcal{H}_1$ which contains $\mathcal{H}$ isometrically. In this paper, we derive dilation result for p-approximate Schauder frames for separable Banach spaces. Our resu…
▽ More
Famous Naimark-Han-Larson dilation theorem for frames in Hilbert spaces states that every frame for a separable Hilbert space $\mathcal{H}$ is image of a Riesz basis under an orthogonal projection from a separable Hilbert space $\mathcal{H}_1$ which contains $\mathcal{H}$ isometrically. In this paper, we derive dilation result for p-approximate Schauder frames for separable Banach spaces. Our result contains Naimark-Han-Larson dilation theorem as a particular case.
△ Less
Submitted 23 November, 2020;
originally announced November 2020.
-
BirdSLAM: Monocular Multibody SLAM in Bird's-Eye View
Authors:
Swapnil Daga,
Gokul B. Nair,
Anirudha Ramesh,
Rahul Sajnani,
Junaid Ahmed Ansari,
K. Madhava Krishna
Abstract:
In this paper, we present BirdSLAM, a novel simultaneous localization and mapping (SLAM) system for the challenging scenario of autonomous driving platforms equipped with only a monocular camera. BirdSLAM tackles challenges faced by other monocular SLAM systems (such as scale ambiguity in monocular reconstruction, dynamic object localization, and uncertainty in feature representation) by using an…
▽ More
In this paper, we present BirdSLAM, a novel simultaneous localization and mapping (SLAM) system for the challenging scenario of autonomous driving platforms equipped with only a monocular camera. BirdSLAM tackles challenges faced by other monocular SLAM systems (such as scale ambiguity in monocular reconstruction, dynamic object localization, and uncertainty in feature representation) by using an orthographic (bird's-eye) view as the configuration space in which localization and mapping are performed. By assuming only the height of the ego-camera above the ground, BirdSLAM leverages single-view metrology cues to accurately localize the ego-vehicle and all other traffic participants in bird's-eye view. We demonstrate that our system outperforms prior work that uses strictly greater information, and highlight the relevance of each design decision via an ablation analysis.
△ Less
Submitted 15 November, 2020;
originally announced November 2020.
-
Factorable Weak Operator-Valued Frames
Authors:
K. Mahesh Krishna,
P. Sam Johnson
Abstract:
Let $\mathcal{H}$ and $\mathcal{H}_0$ be Hilbert spaces and $\{A_n\}_n$ be a sequence of bounded linear operators from $\mathcal{H}$ to $\mathcal{H}_0$. The study frames for Hilbert spaces initiated the study of operators of the form $\sum_{n=1}^{\infty}A_n^*A_n$, where the convergence is in the strong-operator topology, by Kaftal, Larson and Zhang in the paper: Operator-valued frames. \textit{Tra…
▽ More
Let $\mathcal{H}$ and $\mathcal{H}_0$ be Hilbert spaces and $\{A_n\}_n$ be a sequence of bounded linear operators from $\mathcal{H}$ to $\mathcal{H}_0$. The study frames for Hilbert spaces initiated the study of operators of the form $\sum_{n=1}^{\infty}A_n^*A_n$, where the convergence is in the strong-operator topology, by Kaftal, Larson and Zhang in the paper: Operator-valued frames. \textit{Trans. Amer. Math. Soc.}, 361(12):6349-6385, 2009. In this paper, we generalize this and study the series of the form $\sum_{n=1}^{\infty}Ψ_n^*A_n$, where $\{Ψ_n\}_n$ is a sequence of operators from $\mathcal{H}$ to $\mathcal{H}_0$. Main tool used in the study of $\sum_{n=1}^{\infty}A_n^*A_n$ is the factorization of this series. Since the series $\sum_{n=1}^{\infty}Ψ_n^*A_n$ may not be factored, it demands greater care. Therefore we impose a factorization of $\sum_{n=1}^{\infty}Ψ_n^*A_n$ and derive various results. We characterize them and derive dilation results. We further study the series by taking the indexed set as group as well as group-like unitary system. We also derive stability results.
△ Less
Submitted 11 November, 2020;
originally announced November 2020.
-
Frames for Metric Spaces
Authors:
K. Mahesh Krishna,
P. Sam Johnson
Abstract:
We make a systematic study of frames for metric spaces. We prove that every separable metric space admits a metric $\mathcal{M}_d$-frame. Through Lipschitz-free Banach spaces we show that there is a correspondence between frames for metric spaces and frames for subsets of Banach spaces. We derive some characterizations of metric frames. We also derive stability results for metric frames.
We make a systematic study of frames for metric spaces. We prove that every separable metric space admits a metric $\mathcal{M}_d$-frame. Through Lipschitz-free Banach spaces we show that there is a correspondence between frames for metric spaces and frames for subsets of Banach spaces. We derive some characterizations of metric frames. We also derive stability results for metric frames.
△ Less
Submitted 3 November, 2020;
originally announced November 2020.
-
Fast Adaptation of Manipulator Trajectories to Task Perturbation By Differentiating through the Optimal Solution
Authors:
Shashank Srikanth,
Mithun Babu,
Houman Masnavi,
Arun Kumar Singh,
Karl Kruusamäe,
K. Madhava Krishna
Abstract:
Joint space trajectory optimization under end-effector task constraints leads to a challenging non-convex problem. Thus, a real-time adaptation of prior computed trajectories to perturbation in task constraints often becomes intractable. Existing works use the so-called warm-starting of trajectory optimization to improve computational performance. We present a fundamentally different approach that…
▽ More
Joint space trajectory optimization under end-effector task constraints leads to a challenging non-convex problem. Thus, a real-time adaptation of prior computed trajectories to perturbation in task constraints often becomes intractable. Existing works use the so-called warm-starting of trajectory optimization to improve computational performance. We present a fundamentally different approach that relies on deriving analytical gradients of the optimal solution with respect to the task constraint parameters. This gradient map characterizes the direction in which the prior computed joint trajectories need to be deformed to comply with the new task constraints. Subsequently, we develop an iterative line-search algorithm for computing the scale of deformation. Our algorithm provides near real-time adaptation of joint trajectories for a diverse class of task perturbations such as (i) changes in initial and final joint configurations of end-effector orientation-constrained trajectories and (ii) changes in end-effector goal or way-points under end-effector orientation constraints. We relate each of these examples to real-world applications ranging from learning from demonstration to obstacle avoidance. We also show that our algorithm produces trajectories with quality similar to what one would obtain by solving the trajectory optimization from scratch with warm-start initialization. But most importantly, our algorithm achieves a worst-case speed-up of 160x over the latter approach.
△ Less
Submitted 1 November, 2020;
originally announced November 2020.
-
Light induced resistive switching in copper oxide thin films
Authors:
L. D. Varma Sangani,
M. Ghanashyam Krishna
Abstract:
Copper oxide thin film based metal-insulator-metal structures were subjected to white light irradiation.The top electrodes included Al, Cr and Ni while the bottom electrode was either Au or Pt. A white light pulse controls the set process and this light induced set (LIS) can be performed at very low voltages (tens of milli volts) which is not possible in the normal set process. The LIS is initiate…
▽ More
Copper oxide thin film based metal-insulator-metal structures were subjected to white light irradiation.The top electrodes included Al, Cr and Ni while the bottom electrode was either Au or Pt. A white light pulse controls the set process and this light induced set (LIS) can be performed at very low voltages (tens of milli volts) which is not possible in the normal set process. The LIS is initiated at the positive edge of the pulse and there is no effect of the falling edge of the light. In most cases the high resistance state (HRS) to low resistance state (LRS) transition is irreversible i.e.the devices continue to remain in the LRS even after the light pulse is switched off. Light induced reset (LIR) is achieved in only one device structure Al/CuxO/Au. By using LIS and LIR, set and reset power of the device can be reduced to a great extent and the set and reset parameters variation also reduces. The current work, thus, points to the possibility of formation and compliance-free resistive random access memory devices.
△ Less
Submitted 1 November, 2020;
originally announced November 2020.
-
Towards characterizations of approximate Schauder frame and its duals for Banach spaces
Authors:
K. Mahesh Krishna,
P. Sam Johnson
Abstract:
We begin the study of characterizations of recently defined approximate Schauder frame (ASF) and its duals for separable Banach spaces. We show that, under some conditions, both ASF and its dual frames can be characterized for Banach spaces. We also give an operator-theoretic characterization for similarity of ASFs. Our results encode the results of Holub, Li, Balan, Han, and Larson. We also addre…
▽ More
We begin the study of characterizations of recently defined approximate Schauder frame (ASF) and its duals for separable Banach spaces. We show that, under some conditions, both ASF and its dual frames can be characterized for Banach spaces. We also give an operator-theoretic characterization for similarity of ASFs. Our results encode the results of Holub, Li, Balan, Han, and Larson. We also address orthogonality of ASFs.
△ Less
Submitted 20 October, 2020;
originally announced October 2020.
-
The noncommutative $\ell_1-\ell_2$ inequality for Hilbert C*-modules and the exact constant
Authors:
K. Mahesh Krishna,
P. Sam Johnson
Abstract:
Let $\mathcal{A}$ be a unital C*-algebra. Then the theory of Hilbert C*-modules tells that \begin{align*} \sum_{i=1}^{n}(a_ia_i^*)^\frac{1}{2}\leq \sqrt{n} \left(\sum_{i=1}^{n}a_ia_i^*\right)^\frac{1}{2}, \quad \forall n \in \mathbb{N}, \forall a_1, \dots, a_n \in \mathcal{A}. \end{align*} By modifications of arguments of Botelho-Andrade, Casazza, Cheng, and Tran given in 2019, for certain tuple…
▽ More
Let $\mathcal{A}$ be a unital C*-algebra. Then the theory of Hilbert C*-modules tells that \begin{align*} \sum_{i=1}^{n}(a_ia_i^*)^\frac{1}{2}\leq \sqrt{n} \left(\sum_{i=1}^{n}a_ia_i^*\right)^\frac{1}{2}, \quad \forall n \in \mathbb{N}, \forall a_1, \dots, a_n \in \mathcal{A}. \end{align*} By modifications of arguments of Botelho-Andrade, Casazza, Cheng, and Tran given in 2019, for certain tuple $x=(a_1, \dots, a_n) \in \mathcal{A}^n$, we give a method to compute a positive element $c_x$ in the C*-algebra $\mathcal{A}$ such that the equality
\begin{align*} \sum_{i=1}^{n}(a_ia_i^*)^\frac{1}{2}=c_x \sqrt{n} \left(\sum_{i=1}^{n}a_ia_i^*\right)^\frac{1}{2}. \end{align*} holds. We give an application for the integral of G. G. Kasparov. We also derive the formula for the exact constant for the continuous $\ell_1-\ell_2$ inequality.
△ Less
Submitted 6 October, 2020;
originally announced October 2020.
-
Early Bird: Loop Closures from Opposing Viewpoints for Perceptually-Aliased Indoor Environments
Authors:
Satyajit Tourani,
Dhagash Desai,
Udit Singh Parihar,
Sourav Garg,
Ravi Kiran Sarvadevabhatla,
Michael Milford,
K. Madhava Krishna
Abstract:
Significant advances have been made recently in Visual Place Recognition (VPR), feature correspondence, and localization due to the proliferation of deep-learning-based methods. However, existing approaches tend to address, partially or fully, only one of two key challenges: viewpoint change and perceptual aliasing. In this paper, we present novel research that simultaneously addresses both challe…
▽ More
Significant advances have been made recently in Visual Place Recognition (VPR), feature correspondence, and localization due to the proliferation of deep-learning-based methods. However, existing approaches tend to address, partially or fully, only one of two key challenges: viewpoint change and perceptual aliasing. In this paper, we present novel research that simultaneously addresses both challenges by combining deep-learned features with geometric transformations based on reasonable domain assumptions about navigation on a ground-plane, whilst also removing the requirement for specialized hardware setup (e.g. lighting, downwards facing cameras). In particular, our integration of VPR with SLAM by leveraging the robustness of deep-learned features and our homography-based extreme viewpoint invariance significantly boosts the performance of VPR, feature correspondence, and pose graph submodules of the SLAM pipeline. For the first time, we demonstrate a localization system capable of state-of-the-art performance despite perceptual aliasing and extreme 180-degree-rotated viewpoint change in a range of real-world and simulated experiments. Our system is able to achieve early loop closures that prevent significant drifts in SLAM trajectories. We also compare extensively several deep architectures for VPR and descriptor matching. We also show that superior place recognition and descriptor matching across opposite views results in a similar performance gain in back-end pose graph optimization.
△ Less
Submitted 20 December, 2020; v1 submitted 3 October, 2020;
originally announced October 2020.
-
Cosine meets Softmax: A tough-to-beat baseline for visual grounding
Authors:
Nivedita Rufus,
Unni Krishnan R Nair,
K. Madhava Krishna,
Vineet Gandhi
Abstract:
In this paper, we present a simple baseline for visual grounding for autonomous driving which outperforms the state of the art methods, while retaining minimal design choices. Our framework minimizes the cross-entropy loss over the cosine distance between multiple image ROI features with a text embedding (representing the give sentence/phrase). We use pre-trained networks for obtaining the initial…
▽ More
In this paper, we present a simple baseline for visual grounding for autonomous driving which outperforms the state of the art methods, while retaining minimal design choices. Our framework minimizes the cross-entropy loss over the cosine distance between multiple image ROI features with a text embedding (representing the give sentence/phrase). We use pre-trained networks for obtaining the initial embeddings and learn a transformation layer on top of the text embedding. We perform experiments on the Talk2Car dataset and achieve 68.7% AP50 accuracy, improving upon the previous state of the art by 8.6%. Our investigation suggests reconsideration towards more approaches employing sophisticated attention mechanisms or multi-stage reasoning or complex metric learning loss functions by showing promise in simpler alternatives.
△ Less
Submitted 13 September, 2020;
originally announced September 2020.
-
Multipliers for Lipschitz p-Bessel sequences in metric spaces
Authors:
K. Mahesh Krishna,
P. Sam Johnson
Abstract:
The notion of multipliers in Hilbert space was introduced by Schatten in 1960 using orthonormal sequences and was generalized by Balazs in 2007 using Bessel sequences. This was extended to Banach spaces by Rahimi and Balazs in 2010 using p-Bessel sequences. In this paper, we further extend this by considering Lipschitz functions. On the way we define frames for metric spaces which extends the noti…
▽ More
The notion of multipliers in Hilbert space was introduced by Schatten in 1960 using orthonormal sequences and was generalized by Balazs in 2007 using Bessel sequences. This was extended to Banach spaces by Rahimi and Balazs in 2010 using p-Bessel sequences. In this paper, we further extend this by considering Lipschitz functions. On the way we define frames for metric spaces which extends the notion of frames and Bessel sequences for Banach spaces. We show that when the symbol sequence converges to zero, the multiplier is a Lipschitz compact operator. We study how the variation of parameters in the multiplier effects the properties of multiplier.
△ Less
Submitted 7 July, 2020;
originally announced July 2020.
-
Analyticity of density of states for the Cauchy distribution
Authors:
Werner Kirsch,
M. Krishna
Abstract:
We compute the density of states for the Cauchy distribution for a large class of random operators and show it is analytic in a strip about the real axis.
We compute the density of states for the Cauchy distribution for a large class of random operators and show it is analytic in a strip about the real axis.
△ Less
Submitted 29 June, 2020;
originally announced June 2020.
-
Quantum Lattice Wave Guides with Randomness -- Localisation and Delocalisation
Authors:
Werner Kirsch,
M. Krishna
Abstract:
In this paper we consider Schrödinger operators on $M \times \mathbb{Z}^{d_2}$, with $M=\{M_{1}, \ldots, M_{2}\}^{d_1}$ (`quantum wave guides') with a `$Γ$-trimmed' random potential, namely a potential which vanishes outside a subset $Γ$ which is periodic with respect to a sub lattice. We prove that (under appropriate assumptions) for strong disorder these operators have \emph{pure point spectrum…
▽ More
In this paper we consider Schrödinger operators on $M \times \mathbb{Z}^{d_2}$, with $M=\{M_{1}, \ldots, M_{2}\}^{d_1}$ (`quantum wave guides') with a `$Γ$-trimmed' random potential, namely a potential which vanishes outside a subset $Γ$ which is periodic with respect to a sub lattice. We prove that (under appropriate assumptions) for strong disorder these operators have \emph{pure point spectrum } outside the set $Σ_{0}=σ(H_{0,Γ^{c}})$ where $H_{0,Γ^{c}} $ is the free (discrete) Laplacian on the complement $Γ^{c} $ of $Γ$. We also prove that the operators have some \emph{absolutely continuous spectrum} in an energy region $\mathcal{E}\subsetΣ_{0}$. Consequently, there is a mobility edge for such models. We also consider the case $-M_{1}=M_{2}=\infty$, i.~e.~ $Γ$-trimmed operators on $\mathbb{Z}^{d}=\mathbb{Z}^{d_1}\times\mathbb{Z}^{d_2}$. Again, we prove localisation outside $Σ_{0} $ by showing exponential decay of the Green function $G_{E+iη}(x,y) $ uniformly in $η>0 $. For \emph{all} energies $E\in\mathcal{E}$ we prove that the Green's function $G_{E+iη} $ is \emph{not} (uniformly) in $\ell^{1}$ as $η$ approaches $0$. This implies that neither the fractional moment method nor multi scale analysis \emph{can} be applied here.
△ Less
Submitted 24 June, 2020;
originally announced June 2020.
-
Student Mixture Model Based Visual Servoing
Authors:
Mithun. P,
Shaunak A. Mehta,
Suril V. Shah,
Gaurav Bhatnagar,
K. Madhava Krishna
Abstract:
Classical Image-Based Visual Servoing (IBVS) makes use of geometric image features like point, straight line and image moments to control a robotic system. Robust extraction and real-time tracking of these features are crucial to the performance of the IBVS. Moreover, such features can be unsuitable for real world applications where it might not be easy to distinguish a target from the rest of the…
▽ More
Classical Image-Based Visual Servoing (IBVS) makes use of geometric image features like point, straight line and image moments to control a robotic system. Robust extraction and real-time tracking of these features are crucial to the performance of the IBVS. Moreover, such features can be unsuitable for real world applications where it might not be easy to distinguish a target from the rest of the environment. Alternatively, an approach based on complete photometric data can avoid the requirement of feature extraction, tracking and object detection. In this work, we propose one such probabilistic model based approach which uses entire photometric data for the purpose of visual servoing. A novel image modelling method has been proposed using Student Mixture Model (SMM), which is based on Multivariate Student's t-Distribution. Consequently, a vision-based control law is formulated as a least squares minimisation problem. Efficacy of the proposed framework is demonstrated for 2D and 3D positioning tasks showing favourable error convergence and acceptable camera trajectories. Numerical experiments are also carried out to show robustness to distinct image scenes and partial occlusion.
△ Less
Submitted 19 June, 2020;
originally announced June 2020.
-
Investigation of energetics of 1:1 stoichiometric Al/PVP-fuel and nc-CeO2-oxidizer nanocomposite material
Authors:
S. K. Padhi,
M. Ghanashyam Krishna
Abstract:
The investigations of the nanostructured-Al (nano-Al) based thermo-oxidative reaction attributes are detailed in this chapter-5. Two products are selected for the thermo-oxidative reaction studies. They are (1) Nano-Al embedded in the PVP matrix (will be termed as fuel) and (2) its physically mixed 1:1 stoichiometric nanocomposite processed with the ultrafine nc-ceria oxidizer (also will be termed…
▽ More
The investigations of the nanostructured-Al (nano-Al) based thermo-oxidative reaction attributes are detailed in this chapter-5. Two products are selected for the thermo-oxidative reaction studies. They are (1) Nano-Al embedded in the PVP matrix (will be termed as fuel) and (2) its physically mixed 1:1 stoichiometric nanocomposite processed with the ultrafine nc-ceria oxidizer (also will be termed as nanoenergetic material (NEM)), respectively. The graphical abstract presented below illustrates an overview of the thermo-oxidative reaction of fuel tracked employing thermogravimetric analysis (TGA) investigation. Similar TGA experimentation of the designed NEMs is carried out to gather scientific information validating, whether or not a desired enhanced attribute is achieved. Also, in coincidence with the TGA oxidation event, a synchronous exothermic energy release event in differential scanning calorimetry (DSC) trace is observed. The above mentioned two products and their thermo-oxidative reaction behavior employing TGA/DTA and TGA/DSC thermal traces are compared and interpreted based on the data available in the literature.
△ Less
Submitted 10 June, 2020;
originally announced June 2020.
-
Viability of Ultrasonic Sonochemical processing for nanostructures: Case study of Aluminum-crystal growth and Poly (vinylpyrrolidone)-graphitization
Authors:
S. K. Padhi,
M. Ghanashyam Krishna
Abstract:
The viability of ultrasonic sonochemistry is investigated in the context of delivering air-stable metallic Al rich-PVP composite. The parameters investigated are; sono-(1) process intensification, (2) crystallization, (3) agglomeration, and (4) fragmentation, respectively. The conventional solvent of n-hexadecane is employed as the sonotrode generated pressure transmitting medium to carry out the…
▽ More
The viability of ultrasonic sonochemistry is investigated in the context of delivering air-stable metallic Al rich-PVP composite. The parameters investigated are; sono-(1) process intensification, (2) crystallization, (3) agglomeration, and (4) fragmentation, respectively. The conventional solvent of n-hexadecane is employed as the sonotrode generated pressure transmitting medium to carry out the above experiments. Two precursors, (1) Poly (vinylpyrrolidone) (PVP) and (2) Aluminum chloride (AlCl3) are chosen to evaluate and demonstrate the viability of the ultrasonic induced processing. Temperature controlled investigations at RT and higher temperature help in achieving; (a) PVP-graphitization, and (b) Al-crystal growth phenomenon, respectively. The current experiments aid in helping to isolate and identify actual mechanistic happenings. The investigation, thus, has a fabrication protocol of shortened processing-duration, native amorphous oxide-free, metal-rich air-stable product that leads to 10 g of composite product for fuel applications.
△ Less
Submitted 10 June, 2020;
originally announced June 2020.
-
Understanding Dynamic Scenes using Graph Convolution Networks
Authors:
Sravan Mylavarapu,
Mahtab Sandhu,
Priyesh Vijayan,
K Madhava Krishna,
Balaraman Ravindran,
Anoop Namboodiri
Abstract:
We present a novel Multi-Relational Graph Convolutional Network (MRGCN) based framework to model on-road vehicle behaviors from a sequence of temporally ordered frames as grabbed by a moving monocular camera. The input to MRGCN is a multi-relational graph where the graph's nodes represent the active and passive agents/objects in the scene, and the bidirectional edges that connect every pair of nod…
▽ More
We present a novel Multi-Relational Graph Convolutional Network (MRGCN) based framework to model on-road vehicle behaviors from a sequence of temporally ordered frames as grabbed by a moving monocular camera. The input to MRGCN is a multi-relational graph where the graph's nodes represent the active and passive agents/objects in the scene, and the bidirectional edges that connect every pair of nodes are encodings of their Spatio-temporal relations. We show that this proposed explicit encoding and usage of an intermediate spatio-temporal interaction graph to be well suited for our tasks over learning end-end directly on a set of temporally ordered spatial relations. We also propose an attention mechanism for MRGCNs that conditioned on the scene dynamically scores the importance of information from different interaction types. The proposed framework achieves significant performance gain over prior methods on vehicle-behavior classification tasks on four datasets. We also show a seamless transfer of learning to multiple datasets without resorting to fine-tuning. Such behavior prediction methods find immediate relevance in a variety of navigation tasks such as behavior planning, state estimation, and applications relating to the detection of traffic violations over videos.
△ Less
Submitted 14 August, 2020; v1 submitted 9 May, 2020;
originally announced May 2020.
-
SROM: Simple Real-time Odometry and Mapping using LiDAR data for Autonomous Vehicles
Authors:
Nivedita Rufus,
Unni Krishnan R. Nair,
A. V. S. Sai Bhargav Kumar,
Vashist Madiraju,
K. Madhava Krishna
Abstract:
In this paper, we present SROM, a novel real-time Simultaneous Localization and Mapping (SLAM) system for autonomous vehicles. The keynote of the paper showcases SROM's ability to maintain localization at low sampling rates or at high linear or angular velocities where most popular LiDAR based localization approaches get degraded fast. We also demonstrate SROM to be computationally efficient and c…
▽ More
In this paper, we present SROM, a novel real-time Simultaneous Localization and Mapping (SLAM) system for autonomous vehicles. The keynote of the paper showcases SROM's ability to maintain localization at low sampling rates or at high linear or angular velocities where most popular LiDAR based localization approaches get degraded fast. We also demonstrate SROM to be computationally efficient and capable of handling high-speed maneuvers. It also achieves low drifts without the need for any other sensors like IMU and/or GPS. Our method has a two-layer structure wherein first, an approximate estimate of the rotation angle and translation parameters are calculated using a Phase Only Correlation (POC) method. Next, we use this estimate as an initialization for a point-to-plane ICP algorithm to obtain fine matching and registration. Another key feature of the proposed algorithm is the removal of dynamic objects before matching the scans. This improves the performance of our system as the dynamic objects can corrupt the matching scheme and derail localization. Our SLAM system can build reliable maps at the same time generating high-quality odometry. We exhaustively evaluated the proposed method in many challenging highways/country/urban sequences from the KITTI dataset and the results demonstrate better accuracy in comparisons to other state-of-the-art methods with reduced computational expense aiding in real-time realizations. We have also integrated our SROM system with our in-house autonomous vehicle and compared it with the state-of-the-art methods like LOAM and LeGO-LOAM.
△ Less
Submitted 7 May, 2020; v1 submitted 5 May, 2020;
originally announced May 2020.
-
Reconstruct, Rasterize and Backprop: Dense shape and pose estimation from a single image
Authors:
Aniket Pokale,
Aditya Aggarwal,
K. Madhava Krishna
Abstract:
This paper presents a new system to obtain dense object reconstructions along with 6-DoF poses from a single image. Geared towards high fidelity reconstruction, several recent approaches leverage implicit surface representations and deep neural networks to estimate a 3D mesh of an object, given a single image. However, all such approaches recover only the shape of an object; the reconstruction is…
▽ More
This paper presents a new system to obtain dense object reconstructions along with 6-DoF poses from a single image. Geared towards high fidelity reconstruction, several recent approaches leverage implicit surface representations and deep neural networks to estimate a 3D mesh of an object, given a single image. However, all such approaches recover only the shape of an object; the reconstruction is often in a canonical frame, unsuitable for downstream robotics tasks. To this end, we leverage recent advances in differentiable rendering (in particular, rasterization) to close the loop with 3D reconstruction in camera frame. We demonstrate that our approach---dubbed reconstruct, rasterize and backprop (RRB) achieves significantly lower pose estimation errors compared to prior art, and is able to recover dense object shapes and poses from imagery. We further extend our results to an (offline) setup, where we demonstrate a dense monocular object-centric egomotion estimation system.
△ Less
Submitted 25 April, 2020;
originally announced April 2020.
-
LiDAR guided Small obstacle Segmentation
Authors:
Aasheesh Singh,
Aditya Kamireddypalli,
Vineet Gandhi,
K Madhava Krishna
Abstract:
Detecting small obstacles on the road is critical for autonomous driving. In this paper, we present a method to reliably detect such obstacles through a multi-modal framework of sparse LiDAR(VLP-16) and Monocular vision. LiDAR is employed to provide additional context in the form of confidence maps to monocular segmentation networks. We show significant performance gains when the context is fed as…
▽ More
Detecting small obstacles on the road is critical for autonomous driving. In this paper, we present a method to reliably detect such obstacles through a multi-modal framework of sparse LiDAR(VLP-16) and Monocular vision. LiDAR is employed to provide additional context in the form of confidence maps to monocular segmentation networks. We show significant performance gains when the context is fed as an additional input to monocular semantic segmentation frameworks. We further present a new semantic segmentation dataset to the community, comprising of over 3000 image frames with corresponding LiDAR observations. The images come with pixel-wise annotations of three classes off-road, road, and small obstacle. We stress that precise calibration between LiDAR and camera is crucial for this task and thus propose a novel Hausdorff distance based calibration refinement method over extrinsic parameters. As a first benchmark over this dataset, we report our results with 73% instance detection up to a distance of 50 meters on challenging scenarios. Qualitatively by showcasing accurate segmentation of obstacles less than 15 cms at 50m depth and quantitatively through favourable comparisons vis a vis prior art, we vindicate the method's efficacy. Our project-page and Dataset is hosted at https://small-obstacle-dataset.github.io/
△ Less
Submitted 12 March, 2020;
originally announced March 2020.
-
DFVS: Deep Flow Guided Scene Agnostic Image Based Visual Servoing
Authors:
Y V S Harish,
Harit Pandya,
Ayush Gaud,
Shreya Terupally,
Sai Shankar,
K. Madhava Krishna
Abstract:
Existing deep learning based visual servoing approaches regress the relative camera pose between a pair of images. Therefore, they require a huge amount of training data and sometimes fine-tuning for adaptation to a novel scene. Furthermore, current approaches do not consider underlying geometry of the scene and rely on direct estimation of camera pose. Thus, inaccuracies in prediction of the came…
▽ More
Existing deep learning based visual servoing approaches regress the relative camera pose between a pair of images. Therefore, they require a huge amount of training data and sometimes fine-tuning for adaptation to a novel scene. Furthermore, current approaches do not consider underlying geometry of the scene and rely on direct estimation of camera pose. Thus, inaccuracies in prediction of the camera pose, especially for distant goals, lead to a degradation in the servoing performance. In this paper, we propose a two-fold solution: (i) We consider optical flow as our visual features, which are predicted using a deep neural network. (ii) These flow features are then systematically integrated with depth estimates provided by another neural network using interaction matrix. We further present an extensive benchmark in a photo-realistic 3D simulation across diverse scenes to study the convergence and generalisation of visual servoing approaches. We show convergence for over 3m and 40 degrees while maintaining precise positioning of under 2cm and 1 degree on our challenging benchmark where the existing approaches that are unable to converge for majority of scenarios for over 1.5m and 20 degrees. Furthermore, we also evaluate our approach for a real scenario on an aerial robot. Our approach generalizes to novel scenarios producing precise and robust servoing performance for 6 degrees of freedom positioning tasks with even large camera transformations without any retraining or fine-tuning.
△ Less
Submitted 8 March, 2020;
originally announced March 2020.
-
MonoLayout: Amodal scene layout from a single image
Authors:
Kaustubh Mani,
Swapnil Daga,
Shubhika Garg,
N. Sai Shankar,
Krishna Murthy Jatavallabhula,
K. Madhava Krishna
Abstract:
In this paper, we address the novel, highly challenging problem of estimating the layout of a complex urban driving scenario. Given a single color image captured from a driving platform, we aim to predict the bird's-eye view layout of the road and other traffic participants. The estimated layout should reason beyond what is visible in the image, and compensate for the loss of 3D information due to…
▽ More
In this paper, we address the novel, highly challenging problem of estimating the layout of a complex urban driving scenario. Given a single color image captured from a driving platform, we aim to predict the bird's-eye view layout of the road and other traffic participants. The estimated layout should reason beyond what is visible in the image, and compensate for the loss of 3D information due to projection. We dub this problem amodal scene layout estimation, which involves "hallucinating" scene layout for even parts of the world that are occluded in the image. To this end, we present MonoLayout, a deep neural network for real-time amodal scene layout estimation from a single image. We represent scene layout as a multi-channel semantic occupancy grid, and leverage adversarial feature learning to hallucinate plausible completions for occluded image parts. Due to the lack of fair baseline methods, we extend several state-of-the-art approaches for road-layout estimation and vehicle occupancy estimation in bird's-eye view to the amodal setup for rigorous evaluation. By leveraging temporal sensor fusion to generate training labels, we significantly outperform current art over a number of datasets. On the KITTI and Argoverse datasets, we outperform all baselines by a significant margin. We also make all our annotations, and code publicly available. A video abstract of this paper is available https://www.youtube.com/watch?v=HcroGyo6yRQ .
△ Less
Submitted 19 February, 2020;
originally announced February 2020.
-
Omnidirectional Three Module Robot Design and Simulation
Authors:
Kartik Suryavanshi,
Rama Vadapalli,
Praharsha Budharaja,
Abhishek Sarkar,
Madhava Krishna
Abstract:
This paper introduces the Omnidirectional Tractable Three Module Robot for traversing inside complex pipe networks. The robot consists of three omnidirectional modules fixed 120° apart circumferentially which can rotate about their axis allowing holonomic motion of the robot. Holonomic motion enables the robot to overcome motion singularity when negotiating T-junctions and further allows the robot…
▽ More
This paper introduces the Omnidirectional Tractable Three Module Robot for traversing inside complex pipe networks. The robot consists of three omnidirectional modules fixed 120° apart circumferentially which can rotate about their axis allowing holonomic motion of the robot. Holonomic motion enables the robot to overcome motion singularity when negotiating T-junctions and further allows the robot to arrive in a preferred orientation while taking turns inside a pipe. The singularity region while negotiating T-junctions is analyzed to formulate the geometry of the region. The design and motion capabilities are validated by conducting simulations in MSC ADAMS on a simplified lumped-model of the robot.
△ Less
Submitted 19 February, 2020;
originally announced February 2020.