-
SCE-MAE: Selective Correspondence Enhancement with Masked Autoencoder for Self-Supervised Landmark Estimation
Authors:
Kejia Yin,
Varshanth R. Rao,
Ruowei Jiang,
Xudong Liu,
Parham Aarabi,
David B. Lindell
Abstract:
Self-supervised landmark estimation is a challenging task that demands the formation of locally distinct feature representations to identify sparse facial landmarks in the absence of annotated data. To tackle this task, existing state-of-the-art (SOTA) methods (1) extract coarse features from backbones that are trained with instance-level self-supervised learning (SSL) paradigms, which neglect the…
▽ More
Self-supervised landmark estimation is a challenging task that demands the formation of locally distinct feature representations to identify sparse facial landmarks in the absence of annotated data. To tackle this task, existing state-of-the-art (SOTA) methods (1) extract coarse features from backbones that are trained with instance-level self-supervised learning (SSL) paradigms, which neglect the dense prediction nature of the task, (2) aggregate them into memory-intensive hypercolumn formations, and (3) supervise lightweight projector networks to naively establish full local correspondences among all pairs of spatial features. In this paper, we introduce SCE-MAE, a framework that (1) leverages the MAE, a region-level SSL method that naturally better suits the landmark prediction task, (2) operates on the vanilla feature map instead of on expensive hypercolumns, and (3) employs a Correspondence Approximation and Refinement Block (CARB) that utilizes a simple density peak clustering algorithm and our proposed Locality-Constrained Repellence Loss to directly hone only select local correspondences. We demonstrate through extensive experiments that SCE-MAE is highly effective and robust, outperforming existing SOTA methods by large margins of approximately 20%-44% on the landmark matching and approximately 9%-15% on the landmark detection tasks.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
Sparse Attention Regression Network Based Soil Fertility Prediction With Ummaso
Authors:
R V Raghavendra Rao,
U Srinivasulu Reddy
Abstract:
The challenge of imbalanced soil nutrient datasets significantly hampers accurate predictions of soil fertility. To tackle this, a new method is suggested in this research, combining Uniform Manifold Approximation and Projection (UMAP) with Least Absolute Shrinkage and Selection Operator (LASSO). The main aim is to counter the impact of uneven data distribution and improve soil fertility models' p…
▽ More
The challenge of imbalanced soil nutrient datasets significantly hampers accurate predictions of soil fertility. To tackle this, a new method is suggested in this research, combining Uniform Manifold Approximation and Projection (UMAP) with Least Absolute Shrinkage and Selection Operator (LASSO). The main aim is to counter the impact of uneven data distribution and improve soil fertility models' predictive precision. The model introduced uses Sparse Attention Regression, effectively incorporating pertinent features from the imbalanced dataset. UMAP is utilized initially to reduce data complexity, unveiling hidden structures and important patterns. Following this, LASSO is applied to refine features and enhance the model's interpretability. The experimental outcomes highlight the effectiveness of the UMAP and LASSO hybrid approach. The proposed model achieves outstanding performance metrics, reaching a predictive accuracy of 98%, demonstrating its capability in accurate soil fertility predictions. Additionally, it showcases a Precision of 91.25%, indicating its adeptness in identifying fertile soil instances accurately. The Recall metric stands at 90.90%, emphasizing the model's ability to capture true positive cases effectively.
△ Less
Submitted 16 April, 2024;
originally announced April 2024.
-
Decompose the Sounds and Pixels, Recompose the Events
Authors:
Varshanth R. Rao,
Md Ibrahim Khalil,
Haoda Li,
Peng Dai,
Juwei Lu
Abstract:
In this paper, we propose a framework centering around a novel architecture called the Event Decomposition Recomposition Network (EDRNet) to tackle the Audio-Visual Event (AVE) localization problem in the supervised and weakly supervised settings. AVEs in the real world exhibit common unravelling patterns (termed as Event Progress Checkpoints (EPC)), which humans can perceive through the cooperati…
▽ More
In this paper, we propose a framework centering around a novel architecture called the Event Decomposition Recomposition Network (EDRNet) to tackle the Audio-Visual Event (AVE) localization problem in the supervised and weakly supervised settings. AVEs in the real world exhibit common unravelling patterns (termed as Event Progress Checkpoints (EPC)), which humans can perceive through the cooperation of their auditory and visual senses. Unlike earlier methods which attempt to recognize entire event sequences, the EDRNet models EPCs and inter-EPC relationships using stacked temporal convolutions. Based on the postulation that EPC representations are theoretically consistent for an event category, we introduce the State Machine Based Video Fusion, a novel augmentation technique that blends source videos using different EPC template sequences. Additionally, we design a new loss function called the Land-Shore-Sea loss to compactify continuous foreground and background representations. Lastly, to alleviate the issue of confusing events during weak supervision, we propose a prediction stabilization method called Bag to Instance Label Correction. Experiments on the AVE dataset show that our collective framework outperforms the state-of-the-art by a sizable margin.
△ Less
Submitted 21 December, 2021;
originally announced December 2021.
-
Limitations of Sums of Bounded-Read Formulas
Authors:
Purnata Ghosal,
B. V. Raghavendra Rao
Abstract:
Proving super polynomial size lower bounds for various classes of arithmetic circuits computing explicit polynomials is a very important and challenging task in algebraic complexity theory. We study representation of polynomials as sums of weaker models such as read once formulas (ROFs) and read once oblivious algebraic branching programs (ROABPs). We prove:
(1) An exponential separation between…
▽ More
Proving super polynomial size lower bounds for various classes of arithmetic circuits computing explicit polynomials is a very important and challenging task in algebraic complexity theory. We study representation of polynomials as sums of weaker models such as read once formulas (ROFs) and read once oblivious algebraic branching programs (ROABPs). We prove:
(1) An exponential separation between sum of ROFs and read-$k$ formulas for some constant $k$. (2) A sub-exponential separation between sum of ROABPs and syntactic multilinear ABPs.
Our results are based on analysis of the partial derivative matrix under different distributions. These results highlight richness of bounded read restrictions in arithmetic formulas and ABPs.
Finally, we consider a generalization of multilinear ROABPs known as strict-interval ABPs defined in [Ramya-Rao, MFCS2019]. We show that strict-interval ABPs are equivalent to ROABPs upto a polynomial size blow up. In contrast, we show that interval formulas are different from ROFs and also admit depth reduction which is not known in the case of strict-interval ABPs.
△ Less
Submitted 3 October, 2020;
originally announced October 2020.
-
Parameterised Counting in Logspace
Authors:
Anselm Haak,
Arne Meier,
Om Prakash,
B. V. Raghavendra Rao
Abstract:
In this paper, we introduce a new framework for parameterised counting in logspace, inspired by the parameterised space bounded models developed by Elberfeld, Stockhusen and Tantau (IPEC 2013, Algorithmica 2015). They defined the operators paraW and paraBeta for parameterised space complexity classes by allowing bounded nondeterminism with multiple-read and read-once access, respectively. Using th…
▽ More
In this paper, we introduce a new framework for parameterised counting in logspace, inspired by the parameterised space bounded models developed by Elberfeld, Stockhusen and Tantau (IPEC 2013, Algorithmica 2015). They defined the operators paraW and paraBeta for parameterised space complexity classes by allowing bounded nondeterminism with multiple-read and read-once access, respectively. Using these operators, they characterised the parameterised complexity of natural problems on graphs. In the spirit of the operators paraW and paraBeta by Stockhusen and Tantau, we introduce variants based on tail-nondeterminism, paraW[1] and paraBeta-Tail. Then, we consider counting versions of all four operators applied to logspace and obtain several natural complete problems for the resulting classes: counting of paths in digraphs, counting first-order models for formulas, and counting graph homomorphisms. Furthermore, we show that the complexity of a parameterised variant of the determinant function for (0,1)-matrices is #paraBeta-Tail-L-hard and can be written as the difference of two functions in #paraBetaTail-L. For example, we show that the closure of #paraBetaTail-L under parameterised logspace parsimonious reductions coincides with #paraBeta-L, that is, modulo parameterised reductions, tail-nondeterminism with read-once access is the same as read-once nondeterminism. We show that all introduced classes are closed under addition and multiplication, and those without tail-nondeterminism are closed under parameterised logspace parsimonious reductions. Finally, we underline the significance of this topic by providing a promising outlook showing several open problems and options for further directions of research.
△ Less
Submitted 15 January, 2021; v1 submitted 27 April, 2019;
originally announced April 2019.
-
Lower bounds for multilinear bounded order ABPs
Authors:
C. Ramya,
B. V. Raghavendra Rao
Abstract:
Proving super-polynomial size lower bounds for syntactic multilinear Algebraic Branching Programs(smABPs) computing an explicit polynomial is a challenging problem in Algebraic Complexity Theory. The order in which variables in $\{x_1,\ldots,x_n\}$ appear along source to sink paths in any smABP can be viewed as a permutation in $S_n$. In this article, we consider the following special classes of s…
▽ More
Proving super-polynomial size lower bounds for syntactic multilinear Algebraic Branching Programs(smABPs) computing an explicit polynomial is a challenging problem in Algebraic Complexity Theory. The order in which variables in $\{x_1,\ldots,x_n\}$ appear along source to sink paths in any smABP can be viewed as a permutation in $S_n$. In this article, we consider the following special classes of smABPs where the order of occurrence of variables along a source to sink path is restricted:
Strict circular-interval ABPs: For every subprogram the index set of variables occurring in it is contained in some circular interval of $\{1,\ldots,n\}$.
L-ordered ABPs: There is a set of L permutations of variables such that every source to sink path in the ABP reads variables in one of the L orders.
We prove exponential lower bound for the size of a strict circular-interval ABP computing an explicit n-variate multilinear polynomial in VP. For the same polynomial, we show that any sum of L-ordered ABPs of small size will require exponential ($2^{n^{Ω(1)}}$) many summands, when $L \leq 2^{n^{1/2-ε}}, ε>0$. At the heart of above lower bound arguments is a new decomposition theorem for smABPs: We show that any polynomial computable by an smABP of size S can be written as a sum of O(S) many multilinear polynomials where each summand is a product of two polynomials in at most 2n/3 variables computable by smABPs. As a corollary, we obtain a low bottom fan-in version of the depth reduction by Tavenas [MFCS 2013] in the case of smABPs. In particular, we show that a polynomial having size S smABPs can be expressed as a sum of products of multilinear polynomials on $O(\sqrt{n})$ variables, where the total number of summands is bounded by $2^{O(\sqrt{n}\log n \log S)}$. Additionally, we show that L-ordered ABPs can be transformed into L-pass smABPs with a polynomial blowup in size.
△ Less
Submitted 14 January, 2019;
originally announced January 2019.
-
Lower Bounds for Special Cases of Syntactic Multilinear ABPs
Authors:
C. Ramya,
B. V. Raghavendra Rao
Abstract:
Algebraic Branching Programs(ABPs) are standard models for computing polynomials. Syntactic multilinear ABPs (smABPs) are restrictions of ABPs where every variable is allowed to occur at most once in every path from the start to the terminal node. Proving lower bounds against syntactic multilinear ABPs remains a challenging open question in Algebraic Complexity Theory. The current best known bound…
▽ More
Algebraic Branching Programs(ABPs) are standard models for computing polynomials. Syntactic multilinear ABPs (smABPs) are restrictions of ABPs where every variable is allowed to occur at most once in every path from the start to the terminal node. Proving lower bounds against syntactic multilinear ABPs remains a challenging open question in Algebraic Complexity Theory. The current best known bound is only quadratic [Alon-Kumar-Volk, ECCC 2017]. In this article we develop a new approach upper bounding the rank of the partial derivative matrix of syntactic multlinear ABPs: Convert the ABP to a syntactic mulilinear formula with a super polynomial blow up in the size and then exploit the structural limitations of resulting formula to obtain a rank upper bound. Using this approach, we prove exponential lower bounds for special cases of smABPs and circuits - namely sum of Oblivious Read-Once ABPs, r-pass mulitlinear ABPs and sparse ROABPs. En route, we also prove super-polynomial lower bound for a special class of syntactic multilinear arithmetic circuits.
△ Less
Submitted 23 April, 2018;
originally announced April 2018.
-
Linear Projections of the Vandermonde Polynomial
Authors:
C. Ramya,
B. V. Raghavendra Rao
Abstract:
An n-variate Vandermonde polynomial is the determinant of the n x n matrix where the ith column is the vector (1, x_i, x_i^2, ...., x_i^{n-1})^T. Vandermonde polynomials play a crucial role in the theory of alternating polynomials and occur in Lagrangian polynomial interpolation as well as in the theory of error correcting codes. In this work we study structural and computational aspects of linear…
▽ More
An n-variate Vandermonde polynomial is the determinant of the n x n matrix where the ith column is the vector (1, x_i, x_i^2, ...., x_i^{n-1})^T. Vandermonde polynomials play a crucial role in the theory of alternating polynomials and occur in Lagrangian polynomial interpolation as well as in the theory of error correcting codes. In this work we study structural and computational aspects of linear projections of Vandermonde polynomials. Firstly, we consider the problem of testing if a given polynomial is linearly equivalent to the Vandermonde polynomial. We obtain a deterministic polynomial time algorithm to test if the polynomial f is linearly equivalent to the Vandermonde polynomial when f is given as product of linear factors. In the case when the polynomial f is given as a black-box our algorithm runs in randomized polynomial time. Exploring the structure of projections of Vandermonde polynomials further, we describe the group of symmetries of a Vandermonde polynomial and show that the associated Lie algebra is simple.
△ Less
Submitted 9 May, 2017;
originally announced May 2017.
-
A Novel Method of Discrete-Time Amplification using NEMS Devices
Authors:
Sivaneswaran Sankar,
Maryam Shojaei Baghini,
Valipe Ramgopal Rao
Abstract:
In this paper we propose a novel method of realizing discrete-time (D-T) signal amplification using Nano-Electro-Mechanical (NEMS) devices. The amplifier uses mechanical devices instead of traditional solid-state circuits. The proposed NEMS-based D-T amplifier provides high gain and operate on a wide dynamic range of signals, consuming only a few micro watts of power. The proposed concept is subse…
▽ More
In this paper we propose a novel method of realizing discrete-time (D-T) signal amplification using Nano-Electro-Mechanical (NEMS) devices. The amplifier uses mechanical devices instead of traditional solid-state circuits. The proposed NEMS-based D-T amplifier provides high gain and operate on a wide dynamic range of signals, consuming only a few micro watts of power. The proposed concept is subsequently verified using Verilog-A model of the NEMS device. Modifications in the proposed amplifier to suit different specifications are also presented.
△ Less
Submitted 22 May, 2018; v1 submitted 18 February, 2017;
originally announced February 2017.
-
Limitations of sum of products of Read-Once Polynomials
Authors:
C. Ramya,
B. V. Raghavendra Rao
Abstract:
We study limitations of polynomials computed by depth two circuits built over read-once polynomials (ROPs) and depth three syntactically multi-linear formulas.
We prove an exponential lower bound for the size of the $ΣΠ^{[N^{1/30}]}$ arithmetic circuits built over syntactically multi-linear $ΣΠΣ^{[N^{8/15}]}$ arithmetic circuits computing a product of variable disjoint linear forms on $N$ variab…
▽ More
We study limitations of polynomials computed by depth two circuits built over read-once polynomials (ROPs) and depth three syntactically multi-linear formulas.
We prove an exponential lower bound for the size of the $ΣΠ^{[N^{1/30}]}$ arithmetic circuits built over syntactically multi-linear $ΣΠΣ^{[N^{8/15}]}$ arithmetic circuits computing a product of variable disjoint linear forms on $N$ variables. We extend the result to the case of $ΣΠ^{[N^{1/30}]}$ arithmetic circuits built over ROPs of unbounded depth, where the number of variables with $+$ gates as a parent in an proper sub formula is bounded by $N^{1/2+1/30}$. We show that the same lower bound holds for the permanent polynomial. Finally we obtain an exponential lower bound for the sum of ROPs computing a polynomial in ${\sf VP}$ defined by Raz and Yehudayoff.
Our results demonstrate a class of formulas of unbounded depth with exponential size lower bound against the permanent and can be seen as an exponential improvement over the multilinear formula size lower bounds given by Raz for a sub-class of multi-linear and non-multi-linear formulas.
Our proof techniques are built on the one developed by Raz and later extended by Kumar et. al.\cite{KMS13} and are based on non-trivial analysis of ROPs under random partitions. Further, our results exhibit strengths and limitations of the lower bound techniques introduced by Raz\cite{Raz04a}.
△ Less
Submitted 11 December, 2015;
originally announced December 2015.
-
Parameterized Analogues of Probabilistic Computation
Authors:
Ankit Chauhan,
B. V. Raghavendra Rao
Abstract:
We study structural aspects of randomized parameterized computation. We introduce a new class ${\sf W[P]}$-${\sf PFPT}$ as a natural parameterized analogue of ${\sf PP}$. Our definition uses the machine based characterization of the parameterized complexity class ${\sf W[P]}$ obtained by Chen et.al [TCS 2005]. We translate most of the structural properties and characterizations of the class…
▽ More
We study structural aspects of randomized parameterized computation. We introduce a new class ${\sf W[P]}$-${\sf PFPT}$ as a natural parameterized analogue of ${\sf PP}$. Our definition uses the machine based characterization of the parameterized complexity class ${\sf W[P]}$ obtained by Chen et.al [TCS 2005]. We translate most of the structural properties and characterizations of the class ${\sf PP}$ to the new class ${W[P]}$-${\sf PFPT}$.
We study a parameterization of the polynomial identity testing problem based on the degree of the polynomial computed by the arithmetic circuit. We obtain a parameterized analogue of the well known Schwartz-Zippel lemma [Schwartz, JACM 80 and Zippel, EUROSAM 79].
Additionally, we introduce a parameterized variant of permanent, and prove its $\#W[1]$ completeness.
△ Less
Submitted 27 September, 2014;
originally announced September 2014.
-
New Algorithms and Hard Instances for Non-Commutative Computation
Authors:
Christian Engels,
B. V. Raghavendra Rao
Abstract:
Motivated by the recent developments on the complexity of non-com\-mu\-ta\-tive determinant and permanent [Chien et al.\ STOC 2011, Bläser ICALP 2013, Gentry CCC 2014] we attempt at obtaining a tight characterization of hard instances of non-commutative permanent.
We show that computing Cayley permanent and determinant on weight\-ed adjacency matrices of graphs of component size six is…
▽ More
Motivated by the recent developments on the complexity of non-com\-mu\-ta\-tive determinant and permanent [Chien et al.\ STOC 2011, Bläser ICALP 2013, Gentry CCC 2014] we attempt at obtaining a tight characterization of hard instances of non-commutative permanent.
We show that computing Cayley permanent and determinant on weight\-ed adjacency matrices of graphs of component size six is $\#{\sf P}$ complete on algebras that contain $2\times 2$ matrices and the permutation group $S_3$. Also, we prove a lower bound of $2^{Ω(n)}$ on the size of branching programs computing the Cayley permanent on adjacency matrices of graphs with component size bounded by two. Further, we observe that the lower bound holds for almost all graphs of component size two.
On the positive side, we show that the Cayley permanent on graphs of component size $c$ can be computed in time $n^{c{\sf poly}(t)}$, where $t$ is a parameter depending on the labels of the vertices.
Finally, we exhibit polynomials that are equivalent to the Cayley permanent polynomial but are easy to compute over commutative domains.
△ Less
Submitted 10 August, 2015; v1 submitted 2 September, 2014;
originally announced September 2014.
-
Random Shortest Paths: Non-Euclidean Instances for Metric Optimization Problems
Authors:
Karl Bringmann,
Christian Engels,
Bodo Manthey,
B. V. Raghavendra Rao
Abstract:
Probabilistic analysis for metric optimization problems has mostly been conducted on random Euclidean instances, but little is known about metric instances drawn from distributions other than the Euclidean. This motivates our study of random metric instances for optimization problems obtained as follows: Every edge of a complete graph gets a weight drawn independently at random. The distance betwe…
▽ More
Probabilistic analysis for metric optimization problems has mostly been conducted on random Euclidean instances, but little is known about metric instances drawn from distributions other than the Euclidean. This motivates our study of random metric instances for optimization problems obtained as follows: Every edge of a complete graph gets a weight drawn independently at random. The distance between two nodes is then the length of a shortest path (with respect to the weights drawn) that connects these nodes.
We prove structural properties of the random shortest path metrics generated in this way. Our main structural contribution is the construction of a good clustering. Then we apply these findings to analyze the approximation ratios of heuristics for matching, the traveling salesman problem (TSP), and the k-median problem, as well as the running-time of the 2-opt heuristic for the TSP. The bounds that we obtain are considerably better than the respective worst-case bounds. This suggests that random shortest path metrics are easy instances, similar to random Euclidean instances, albeit for completely different structural reasons.
△ Less
Submitted 23 May, 2014; v1 submitted 13 June, 2013;
originally announced June 2013.
-
Design of Run time Architectures for Real time UML Models an Actor Centric Approach
Authors:
P. V. R. R. Bhogendra Rao,
V. Kamakshi Prasad
Abstract:
Although a lot of research has taken place in Object Oriented Design of software for Real Time systems and mapping of design models to implementation models, these methodologies are applicable to systems which are less complex and small in source code size. However, in practice, the size of the software for real time applications is growing. The run time architecture of real time applications is…
▽ More
Although a lot of research has taken place in Object Oriented Design of software for Real Time systems and mapping of design models to implementation models, these methodologies are applicable to systems which are less complex and small in source code size. However, in practice, the size of the software for real time applications is growing. The run time architecture of real time applications is becoming increasingly complex. In this paper, we present a generic approach for mapping the design models to run time architectures resulting in combination of processes and threads. This method is applied in development of a communication subsystem of C4I complex and shall be presented as a case study.
△ Less
Submitted 29 January, 2010;
originally announced January 2010.
-
Faster Algorithms for Finding and Counting Subgraphs
Authors:
Fedor V. Fomin,
Daniel Lokshtanov,
Venkatesh Raman,
B. V. Raghavendra Rao,
Saket Saurabh
Abstract:
In this paper we study a natural generalization of both {\sc $k$-Path} and {\sc $k$-Tree} problems, namely, the {\sc Subgraph Isomorphism} problem.
In the {\sc Subgraph Isomorphism} problem we are given two graphs $F$ and $G$ on $k$ and $n$ vertices respectively as an input, and the question is whether there exists a subgraph of $G$ isomorphic to $F$. We show that if the treewidth of $F$ is at…
▽ More
In this paper we study a natural generalization of both {\sc $k$-Path} and {\sc $k$-Tree} problems, namely, the {\sc Subgraph Isomorphism} problem.
In the {\sc Subgraph Isomorphism} problem we are given two graphs $F$ and $G$ on $k$ and $n$ vertices respectively as an input, and the question is whether there exists a subgraph of $G$ isomorphic to $F$. We show that if the treewidth of $F$ is at most $t$, then there is a randomized algorithm for the {\sc Subgraph Isomorphism} problem running in time $\cO^*(2^k n^{2t})$. To do so, we associate a new multivariate {Homomorphism polynomial} of degree at most $k$ with the {\sc Subgraph Isomorphism} problem and construct an arithmetic circuit of size at most $n^{\cO(t)}$ for this polynomial. Using this polynomial, we also give a deterministic algorithm to count the number of homomorphisms from $F$ to $G$ that takes $n^{\cO(t)}$ time and uses polynomial space. For the counting version of the {\sc Subgraph Isomorphism} problem, where the objective is to count the number of distinct subgraphs of $G$ that are isomorphic to $F$, we give a deterministic algorithm running in time and space $\cO^*({n \choose k/2}n^{2p})$ or ${n\choose k/2}n^{\cO(t \log k)}$. We also give an algorithm running in time $\cO^{*}(2^{k}{n \choose k/2}n^{5p})$ and taking space polynomial in $n$. Here $p$ and $t$ denote the pathwidth and the treewidth of $F$, respectively. Thus our work not only improves on known results on {\sc Subgraph Isomorphism} but it also extends and generalize most of the known results on {\sc $k$-Path} and {\sc $k$-Tree}.
△ Less
Submitted 11 December, 2009;
originally announced December 2009.