-
FastVPINNs: Tensor-Driven Acceleration of VPINNs for Complex Geometries
Authors:
Thivin Anandh,
Divij Ghose,
Himanshu Jain,
Sashikumaar Ganesan
Abstract:
Variational Physics-Informed Neural Networks (VPINNs) utilize a variational loss function to solve partial differential equations, mirroring Finite Element Analysis techniques. Traditional hp-VPINNs, while effective for high-frequency problems, are computationally intensive and scale poorly with increasing element counts, limiting their use in complex geometries. This work introduces FastVPINNs, a…
▽ More
Variational Physics-Informed Neural Networks (VPINNs) utilize a variational loss function to solve partial differential equations, mirroring Finite Element Analysis techniques. Traditional hp-VPINNs, while effective for high-frequency problems, are computationally intensive and scale poorly with increasing element counts, limiting their use in complex geometries. This work introduces FastVPINNs, a tensor-based advancement that significantly reduces computational overhead and improves scalability. Using optimized tensor operations, FastVPINNs achieve a 100-fold reduction in the median training time per epoch compared to traditional hp-VPINNs. With proper choice of hyperparameters, FastVPINNs surpass conventional PINNs in both speed and accuracy, especially in problems with high-frequency solutions. Demonstrated effectiveness in solving inverse problems on complex domains underscores FastVPINNs' potential for widespread application in scientific and engineering challenges, opening new avenues for practical implementations in scientific machine learning.
△ Less
Submitted 18 April, 2024;
originally announced April 2024.
-
Comparative Analysis of Transformers for Modeling Tabular Data: A Casestudy using Industry Scale Dataset
Authors:
Usneek Singh,
Piyush Arora,
Shamika Ganesan,
Mohit Kumar,
Siddhant Kulkarni,
Salil R. Joshi
Abstract:
We perform a comparative analysis of transformer-based models designed for modeling tabular data, specifically on an industry-scale dataset. While earlier studies demonstrated promising outcomes on smaller public or synthetic datasets, the effectiveness did not extend to larger industry-scale datasets. The challenges identified include handling high-dimensional data, the necessity for efficient pr…
▽ More
We perform a comparative analysis of transformer-based models designed for modeling tabular data, specifically on an industry-scale dataset. While earlier studies demonstrated promising outcomes on smaller public or synthetic datasets, the effectiveness did not extend to larger industry-scale datasets. The challenges identified include handling high-dimensional data, the necessity for efficient pre-processing of categorical and numerical features, and addressing substantial computational requirements.
To overcome the identified challenges, the study conducts an extensive examination of various transformer-based models using both synthetic datasets and the default prediction Kaggle dataset (2022) from American Express. The paper presents crucial insights into optimal data pre-processing, compares pre-training and direct supervised learning methods, discusses strategies for managing categorical and numerical features, and highlights trade-offs between computational resources and performance. Focusing on temporal financial data modeling, the research aims to facilitate the systematic development and deployment of transformer-based models in real-world scenarios, emphasizing scalability.
△ Less
Submitted 24 November, 2023;
originally announced November 2023.
-
SParSH-AMG: A library for hybrid CPU-GPU algebraic multigrid and preconditioned iterative methods
Authors:
Sashikumaar Ganesan,
Manan Shah
Abstract:
Hybrid CPU-GPU algorithms for Algebraic Multigrid methods (AMG) to efficiently utilize both CPU and GPU resources are presented. In particular, hybrid AMG framework focusing on minimal utilization of GPU memory with performance on par with GPU-only implementations is developed. The hybrid AMG framework can be tuned to operate at a significantly lower GPU-memory, consequently, enables to solve larg…
▽ More
Hybrid CPU-GPU algorithms for Algebraic Multigrid methods (AMG) to efficiently utilize both CPU and GPU resources are presented. In particular, hybrid AMG framework focusing on minimal utilization of GPU memory with performance on par with GPU-only implementations is developed. The hybrid AMG framework can be tuned to operate at a significantly lower GPU-memory, consequently, enables to solve large algebraic systems. Combining the hybrid AMG framework as a preconditioner with Krylov Subspace solvers like Conjugate Gradient, BiCG methods provides a solver stack to solve a large class of problems. The performance of the proposed hybrid AMG framework is analysed for an array of matrices with different properties and size. Further, the performance of CPU-GPU algorithms are compared with the GPU-only implementations to illustrate the significantly lower memory requirements.
△ Less
Submitted 30 June, 2020;
originally announced July 2020.
-
Self-Learning AI Framework for Skin Lesion Image Segmentation and Classification
Authors:
Anandhanarayanan Kamalakannan,
Shiva Shankar Ganesan,
Govindaraj Rajamanickam
Abstract:
Image segmentation and classification are the two main fundamental steps in pattern recognition. To perform medical image segmentation or classification with deep learning models, it requires training on large image dataset with annotation. The dermoscopy images (ISIC archive) considered for this work does not have ground truth information for lesion segmentation. Performing manual labelling on th…
▽ More
Image segmentation and classification are the two main fundamental steps in pattern recognition. To perform medical image segmentation or classification with deep learning models, it requires training on large image dataset with annotation. The dermoscopy images (ISIC archive) considered for this work does not have ground truth information for lesion segmentation. Performing manual labelling on this dataset is time-consuming. To overcome this issue, self-learning annotation scheme was proposed in the two-stage deep learning algorithm. The two-stage deep learning algorithm consists of U-Net segmentation model with the annotation scheme and CNN classifier model. The annotation scheme uses a K-means clustering algorithm along with merging conditions to achieve initial labelling information for training the U-Net model. The classifier models namely ResNet-50 and LeNet-5 were trained and tested on the image dataset without segmentation for comparison and with the U-Net segmentation for implementing the proposed self-learning Artificial Intelligence (AI) framework. The classification results of the proposed AI framework achieved training accuracy of 93.8% and testing accuracy of 82.42% when compared with the two classifier models directly trained on the input images.
△ Less
Submitted 4 January, 2020;
originally announced January 2020.
-
Design of a 5G Ready and Reliable Architecture for the Smart Factory of the Future
Authors:
Mathias Strufe,
Michael Gundall,
Hans D. Schotten,
Christian Markwart,
Rakash S. Ganesan,
Markus Aleksy
Abstract:
The increasing demands for highly individual products as well as for flexible production lines represent new challenges. To address these demands, future plants must be highly flexible and dynamically reconfigurable. Current systems are usually based on wired technologies for the connection of sensors, actuators, and controlling or monitoring devices that allow only very limited dynamics. New appl…
▽ More
The increasing demands for highly individual products as well as for flexible production lines represent new challenges. To address these demands, future plants must be highly flexible and dynamically reconfigurable. Current systems are usually based on wired technologies for the connection of sensors, actuators, and controlling or monitoring devices that allow only very limited dynamics. New applications, such as the use of robots, drones, or reconfigurable production lines, require the exploitation of wireless communication technologies. However, current technologies are not able to meet the high requirements in terms of latency, robustness, resilience and data rate. The introduction of the 5th generation (5G) cellular communication system will meet these requirements for the first time. Besides the use of radio-based solutions in new plants - so-called greenfield scenarios - deploying 5G also represents an efficient migration of existing plants - so-called brownfield scenarios - to Industry 4.0. In order to ensure that the challenging requirements are indeed meet in practical deployments of the new 5G technology, a tailor-made architecture is being developed within the Tactile Internet 4.0 (TACNET 4.0) project. As a basis for the design of the architecture, representative Industry 4.0 application scenarios, which are also be considered by the 3rd Generation Partnership Project (3GPP), were analyzed and compliance with the latest developments in the relevant standardization is also our target. The paper gives an overview of the considered use cases as well as the relevant reference architectures and the design process of the TACNET 4.0 architecture.
△ Less
Submitted 13 May, 2019;
originally announced June 2019.
-
Maturation Trajectories of Cortical Resting-State Networks Depend on the Mediating Frequency Band
Authors:
Sheraz Khan,
Javeria Hashmi,
Fahimeh Mamashli,
Konstantinos Michmizos,
Manfred Kitzbichler,
Hari Bharadwaj,
Yousra Bekhti,
Santosh Ganesan,
Keri A Garel,
Susan Whitfield-Gabrieli,
Randy Gollub,
Jian Kong,
Lucia M Vaina,
Kunjan Rana,
Steven Stufflebeam,
Matti Hamalainen,
Tal Kenet
Abstract:
The functional significance of resting state networks and their abnormal manifestations in psychiatric disorders are firmly established, as is the importance of the cortical rhythms in mediating these networks. Resting state networks are known to undergo substantial reorganization from childhood to adulthood, but whether distinct cortical rhythms, which are generated by separable neural mechanisms…
▽ More
The functional significance of resting state networks and their abnormal manifestations in psychiatric disorders are firmly established, as is the importance of the cortical rhythms in mediating these networks. Resting state networks are known to undergo substantial reorganization from childhood to adulthood, but whether distinct cortical rhythms, which are generated by separable neural mechanisms and are often manifested abnormally in psychiatric conditions, mediate maturation differentially, remains unknown. Using magnetoencephalography (MEG) to map frequency band specific maturation of resting state networks from age 7 to 29 in 162 participants (31 independent), we found significant changes with age in networks mediated by the beta (13-30Hz) and gamma (31-80Hz) bands. More specifically, gamma band mediated networks followed an expected asymptotic trajectory, but beta band mediated networks followed a linear trajectory. Network integration increased with age in gamma band mediated networks, while local segregation increased with age in beta band mediated networks. Spatially, the hubs that changed in importance with age in the beta band mediated networks had relatively little overlap with those that showed the greatest changes in the gamma band mediated networks. These findings are relevant for our understanding of the neural mechanisms of cortical maturation, in both typical and atypical development.
△ Less
Submitted 12 February, 2018;
originally announced March 2018.
-
Quantized Precoding for Multi-Antenna Downlink Channels with MAGIQ
Authors:
Andrei Nedelcu,
Fabian Steiner,
Markus Staudacher,
Gerhard Kramer,
Wolfgang Zirwas,
Rakash Sivasiva Ganesan,
Paolo Baracca,
Stefan Wesemann
Abstract:
A multi-antenna, greedy, iterative, and quantized (MAGIQ) precoding algorithm is proposed for downlink channels. MAGIQ allows a straightforward integration with orthogonal frequency-division multiplexing (OFDM). MAGIQ is compared to three existing algorithms in terms of information rates and complexity: quantized linear precoding (QLP), SQUID, and an ADMM-based algorithm. The information rate is m…
▽ More
A multi-antenna, greedy, iterative, and quantized (MAGIQ) precoding algorithm is proposed for downlink channels. MAGIQ allows a straightforward integration with orthogonal frequency-division multiplexing (OFDM). MAGIQ is compared to three existing algorithms in terms of information rates and complexity: quantized linear precoding (QLP), SQUID, and an ADMM-based algorithm. The information rate is measured by using a lower bound for finite modulation sets, and the complexity is measured by the number of multiplications and comparisons. MAGIQ and ADMM achieve similar information rates with similar complexity for Rayleigh flat-fading channels and one-bit quantization per real dimension, and they outperform QLP and SQUID for higher order modulation.
△ Less
Submitted 2 March, 2018; v1 submitted 23 December, 2017;
originally announced December 2017.
-
ParMooN - a modernized program package based on mapped finite elements
Authors:
Ulrich Wilbrandt,
Clemens Bartsch,
Naveed Ahmed,
Najib Alia,
Felix Anker,
Laura Blank,
Alfonso Caiazzo,
Sashikumaar Ganesan,
Swetlana Giere,
Gunar Matthies,
Raviteja Meesala,
Abdus Shamim,
Jagannath Venkatesan,
Volker John
Abstract:
{\sc ParMooN} is a program package for the numerical solution of elliptic and parabolic partial differential equations. It inherits the distinct features of its predecessor {\sc MooNMD} \cite{JM04}: strict decoupling of geometry and finite element spaces, implementation of mapped finite elements as their definition can be found in textbooks, and a geometric multigrid preconditioner with the option…
▽ More
{\sc ParMooN} is a program package for the numerical solution of elliptic and parabolic partial differential equations. It inherits the distinct features of its predecessor {\sc MooNMD} \cite{JM04}: strict decoupling of geometry and finite element spaces, implementation of mapped finite elements as their definition can be found in textbooks, and a geometric multigrid preconditioner with the option to use different finite element spaces on different levels of the multigrid hierarchy. After having presented some thoughts about in-house research codes, this paper focuses on aspects of the parallelization for a distributed memory environment, which is the main novelty of {\sc ParMooN}. Numerical studies, performed on compute servers, assess the efficiency of the parallelized geometric multigrid preconditioner in comparison with some parallel solvers that are available in the library {\sc PETSc}. The results of these studies give a first indication whether the cumbersome implementation of the parallelized geometric multigrid method was worthwhile or not.
△ Less
Submitted 31 May, 2017; v1 submitted 24 May, 2017;
originally announced May 2017.
-
Constructing Receiver Signal Points using Constrained Massive MIMO Arrays
Authors:
Markus Staudacher,
Gerhard Kramer,
Wolfgang Zirwas,
Berthold Panzner,
Rakash Sivasiva Ganesan
Abstract:
A low cost solution for constructing receiver signal points is investigated that combines a large number of constrained radio frequency (RF) frontends with a limited number of full RF chains. The constrained RF front ends have low cost and are limited to on/off switching of antenna elements and a small number of phases. Severe degradations are typically observed for multi-user MIMO for these simpl…
▽ More
A low cost solution for constructing receiver signal points is investigated that combines a large number of constrained radio frequency (RF) frontends with a limited number of full RF chains. The constrained RF front ends have low cost and are limited to on/off switching of antenna elements and a small number of phases. Severe degradations are typically observed for multi-user MIMO for these simple on/off antenna arrays. A few full RF frontends are shown to compensate for the signal errors of the high number of constrained RF frontends for various scenarios. An algorithm for such a hybrid RF (HRF) system is developed that achieves performance close to that of exhaustive search with respect to the mean square error of the constructed receiver signals for Rayleigh fading and the WINNER 2 Urban Macro channel model.
△ Less
Submitted 8 February, 2017;
originally announced February 2017.
-
An object oriented parallel finite element scheme for computations of PDEs: Design and implementation
Authors:
Sashikumaar Ganesan,
Volker John,
Gunar Matthies,
Raviteja Meesala,
Shamim Abdus,
Ulrich Wilbrandt
Abstract:
Parallel finite element algorithms based on object-oriented concepts are presented. Moreover, the design and implementation of a data structure proposed are utilized in realizing a parallel geometric multigrid method. The ParFEMapper and the ParFECommunicator are the key components of the data structure in the proposed parallel scheme. These classes are constructed based on the type of finite elem…
▽ More
Parallel finite element algorithms based on object-oriented concepts are presented. Moreover, the design and implementation of a data structure proposed are utilized in realizing a parallel geometric multigrid method. The ParFEMapper and the ParFECommunicator are the key components of the data structure in the proposed parallel scheme. These classes are constructed based on the type of finite elements (continuous or nonconforming or discontinuous) used. The proposed solver is compared with the open source direct solvers, MUMPS and PasTiX. Further, the performance of the parallel multigrid solver is analyzed up to 1080 processors. The solver shows a very good speedup up to 960 processors and the problem size has to be increased in order to maintain the good speedup when the number of processors are increased further. As a result, the parallel solver is able to handle large scale problems on massively parallel supercomputers. The proposed parallel finite element algorithms and multigrid solver are implemented in our in-house package ParMooN.
△ Less
Submitted 15 September, 2016;
originally announced September 2016.
-
Maximizing the Sum Rate in Cellular Networks Using Multi-Convex Optimization
Authors:
Hussein Al-Shatri,
Xiang Li,
Rakash SivaSiva Ganesan,
Anja Klein,
Tobias Weber
Abstract:
In this paper, we propose a novel algorithm to maximize the sum rate in interference-limited scenarios where each user decodes its own message with the presence of unknown interferences and noise considering the signal-to-interference-plus-noise-ratio. It is known that the problem of adapting the transmit and receive filters of the users to maximize the sum rate with a sum transmit power constrain…
▽ More
In this paper, we propose a novel algorithm to maximize the sum rate in interference-limited scenarios where each user decodes its own message with the presence of unknown interferences and noise considering the signal-to-interference-plus-noise-ratio. It is known that the problem of adapting the transmit and receive filters of the users to maximize the sum rate with a sum transmit power constraint is non-convex. Our novel approach is to formulate the sum rate maximization problem as an equivalent multi-convex optimization problem by adding two sets of auxiliary variables. An iterative algorithm which alternatingly adjusts the system variables and the auxiliary variables is proposed to solve the multi-convex optimization problem. The proposed algorithm is applied to a downlink cellular scenario consisting of several cells each of which contains a base station serving several mobile stations. We examine the two cases, with or without several half-duplex amplify-and-forward relays assisting the transmission. A sum power constraint at the base stations and a sum power constraint at the relays are assumed. Finally, we show that the proposed multi-convex formulation of the sum rate maximization problem is applicable to many other wireless systems in which the estimated data symbols are multi-affine functions of the system variables.
△ Less
Submitted 20 March, 2015;
originally announced March 2015.
