-
Decoding BACnet Packets: A Large Language Model Approach for Packet Interpretation
Authors:
Rashi Sharma,
Hiroyuki Okada,
Tatsumi Oba,
Karthikk Subramanian,
Naoto Yanai,
Sugiri Pranata
Abstract:
The Industrial Control System (ICS) environment encompasses a wide range of intricate communication protocols, posing substantial challenges for Security Operations Center (SOC) analysts tasked with monitoring, interpreting, and addressing network activities and security incidents. Conventional monitoring tools and techniques often struggle to provide a clear understanding of the nature and intent…
▽ More
The Industrial Control System (ICS) environment encompasses a wide range of intricate communication protocols, posing substantial challenges for Security Operations Center (SOC) analysts tasked with monitoring, interpreting, and addressing network activities and security incidents. Conventional monitoring tools and techniques often struggle to provide a clear understanding of the nature and intent of ICS-specific communications. To enhance comprehension, we propose a software solution powered by a Large Language Model (LLM). This solution currently focused on BACnet protocol, processes a packet file data and extracts context by using a mapping database, and contemporary context retrieval methods for Retrieval Augmented Generation (RAG). The processed packet information, combined with the extracted context, serves as input to the LLM, which generates a concise packet file summary for the user. The software delivers a clear, coherent, and easily understandable summary of network activities, enabling SOC analysts to better assess the current state of the control system.
△ Less
Submitted 22 July, 2024;
originally announced July 2024.
-
A Super-human Vision-based Reinforcement Learning Agent for Autonomous Racing in Gran Turismo
Authors:
Miguel Vasco,
Takuma Seno,
Kenta Kawamoto,
Kaushik Subramanian,
Peter R. Wurman,
Peter Stone
Abstract:
Racing autonomous cars faster than the best human drivers has been a longstanding grand challenge for the fields of Artificial Intelligence and robotics. Recently, an end-to-end deep reinforcement learning agent met this challenge in a high-fidelity racing simulator, Gran Turismo. However, this agent relied on global features that require instrumentation external to the car. This paper introduces,…
▽ More
Racing autonomous cars faster than the best human drivers has been a longstanding grand challenge for the fields of Artificial Intelligence and robotics. Recently, an end-to-end deep reinforcement learning agent met this challenge in a high-fidelity racing simulator, Gran Turismo. However, this agent relied on global features that require instrumentation external to the car. This paper introduces, to the best of our knowledge, the first super-human car racing agent whose sensor input is purely local to the car, namely pixels from an ego-centric camera view and quantities that can be sensed from on-board the car, such as the car's velocity. By leveraging global features only at training time, the learned agent is able to outperform the best human drivers in time trial (one car on the track at a time) races using only local input features. The resulting agent is evaluated in Gran Turismo 7 on multiple tracks and cars. Detailed ablation experiments demonstrate the agent's strong reliance on visual inputs, making it the first vision-based super-human car racing agent.
△ Less
Submitted 18 June, 2024;
originally announced June 2024.
-
Using 3-D LiDAR Data for Safe Physical Human-Robot Interaction
Authors:
Sarthak Arora,
Karthik Subramanian,
Odysseus Adamides,
Ferat Sahin
Abstract:
This paper explores the use of 3D lidar in a physical Human-Robot Interaction (pHRI) scenario. To achieve the aforementioned, experiments were conducted to mimic a modern shop-floor environment. Data was collected from a pool of seventeen participants while performing pre-determined tasks in a shared workspace with the robot. To demonstrate an end-to-end case; a perception pipeline was developed t…
▽ More
This paper explores the use of 3D lidar in a physical Human-Robot Interaction (pHRI) scenario. To achieve the aforementioned, experiments were conducted to mimic a modern shop-floor environment. Data was collected from a pool of seventeen participants while performing pre-determined tasks in a shared workspace with the robot. To demonstrate an end-to-end case; a perception pipeline was developed that leverages reflectivity, signal, near-infrared, and point-cloud data from a 3-D lidar. This data is then used to perform safety based control whilst satisfying the speed and separation monitoring (SSM) criteria. In order to support the perception pipeline, a state-of-the-art object detection network was leveraged and fine-tuned by transfer learning. An analysis is provided along with results of the perception and the safety based controller. Additionally, this system is compared with the previous work.
△ Less
Submitted 2 June, 2024;
originally announced June 2024.
-
Spatial and Temporal Attention-based emotion estimation on HRI-AVC dataset
Authors:
Karthik Subramanian,
Saurav Singh,
Justin Namba,
Jamison Heard,
Christopher Kanan,
Ferat Sahin
Abstract:
Many attempts have been made at estimating discrete emotions (calmness, anxiety, boredom, surprise, anger) and continuous emotional measures commonly used in psychology, namely `valence' (The pleasantness of the emotion being displayed) and `arousal' (The intensity of the emotion being displayed). Existing methods to estimate arousal and valence rely on learning from data sets, where an expert ann…
▽ More
Many attempts have been made at estimating discrete emotions (calmness, anxiety, boredom, surprise, anger) and continuous emotional measures commonly used in psychology, namely `valence' (The pleasantness of the emotion being displayed) and `arousal' (The intensity of the emotion being displayed). Existing methods to estimate arousal and valence rely on learning from data sets, where an expert annotator labels every image frame. Access to an expert annotator is not always possible, and the annotation can also be tedious. Hence it is more practical to obtain self-reported arousal and valence values directly from the human in a real-time Human-Robot collaborative setting. Hence this paper provides an emotion data set (HRI-AVC) obtained while conducting a human-robot interaction (HRI) task. The self-reported pair of labels in this data set is associated with a set of image frames. This paper also proposes a spatial and temporal attention-based network to estimate arousal and valence from this set of image frames. The results show that an attention-based network can estimate valence and arousal on the HRI-AVC data set even when Arousal and Valence values are unavailable per frame.
△ Less
Submitted 19 October, 2023;
originally announced October 2023.
-
Doing More by Doing Less: How Structured Partial Backpropagation Improves Deep Learning Clusters
Authors:
Adarsh Kumar,
Kausik Subramanian,
Shivaram Venkataraman,
Aditya Akella
Abstract:
Many organizations employ compute clusters equipped with accelerators such as GPUs and TPUs for training deep learning models in a distributed fashion. Training is resource-intensive, consuming significant compute, memory, and network resources. Many prior works explore how to reduce training resource footprint without impacting quality, but their focus on a subset of the bottlenecks (typically on…
▽ More
Many organizations employ compute clusters equipped with accelerators such as GPUs and TPUs for training deep learning models in a distributed fashion. Training is resource-intensive, consuming significant compute, memory, and network resources. Many prior works explore how to reduce training resource footprint without impacting quality, but their focus on a subset of the bottlenecks (typically only the network) limits their ability to improve overall cluster utilization. In this work, we exploit the unique characteristics of deep learning workloads to propose Structured Partial Backpropagation(SPB), a technique that systematically controls the amount of backpropagation at individual workers in distributed training. This simultaneously reduces network bandwidth, compute utilization, and memory footprint while preserving model quality. To efficiently leverage the benefits of SPB at cluster level, we introduce JigSaw, a SPB aware scheduler, which does scheduling at the iteration level for Deep Learning Training(DLT) jobs. We find that JigSaw can improve large scale cluster efficiency by as high as 28\%.
△ Less
Submitted 20 November, 2021;
originally announced November 2021.
-
Exploring Dropout Discriminator for Domain Adaptation
Authors:
Vinod K Kurmi,
Venkatesh K Subramanian,
Vinay P. Namboodiri
Abstract:
Adaptation of a classifier to new domains is one of the challenging problems in machine learning. This has been addressed using many deep and non-deep learning based methods. Among the methodologies used, that of adversarial learning is widely applied to solve many deep learning problems along with domain adaptation. These methods are based on a discriminator that ensures source and target distrib…
▽ More
Adaptation of a classifier to new domains is one of the challenging problems in machine learning. This has been addressed using many deep and non-deep learning based methods. Among the methodologies used, that of adversarial learning is widely applied to solve many deep learning problems along with domain adaptation. These methods are based on a discriminator that ensures source and target distributions are close. However, here we suggest that rather than using a point estimate obtaining by a single discriminator, it would be useful if a distribution based on ensembles of discriminators could be used to bridge this gap. This could be achieved using multiple classifiers or using traditional ensemble methods. In contrast, we suggest that a Monte Carlo dropout based ensemble discriminator could suffice to obtain the distribution based discriminator. Specifically, we propose a curriculum based dropout discriminator that gradually increases the variance of the sample based distribution and the corresponding reverse gradients are used to align the source and target feature representations. An ensemble of discriminators helps the model to learn the data distribution efficiently. It also provides a better gradient estimates to train the feature extractor. The detailed results and thorough ablation analysis show that our model outperforms state-of-the-art results.
△ Less
Submitted 9 July, 2021;
originally announced July 2021.
-
Small World Student Network at the University of Texas at Dallas in Times of Social Distancing
Authors:
Kailash Subramanian,
Joshua M. Williams,
Daniel C. DeAnda,
Aditya A. Agrawal,
Andrei Racila,
Aditi R. Prabhu,
Lawrence Redlinger,
Christopher Wendt,
Ravi Prakash
Abstract:
To limit the spread of the novel coronavirus on college campuses, a common strategy for the Fall 2020 and Spring 2021 terms has been to offer instruction weighted toward hybrid or fully online modalities. Colleges are now considering whether and how to expand hybrid or fully in-person instruction for future terms, and learn lessons from this experience for future use. Our paper uses Fall 2019 enro…
▽ More
To limit the spread of the novel coronavirus on college campuses, a common strategy for the Fall 2020 and Spring 2021 terms has been to offer instruction weighted toward hybrid or fully online modalities. Colleges are now considering whether and how to expand hybrid or fully in-person instruction for future terms, and learn lessons from this experience for future use. Our paper uses Fall 2019 enrollment data for a medium-sized public American university to analyze whether some student groupings by class standing or course level are more susceptible to the spread of infectious disease through academic enrollment networks. Replicating Weeden and Cornwell [8], we find that enrollment networks at the institution are "small worlds" characterized by high clustering, short average path lengths, and multiple independent connections. Connectivity decreases as class standing (graduate vs. undergraduate; senior vs. freshman) and course level increase; as students move from generalized to specialized course loads, networks cluster by major. Holding other factors constant, policies focusing on in-person instruction for lower division students conflict with the greater risk of infectious spread through a lower division network in the absence of additional steps to minimize academic connectivity. There are academic and financial incentives for emphasizing the freshman experience, including concerns about student attrition from the first to second academic year and recouping costs of infrastructure investments in dormitories. Possible solutions could include (i) restricting face-to-face or hybrid instruction to courses in students' academic majors, which would disrupt larger networks into smaller ones and thus restrict the spread of infection across majors, and (ii) take a "scalpel" approach to instruction modes by moving online courses most likely to facilitate epidemic spread.
△ Less
Submitted 2 April, 2021;
originally announced April 2021.
-
Domain Impression: A Source Data Free Domain Adaptation Method
Authors:
Vinod K Kurmi,
Venkatesh K Subramanian,
Vinay P Namboodiri
Abstract:
Unsupervised Domain adaptation methods solve the adaptation problem for an unlabeled target set, assuming that the source dataset is available with all labels. However, the availability of actual source samples is not always possible in practical cases. It could be due to memory constraints, privacy concerns, and challenges in sharing data. This practical scenario creates a bottleneck in the domai…
▽ More
Unsupervised Domain adaptation methods solve the adaptation problem for an unlabeled target set, assuming that the source dataset is available with all labels. However, the availability of actual source samples is not always possible in practical cases. It could be due to memory constraints, privacy concerns, and challenges in sharing data. This practical scenario creates a bottleneck in the domain adaptation problem. This paper addresses this challenging scenario by proposing a domain adaptation technique that does not need any source data. Instead of the source data, we are only provided with a classifier that is trained on the source data. Our proposed approach is based on a generative framework, where the trained classifier is used for generating samples from the source classes. We learn the joint distribution of data by using the energy-based modeling of the trained classifier. At the same time, a new classifier is also adapted for the target domain. We perform various ablation analysis under different experimental setups and demonstrate that the proposed approach achieves better results than the baseline models in this extremely novel scenario.
△ Less
Submitted 17 February, 2021;
originally announced February 2021.
-
Do Not Forget to Attend to Uncertainty while Mitigating Catastrophic Forgetting
Authors:
Vinod K Kurmi,
Badri N. Patro,
Venkatesh K. Subramanian,
Vinay P. Namboodiri
Abstract:
One of the major limitations of deep learning models is that they face catastrophic forgetting in an incremental learning scenario. There have been several approaches proposed to tackle the problem of incremental learning. Most of these methods are based on knowledge distillation and do not adequately utilize the information provided by older task models, such as uncertainty estimation in predicti…
▽ More
One of the major limitations of deep learning models is that they face catastrophic forgetting in an incremental learning scenario. There have been several approaches proposed to tackle the problem of incremental learning. Most of these methods are based on knowledge distillation and do not adequately utilize the information provided by older task models, such as uncertainty estimation in predictions. The predictive uncertainty provides the distributional information can be applied to mitigate catastrophic forgetting in a deep learning framework. In the proposed work, we consider a Bayesian formulation to obtain the data and model uncertainties. We also incorporate self-attention framework to address the incremental learning problem. We define distillation losses in terms of aleatoric uncertainty and self-attention. In the proposed work, we investigate different ablation analyses on these losses. Furthermore, we are able to obtain better results in terms of accuracy on standard benchmarks.
△ Less
Submitted 3 February, 2021;
originally announced February 2021.
-
D2R: Dataplane-Only Policy-Compliant Routing Under Failures
Authors:
Kausik Subramanian,
Anubhavnidhi Abhashkumar,
Loris D'Antoni,
Aditya Akella
Abstract:
In networks today, the data plane handles forwarding---sending a packet to the next device in the path---and the control plane handles routing---deciding the path of the packet in the network. This architecture has limitations. First, when link failures occur, the data plane has to wait for the control plane to install new routes, and packet losses can occur due to delayed routing convergence or c…
▽ More
In networks today, the data plane handles forwarding---sending a packet to the next device in the path---and the control plane handles routing---deciding the path of the packet in the network. This architecture has limitations. First, when link failures occur, the data plane has to wait for the control plane to install new routes, and packet losses can occur due to delayed routing convergence or central controller latencies. Second, policy-compliance is not guaranteed without sophisticated configuration synthesis or controller intervention. In this paper, we take advantage of the recent advances in fast programmable switches to perform policy-compliant route computations entirely in the data plane, thus providing fast reactions to failures. D2R, our new network architecture, can provide the illusion of a network fabric that is always available and policy-compliant, even under failures. We implement our data plane in P4 and demonstrate its viability in real world topologies.
△ Less
Submitted 5 December, 2019;
originally announced December 2019.
-
Curriculum based Dropout Discriminator for Domain Adaptation
Authors:
Vinod Kumar Kurmi,
Vipul Bajaj,
Venkatesh K Subramanian,
Vinay P Namboodiri
Abstract:
Domain adaptation is essential to enable wide usage of deep learning based networks trained using large labeled datasets. Adversarial learning based techniques have shown their utility towards solving this problem using a discriminator that ensures source and target distributions are close. However, here we suggest that rather than using a point estimate, it would be useful if a distribution based…
▽ More
Domain adaptation is essential to enable wide usage of deep learning based networks trained using large labeled datasets. Adversarial learning based techniques have shown their utility towards solving this problem using a discriminator that ensures source and target distributions are close. However, here we suggest that rather than using a point estimate, it would be useful if a distribution based discriminator could be used to bridge this gap. This could be achieved using multiple classifiers or using traditional ensemble methods. In contrast, we suggest that a Monte Carlo dropout based ensemble discriminator could suffice to obtain the distribution based discriminator. Specifically, we propose a curriculum based dropout discriminator that gradually increases the variance of the sample based distribution and the corresponding reverse gradients are used to align the source and target feature representations. The detailed results and thorough ablation analysis show that our model outperforms state-of-the-art results.
△ Less
Submitted 19 October, 2019; v1 submitted 24 July, 2019;
originally announced July 2019.
-
Mean Spectral Normalization of Deep Neural Networks for Embedded Automation
Authors:
Anand Krishnamoorthy Subramanian,
Nak Young Chong
Abstract:
Deep Neural Networks (DNNs) have begun to thrive in the field of automation systems, owing to the recent advancements in standardising various aspects such as architecture, optimization techniques, and regularization. In this paper, we take a step towards a better understanding of Spectral Normalization (SN) and its potential for standardizing regularization of a wider range of Deep Learning model…
▽ More
Deep Neural Networks (DNNs) have begun to thrive in the field of automation systems, owing to the recent advancements in standardising various aspects such as architecture, optimization techniques, and regularization. In this paper, we take a step towards a better understanding of Spectral Normalization (SN) and its potential for standardizing regularization of a wider range of Deep Learning models, following an empirical approach. We conduct several experiments to study their training dynamics, in comparison with the ubiquitous Batch Normalization (BN) and show that SN increases the gradient sparsity and controls the gradient variance. Furthermore, we show that SN suffers from a phenomenon, we call the mean-drift effect, which mitigates its performance. We, then, propose a weight reparameterization called as the Mean Spectral Normalization (MSN) to resolve the mean drift, thereby significantly improving the network's performance. Our model performs ~16% faster as compared to BN in practice, and has fewer trainable parameters. We also show the performance of our MSN for small, medium, and large CNNs - 3-layer CNN, VGG7 and DenseNet-BC, respectively - and unsupervised image generation tasks using Generative Adversarial Networks (GANs) to evaluate its applicability for a broad range of embedded automation tasks.
△ Less
Submitted 9 July, 2019;
originally announced July 2019.
-
Intention-Net: Integrating Planning and Deep Learning for Goal-Directed Autonomous Navigation
Authors:
Wei Gao,
David Hsu,
Wee Sun Lee,
Shengmei Shen,
Karthikk Subramanian
Abstract:
How can a delivery robot navigate reliably to a destination in a new office building, with minimal prior information? To tackle this challenge, this paper introduces a two-level hierarchical approach, which integrates model-free deep learning and model-based path planning. At the low level, a neural-network motion controller, called the intention-net, is trained end-to-end to provide robust local…
▽ More
How can a delivery robot navigate reliably to a destination in a new office building, with minimal prior information? To tackle this challenge, this paper introduces a two-level hierarchical approach, which integrates model-free deep learning and model-based path planning. At the low level, a neural-network motion controller, called the intention-net, is trained end-to-end to provide robust local navigation. The intention-net maps images from a single monocular camera and "intentions" directly to robot controls. At the high level, a path planner uses a crude map, e.g., a 2-D floor plan, to compute a path from the robot's current location to the goal. The planned path provides intentions to the intention-net. Preliminary experiments suggest that the learned motion controller is robust against perceptual uncertainty and by integrating with a path planner, it generalizes effectively to new environments and goals.
△ Less
Submitted 16 October, 2017; v1 submitted 16 October, 2017;
originally announced October 2017.
-
Two-Dimensional Pattern Languages
Authors:
Henning Fernau,
Markus L. Schmid,
K. G. Subramanian
Abstract:
We introduce several classes of array languages obtained by generalising Angluin's pattern languages to the two-dimensional case. These classes of two-dimensional pattern languages are compared with respect to their expressive power and their closure properties are investigated.
We introduce several classes of array languages obtained by generalising Angluin's pattern languages to the two-dimensional case. These classes of two-dimensional pattern languages are compared with respect to their expressive power and their closure properties are investigated.
△ Less
Submitted 13 July, 2017;
originally announced July 2017.
-
Navigating Occluded Intersections with Autonomous Vehicles using Deep Reinforcement Learning
Authors:
David Isele,
Reza Rahimi,
Akansel Cosgun,
Kaushik Subramanian,
Kikuo Fujimura
Abstract:
Providing an efficient strategy to navigate safely through unsignaled intersections is a difficult task that requires determining the intent of other drivers. We explore the effectiveness of Deep Reinforcement Learning to handle intersection problems. Using recent advances in Deep RL, we are able to learn policies that surpass the performance of a commonly-used heuristic approach in several metric…
▽ More
Providing an efficient strategy to navigate safely through unsignaled intersections is a difficult task that requires determining the intent of other drivers. We explore the effectiveness of Deep Reinforcement Learning to handle intersection problems. Using recent advances in Deep RL, we are able to learn policies that surpass the performance of a commonly-used heuristic approach in several metrics including task completion time and goal success rate and have limited ability to generalize. We then explore a system's ability to learn active sensing behaviors to enable navigating safely in the case of occlusions. Our analysis, provides insight into the intersection handling problem, the solutions learned by the network point out several shortcomings of current rule-based methods, and the failures of our current deep reinforcement learning system point to future research directions.
△ Less
Submitted 26 February, 2018; v1 submitted 2 May, 2017;
originally announced May 2017.
-
One-dimensional Array Grammars and P Systems with Array Insertion and Deletion Rules
Authors:
Rudolf Freund,
Sergiu Ivanov,
Marion Oswald,
K. G. Subramanian
Abstract:
We consider the (one-dimensional) array counterpart of contextual as well as insertion and deletion string grammars and consider the operations of array insertion and deletion in array grammars. First we show that the emptiness problem for P systems with (one-dimensional) insertion rules is undecidable. Then we show computational completeness of P systems using (one-dimensional) array insertion an…
▽ More
We consider the (one-dimensional) array counterpart of contextual as well as insertion and deletion string grammars and consider the operations of array insertion and deletion in array grammars. First we show that the emptiness problem for P systems with (one-dimensional) insertion rules is undecidable. Then we show computational completeness of P systems using (one-dimensional) array insertion and deletion rules even of norm one only. The main result of the paper exhibits computational completeness of one-dimensional array grammars using array insertion and deletion rules of norm at most two.
△ Less
Submitted 5 September, 2013;
originally announced September 2013.
-
Robust Multi biometric Recognition Using Face and Ear Images
Authors:
Nazmeen Bibi Boodoo,
R. K. Subramanian
Abstract:
This study investigates the use of ear as a biometric for authentication and shows experimental results obtained on a newly created dataset of 420 images. Images are passed to a quality module in order to reduce False Rejection Rate. The Principal Component Analysis (eigen ear) approach was used, obtaining 90.7 percent recognition rate. Improvement in recognition results is obtained when ear bio…
▽ More
This study investigates the use of ear as a biometric for authentication and shows experimental results obtained on a newly created dataset of 420 images. Images are passed to a quality module in order to reduce False Rejection Rate. The Principal Component Analysis (eigen ear) approach was used, obtaining 90.7 percent recognition rate. Improvement in recognition results is obtained when ear biometric is fused with face biometric. The fusion is done at decision level, achieving a recognition rate of 96 percent.
△ Less
Submitted 4 December, 2009;
originally announced December 2009.
