-
The Llama 3 Herd of Models
Authors:
Abhimanyu Dubey,
Abhinav Jauhri,
Abhinav Pandey,
Abhishek Kadian,
Ahmad Al-Dahle,
Aiesha Letman,
Akhil Mathur,
Alan Schelten,
Amy Yang,
Angela Fan,
Anirudh Goyal,
Anthony Hartshorn,
Aobo Yang,
Archi Mitra,
Archie Sravankumar,
Artem Korenev,
Arthur Hinsvark,
Arun Rao,
Aston Zhang,
Aurelien Rodriguez,
Austen Gregerson,
Ava Spataru,
Baptiste Roziere,
Bethany Biron,
Binh Tang
, et al. (510 additional authors not shown)
Abstract:
Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical…
▽ More
Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models that natively support multilinguality, coding, reasoning, and tool usage. Our largest model is a dense Transformer with 405B parameters and a context window of up to 128K tokens. This paper presents an extensive empirical evaluation of Llama 3. We find that Llama 3 delivers comparable quality to leading language models such as GPT-4 on a plethora of tasks. We publicly release Llama 3, including pre-trained and post-trained versions of the 405B parameter language model and our Llama Guard 3 model for input and output safety. The paper also presents the results of experiments in which we integrate image, video, and speech capabilities into Llama 3 via a compositional approach. We observe this approach performs competitively with the state-of-the-art on image, video, and speech recognition tasks. The resulting models are not yet being broadly released as they are still under development.
△ Less
Submitted 15 August, 2024; v1 submitted 31 July, 2024;
originally announced July 2024.
-
FL-DECO-BC: A Privacy-Preserving, Provably Secure, and Provenance-Preserving Federated Learning Framework with Decentralized Oracles on Blockchain for VANETs
Authors:
Sathwik Narkedimilli,
Rayachoti Arun Kumar,
N. V. Saran Kumar,
Ramapathruni Praneeth Reddy,
Pavan Kumar C
Abstract:
Vehicular Ad-Hoc Networks (VANETs) hold immense potential for improving traffic safety and efficiency. However, traditional centralized approaches for machine learning in VANETs raise concerns about data privacy and security. Federated Learning (FL) offers a solution that enables collaborative model training without sharing raw data. This paper proposes FL-DECO-BC as a novel privacy-preserving, pr…
▽ More
Vehicular Ad-Hoc Networks (VANETs) hold immense potential for improving traffic safety and efficiency. However, traditional centralized approaches for machine learning in VANETs raise concerns about data privacy and security. Federated Learning (FL) offers a solution that enables collaborative model training without sharing raw data. This paper proposes FL-DECO-BC as a novel privacy-preserving, provably secure, and provenance-preserving federated learning framework specifically designed for VANETs. FL-DECO-BC leverages decentralized oracles on blockchain to securely access external data sources while ensuring data privacy through advanced techniques. The framework guarantees provable security through cryptographic primitives and formal verification methods. Furthermore, FL-DECO-BC incorporates a provenance-preserving design to track data origin and history, fostering trust and accountability. This combination of features empowers VANETs with secure and privacy-conscious machine-learning capabilities, paving the way for advanced traffic management and safety applications.
△ Less
Submitted 30 July, 2024;
originally announced July 2024.
-
Remote ID for separation provision and multi-agent navigation
Authors:
Evgenii Vinogradov,
A. V. S. Sai Bhargav Kumar,
Franco Minucci,
Sofie Pollin,
Enrico Natalizio
Abstract:
In this paper, we investigate the integration of drone identification data (Remote ID) with collision avoidance mechanisms to improve the safety and efficiency of multi-drone operations. We introduce an improved Near Mid-Air Collision (NMAC) definition, termed as UAV NMAC (uNMAC), which accounts for uncertainties in the drone's location due to self-localization errors and possible displacements be…
▽ More
In this paper, we investigate the integration of drone identification data (Remote ID) with collision avoidance mechanisms to improve the safety and efficiency of multi-drone operations. We introduce an improved Near Mid-Air Collision (NMAC) definition, termed as UAV NMAC (uNMAC), which accounts for uncertainties in the drone's location due to self-localization errors and possible displacements between two location reports. Our proposed uNMAC-based Reciprocal Velocity Obstacle (RVO) model integrates Remote ID messages with RVO to enable enhanced collision-free navigation. We propose modifications to the Remote ID format to include data on localization accuracy and drone airframe size, facilitating more efficient collision avoidance decisions. Through extensive simulations, we demonstrate that our approach halves mission execution times compared to a conservative standard Remote ID-based RVO. Importantly, it ensures collision-free operations even under localization uncertainties. By integrating the improved Remote ID messages and uNMAC-based RVO, we offer a solution to significantly increase airspace capacity while adhering to strict safety standards. Our study emphasizes the potential to augment the safety and efficiency of future drone operations, thereby benefiting industries reliant on drone technologies.
△ Less
Submitted 2 September, 2023;
originally announced September 2023.
-
A Practical Entity Linking System for Tables in Scientific Literature
Authors:
Varish Mulwad,
Tim Finin,
Vijay S. Kumar,
Jenny Weisenberg Williams,
Sharad Dixit,
Anupam Joshi
Abstract:
Entity linking is an important step towards constructing knowledge graphs that facilitate advanced question answering over scientific documents, including the retrieval of relevant information included in tables within these documents. This paper introduces a general-purpose system for linking entities to items in the Wikidata knowledge base. It describes how we adapt this system for linking domai…
▽ More
Entity linking is an important step towards constructing knowledge graphs that facilitate advanced question answering over scientific documents, including the retrieval of relevant information included in tables within these documents. This paper introduces a general-purpose system for linking entities to items in the Wikidata knowledge base. It describes how we adapt this system for linking domain-specific entities, especially for those entities embedded within tables drawn from COVID-19-related scientific literature. We describe the setup of an efficient offline instance of the system that enables our entity-linking approach to be more feasible in practice. As part of a broader approach to infer the semantic meaning of scientific tables, we leverage the structural and semantic characteristics of the tables to improve overall entity linking performance.
△ Less
Submitted 11 June, 2023;
originally announced June 2023.
-
Solar Power Prediction Using Machine Learning
Authors:
E. Subramanian,
M. Mithun Karthik,
G Prem Krishna,
D. Vaisnav Prasath,
V. Sukesh Kumar
Abstract:
This paper presents a machine learning-based approach for predicting solar power generation with high accuracy using a 99% AUC (Area Under the Curve) metric. The approach includes data collection, pre-processing, feature selection, model selection, training, evaluation, and deployment. High-quality data from multiple sources, including weather data, solar irradiance data, and historical solar powe…
▽ More
This paper presents a machine learning-based approach for predicting solar power generation with high accuracy using a 99% AUC (Area Under the Curve) metric. The approach includes data collection, pre-processing, feature selection, model selection, training, evaluation, and deployment. High-quality data from multiple sources, including weather data, solar irradiance data, and historical solar power generation data, are collected and pre-processed to remove outliers, handle missing values, and normalize the data. Relevant features such as temperature, humidity, wind speed, and solar irradiance are selected for model training. Support Vector Machines (SVM), Random Forest, and Gradient Boosting are used as machine learning algorithms to produce accurate predictions. The models are trained on a large dataset of historical solar power generation data and other relevant features. The performance of the models is evaluated using AUC and other metrics such as precision, recall, and F1-score. The trained machine learning models are then deployed in a production environment, where they can be used to make real-time predictions about solar power generation. The results show that the proposed approach achieves a 99% AUC for solar power generation prediction, which can help energy companies better manage their solar power systems, reduce costs, and improve energy efficiency.
△ Less
Submitted 11 March, 2023;
originally announced March 2023.
-
Random Forest Regression for continuous affect using Facial Action Units
Authors:
Saurabh Hinduja,
Shaun Canavan,
Liza Jivnani,
Sk Rahatul Jannat,
V Sri Chakra Kumar
Abstract:
In this paper we describe our approach to the arousal and valence track of the 3rd Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW). We extracted facial features using OpenFace and used them to train a multiple output random forest regressor. Our approach performed comparable to the baseline approach.
In this paper we describe our approach to the arousal and valence track of the 3rd Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW). We extracted facial features using OpenFace and used them to train a multiple output random forest regressor. Our approach performed comparable to the baseline approach.
△ Less
Submitted 29 March, 2022; v1 submitted 23 March, 2022;
originally announced March 2022.
-
Automated Creation and Human-assisted Curation of Computable Scientific Models from Code and Text
Authors:
Varish Mulwad,
Andrew Crapo,
Vijay S. Kumar,
James Jobin,
Alfredo Gabaldon,
Nurali Virani,
Sharad Dixit,
Narendra Joshi
Abstract:
Scientific models hold the key to better understanding and predicting the behavior of complex systems. The most comprehensive manifestation of a scientific model, including crucial assumptions and parameters that underpin its usability, is usually embedded in associated source code and documentation, which may employ a variety of (potentially outdated) programming practices and languages. Domain e…
▽ More
Scientific models hold the key to better understanding and predicting the behavior of complex systems. The most comprehensive manifestation of a scientific model, including crucial assumptions and parameters that underpin its usability, is usually embedded in associated source code and documentation, which may employ a variety of (potentially outdated) programming practices and languages. Domain experts cannot gain a complete understanding of the implementation of a scientific model if they are not familiar with the code. Furthermore, rapid research and development iterations make it challenging to keep up with constantly evolving scientific model codebases. To address these challenges, we develop a system for the automated creation and human-assisted curation of a knowledge graph of computable scientific models that analyzes a model's code in the context of any associated inline comments and external documentation. Our system uses knowledge-driven as well as data-driven approaches to identify and extract relevant concepts from code and equations from textual documents to semantically annotate models using domain terminology. These models are converted into executable Python functions and then can further be composed into complex workflows to answer different forms of domain-driven questions. We present experimental results obtained using a dataset of code and associated text derived from NASA's Hypersonic Aerodynamics website.
△ Less
Submitted 28 January, 2022;
originally announced February 2022.
-
SROM: Simple Real-time Odometry and Mapping using LiDAR data for Autonomous Vehicles
Authors:
Nivedita Rufus,
Unni Krishnan R. Nair,
A. V. S. Sai Bhargav Kumar,
Vashist Madiraju,
K. Madhava Krishna
Abstract:
In this paper, we present SROM, a novel real-time Simultaneous Localization and Mapping (SLAM) system for autonomous vehicles. The keynote of the paper showcases SROM's ability to maintain localization at low sampling rates or at high linear or angular velocities where most popular LiDAR based localization approaches get degraded fast. We also demonstrate SROM to be computationally efficient and c…
▽ More
In this paper, we present SROM, a novel real-time Simultaneous Localization and Mapping (SLAM) system for autonomous vehicles. The keynote of the paper showcases SROM's ability to maintain localization at low sampling rates or at high linear or angular velocities where most popular LiDAR based localization approaches get degraded fast. We also demonstrate SROM to be computationally efficient and capable of handling high-speed maneuvers. It also achieves low drifts without the need for any other sensors like IMU and/or GPS. Our method has a two-layer structure wherein first, an approximate estimate of the rotation angle and translation parameters are calculated using a Phase Only Correlation (POC) method. Next, we use this estimate as an initialization for a point-to-plane ICP algorithm to obtain fine matching and registration. Another key feature of the proposed algorithm is the removal of dynamic objects before matching the scans. This improves the performance of our system as the dynamic objects can corrupt the matching scheme and derail localization. Our SLAM system can build reliable maps at the same time generating high-quality odometry. We exhaustively evaluated the proposed method in many challenging highways/country/urban sequences from the KITTI dataset and the results demonstrate better accuracy in comparisons to other state-of-the-art methods with reduced computational expense aiding in real-time realizations. We have also integrated our SROM system with our in-house autonomous vehicle and compared it with the state-of-the-art methods like LOAM and LeGO-LOAM.
△ Less
Submitted 7 May, 2020; v1 submitted 5 May, 2020;
originally announced May 2020.
-
Reactive Navigation under Non-Parametric Uncertainty through Hilbert Space Embedding of Probabilistic Velocity Obstacles
Authors:
P. S. Naga Jyotish,
Bharath Gopalakrishnan,
A. V. S. Sai Bhargav Kumar,
Arun Kumar Singh,
K. Madhava Krishna,
Dinesh Manocha
Abstract:
The probabilistic velocity obstacle (PVO) extends the concept of velocity obstacle (VO) to work in uncertain dynamic environments. In this paper, we show how a robust model predictive control (MPC) with PVO constraints under non-parametric uncertainty can be made computationally tractable. At the core of our formulation is a novel yet simple interpretation of our robust MPC as a problem of matchin…
▽ More
The probabilistic velocity obstacle (PVO) extends the concept of velocity obstacle (VO) to work in uncertain dynamic environments. In this paper, we show how a robust model predictive control (MPC) with PVO constraints under non-parametric uncertainty can be made computationally tractable. At the core of our formulation is a novel yet simple interpretation of our robust MPC as a problem of matching the distribution of PVO with a certain desired distribution. To this end, we propose two methods. Our first baseline method is based on approximating the distribution of PVO with a Gaussian Mixture Model (GMM) and subsequently performing distribution matching using Kullback Leibler (KL) divergence metric. Our second formulation is based on the possibility of representing arbitrary distributions as functions in Reproducing Kernel Hilbert Space (RKHS). We use this foundation to interpret our robust MPC as a problem of minimizing the distance between the desired distribution and the distribution of the PVO in the RKHS. Both the RKHS and GMM based formulation can work with any uncertainty distribution and thus allowing us to relax the prevalent Gaussian assumption in the existing works. We validate our formulation by taking an example of 2D navigation of quadrotors with a realistic noise model for perception and ego-motion uncertainty. In particular, we present a systematic comparison between the GMM and the RKHS approach and show that while both approaches can produce safe trajectories, the former is highly conservative and leads to poor tracking and control costs. Furthermore, RKHS based approach gives better computational times that are up to one order of magnitude lesser than the computation time of the GMM based approach.
△ Less
Submitted 21 January, 2020;
originally announced January 2020.
-
IVO: Inverse Velocity Obstacles for Real Time Navigation
Authors:
P. S. Naga Jyotish,
Yash Goel,
A. V. S. Sai Bhargav Kumar,
K. Madhava Krishna
Abstract:
In this paper, we present "IVO: Inverse Velocity Obstacles" an ego-centric framework that improves the real time implementation. The proposed method stems from the concept of velocity obstacle and can be applied for both single agent and multi-agent system. It focuses on computing collision free maneuvers without any knowledge or assumption on the pose and the velocity of the robot. This is primar…
▽ More
In this paper, we present "IVO: Inverse Velocity Obstacles" an ego-centric framework that improves the real time implementation. The proposed method stems from the concept of velocity obstacle and can be applied for both single agent and multi-agent system. It focuses on computing collision free maneuvers without any knowledge or assumption on the pose and the velocity of the robot. This is primarily achieved by reformulating the velocity obstacle to adapt to an ego-centric framework. This is a significant step towards improving real time implementations of collision avoidance in dynamic environments as there is no dependency on state estimation techniques to infer the robot pose and velocity. We evaluate IVO for both single agent and multi-agent in different scenarios and show it's efficacy over the existing formulations. We also show the real time scalability of the proposed methodology.
△ Less
Submitted 4 May, 2019;
originally announced May 2019.
-
Gradient Aware - Shrinking Domain based Control Design for Reactive Planning Frameworks used in Autonomous Vehicles
Authors:
Adarsh Modh,
Siddharth Singh,
A. V. S. Sai Bhargav Kumar,
Sriram N. N.,
K. Madhava Krishna
Abstract:
In this paper, we present a novel control law for longitudinal speed control of autonomous vehicles. The key contributions of the proposed work include the design of a control law that reactively integrates the longitudinal surface gradient of road into its operation. In contrast to the existing works, we found that integrating the path gradient into the control framework improves the speed tracki…
▽ More
In this paper, we present a novel control law for longitudinal speed control of autonomous vehicles. The key contributions of the proposed work include the design of a control law that reactively integrates the longitudinal surface gradient of road into its operation. In contrast to the existing works, we found that integrating the path gradient into the control framework improves the speed tracking efficacy. Since the control law is implemented over a shrinking domain scheme, it minimizes the integrated error by recomputing the control inputs at every discretized step and consequently provides less reaction time. This makes our control law suitable for motion planning frameworks that are operating at high frequencies. Furthermore, our work is implemented using a generalized vehicle model and can be easily extended to other classes of vehicles. The performance of gradient aware-shrinking domain based controller is implemented and tested on a stock electric vehicle on which a number of sensors are mounted. Results from the tests show the robustness of our control law for speed tracking on a terrain with varying gradient while also considering stringent time constraints imposed by the planning framework.
△ Less
Submitted 23 April, 2018;
originally announced April 2018.
-
Link Analysis for Communities Detection on Facebook
Authors:
Mohamed Adnane Mellah,
Abdelmalek Amine,
Reda Mohamed Hamou,
A. V. Senthil Kumar
Abstract:
Social networks have become a part in the daily life of millions of users, which offer wide range of interests and practices. The main characteristic of social networks is its ability to gather different individuals around a common point of view or collective beliefs. Among the current social networking sites, Facebook is the most popular, which has the highest number of users. However, in Faceboo…
▽ More
Social networks have become a part in the daily life of millions of users, which offer wide range of interests and practices. The main characteristic of social networks is its ability to gather different individuals around a common point of view or collective beliefs. Among the current social networking sites, Facebook is the most popular, which has the highest number of users. However, in Facebook, the existence of communities (groups)is a critical question; thus, many researchers focus on potential communities by using techniques like data mining and web mining. In this work, we present four approaches based on link analysis techniques to detect prospective groups and their members
△ Less
Submitted 25 June, 2014;
originally announced June 2014.
-
A Fast Distributed Approximation Algorithm for Minimum Spanning Trees in the SINR Model
Authors:
Maleq Khan,
V. S. Anil Kumar,
Gopal Pandurangan,
Guanhong Pei
Abstract:
A fundamental problem in wireless networks is the \emph{minimum spanning tree} (MST) problem: given a set $V$ of wireless nodes, compute a spanning tree $T$, so that the total cost of $T$ is minimized. In recent years, there has been a lot of interest in the physical interference model based on SINR constraints. Distributed algorithms are especially challenging in the SINR model, because of the no…
▽ More
A fundamental problem in wireless networks is the \emph{minimum spanning tree} (MST) problem: given a set $V$ of wireless nodes, compute a spanning tree $T$, so that the total cost of $T$ is minimized. In recent years, there has been a lot of interest in the physical interference model based on SINR constraints. Distributed algorithms are especially challenging in the SINR model, because of the non-locality of the model.
In this paper, we develop a fast distributed approximation algorithm for MST construction in an SINR based distributed computing model. For an $n$-node network, our algorithm's running time is $O(D\log{n}+μ\log{n})$ and produces a spanning tree whose cost is within $O(\log n)$ times the optimal (MST cost), where $D$ denotes the diameter of the disk graph obtained by using the maximum possible transmission range, and $μ=\log{\frac{d_{max}}{d_{min}}}$ denotes the "distance diversity" w.r.t. the largest and smallest distances between two nodes. (When $\frac{d_{max}}{d_{min}}$ is $n$-polynomial, $μ= O(\log n)$.) Our algorithm's running time is essentially optimal (upto a logarithmic factor), since computing {\em any} spanning tree takes $Ω(D)$ time; thus our algorithm produces a low cost spanning tree in time only a logarithmic factor more than the time to compute a spanning tree. The distributed scheduling complexity of the spanning tree resulted from our algorithm is $O(μ\log n)$. Our algorithmic design techniques can be useful in designing efficient distributed algorithms for related "global" problems in wireless networks in the SINR model.
△ Less
Submitted 5 June, 2012;
originally announced June 2012.
-
Cloud Computing Through Mobile-Learning
Authors:
N. Mallikharjuna Rao,
C. Sasidhar,
V. Sathyendra Kumar
Abstract:
Cloud computing is the new technology that has various advantages and it is an adoptable technology in this present scenario. The main advantage of the cloud computing is that this technology reduces the cost effectiveness for the implementation of the Hardware, software and License for all. This is the better peak time to analyze the cloud and its implementation and better use it for the developm…
▽ More
Cloud computing is the new technology that has various advantages and it is an adoptable technology in this present scenario. The main advantage of the cloud computing is that this technology reduces the cost effectiveness for the implementation of the Hardware, software and License for all. This is the better peak time to analyze the cloud and its implementation and better use it for the development of the quality and low cost education for all over the world. In this paper, we discuss how to influence on cloud computing and influence on this technology to take education to a wider mass of students over the country. We believe cloud computing will surely improve the current system of education and improve quality at an affordable cost.
△ Less
Submitted 7 April, 2012;
originally announced April 2012.
-
Early Performance Prediction of Web Services
Authors:
Ch Ram Mohan Reddy,
D. Evangelin Geetha,
K. G. Srinivasa,
T. V. Suresh Kumar,
K. Rajani Kanth
Abstract:
Web Service is an interface which implements business logic. Performance is an important quality aspect of Web services because of their distributed nature. Predicting the performance of web services during early stages of software development is significant. In this paper we model web service using Unified Modeling Language, Use Case Diagram, Sequence Diagram, Deployment Diagram. We obtain the Pe…
▽ More
Web Service is an interface which implements business logic. Performance is an important quality aspect of Web services because of their distributed nature. Predicting the performance of web services during early stages of software development is significant. In this paper we model web service using Unified Modeling Language, Use Case Diagram, Sequence Diagram, Deployment Diagram. We obtain the Performance metrics by simulating the web services model using a simulation tool Simulation of Multi-Tier Queuing Architecture. We have identified the bottle neck resources.
△ Less
Submitted 10 January, 2012;
originally announced January 2012.
-
General Methodology for developing UML models from UI
Authors:
Ch Ram Mohan Reddy,
D. Evangelin Geetha,
K. G. Srinivasa,
T. V. Suresh Kumar,
K. Rajani Kanth
Abstract:
In recent past every discipline and every industry have their own methods of developing products. It may be software development, mechanics, construction, psychology and so on. These demarcations work fine as long as the requirements are within one discipline. However, if the project extends over several disciplines, interfaces have to be created and coordinated between the methods of these discip…
▽ More
In recent past every discipline and every industry have their own methods of developing products. It may be software development, mechanics, construction, psychology and so on. These demarcations work fine as long as the requirements are within one discipline. However, if the project extends over several disciplines, interfaces have to be created and coordinated between the methods of these disciplines. Performance is an important quality aspect of Web Services because of their distributed nature. Predicting the performance of web services during early stages of software development is significant. In Industry, Prototype of these applications is developed during analysis phase of Software Development Life Cycle (SDLC). However, Performance models are generated from UML models. Methodologies for predicting the performance from UML models is available. Hence, In this paper, a methodology for developing Use Case model and Activity model from User Interface is presented. The methodology is illustrated with a case study on Amazon.com.
△ Less
Submitted 10 January, 2012;
originally announced January 2012.