-
Radio Resource Management and Path Planning in Intelligent Transportation Systems via Reinforcement Learning for Environmental Sustainability
Authors:
S. Norouzi,
N. Azarasa,
M. R. Abedi,
N. Mokari,
S. E. Seyedabrishami,
H. Saeedi,
E. A. Jorswieck
Abstract:
Efficient and dynamic path planning has become an important topic for urban areas with larger density of connected vehicles (CV) which results in reduction of travel time and directly contributes to environmental sustainability through reducing energy consumption. CVs exploit the cellular wireless vehicle-to-everything (C-V2X) communication technology to disseminate the vehicle-to-infrastructure (…
▽ More
Efficient and dynamic path planning has become an important topic for urban areas with larger density of connected vehicles (CV) which results in reduction of travel time and directly contributes to environmental sustainability through reducing energy consumption. CVs exploit the cellular wireless vehicle-to-everything (C-V2X) communication technology to disseminate the vehicle-to-infrastructure (V2I) messages to the Base-station (BS) to improve situation awareness on urban roads. In this paper, we investigate radio resource management (RRM) in such a framework to minimize the age of information (AoI) so as to enhance path planning results. We use the fact that V2I messages with lower AoI value result in less error in estimating the road capacity and more accurate path planning. Through simulations, we compare road travel times and volume over capacity (V/C) against different levels of AoI and demonstrate the promising performance of the proposed framework.
△ Less
Submitted 13 May, 2024;
originally announced May 2024.
-
Towards Complex Ontology Alignment using Large Language Models
Authors:
Reihaneh Amini,
Sanaz Saki Norouzi,
Pascal Hitzler,
Reza Amini
Abstract:
Ontology alignment, a critical process in the Semantic Web for detecting relationships between different ontologies, has traditionally focused on identifying so-called "simple" 1-to-1 relationships through class labels and properties comparison. The more practically useful exploration of more complex alignments remains a hard problem to automate, and as such is largely underexplored, i.e. in appli…
▽ More
Ontology alignment, a critical process in the Semantic Web for detecting relationships between different ontologies, has traditionally focused on identifying so-called "simple" 1-to-1 relationships through class labels and properties comparison. The more practically useful exploration of more complex alignments remains a hard problem to automate, and as such is largely underexplored, i.e. in application practice it is usually done manually by ontology and domain experts. Recently, the surge in Natural Language Processing (NLP) capabilities, driven by advancements in Large Language Models (LLMs), presents new opportunities for enhancing ontology engineering practices, including ontology alignment tasks. This paper investigates the application of LLM technologies to tackle the complex ontology alignment challenge. Leveraging a prompt-based approach and integrating rich ontology content so-called modules our work constitutes a significant advance towards automating the complex alignment task.
△ Less
Submitted 22 July, 2024; v1 submitted 16 April, 2024;
originally announced April 2024.
-
Conversational Ontology Alignment with ChatGPT
Authors:
Sanaz Saki Norouzi,
Mohammad Saeid Mahdavinejad,
Pascal Hitzler
Abstract:
This study evaluates the applicability and efficiency of ChatGPT for ontology alignment using a naive approach. ChatGPT's output is compared to the results of the Ontology Alignment Evaluation Initiative 2022 campaign using conference track ontologies. This comparison is intended to provide insights into the capabilities of a conversational large language model when used in a naive way for ontolog…
▽ More
This study evaluates the applicability and efficiency of ChatGPT for ontology alignment using a naive approach. ChatGPT's output is compared to the results of the Ontology Alignment Evaluation Initiative 2022 campaign using conference track ontologies. This comparison is intended to provide insights into the capabilities of a conversational large language model when used in a naive way for ontology matching, and to investigate the potential advantages and disadvantages of this approach.
△ Less
Submitted 17 August, 2023;
originally announced August 2023.
-
LCPOM: Precise Reconstruction of Polarized Optical Microscopy Images of Liquid Crystals
Authors:
Chuqiao Chen,
Viviana Palacio-Betancur,
Sepideh Norouzi,
Pablo F. Zubieta Rico,
Monirosadat Sadati,
Stuart J. Rowan,
Juan J. de Pablo
Abstract:
When viewed with a cross-polarized optical microscope (POM), liquid crystals display interference colors and complex patterns that depend on the material's microscopic orientation. That orientation can be manipulated by application of external fields, which provides the basis for applications in optical display and sensing technologies. The color patterns themselves have a high information content…
▽ More
When viewed with a cross-polarized optical microscope (POM), liquid crystals display interference colors and complex patterns that depend on the material's microscopic orientation. That orientation can be manipulated by application of external fields, which provides the basis for applications in optical display and sensing technologies. The color patterns themselves have a high information content. Traditionally, however, calculations of the optical appearance of liquid crystals have been performed by assuming that a single-wavelength light source is employed, and reported in a monochromatic scale. In this work, the original Jones matrix method is extended to calculate the colored images that arise when a liquid crystal is exposed to a multi-wavelength source. By accounting for the material properties, the visible light spectrum and the CIE color matching functions, we demonstrate that the proposed approach produces colored POM images that are in quantitative agreement with experimental data. Results are presented for a variety of systems, including radial, bipolar, and cholesteric droplets, where results of simulations are compared to experimental microscopy images. The effects of droplet size, topological defect structure, and droplet orientation are examined systematically. The technique introduced here generates images that can be directly compared to experiments, thereby facilitating machine learning efforts aimed at interpreting LC microscopy images, and paving the way for the inverse design of materials capable of producing specific internal microstructures in response to external stimuli.
△ Less
Submitted 21 July, 2023;
originally announced July 2023.
-
DiMS: Distilling Multiple Steps of Iterative Non-Autoregressive Transformers for Machine Translation
Authors:
Sajad Norouzi,
Rasa Hosseinzadeh,
Felipe Perez,
Maksims Volkovs
Abstract:
The computational benefits of iterative non-autoregressive transformers decrease as the number of decoding steps increases. As a remedy, we introduce Distill Multiple Steps (DiMS), a simple yet effective distillation technique to decrease the number of required steps to reach a certain translation quality. The distilled model enjoys the computational benefits of early iterations while preserving t…
▽ More
The computational benefits of iterative non-autoregressive transformers decrease as the number of decoding steps increases. As a remedy, we introduce Distill Multiple Steps (DiMS), a simple yet effective distillation technique to decrease the number of required steps to reach a certain translation quality. The distilled model enjoys the computational benefits of early iterations while preserving the enhancements from several iterative steps. DiMS relies on two models namely student and teacher. The student is optimized to predict the output of the teacher after multiple decoding steps while the teacher follows the student via a slow-moving average. The moving average keeps the teacher's knowledge updated and enhances the quality of the labels provided by the teacher. During inference, the student is used for translation and no additional computation is added. We verify the effectiveness of DiMS on various models obtaining 7.8 and 12.9 BLEU points improvements in single-step translation accuracy on distilled and raw versions of WMT'14 De-En.
△ Less
Submitted 9 June, 2023; v1 submitted 7 June, 2022;
originally announced June 2022.
-
Code Generation from Natural Language with Less Prior and More Monolingual Data
Authors:
Sajad Norouzi,
Keyi Tang,
Yanshuai Cao
Abstract:
Training datasets for semantic parsing are typically small due to the higher expertise required for annotation than most other NLP tasks. As a result, models for this application usually need additional prior knowledge to be built into the architecture or algorithm. The increased dependency on human experts hinders automation and raises the development and maintenance costs in practice. This work…
▽ More
Training datasets for semantic parsing are typically small due to the higher expertise required for annotation than most other NLP tasks. As a result, models for this application usually need additional prior knowledge to be built into the architecture or algorithm. The increased dependency on human experts hinders automation and raises the development and maintenance costs in practice. This work investigates whether a generic transformer-based seq2seq model can achieve competitive performance with minimal code-generation-specific inductive bias design. By exploiting a relatively sizeable monolingual corpus of the target programming language, which is cheap to mine from the web, we achieved 81.03% exact match accuracy on Django and 32.57 BLEU score on CoNaLa. Both are SOTA to the best of our knowledge. This positive evidence highlights a potentially easier path toward building accurate semantic parsers in practice.
△ Less
Submitted 10 June, 2021; v1 submitted 1 January, 2021;
originally announced January 2021.
-
Exemplar VAE: Linking Generative Models, Nearest Neighbor Retrieval, and Data Augmentation
Authors:
Sajad Norouzi,
David J. Fleet,
Mohammad Norouzi
Abstract:
We introduce Exemplar VAEs, a family of generative models that bridge the gap between parametric and non-parametric, exemplar based generative models. Exemplar VAE is a variant of VAE with a non-parametric prior in the latent space based on a Parzen window estimator. To sample from it, one first draws a random exemplar from a training set, then stochastically transforms that exemplar into a latent…
▽ More
We introduce Exemplar VAEs, a family of generative models that bridge the gap between parametric and non-parametric, exemplar based generative models. Exemplar VAE is a variant of VAE with a non-parametric prior in the latent space based on a Parzen window estimator. To sample from it, one first draws a random exemplar from a training set, then stochastically transforms that exemplar into a latent code and a new observation. We propose retrieval augmented training (RAT) as a way to speed up Exemplar VAE training by using approximate nearest neighbor search in the latent space to define a lower bound on log marginal likelihood. To enhance generalization, model parameters are learned using exemplar leave-one-out and subsampling. Experiments demonstrate the effectiveness of Exemplar VAEs on density estimation and representation learning. Importantly, generative data augmentation using Exemplar VAEs on permutation invariant MNIST and Fashion MNIST reduces classification error from 1.17% to 0.69% and from 8.56% to 8.16%.
△ Less
Submitted 24 November, 2020; v1 submitted 9 April, 2020;
originally announced April 2020.
-
Certainty of outlier and boundary points processing in data mining
Authors:
Elyas Rashno,
Sanaz Saki Norouzi,
Behrouz Minaei-bidgoli,
Yanhui Guo
Abstract:
Data certainty is one of the issues in the real-world applications which is caused by unwanted noise in data. Recently, more attentions have been paid to overcome this problem. We proposed a new method based on neutrosophic set (NS) theory to detect boundary and outlier points as challenging points in clustering methods. Generally, firstly, a certainty value is assigned to data points based on the…
▽ More
Data certainty is one of the issues in the real-world applications which is caused by unwanted noise in data. Recently, more attentions have been paid to overcome this problem. We proposed a new method based on neutrosophic set (NS) theory to detect boundary and outlier points as challenging points in clustering methods. Generally, firstly, a certainty value is assigned to data points based on the proposed definition in NS. Then, certainty set is presented for the proposed cost function in NS domain by considering a set of main clusters and noise cluster. After that, the proposed cost function is minimized by gradient descent method. Data points are clustered based on their membership degrees. Outlier points are assigned to noise cluster and boundary points are assigned to main clusters with almost same membership degrees. To show the effectiveness of the proposed method, two types of datasets including 3 datasets in Scatter type and 4 datasets in UCI type are used. Results demonstrate that the proposed cost function handles boundary and outlier points with more accurate membership degrees and outperforms existing state of the art clustering methods.
△ Less
Submitted 19 December, 2018;
originally announced December 2018.
