-
A note on MDS Property of Circulant Matrices
Authors:
Tapas Chatterjee,
Ayantika Laha
Abstract:
In $2014$, Gupta and Ray proved that the circulant involutory matrices over the finite field $\mathbb{F}_{2^m}$ can not be maximum distance separable (MDS). This non-existence also extends to circulant orthogonal matrices of order $2^d \times 2^d$ over finite fields of characteristic $2$. These findings inspired many authors to generalize the circulant property for constructing lightweight MDS mat…
▽ More
In $2014$, Gupta and Ray proved that the circulant involutory matrices over the finite field $\mathbb{F}_{2^m}$ can not be maximum distance separable (MDS). This non-existence also extends to circulant orthogonal matrices of order $2^d \times 2^d$ over finite fields of characteristic $2$. These findings inspired many authors to generalize the circulant property for constructing lightweight MDS matrices with practical applications in mind. Recently, in $2022,$ Chatterjee and Laha initiated a study of circulant matrices by considering semi-involutory and semi-orthogonal properties. Expanding on their work, this article delves into circulant matrices possessing these characteristics over the finite field $\mathbb{F}_{2^m}.$ Notably, we establish a correlation between the trace of associated diagonal matrices and the MDS property of the matrix. We prove that this correlation holds true for even order semi-orthogonal matrices and semi-involutory matrices of all orders. Additionally, we provide examples that for circulant, semi-orthogonal matrices of odd orders over a finite field with characteristic $2$, the trace of associated diagonal matrices may possess non-zero values.
△ Less
Submitted 22 June, 2024;
originally announced June 2024.
-
On MDS Property of g-Circulant Matrices
Authors:
Tapas Chatterjee,
Ayantika Laha
Abstract:
Circulant Maximum Distance Separable (MDS) matrices have gained significant importance due to their applications in the diffusion layer of the AES block cipher. In $2013$, Gupta and Ray established that circulant involutory matrices of order greater than $3$ cannot be MDS. This finding prompted a generalization of circulant matrices and the involutory property of matrices by various authors. In…
▽ More
Circulant Maximum Distance Separable (MDS) matrices have gained significant importance due to their applications in the diffusion layer of the AES block cipher. In $2013$, Gupta and Ray established that circulant involutory matrices of order greater than $3$ cannot be MDS. This finding prompted a generalization of circulant matrices and the involutory property of matrices by various authors. In $2016$, Liu and Sim introduced cyclic matrices by changing the permutation of circulant matrices. In $1961,$ Friedman introduced $g$-circulant matrices which form a subclass of cyclic matrices. In this article, we first discuss $g$-circulant matrices with involutory and MDS properties. We prove that $g$-circulant involutory matrices of order $k \times k$ cannot be MDS unless $g \equiv -1 \pmod k.$ Next, we delve into $g$-circulant semi-involutory and semi-orthogonal matrices with entries from finite fields. We establish that the $k$-th power of the associated diagonal matrices of a $g$-circulant semi-orthogonal (semi-involutory) matrix of order $k \times k$ results in a scalar matrix. These findings can be viewed as an extension of the results concerning circulant matrices established by Chatterjee {\it{et al.}} in $2022.$
△ Less
Submitted 22 June, 2024;
originally announced June 2024.
-
A note on cyclic non-MDS matrices
Authors:
Tapas Chatterjee,
Ayantika Laha
Abstract:
In $1998,$ Daemen {\it{ et al.}} introduced a circulant Maximum Distance Separable (MDS) matrix in the diffusion layer of the Rijndael block cipher, drawing significant attention to circulant MDS matrices. This block cipher is now universally acclaimed as the AES block cipher. In $2016,$ Liu and Sim introduced cyclic matrices by modifying the permutation of circulant matrices and established the e…
▽ More
In $1998,$ Daemen {\it{ et al.}} introduced a circulant Maximum Distance Separable (MDS) matrix in the diffusion layer of the Rijndael block cipher, drawing significant attention to circulant MDS matrices. This block cipher is now universally acclaimed as the AES block cipher. In $2016,$ Liu and Sim introduced cyclic matrices by modifying the permutation of circulant matrices and established the existence of MDS property for orthogonal left-circulant matrices, a notable subclass within cyclic matrices. While circulant matrices have been well-studied in the literature, the properties of cyclic matrices are not. Back in $1961$, Friedman introduced $g$-circulant matrices which form a subclass of cyclic matrices. In this article, we first establish a permutation equivalence between a cyclic matrix and a circulant matrix. We explore properties of cyclic matrices similar to $g$-circulant matrices. Additionally, we determine the determinant of $g$-circulant matrices of order $2^d \times 2^d$ and prove that they cannot be simultaneously orthogonal and MDS over a finite field of characteristic $2$. Furthermore, we prove that this result holds for any cyclic matrix.
△ Less
Submitted 20 June, 2024;
originally announced June 2024.
-
A Characterization of Semi-Involutory MDS Matrices
Authors:
Tapas Chatterjee,
Ayantika Laha
Abstract:
In symmetric cryptography, maximum distance separable (MDS) matrices with computationally simple inverses have wide applications. Many block ciphers like AES, SQUARE, SHARK, and hash functions like PHOTON use an MDS matrix in the diffusion layer. In this article, we first characterize all $3 \times 3$ irreducible semi-involutory matrices over the finite field of characteristic $2$. Using this matr…
▽ More
In symmetric cryptography, maximum distance separable (MDS) matrices with computationally simple inverses have wide applications. Many block ciphers like AES, SQUARE, SHARK, and hash functions like PHOTON use an MDS matrix in the diffusion layer. In this article, we first characterize all $3 \times 3$ irreducible semi-involutory matrices over the finite field of characteristic $2$. Using this matrix characterization, we provide a necessary and sufficient condition to construct MDS semi-involutory matrices using only their diagonal entries and the entries of an associated diagonal matrix. Finally, we count the number of $3 \times 3$ semi-involutory MDS matrices over any finite field of characteristic $2$.
△ Less
Submitted 18 June, 2024;
originally announced June 2024.
-
Optical MIMO communication with unequal power allocation to channels
Authors:
Aritra Laha,
Santosh Kumar
Abstract:
Multiple input multiple output (MIMO) approach in fiber optical communication has emerged as an effective proposition to address the ever increasing demand for information exchange. In the ergodic case, the multiple channels, associated with multiple modes or cores or both in the optical fiber, is modeled by the Jacobi ensemble of random matrices. A key quantity for assessing the performance of MI…
▽ More
Multiple input multiple output (MIMO) approach in fiber optical communication has emerged as an effective proposition to address the ever increasing demand for information exchange. In the ergodic case, the multiple channels, associated with multiple modes or cores or both in the optical fiber, is modeled by the Jacobi ensemble of random matrices. A key quantity for assessing the performance of MIMO systems is the mutual information (MI). We focus here on the case of an arbitrary transmission covariance matrix and derive exact determinant based results for the moment generating function (MGF) of mutual information (MI), and thereby address the scenario of unequal power per excited mode. The MGF is used to obtain Gaussian- and Weibull-distribution based approximations for the probability density function (PDF), cumulative distribution function (CDF) or, equivalently, the outage probability, and also the survival function (SF) or reliability function. Moreover, a numerical Fourier inversion approach is implemented to obtain the PDF, CDF, and SF directly from the MGF. The MGF is further used to investigate the ergodic capacity, which is the first moment (mean) of the mutual information. The analytical results are found to be in excellent agreement with Monte Carlo simulations. Our study goes beyond the earlier investigations where covariance matrix proportional to identity matrix has been considered which corresponds to equal power allocation per excited mode.
△ Less
Submitted 24 November, 2022;
originally announced November 2022.
-
Random density matrices: Analytical results for mean fidelity and variance of squared Bures distance
Authors:
Aritra Laha,
Santosh Kumar
Abstract:
One of the key issues in quantum information theory related problems concerns with that of distinguishability of quantum states. In this context, Bures distance serves as one of the foremost choices among various distance measures. It also relates to fidelity, which is another quantity of immense importance in quantum information theory. In this work, we derive exact results for the average fideli…
▽ More
One of the key issues in quantum information theory related problems concerns with that of distinguishability of quantum states. In this context, Bures distance serves as one of the foremost choices among various distance measures. It also relates to fidelity, which is another quantity of immense importance in quantum information theory. In this work, we derive exact results for the average fidelity and variance of the squared Bures distance between a fixed density matrix and a random density matrix, and also between two independent random density matrices. These results supplement the recently obtained results for the mean root fidelity and mean of squared Bures distance [Phys. Rev. A 104, 022438 (2021)]. The availability of both mean and variance also enables us to provide a gamma-distribution-based approximation for the probability density of the squared Bures distance. The analytical results are corroborated using Monte Carlo simulations. Furthermore, we compare our analytical results with the mean and variance of the squared Bures distance between reduced density matrices generated using coupled kicked tops, and a correlated spin chain system in a random magnetic field. In both cases, we find good agreement.
△ Less
Submitted 10 November, 2022;
originally announced November 2022.
-
Random density matrices: Analytical results for mean root fidelity and mean square Bures distance
Authors:
Aritra Laha,
Agrim Aggarwal,
Santosh Kumar
Abstract:
Bures distance holds a special place among various distance measures due to its several distinguished features and finds applications in diverse problems in quantum information theory. It is related to fidelity and, among other things, it serves as a bona fide measure for quantifying the separability of quantum states. In this work, we calculate exact analytical results for the mean root fidelity…
▽ More
Bures distance holds a special place among various distance measures due to its several distinguished features and finds applications in diverse problems in quantum information theory. It is related to fidelity and, among other things, it serves as a bona fide measure for quantifying the separability of quantum states. In this work, we calculate exact analytical results for the mean root fidelity and mean square Bures distance between a fixed density matrix and a random density matrix, and also between two random density matrices. In the course of derivation, we also obtain spectral density for product of above pairs of density matrices. We corroborate our analytical results using Monte Carlo simulations. Moreover, we compare these results with the mean square Bures distance between reduced density matrices generated using coupled kicked tops and find very good agreement.
△ Less
Submitted 18 November, 2022; v1 submitted 6 May, 2021;
originally announced May 2021.
-
An open-source software platform for translational photoacoustic research and its application to motion-corrected blood oxygenation estimation
Authors:
Thomas Kirchner,
Janek Gröhl,
Franz Sattler,
Moritz S. Bischoff,
Angelika Laha,
Marco Nolden,
Lena Maier-Hein
Abstract:
Photoacoustic (PA) imaging systems based on clinical linear ultrasound arrays have become increasingly popular in translational PA research. Such systems can be more easily integrated in a clinical workflow due to the simultaneous access to ultrasonic imaging and their familiarity of use to clinicians. In contrast to more complex setups, hand held linear probes can be applied to a large variety of…
▽ More
Photoacoustic (PA) imaging systems based on clinical linear ultrasound arrays have become increasingly popular in translational PA research. Such systems can be more easily integrated in a clinical workflow due to the simultaneous access to ultrasonic imaging and their familiarity of use to clinicians. In contrast to more complex setups, hand held linear probes can be applied to a large variety of clinical use cases. However, most translational work with such scanners is based on proprietary development and as such not accessible to the community. In this contribution, we present a custom-built, hybrid, multispectral, real-time photoacoustic and ultrasonic imaging system with a linear array probe that is controlled by software developed within the Medical Imaging Interaction Toolkit (MITK) a highly customizable and extendable open-source software platform. Our software offers direct control of both the laser and the ultrasonic system and may serve as a starting point for various translational research projects and developments. To demonstrate the applicability of the platform, we used it to implement a new method for blood oxygenation estimation in the presence of non-rigid inter-frame motion caused by pulsing arteries. Initial results from experiments with healthy human volunteers demonstrate the suitability of the method with the sample clinical application of imaging the common carotid artery as well as peripheral extremity vessels.
△ Less
Submitted 28 January, 2019;
originally announced January 2019.
-
On Controllable Sparse Alternatives to Softmax
Authors:
Anirban Laha,
Saneem A. Chemmengath,
Priyanka Agrawal,
Mitesh M. Khapra,
Karthik Sankaranarayanan,
Harish G. Ramaswamy
Abstract:
Converting an n-dimensional vector to a probability distribution over n objects is a commonly used component in many machine learning tasks like multiclass classification, multilabel classification, attention mechanisms etc. For this, several probability mapping functions have been proposed and employed in literature such as softmax, sum-normalization, spherical softmax, and sparsemax, but there i…
▽ More
Converting an n-dimensional vector to a probability distribution over n objects is a commonly used component in many machine learning tasks like multiclass classification, multilabel classification, attention mechanisms etc. For this, several probability mapping functions have been proposed and employed in literature such as softmax, sum-normalization, spherical softmax, and sparsemax, but there is very little understanding in terms how they relate with each other. Further, none of the above formulations offer an explicit control over the degree of sparsity. To address this, we develop a unified framework that encompasses all these formulations as special cases. This framework ensures simple closed-form solutions and existence of sub-gradients suitable for learning via backpropagation. Within this framework, we propose two novel sparse formulations, sparsegen-lin and sparsehourglass, that seek to provide a control over the degree of desired sparsity. We further develop novel convex loss functions that help induce the behavior of aforementioned formulations in the multilabel classification setting, showing improved performance. We also demonstrate empirically that the proposed formulations, when used to compute attention weights, achieve better or comparable performance on standard seq2seq tasks like neural machine translation and abstractive summarization.
△ Less
Submitted 30 October, 2018; v1 submitted 29 October, 2018;
originally announced October 2018.
-
Unsupervised Neural Text Simplification
Authors:
Sai Surya,
Abhijit Mishra,
Anirban Laha,
Parag Jain,
Karthik Sankaranarayanan
Abstract:
The paper presents a first attempt towards unsupervised neural text simplification that relies only on unlabeled text corpora. The core framework is composed of a shared encoder and a pair of attentional-decoders and gains knowledge of simplification through discrimination based-losses and denoising. The framework is trained using unlabeled text collected from en-Wikipedia dump. Our analysis (both…
▽ More
The paper presents a first attempt towards unsupervised neural text simplification that relies only on unlabeled text corpora. The core framework is composed of a shared encoder and a pair of attentional-decoders and gains knowledge of simplification through discrimination based-losses and denoising. The framework is trained using unlabeled text collected from en-Wikipedia dump. Our analysis (both quantitative and qualitative involving human evaluators) on a public test data shows that the proposed model can perform text-simplification at both lexical and syntactic levels, competitive to existing supervised methods. Addition of a few labelled pairs also improves the performance further.
△ Less
Submitted 21 August, 2019; v1 submitted 18 October, 2018;
originally announced October 2018.
-
Scalable Micro-planned Generation of Discourse from Structured Data
Authors:
Anirban Laha,
Parag Jain,
Abhijit Mishra,
Karthik Sankaranarayanan
Abstract:
We present a framework for generating natural language description from structured data such as tables; the problem comes under the category of data-to-text natural language generation (NLG). Modern data-to-text NLG systems typically employ end-to-end statistical and neural architectures that learn from a limited amount of task-specific labeled data, and therefore, exhibit limited scalability, dom…
▽ More
We present a framework for generating natural language description from structured data such as tables; the problem comes under the category of data-to-text natural language generation (NLG). Modern data-to-text NLG systems typically employ end-to-end statistical and neural architectures that learn from a limited amount of task-specific labeled data, and therefore, exhibit limited scalability, domain-adaptability, and interpretability. Unlike these systems, ours is a modular, pipeline-based approach, and does not require task-specific parallel data. It rather relies on monolingual corpora and basic off-the-shelf NLP tools. This makes our system more scalable and easily adaptable to newer domains.
Our system employs a 3-staged pipeline that: (i) converts entries in the structured data to canonical form, (ii) generates simple sentences for each atomic entry in the canonicalized representation, and (iii) combines the sentences to produce a coherent, fluent and adequate paragraph description through sentence compounding and co-reference replacement modules. Experiments on a benchmark mixed-domain dataset curated for paragraph description from tables reveals the superiority of our system over existing data-to-text approaches. We also demonstrate the robustness of our system in accepting other popular datasets covering diverse data types such as Knowledge Graphs and Key-Value maps.
△ Less
Submitted 4 October, 2019; v1 submitted 5 October, 2018;
originally announced October 2018.
-
A Mixed Hierarchical Attention based Encoder-Decoder Approach for Standard Table Summarization
Authors:
Parag Jain,
Anirban Laha,
Karthik Sankaranarayanan,
Preksha Nema,
Mitesh M. Khapra,
Shreyas Shetty
Abstract:
Structured data summarization involves generation of natural language summaries from structured input data. In this work, we consider summarizing structured data occurring in the form of tables as they are prevalent across a wide variety of domains. We formulate the standard table summarization problem, which deals with tables conforming to a single predefined schema. To this end, we propose a mix…
▽ More
Structured data summarization involves generation of natural language summaries from structured input data. In this work, we consider summarizing structured data occurring in the form of tables as they are prevalent across a wide variety of domains. We formulate the standard table summarization problem, which deals with tables conforming to a single predefined schema. To this end, we propose a mixed hierarchical attention based encoder-decoder model which is able to leverage the structure in addition to the content of the tables. Our experiments on the publicly available WEATHERGOV dataset show around 18 BLEU (~ 30%) improvement over the current state-of-the-art.
△ Less
Submitted 20 April, 2018;
originally announced April 2018.
-
Generating Descriptions from Structured Data Using a Bifocal Attention Mechanism and Gated Orthogonalization
Authors:
Preksha Nema,
Shreyas Shetty,
Parag Jain,
Anirban Laha,
Karthik Sankaranarayanan,
Mitesh M. Khapra
Abstract:
In this work, we focus on the task of generating natural language descriptions from a structured table of facts containing fields (such as nationality, occupation, etc) and values (such as Indian, actor, director, etc). One simple choice is to treat the table as a sequence of fields and values and then use a standard seq2seq model for this task. However, such a model is too generic and does not ex…
▽ More
In this work, we focus on the task of generating natural language descriptions from a structured table of facts containing fields (such as nationality, occupation, etc) and values (such as Indian, actor, director, etc). One simple choice is to treat the table as a sequence of fields and values and then use a standard seq2seq model for this task. However, such a model is too generic and does not exploit task-specific characteristics. For example, while generating descriptions from a table, a human would attend to information at two levels: (i) the fields (macro level) and (ii) the values within the field (micro level). Further, a human would continue attending to a field for a few timesteps till all the information from that field has been rendered and then never return back to this field (because there is nothing left to say about it). To capture this behavior we use (i) a fused bifocal attention mechanism which exploits and combines this micro and macro level information and (ii) a gated orthogonalization mechanism which tries to ensure that a field is remembered for a few time steps and then forgotten. We experiment with a recently released dataset which contains fact tables about people and their corresponding one line biographical descriptions in English. In addition, we also introduce two similar datasets for French and German. Our experiments show that the proposed model gives 21% relative improvement over a recently proposed state of the art method and 10% relative improvement over basic seq2seq models. The code and the datasets developed as a part of this work are publicly available.
△ Less
Submitted 20 April, 2018;
originally announced April 2018.
-
A Hybrid Approach for Efficient Wireless Information and Power Transfer in Green C-RAN
Authors:
Xu Li,
Zhao Chen,
Aurobinda Laha,
Ziru Chen,
Yu Cheng,
Lin X. Cai
Abstract:
In this paper, we consider a green cloud radio access network (C-RAN) with simultaneous wireless and power transfer ability. In order to reduce the energy consumed for updating the chanel state information (CSI), energy users are divided into two different groups, including the free charge group and the MIMO group. Then a semi-definite programming problem is formulated under the constraints of ene…
▽ More
In this paper, we consider a green cloud radio access network (C-RAN) with simultaneous wireless and power transfer ability. In order to reduce the energy consumed for updating the chanel state information (CSI), energy users are divided into two different groups, including the free charge group and the MIMO group. Then a semi-definite programming problem is formulated under the constraints of energy and information transmission requirements. To minimize the total energy consumption, two algorithms are developed to authorize the energy users into two group divisions in single time slot. Then the algorithms are extended to long term scenarios consisting training and long term stages, the CSI of free charge energy users are not required during the long term stage. Simulation and numerical results are presented to demonstrate the efficiency of the proposed algorithms in significantly reducing the energy consumption of C-RAN systems.
△ Less
Submitted 28 March, 2018;
originally announced March 2018.
-
Story Generation from Sequence of Independent Short Descriptions
Authors:
Parag Jain,
Priyanka Agrawal,
Abhijit Mishra,
Mohak Sukhwani,
Anirban Laha,
Karthik Sankaranarayanan
Abstract:
Existing Natural Language Generation (NLG) systems are weak AI systems and exhibit limited capabilities when language generation tasks demand higher levels of creativity, originality and brevity. Effective solutions or, at least evaluations of modern NLG paradigms for such creative tasks have been elusive, unfortunately. This paper introduces and addresses the task of coherent story generation fro…
▽ More
Existing Natural Language Generation (NLG) systems are weak AI systems and exhibit limited capabilities when language generation tasks demand higher levels of creativity, originality and brevity. Effective solutions or, at least evaluations of modern NLG paradigms for such creative tasks have been elusive, unfortunately. This paper introduces and addresses the task of coherent story generation from independent descriptions, describing a scene or an event. Towards this, we explore along two popular text-generation paradigms -- (1) Statistical Machine Translation (SMT), posing story generation as a translation problem and (2) Deep Learning, posing story generation as a sequence to sequence learning problem. In SMT, we chose two popular methods such as phrase based SMT (PB-SMT) and syntax based SMT (SYNTAX-SMT) to `translate' the incoherent input text into stories. We then implement a deep recurrent neural network (RNN) architecture that encodes sequence of variable length input descriptions to corresponding latent representations and decodes them to produce well formed comprehensive story like summaries. The efficacy of the suggested approaches is demonstrated on a publicly available dataset with the help of popular machine translation and summarization evaluation metrics.
△ Less
Submitted 21 August, 2017; v1 submitted 18 July, 2017;
originally announced July 2017.
-
A Machine Learning Approach for Evaluating Creative Artifacts
Authors:
Disha Shrivastava,
Saneem Ahmed CG,
Anirban Laha,
Karthik Sankaranarayanan
Abstract:
Much work has been done in understanding human creativity and defining measures to evaluate creativity. This is necessary mainly for the reason of having an objective and automatic way of quantifying creative artifacts. In this work, we propose a regression-based learning framework which takes into account quantitatively the essential criteria for creativity like novelty, influence, value and unex…
▽ More
Much work has been done in understanding human creativity and defining measures to evaluate creativity. This is necessary mainly for the reason of having an objective and automatic way of quantifying creative artifacts. In this work, we propose a regression-based learning framework which takes into account quantitatively the essential criteria for creativity like novelty, influence, value and unexpectedness. As it is often the case with most creative domains, there is no clear ground truth available for creativity. Our proposed learning framework is applicable to all creative domains; yet we evaluate it on a dataset of movies created from IMDb and Rotten Tomatoes due to availability of audience and critic scores, which can be used as proxy ground truth labels for creativity. We report promising results and observations from our experiments in the following ways : 1) Correlation of creative criteria with critic scores, 2) Improvement in movie rating prediction with inclusion of various creative criteria, and 3) Identification of creative movies.
△ Less
Submitted 18 July, 2017;
originally announced July 2017.
-
Diversity driven Attention Model for Query-based Abstractive Summarization
Authors:
Preksha Nema,
Mitesh Khapra,
Anirban Laha,
Balaraman Ravindran
Abstract:
Abstractive summarization aims to generate a shorter version of the document covering all the salient points in a compact and coherent fashion. On the other hand, query-based summarization highlights those points that are relevant in the context of a given query. The encode-attend-decode paradigm has achieved notable success in machine translation, extractive summarization, dialog systems, etc. Bu…
▽ More
Abstractive summarization aims to generate a shorter version of the document covering all the salient points in a compact and coherent fashion. On the other hand, query-based summarization highlights those points that are relevant in the context of a given query. The encode-attend-decode paradigm has achieved notable success in machine translation, extractive summarization, dialog systems, etc. But it suffers from the drawback of generation of repeated phrases. In this work we propose a model for the query-based summarization task based on the encode-attend-decode paradigm with two key additions (i) a query attention model (in addition to document attention model) which learns to focus on different portions of the query at different time steps (instead of using a static representation for the query) and (ii) a new diversity based attention model which aims to alleviate the problem of repeating phrases in the summary. In order to enable the testing of this model we introduce a new query-based summarization dataset building on debatepedia. Our experiments show that with these two additions the proposed model clearly outperforms vanilla encode-attend-decode models with a gain of 28% (absolute) in ROUGE-L scores.
△ Less
Submitted 13 July, 2018; v1 submitted 26 April, 2017;
originally announced April 2017.
-
Joint Learning of Correlated Sequence Labelling Tasks Using Bidirectional Recurrent Neural Networks
Authors:
Vardaan Pahuja,
Anirban Laha,
Shachar Mirkin,
Vikas Raykar,
Lili Kotlerman,
Guy Lev
Abstract:
The stream of words produced by Automatic Speech Recognition (ASR) systems is typically devoid of punctuations and formatting. Most natural language processing applications expect segmented and well-formatted texts as input, which is not available in ASR output. This paper proposes a novel technique of jointly modeling multiple correlated tasks such as punctuation and capitalization using bidirect…
▽ More
The stream of words produced by Automatic Speech Recognition (ASR) systems is typically devoid of punctuations and formatting. Most natural language processing applications expect segmented and well-formatted texts as input, which is not available in ASR output. This paper proposes a novel technique of jointly modeling multiple correlated tasks such as punctuation and capitalization using bidirectional recurrent neural networks, which leads to improved performance for each of these tasks. This method could be extended for joint modeling of any other correlated sequence labeling tasks.
△ Less
Submitted 18 July, 2017; v1 submitted 14 March, 2017;
originally announced March 2017.
-
An Empirical Evaluation of various Deep Learning Architectures for Bi-Sequence Classification Tasks
Authors:
Anirban Laha,
Vikas Raykar
Abstract:
Several tasks in argumentation mining and debating, question-answering, and natural language inference involve classifying a sequence in the context of another sequence (referred as bi-sequence classification). For several single sequence classification tasks, the current state-of-the-art approaches are based on recurrent and convolutional neural networks. On the other hand, for bi-sequence classi…
▽ More
Several tasks in argumentation mining and debating, question-answering, and natural language inference involve classifying a sequence in the context of another sequence (referred as bi-sequence classification). For several single sequence classification tasks, the current state-of-the-art approaches are based on recurrent and convolutional neural networks. On the other hand, for bi-sequence classification problems, there is not much understanding as to the best deep learning architecture. In this paper, we attempt to get an understanding of this category of problems by extensive empirical evaluation of 19 different deep learning architectures (specifically on different ways of handling context) for various problems originating in natural language processing like debating, textual entailment and question-answering. Following the empirical evaluation, we offer our insights and conclusions regarding the architectures we have considered. We also establish the first deep learning baselines for three argumentation mining tasks.
△ Less
Submitted 2 October, 2016; v1 submitted 17 July, 2016;
originally announced July 2016.
-
An Efficient Cryptographic Hash Algorithm (BSA)
Authors:
Subhabrata Mukherjee,
Bimal Roy,
Anirban Laha
Abstract:
Recent cryptanalytic attacks have exposed the vulnerabilities of some widely used cryptographic hash functions like MD5 and SHA-1. Attacks in the line of differential attacks have been used to expose the weaknesses of several other hash functions like RIPEMD, HAVAL. In this paper we propose a new efficient hash algorithm that provides a near random hash output and overcomes some of the earlier wea…
▽ More
Recent cryptanalytic attacks have exposed the vulnerabilities of some widely used cryptographic hash functions like MD5 and SHA-1. Attacks in the line of differential attacks have been used to expose the weaknesses of several other hash functions like RIPEMD, HAVAL. In this paper we propose a new efficient hash algorithm that provides a near random hash output and overcomes some of the earlier weaknesses. Extensive simulations and comparisons with some existing hash functions have been done to prove the effectiveness of the BSA, which is an acronym for the name of the 3 authors.
△ Less
Submitted 18 September, 2012; v1 submitted 12 April, 2012;
originally announced April 2012.
-
Enhancing Support for Knowledge Works: A relatively unexplored vista of computing research
Authors:
Arijit Laha
Abstract:
Let us envision a new class of IT systems, the "Support Systems for Knowledge Works" or SSKW. An SSKW can be defined as a system built for providing comprehensive support to human knowledge-workers while performing instances of complex knowledge-works of a particular type within a particular domain of professional activities To get an idea what an SSKW-enabled work environment can be like, let us…
▽ More
Let us envision a new class of IT systems, the "Support Systems for Knowledge Works" or SSKW. An SSKW can be defined as a system built for providing comprehensive support to human knowledge-workers while performing instances of complex knowledge-works of a particular type within a particular domain of professional activities To get an idea what an SSKW-enabled work environment can be like, let us look into a hypothetical scenario that depicts the interaction between a physician and a patient-care SSKW during the activity of diagnosing a patient.
△ Less
Submitted 22 December, 2011;
originally announced December 2011.
-
Fuzzy Rules and Evidence Theory for Satellite Image Analysis
Authors:
Arijit Laha,
J. Das
Abstract:
Design of a fuzzy rule based classifier is proposed. The performance of the classifier for multispectral satellite image classification is improved using Dempster- Shafer theory of evidence that exploits information of the neighboring pixels. The classifiers are tested rigorously with two known images and their performance are found to be better than the results available in the literature. We als…
▽ More
Design of a fuzzy rule based classifier is proposed. The performance of the classifier for multispectral satellite image classification is improved using Dempster- Shafer theory of evidence that exploits information of the neighboring pixels. The classifiers are tested rigorously with two known images and their performance are found to be better than the results available in the literature. We also demonstrate the improvement of performance while using D-S theory along with fuzzy rule based classifiers over the basic fuzzy rule based classifiers for all the test cases.
△ Less
Submitted 8 April, 2011;
originally announced April 2011.
-
An Agent-based Architecture for a Knowledge-work Support System
Authors:
Arijit Laha
Abstract:
Enhancement of technology-based system support for knowledge workers is an issue of great importance. The "Knowledge work Support System (KwSS)" framework analyzes this issue from a holistic perspective. KwSS proposes a set of design principles for building a comprehensive IT-based support system, which enhances the capability of a human agent for performing a set of complex and interrelated knowl…
▽ More
Enhancement of technology-based system support for knowledge workers is an issue of great importance. The "Knowledge work Support System (KwSS)" framework analyzes this issue from a holistic perspective. KwSS proposes a set of design principles for building a comprehensive IT-based support system, which enhances the capability of a human agent for performing a set of complex and interrelated knowledge-works relevant to one or more target task-types within a domain of professional activities. In this paper, we propose a high-level, software-agent based architecture for realizing a KwSS system that incorporates these design principles. Here we focus on developing a number of crucial enabling components of the architecture, including (1) an Activity Theory-based novel modeling technique for knowledgeintensive activities; (2) a graph theoretic formalism for representing these models in a knowledge base in conjunction with relevant entity taxonomies/ontologies; and (3) an algorithm for reasoning, using the knowledge base, about various aspects of possible supports for activities at performance-time.
△ Less
Submitted 7 April, 2011;
originally announced April 2011.
-
On the issues of building Information Warehouses
Authors:
Arijit Laha
Abstract:
While performing knowledge-intensive tasks of professional nature, the knowledge workers need to access and process large volume of information. Apart from the quantity, they also require that the information received is of high quality in terms of authenticity and details. This, in turn, requires that the information delivered should also include argumentative support, exhibiting the reasoning…
▽ More
While performing knowledge-intensive tasks of professional nature, the knowledge workers need to access and process large volume of information. Apart from the quantity, they also require that the information received is of high quality in terms of authenticity and details. This, in turn, requires that the information delivered should also include argumentative support, exhibiting the reasoning process behind their development and provenance to indicate their lineage. In conventional document-centric practices for information management, such details are difficult to capture, represent/archive and retrieve/deliver. To achieve such capability we need to re-think some core issues of information management from the above requirements perspective. In this paper we develop a framework for comprehensive representation of information in archive, capturing informational contents along with their context. We shall call it the "Information Warehouse (IW)" framework of information archival. The IW is a significant yet technologically realizable conceptual advancement which can support efficiently some interesting classes of applications which can be very useful to the knowledge workers.
△ Less
Submitted 2 December, 2009;
originally announced December 2009.
-
Land cover classification using fuzzy rules and aggregation of contextual information through evidence theory
Authors:
Arijit Laha,
Nikhil R. Pal,
J. Das
Abstract:
Land cover classification using multispectral satellite image is a very challenging task with numerous practical applications. We propose a multi-stage classifier that involves fuzzy rule extraction from the training data and then generation of a possibilistic label vector for each pixel using the fuzzy rule base. To exploit the spatial correlation of land cover types we propose four different i…
▽ More
Land cover classification using multispectral satellite image is a very challenging task with numerous practical applications. We propose a multi-stage classifier that involves fuzzy rule extraction from the training data and then generation of a possibilistic label vector for each pixel using the fuzzy rule base. To exploit the spatial correlation of land cover types we propose four different information aggregation methods which use the possibilistic class label of a pixel and those of its eight spatial neighbors for making the final classification decision. Three of the aggregation methods use Dempster-Shafer theory of evidence while the remaining one is modeled after the fuzzy k-NN rule. The proposed methods are tested with two benchmark seven channel satellite images and the results are found to be quite satisfactory. They are also compared with a Markov random field (MRF) model-based contextual classification method and found to perform consistently better.
△ Less
Submitted 23 November, 2009;
originally announced November 2009.
-
Designing fuzzy rule based classifier using self-organizing feature map for analysis of multispectral satellite images
Authors:
Nikhil R. Pal,
Arijit Laha,
J. Das
Abstract:
We propose a novel scheme for designing fuzzy rule based classifier. An SOFM based method is used for generating a set of prototypes which is used to generate a set of fuzzy rules. Each rule represents a region in the feature space that we call the context of the rule. The rules are tuned with respect to their context. We justified that the reasoning scheme may be different in different context…
▽ More
We propose a novel scheme for designing fuzzy rule based classifier. An SOFM based method is used for generating a set of prototypes which is used to generate a set of fuzzy rules. Each rule represents a region in the feature space that we call the context of the rule. The rules are tuned with respect to their context. We justified that the reasoning scheme may be different in different context leading to context sensitive inferencing. To realize context sensitive inferencing we used a softmin operator with a tunable parameter. The proposed scheme is tested on several multispectral satellite image data sets and the performance is found to be much better than the results reported in the literature.
△ Less
Submitted 23 November, 2009;
originally announced November 2009.
-
A theoretical foundation for building Knowledge-work Support Systems
Authors:
Arijit Laha
Abstract:
In this paper we propose a novel approach aimed at building a new class of information system platforms which we call the "Knowledge-work Support Systems" or KwSS. KwSS can play a significant role in enhancing the IS support for knowledge management processes, including those customarily identified as less amenable to IS support. In our approach we try to enhance basic functionalities provided b…
▽ More
In this paper we propose a novel approach aimed at building a new class of information system platforms which we call the "Knowledge-work Support Systems" or KwSS. KwSS can play a significant role in enhancing the IS support for knowledge management processes, including those customarily identified as less amenable to IS support. In our approach we try to enhance basic functionalities provided by the computer-based information systems, namely, that of improving the efficiency of the knowledge workers in accessing, processing and creating useful information. The improvement, along with proper focus on cultural, social and other aspects of the knowledge management processes, can enhance the workers' efficiency significantly in performing high quality knowledge works. In order to build the proposed approach, we develop several new concepts. The approach analyzes the information availability and usage from the knowledge workers and their works' perspectives and consequently brings forth more transparency in various aspects of information life-cycle with respect to knowledge management. KsSSes are technology platforms, which can be implemented independently as well as in conjunction with other knowledge management and data management technology platforms, to provide significant boost in the knowledge capabilities of organizations.
△ Less
Submitted 28 October, 2009;
originally announced October 2009.
-
On building Information Warehouses
Authors:
Arijit Laha
Abstract:
One of the most important goals of information management (IM) is supporting the knowledge workers in performing their works. In this paper we examine issues of relevance, linkage and provenance of information, as accessed and used by the knowledge workers. These are usually not adequately addressed in most of the IT based solutions for IM. Here we propose a non-conventional approach for buildin…
▽ More
One of the most important goals of information management (IM) is supporting the knowledge workers in performing their works. In this paper we examine issues of relevance, linkage and provenance of information, as accessed and used by the knowledge workers. These are usually not adequately addressed in most of the IT based solutions for IM. Here we propose a non-conventional approach for building information systems for supporting the knowledge workers which addresses these issues. The approach leads to the ideas of building Information Warehouses (IW) and Knowledge work Support Systems (KwSS). Such systems can open up potential for building innovative applications of significant impact, including those capable of helping organizations in implementing processes for double-loop learning.
△ Less
Submitted 14 October, 2009;
originally announced October 2009.
-
On challenges and opportunities of designing integrated IT platforms for supporting knowledge works in organizations
Authors:
Arijit Laha
Abstract:
Designing and implementing comprehensive IT-based support environments for KM in organizations is fraught with many problems. Solving them requires intimate knowledge about the information usage in knowledge works and the scopes of technology intervention. In this paper, the Task-oriented Organizational Knowledge Management or TOKM, a design theory for building integrated IT platforms for suppor…
▽ More
Designing and implementing comprehensive IT-based support environments for KM in organizations is fraught with many problems. Solving them requires intimate knowledge about the information usage in knowledge works and the scopes of technology intervention. In this paper, the Task-oriented Organizational Knowledge Management or TOKM, a design theory for building integrated IT platforms for supporting organizational KM, is proposed. TOKM brings together two apparently mutually exclusive practices of building KM systems, the task-based approach and the generic or universalistic approach. In developing the design, the information requirements of knowledge workers in light of an information usage model of knowledge works is studied. Then the model is extended to study possibilities of more advanced IT support and formulate them in form of a set of meta-requirements. Following the IS design theory paradigm, a set of artifacts are hypothesized to meet the requirements. Finally, a design method, as a possible approach of building an IT-based integrated platform, the Knowledge Work Support Platform (KWSP) to realize the artifacts in order to meet the requirements, is outlined. The KWSP is a powerful platform for building and maintaining a number of task-type specific Knowledge Work Support Systems (KWSS) on a common sharable platform. Each KWSS, for the task-type supported by it, can be easily designed to provide extensive and sophisticated support to individual as well as group of knowledge workers in performing their respective knowledge work instances
△ Less
Submitted 14 October, 2009;
originally announced October 2009.
