Showing 1–29 of 29 results for author: Mukherjee, M

Generalization Bounds for Dependent Data using Online-to-Batch Conversion

Authors: Sagnik Chatterjee, Manuj Mukherjee, Alhad Sethi

Abstract: In this work, we give generalization bounds of statistical learning algorithms trained on samples drawn from a dependent data source, both in expectation and with high probability, using the Online-to-Batch conversion paradigm. We show that the generalization error of statistical learners in the dependent data setting is equivalent to the generalization error of statistical learners in the i.i.d.… ▽ More In this work, we give generalization bounds of statistical learning algorithms trained on samples drawn from a dependent data source, both in expectation and with high probability, using the Online-to-Batch conversion paradigm. We show that the generalization error of statistical learners in the dependent data setting is equivalent to the generalization error of statistical learners in the i.i.d. setting up to a term that depends on the decay rate of the underlying mixing stochastic process and is independent of the complexity of the statistical learner. Our proof techniques involve defining a new notion of stability of online learning algorithms based on Wasserstein distances and employing "near-martingale" concentration bounds for dependent random variables to arrive at appropriate upper bounds for the generalization error of statistical learners trained on dependent data. △ Less

Submitted 22 May, 2024; originally announced May 2024.

A Novel Technique to Parameterize Congestion Control in 6TiSCH IIoT Networks

Authors: Kushal Chakraborty, Aritra Kumar Dutta, Mohammad Avesh Hussain, Syed Raafay Mohiuddin, Nikumani Choudhury, Rakesh Matam, Mithun Mukherjee

Abstract: The Industrial Internet of Things (IIoT) refers to the use of interconnected smart devices, sensors, and other technologies to create a network of intelligent systems that can monitor and manage industrial processes. 6TiSCH (IPv6 over the Time Slotted Channel Hopping mode of IEEE 802.15.4e) as an enabling technology facilitates low-power and low-latency communication between IoT devices in industr… ▽ More The Industrial Internet of Things (IIoT) refers to the use of interconnected smart devices, sensors, and other technologies to create a network of intelligent systems that can monitor and manage industrial processes. 6TiSCH (IPv6 over the Time Slotted Channel Hopping mode of IEEE 802.15.4e) as an enabling technology facilitates low-power and low-latency communication between IoT devices in industrial environments. The Routing Protocol for Low power and lossy networks (RPL), which is used as the de-facto routing protocol for 6TiSCH networks is observed to suffer from several limitations, especially during congestion in the network. Therefore, there is an immediate need for some modifications to the RPL to deal with this problem. Under traffic load which keeps on changing continuously at different instants of time, the proposed mechanism aims at finding the appropriate parent for a node that can forward the packet to the destination through the least congested path with minimal packet loss. This facilitates congestion management under dynamic traffic loads. For this, a new metric for routing using the concept of exponential weighting has been proposed, which takes the number of packets present in the queue of the node into account when choosing the parent at a particular instance of time. Additionally, the paper proposes a parent selection and swapping mechanism for congested networks. Performance evaluations are carried out in order to validate the proposed work. The results show an improvement in the performance of RPL under heavy and dynamic traffic loads. △ Less

Submitted 11 February, 2024; originally announced February 2024.

Comments: The paper has been submitted, accepted, and presented at the 2023 IEEE Global Communications Conference: Next-Generation Networking and Internet, with plans for publication. It was delivered during the IEEE Global Communications Conference held on December 6th, 2023, in Kuala Lumpur, Malaysia

Improved bounds on the interactive capacity via error pattern analysis

Authors: Mudit Aggarwal, Manuj Mukherjee

Abstract: Any interactive protocol between a pair of parties can be reliably simulated in the presence of noise with a multiplicative overhead on the number of rounds (Schulman 1996). The reciprocal of the best (least) overhead is called the interactive capacity of the noisy channel. In this work, we present lower bounds on the interactive capacity of the binary erasure channel. Our lower bound improves t… ▽ More Any interactive protocol between a pair of parties can be reliably simulated in the presence of noise with a multiplicative overhead on the number of rounds (Schulman 1996). The reciprocal of the best (least) overhead is called the interactive capacity of the noisy channel. In this work, we present lower bounds on the interactive capacity of the binary erasure channel. Our lower bound improves the best known bound due to Ben-Yishai et al. 2021 by roughly a factor of 1.75. The improvement is due to a tighter analysis of the correctness of the simulation protocol using error pattern analysis. More precisely, instead of using the well-known technique of bounding the least number of erasures needed to make the simulation fail, we identify and bound the probability of specific erasure patterns causing simulation failure. We remark that error pattern analysis can be useful in solving other problems involving stochastic noise, such as bounding the interactive capacity of different channels. △ Less

Submitted 18 April, 2024; v1 submitted 27 January, 2024; originally announced January 2024.

Comments: Shorter version accepted at ISIT 2024

Optimal storage codes on graphs with fixed locality

Authors: Sabyasachi Basu, Manuj Mukherjee

Abstract: Storage codes on graphs are an instance of \emph{codes with locality}, which are used in distributed storage schemes to provide local repairability. Specifically, the nodes of the graph correspond to storage servers, and the neighbourhood of each server constitute the set of servers it can query to repair its stored data in the event of a failure. A storage code on a graph with $n$-vertices is a s… ▽ More Storage codes on graphs are an instance of \emph{codes with locality}, which are used in distributed storage schemes to provide local repairability. Specifically, the nodes of the graph correspond to storage servers, and the neighbourhood of each server constitute the set of servers it can query to repair its stored data in the event of a failure. A storage code on a graph with $n$-vertices is a set of $n$-length codewords over $\field_q$ where the $i$th codeword symbol is stored in server $i$, and it can be recovered by querying the neighbours of server $i$ according to the underlying graph. In this work, we look at binary storage codes whose repair function is the parity check, and characterise the tradeoff between the locality of the code and its rate. Specifically, we show that the maximum rate of a code on $n$ vertices with locality $r$ is bounded between $1-1/n\lceil n/(r+1)\rceil$ and $1-1/n\lceil n/(r+1)\rceil$. The lower bound on the rate is derived by constructing an explicit family of graphs with locality $r$, while the upper bound is obtained via a lower bound on the binary-field rank of a class of symmetric binary matrices. Our upper bound on maximal rate of a storage code matches the upper bound on the larger class of codes with locality derived by Tamo and Barg. As a corollary to our result, we obtain the following asymptotic separation result: given a sequence $r(n), n\geq 1$, there exists a sequence of graphs on $n$-vertices with storage codes of rate $1-o(1)$ if and only if $r(n)=ω(1)$. △ Less

Submitted 17 July, 2023; originally announced July 2023.

"Medium" LMs of Code in the Era of LLMs: Lessons From StackOverflow

Authors: Manisha Mukherjee, Vincent J. Hellendoorn

Abstract: Large pre-trained neural language models have brought immense progress to both NLP and software engineering. Models in OpenAI's GPT series now dwarf Google's BERT and Meta's RoBERTa, which previously set new benchmarks on a wide range of NLP applications. These models are trained on massive corpora of heterogeneous data from web crawls, which enables them to learn general language patterns and sem… ▽ More Large pre-trained neural language models have brought immense progress to both NLP and software engineering. Models in OpenAI's GPT series now dwarf Google's BERT and Meta's RoBERTa, which previously set new benchmarks on a wide range of NLP applications. These models are trained on massive corpora of heterogeneous data from web crawls, which enables them to learn general language patterns and semantic relationships. However, the largest models are both expensive to train and deploy and are often closed-source, so we lack access to their data and design decisions. We argue that this trend towards large, general-purpose models should be complemented with single-purpose, more modestly sized pre-trained models. In this work, we take StackOverflow (SO) as a domain example in which large volumes of rich aligned code and text data is available. We adopt standard practices for pre-training large language models, including using a very large context size (2,048 tokens), batch size (0.5M tokens) and training set (27B tokens), coupled with a powerful toolkit (Megatron-LM), to train two models: SOBertBase, with 109M parameters, and SOBertLarge with 762M parameters, at a budget of just $\$187$ and $\$800$ each. We compare the performance of our models with both the previous SOTA model trained on SO data exclusively as well general-purpose BERT models and OpenAI's ChatGPT on four SO-specific downstream tasks - question quality prediction, closed question prediction, named entity recognition and obsoletion prediction (a new task we introduce). Not only do our models consistently outperform all baselines, the smaller model is often sufficient for strong results. Both models are released to the public. These results demonstrate that pre-training both extensively and properly on in-domain data can yield a powerful and affordable alternative to leveraging closed-source general-purpose models. △ Less

Submitted 24 January, 2024; v1 submitted 5 June, 2023; originally announced June 2023.

On the Impact of Stable Ranks in Deep Nets

Authors: Bogdan Georgiev, Lukas Franken, Mayukh Mukherjee, Georgios Arvanitidis

Abstract: A recent line of work has established intriguing connections between the generalization/compression properties of a deep neural network (DNN) model and the so-called layer weights' stable ranks. Intuitively, the latter are indicators of the effective number of parameters in the net. In this work, we address some natural questions regarding the space of DNNs conditioned on the layers' stable rank,… ▽ More A recent line of work has established intriguing connections between the generalization/compression properties of a deep neural network (DNN) model and the so-called layer weights' stable ranks. Intuitively, the latter are indicators of the effective number of parameters in the net. In this work, we address some natural questions regarding the space of DNNs conditioned on the layers' stable rank, where we study feed-forward dynamics, initialization, training and expressivity. To this end, we first propose a random DNN model with a new sampling scheme based on stable rank. Then, we show how feed-forward maps are affected by the constraint and how training evolves in the overparametrized regime (via Neural Tangent Kernels). Our results imply that stable ranks appear layerwise essentially as linear factors whose effect accumulates exponentially depthwise. Moreover, we provide empirical analysis suggesting that stable rank initialization alone can lead to convergence speed ups. △ Less

Submitted 5 October, 2021; originally announced October 2021.

Comments: 24 pages, 8 figures, comments welcome!

Reconfigurable Intelligent Surface-assisted Edge Computing to Minimize Delay in Task Offloading

Authors: Mithun Mukherjee, Vikas Kumar, Suman Kumar, Jaime Lloret, Qi Zhang, Mian Guo

Abstract: The advantage of computational resources in edge computing near the data source has kindled growing interest in delay-sensitive Internet of Things (IoT) applications. However, the benefit of the edge server is limited by the uploading and downloading links between end-users and edge servers when these end-users seek computational resources from edge servers. The scenario becomes more severe when t… ▽ More The advantage of computational resources in edge computing near the data source has kindled growing interest in delay-sensitive Internet of Things (IoT) applications. However, the benefit of the edge server is limited by the uploading and downloading links between end-users and edge servers when these end-users seek computational resources from edge servers. The scenario becomes more severe when the user-end's devices are in the shaded region resulting in low uplink/downlink quality. In this paper, we consider a reconfigurable intelligent surface (RIS)-assisted edge computing system, where the benefits of RIS are exploited to improve the uploading transmission rate. We further aim to minimize the delay of worst-case in the network when the end-users either compute task data in their local CPU or offload task data to the edge server. Next, we optimize the uploading bandwidth allocation for every end-user's task data to minimize the maximum delay in the network. The above optimization problem is formulated as quadratically constrained quadratic programming. Afterward, we solve this problem by semidefinite relaxation. Finally, the simulation results demonstrate that the proposed strategy is scalable under various network settings. △ Less

Submitted 15 September, 2021; originally announced September 2021.

Comments: 6 pages, 3 figures, accepted for publication in IEEE GLOBECOM 2021

Powering Effective Climate Communication with a Climate Knowledge Base

Authors: Kameron B. Rodrigues, Shweta Khushu, Mukut Mukherjee, Andrew Banister, Anthony Hevia, Sampath Duddu, Nikita Bhutani

Abstract: While many accept climate change and its growing impacts, few converse about it well, limiting the adoption speed of societal changes necessary to address it. In order to make effective climate communication easier, we aim to build a system that presents to any individual the climate information predicted to best motivate and inspire them to take action given their unique set of personal values. T… ▽ More While many accept climate change and its growing impacts, few converse about it well, limiting the adoption speed of societal changes necessary to address it. In order to make effective climate communication easier, we aim to build a system that presents to any individual the climate information predicted to best motivate and inspire them to take action given their unique set of personal values. To alleviate the cold-start problem, the system relies on a knowledge base (ClimateKB) of causes and effects of climate change, and their associations to personal values. Since no such comprehensive ClimateKB exists, we revisit knowledge base construction techniques and build a ClimateKB from free text. We plan to open source the ClimateKB and associated code to encourage future research and applications. △ Less

Submitted 23 July, 2021; originally announced July 2021.

Collaborative Edge Learning in MIMO-NOMA Uplink Transmission Environment

Authors: Mian Guo, Chun Shan, Mithun Mukherjee, Jaime Lloret, Quansheng Guan

Abstract: Multiple-input multiple-output non-orthogonal multiple access (MIMO-NOMA) cellular network is promising for supporting massive connectivity. This paper exploits low-latency machine learning in the MIMO-NOMA uplink transmission environment, where a substantial amount of data must be uploaded from multiple data sources to a one-hop away edge server for machine learning. A delay-aware edge learning f… ▽ More Multiple-input multiple-output non-orthogonal multiple access (MIMO-NOMA) cellular network is promising for supporting massive connectivity. This paper exploits low-latency machine learning in the MIMO-NOMA uplink transmission environment, where a substantial amount of data must be uploaded from multiple data sources to a one-hop away edge server for machine learning. A delay-aware edge learning framework with the collaboration of data sources, the edge server, and the base station, referred to as DACEL, is proposed. Based on the delay analysis of DACEL, a NOMA channel allocation algorithm is further designed to minimize the learning delay. The simulation results show that the proposed algorithm outperforms the baseline schemes in terms of learning delay reduction. △ Less

Submitted 27 June, 2021; originally announced June 2021.

Comments: 5 pages, 3 figures, accepted for publication in IEEE/CIC ICCC 2021

The Interplay of Reconfigurable Intelligent Surfaces and Mobile Edge Computing in Future Wireless Networks: A Win-Win Strategy to 6G

Authors: Mithun Mukherjee, Vikas Kumar, Mian Guo, Daniel Benevides da Costa, Ertugrul Basar, Zhiguo Ding

Abstract: Reconfigurable intelligent surface (RIS)-empowered communication is being considered as an enabling technology for sixth generation (6G) wireless networks. The key idea of RIS-assisted communication is to enhance the capacity, coverage, energy efficiency, physical layer security, and many other aspects of modern wireless networks. At the same time, mobile edge computing (MEC) has already shown its… ▽ More Reconfigurable intelligent surface (RIS)-empowered communication is being considered as an enabling technology for sixth generation (6G) wireless networks. The key idea of RIS-assisted communication is to enhance the capacity, coverage, energy efficiency, physical layer security, and many other aspects of modern wireless networks. At the same time, mobile edge computing (MEC) has already shown its huge potential by extending the computation, communication, and caching capabilities of a standalone cloud server to the network edge. In this article, we first provide an overview of how MEC and RIS can benefit each other. We envision that the integration of MEC and RIS will bring an unprecedented transformation to the future evolution of wireless networks. We provide a system-level perspective on the MEC-aided RIS (and RIS-assisted MEC) that will evolve wireless network towards 6G. We also outline some of the fundamental challenges that pertain to the implementation of MEC-aided RIS (and RIS-assisted MEC) networks. Finally, the key research trends in the RIS-assisted MEC are discussed. △ Less

Submitted 12 May, 2021; originally announced June 2021.

Multiparty Interactive Coding over Networks of Intersecting Broadcast Links

Authors: Manuj Mukherjee, Ran Gelles

Abstract: We consider computations over networks with multiple broadcast channels that intersect at a single party. Each broadcast link suffers from random bit-flip noise that affects the receivers independently. We design interactive coding schemes that successfully perform any computation over these noisy networks and strive to reduce their communication overhead with respect to the original (noiseless) c… ▽ More We consider computations over networks with multiple broadcast channels that intersect at a single party. Each broadcast link suffers from random bit-flip noise that affects the receivers independently. We design interactive coding schemes that successfully perform any computation over these noisy networks and strive to reduce their communication overhead with respect to the original (noiseless) computation. A simple variant of a coding scheme by Rajagopalan and Schulman (STOC 1994) shows that any (noiseless) protocol of $R$ rounds can be reliably simulated in $O(R\log n)$ rounds over a network with $n=n_1n_2+1$ parties in which a single party is connected to $n_2$ noisy broadcast channels, each of which connects $n_1$ distinct parties. We design new coding schemes with improved overheads. Our approach divides the network into four regimes according to the relationship between $n_1$ and $n_2$. We employ a two-layer coding where the inner code protects each broadcast channel and is tailored to the specific conditions of the regime in consideration. The outer layer protects the computation in the network and is generally based on the scheme of Rajagopalan and Schulman, adapted to the case of broadcast channels. The overhead we obtain ranges from $O(\log\log n_2)$ to $O(\log n_2 \frac{\log\log n_1}{\log n_1})$ and beats the trivial $O(\log n)$ overhead in all four regimes. △ Less

Submitted 4 May, 2021; originally announced May 2021.

Reconfigurable Adaptive Channel Sensing

Authors: Manuj Mukherjee, Aslan Tchamkerten, Chadi Jabbour

Abstract: Channel sensing consists of probing the channel from time to time to check whether or not it is active - say, because of an incoming message. When communication is sparse with information being sent once in a long while, channel sensing becomes a significant source of energy consumption. How to reliably detect messages while minimizing the receiver energy consumption? This paper addresses this pro… ▽ More Channel sensing consists of probing the channel from time to time to check whether or not it is active - say, because of an incoming message. When communication is sparse with information being sent once in a long while, channel sensing becomes a significant source of energy consumption. How to reliably detect messages while minimizing the receiver energy consumption? This paper addresses this problem through a reconfigurable scheme, referred to as AdaSense, which exploits the dependency between the receiver noise figure (i.e., the receiver added noise) and the receiver power consumption; a higher power typically translates into less noisy channel observations. AdaSense begins in a low power low reliability mode and makes a first tentative decision based on a few channel observations. If a message is declared, it switches to a high power high reliability mode to confirm the decision, else it sleeps for the entire duration of the second phase. Compared to prominent detection schemes such as the BMAC protocol, AdaSense provides relative energy gains that grow unbounded in the small probability of false-alarm regime, as communication gets sparser. In the non-asymptotic regime energy gains are 30% to 75% for communication scenarios typically found in the context of wake-up receivers. △ Less

Submitted 26 April, 2021; originally announced April 2021.

SMOTE-ENC: A novel SMOTE-based method to generate synthetic data for nominal and continuous features

Authors: Mimi Mukherjee, Matloob Khushi

Abstract: Real world datasets are heavily skewed where some classes are significantly outnumbered by the other classes. In these situations, machine learning algorithms fail to achieve substantial efficacy while predicting these under-represented instances. To solve this problem, many variations of synthetic minority over-sampling methods (SMOTE) have been proposed to balance the dataset which deals with co… ▽ More Real world datasets are heavily skewed where some classes are significantly outnumbered by the other classes. In these situations, machine learning algorithms fail to achieve substantial efficacy while predicting these under-represented instances. To solve this problem, many variations of synthetic minority over-sampling methods (SMOTE) have been proposed to balance the dataset which deals with continuous features. However, for datasets with both nominal and continuous features, SMOTE-NC is the only SMOTE-based over-sampling technique to balance the data. In this paper, we present a novel minority over-sampling method, SMOTE-ENC (SMOTE - Encoded Nominal and Continuous), in which, nominal features are encoded as numeric values and the difference between two such numeric value reflects the amount of change of association with minority class. Our experiments show that the classification model using SMOTE-ENC method offers better prediction than model using SMOTE-NC when the dataset has a substantial number of nominal features and also when there is some association between the categorical features and the target class. Additionally, our proposed method addressed one of the major limitations of SMOTE-NC algorithm. SMOTE-NC can be applied only on mixed datasets that have features consisting of both continuous and nominal features and cannot function if all the features of the dataset are nominal. Our novel method has been generalized to be applied on both mixed datasets and on nominal only datasets. The code is available from mkhushi.github.io △ Less

Submitted 12 March, 2021; originally announced March 2021.

Journal ref: Appl. Syst. Innov. 2021, 4, 18

Exploring the dynamics of protest against National Register of Citizens & Citizenship Amendment Act through online social media: the Indian experience

Authors: Souvik Roy, Milan Mukherjee, Priyadarsini Sinha, Sukanta Das, Subhasis Bandopadhyay, Abhik Mukherjee

Abstract: The generic fluidity observed in the nature of political protest movements across the world during the last decade weigh heavily with the presence of social media. As such, there is a possibility to study the contemporary movements with an interdisciplinary approach combining computational analytics with social science perspectives. The present study has put efforts to understand such dynamics in… ▽ More The generic fluidity observed in the nature of political protest movements across the world during the last decade weigh heavily with the presence of social media. As such, there is a possibility to study the contemporary movements with an interdisciplinary approach combining computational analytics with social science perspectives. The present study has put efforts to understand such dynamics in the context of the ongoing nationwide movement in India opposing the NRC-CAA enactment. The transformative nature of individual discontent into collective mobilization, especially with a reflective intervention in social media across a sensitive region of the nation state, is presented here with a combination of qualitative (fieldwork) and quantitative (computing) techniques. The study is augmented further by the primary data generation coupled with real-time application of analytical approaches. △ Less

Submitted 21 February, 2021; originally announced February 2021.

Approximating Probability Distributions by ReLU Networks

Authors: Manuj Mukherjee, Aslan Tchamkerten, Mansoor Yousefi

Abstract: How many neurons are needed to approximate a target probability distribution using a neural network with a given input distribution and approximation error? This paper examines this question for the case when the input distribution is uniform, and the target distribution belongs to the class of histogram distributions. We obtain a new upper bound on the number of required neurons, which is strictl… ▽ More How many neurons are needed to approximate a target probability distribution using a neural network with a given input distribution and approximation error? This paper examines this question for the case when the input distribution is uniform, and the target distribution belongs to the class of histogram distributions. We obtain a new upper bound on the number of required neurons, which is strictly better than previously existing upper bounds. The key ingredient in this improvement is an efficient construction of the neural nets representing piecewise linear functions. We also obtain a lower bound on the minimum number of neurons needed to approximate the histogram distributions. △ Less

Submitted 25 January, 2021; originally announced January 2021.

Comments: Longer version of a paper accepted for presentation at the ITW 2020

Heating up decision boundaries: isocapacitory saturation, adversarial scenarios and generalization bounds

Authors: Bogdan Georgiev, Lukas Franken, Mayukh Mukherjee

Abstract: In the present work we study classifiers' decision boundaries via Brownian motion processes in ambient data space and associated probabilistic techniques. Intuitively, our ideas correspond to placing a heat source at the decision boundary and observing how effectively the sample points warm up. We are largely motivated by the search for a soft measure that sheds further light on the decision bound… ▽ More In the present work we study classifiers' decision boundaries via Brownian motion processes in ambient data space and associated probabilistic techniques. Intuitively, our ideas correspond to placing a heat source at the decision boundary and observing how effectively the sample points warm up. We are largely motivated by the search for a soft measure that sheds further light on the decision boundary's geometry. En route, we bridge aspects of potential theory and geometric analysis (Mazya, 2011, Grigoryan-Saloff-Coste, 2002) with active fields of ML research such as adversarial examples and generalization bounds. First, we focus on the geometric behavior of decision boundaries in the light of adversarial attack/defense mechanisms. Experimentally, we observe a certain capacitory trend over different adversarial defense strategies: decision boundaries locally become flatter as measured by isoperimetric inequalities (Ford et al, 2019); however, our more sensitive heat-diffusion metrics extend this analysis and further reveal that some non-trivial geometry invisible to plain distance-based methods is still preserved. Intuitively, we provide evidence that the decision boundaries nevertheless retain many persistent "wiggly and fuzzy" regions on a finer scale. Second, we show how Brownian hitting probabilities translate to soft generalization bounds which are in turn connected to compression and noise stability (Arora et al, 2018), and these bounds are significantly stronger if the decision boundary has controlled geometric features. △ Less

Submitted 15 January, 2021; originally announced January 2021.

Comments: Accepted as conference paper at ICLR 2021. 36 pages, 16 figures, comments welcome!

Multiterminal Secret Key Agreement with Nearly No Discussion

Authors: Chung Chan, Manuj Mukherjee, Praneeth Kumar Vippathalla, Qiaoqiao Zhou

Abstract: We consider the secret key agreement problem under the multiterminal source model proposed by Csiszár and Narayan. A single-letter characterization of the secrecy capacity is desired but remains unknown except in the extreme case with unlimited public discussion and without wiretapper's side information. Taking the problem to the opposite extreme by requiring the public discussion rate to be zero… ▽ More We consider the secret key agreement problem under the multiterminal source model proposed by Csiszár and Narayan. A single-letter characterization of the secrecy capacity is desired but remains unknown except in the extreme case with unlimited public discussion and without wiretapper's side information. Taking the problem to the opposite extreme by requiring the public discussion rate to be zero asymptotically, we obtain the desired characterization under surprisingly general setting with wiretapper's side information, silent users, trusted and untrusted helpers. An immediate consequence of the result is that the capacity with nearly no discussion is the same as the capacity with no discussion, resolving a previous conjecture in the affirmative. The idea of the proof is to characterize the capacity in the special case with neither wiretapper's side information nor untrusted helpers using a multivariate extension of Gács-Körner common information, and then extend the result to the general setting by a change of scenario that turns untrusted helpers into trusted helpers. We further show how to evaluate the capacity explicitly for finite linear sources and discuss how the current result can be extended to improve and unify existing bounds on the capacity for strictly positive discussion rates. △ Less

Submitted 25 April, 2019; originally announced April 2019.

Threats, Protection and Attribution of Cyber Attacks on Critical Infrastructures

Authors: Leandros Maglaras, Mohamed Amine Ferrag, Abdelouahid Derhab, Mithun Mukherjee, Helge Janicke, Stylianos Rallis

Abstract: As Critical National Infrastructures are becoming more vulnerable to cyber attacks, their protection becomes a significant issue for any organization as well as a nation. Moreover, the ability to attribute is a vital element of avoiding impunity in cyberspace. In this article, we present main threats to critical infrastructures along with protective measures that one nation can take, and which are… ▽ More As Critical National Infrastructures are becoming more vulnerable to cyber attacks, their protection becomes a significant issue for any organization as well as a nation. Moreover, the ability to attribute is a vital element of avoiding impunity in cyberspace. In this article, we present main threats to critical infrastructures along with protective measures that one nation can take, and which are classified according to legal, technical, organizational, capacity building, and cooperation aspects. Finally we provide an overview of current methods and practices regarding cyber attribution and cyber peace keeping △ Less

Submitted 12 January, 2019; originally announced January 2019.

Blockchain Technologies for the Internet of Things: Research Issues and Challenges

Authors: Mohamed Amine Ferrag, Makhlouf Derdour, Mithun Mukherjee, Abdelouahid Derhab, Leandros Maglaras, Helge Janicke

Abstract: This paper presents a comprehensive survey of the existing blockchain protocols for the Internet of Things (IoT) networks. We start by describing the blockchains and summarizing the existing surveys that deal with blockchain technologies. Then, we provide an overview of the application domains of blockchain technologies in IoT, e.g, Internet of Vehicles, Internet of Energy, Internet of Cloud, Fog… ▽ More This paper presents a comprehensive survey of the existing blockchain protocols for the Internet of Things (IoT) networks. We start by describing the blockchains and summarizing the existing surveys that deal with blockchain technologies. Then, we provide an overview of the application domains of blockchain technologies in IoT, e.g, Internet of Vehicles, Internet of Energy, Internet of Cloud, Fog computing, etc. Moreover, we provide a classification of threat models, which are considered by blockchain protocols in IoT networks, into five main categories, namely, identity-based attacks, manipulation-based attacks, cryptanalytic attacks, reputation-based attacks, and service-based attacks. In addition, we provide a taxonomy and a side-by-side comparison of the state-of-the-art methods towards secure and privacy-preserving blockchain technologies with respect to the blockchain model, specific security goals, performance, limitations, computation complexity, and communication overhead. Based on the current survey, we highlight open research challenges and discuss possible future research directions in the blockchain technologies for IoT. △ Less

Submitted 24 June, 2018; originally announced June 2018.

Comments: 14 pages, 5 figures

Upper Bounds via Lamination on the Constrained Secrecy Capacity of Hypergraphical Sources

Authors: Chung Chan, Manuj Mukherjee, Navin Kashyap, Qiaoqiao Zhou

Abstract: Hypergraphical sources are a natural class of sources for secret key generation, within which different subsets of terminals sharing secrets are allowed to discuss publicly in order to agree upon a global secret key. While their secrecy capacity, i.e., the maximum rate of a secret key that can be agreed upon by the entire set of terminals, is well-understood, what remains open is the maximum rate… ▽ More Hypergraphical sources are a natural class of sources for secret key generation, within which different subsets of terminals sharing secrets are allowed to discuss publicly in order to agree upon a global secret key. While their secrecy capacity, i.e., the maximum rate of a secret key that can be agreed upon by the entire set of terminals, is well-understood, what remains open is the maximum rate of a secret key that can be generated when there is a restriction on the overall rate of public discussion allowed. In this work, we obtain a family of explicitly computable upper bounds on the number of bits of secret key that can be generated per bit of public discussion. These upper bounds are derived using a lamination technique based on the submodularity of the entropy function. In particular, a specific instance of these upper bounds, called the edge-partition bound, is shown to be tight for the pairwise independent network model, a special case of the hypergraphical source. The secret key generation scheme achieving this upper bound is the tree-packing protocol of Nitinawarat et al., thereby resolving in the affirmative the discussion rate optimality of the tree packing protocol. △ Less

Submitted 3 May, 2018; originally announced May 2018.

Synchronization for Diffusion-based Molecular Communication Systems via Faster Molecules

Authors: Mithun Mukherjee, H. Birkan Yilmaz, Bishanka Brata Bhowmik, Jaime Lloret, Yunrong Lv

Abstract: In this paper, we address the symbol synchronization issue in molecular communication via diffusion (MCvD). Symbol synchronization among chemical sensors and nanomachines is one of the critical challenges to manage complex tasks in the nanonetworks with molecular communication (MC). As in diffusion-based MC, most of the molecules arrive at the receptor closer to the start of the symbol duration, t… ▽ More In this paper, we address the symbol synchronization issue in molecular communication via diffusion (MCvD). Symbol synchronization among chemical sensors and nanomachines is one of the critical challenges to manage complex tasks in the nanonetworks with molecular communication (MC). As in diffusion-based MC, most of the molecules arrive at the receptor closer to the start of the symbol duration, the wrong estimation of the start of the symbol interval leads to a high symbol detection error. By utilizing two types of molecules with different diffusion coefficients we propose a synchronization technique for MCvD. Moreover, we evaluate the symbol-error-rate performance under the proposed symbol synchronization scheme for equal and non-equal symbol duration in MCvD systems. △ Less

Submitted 4 March, 2019; v1 submitted 17 April, 2018; originally announced April 2018.

Comments: Changed title, revised text, IEEE International Conference on Communications (ICC), Shanghai, China, May, 2019

Multiterminal Secret Key Agreement at Asymptotically Zero Discussion Rate

Authors: Chung Chan, Manuj Mukherjee, Navin Kashyap, Qiaoqiao Zhou

Abstract: In the multiterminal secret key agreement problem, a set of users want to discuss with each other until they share a common secret key independent of their discussion. We want to characterize the maximum secret key rate, called the secrecy capacity, asymptotically when the total discussion rate goes to zero. In the case of only two users, the capacity is equal to the Gács-Körner common information… ▽ More In the multiterminal secret key agreement problem, a set of users want to discuss with each other until they share a common secret key independent of their discussion. We want to characterize the maximum secret key rate, called the secrecy capacity, asymptotically when the total discussion rate goes to zero. In the case of only two users, the capacity is equal to the Gács-Körner common information. However, when there are more than two users, the capacity is unknown. It is plausible that a multivariate extension of the Gács-Körner common information is the capacity, however, proving the converse is challenging. We resolved this for the hypergraphical sources and finite linear sources, and provide efficiently computable characterizations. We also give some ideas of extending the techniques to more general source models. △ Less

Submitted 13 February, 2018; originally announced February 2018.

On the Optimality of Secret Key Agreement via Omniscience

Authors: Chung Chan, Manuj Mukherjee, Navin Kashyap, Qiaoqiao Zhou

Abstract: For the multiterminal secret key agreement problem under a private source model, it is known that the maximum key rate, i.e., the secrecy capacity, can be achieved through communication for omniscience, but the omniscience strategy can be strictly suboptimal in terms of minimizing the public discussion rate. While a single-letter characterization is not known for the minimum discussion rate needed… ▽ More For the multiterminal secret key agreement problem under a private source model, it is known that the maximum key rate, i.e., the secrecy capacity, can be achieved through communication for omniscience, but the omniscience strategy can be strictly suboptimal in terms of minimizing the public discussion rate. While a single-letter characterization is not known for the minimum discussion rate needed for achieving the secrecy capacity, we derive single-letter lower and upper bounds that yield some simple conditions for omniscience to be discussion-rate optimal. These conditions turn out to be enough to deduce the optimality of omniscience for a large class of sources including the hypergraphical sources. Through conjectures and examples, we explore other source models to which our methods do not easily extend. △ Less

Submitted 4 January, 2018; v1 submitted 23 February, 2017; originally announced February 2017.

Secret Key Agreement under Discussion Rate Constraints

Authors: Chung Chan, Manuj Mukherjee, Navin Kashyap, Qiaoqiao Zhou

Abstract: For the multiterminal secret key agreement problem, new single-letter lower bounds are obtained on the public discussion rate required to achieve any given secret key rate below the secrecy capacity. The results apply to general source model without helpers or wiretapper's side information but can be strengthened for hypergraphical sources. In particular, for the pairwise independent network, the… ▽ More For the multiterminal secret key agreement problem, new single-letter lower bounds are obtained on the public discussion rate required to achieve any given secret key rate below the secrecy capacity. The results apply to general source model without helpers or wiretapper's side information but can be strengthened for hypergraphical sources. In particular, for the pairwise independent network, the results give rise to a complete characterization of the maximum secret key rate achievable under a constraint on the total discussion rate. △ Less

Submitted 19 January, 2017; v1 submitted 18 January, 2017; originally announced January 2017.

Bounds on the Communication Rate Needed to Achieve SK Capacity in the Hypergraphical Source Model

Authors: Manuj Mukherjee, Chung Chan, Navin Kashyap, Qiaoqiao Zhou

Abstract: In the multiterminal source model of Csisz$\text{á}$r and Narayan, the communication complexity, $R_{\text{SK}}$, for secret key (SK) generation is the minimum rate of communication required to achieve SK capacity. An obvious upper bound to $R_{\text{SK}}$ is given by $R_{\text{CO}}$, which is the minimum rate of communication required for \emph{omniscience}. In this paper we derive a better upper… ▽ More In the multiterminal source model of Csisz$\text{á}$r and Narayan, the communication complexity, $R_{\text{SK}}$, for secret key (SK) generation is the minimum rate of communication required to achieve SK capacity. An obvious upper bound to $R_{\text{SK}}$ is given by $R_{\text{CO}}$, which is the minimum rate of communication required for \emph{omniscience}. In this paper we derive a better upper bound to $R_{\text{SK}}$ for the hypergraphical source model, which is a special instance of the multiterminal source model. The upper bound is based on the idea of fractional removal of hyperedges. It is further shown that this upper bound can be computed in polynomial time. We conjecture that our upper bound is tight. For the special case of a graphical source model, we also give an explicit lower bound on $R_{\text{SK}}$. This bound, however, is not tight, as demonstrated by a counterexample. △ Less

Submitted 28 January, 2016; v1 submitted 20 January, 2016; originally announced January 2016.

Comments: A shorter version has been submitted to IEEE ISIT 2016, Barcelona, Spain

On the Public Communication Needed to Achieve SK Capacity in the Multiterminal Source Model

Authors: Manuj Mukherjee, Navin Kashyap, Yogesh Sankarasubramaniam

Abstract: The focus of this paper is on the public communication required for generating a maximal-rate secret key (SK) within the multiterminal source model of Csisz{á}r and Narayan. Building on the prior work of Tyagi for the two-terminal scenario, we derive a lower bound on the communication complexity, $R_{\text{SK}}$, defined to be the minimum rate of public communication needed to generate a maximal-r… ▽ More The focus of this paper is on the public communication required for generating a maximal-rate secret key (SK) within the multiterminal source model of Csisz{á}r and Narayan. Building on the prior work of Tyagi for the two-terminal scenario, we derive a lower bound on the communication complexity, $R_{\text{SK}}$, defined to be the minimum rate of public communication needed to generate a maximal-rate SK. It is well known that the minimum rate of communication for omniscience, denoted by $R_{\text{CO}}$, is an upper bound on $R_{\text{SK}}$. For the class of pairwise independent network (PIN) models defined on uniform hypergraphs, we show that a certain "Type $\mathcal{S}$" condition, which is verifiable in polynomial time, guarantees that our lower bound on $R_{\text{SK}}$ meets the $R_{\text{CO}}$ upper bound. Thus, PIN models satisfying our condition are $R_{\text{SK}}$-maximal, meaning that the upper bound $R_{\text{SK}} \le R_{\text{CO}}$ holds with equality. This allows us to explicitly evaluate $R_{\text{SK}}$ for such PIN models. We also give several examples of PIN models that satisfy our Type $\mathcal S$ condition. Finally, we prove that for an arbitrary multiterminal source model, a stricter version of our Type $\mathcal S$ condition implies that communication from \emph{all} terminals ("omnivocality") is needed for establishing a SK of maximum rate. For three-terminal source models, the converse is also true: omnivocality is needed for generating a maximal-rate SK only if the strict Type $\mathcal S$ condition is satisfied. Counterexamples exist that show that the converse is not true in general for source models with four or more terminals. △ Less

Submitted 10 July, 2015; originally announced July 2015.

Comments: Submitted to the IEEE Transactions on Information Theory. arXiv admin note: text overlap with arXiv:1504.00629

The communication complexity of achieving SK capacity in a class of PIN models

Authors: Manuj Mukherjee, Navin Kashyap

Abstract: The communication complexity of achieving secret key (SK) capacity in the multiterminal source model of Csisz$á$r and Narayan is the minimum rate of public communication required to generate a maximal-rate SK. It is well known that the minimum rate of communication for omniscience, denoted by $R_{\text{CO}}$, is an upper bound on the communication complexity, denoted by $R_{\text{SK}}$. A source m… ▽ More The communication complexity of achieving secret key (SK) capacity in the multiterminal source model of Csisz$á$r and Narayan is the minimum rate of public communication required to generate a maximal-rate SK. It is well known that the minimum rate of communication for omniscience, denoted by $R_{\text{CO}}$, is an upper bound on the communication complexity, denoted by $R_{\text{SK}}$. A source model for which this upper bound is tight is called $R_{\text{SK}}$-maximal. In this paper, we establish a sufficient condition for $R_{\text{SK}}$-maximality within the class of pairwise independent network (PIN) models defined on hypergraphs. This allows us to compute $R_{\text{SK}}$ exactly within the class of PIN models satisfying this condition. On the other hand, we also provide a counterexample that shows that our condition does not in general guarantee $R_{\text{SK}}$-maximality for sources beyond PIN models. △ Less

Submitted 3 April, 2015; v1 submitted 2 April, 2015; originally announced April 2015.

Achieving SK Capacity in the Source Model: When Must All Terminals Talk?

Authors: Manuj Mukherjee, Navin Kashyap, Yogesh Sankarasubramaniam

Abstract: In this paper, we address the problem of characterizing the instances of the multiterminal source model of Csiszár and Narayan in which communication from all terminals is needed for establishing a secret key of maximum rate. We give an information-theoretic sufficient condition for identifying such instances. We believe that our sufficient condition is in fact an exact characterization, but we ar… ▽ More In this paper, we address the problem of characterizing the instances of the multiterminal source model of Csiszár and Narayan in which communication from all terminals is needed for establishing a secret key of maximum rate. We give an information-theoretic sufficient condition for identifying such instances. We believe that our sufficient condition is in fact an exact characterization, but we are only able to prove this in the case of the three-terminal source model. We also give a relatively simple criterion for determining whether or not our condition holds for a given multiterminal source model. △ Less

Submitted 20 January, 2014; originally announced January 2014.

Comments: A 5-page version of this paper was submitted to the 2014 IEEE International Symposium on Information Theory (ISIT 2014)

On the Communication Complexity of Secret Key Generation in the Multiterminal Source Model

Authors: Manuj Mukherjee, Navin Kashyap

Abstract: Communication complexity refers to the minimum rate of public communication required for generating a maximal-rate secret key (SK) in the multiterminal source model of Csiszar and Narayan. Tyagi recently characterized this communication complexity for a two-terminal system. We extend the ideas in Tyagi's work to derive a lower bound on communication complexity in the general multiterminal setting.… ▽ More Communication complexity refers to the minimum rate of public communication required for generating a maximal-rate secret key (SK) in the multiterminal source model of Csiszar and Narayan. Tyagi recently characterized this communication complexity for a two-terminal system. We extend the ideas in Tyagi's work to derive a lower bound on communication complexity in the general multiterminal setting. In the important special case of the complete graph pairwise independent network (PIN) model, our bound allows us to determine the exact linear communication complexity, i.e., the communication complexity when the communication and SK are restricted to be linear functions of the randomness available at the terminals. △ Less

Submitted 11 January, 2014; v1 submitted 6 January, 2014; originally announced January 2014.

Comments: A 5-page version of this manuscript will be submitted to the 2014 IEEE International Symposium on Information Theory (ISIT 2014)