-
Convolutional Prompting meets Language Models for Continual Learning
Authors:
Anurag Roy,
Riddhiman Moulick,
Vinay K. Verma,
Saptarshi Ghosh,
Abir Das
Abstract:
Continual Learning (CL) enables machine learning models to learn from continuously shifting new training data in absence of data from old tasks. Recently, pretrained vision transformers combined with prompt tuning have shown promise for overcoming catastrophic forgetting in CL. These approaches rely on a pool of learnable prompts which can be inefficient in sharing knowledge across tasks leading t…
▽ More
Continual Learning (CL) enables machine learning models to learn from continuously shifting new training data in absence of data from old tasks. Recently, pretrained vision transformers combined with prompt tuning have shown promise for overcoming catastrophic forgetting in CL. These approaches rely on a pool of learnable prompts which can be inefficient in sharing knowledge across tasks leading to inferior performance. In addition, the lack of fine-grained layer specific prompts does not allow these to fully express the strength of the prompts for CL. We address these limitations by proposing ConvPrompt, a novel convolutional prompt creation mechanism that maintains layer-wise shared embeddings, enabling both layer-specific learning and better concept transfer across tasks. The intelligent use of convolution enables us to maintain a low parameter overhead without compromising performance. We further leverage Large Language Models to generate fine-grained text descriptions of each category which are used to get task similarity and dynamically decide the number of prompts to be learned. Extensive experiments demonstrate the superiority of ConvPrompt and improves SOTA by ~3% with significantly less parameter overhead. We also perform strong ablation over various modules to disentangle the importance of different components.
△ Less
Submitted 29 March, 2024;
originally announced March 2024.
-
Efficient Controlled Quantum Secure Direct Communication Protocols
Authors:
Siddharth Patwardhan,
Subhayan Roy Moulick,
Prasanta K. Panigrahi
Abstract:
We study controlled quantum secure direct communication (CQSDC), a cryptographic scheme where a sender can send a secret bit-string to an intended recipient, without any secure classical channel, who can obtain the complete bit-string only with the permission of a controller. We report an efficient protocol to realize CQSDC using Cluster state and then go on to construct a (2-3)-CQSDC using Brown…
▽ More
We study controlled quantum secure direct communication (CQSDC), a cryptographic scheme where a sender can send a secret bit-string to an intended recipient, without any secure classical channel, who can obtain the complete bit-string only with the permission of a controller. We report an efficient protocol to realize CQSDC using Cluster state and then go on to construct a (2-3)-CQSDC using Brown state, where a coalition of any two of the three controllers is required to retrieve the complete message. We argue both protocols to be unconditionally secure and analyze the efficiency of the protocols to show it to outperform the existing schemes while maintaining the same security specifications.
△ Less
Submitted 6 October, 2015; v1 submitted 19 September, 2015;
originally announced September 2015.
-
Signing Perfect Currency Bonds
Authors:
Subhayan Roy Moulick,
Prasanta K. Panigrahi
Abstract:
We propose the idea of a Quantum Cheque Scheme, a cryptographic protocol in which any legitimate client of a trusted bank can issue a cheque, that cannot be counterfeited or altered in anyway, and can be verified by a bank or any of its branches. We formally define a Quantum Cheque and present the first Unconditionally Secure Quantum Cheque Scheme and show it to be secure against any no-signaling…
▽ More
We propose the idea of a Quantum Cheque Scheme, a cryptographic protocol in which any legitimate client of a trusted bank can issue a cheque, that cannot be counterfeited or altered in anyway, and can be verified by a bank or any of its branches. We formally define a Quantum Cheque and present the first Unconditionally Secure Quantum Cheque Scheme and show it to be secure against any no-signaling adversary. The proposed Quantum Cheque Scheme can been perceived as the quantum analog of Electronic Data Interchange, as an alternate for current e-Payment Gateways.
△ Less
Submitted 6 August, 2015; v1 submitted 20 May, 2015;
originally announced May 2015.
-
Reliable SVD based Semi-blind and Invisible Watermarking Schemes
Authors:
Subhayan Roy Moulick,
Siddharth Arora,
Chirag Jain,
Prasanta K. Panigrahi
Abstract:
A semi-blind watermarking scheme is presented based on Singular Value Decomposition (SVD), which makes essential use of the fact that, the SVD subspace preserves significant amount of information of an image and is a one way decomposition. The principal components are used, along with the corresponding singular vectors of the watermark image to watermark the target image. For further security, the…
▽ More
A semi-blind watermarking scheme is presented based on Singular Value Decomposition (SVD), which makes essential use of the fact that, the SVD subspace preserves significant amount of information of an image and is a one way decomposition. The principal components are used, along with the corresponding singular vectors of the watermark image to watermark the target image. For further security, the semi-blind scheme is extended to an invisible hash based watermarking scheme. The hash based scheme commits a watermark with a key such that, it is incoherent with the actual watermark, and can only be extracted using the key. Its security is analyzed in the random oracle model and shown to be unforgeable, invisible and satisfying the property of non-repudiation.
△ Less
Submitted 6 March, 2015;
originally announced March 2015.
-
Quantum Image Representation Through Two-Dimensional Quantum States and Normalized Amplitude
Authors:
Madhur Srivastava,
Subhayan R. Moulick,
Prasanta K. Panigrahi
Abstract:
We propose a novel method for image representation in quantum computers, which uses the two-dimensional (2-D) quantum states to locate each pixel in an image through row-location and column-location vectors for identifying each pixel location. The quantum state of an image is the linear superposition of the tensor product of the m-qubits row-location vector and the n-qubits column-location vector…
▽ More
We propose a novel method for image representation in quantum computers, which uses the two-dimensional (2-D) quantum states to locate each pixel in an image through row-location and column-location vectors for identifying each pixel location. The quantum state of an image is the linear superposition of the tensor product of the m-qubits row-location vector and the n-qubits column-location vector of each pixel. It enables the natural quantum representation of rectangular images that other methods lack. The amplitude/intensity of each pixel is incorporated into the coefficient values of the pixel's quantum state, without using any qubits. Due to the fact that linear superposition, tensor product and qubits form the fundamental basis of quantum computing, the proposed method presents the machine level representation of images on quantum computers. Unlike other methods, this method is a pure quantum representation without any classical components.
△ Less
Submitted 17 July, 2015; v1 submitted 9 May, 2013;
originally announced May 2013.