Showing 1–19 of 19 results for author: Lebedev, V

Correcting One Error in Non-Binary Channels with Feedback

Authors: Ilya Vorobyev, Vladimir Lebedev, Alexey Lebedev

Abstract: In this paper, the problem of correction of a single error in $q$-ary symmetric channel with noiseless feedback is considered. We propose an algorithm to construct codes with feedback inductively. For all prime power $q$ we prove that two instances of feedback are sufficient to transmit over the $q$-ary symmetric channel the same number of messages as in the case of complete feedback. Our other co… ▽ More In this paper, the problem of correction of a single error in $q$-ary symmetric channel with noiseless feedback is considered. We propose an algorithm to construct codes with feedback inductively. For all prime power $q$ we prove that two instances of feedback are sufficient to transmit over the $q$-ary symmetric channel the same number of messages as in the case of complete feedback. Our other contribution is the construction of codes with one-time feedback with the same parameters as Hamming codes for $q$ that is not a prime power. We also construct single-error-correcting codes with one-time feedback of size $q^{n-2}$ for arbitrary $q$ and $n\leq q+1$, which can be seen as an analog for Reed-Solomon codes. △ Less

Submitted 11 May, 2023; originally announced May 2023.

Correcting one error in channels with feedback

Authors: Ilya Vorobyev, Alexey Lebedev, Vladimir Lebedev, Christian Deppe

Abstract: We address the problem of correcting a single error in an arbitrary discrete memoryless channel with error-free instantaneous feedback. For the case of a one-time feedback, we propose a method for constructing optimal transmission strategies. The obtained result allows us to prove that for a binary channel, two feedbacks are sufficient to transmit the same number of messages as in the case of comp… ▽ More We address the problem of correcting a single error in an arbitrary discrete memoryless channel with error-free instantaneous feedback. For the case of a one-time feedback, we propose a method for constructing optimal transmission strategies. The obtained result allows us to prove that for a binary channel, two feedbacks are sufficient to transmit the same number of messages as in the case of complete feedback. We also apply the developed techniques to a binary asymmetric channel to construct transmission strategies for small lengths. △ Less

Submitted 4 January, 2023; originally announced January 2023.

Non-adaptive and two-stage coding over the Z-channel

Authors: Alexey Lebedev, Ilya Vorobyev, Vladimir Lebedev, Christian Deppe

Abstract: In this paper, we developed new coding strategies for the Z-channel. In particular, we look at the case with two-stage encoding. In this case, the encoder uses noiseless feedback once and adjusts the further encoding strategy based on the previous partial output of the channel. Nevertheless, the developed codes improve the known results with full feedback for small length and 1 error. A tool for t… ▽ More In this paper, we developed new coding strategies for the Z-channel. In particular, we look at the case with two-stage encoding. In this case, the encoder uses noiseless feedback once and adjusts the further encoding strategy based on the previous partial output of the channel. Nevertheless, the developed codes improve the known results with full feedback for small length and 1 error. A tool for the two-stage strategy is the development of a new optimality condition for non-adaptive codes. △ Less

Submitted 8 September, 2022; v1 submitted 31 January, 2022; originally announced February 2022.

Comments: Some references and known results, which were missed in the previous version, have been added

Two-stage coding over the Z-channel

Authors: Alexey Lebedev, Vladimir Lebedev, Nikita Polyanskii

Abstract: In this paper, we discuss two-stage encoding algorithms capable of correcting a fraction of asymmetric errors. Suppose that the encoder transmits $n$ binary symbols $(x_1,\ldots,x_n)$ one-by-one over the Z-channel, in which a 1 is received only if a 1 is transmitted. At some designated moment, say $n_1$, the encoder uses noiseless feedback and adjusts further encoding strategy based on the partial… ▽ More In this paper, we discuss two-stage encoding algorithms capable of correcting a fraction of asymmetric errors. Suppose that the encoder transmits $n$ binary symbols $(x_1,\ldots,x_n)$ one-by-one over the Z-channel, in which a 1 is received only if a 1 is transmitted. At some designated moment, say $n_1$, the encoder uses noiseless feedback and adjusts further encoding strategy based on the partial output of the channel $(y_1,\ldots,y_{n_1})$. The goal is to transmit error-free as much information as possible under the assumption that the total number of errors inflicted by the Z-channel is limited by $τn$, $0<τ<1$. We propose an encoding strategy that uses a list-decodable code at the first stage and a high-error low-rate code at the second stage. This strategy and our converse result yield that there is a sharp transition at $τ=\max\limits_{0<w<1}\frac{w + w^3}{1+4w^3}\approx 0.44$ from positive rate to zero rate for two-stage encoding strategies. As side results, we derive bounds on the size of list-decodable codes for the Z-channel and prove that for a fraction $1/4+ε$ of asymmetric errors, an error-correcting code contains at most $O(ε^{-3/2})$ codewords. △ Less

Submitted 10 January, 2022; v1 submitted 30 October, 2020; originally announced October 2020.

Comments: ten pages, two columns, three figures, one table, published in IEEE Transactions on Information Theory

Algorithms for $q$-ary Error-Correcting Codes with Limited Magnitude and Feedback

Authors: Christian Deppe, Vladimir Lebedev

Abstract: Berlekamp and Zigangirov completely determined the capacity error function for binary error correcting codes with noiseless feedback. It is still an unsolved problem if the upper bound for the capacity error function in the non-binary case of Ahlswede, Lebedev, and Deppe is sharp. We consider wraparound channels with limited magnitude and noiseless feedback. We completely determine the capacity er… ▽ More Berlekamp and Zigangirov completely determined the capacity error function for binary error correcting codes with noiseless feedback. It is still an unsolved problem if the upper bound for the capacity error function in the non-binary case of Ahlswede, Lebedev, and Deppe is sharp. We consider wraparound channels with limited magnitude and noiseless feedback. We completely determine the capacity error function for all $q$-ary wraparound channels with a magnitude of level $r$. All of our algorithms use partial noiseless feedback. Furthermore, a special case of the problem is equivalent to Shannon's zero-error problem. △ Less

Submitted 19 November, 2020; v1 submitted 27 October, 2020; originally announced October 2020.

Self-supervised Depth Denoising Using Lower- and Higher-quality RGB-D sensors

Authors: Akhmedkhan Shabanov, Ilya Krotov, Nikolay Chinaev, Vsevolod Poletaev, Sergei Kozlukov, Igor Pasechnik, Bulat Yakupov, Artsiom Sanakoyeu, Vadim Lebedev, Dmitry Ulyanov

Abstract: Consumer-level depth cameras and depth sensors embedded in mobile devices enable numerous applications, such as AR games and face identification. However, the quality of the captured depth is sometimes insufficient for 3D reconstruction, tracking and other computer vision tasks. In this paper, we propose a self-supervised depth denoising approach to denoise and refine depth coming from a low quali… ▽ More Consumer-level depth cameras and depth sensors embedded in mobile devices enable numerous applications, such as AR games and face identification. However, the quality of the captured depth is sometimes insufficient for 3D reconstruction, tracking and other computer vision tasks. In this paper, we propose a self-supervised depth denoising approach to denoise and refine depth coming from a low quality sensor. We record simultaneous RGB-D sequences with unzynchronized lower- and higher-quality cameras and solve a challenging problem of aligning sequences both temporally and spatially. We then learn a deep neural network to denoise the lower-quality depth using the matched higher-quality data as a source of supervision signal. We experimentally validate our method against state-of-the-art filtering-based and deep denoising techniques and show its application for 3D object reconstruction tasks where our approach leads to more detailed fused surfaces and better tracking. △ Less

Submitted 13 September, 2020; v1 submitted 10 September, 2020; originally announced September 2020.

Journal ref: 2020 International Conference on 3D Vision (3DV)

How to apply the rubber method for channels with feedback

Authors: Christian Deppe, Vladimir Lebedev, Georg Maringer

Abstract: We give an overview of applications of the rubber method. The rubber method is a coding algorithm that was developed in 2005 by Ahlswede, Deppe and Lebedev for channels with feedback. It was a big surprise that an encoding strategy that reserves one symbol exclusively as a rubber can sometimes reach the capacity of a channel. Since then, generalizations of the algorithm have been developed. These… ▽ More We give an overview of applications of the rubber method. The rubber method is a coding algorithm that was developed in 2005 by Ahlswede, Deppe and Lebedev for channels with feedback. It was a big surprise that an encoding strategy that reserves one symbol exclusively as a rubber can sometimes reach the capacity of a channel. Since then, generalizations of the algorithm have been developed. These generalizations can be used for special channels. There are also other ideas for modifying the rubber method. △ Less

Submitted 15 July, 2020; originally announced July 2020.

Comments: arXiv admin note: substantial text overlap with arXiv:2001.09030

Coding with Noiseless Feedback over the Z-channel

Authors: Christian Deppe, Vladimir Lebedev, Georg Maringer, Nikita Polyanskii

Abstract: In this paper, we consider encoding strategies for the Z-channel with noiseless feedback. We analyze the combinatorial setting where the maximum number of errors inflicted by an adversary is proportional to the number of transmissions, which goes to infinity. Without feedback, it is known that the rate of optimal asymmetric-error-correcting codes for the error fraction $τ\ge 1/4$ vanishes as the b… ▽ More In this paper, we consider encoding strategies for the Z-channel with noiseless feedback. We analyze the combinatorial setting where the maximum number of errors inflicted by an adversary is proportional to the number of transmissions, which goes to infinity. Without feedback, it is known that the rate of optimal asymmetric-error-correcting codes for the error fraction $τ\ge 1/4$ vanishes as the blocklength grows. In this paper, we give an efficient feedback encoding scheme with $n$ transmissions that achieves a positive rate for any fraction of errors $τ<1$ and $n\to\infty$. Additionally, we state an upper bound on the rate of asymptotically long feedback asymmetric error-correcting codes. △ Less

Submitted 9 February, 2021; v1 submitted 8 July, 2020; originally announced July 2020.

Comments: 12 pages, 5 figures

Bounds for the capacity error function for unidirectional channels with noiseless feedback

Authors: Christian Deppe, Vladimir Lebedev, Georg Maringer

Abstract: In digital systems such as fiber optical communications, the ratio between probability of errors of type $1\to 0$ and $0 \to 1$ can be large. Practically, one can assume that only one type of error can occur. These errors arecalled asymmetric. Unidirectional errors differ from asymmetric type of errors; here both $1 \to 0$ and $0 \to 1$ type of errors are possible, but in any submittedcodeword all… ▽ More In digital systems such as fiber optical communications, the ratio between probability of errors of type $1\to 0$ and $0 \to 1$ can be large. Practically, one can assume that only one type of error can occur. These errors arecalled asymmetric. Unidirectional errors differ from asymmetric type of errors; here both $1 \to 0$ and $0 \to 1$ type of errors are possible, but in any submittedcodeword all the errors are of the same type. This can be generalized for the $q$-ary case. We consider $q$-ary unidirectional channels with feedback and give bounds for the capacity error function. It turns out that the bounds depend on the parity of the alphabet $q$. Furthermore, we show that for feedback, the capacity error function for the binary asymmetric channel is different from the symmetric channel. This is in contrast to the behavior of the function without feedback. △ Less

Submitted 28 April, 2020; v1 submitted 24 January, 2020; originally announced January 2020.

Comments: 24 pages, short version accepted at ISIT 2020

Precipitation Nowcasting with Satellite Imagery

Authors: Vadim Lebedev, Vladimir Ivashkin, Irina Rudenko, Alexander Ganshin, Alexander Molchanov, Sergey Ovcharenko, Ruslan Grokhovetskiy, Ivan Bushmarinov, Dmitry Solomentsev

Abstract: Precipitation nowcasting is a short-range forecast of rain/snow (up to 2 hours), often displayed on top of the geographical map by the weather service. Modern precipitation nowcasting algorithms rely on the extrapolation of observations by ground-based radars via optical flow techniques or neural network models. Dependent on these radars, typical nowcasting is limited to the regions around their l… ▽ More Precipitation nowcasting is a short-range forecast of rain/snow (up to 2 hours), often displayed on top of the geographical map by the weather service. Modern precipitation nowcasting algorithms rely on the extrapolation of observations by ground-based radars via optical flow techniques or neural network models. Dependent on these radars, typical nowcasting is limited to the regions around their locations. We have developed a method for precipitation nowcasting based on geostationary satellite imagery and incorporated the resulting data into the Yandex.Weather precipitation map (including an alerting service with push notifications for products in the Yandex ecosystem), thus expanding its coverage and paving the way to a truly global nowcasting service. △ Less

Submitted 23 May, 2019; originally announced May 2019.

Comments: Final KDD 2019 version

Journal ref: in Proceedings of The 25th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD 2019

Spatiotemporal Data Fusion for Precipitation Nowcasting

Authors: Vladimir Ivashkin, Vadim Lebedev

Abstract: Precipitation nowcasting using neural networks and ground-based radars has become one of the key components of modern weather prediction services, but it is limited to the regions covered by ground-based radars. Truly global precipitation nowcasting requires fusion of radar and satellite observations. We propose the data fusion pipeline based on computer vision techniques, including novel inpainti… ▽ More Precipitation nowcasting using neural networks and ground-based radars has become one of the key components of modern weather prediction services, but it is limited to the regions covered by ground-based radars. Truly global precipitation nowcasting requires fusion of radar and satellite observations. We propose the data fusion pipeline based on computer vision techniques, including novel inpainting algorithm with soft masking. △ Less

Submitted 28 December, 2018; originally announced December 2018.

Impostor Networks for Fast Fine-Grained Recognition

Authors: Vadim Lebedev, Artem Babenko, Victor Lempitsky

Abstract: In this work we introduce impostor networks, an architecture that allows to perform fine-grained recognition with high accuracy and using a light-weight convolutional network, making it particularly suitable for fine-grained applications on low-power and non-GPU enabled platforms. Impostor networks compensate for the lightness of its `backend' network by combining it with a lightweight non-paramet… ▽ More In this work we introduce impostor networks, an architecture that allows to perform fine-grained recognition with high accuracy and using a light-weight convolutional network, making it particularly suitable for fine-grained applications on low-power and non-GPU enabled platforms. Impostor networks compensate for the lightness of its `backend' network by combining it with a lightweight non-parametric classifier. The combination of a convolutional network and such non-parametric classifier is trained in an end-to-end fashion. Similarly to convolutional neural networks, impostor networks can fit large-scale training datasets very well, while also being able to generalize to new data points. At the same time, the bulk of computations within impostor networks happen through nearest neighbor search in high-dimensions. Such search can be performed efficiently on a variety of architectures including standard CPUs, where deep convolutional networks are inefficient. In a series of experiments with three fine-grained datasets, we show that impostor networks are able to boost the classification accuracy of a moderate-sized convolutional network considerably at a very small computational cost. △ Less

Submitted 13 June, 2018; originally announced June 2018.

Arrow of time and its reversal on IBM quantum computer

Authors: G. B. Lesovik, I. A. Sadovskyy, M. V. Suslov, A. V. Lebedev, V. M. Vinokur

Abstract: Uncovering the origin of the arrow of time remains a fundamental scientific challenge. Within the framework of statistical physics, this problem was inextricably associated with the second law of thermodynamics, which declares that entropy growth proceeds from the system's entanglement with the environment. It remains to be seen, however, whether the irreversibility of time is a fundamental law of… ▽ More Uncovering the origin of the arrow of time remains a fundamental scientific challenge. Within the framework of statistical physics, this problem was inextricably associated with the second law of thermodynamics, which declares that entropy growth proceeds from the system's entanglement with the environment. It remains to be seen, however, whether the irreversibility of time is a fundamental law of nature or whether, on the contrary, it might be circumvented. Here we show that, while in nature the complex conjugation needed for time reversal is exponentially improbable, one can design a quantum algorithm that includes complex conjugation and thus reverses a given quantum state. Using this algorithm on an IBM quantum computer enables us to experimentally demonstrate a backward time dynamics for an electron scattered on a two-level impurity. △ Less

Submitted 23 February, 2018; v1 submitted 28 December, 2017; originally announced December 2017.

Comments: 14 pages, 3 figures

Learnable Visual Markers

Authors: Oleg Grinchuk, Vadim Lebedev, Victor Lempitsky

Abstract: We propose a new approach to designing visual markers (analogous to QR-codes, markers for augmented reality, and robotic fiducial tags) based on the advances in deep generative networks. In our approach, the markers are obtained as color images synthesized by a deep network from input bit strings, whereas another deep network is trained to recover the bit strings back from the photos of these mark… ▽ More We propose a new approach to designing visual markers (analogous to QR-codes, markers for augmented reality, and robotic fiducial tags) based on the advances in deep generative networks. In our approach, the markers are obtained as color images synthesized by a deep network from input bit strings, whereas another deep network is trained to recover the bit strings back from the photos of these markers. The two networks are trained simultaneously in a joint backpropagation process that takes characteristic photometric and geometric distortions associated with marker fabrication and marker scanning into account. Additionally, a stylization loss based on statistics of activations in a pretrained classification network can be inserted into the learning in order to shift the marker appearance towards some texture prototype. In the experiments, we demonstrate that the markers obtained using our approach are capable of retaining bit strings that are long enough to be practical. The ability to automatically adapt markers according to the usage scenario and the desired capacity as well as the ability to combine information encoding with artistic stylization are the unique properties of our approach. As a byproduct, our approach provides an insight on the structure of patterns that are most suitable for recognition by ConvNets and on their ability to distinguish composite patterns. △ Less

Submitted 28 October, 2016; originally announced October 2016.

Comments: NIPS 2016

Texture Networks: Feed-forward Synthesis of Textures and Stylized Images

Authors: Dmitry Ulyanov, Vadim Lebedev, Andrea Vedaldi, Victor Lempitsky

Abstract: Gatys et al. recently demonstrated that deep networks can generate beautiful textures and stylized images from a single texture example. However, their methods requires a slow and memory-consuming optimization process. We propose here an alternative approach that moves the computational burden to a learning stage. Given a single example of a texture, our approach trains compact feed-forward convol… ▽ More Gatys et al. recently demonstrated that deep networks can generate beautiful textures and stylized images from a single texture example. However, their methods requires a slow and memory-consuming optimization process. We propose here an alternative approach that moves the computational burden to a learning stage. Given a single example of a texture, our approach trains compact feed-forward convolutional networks to generate multiple samples of the same texture of arbitrary size and to transfer artistic style from a given image to any other image. The resulting networks are remarkably light-weight and can generate textures of quality comparable to Gatys~et~al., but hundreds of times faster. More generally, our approach highlights the power and flexibility of generative feed-forward models trained with complex and expressive loss functions. △ Less

Submitted 10 March, 2016; originally announced March 2016.

Fast ConvNets Using Group-wise Brain Damage

Authors: Vadim Lebedev, Victor Lempitsky

Abstract: We revisit the idea of brain damage, i.e. the pruning of the coefficients of a neural network, and suggest how brain damage can be modified and used to speedup convolutional layers. The approach uses the fact that many efficient implementations reduce generalized convolutions to matrix multiplications. The suggested brain damage process prunes the convolutional kernel tensor in a group-wise fashio… ▽ More We revisit the idea of brain damage, i.e. the pruning of the coefficients of a neural network, and suggest how brain damage can be modified and used to speedup convolutional layers. The approach uses the fact that many efficient implementations reduce generalized convolutions to matrix multiplications. The suggested brain damage process prunes the convolutional kernel tensor in a group-wise fashion by adding group-sparsity regularization to the standard training process. After such group-wise pruning, convolutions can be reduced to multiplications of thinned dense matrices, which leads to speedup. In the comparison on AlexNet, the method achieves very competitive performance. △ Less

Submitted 7 December, 2015; v1 submitted 8 June, 2015; originally announced June 2015.

Speeding-up Convolutional Neural Networks Using Fine-tuned CP-Decomposition

Authors: Vadim Lebedev, Yaroslav Ganin, Maksim Rakhuba, Ivan Oseledets, Victor Lempitsky

Abstract: We propose a simple two-step approach for speeding up convolution layers within large convolutional neural networks based on tensor decomposition and discriminative fine-tuning. Given a layer, we use non-linear least squares to compute a low-rank CP-decomposition of the 4D convolution kernel tensor into a sum of a small number of rank-one tensors. At the second step, this decomposition is used to… ▽ More We propose a simple two-step approach for speeding up convolution layers within large convolutional neural networks based on tensor decomposition and discriminative fine-tuning. Given a layer, we use non-linear least squares to compute a low-rank CP-decomposition of the 4D convolution kernel tensor into a sum of a small number of rank-one tensors. At the second step, this decomposition is used to replace the original convolutional layer with a sequence of four convolutional layers with small kernels. After such replacement, the entire network is fine-tuned on the training data using standard backpropagation process. We evaluate this approach on two CNNs and show that it is competitive with previous approaches, leading to higher obtained CPU speedups at the cost of lower accuracy drops for the smaller of the two networks. Thus, for the 36-class character classification CNN, our approach obtains a 8.5x CPU speedup of the whole network with only minor accuracy drop (1% from 91% to 90%). For the standard ImageNet architecture (AlexNet), the approach speeds up the second convolution layer by a factor of 4x at the cost of $1\%$ increase of the overall top-5 classification error. △ Less

Submitted 24 April, 2015; v1 submitted 19 December, 2014; originally announced December 2014.

Superimposed Codes and Threshold Group Testing

Authors: A. D'yachkov, V. Rykov, C. Deppe, V. Lebedev

Abstract: We will discuss superimposed codes and non-adaptive group testing designs arising from the potentialities of compressed genotyping models in molecular biology. The given paper was motivated by the 30th anniversary of D'yachkov-Rykov recurrent upper bound on the rate of superimposed codes published in 1982. We were also inspired by recent results obtained for non-adaptive threshold group testing wh… ▽ More We will discuss superimposed codes and non-adaptive group testing designs arising from the potentialities of compressed genotyping models in molecular biology. The given paper was motivated by the 30th anniversary of D'yachkov-Rykov recurrent upper bound on the rate of superimposed codes published in 1982. We were also inspired by recent results obtained for non-adaptive threshold group testing which develop the theory of superimposed codes △ Less

Submitted 29 January, 2014; originally announced January 2014.

Comments: 19 pages, 4 tables

Voltage Collapse and ODE Approach to Power Flows: Analysis of a Feeder Line with Static Disorder in Consumption/Production

Authors: M. Chertkov, S. Backhaus, K. Turtisyn, V. Chernyak, V. Lebedev

Abstract: We consider a model of a distribution feeder connecting multiple loads to the sub-station. Voltage is controlled directly at the head of the line (sub-station), however, voltage anywhere further down the line is subject to fluctuations, caused by irregularities of real and reactive distributed power consumption/generation. The lack of a direct control of voltage along the line may result in the vo… ▽ More We consider a model of a distribution feeder connecting multiple loads to the sub-station. Voltage is controlled directly at the head of the line (sub-station), however, voltage anywhere further down the line is subject to fluctuations, caused by irregularities of real and reactive distributed power consumption/generation. The lack of a direct control of voltage along the line may result in the voltage instability, also called voltage collapse - phenomenon well known and documented in the power engineering literature. Motivated by emerging photo-voltaic technology, which brings a new source of renewable generation but also contributes significant increase in power flow fluctuations, we reexamine the phenomenon of voltage stability and collapse. In the limit where the number of consumers is large and spatial variations in power flows are smooth functions of position along the feeder, we derive a set of the power flow Ordinary Differential Equations (ODE), verify phenomenon of voltage collapse, and study the effect of disorder and irregularity in injection and consumption on the voltage profile by simulating the stochastic ODE. We observe that disorder leads to nonlinear amplification of the voltage variations at the end of the line as the point of voltage collapse is approached. We also find that the disorder, when correlated on a scale sufficiently small compared to the length of the line, self-averages, i.e. the voltage profile remains spatially smooth for any individual realization of the disorder and is correlated only at scales comparable to the length of the line. Finally, we explain why the integrated effect of disorder on the voltage at the end of the line cannot be described within a naive one-generator-one-load model. △ Less

Submitted 24 June, 2011; originally announced June 2011.

Comments: 8 pages, 5 figures

Report number: LANL-LAUR 11-03433