-
Performance Analysis and ISI Mitigation with Imperfect Transmitter in Molecular Communication
Authors:
Dongliang Jing,
Lin Lin,
Andrew W. Eckford
Abstract:
In molecular communication (MC), molecules are released from the transmitter to convey information. This paper considers a realistic molecule shift keying (MoSK) scenario with two species of molecule in two reservoirs, where the molecules are harvested from the environment and placed into different reservoirs, which are purified by exchanging molecules between the reservoirs. This process consumes…
▽ More
In molecular communication (MC), molecules are released from the transmitter to convey information. This paper considers a realistic molecule shift keying (MoSK) scenario with two species of molecule in two reservoirs, where the molecules are harvested from the environment and placed into different reservoirs, which are purified by exchanging molecules between the reservoirs. This process consumes energy, and for a reasonable energy cost, the reservoirs cannot be pure; thus, our MoSK transmitter is imperfect, releasing mixtures of both molecules for every symbol, resulting in inter-symbol interference (ISI). To mitigate ISI, the properties of the receiver are analyzed and a detection method based on the ratio of different molecules is proposed. Theoretical and simulation results are provided, showing that with the increase of energy cost, the system achieves better performance. The good performance of the proposed detection scheme is also demonstrated.
△ Less
Submitted 2 April, 2024;
originally announced April 2024.
-
Energy Allocation for Multi-User Cooperative Molecular Communication Systems in the Internet of Bio-Nano Things
Authors:
Dongliang Jing,
Lin Lin,
Andrew W. Eckford
Abstract:
Cooperative molecular communication (MC) is a promising technology for facilitating communication between nanomachines in the Internet of Bio-Nano Things (IoBNT) field. However, the performance of IoBNT is limited by the availability of energy for cooperative MC. This paper presents a novel transmitter design scheme that utilizes molecule movement between reservoirs, creating concentration differe…
▽ More
Cooperative molecular communication (MC) is a promising technology for facilitating communication between nanomachines in the Internet of Bio-Nano Things (IoBNT) field. However, the performance of IoBNT is limited by the availability of energy for cooperative MC. This paper presents a novel transmitter design scheme that utilizes molecule movement between reservoirs, creating concentration differences through the consumption of free energy, and encoding information on molecule types. The performance of the transmitter is primarily influenced by energy costs, which directly impact the overall IoBNT system performance. To address this, the paper focuses on optimizing energy allocation in cooperative MC for enhanced transmitter performance. Theoretical analysis is conducted for two transmitters. For scenarios with more than two users, a genetic algorithm is employed in the energy allocation to minimize the total bit error rate (BER). Finally, numerical results show the effectiveness of the proposed energy allocation strategies in the considered cooperative MC system.
△ Less
Submitted 2 April, 2024;
originally announced April 2024.
-
CoTBal: Comprehensive Task Balancing for Multi-Task Visual Instruction Tuning
Authors:
Yanqi Dai,
Dong Jing,
Nanyi Fei,
Zhiwu Lu
Abstract:
Visual instruction tuning is a key training stage of large multimodal models (LMMs). Nevertheless, the common practice of indiscriminately mixing instruction-following data from various tasks may result in suboptimal overall performance due to different instruction formats and knowledge domains across tasks. To mitigate this issue, we propose a novel Comprehensive Task Balancing (CoTBal) algorithm…
▽ More
Visual instruction tuning is a key training stage of large multimodal models (LMMs). Nevertheless, the common practice of indiscriminately mixing instruction-following data from various tasks may result in suboptimal overall performance due to different instruction formats and knowledge domains across tasks. To mitigate this issue, we propose a novel Comprehensive Task Balancing (CoTBal) algorithm for multi-task visual instruction tuning of LMMs. To our knowledge, this is the first work that explores multi-task optimization in visual instruction tuning. Specifically, we consider two key dimensions for task balancing: (1) Inter-Task Contribution, the phenomenon where learning one task potentially enhances the performance in other tasks, attributable to the overlapping knowledge domains, and (2) Intra-Task Difficulty, which refers to the learning difficulty within a single task. By quantifying these two dimensions with performance-based metrics, task balancing is thus enabled by assigning more weights to tasks that offer substantial contributions to others, receive minimal contributions from others, and also have great intra-task difficulties. Experiments show that our CoTBal leads to superior overall performance in multi-task visual instruction tuning.
△ Less
Submitted 7 March, 2024;
originally announced March 2024.
-
Lightweight Channel Codes for ISI Mitigation in Molecular Communication between Bionanosensors
Authors:
Dongliang Jing,
Andrew W. Eckford
Abstract:
Channel memory and inter-symbol interference (ISI) are harmful factors in diffusion-based molecular communication (DBMC) between bionanosensors. To tackle these problems, this paper proposes a lightweight ISI-mitigating coding scheme to improve the system performance by shaping the signal using a constrained code. To characterize the proposed coding scheme theoretically, we derive analytical expre…
▽ More
Channel memory and inter-symbol interference (ISI) are harmful factors in diffusion-based molecular communication (DBMC) between bionanosensors. To tackle these problems, this paper proposes a lightweight ISI-mitigating coding scheme to improve the system performance by shaping the signal using a constrained code. To characterize the proposed coding scheme theoretically, we derive analytical expressions for the bit error rate (BER) and the achievable rate based on Central Limit Theorem. Computer simulations are conducted to verify the accuracy of the theoretical results and demonstrate the superiority of the proposed coding scheme compared with the existing coding schemes.
△ Less
Submitted 23 May, 2023;
originally announced May 2023.
-
Light Field Raindrop Removal via 4D Re-sampling
Authors:
Dong Jing,
Shuo Zhang,
Song Chang,
Youfang Lin
Abstract:
The Light Field Raindrop Removal (LFRR) aims to restore the background areas obscured by raindrops in the Light Field (LF). Compared with single image, the LF provides more abundant information by regularly and densely sampling the scene. Since raindrops have larger disparities than the background in the LF, the majority of texture details occluded by raindrops are visible in other views. In this…
▽ More
The Light Field Raindrop Removal (LFRR) aims to restore the background areas obscured by raindrops in the Light Field (LF). Compared with single image, the LF provides more abundant information by regularly and densely sampling the scene. Since raindrops have larger disparities than the background in the LF, the majority of texture details occluded by raindrops are visible in other views. In this paper, we propose a novel LFRR network by directly utilizing the complementary pixel information of raindrop-free areas in the input raindrop LF, which consists of the re-sampling module and the refinement module. Specifically, the re-sampling module generates a new LF which is less polluted by raindrops through re-sampling position predictions and the proposed 4D interpolation. The refinement module improves the restoration of the completely occluded background areas and corrects the pixel error caused by 4D interpolation. Furthermore, we carefully build the first real scene LFRR dataset for model training and validation. Experiments demonstrate that the proposed method can effectively remove raindrops and achieves state-of-the-art performance in both background restoration and view consistency maintenance.
△ Less
Submitted 26 May, 2022;
originally announced May 2022.
-
An Extended Kalman Filter for Distance Estimation and Power Control in Mobile Molecular Communication
Authors:
Dongliang Jing,
Yongzhao Li,
Andrew W. Eckford
Abstract:
In this paper, we consider a mobile molecular communication (MC) system consisting of two mobile nanomachines, a transmitter and a receiver, propelled by a positive drift velocity and Brownian motion in a realistic blood-vessel-type flow regime. Considering the nonlinear movement of the nanomachines, an extended Kalman filter is employed to estimate the distance from the transmitter. Furthermore,…
▽ More
In this paper, we consider a mobile molecular communication (MC) system consisting of two mobile nanomachines, a transmitter and a receiver, propelled by a positive drift velocity and Brownian motion in a realistic blood-vessel-type flow regime. Considering the nonlinear movement of the nanomachines, an extended Kalman filter is employed to estimate the distance from the transmitter. Furthermore, based on the predicted distance, to keep the number of received molecules for bit 1 at a stable level, we employ power control on the number of transmitted molecules based on the distance between the transmitter and the receiver and the residual molecules in the channel from the previous transmission. Finally, the optimal detection threshold is obtained by minimizing the error probability. It is verified that a fixed optimal detection threshold can be effective for the power control scheme in the mobile MC. The bit error rate (BER) performance of our scheme is verified via simulation results.
△ Less
Submitted 19 May, 2022;
originally announced May 2022.
-
What Can I Do Here? Learning New Skills by Imagining Visual Affordances
Authors:
Alexander Khazatsky,
Ashvin Nair,
Daniel Jing,
Sergey Levine
Abstract:
A generalist robot equipped with learned skills must be able to perform many tasks in many different environments. However, zero-shot generalization to new settings is not always possible. When the robot encounters a new environment or object, it may need to finetune some of its previously learned skills to accommodate this change. But crucially, previously learned behaviors and models should stil…
▽ More
A generalist robot equipped with learned skills must be able to perform many tasks in many different environments. However, zero-shot generalization to new settings is not always possible. When the robot encounters a new environment or object, it may need to finetune some of its previously learned skills to accommodate this change. But crucially, previously learned behaviors and models should still be suitable to accelerate this relearning. In this paper, we aim to study how generative models of possible outcomes can allow a robot to learn visual representations of affordances, so that the robot can sample potentially possible outcomes in new situations, and then further train its policy to achieve those outcomes. In effect, prior data is used to learn what kinds of outcomes may be possible, such that when the robot encounters an unfamiliar setting, it can sample potential outcomes from its model, attempt to reach them, and thereby update both its skills and its outcome model. This approach, visuomotor affordance learning (VAL), can be used to train goal-conditioned policies that operate on raw image inputs, and can rapidly learn to manipulate new objects via our proposed affordance-directed exploration scheme. We show that VAL can utilize prior data to solve real-world tasks such drawer opening, grasping, and placing objects in new scenes with only five minutes of online experience in the new scene.
△ Less
Submitted 12 June, 2021; v1 submitted 1 June, 2021;
originally announced June 2021.
-
Power Control for ISI Mitigation in Mobile Molecular Communication
Authors:
Dongliang Jing,
Yongzhao Li,
Andrew W. Eckford
Abstract:
In mobile molecular communication (MC), inter-symbol interference (ISI) can be mitigated by power control, requiring accurate estimates of the distance from transmitter to receiver. We present two power control strategies based on binary concentration shift keying (BCSK), namely BCSK with power control based on distance (BCSK-d), and BCSK with power control jointly considering distance and residua…
▽ More
In mobile molecular communication (MC), inter-symbol interference (ISI) can be mitigated by power control, requiring accurate estimates of the distance from transmitter to receiver. We present two power control strategies based on binary concentration shift keying (BCSK), namely BCSK with power control based on distance (BCSK-d), and BCSK with power control jointly considering distance and residual molecules in the channel (BCSK-d-RM). Performance of BCSK-d and BCSK-d-RM are analyzed in terms of the bit error rate (BER), the average energy consumption per bit, and the optimal detection threshold. Simulation results show that BCSK-d-RM and BCSK-d outperform BCSK in BER with the varying distance and the number of transmitted molecules. As BCSK-d-RM has higher performance, while BCSK-d has lower complexity, these schemes present a useful design tradeoff for mobile MC.
△ Less
Submitted 27 August, 2020;
originally announced August 2020.
-
A scheme for dynamically integrating C library functions into a $λ$Prolog implementation
Authors:
Duanyang Jing
Abstract:
The Teyjus system realizes the higher-order logic programming language$λ$Prolog by compiling programs into bytecode for an abstract machine and executing this translated form using a simulator for the machine. Teyjus supports a number of builtin relations that are realized through C code. In the current scheme, these relations are realized by including the C programs that implement them within the…
▽ More
The Teyjus system realizes the higher-order logic programming language$λ$Prolog by compiling programs into bytecode for an abstract machine and executing this translated form using a simulator for the machine. Teyjus supports a number of builtin relations that are realized through C code. In the current scheme, these relations are realized by including the C programs that implement them within the simulator and tailoring the compiler to produce instructions to invoke such code. There are two drawbacks to such an approach. First, the entire collection of library functions must be included within the system, thereby leading to a larger than necessary memory footprint. Second, enhancing the collection of built-in predicates requires changing parts of the simulator and compiler, a task whose accomplishment requires specific knowledge of these two subsystems. This project addresses these problems in three steps. First, the code for the builtin functions is moved from the simulator into a library from where relevant parts, determined by information in the bytecode file, are linked into the runtime system at load time. Second, information is associated with each library function about how it can be invoked from a $λ$Prolog program and where the C code for it is to be found. Finally, the compiler is modified to use the preceding information to include relevant linking instructions in the bytecode file and to translate invocations to builtin relations into a special instruction that calls the dynamically linked code. More generally, these ideas are capable of supporting an interface in $λ$Prolog to "foreign functions" implemented in C, a possibility that is also discussed.
△ Less
Submitted 3 June, 2019;
originally announced June 2019.