-
Self-Supervised Learning of Dynamic Planar Manipulation of Free-End Cables
Authors:
Jonathan Wang,
Huang Huang,
Vincent Lim,
Harry Zhang,
Jeffrey Ichnowski,
Daniel Seita,
Yunliang Chen,
Ken Goldberg
Abstract:
Dynamic manipulation of free-end cables has applications for cable management in homes, warehouses and manufacturing plants. We present a supervised learning approach for dynamic manipulation of free-end cables, focusing on the problem of getting the cable endpoint to a designated target position, which may lie outside the reachable workspace of the robot end effector. We present a simulator, tune…
▽ More
Dynamic manipulation of free-end cables has applications for cable management in homes, warehouses and manufacturing plants. We present a supervised learning approach for dynamic manipulation of free-end cables, focusing on the problem of getting the cable endpoint to a designated target position, which may lie outside the reachable workspace of the robot end effector. We present a simulator, tune it to closely match experiments with physical cables, and then collect training data for learning dynamic cable manipulation. We evaluate with 3 cables and a physical UR5 robot. Results over 32x5 trials on 3 cables suggest that a physical UR5 robot can attain a median error distance ranging from 22% to 35% of the cable length among cables, outperforming an analytic baseline by 21% and a Gaussian Process baseline by 7% with lower interquartile range (IQR).
△ Less
Submitted 28 May, 2024; v1 submitted 14 May, 2024;
originally announced May 2024.
-
Contrastive Learning in Distilled Models
Authors:
Valerie Lim,
Kai Wen Ng,
Kenneth Lim
Abstract:
Natural Language Processing models like BERT can provide state-of-the-art word embeddings for downstream NLP tasks. However, these models yet to perform well on Semantic Textual Similarity, and may be too large to be deployed as lightweight edge applications. We seek to apply a suitable contrastive learning method based on the SimCSE paper, to a model architecture adapted from a knowledge distilla…
▽ More
Natural Language Processing models like BERT can provide state-of-the-art word embeddings for downstream NLP tasks. However, these models yet to perform well on Semantic Textual Similarity, and may be too large to be deployed as lightweight edge applications. We seek to apply a suitable contrastive learning method based on the SimCSE paper, to a model architecture adapted from a knowledge distillation based model, DistilBERT, to address these two issues. Our final lightweight model DistilFace achieves an average of 72.1 in Spearman's correlation on STS tasks, a 34.2 percent improvement over BERT base.
△ Less
Submitted 22 January, 2024;
originally announced January 2024.
-
Non-Markovianity in photosynthetic reaction centers: A noise-induced quantum coherence perspective
Authors:
Zibo Wang,
Antonio V. Lim,
Imran M. Mirza
Abstract:
The long-standing problem of nearly perfect photosynthetic yield in some types of bacteria and nearly all kinds of plants despite the interaction with a hot and noisy environment has witnessed quantum optical explanations in the last decade or so. Typically in these explanations, photosynthetic reaction centers are modeled as five-level quantum heat engines where the generation of Fano-type interf…
▽ More
The long-standing problem of nearly perfect photosynthetic yield in some types of bacteria and nearly all kinds of plants despite the interaction with a hot and noisy environment has witnessed quantum optical explanations in the last decade or so. Typically in these explanations, photosynthetic reaction centers are modeled as five-level quantum heat engines where the generation of Fano-type interference due to the coupling of discrete state transitions with a common Markovian reservoir is held responsible for the enhancement of the photosynthetic efficiency. In this work, we go beyond the Born-Markov approximation used in the earlier works and study the impact of non-Markovian environments with Lorentzian spectral densities on the dynamics of light-harvesting complexes.
△ Less
Submitted 3 May, 2022; v1 submitted 12 April, 2022;
originally announced April 2022.
-
Policy-Based Bayesian Experimental Design for Non-Differentiable Implicit Models
Authors:
Vincent Lim,
Ellen Novoseller,
Jeffrey Ichnowski,
Huang Huang,
Ken Goldberg
Abstract:
For applications in healthcare, physics, energy, robotics, and many other fields, designing maximally informative experiments is valuable, particularly when experiments are expensive, time-consuming, or pose safety hazards. While existing approaches can sequentially design experiments based on prior observation history, many of these methods do not extend to implicit models, where simulation is po…
▽ More
For applications in healthcare, physics, energy, robotics, and many other fields, designing maximally informative experiments is valuable, particularly when experiments are expensive, time-consuming, or pose safety hazards. While existing approaches can sequentially design experiments based on prior observation history, many of these methods do not extend to implicit models, where simulation is possible but computing the likelihood is intractable. Furthermore, they often require either significant online computation during deployment or a differentiable simulation system. We introduce Reinforcement Learning for Deep Adaptive Design (RL-DAD), a method for simulation-based optimal experimental design for non-differentiable implicit models. RL-DAD extends prior work in policy-based Bayesian Optimal Experimental Design (BOED) by reformulating it as a Markov Decision Process with a reward function based on likelihood-free information lower bounds, which is used to learn a policy via deep reinforcement learning. The learned design policy maps prior histories to experiment designs offline and can be quickly deployed during online execution. We evaluate RL-DAD and find that it performs competitively with baselines on three benchmarks.
△ Less
Submitted 8 March, 2022;
originally announced March 2022.
-
Planar Robot Casting with Real2Sim2Real Self-Supervised Learning
Authors:
Vincent Lim,
Huang Huang,
Lawrence Yunliang Chen,
Jonathan Wang,
Jeffrey Ichnowski,
Daniel Seita,
Michael Laskey,
Ken Goldberg
Abstract:
This paper introduces the task of {\em Planar Robot Casting (PRC)}: where one planar motion of a robot arm holding one end of a cable causes the other end to slide across the plane toward a desired target. PRC allows the cable to reach points beyond the robot workspace and has applications for cable management in homes, warehouses, and factories. To efficiently learn a PRC policy for a given cable…
▽ More
This paper introduces the task of {\em Planar Robot Casting (PRC)}: where one planar motion of a robot arm holding one end of a cable causes the other end to slide across the plane toward a desired target. PRC allows the cable to reach points beyond the robot workspace and has applications for cable management in homes, warehouses, and factories. To efficiently learn a PRC policy for a given cable, we propose Real2Sim2Real, a self-supervised framework that automatically collects physical trajectory examples to tune parameters of a dynamics simulator using Differential Evolution, generates many simulated examples, and then learns a policy using a weighted combination of simulated and physical data. We evaluate Real2Sim2Real with three simulators, Isaac Gym-segmented, Isaac Gym-hybrid, and PyBullet, two function approximators, Gaussian Processes and Neural Networks (NNs), and three cables with differing stiffness, torsion, and friction. Results with 240 physical trials suggest that the PRC policies can attain median error distance (as % of cable length) ranging from 8% to 14%, outperforming baselines and policies trained on only real or only simulated examples. Code, data, and videos are available at https://tinyurl.com/robotcast.
△ Less
Submitted 25 June, 2022; v1 submitted 8 November, 2021;
originally announced November 2021.
-
A matrix math facility for Power ISA(TM) processors
Authors:
José E. Moreira,
Kit Barton,
Steven Battle,
Peter Bergner,
Ramon Bertran,
Puneeth Bhat,
Pedro Caldeira,
David Edelsohn,
Gordon Fossum,
Brad Frey,
Nemanja Ivanovic,
Chip Kerchner,
Vincent Lim,
Shakti Kapoor,
Tulio Machado Filho,
Silvia Melitta Mueller,
Brett Olsson,
Satish Sadasivam,
Baptiste Saleil,
Bill Schmidt,
Rajalakshmi Srinivasaraghavan,
Shricharan Srivatsan,
Brian Thompto,
Andreas Wagner,
Nelson Wu
Abstract:
Power ISA(TM) Version 3.1 has introduced a new family of matrix math instructions, collectively known as the Matrix-Multiply Assist (MMA) facility. The instructions in this facility implement numerical linear algebra operations on small matrices and are meant to accelerate computation-intensive kernels, such as matrix multiplication, convolution and discrete Fourier transform. These instructions h…
▽ More
Power ISA(TM) Version 3.1 has introduced a new family of matrix math instructions, collectively known as the Matrix-Multiply Assist (MMA) facility. The instructions in this facility implement numerical linear algebra operations on small matrices and are meant to accelerate computation-intensive kernels, such as matrix multiplication, convolution and discrete Fourier transform. These instructions have led to a power- and area-efficient implementation of a high throughput math engine in the future POWER10 processor. Performance per core is 4 times better, at constant frequency, than the previous generation POWER9 processor. We also advocate the use of compiler built-ins as the preferred way of leveraging these instructions, which we illustrate through case studies covering matrix multiplication and convolution.
△ Less
Submitted 7 April, 2021;
originally announced April 2021.
-
Current fluctuations in nanopores reveal the polymer-wall adsorption potential
Authors:
Stuart F Knowles,
Nicole E Weckman,
Vincent J Lim,
Douwe J Bonthuis,
Ulrich F Keyser,
Alice L Thorneywork
Abstract:
Modification of surface properties by polymer adsorption is a widely used technique to tune interactions in molecular experiments such as nanopore sensing. Here, we investigate how the ionic current noise through solid-state nanopores reflects the adsorption of short, neutral polymers to the pore surface. The power spectral density of the noise shows a characteristic change upon adsorption of poly…
▽ More
Modification of surface properties by polymer adsorption is a widely used technique to tune interactions in molecular experiments such as nanopore sensing. Here, we investigate how the ionic current noise through solid-state nanopores reflects the adsorption of short, neutral polymers to the pore surface. The power spectral density of the noise shows a characteristic change upon adsorption of polymer, the magnitude of which is strongly dependent on both polymer length and salt concentration. In particular, for short polymers at low salt concentrations no change is observed, despite verification of comparable adsorption in these systems using quartz crystal microbalance measurements. We propose that the characteristic noise is generated by the movement of polymers on and off the surface and perform simulations to assess the feasibility of this model. Excellent agreement with experimental data is obtained using physically motivated simulation parameters, providing deep insight into the shape of the adsorption potential and underlying processes. This paves the way towards using noise spectral analysis for in situ characterisation of functionalised nanopores.
△ Less
Submitted 24 February, 2021; v1 submitted 1 December, 2020;
originally announced December 2020.
-
PlugSonic: a web- and mobile-based platform for binaural audio and sonic narratives
Authors:
Marco Comunità,
Andrea Gerino,
Veranika Lim,
Lorenzo Picinali
Abstract:
PlugSonic is a suite of web- and mobile-based applications for the curation and experience of binaural interactive soundscapes and sonic narratives. It was developed as part of the PLUGGY EU project (Pluggable Social Platform for Heritage Awareness and Participation) and consists of two main applications: PlugSonic Sample, to edit and apply audio effects, and PlugSonic Soundscape, to create and ex…
▽ More
PlugSonic is a suite of web- and mobile-based applications for the curation and experience of binaural interactive soundscapes and sonic narratives. It was developed as part of the PLUGGY EU project (Pluggable Social Platform for Heritage Awareness and Participation) and consists of two main applications: PlugSonic Sample, to edit and apply audio effects, and PlugSonic Soundscape, to create and experience binaural soundscapes. The audio processing within PlugSonic is based on the Web Audio API and the 3D Tune-In Toolkit, while the exploration of soundscapes in a physical space is obtained using Apple's ARKit. In this paper we present the design choices, the user involvement processes and the implementation details. The main goal of PlugSonic is technology democratisation; PlugSonic users - whether institutions or citizens - are all given the instruments needed to create, process and experience 3D soundscapes and sonic narrative; without the need for specific devices, external tools (software and/or hardware), specialised knowledge or custom development. The evaluation, which was conducted with inexperienced users on three tasks - creation, curation and experience - demonstrates how PlugSonic is indeed a simple, effective, yet powerful tool.
△ Less
Submitted 11 August, 2020;
originally announced August 2020.
-
Massive Open and Online Courses and Open Education Resources in Singapore
Authors:
Victor Lim,
Lawrence Wee,
Jessica Teo,
Shannalyn Ng
Abstract:
This paper looks at the increasing popularity of massive open and online courses (MOOCs) and open educational resources (OERs) offered in Singapore. Despite being a relatively new phenomenon, the Singapore government has collaborated with different organizations to improve the quality and accessibility of MOOCs, and many institutions of higher learning (IHLs) are spearheading efforts to improve OE…
▽ More
This paper looks at the increasing popularity of massive open and online courses (MOOCs) and open educational resources (OERs) offered in Singapore. Despite being a relatively new phenomenon, the Singapore government has collaborated with different organizations to improve the quality and accessibility of MOOCs, and many institutions of higher learning (IHLs) are spearheading efforts to improve OERs to facilitate greater public access to educational resources. It will also explore the benefits and potential problems that MOOCs and OERs face. For example, both MOOCs and OERs are able to lower the costs of university-level education and increase public access to such courses. They also provide skills and job training for members of the public as well as encourage lifelong learning. However, both MOOCs and OERs may not be sustainable in the long run, as the financial gains of both may not be able to cover the costs of mounting them. Each system also has its own set of problems. For example, formal structures to guarantee the quality of MOOCs offered remain lacking. MOOCs also tend to have low completion rates and there have been issues regarding plagiarism with the use of MOOCs as learning platforms. OERs pose challenges to traditional copyright policies while lack of sustainable funding prevents them from being adopted more widely. Even though both systems may potentially transform the traditional education system, a deeper understanding of MOOCs and OERs as well as their implications on learning will be useful.
△ Less
Submitted 15 August, 2017;
originally announced August 2017.
-
Autotuning GPU Kernels via Static and Predictive Analysis
Authors:
Robert V. Lim,
Boyana Norris,
Allen D. Malony
Abstract:
Optimizing the performance of GPU kernels is challenging for both human programmers and code generators. For example, CUDA programmers must set thread and block parameters for a kernel, but might not have the intuition to make a good choice. Similarly, compilers can generate working code, but may miss tuning opportunities by not targeting GPU models or performing code transformations. Although emp…
▽ More
Optimizing the performance of GPU kernels is challenging for both human programmers and code generators. For example, CUDA programmers must set thread and block parameters for a kernel, but might not have the intuition to make a good choice. Similarly, compilers can generate working code, but may miss tuning opportunities by not targeting GPU models or performing code transformations. Although empirical autotuning addresses some of these challenges, it requires extensive experimentation and search for optimal code variants. This research presents an approach for tuning CUDA kernels based on static analysis that considers fine-grained code structure and the specific GPU architecture features. Notably, our approach does not require any program runs in order to discover near-optimal parameter settings. We demonstrate the applicability of our approach in enabling code autotuners such as Orio to produce competitive code variants comparable with empirical-based methods, without the high cost of experiments.
△ Less
Submitted 29 June, 2017; v1 submitted 30 January, 2017;
originally announced January 2017.
-
Augmenting Customer Journey Maps with quantitative empirical data: a case on EEG and eye tracking
Authors:
Rui Alves,
Veranika Lim,
Evangelos Niforatos,
Monchu Chen,
Evangelos Karapanos,
Nuno Jardim Nunes
Abstract:
This paper introduces the use of electroencephalography (EEG) and eye tracking in exploring customer experiences in service design. These tools are expected to allow designers to generate customer journeys from empirical data leading to new visualization methods and therefore improvements in service design deliverables.
This paper introduces the use of electroencephalography (EEG) and eye tracking in exploring customer experiences in service design. These tools are expected to allow designers to generate customer journeys from empirical data leading to new visualization methods and therefore improvements in service design deliverables.
△ Less
Submitted 14 September, 2012;
originally announced September 2012.
