-
INSTRUCTIR: A Benchmark for Instruction Following of Information Retrieval Models
Authors:
Hanseok Oh,
Hyunji Lee,
Seonghyeon Ye,
Haebin Shin,
Hansol Jang,
Changwook Jun,
Minjoon Seo
Abstract:
Despite the critical need to align search targets with users' intention, retrievers often only prioritize query information without delving into the users' intended search context. Enhancing the capability of retrievers to understand intentions and preferences of users, akin to language model instructions, has the potential to yield more aligned search targets. Prior studies restrict the applicati…
▽ More
Despite the critical need to align search targets with users' intention, retrievers often only prioritize query information without delving into the users' intended search context. Enhancing the capability of retrievers to understand intentions and preferences of users, akin to language model instructions, has the potential to yield more aligned search targets. Prior studies restrict the application of instructions in information retrieval to a task description format, neglecting the broader context of diverse and evolving search scenarios. Furthermore, the prevailing benchmarks utilized for evaluation lack explicit tailoring to assess instruction-following ability, thereby hindering progress in this field. In response to these limitations, we propose a novel benchmark,INSTRUCTIR, specifically designed to evaluate instruction-following ability in information retrieval tasks. Our approach focuses on user-aligned instructions tailored to each query instance, reflecting the diverse characteristics inherent in real-world search scenarios. Through experimental analysis, we observe that retrievers fine-tuned to follow task-style instructions, such as INSTRUCTOR, can underperform compared to their non-instruction-tuned counterparts. This underscores potential overfitting issues inherent in constructing retrievers trained on existing instruction-aware retrieval datasets.
△ Less
Submitted 22 February, 2024;
originally announced February 2024.
-
Electrical addressing of exceptional points in compact plasmonic structures
Authors:
Hoon Yeub Jeong,
Yeonsoo Lim,
Jungho Han,
Soo-Chan An,
Young Chul Jun
Abstract:
Exceptional points (EPs) are degenerate singularities in a non-Hermitian system that can be induced by controlling the interaction between resonant photonic modes. EPs can enable unusual optical phenomena and significantly enhance the optical sensitivity under small perturbations. However, most studies thus far have been limited to static photonic structures. In this study, we propose and experime…
▽ More
Exceptional points (EPs) are degenerate singularities in a non-Hermitian system that can be induced by controlling the interaction between resonant photonic modes. EPs can enable unusual optical phenomena and significantly enhance the optical sensitivity under small perturbations. However, most studies thus far have been limited to static photonic structures. In this study, we propose and experimentally demonstrate electrically addressable EP in a plasmonic structure. Inspired by optical microcavity studies, we employ a localized spoof plasmon structure that supports circulating plasmonic modes in a compact single-resonator geometry. The plasmonic modes are perturbed by an angled metal line, and the interaction between the plasmonic modes is electrically controlled using a varactor. Continuous electrical tuning of the varactor capacitance facilitates simultaneous coalescence of the real and imaginary parts of the eigenfrequency, allowing the direct addressing of EPs. We first investigate the eigenmodes and their coupling in localized plasmonic structures using numerical simulations. We then present experimentally measured spectra that manifest the coalescence of the two resonant modes in both the resonance frequency and linewidth. Electrically addressable EPs in compact plasmonic structures may provide exciting opportunities for highly functional and tunable elements in integrated device platforms.
△ Less
Submitted 2 April, 2023;
originally announced April 2023.
-
Chiral electroluminescence from thin-film perovskite metacavities
Authors:
Seongheon Kim,
Soo-Chan An,
Younggon Kim,
Yun Seop Shin,
Alexander A. Antonov,
In Cheol Seo,
Byung Hoon Woo,
Yeonsoo Lim,
Maxim V. Gorkunov,
Yuri S. Kivshar,
Jin Young Kim,
Young Chul Jun
Abstract:
Chiral light sources realized in ultracompact device platforms are highly desirable for various applications. Among active media employed for thin-film emission devices, lead-halide perovskites have been extensively studied for photoluminescence due to their exceptional properties. However, up to date, there have been no demonstrations of chiral electroluminescence with a substantial degree of cir…
▽ More
Chiral light sources realized in ultracompact device platforms are highly desirable for various applications. Among active media employed for thin-film emission devices, lead-halide perovskites have been extensively studied for photoluminescence due to their exceptional properties. However, up to date, there have been no demonstrations of chiral electroluminescence with a substantial degree of circular polarization (DCP), being critical for the development of practical devices. Here, we propose a new concept of chiral light sources based on a thin-film perovskite metacavity and experimentally demonstrate chiral electroluminescence with DCP approaching 0.38. We design a metacavity created by a metal and a dielectric metasurface supporting photonic eigenstates with close-to-maximum chiral response. Chiral cavity modes facilitate asymmetric electroluminescence of pairs of left and right circularly polarized waves propagating in the opposite oblique directions. The proposed ultracompact light sources are especially advantageous for many applications requiring chiral light beams of both helicities.
△ Less
Submitted 10 February, 2023;
originally announced February 2023.
-
Block Selection Method for Using Feature Norm in Out-of-distribution Detection
Authors:
Yeonguk Yu,
Sungho Shin,
Seongju Lee,
Changhyun Jun,
Kyoobin Lee
Abstract:
Detecting out-of-distribution (OOD) inputs during the inference stage is crucial for deploying neural networks in the real world. Previous methods commonly relied on the output of a network derived from the highly activated feature map. In this study, we first revealed that a norm of the feature map obtained from the other block than the last block can be a better indicator of OOD detection. Motiv…
▽ More
Detecting out-of-distribution (OOD) inputs during the inference stage is crucial for deploying neural networks in the real world. Previous methods commonly relied on the output of a network derived from the highly activated feature map. In this study, we first revealed that a norm of the feature map obtained from the other block than the last block can be a better indicator of OOD detection. Motivated by this, we propose a simple framework consisting of FeatureNorm: a norm of the feature map and NormRatio: a ratio of FeatureNorm for ID and OOD to measure the OOD detection performance of each block. In particular, to select the block that provides the largest difference between FeatureNorm of ID and FeatureNorm of OOD, we create Jigsaw puzzle images as pseudo OOD from ID training samples and calculate NormRatio, and the block with the largest value is selected. After the suitable block is selected, OOD detection with the FeatureNorm outperforms other OOD detection methods by reducing FPR95 by up to 52.77% on CIFAR10 benchmark and by up to 48.53% on ImageNet benchmark. We demonstrate that our framework can generalize to various architectures and the importance of block selection, which can improve previous OOD detection methods as well.
△ Less
Submitted 2 March, 2023; v1 submitted 5 December, 2022;
originally announced December 2022.
-
ANNA: Enhanced Language Representation for Question Answering
Authors:
Changwook Jun,
Hansol Jang,
Myoseop Sim,
Hyun Kim,
Jooyoung Choi,
Kyungkoo Min,
Kyunghoon Bae
Abstract:
Pre-trained language models have brought significant improvements in performance in a variety of natural language processing tasks. Most existing models performing state-of-the-art results have shown their approaches in the separate perspectives of data processing, pre-training tasks, neural network modeling, or fine-tuning. In this paper, we demonstrate how the approaches affect performance indiv…
▽ More
Pre-trained language models have brought significant improvements in performance in a variety of natural language processing tasks. Most existing models performing state-of-the-art results have shown their approaches in the separate perspectives of data processing, pre-training tasks, neural network modeling, or fine-tuning. In this paper, we demonstrate how the approaches affect performance individually, and that the language model performs the best results on a specific question answering task when those approaches are jointly considered in pre-training models. In particular, we propose an extended pre-training task, and a new neighbor-aware mechanism that attends neighboring tokens more to capture the richness of context for pre-training language modeling. Our best model achieves new state-of-the-art results of 95.7\% F1 and 90.6\% EM on SQuAD 1.1 and also outperforms existing pre-trained language models such as RoBERTa, ALBERT, ELECTRA, and XLNet on the SQuAD 2.0 benchmark.
△ Less
Submitted 3 April, 2022; v1 submitted 28 March, 2022;
originally announced March 2022.
-
Korean-Specific Dataset for Table Question Answering
Authors:
Changwook Jun,
Jooyoung Choi,
Myoseop Sim,
Hyun Kim,
Hansol Jang,
Kyungkoo Min
Abstract:
Existing question answering systems mainly focus on dealing with text data. However, much of the data produced daily is stored in the form of tables that can be found in documents and relational databases, or on the web. To solve the task of question answering over tables, there exist many datasets for table question answering written in English, but few Korean datasets. In this paper, we demonstr…
▽ More
Existing question answering systems mainly focus on dealing with text data. However, much of the data produced daily is stored in the form of tables that can be found in documents and relational databases, or on the web. To solve the task of question answering over tables, there exist many datasets for table question answering written in English, but few Korean datasets. In this paper, we demonstrate how we construct Korean-specific datasets for table question answering: Korean tabular dataset is a collection of 1.4M tables with corresponding descriptions for unsupervised pre-training language models. Korean table question answering corpus consists of 70k pairs of questions and answers created by crowd-sourced workers. Subsequently, we then build a pre-trained language model based on Transformer and fine-tune the model for table question answering with these datasets. We then report the evaluation results of our model. We make our datasets publicly available via our GitHub repository and hope that those datasets will help further studies for question answering over tables, and for the transformation of table formats.
△ Less
Submitted 1 May, 2022; v1 submitted 17 January, 2022;
originally announced January 2022.
-
Importance of Secure Software Development Processes and Tools for Developers
Authors:
Muhammad Danish Roshaidie,
William Pang Han Liang,
Calvin Goh Kai Jun,
Kok Hong Yew,
Fatima-tuz-Zahra
Abstract:
In this research paper of secure software systems, authors have discussed what the proper development process is when it comes to creating a secure software, which will be suited for developers and relevent stakeholders alike. Secure Software Development Process for Developers is of crucial importance for software engineers as more and more software-based devices are becoming commonly available, a…
▽ More
In this research paper of secure software systems, authors have discussed what the proper development process is when it comes to creating a secure software, which will be suited for developers and relevent stakeholders alike. Secure Software Development Process for Developers is of crucial importance for software engineers as more and more software-based devices are becoming commonly available, and cloud services are evolving which require for the software to be constantly connected to the internet. With this in mind, Secure Software Development needs to be transformed to something most developers can rely upon to make applied software safe and have the capability to mitigate against potential attacks by hackers. Furthermore, in this paper, existing Secure Software Development Process ideas and implementations are reviewed and investigated using the research paper pool available online. Thereafter, an approach is proposed to enhance the security aspect in software development process to resolve security issues. Lastly, the paper concludes with final remarks on practical implementation of security features in software development phases for production of secure and reliable software programs and systems.
△ Less
Submitted 30 December, 2020;
originally announced December 2020.
-
Variable Selection and Task Grouping for Multi-Task Learning
Authors:
Jun-Yong Jeong,
Chi-Hyuck Jun
Abstract:
We consider multi-task learning, which simultaneously learns related prediction tasks, to improve generalization performance. We factorize a coefficient matrix as the product of two matrices based on a low-rank assumption. These matrices have sparsities to simultaneously perform variable selection and learn and overlapping group structure among the tasks. The resulting bi-convex objective function…
▽ More
We consider multi-task learning, which simultaneously learns related prediction tasks, to improve generalization performance. We factorize a coefficient matrix as the product of two matrices based on a low-rank assumption. These matrices have sparsities to simultaneously perform variable selection and learn and overlapping group structure among the tasks. The resulting bi-convex objective function is minimized by alternating optimization where sub-problems are solved using alternating direction method of multipliers and accelerated proximal gradient descent. Moreover, we provide the performance bound of the proposed method. The effectiveness of the proposed method is validated for both synthetic and real-world datasets.
△ Less
Submitted 13 February, 2018;
originally announced February 2018.
-
Time-dependent gradient curves on CAT(0) spaces
Authors:
Chanyoung Jun
Abstract:
This is a preliminary version dated Dec. 2013. It was written independently of [Kim-Masmoudi reference] which uses a similar method. [KM] works with flows in a more general setting and does not mention CAT(K) geometry and gradient curves. There are flows to which our method applies that do not satisfy the conditions in [KM].
This is a preliminary version dated Dec. 2013. It was written independently of [Kim-Masmoudi reference] which uses a similar method. [KM] works with flows in a more general setting and does not mention CAT(K) geometry and gradient curves. There are flows to which our method applies that do not satisfy the conditions in [KM].
△ Less
Submitted 14 January, 2018;
originally announced January 2018.
-
Measurement of the fluorescence quantum yield of bis-MSB
Authors:
Ding Xue Feng,
Wen Liang Jian,
Zhou Xiang,
Ding Ya Yun,
Ye Xing Chen,
Zhou Li,
Liu Meng Chao,
Cai Hao,
Cao Jun
Abstract:
The fluorescence quantum yield of bis-MSB, a widely used liquid scintillator wavelength shifter, was measured to study the photon absorption and re-emission processes in liquid scintillator. The re-emission process affects the photoelectron yield and distribution, especially in a large liquid scintillator detector, thus must be understood to optimize the liquid scintillator for good energy resolut…
▽ More
The fluorescence quantum yield of bis-MSB, a widely used liquid scintillator wavelength shifter, was measured to study the photon absorption and re-emission processes in liquid scintillator. The re-emission process affects the photoelectron yield and distribution, especially in a large liquid scintillator detector, thus must be understood to optimize the liquid scintillator for good energy resolution and to precisely simulate the detector with Monte Carlo. In this study, solutions of different bis-MSB concentration were prepared for absorption and fluorescence emission measurements to cover a broad range of wavelengths. Harmane was used as a standard reference to obtain the absolution fluorescence quantum yield. For the first time we measured the fluorescence quantum yield of bis-MSB up to 430 nm as inputs required by Monte Carlo simulation, which is 0.926$\pm$0.053 at $λ_{\rm ex}$ = 350 nm.
△ Less
Submitted 31 May, 2015;
originally announced June 2015.
-
Directional perfect absorption using deep subwavelength low permittivity films
Authors:
Ting S. Luk,
Salvatore Campione,
Iltai Kim,
Simin Feng,
Young Chul Jun,
Sheng Liu,
Jeremy B. Wright,
Igal Brener,
Peter B. Catrysse,
Shanhui Fan,
Michael B. Sinclair
Abstract:
We experimentally demonstrate single beam directional perfect absorption (to within experimental accuracy) of p-polarized light in the near-infrared using unpatterned, deep subwavelength films of indium tin oxide (ITO) on Ag. The experimental perfect absorption occurs slightly above the epsilon-near-zero (ENZ) frequency of ITO where the permittivity is less than one. Remarkably, we obtain perfect…
▽ More
We experimentally demonstrate single beam directional perfect absorption (to within experimental accuracy) of p-polarized light in the near-infrared using unpatterned, deep subwavelength films of indium tin oxide (ITO) on Ag. The experimental perfect absorption occurs slightly above the epsilon-near-zero (ENZ) frequency of ITO where the permittivity is less than one. Remarkably, we obtain perfect absorption for films whose thickness is as low as ~1/50th of the operating free-space wavelength and whose single pass attenuation is only ~ 5%. We further derive simple analytical conditions for perfect absorption in the subwavelength-film regime that reveal the constraints that the ITO permittivity must satisfy if perfect absorption is to be achieved. Then, to get a physical insight on the perfect absorption properties, we analyze the eigenmodes of the layered structure by computing both the real-frequency/complex-wavenumber and the complex-frequency/real-wavenumber modal dispersion diagrams. These analyses allow us to attribute the experimental perfect absorption behavior to the crossover between bound and leaky behavior of one eigenmode of the layered structure. Both modal methods show that perfect absorption occurs at a frequency slightly larger than the ENZ frequency, in agreement with experimental results, and both methods predict a second perfect absorption condition at higher frequencies attributed to another crossover between bound and leaky behavior of the same eigenmode. Our results greatly expand the list of materials that can be considered for use as ultrathin perfect absorbers and also provide a methodology for the design of absorber systems at any desired frequency.
△ Less
Submitted 24 July, 2014; v1 submitted 21 May, 2014;
originally announced May 2014.
-
Geometric projection-based switching policy for multiple energy harvesting transmitters
Authors:
Chen Hongbin,
Zhou Fangfang,
Cai Jun,
Zhao Feng,
He Qian
Abstract:
Transmitter switching can provide resiliency and robustness to a communication system with multiple energy harvesting transmitters. However, excessive transmitter switching will bring heavy control overhead. In this paper, a geometric projection-based transmitter switching policy is proposed for a communication system with multiple energy harvesting transmitters and one receiver, which can reduce…
▽ More
Transmitter switching can provide resiliency and robustness to a communication system with multiple energy harvesting transmitters. However, excessive transmitter switching will bring heavy control overhead. In this paper, a geometric projection-based transmitter switching policy is proposed for a communication system with multiple energy harvesting transmitters and one receiver, which can reduce the number of switches. The results show that the proposed transmitter switching policy outperforms several heuristic ones.
△ Less
Submitted 19 May, 2014;
originally announced May 2014.
-
Optical Magnetic Mirrors without Metals
Authors:
Sheng Liu,
Michael B. Sinclair,
Thomas S. Mahony,
Young Chul Jun,
Salvatore Campione,
James Ginn,
Daniel A. Bender,
Joel R. Wendt,
Jon F. Ihlefeld,
Paul G. Clem,
Jeremy B. Wright,
Igal Brener
Abstract:
The reflection of an optical wave from a metal, arising from strong interactions between the optical electric field and the free carriers of the metal, is accompanied by a phase reversal of the reflected electric field. A far less common route to achieve high reflectivity exploits strong interactions between the material and the optical magnetic field to produce a magnetic mirror which does not re…
▽ More
The reflection of an optical wave from a metal, arising from strong interactions between the optical electric field and the free carriers of the metal, is accompanied by a phase reversal of the reflected electric field. A far less common route to achieve high reflectivity exploits strong interactions between the material and the optical magnetic field to produce a magnetic mirror which does not reverse the phase of the reflected electric field. At optical frequencies, the magnetic properties required for strong interaction can only be achieved through the use of artificially tailored materials. Here we experimentally demonstrate, for the first time, the magnetic mirror behavior of a low-loss, all-dielectric metasurface at infrared optical frequencies through direct measurements of the phase and amplitude of the reflected optical wave. The enhanced absorption and emission of transverse electric dipoles placed very close to magnetic mirrors can lead to exciting new advances in sensors, photodetectors, and light sources.
△ Less
Submitted 5 March, 2014;
originally announced March 2014.
-
Temperature dependence of the light yield of the LAB-based and mesitylene-based liquid scintillators
Authors:
Xia DongMei,
Yu BoXiang,
Li XiaoBo,
Sun XiLei,
Ding YaYun,
Zhou Li,
Cao Jun,
Hu Wei,
Ye XingCheng,
Chen HaiTao,
Ding XueFeng,
Du Bing
Abstract:
We studied the temperature dependence of the light yield of the linear alkyl benzene (LAB)-based and mesitylene-based liquid scintillators. The light yield increases by 23% for both liquid scintillators when the temperature is lowered from $26\;^{\circ}$C to $-40\;^{\circ }$C, correcting for the temperature response of the photomultiplier tube. The measurements help to understand the energy respon…
▽ More
We studied the temperature dependence of the light yield of the linear alkyl benzene (LAB)-based and mesitylene-based liquid scintillators. The light yield increases by 23% for both liquid scintillators when the temperature is lowered from $26\;^{\circ}$C to $-40\;^{\circ }$C, correcting for the temperature response of the photomultiplier tube. The measurements help to understand the energy response of the liquid scintillator detectors. Especially, the next generation reactor neutrino experiments for neutrino mass hierarchy, such as the Jiangmen Underground Neutrino Observatory (JUNO), require very high energy resolution. As no apparent degradation on the liquid scintillator transparency was observed, lowering the operation temperature of the detector to $\sim4\;^\circ$C will increase the photoelectron yield of the detector by 13%, combining the light yield increase of the liquid scintillator and the quantum efficiency increase of the photomultiplier tubes.
△ Less
Submitted 27 February, 2014;
originally announced February 2014.
-
Ishikawa iteration process on CAT(K) spaces
Authors:
Chanyoung Jun
Abstract:
In this paper, we establish $Δ$-convergence results for Ishikawa iterations in complete CAT(K) spaces.
In this paper, we establish $Δ$-convergence results for Ishikawa iterations in complete CAT(K) spaces.
△ Less
Submitted 26 March, 2013;
originally announced March 2013.
-
Strong Off-Resonant Enhancement of Spontaneous Emission in Metal-Dielectric-Metal Plasmon Waveguide Structures
Authors:
Y. C. Jun,
R. D. Kekapture,
J. S. White,
M. L. Brongersma
Abstract:
We theoretically investigate the spontaneous emission process of an optical, dipolar emitter in metal-dielectric-metal slab and slot waveguide structures. We find that both structures exhibit strong off-resonant emission enhancements due to the tight confinement of modes between two metallic plates. The large enhancement of surface plasmon-polariton excitation enables dipole emission to be prefe…
▽ More
We theoretically investigate the spontaneous emission process of an optical, dipolar emitter in metal-dielectric-metal slab and slot waveguide structures. We find that both structures exhibit strong off-resonant emission enhancements due to the tight confinement of modes between two metallic plates. The large enhancement of surface plasmon-polariton excitation enables dipole emission to be preferentially coupled into plasmon waveguide modes. These structures find applications in creating nanoscale local light sources or in generating guided single plasmons in integrated optical circuits.
△ Less
Submitted 11 August, 2008;
originally announced August 2008.
-
A generalized spatiotemporal covariance model for stationary background in analysis of MEG data
Authors:
S. M. Plis,
D. M. Schmidt,
S. C. Jun,
D. M. Ranken
Abstract:
Using a noise covariance model based on a single Kronecker product of spatial and temporal covariance in the spatiotemporal analysis of MEG data was demonstrated to provide improvement in the results over that of the commonly used diagonal noise covariance model. In this paper we present a model that is a generalization of all of the above models. It describes models based on a single Kronecker…
▽ More
Using a noise covariance model based on a single Kronecker product of spatial and temporal covariance in the spatiotemporal analysis of MEG data was demonstrated to provide improvement in the results over that of the commonly used diagonal noise covariance model. In this paper we present a model that is a generalization of all of the above models. It describes models based on a single Kronecker product of spatial and temporal covariance as well as more complicated multi-pair models together with any intermediate form expressed as a sum of Kronecker products of spatial component matrices of reduced rank and their corresponding temporal covariance matrices. The model provides a framework for controlling the tradeoff between the described complexity of the background and computational demand for the analysis using this model. Ways to estimate the value of the parameter controlling this tradeoff are also discussed
△ Less
Submitted 17 May, 2006;
originally announced May 2006.
-
Modeling spatiotemporal noise covariance for MEG/EEG source analysis
Authors:
S. M. Plis,
J. S. George,
S. C. Jun,
J. Pare-Blagoev,
D. M. Ranken,
D. M. Schmidt,
C. C. Wood
Abstract:
We propose a new model for approximating spatiotemporal noise covariance for use in MEG/EEG source analysis. Our model is an extension of an existing model [1,2] that uses a single Kronecker product of a pair of matrices - temporal and spatial covariance; we employ a series of Kronecker products in order to construct a better approximation of the full covariance. In contrast to the single-pair m…
▽ More
We propose a new model for approximating spatiotemporal noise covariance for use in MEG/EEG source analysis. Our model is an extension of an existing model [1,2] that uses a single Kronecker product of a pair of matrices - temporal and spatial covariance; we employ a series of Kronecker products in order to construct a better approximation of the full covariance. In contrast to the single-pair model that assumes the same temporal structure for all spatial components, the proposed model allows for distinct, independent time courses at each spatial component. This model better describes spatially and temporally correlated background activity. At the same time, inversion of the model is fast which makes it useful in the inverse analysis. We have explored two versions of the model. One is based on orthogonal spatial components of the background. The other, more general model, is based on independent spatial components. Performance of the new and previous models is compared in inverse solutions to a large number of single dipole problems with simulated time courses and background from authentic MEG data.
△ Less
Submitted 20 March, 2006; v1 submitted 8 March, 2005;
originally announced March 2005.
