Showing 1–40 of 40 results for author: Tsuchiya, T

Blockchain Economic Denial of Sustainability Attack: Exploiting Latency Optimization in Ethereum Transaction Forwarding

Authors: Taro Tsuchiya, Liyi Zhou, Kaihua Qin, Arthur Gervais, Nicolas Christin

Abstract: Strategies related to the blockchain concept of Extractable Value (MEV/BEV), such as arbitrage, front- or back-running create an economic incentive for network nodes to reduce latency, including minimizing transaction validation time -- a core feature to secure blockchain networks. A modified node, that neglects to filter invalid transactions in the Ethereum P2P network, introduces novel attack ve… ▽ More Strategies related to the blockchain concept of Extractable Value (MEV/BEV), such as arbitrage, front- or back-running create an economic incentive for network nodes to reduce latency, including minimizing transaction validation time -- a core feature to secure blockchain networks. A modified node, that neglects to filter invalid transactions in the Ethereum P2P network, introduces novel attack vectors. In this work, we formalize and evaluate a Blockchain Economic Denial of Sustainability (EDoS) attack, which can cause financial losses in traffic costs for operators of modified nodes. We 1) mathematically define the attack model, 2) identify thousands of empirical instances of this similar attack in the wild, 3) empirically measure the model parameters from our two monitoring nodes, and 4) conduct attack simulations on the local network to compare its performance with existing Denial-of-Service attacks. We show that an attacker can amplify network traffic at modified nodes by a factor of 3,600, and cause economic damages 13,800 times greater than the amount needed to carry out the attack. Despite these risks, aggressive latency reduction may still be profitable enough to justify the existence of modified nodes. To assess this trade-off, we 1) simulate the transaction validation process in the local network and 2) empirically measure the latency reduction by deploying our modified node in the Ethereum testnet. We conclude with a cost-benefit analysis of skipping validation and provide mitigation strategies against this attack. △ Less

Submitted 2 August, 2024; originally announced August 2024.

A Simple and Adaptive Learning Rate for FTRL in Online Learning with Minimax Regret of $Θ(T^{2/3})$ and its Application to Best-of-Both-Worlds

Authors: Taira Tsuchiya, Shinji Ito

Abstract: Follow-the-Regularized-Leader (FTRL) is a powerful framework for various online learning problems. By designing its regularizer and learning rate to be adaptive to past observations, FTRL is known to work adaptively to various properties of an underlying environment. However, most existing adaptive learning rates are for online learning problems with a minimax regret of $Θ(\sqrt{T})$ for the numbe… ▽ More Follow-the-Regularized-Leader (FTRL) is a powerful framework for various online learning problems. By designing its regularizer and learning rate to be adaptive to past observations, FTRL is known to work adaptively to various properties of an underlying environment. However, most existing adaptive learning rates are for online learning problems with a minimax regret of $Θ(\sqrt{T})$ for the number of rounds $T$, and there are only a few studies on adaptive learning rates for problems with a minimax regret of $Θ(T^{2/3})$, which include several important problems dealing with indirect feedback. To address this limitation, we establish a new adaptive learning rate framework for problems with a minimax regret of $Θ(T^{2/3})$. Our learning rate is designed by matching the stability, penalty, and bias terms that naturally appear in regret upper bounds for problems with a minimax regret of $Θ(T^{2/3})$. As applications of this framework, we consider two major problems dealing with indirect feedback: partial monitoring and graph bandits. We show that FTRL with our learning rate and the Tsallis entropy regularizer improves existing Best-of-Both-Worlds (BOBW) regret upper bounds, which achieve simultaneous optimality in the stochastic and adversarial regimes. The resulting learning rate is surprisingly simple compared to the existing learning rates for BOBW algorithms for problems with a minimax regret of $Θ(T^{2/3})$. △ Less

Submitted 30 May, 2024; originally announced May 2024.

Comments: 31 pages

Adaptive Learning Rate for Follow-the-Regularized-Leader: Competitive Analysis and Best-of-Both-Worlds

Authors: Shinji Ito, Taira Tsuchiya, Junya Honda

Abstract: Follow-The-Regularized-Leader (FTRL) is known as an effective and versatile approach in online learning, where appropriate choice of the learning rate is crucial for smaller regret. To this end, we formulate the problem of adjusting FTRL's learning rate as a sequential decision-making problem and introduce the framework of competitive analysis. We establish a lower bound for the competitive ratio… ▽ More Follow-The-Regularized-Leader (FTRL) is known as an effective and versatile approach in online learning, where appropriate choice of the learning rate is crucial for smaller regret. To this end, we formulate the problem of adjusting FTRL's learning rate as a sequential decision-making problem and introduce the framework of competitive analysis. We establish a lower bound for the competitive ratio and propose update rules for learning rate that achieves an upper bound within a constant factor of this lower bound. Specifically, we illustrate that the optimal competitive ratio is characterized by the (approximate) monotonicity of components of the penalty term, showing that a constant competitive ratio is achievable if the components of the penalty term form a monotonically non-increasing sequence, and derive a tight competitive ratio when penalty terms are $ξ$-approximately monotone non-increasing. Our proposed update rule, referred to as \textit{stability-penalty matching}, also facilitates constructing the Best-Of-Both-Worlds (BOBW) algorithms for stochastic and adversarial environments. In these environments our result contributes to achieve tighter regret bound and broaden the applicability of algorithms for various settings such as multi-armed bandits, graph bandits, linear bandits, and contextual bandits. △ Less

Submitted 10 March, 2024; v1 submitted 1 March, 2024; originally announced March 2024.

Fast Rates in Online Convex Optimization by Exploiting the Curvature of Feasible Sets

Authors: Taira Tsuchiya, Shinji Ito

Abstract: In this paper, we explore online convex optimization (OCO) and introduce a new analysis that provides fast rates by exploiting the curvature of feasible sets. In online linear optimization, it is known that if the average gradient of loss functions is larger than a certain value, the curvature of feasible sets can be exploited by the follow-the-leader (FTL) algorithm to achieve a logarithmic regre… ▽ More In this paper, we explore online convex optimization (OCO) and introduce a new analysis that provides fast rates by exploiting the curvature of feasible sets. In online linear optimization, it is known that if the average gradient of loss functions is larger than a certain value, the curvature of feasible sets can be exploited by the follow-the-leader (FTL) algorithm to achieve a logarithmic regret. This paper reveals that algorithms adaptive to the curvature of loss functions can also leverage the curvature of feasible sets. We first prove that if an optimal decision is on the boundary of a feasible set and the gradient of an underlying loss function is non-zero, then the algorithm achieves a regret upper bound of $O(ρ\log T)$ in stochastic environments. Here, $ρ> 0$ is the radius of the smallest sphere that includes the optimal decision and encloses the feasible set. Our approach, unlike existing ones, can work directly with convex loss functions, exploiting the curvature of loss functions simultaneously, and can achieve the logarithmic regret only with a local property of feasible sets. Additionally, it achieves an $O(\sqrt{T})$ regret even in adversarial environments where FTL suffers an $Ω(T)$ regret, and attains an $O(ρ\log T + \sqrt{C ρ\log T})$ regret bound in corrupted stochastic environments with corruption level $C$. Furthermore, by extending our analysis, we establish a regret upper bound of $O\Big(T^{\frac{q-2}{2(q-1)}} (\log T)^{\frac{q}{2(q-1)}}\Big)$ for $q$-uniformly convex feasible sets, where uniformly convex sets include strongly convex sets and $\ell_p$-balls for $p \in [1,\infty)$. This bound bridges the gap between the $O(\log T)$ regret bound for strongly convex sets ($q=2$) and the $O(\sqrt{T})$ regret bound for non-curved sets ($q\to\infty$). △ Less

Submitted 20 February, 2024; originally announced February 2024.

Comments: 17 pages

Online Control of Linear Systems with Unbounded and Degenerate Noise

Authors: Kaito Ito, Taira Tsuchiya

Abstract: This paper investigates the problem of controlling a linear system under possibly unbounded and degenerate noise with unknown cost functions, known as an online control problem. In contrast to the existing work, which assumes the boundedness of noise, we reveal that for convex costs, an $ \widetilde{O}(\sqrt{T}) $ regret bound can be achieved even for unbounded noise, where $ T $ denotes the time… ▽ More This paper investigates the problem of controlling a linear system under possibly unbounded and degenerate noise with unknown cost functions, known as an online control problem. In contrast to the existing work, which assumes the boundedness of noise, we reveal that for convex costs, an $ \widetilde{O}(\sqrt{T}) $ regret bound can be achieved even for unbounded noise, where $ T $ denotes the time horizon. Moreover, when the costs are strongly convex, we establish an $ O({\rm poly} (\log T)) $ regret bound without the assumption that noise covariance is non-degenerate, which has been required in the literature. The key ingredient in removing the rank assumption on noise is a system transformation associated with the noise covariance. This simultaneously enables the parameter reduction of an online control algorithm. △ Less

Submitted 15 February, 2024; originally announced February 2024.

Comments: 26 pages

Exploration by Optimization with Hybrid Regularizers: Logarithmic Regret with Adversarial Robustness in Partial Monitoring

Authors: Taira Tsuchiya, Shinji Ito, Junya Honda

Abstract: Partial monitoring is a generic framework of online decision-making problems with limited observations. To make decisions from such limited observations, it is necessary to find an appropriate distribution for exploration. Recently, a powerful approach for this purpose, exploration by optimization (ExO), was proposed, which achieves the optimal bounds in adversarial environments with follow-the-re… ▽ More Partial monitoring is a generic framework of online decision-making problems with limited observations. To make decisions from such limited observations, it is necessary to find an appropriate distribution for exploration. Recently, a powerful approach for this purpose, exploration by optimization (ExO), was proposed, which achieves the optimal bounds in adversarial environments with follow-the-regularized-leader for a wide range of online decision-making problems. However, a naive application of ExO in stochastic environments significantly degrades regret bounds. To resolve this problem in locally observable games, we first establish a novel framework and analysis for ExO with a hybrid regularizer. This development allows us to significantly improve the existing regret bounds of best-of-both-worlds (BOBW) algorithms, which achieves nearly optimal bounds both in stochastic and adversarial environments. In particular, we derive a stochastic regret bound of $O(\sum_{a \neq a^*} k^2 m^2 \log T / Δ_a)$, where $k$, $m$, and $T$ are the numbers of actions, observations and rounds, $a^*$ is an optimal action, and $Δ_a$ is the suboptimality gap for action $a$. This bound is roughly $Θ(k^2 \log T)$ times smaller than existing BOBW bounds. In addition, for globally observable games, we provide a new BOBW algorithm with the first $O(\log T)$ stochastic bound. △ Less

Submitted 13 February, 2024; originally announced February 2024.

Comments: 30 pages

Online Structured Prediction with Fenchel--Young Losses and Improved Surrogate Regret for Online Multiclass Classification with Logistic Loss

Authors: Shinsaku Sakaue, Han Bao, Taira Tsuchiya, Taihei Oki

Abstract: This paper studies online structured prediction with full-information feedback. For online multiclass classification, Van der Hoeven (2020) established \emph{finite} surrogate regret bounds, which are independent of the time horizon, by introducing an elegant \emph{exploit-the-surrogate-gap} framework. However, this framework has been limited to multiclass classification primarily because it relie… ▽ More This paper studies online structured prediction with full-information feedback. For online multiclass classification, Van der Hoeven (2020) established \emph{finite} surrogate regret bounds, which are independent of the time horizon, by introducing an elegant \emph{exploit-the-surrogate-gap} framework. However, this framework has been limited to multiclass classification primarily because it relies on a classification-specific procedure for converting estimated scores to outputs. We extend the exploit-the-surrogate-gap framework to online structured prediction with \emph{Fenchel--Young losses}, a large family of surrogate losses that includes the logistic loss for multiclass classification as a special case, obtaining finite surrogate regret bounds in various structured prediction problems. To this end, we propose and analyze \emph{randomized decoding}, which converts estimated scores to general structured outputs. Moreover, by applying our decoding to online multiclass classification with the logistic loss, we obtain a surrogate regret bound of $O(\| \mathbf{U} \|_\mathrm{F}^2)$, where $\mathbf{U}$ is the best offline linear estimator and $\| \cdot \|_\mathrm{F}$ denotes the Frobenius norm. This bound is tight up to logarithmic factors and improves the previous bound of $O(d\| \mathbf{U} \|_\mathrm{F}^2)$ due to Van der Hoeven (2020) by a factor of $d$, the number of classes. △ Less

Submitted 10 June, 2024; v1 submitted 12 February, 2024; originally announced February 2024.

Best-of-Both-Worlds Algorithms for Linear Contextual Bandits

Authors: Yuko Kuroki, Alberto Rumi, Taira Tsuchiya, Fabio Vitale, Nicolò Cesa-Bianchi

Abstract: We study best-of-both-worlds algorithms for $K$-armed linear contextual bandits. Our algorithms deliver near-optimal regret bounds in both the adversarial and stochastic regimes, without prior knowledge about the environment. In the stochastic regime, we achieve the polylogarithmic rate $\frac{(dK)^2\mathrm{poly}\log(dKT)}{Δ_{\min}}$, where $Δ_{\min}$ is the minimum suboptimality gap over the $d$-… ▽ More We study best-of-both-worlds algorithms for $K$-armed linear contextual bandits. Our algorithms deliver near-optimal regret bounds in both the adversarial and stochastic regimes, without prior knowledge about the environment. In the stochastic regime, we achieve the polylogarithmic rate $\frac{(dK)^2\mathrm{poly}\log(dKT)}{Δ_{\min}}$, where $Δ_{\min}$ is the minimum suboptimality gap over the $d$-dimensional context space. In the adversarial regime, we obtain either the first-order $\widetilde{O}(dK\sqrt{L^*})$ bound, or the second-order $\widetilde{O}(dK\sqrt{Λ^*})$ bound, where $L^*$ is the cumulative loss of the best action and $Λ^*$ is a notion of the cumulative second moment for the losses incurred by the algorithm. Moreover, we develop an algorithm based on FTRL with Shannon entropy regularizer that does not require the knowledge of the inverse of the covariance matrix, and achieves a polylogarithmic regret in the stochastic regime while obtaining $\widetilde{O}\big(dK\sqrt{T}\big)$ regret bounds in the adversarial regime. △ Less

Submitted 19 February, 2024; v1 submitted 24 December, 2023; originally announced December 2023.

Comments: Accepted at AISTATS2024

A high-performance deep reservoir computing experimentally demonstrated with ion-gating reservoirs

Authors: Daiki Nishioka, Takashi Tsuchiya, Masataka Imura, Yasuo Koide, Tohru Higuchi, Kazuya Terabe

Abstract: While physical reservoir computing (PRC) is a promising way to achieve low power consumption neuromorphic computing, its computational performance is still insufficient at a practical level. One promising approach to improving PRC performance is deep reservoir computing (deep-RC), in which the component reservoirs are multi-layered. However, all of the deep-RC schemes reported so far have been eff… ▽ More While physical reservoir computing (PRC) is a promising way to achieve low power consumption neuromorphic computing, its computational performance is still insufficient at a practical level. One promising approach to improving PRC performance is deep reservoir computing (deep-RC), in which the component reservoirs are multi-layered. However, all of the deep-RC schemes reported so far have been effective only for simulation reservoirs and limited PRCs, and there have been no reports of nanodevice implementations. Here, as the first nanodevice implementation of Deep-RC, we report a demonstration of deep physical reservoir computing using an ion gating reservoir (IGR), which is a small and high-performance physical reservoir. While previously reported Deep-RC scheme did not improve the performance of IGR, our Deep-IGR achieved a normalized mean squared error of 0.0092 on a second-order nonlinear autoregressive moving average task, with is the best performance of any physical reservoir so far reported. More importantly, the device outperformed full simulation reservoir computing. The dramatic performance improvement of the IGR with our deep-RC architecture paves the way for high-performance, large-scale, physical neural network devices. △ Less

Submitted 11 September, 2023; v1 submitted 6 September, 2023; originally announced September 2023.

Comments: 21 pages, 6 figures

Computational Dating for the Nuzi Cuneiform Archive: The Least Squares Constrained by Family Trees and Synchronisms

Authors: Sumie Ueda, Takashi Tsuchiya, Yoshiaki Itoh

Abstract: We introduce a computational method of dating for an archive in ancient Mesopotamia. We use the name index Nuzi Personal Names (NPN) published in 1943. We made an electronic version of NPN and added the kinships of the two powerful families to NPN to reflect the Nuzi studies after 1943. Nuzi is a town from the 15th - 14th century B.C.E.for a period of some five generations in Arrapha. The cuneifor… ▽ More We introduce a computational method of dating for an archive in ancient Mesopotamia. We use the name index Nuzi Personal Names (NPN) published in 1943. We made an electronic version of NPN and added the kinships of the two powerful families to NPN to reflect the Nuzi studies after 1943. Nuzi is a town from the 15th - 14th century B.C.E.for a period of some five generations in Arrapha. The cuneiform tablets listed in NPN are for contracts on land transactions, marriage, loans, slavery, etc. In NPN, the kinships and cuneiform tablets (contracts, documents, texts) involved are listed for each person. We reconstruct family trees from the added NPN to formulate the least squares problem with the constraints: a person's father is at least 22.5 years older than the person, contractors were living at the time of the contract, etc. Our results agree with the Assyriological results of M. P. Maidman on the seniority among siblings of a powerful family. Our method could be applied to the other clay tablet archives once we have the name index in the format of NPN. △ Less

Submitted 23 August, 2023; originally announced August 2023.

Blockchain Censorship

Authors: Anton Wahrstätter, Jens Ernstberger, Aviv Yaish, Liyi Zhou, Kaihua Qin, Taro Tsuchiya, Sebastian Steinhorst, Davor Svetinovic, Nicolas Christin, Mikolaj Barczentewicz, Arthur Gervais

Abstract: Permissionless blockchains promise to be resilient against censorship by a single entity. This suggests that deterministic rules, and not third-party actors, are responsible for deciding if a transaction is appended to the blockchain or not. In 2022, the U.S. Office of Foreign Assets Control (OFAC) sanctioned a Bitcoin mixer and an Ethereum application, putting the neutrality of permissionless blo… ▽ More Permissionless blockchains promise to be resilient against censorship by a single entity. This suggests that deterministic rules, and not third-party actors, are responsible for deciding if a transaction is appended to the blockchain or not. In 2022, the U.S. Office of Foreign Assets Control (OFAC) sanctioned a Bitcoin mixer and an Ethereum application, putting the neutrality of permissionless blockchains to the test. In this paper, we formalize quantify and analyze the security impact of blockchain censorship. We start by defining censorship, followed by a quantitative assessment of current censorship practices. We find that 46% of Ethereum blocks were made by censoring actors that intend to comply with OFAC sanctions, indicating the significant impact of OFAC sanctions on the neutrality of public blockchains. We further uncover that censorship not only impacts neutrality, but also security. We show how after Ethereum's move to Proof-of-Stake (PoS) and adoption of Proposer-Builder Separation (PBS) the inclusion of censored transactions was delayed by an average of 85%. Inclusion delays compromise a transaction's security by, e.g., strengthening a sandwich adversary. Finally we prove a fundamental limitation of PoS and Proof-of-Work (PoW) protocols against censorship resilience. △ Less

Submitted 2 June, 2023; v1 submitted 29 May, 2023; originally announced May 2023.

Stability-penalty-adaptive follow-the-regularized-leader: Sparsity, game-dependency, and best-of-both-worlds

Authors: Taira Tsuchiya, Shinji Ito, Junya Honda

Abstract: Adaptivity to the difficulties of a problem is a key property in sequential decision-making problems to broaden the applicability of algorithms. Follow-the-regularized-leader (FTRL) has recently emerged as one of the most promising approaches for obtaining various types of adaptivity in bandit problems. Aiming to further generalize this adaptivity, we develop a generic adaptive learning rate, call… ▽ More Adaptivity to the difficulties of a problem is a key property in sequential decision-making problems to broaden the applicability of algorithms. Follow-the-regularized-leader (FTRL) has recently emerged as one of the most promising approaches for obtaining various types of adaptivity in bandit problems. Aiming to further generalize this adaptivity, we develop a generic adaptive learning rate, called stability-penalty-adaptive (SPA) learning rate for FTRL. This learning rate yields a regret bound jointly depending on stability and penalty of the algorithm, into which the regret of FTRL is typically decomposed. With this result, we establish several algorithms with three types of adaptivity: sparsity, game-dependency, and best-of-both-worlds (BOBW). Despite the fact that sparsity appears frequently in real problems, existing sparse multi-armed bandit algorithms with $k$-arms assume that the sparsity level $s \leq k$ is known in advance, which is often not the case in real-world scenarios. To address this issue, we first establish $s$-agnostic algorithms with regret bounds of $\tilde{O}(\sqrt{sT})$ in the adversarial regime for $T$ rounds, which matches the existing lower bound up to a logarithmic factor. Meanwhile, BOBW algorithms aim to achieve a near-optimal regret in both the stochastic and adversarial regimes. Leveraging the SPA learning rate and the technique for $s$-agnostic algorithms combined with a new analysis to bound the variation in FTRL output in response to changes in a regularizer, we establish the first BOBW algorithm with a sparsity-dependent bound. Additionally, we explore partial monitoring and demonstrate that the proposed SPA learning rate framework allows us to achieve a game-dependent bound and the BOBW simultaneously. △ Less

Submitted 13 February, 2024; v1 submitted 26 May, 2023; originally announced May 2023.

Comments: Published version in Advances in Neural Information Processing Systems 36 (NeurIPS 2023), 32 pages

Build a training interface to install the bat's echolocation skills in humans

Authors: Miyoko Tsumaki, Yu Teshima, Takao Tsuchiya, Kaoru Ashihara, Kohta I. Kobayasi, Shizuko Hiryu

Abstract: Bats use a sophisticated ultrasonic sensing method called echolocation to recognize the environment. Recently, it has been reported that sighted human participants with no prior experience in echolocation can improve their ability to perceive the spatial layout of various environments through training to listen to echoes (Norman, et al., 2021). In this study, we developed the new training system f… ▽ More Bats use a sophisticated ultrasonic sensing method called echolocation to recognize the environment. Recently, it has been reported that sighted human participants with no prior experience in echolocation can improve their ability to perceive the spatial layout of various environments through training to listen to echoes (Norman, et al., 2021). In this study, we developed the new training system for human echolocation using the eye-tracker. Binaural echoes of consecutive downward linear FM pulses that were inspired by feeding strategies of echolocating bats were simulated using the wave equation finite difference time domain method. The virtual echoes were presented to the sighted subject in response to his or her eye movements on the monitor. The latency from eye gazing to the echo presentation wasn't audible delay to perceive. In a preliminary experiment in which the participants were asked to identify the shapes of the hidden target, the participants were found to concentrate their gaze on the edges of the hidden target on the monitor. We will conduct a psycho-acoustical experiment to examine the learning process of human echolocation in a shape-identification task, which will lead to device development in the field of welfare engineering. △ Less

Submitted 17 February, 2023; originally announced February 2023.

Comments: 4 pages, 3 figures

Finding Critical Nodes in Interdependent Networks with SAT and ILP Solvers

Authors: Kyozo Hida, Tatsuhiro Tsuchiya

Abstract: Infrastructure systems, such as power systems, often experience cascading failures. Modeling an infrastructure system as a collection of interdependent networks has recently received attention as a way to explain cascading failures. In this study, we propose an approach to find the set of critical nodes in an interdependent network. For an integer k, we say that a set of k nodes is critical if the… ▽ More Infrastructure systems, such as power systems, often experience cascading failures. Modeling an infrastructure system as a collection of interdependent networks has recently received attention as a way to explain cascading failures. In this study, we propose an approach to find the set of critical nodes in an interdependent network. For an integer k, we say that a set of k nodes is critical if the initial failures of these k nodes result in the most severe cascading failure among all sets of k nodes. This approach adopts the seminal model of interdependent networks proposed by Buldyrev et al., in which new link failures occur in a network if the connectivity is lost in the paired network. The problem of finding critical nodes is NP-hard; thus the aim of the approach is to accurately solve the problem in feasible time for moderate-size problem instances. The proposed approach consists of two phases. In the first phase, the maximum number of failure propagation stages is computed by repeatedly solving the Boolean satisfiability problem. This number is then used in the second phase, where the set of critical nodes is computed using integer linear programming. The results of applying this approach to a variety of problem instances demonstrate that the approach is feasible for up to at least 30 nodes and can be used as the baseline to compare the performance of heuristic solutions. △ Less

Submitted 10 November, 2022; originally announced November 2022.

Best-of-Both-Worlds Algorithms for Partial Monitoring

Authors: Taira Tsuchiya, Shinji Ito, Junya Honda

Abstract: This study considers the partial monitoring problem with $k$-actions and $d$-outcomes and provides the first best-of-both-worlds algorithms, whose regrets are favorably bounded both in the stochastic and adversarial regimes. In particular, we show that for non-degenerate locally observable games, the regret is $O(m^2 k^4 \log(T) \log(k_Π T) / Δ_{\min})$ in the stochastic regime and… ▽ More This study considers the partial monitoring problem with $k$-actions and $d$-outcomes and provides the first best-of-both-worlds algorithms, whose regrets are favorably bounded both in the stochastic and adversarial regimes. In particular, we show that for non-degenerate locally observable games, the regret is $O(m^2 k^4 \log(T) \log(k_Π T) / Δ_{\min})$ in the stochastic regime and $O(m k^{2/3} \sqrt{T \log(T) \log k_Π})$ in the adversarial regime, where $T$ is the number of rounds, $m$ is the maximum number of distinct observations per action, $Δ_{\min}$ is the minimum suboptimality gap, and $k_Π$ is the number of Pareto optimal actions. Moreover, we show that for globally observable games, the regret is $O(c_{\mathcal{G}}^2 \log(T) \log(k_Π T) / Δ_{\min}^2)$ in the stochastic regime and $O((c_{\mathcal{G}}^2 \log(T) \log(k_Π T))^{1/3} T^{2/3})$ in the adversarial regime, where $c_{\mathcal{G}}$ is a game-dependent constant. We also provide regret bounds for a stochastic regime with adversarial corruptions. Our algorithms are based on the follow-the-regularized-leader framework and are inspired by the approach of exploration by optimization and the adaptive learning rate in the field of online learning with feedback graphs. △ Less

Submitted 9 October, 2022; v1 submitted 29 July, 2022; originally announced July 2022.

Comments: 31 pages

Experimental Demonstration of High-Performance Physical Reservoir Computing with Nonlinear Interfered Spin Wave Multi-Detection

Authors: Wataru Namiki, Daiki Nishioka, Yu Yamaguchi, Takashi Tsuchiya, Tohru Higuchi, Kazuya Terabe

Abstract: Physical reservoir computing, which is a promising method for the implementation of highly efficient artificial intelligence devices, requires a physical system with nonlinearity, fading memory, and the ability to map in high dimensions. Although it is expected that spin wave interference can perform as highly efficient reservoir computing in some micromagnetic simulations, there has been no exper… ▽ More Physical reservoir computing, which is a promising method for the implementation of highly efficient artificial intelligence devices, requires a physical system with nonlinearity, fading memory, and the ability to map in high dimensions. Although it is expected that spin wave interference can perform as highly efficient reservoir computing in some micromagnetic simulations, there has been no experimental verification to date. Herein, we demonstrate reservoir computing that utilizes multidetected nonlinear spin wave interference in an yttrium iron garnet single crystal. The subject computing system achieved excellent performance when used for hand-written digit recognition, second-order nonlinear dynamical tasks, and nonlinear autoregressive moving average (NARMA). It is of particular note that normalized mean square errors (NMSEs) for NARMA2 and second-order nonlinear dynamical tasks were 1.81x10-2 and 8.37x10-5, respectively, which are the lowest figures for any experimental physical reservoir so far reported. Said high performance was achieved with higher nonlinearity and the large memory capacity of interfered spin wave multi-detection. △ Less

Submitted 7 July, 2022; originally announced July 2022.

Comments: 19 pages, 5 figures

Edge-Of-Chaos Learning Achieved by Ion-Electron Coupled Dynamics in an Ion-Gating Reservoir

Authors: Daiki Nishioka, Takashi Tsuchiya, Wataru Namiki, Makoto Takayanagi, Masataka Imura, Yasuo Koide, Tohru Higuchi, Kazuya Terabe

Abstract: Physical reservoir computing has recently been attracting attention for its ability to significantly reduce the computational resources required to process time-series data. However, the physical reservoirs that have been reported to date have had insufficient expression power, and most of them have a large volume, which makes their practical application difficult. Herein we describe the developme… ▽ More Physical reservoir computing has recently been attracting attention for its ability to significantly reduce the computational resources required to process time-series data. However, the physical reservoirs that have been reported to date have had insufficient expression power, and most of them have a large volume, which makes their practical application difficult. Herein we describe the development of a Li+-electrolyte based ion-gating reservoir (IGR), with ion-electron coupled dynamics, for use in high performance physical reservoir computing. A variety of synaptic responses were obtained in response to past experience, which responses were stored as transient charge density patterns in an electric double layer, at the Li+-electrolyte/diamond interface. Performance, which was tested using a nonlinear autoregressive moving-average (NARMA) task, was found to be excellent, with a NMSE of 0.023 for NARMA2, which is the highest for any physical reservoir reported to date. The maximum Lyapunov exponent of the IGR was 0.0083: the edge of chaos state enabling the best computational capacity. The IGR described herein opens the way for high-performance and integrated neural network devices. △ Less

Submitted 6 July, 2022; originally announced July 2022.

Comments: 25 pages, 5 figures for main part and 4 figures for Supplementary information

Generalized Two Color Map Theorem -- Complete Theorem of Robust Gait Plan for a Tilt-rotor

Authors: Zhe Shen, Yudong Ma, Takeshi Tsuchiya

Abstract: Gait plan is a procedure that is typically applied on the ground robots, e.g., quadrupedal robots; the tilt-rotor, a novel type of quadrotor with eight inputs, is not one of them. While controlling the tilt-rotor relying on feedback linearization, the tilting angles (inputs) are expected to change over-intensively, which may not be expected in the application. To help suppress the intensive change… ▽ More Gait plan is a procedure that is typically applied on the ground robots, e.g., quadrupedal robots; the tilt-rotor, a novel type of quadrotor with eight inputs, is not one of them. While controlling the tilt-rotor relying on feedback linearization, the tilting angles (inputs) are expected to change over-intensively, which may not be expected in the application. To help suppress the intensive change in the tilting angles, a gait plan procedure is introduced to the tilt-rotor before feedback linearization. The tilting angles are specified with time in advance by users rather than given by the control rule. However, based on this scenario, the decoupling matrix in feedback linearization can be singular for some attitudes, combinations of roll angle and pitch angle. It hinders the further application of the feedback linearization. With this concern, Two Color Map Theorem is established to maximize the acceptable attitude region, where the combinations of roll and pitch will give an invertible decoupling matrix. That theorem, however, over-restricts the choice of the tilting angles, which can rule out some feasible robust gaits. This paper gives the generalized Two Color Map Theorem; all the robust gaits can be found based on this generalized theorem. The robustness of three gaits that satisfy this generalized Two Color Map Theorem (while violating Two Color Map Theorem) are analyzed. The results show that Generalized Two Color Map Theorem completes the search for the robust gaits for a tilt-rotor. △ Less

Submitted 12 November, 2023; v1 submitted 27 June, 2022; originally announced June 2022.

The Robust Gait of a Tilt-rotor and Its Application to Tracking Control -- Application of Two Color Map Theorem

Authors: Zhe Shen, Takeshi Tsuchiya

Abstract: Rylls tilt-rotor is a UAV with eight inputs; the four magnitudes of the thrusts as well as four tilting angles of the thrusts can be specified in need, e.g., based on a control rule. Despite of the success in simulation, conventional feedback linearization witnesses the over-intensive change in the inputs while applying to stabilize Rylls tilt-rotor. Our previous research thus put the extra proced… ▽ More Rylls tilt-rotor is a UAV with eight inputs; the four magnitudes of the thrusts as well as four tilting angles of the thrusts can be specified in need, e.g., based on a control rule. Despite of the success in simulation, conventional feedback linearization witnesses the over-intensive change in the inputs while applying to stabilize Rylls tilt-rotor. Our previous research thus put the extra procedure named gait plan forward to suppress the unexpected changes in the tilting angles. Accompanying the Two Color Map Theorem, the tilting-angles are planned robustly and continuously. The designed gaits are robust to the change of the attitude. However, this is not a complete theory before further applying to the tracking simulation test. This paper further discusses some gaits following the Two Color Map Theorem and simulates a tracking problem for a tilt-rotor. A uniform circular moving reference is designed to be tracked by the tilt-rotor equipped with the designed robust gait and the feedback linearization controller. The gaits satisfying Two Color Map Theorem show the robustness. The results from the simulation show the success in tracking of the tilt-rotor. △ Less

Submitted 26 June, 2022; v1 submitted 22 June, 2022; originally announced June 2022.

Comments: Submitted to ICCAS 2022

Joint Analysis of Acoustic Scenes and Sound Events Based on Multitask Learning with Dynamic Weight Adaptation

Authors: Kayo Nada, Keisuke Imoto, Takao Tsuchiya

Abstract: Acoustic scene classification (ASC) and sound event detection (SED) are major topics in environmental sound analysis. Considering that acoustic scenes and sound events are closely related to each other, the joint analysis of acoustic scenes and sound events using multitask learning (MTL)-based neural networks was proposed in some previous works. Conventional methods train MTL-based models using a… ▽ More Acoustic scene classification (ASC) and sound event detection (SED) are major topics in environmental sound analysis. Considering that acoustic scenes and sound events are closely related to each other, the joint analysis of acoustic scenes and sound events using multitask learning (MTL)-based neural networks was proposed in some previous works. Conventional methods train MTL-based models using a linear combination of ASC and SED loss functions with constant weights. However, the performance of conventional MTL-based methods depends strongly on the weights of the ASC and SED losses, and it is difficult to determine the appropriate balance between the constant weights of the losses of MTL of ASC and SED. In this paper, we thus propose dynamic weight adaptation methods for MTL of ASC and SED based on dynamic weight average and multi--focal loss to adjust the learning weights automatically. Evaluation experiments using parts of the TUT Acoustic Scenes 2016/2017 and TUT Sound Events 2016/2017 are conducted, and we show that the proposed methods improve the scene classification and event detection performance characteristics compared with the conventional MTL-based method. We then investigate how the learning weights of ASC and SED tasks dynamically adapt as the model training progresses. △ Less

Submitted 21 June, 2022; originally announced June 2022.

Comments: Submitted to Acoustical Science and Technology

Adversarially Robust Multi-Armed Bandit Algorithm with Variance-Dependent Regret Bounds

Authors: Shinji Ito, Taira Tsuchiya, Junya Honda

Abstract: This paper considers the multi-armed bandit (MAB) problem and provides a new best-of-both-worlds (BOBW) algorithm that works nearly optimally in both stochastic and adversarial settings. In stochastic settings, some existing BOBW algorithms achieve tight gap-dependent regret bounds of $O(\sum_{i: Δ_i>0} \frac{\log T}{Δ_i})$ for suboptimality gap $Δ_i$ of arm $i$ and time horizon $T$. As Audibert e… ▽ More This paper considers the multi-armed bandit (MAB) problem and provides a new best-of-both-worlds (BOBW) algorithm that works nearly optimally in both stochastic and adversarial settings. In stochastic settings, some existing BOBW algorithms achieve tight gap-dependent regret bounds of $O(\sum_{i: Δ_i>0} \frac{\log T}{Δ_i})$ for suboptimality gap $Δ_i$ of arm $i$ and time horizon $T$. As Audibert et al. [2007] have shown, however, that the performance can be improved in stochastic environments with low-variance arms. In fact, they have provided a stochastic MAB algorithm with gap-variance-dependent regret bounds of $O(\sum_{i: Δ_i>0} (\frac{σ_i^2}{Δ_i} + 1) \log T )$ for loss variance $σ_i^2$ of arm $i$. In this paper, we propose the first BOBW algorithm with gap-variance-dependent bounds, showing that the variance information can be used even in the possibly adversarial environment. Further, the leading constant factor in our gap-variance dependent bound is only (almost) twice the value for the lower bound. Additionally, the proposed algorithm enjoys multiple data-dependent regret bounds in adversarial settings and works well in stochastic settings with adversarial corruptions. The proposed algorithm is based on the follow-the-regularized-leader method and employs adaptive learning rates that depend on the empirical prediction error of the loss, which leads to gap-variance-dependent regret bounds reflecting the variance of the arms. △ Less

Submitted 14 June, 2022; originally announced June 2022.

Comments: Accepted for presentation at the 35th Annual Conference on Learning Theory (COLT 2022). Only the extended abstract will appear in the conference proceedings

Minimax Optimal Algorithms for Fixed-Budget Best Arm Identification

Authors: Junpei Komiyama, Taira Tsuchiya, Junya Honda

Abstract: We consider the fixed-budget best arm identification problem where the goal is to find the arm of the largest mean with a fixed number of samples. It is known that the probability of misidentifying the best arm is exponentially small to the number of rounds. However, limited characterizations have been discussed on the rate (exponent) of this value. In this paper, we characterize the minimax optim… ▽ More We consider the fixed-budget best arm identification problem where the goal is to find the arm of the largest mean with a fixed number of samples. It is known that the probability of misidentifying the best arm is exponentially small to the number of rounds. However, limited characterizations have been discussed on the rate (exponent) of this value. In this paper, we characterize the minimax optimal rate as a result of an optimization over all possible parameters. We introduce two rates, $R^{\mathrm{go}}$ and $R^{\mathrm{go}}_{\infty}$, corresponding to lower bounds on the probability of misidentification, each of which is associated with a proposed algorithm. The rate $R^{\mathrm{go}}$ is associated with $R^{\mathrm{go}}$-tracking, which can be efficiently implemented by a neural network and is shown to outperform existing algorithms. However, this rate requires a nontrivial condition to be achievable. To address this issue, we introduce the second rate $R^{\mathrm{go}}_\infty$. We show that this rate is indeed achievable by introducing a conceptual algorithm called delayed optimal tracking (DOT). △ Less

Submitted 26 October, 2022; v1 submitted 9 June, 2022; originally announced June 2022.

Comments: NeurIPS 2022 version https://openreview.net/forum?id=TIQfmR7IF6H

Nearly Optimal Best-of-Both-Worlds Algorithms for Online Learning with Feedback Graphs

Authors: Shinji Ito, Taira Tsuchiya, Junya Honda

Abstract: This study considers online learning with general directed feedback graphs. For this problem, we present best-of-both-worlds algorithms that achieve nearly tight regret bounds for adversarial environments as well as poly-logarithmic regret bounds for stochastic environments. As Alon et al. [2015] have shown, tight regret bounds depend on the structure of the feedback graph: strongly observable gra… ▽ More This study considers online learning with general directed feedback graphs. For this problem, we present best-of-both-worlds algorithms that achieve nearly tight regret bounds for adversarial environments as well as poly-logarithmic regret bounds for stochastic environments. As Alon et al. [2015] have shown, tight regret bounds depend on the structure of the feedback graph: strongly observable graphs yield minimax regret of $\tildeΘ( α^{1/2} T^{1/2} )$, while weakly observable graphs induce minimax regret of $\tildeΘ( δ^{1/3} T^{2/3} )$, where $α$ and $δ$, respectively, represent the independence number of the graph and the domination number of a certain portion of the graph. Our proposed algorithm for strongly observable graphs has a regret bound of $\tilde{O}( α^{1/2} T^{1/2} ) $ for adversarial environments, as well as of $ {O} ( \frac{α(\ln T)^3 }{Δ_{\min}} ) $ for stochastic environments, where $Δ_{\min}$ expresses the minimum suboptimality gap. This result resolves an open question raised by Erez and Koren [2021]. We also provide an algorithm for weakly observable graphs that achieves a regret bound of $\tilde{O}( δ^{1/3}T^{2/3} )$ for adversarial environments and poly-logarithmic regret for stochastic environments. The proposed algorithms are based on the follow-the-regularized-leader approach combined with newly designed update rules for learning rates. △ Less

Submitted 26 December, 2022; v1 submitted 2 June, 2022; originally announced June 2022.

Comments: Accepted at NeurIPS 2022

Embedded System Evolution in IoT System Development Based on MAPE-K Loop Mechanism

Authors: Hiroyuki Nakagawa, Shinya Tsuchida, Emiliano Tramontana, Andrea Fornaia, Tatsuhiro Tsuchiya

Abstract: Embedded systems including IoT devices are designed for specialized functions; thus, changes in functions are not considered following their release. For this reason, changing functions to satisfy the requirements of IoT systems is difficult. In this study, we focus on updating existing embedded systems without modifying them. We investigate the design of new functions and their implementation wit… ▽ More Embedded systems including IoT devices are designed for specialized functions; thus, changes in functions are not considered following their release. For this reason, changing functions to satisfy the requirements of IoT systems is difficult. In this study, we focus on updating existing embedded systems without modifying them. We investigate the design of new functions and their implementation with limited resources. This paper describes an evolution mechanism for updating the functionalities of existing embedded systems. The evolution mechanism uses a control unit that is deployed outside the embedded system. To guide the steady implementation of the evolution mechanism, we define an evolution process that effectively uses the state machine diagram at the design time and runtime to update the embedded systems. The programming framework implemented in this study supports the evolution process. We evaluate the evolution mechanism based on the results from two experiments. The first experiment involved applying the evolution mechanism to a cleaning robot, this demonstrated that the evolution mechanism systematically enables the injection of new functions into an embedded system in the real world. The second experiment, on the probabilistic model checking, demonstrated that the mechanism provides almost the same performance as the ordinary embedded system with an improved robustness. △ Less

Submitted 26 May, 2022; originally announced May 2022.

Four-dimensional Gait Surfaces for A Tilt-rotor -- Two Color Map Theorem

Authors: Zhe Shen, Yudong Ma, Takeshi Tsuchiya

Abstract: This article presents the four-dimensional surfaces which instruct the gait plan for a tilt-rotor. The previous gaits analyzed in the tilt-rotor research are inspired by animals; no theoretical base backs the robustness of these gaits. This research deduces the gaits by diminishing the effect of the attitude of the tilt-rotor for the first time. Four-dimensional gait surfaces are subsequently foun… ▽ More This article presents the four-dimensional surfaces which instruct the gait plan for a tilt-rotor. The previous gaits analyzed in the tilt-rotor research are inspired by animals; no theoretical base backs the robustness of these gaits. This research deduces the gaits by diminishing the effect of the attitude of the tilt-rotor for the first time. Four-dimensional gait surfaces are subsequently found, on which the gaits are expected to be robust to the attitude. These surfaces provide the region where the gait is suggested to be planned. However, a discontinuous region may hinder the gait plan process while utilizing the proposal gait surfaces. A Two Color Map Theorem is then established to guarantee the continuity of each gait designed. The robustness of the typical gaits obeying the Two Color Map Theorem and on the gait surface is demonstrated by comparing the singular curve in attitude with the gaits not on the gait surface. The result shows that the acceptable attitudes enlarge for the gaits on the gait surface. △ Less

Submitted 4 April, 2022; originally announced April 2022.

Cat-inspired Gaits for A Tilt-rotor -- from Symmetrical to Asymmetrical

Authors: Zhe Shen, Takeshi Tsuchiya

Abstract: Among the tilt-rotors (quadrotors) developed in the last decades, Rylls model with eight inputs (four magnitudes of the thrusts and four tilting angles) attracted great attention. Typical feedback linearization maneuvers all the eight inputs with a united control rule to stabilize this tilt-rotor. Instead of assigning the tilting angles by the control rule, the recent research predetermined the ti… ▽ More Among the tilt-rotors (quadrotors) developed in the last decades, Rylls model with eight inputs (four magnitudes of the thrusts and four tilting angles) attracted great attention. Typical feedback linearization maneuvers all the eight inputs with a united control rule to stabilize this tilt-rotor. Instead of assigning the tilting angles by the control rule, the recent research predetermined the tilting angles and left the magnitudes of the thrusts the only control signals. These tilting angles are designed to mimic the cat-trot gait, avoiding the singular decoupling matrix feedback linearization. To complete the discussions of the cat-gaits inspired tilt-rotor gaits, this research addresses the analyses on the rest of the common cat gaits, walk, run, transverse gallop, and rotary gallop. It is found that the singular decoupling matrix exist in walk gait and rotary gallop. Further modifications are conducted to these two gaits to accommodate the application of feedback linearization. The modified gaits with different periods are then applied to the tilt-rotor in tracking experiments, in which the references are uniform rectilinear motion and uniform circular motion. All the experiments are simulated in Simulink, MATLAB. The result shows that. △ Less

Submitted 22 March, 2022; originally announced March 2022.

Feedback Linearization Based Tracking Control of A Tilt-rotor with Cat-trot Gait Plan

Authors: Zhe Shen, Yudong Ma, Takeshi Tsuchiya

Abstract: With the introduction of the laterally bounded forces, the tilt-rotor gains more flexibility in the controller design. Typical feedback linearization methods utilize all the inputs in controlling this vehicle; the magnitudes as well as the directions of the thrusts are maneuvered simultaneously based on a unified control rule. Although several promising results indicate that these controllers may… ▽ More With the introduction of the laterally bounded forces, the tilt-rotor gains more flexibility in the controller design. Typical feedback linearization methods utilize all the inputs in controlling this vehicle; the magnitudes as well as the directions of the thrusts are maneuvered simultaneously based on a unified control rule. Although several promising results indicate that these controllers may track the desired complicated trajectories, the tilting angles are required to change relatively fast or in large scale during the flight, which turns to be a challenge in application. The recent gait plan for a tilt-rotor may solve this problem; the tilting angles are fixed or vary in a predetermined pattern without being maneuvered by the control algorithm. Carefully avoiding the singular decoupling matrix, several attitudes can be tracked without changing the tilting angles frequently. While the position was not directly regulated in that research, which left the position-tracking still an open question. In this research, we elucidate the coupling relationship between the position and the attitude. Based on this, we design the position-tracking controller, adopting feedback linearization. A cat-trot gait is further designed for a tilt-rotor to track the reference; three types of references are designed for our tracking experiments: setpoint, uniform rectilinear motion, and uniform circular motion. The significant improvement with less steady state error is witnessed after equipping with our modified attitude-position decoupler. It is also found that the frequency of the cat-trot gait highly influenced the steady state error. △ Less

Submitted 26 March, 2022; v1 submitted 6 February, 2022; originally announced February 2022.

Gait Analysis for A Tilt-rotor: The Dynamic Invertible Gait

Authors: Zhe Shen, Takeshi Tsuchiya

Abstract: Conventional Feedback-Linearization-based controller, applied to the tilt-rotor (eight inputs), results in the extensive changes in the tilting angles, which are not expected in practice. To solve this problem, we introduce the novel concept UAV gait to restrict the tilting angles. The gait plan was initially to solve the control problems for quadruped (four-legged) robots. Transplanting this appr… ▽ More Conventional Feedback-Linearization-based controller, applied to the tilt-rotor (eight inputs), results in the extensive changes in the tilting angles, which are not expected in practice. To solve this problem, we introduce the novel concept UAV gait to restrict the tilting angles. The gait plan was initially to solve the control problems for quadruped (four-legged) robots. Transplanting this approach, accompanied by feedback linearization, to the tiltrotor may cause the well-known non-invertible problem in the decoupling matrix. In this research, we explore the invertible gait for the tiltrotor and apply feedback linearization to stabilize the attitude and the altitude. The equivalent conditions to achieve a full-rank decoupling matrix are deduced and simplified to a near zero roll and zero pitch. This paper proposed several invertible gaits to conduct the attitude-altitude control test. The accepted gaits within the region of interest are visualized. The experiment is simulated in Simulink, MATLAB. The results show the promising response in attitude and altitude. △ Less

Submitted 11 February, 2022; v1 submitted 5 January, 2022; originally announced January 2022.

Constrained Detecting Arrays: Mathematical Structures for Fault Identification in Combinatorial Interaction Testing

Authors: Hao Jin, Ce Shi, Tatsuhiro Tsuchiya

Abstract: Context: Detecting arrays are mathematical structures aimed at fault identification in combinatorial interaction testing. However, they cannot be directly applied to systems that have constraints among test parameters. Such constraints are prevalent in real-world systems. Objectives: This paper proposes Constrained Detecting Arrays (CDAs), an extension of detecting arrays, which can be used for… ▽ More Context: Detecting arrays are mathematical structures aimed at fault identification in combinatorial interaction testing. However, they cannot be directly applied to systems that have constraints among test parameters. Such constraints are prevalent in real-world systems. Objectives: This paper proposes Constrained Detecting Arrays (CDAs), an extension of detecting arrays, which can be used for systems with constraints. Methods: The paper examines the properties and capabilities of CDAs with rigorous arguments. The paper also proposes two algorithms for constructing CDAs: One is aimed at generating minimum CDAs and the other is a heuristic algorithm aimed at fast generation of CDAs. The algorithms are evaluated through experiments using a benchmark dataset. Results: Experimental results show that the first algorithm can generate minimum CDAs if a sufficiently long generation time is allowed, and the second algorithm can generate minimum or near-minimum CDAs in a reasonable time. Conclusion: CDAs enhance detecting arrays to be applied to systems with constraints. The two proposed algorithms have different advantages with respect to the array size and generation time △ Less

Submitted 12 October, 2021; originally announced October 2021.

Quad-cone-rotor: A Novel Tilt Quadrotor with Severe-fault-tolerant Ability

Authors: Zhe Shen, Yudong Ma, Takeshi Tsuchiya

Abstract: Conventional quadrotors received great attention in trajectory design and fault-tolerant control in these years. The direction of each thrust is perpendicular to the body because of the geometrics in mechanical design. Comparing with the conventional quadrotor, a novel quadrotor named quad-tilt-rotor brings better freedom in manipulating the thrust vector. Quad-tilt-rotor augments the additional d… ▽ More Conventional quadrotors received great attention in trajectory design and fault-tolerant control in these years. The direction of each thrust is perpendicular to the body because of the geometrics in mechanical design. Comparing with the conventional quadrotor, a novel quadrotor named quad-tilt-rotor brings better freedom in manipulating the thrust vector. Quad-tilt-rotor augments the additional degrees of freedom in the thrust, providing the possibility of violating the normal direction of the thrust in the conventional quadrotor. This provides the ability of greater agility in control. This paper presents a novel design of a quad-tilt-rotor (quad-cone-rotor) whose thrust can be assigned along the edge of a cone shape. Besides the inheriting merits in agile from quad-tilt-rotor, the quad-cone-rotor is expected to take fault-tolerant control in severe dynamic failure (total loss in all thrusts). We simulate the control result in a UAV simulator in SIMULINK, MATLAB. △ Less

Submitted 19 August, 2021; originally announced August 2021.

Stability-Certified Reinforcement Learning via Spectral Normalization

Authors: Ryoichi Takase, Nobuyuki Yoshikawa, Toshisada Mariyama, Takeshi Tsuchiya

Abstract: In this article, two types of methods from different perspectives based on spectral normalization are described for ensuring the stability of the system controlled by a neural network. The first one is that the L2 gain of the feedback system is bounded less than 1 to satisfy the stability condition derived from the small-gain theorem. While explicitly including the stability condition, the first m… ▽ More In this article, two types of methods from different perspectives based on spectral normalization are described for ensuring the stability of the system controlled by a neural network. The first one is that the L2 gain of the feedback system is bounded less than 1 to satisfy the stability condition derived from the small-gain theorem. While explicitly including the stability condition, the first method may provide an insufficient performance on the neural network controller due to its strict stability condition. To overcome this difficulty, the second one is proposed, which improves the performance while ensuring the local stability with a larger region of attraction. In the second method, the stability is ensured by solving linear matrix inequalities after training the neural network controller. The spectral normalization proposed in this article improves the feasibility of the a-posteriori stability test by constructing tighter local sectors. The numerical experiments show that the second method provides enough performance compared with the first one while ensuring enough stability compared with the existing reinforcement learning algorithms. △ Less

Submitted 26 December, 2020; originally announced December 2020.

Analysis and Design of Thompson Sampling for Stochastic Partial Monitoring

Authors: Taira Tsuchiya, Junya Honda, Masashi Sugiyama

Abstract: We investigate finite stochastic partial monitoring, which is a general model for sequential learning with limited feedback. While Thompson sampling is one of the most promising algorithms on a variety of online decision-making problems, its properties for stochastic partial monitoring have not been theoretically investigated, and the existing algorithm relies on a heuristic approximation of the p… ▽ More We investigate finite stochastic partial monitoring, which is a general model for sequential learning with limited feedback. While Thompson sampling is one of the most promising algorithms on a variety of online decision-making problems, its properties for stochastic partial monitoring have not been theoretically investigated, and the existing algorithm relies on a heuristic approximation of the posterior distribution. To mitigate these problems, we present a novel Thompson-sampling-based algorithm, which enables us to exactly sample the target parameter from the posterior distribution. Besides, we prove that the new algorithm achieves the logarithmic problem-dependent expected pseudo-regret $\mathrm{O}(\log T)$ for a linearized variant of the problem with local observability. This result is the first regret bound of Thompson sampling for partial monitoring, which also becomes the first logarithmic regret bound of Thompson sampling for linear bandits. △ Less

Submitted 10 June, 2021; v1 submitted 17 June, 2020; originally announced June 2020.

Comments: Published version in NeurIPS 2020 (https://proceedings.neurips.cc/paper/2020/hash/649d45bf179296e31731adfd4df25588-Abstract.html), 39 pages, 4 figures

Locating arrays with mixed alphabet sizes

Authors: Ce Shi, Hao Jin, Tatsuhiro Tsuchiya

Abstract: Locating arrays (LAs) can be used to detect and identify interaction faults among factors in a component-based system. The optimality and constructions of LAs with a single fault have been investigated extensively under the assumption that all the factors have the same values. However, in real life, different factors in a system have different numbers of possible values. Thus, it is necessary for… ▽ More Locating arrays (LAs) can be used to detect and identify interaction faults among factors in a component-based system. The optimality and constructions of LAs with a single fault have been investigated extensively under the assumption that all the factors have the same values. However, in real life, different factors in a system have different numbers of possible values. Thus, it is necessary for LAs to satisfy such requirements. We herein establish a general lower bound on the size of mixed-level $(\bar{1},t)$-locating arrays. Some methods for constructing LAs including direct and recursive constructions are provided. In particular, constructions that produce optimal LAs satisfying the lower bound are described. Additionally, some series of optimal LAs satisfying the lower bound are presented. △ Less

Submitted 31 January, 2020; originally announced January 2020.

MSC Class: 05B15; 05B20; 94C12; 62K15

Using simulated annealing for locating array construction

Authors: Tatsuya Konishi, Hideharu Kojima, Hiroyuki Nakagawa, Tatsuhiro Tsuchiya

Abstract: Context: Combinatorial interaction testing is known to be an efficient testing strategy for computing and information systems. Locating arrays are mathematical objects that are useful for this testing strategy, as they can be used as a test suite that enables fault localization as well as fault detection. In this application, each row of an array is used as an individual test. Objective: This pa… ▽ More Context: Combinatorial interaction testing is known to be an efficient testing strategy for computing and information systems. Locating arrays are mathematical objects that are useful for this testing strategy, as they can be used as a test suite that enables fault localization as well as fault detection. In this application, each row of an array is used as an individual test. Objective: This paper proposes an algorithm for constructing locating arrays with a small number of rows. Testing cost increases as the number of tests increases; thus the problem of finding locating arrays of small sizes is of practical importance. Method: The proposed algorithm uses simulation annealing, a meta-heuristic algorithm, to find locating array of a given size. The whole algorithm repeatedly executes the simulated annealing algorithm by dynamically varying the input array size. Results: Experimental results show 1) that the proposed algorithm is able to construct locating arrays for problem instances of large sizes and 2) that, for problem instances for which nontrivial locating arrays are known, the algorithm is often able to generate locating arrays that are smaller than or at least equal to the known arrays. Conclusion: Based on the results, it is concluded that the proposed algorithm can produce small locating arrays and scale to practical problems. △ Less

Submitted 28 September, 2019; originally announced September 2019.

MSC Class: 94C12; 05B30; 68R05;

Using binary decision diagrams for constraint handling in combinatorial interaction testing

Authors: Tatsuhiro Tsuchiya

Abstract: Constraints among test parameters often have substantial effects on the performance of test case generation for combinatorial interaction testing. This paper investigates the effectiveness of the use of Binary Decision Diagrams (BDDs) for constraint handling. BDDs are a data structure used to represent and manipulate Boolean functions. The core role of a constraint handler is to perform a check to… ▽ More Constraints among test parameters often have substantial effects on the performance of test case generation for combinatorial interaction testing. This paper investigates the effectiveness of the use of Binary Decision Diagrams (BDDs) for constraint handling. BDDs are a data structure used to represent and manipulate Boolean functions. The core role of a constraint handler is to perform a check to determine if a partial test case with unspecified parameter values satisfies the constraints. In the course of generating a test suite, this check is executed a number of times; thus the efficiency of the check significantly affects the overall time required for test case generation. In the paper, we study two different approaches. The first approach performs this check by computing the logical AND of Boolean functions that represent all constraint-satisfying full test cases and a given partial test case. The second approach uses a new technique to construct a BDD that represents all constraint-satisfying partial test cases. With this BDD, the check can be performed by simply traversing the BDD from the root to a sink. We developed a program that incorporates both approaches into IPOG, a well-known test case generation algorithm. Using this program, we empirically evaluate the performance of these BDD-based constraint handling approaches using a total of 62 problem instances. In the evaluation, the two approaches are compared with three different constraint handling approaches, namely, those based on Boolean satisfiability (SAT) solving, Minimum Forbidden Tuples (MFTs), and Constraint Satisfiction Problem (CSP) solving. The results of the evaluation show that the two BDD-based approaches usually outperform the other constraint handling techniques and that the BDD-based approach using the new technique exhibits best performance. △ Less

Submitted 3 July, 2019; originally announced July 2019.

MSC Class: 68M15; 68N30

Finding minimum locating arrays using a CSP solver

Authors: Tatsuya Konishi, Hideharu Kojima, Hiroyuki Nakagawa, Tatsuhiro Tsuchiya

Abstract: Combinatorial interaction testing is an efficient software testing strategy. If all interactions among test parameters or factors needed to be covered, the size of a required test suite would be prohibitively large. In contrast, this strategy only requires covering $t$-wise interactions where $t$ is typically very small. As a result, it becomes possible to significantly reduce test suite size. Loc… ▽ More Combinatorial interaction testing is an efficient software testing strategy. If all interactions among test parameters or factors needed to be covered, the size of a required test suite would be prohibitively large. In contrast, this strategy only requires covering $t$-wise interactions where $t$ is typically very small. As a result, it becomes possible to significantly reduce test suite size. Locating arrays aim to enhance the ability of combinatorial interaction testing. In particular, $(\overline{1}, t)$-locating arrays can not only execute all $t$-way interactions but also identify, if any, which of the interactions causes a failure. In spite of this useful property, there is only limited research either on how to generate locating arrays or on their minimum sizes. In this paper, we propose an approach to generating minimum locating arrays. In the approach, the problem of finding a locating array consisting of $N$ tests is represented as a Constraint Satisfaction Problem (CSP) instance, which is in turn solved by a modern CSP solver. The results of using the proposed approach reveal many $(\overline{1}, t)$-locating arrays that are smallest known so far. In addition, some of these arrays are proved to be minimum. △ Less

Submitted 16 April, 2019; originally announced April 2019.

Comments: 16 pages

MSC Class: 94C12; 05B30; 68R05

Semi-Supervised Ordinal Regression Based on Empirical Risk Minimization

Authors: Taira Tsuchiya, Nontawat Charoenphakdee, Issei Sato, Masashi Sugiyama

Abstract: Ordinal regression is aimed at predicting an ordinal class label. In this paper, we consider its semi-supervised formulation, in which we have unlabeled data along with ordinal-labeled data to train an ordinal regressor. There are several metrics to evaluate the performance of ordinal regression, such as the mean absolute error, mean zero-one error, and mean squared error. However, the existing st… ▽ More Ordinal regression is aimed at predicting an ordinal class label. In this paper, we consider its semi-supervised formulation, in which we have unlabeled data along with ordinal-labeled data to train an ordinal regressor. There are several metrics to evaluate the performance of ordinal regression, such as the mean absolute error, mean zero-one error, and mean squared error. However, the existing studies do not take the evaluation metric into account, have a restriction on the model choice, and have no theoretical guarantee. To overcome these problems, we propose a novel generic framework for semi-supervised ordinal regression based on the empirical risk minimization principle that is applicable to optimizing all of the metrics mentioned above. Besides, our framework has flexible choices of models, surrogate losses, and optimization algorithms without the common geometric assumption on unlabeled data such as the cluster assumption or manifold assumption. We further provide an estimation error bound to show that our risk estimator is consistent. Finally, we conduct experiments to show the usefulness of our framework. △ Less

Submitted 10 June, 2021; v1 submitted 31 January, 2019; originally announced January 2019.

Comments: 38 pages, 9 figures

Constrained locating arrays for combinatorial interaction testing

Authors: Hao Jin, Tatsuhiro Tsuchiya

Abstract: This paper introduces the notion of Constrained Locating Arrays (CLAs), mathematical objects which can be used for fault localization in software testing. CLAs extend ordinary locating arrays to make them applicable to testing of systems that have constraints on test parameters. Such constraints are common in real-world systems; thus CLA enhances the applicability of locating arrays to practical t… ▽ More This paper introduces the notion of Constrained Locating Arrays (CLAs), mathematical objects which can be used for fault localization in software testing. CLAs extend ordinary locating arrays to make them applicable to testing of systems that have constraints on test parameters. Such constraints are common in real-world systems; thus CLA enhances the applicability of locating arrays to practical testing problems. The paper also proposes an algorithm for constructing CLAs. Experimental results show that the proposed algorithm scales to problems of practical sizes. △ Less

Submitted 31 May, 2019; v1 submitted 5 December, 2017; originally announced January 2018.

MSC Class: 94C12; 05B30; 68R05

Automatic Generation of Typographic Font from a Small Font Subset

Authors: Tomo Miyazaki, Tatsunori Tsuchiya, Yoshihiro Sugaya, Shinichiro Omachi, Masakazu Iwamura, Seiichi Uchida, Koichi Kise

Abstract: This paper addresses the automatic generation of a typographic font from a subset of characters. Specifically, we use a subset of a typographic font to extrapolate additional characters. Consequently, we obtain a complete font containing a number of characters sufficient for daily use. The automated generation of Japanese fonts is in high demand because a Japanese font requires over 1,000 characte… ▽ More This paper addresses the automatic generation of a typographic font from a subset of characters. Specifically, we use a subset of a typographic font to extrapolate additional characters. Consequently, we obtain a complete font containing a number of characters sufficient for daily use. The automated generation of Japanese fonts is in high demand because a Japanese font requires over 1,000 characters. Unfortunately, professional typographers create most fonts, resulting in significant financial and time investments for font generation. The proposed method can be a great aid for font creation because designers do not need to create the majority of the characters for a new font. The proposed method uses strokes from given samples for font generation. The strokes, from which we construct characters, are extracted by exploiting a character skeleton dataset. This study makes three main contributions: a novel method of extracting strokes from characters, which is applicable to both standard fonts and their variations; a fully automated approach for constructing characters; and a selection method for sample characters. We demonstrate our proposed method by generating 2,965 characters in 47 fonts. Objective and subjective evaluations verify that the generated characters are similar to handmade characters. △ Less

Submitted 20 January, 2017; originally announced January 2017.

Comments: 12 pages, 17 figures

Journal ref: IEEE Computer Graphics and Applications, 2019

Reorganizing topologies of Steiner trees to accelerate their elimination

Authors: Aymeric Grodet, Takuya Tsuchiya

Abstract: We describe a technique to reorganize topologies of Steiner trees by exchanging neighbors of adjacent Steiner points. We explain how to use the systematic way of building trees, and therefore topologies, to find the correct topology after nodes have been exchanged. Topology reorganizations can be inserted into the enumeration scheme commonly used by exact algorithms for the Euclidean Steiner tree… ▽ More We describe a technique to reorganize topologies of Steiner trees by exchanging neighbors of adjacent Steiner points. We explain how to use the systematic way of building trees, and therefore topologies, to find the correct topology after nodes have been exchanged. Topology reorganizations can be inserted into the enumeration scheme commonly used by exact algorithms for the Euclidean Steiner tree problem in $d$-space, providing a method of improvement different than the usual approaches. As an example, we show how topology reorganizations can be used to dynamically change the exploration of the usual branch-and-bound tree when two Steiner points collide during the optimization process. We also turn our attention to the erroneous use of a pre-optimization lower bound in the original algorithm and give an example to confirm its usage is incorrect. In order to provide numerical results on correct solutions, we use planar equilateral points to quickly compute this lower bound, even in dimensions higher than two. Finally, we describe planar twin trees, identical trees yielded by different topologies, whose generalization to higher dimensions could open a new way of building Steiner trees. △ Less

Submitted 12 March, 2018; v1 submitted 11 November, 2015; originally announced November 2015.

MSC Class: 90C35; 05C05; 90C57