-
Adaptive Decision Making via Entropy Minimization
Authors:
Armen E. Allahverdyan,
Aram Galstyan,
Ali E. Abbas,
Zbigniew R. Struzik
Abstract:
An agent choosing between various actions tends to take the one with the lowest cost. But this choice is arguably too rigid (not adaptive) to be useful in complex situations, e.g., where exploration-exploitation trade-off is relevant in creative task solving or when stated preferences differ from revealed ones. Here we study an agent who is willing to sacrifice a fixed amount of expected utility f…
▽ More
An agent choosing between various actions tends to take the one with the lowest cost. But this choice is arguably too rigid (not adaptive) to be useful in complex situations, e.g., where exploration-exploitation trade-off is relevant in creative task solving or when stated preferences differ from revealed ones. Here we study an agent who is willing to sacrifice a fixed amount of expected utility for adaptation. How can/ought our agent choose an optimal (in a technical sense) mixed action? We explore consequences of making this choice via entropy minimization, which is argued to be a specific example of risk-aversion. This recovers the $ε$-greedy probabilities known in reinforcement learning. We show that the entropy minimization leads to rudimentary forms of intelligent behavior: (i) the agent assigns a non-negligible probability to costly events; but (ii) chooses with a sizable probability the action related to less cost (lesser of two evils) when confronted with two actions with comparable costs; (iii) the agent is subject to effects similar to cognitive dissonance and frustration. Neither of these features are shown by entropy maximization.
△ Less
Submitted 1 December, 2018; v1 submitted 18 March, 2018;
originally announced March 2018.
-
Multi-command Tactile Brain Computer Interface: A Feasibility Study
Authors:
Hiromu Mori,
Yoshihiro Matsumoto,
Victor Kryssanov,
Eric Cooper,
Hitoshi Ogawa,
Shoji Makino,
Zbigniew R. Struzik,
Tomasz M. Rutkowski
Abstract:
The study presented explores the extent to which tactile stimuli delivered to the ten digits of a BCI-naive subject can serve as a platform for a brain computer interface (BCI) that could be used in an interactive application such as robotic vehicle operation. The ten fingertips are used to evoke somatosensory brain responses, thus defining a tactile brain computer interface (tBCI). Experimental r…
▽ More
The study presented explores the extent to which tactile stimuli delivered to the ten digits of a BCI-naive subject can serve as a platform for a brain computer interface (BCI) that could be used in an interactive application such as robotic vehicle operation. The ten fingertips are used to evoke somatosensory brain responses, thus defining a tactile brain computer interface (tBCI). Experimental results on subjects performing online (real-time) tBCI, using stimuli with a moderately fast inter-stimulus-interval (ISI), provide a validation of the tBCI prototype, while the feasibility of the concept is illuminated through information-transfer rates obtained through the case study.
△ Less
Submitted 18 May, 2013;
originally announced May 2013.
-
Comparison of P300 Responses in Auditory, Visual and Audiovisual Spatial Speller BCI Paradigms
Authors:
M. Chang,
N. Nishikawa,
Z. R. Struzik,
K. Mori,
S. Makino,
D. Mandic,
T. M. Rutkowski
Abstract:
The aim of this study is to provide a comprehensive test of three spatial speller settings, for the auditory, visual, and audiovisual paradigms. For rigour, the study is conducted with 16 BCI-naïve subjects in an experimental set-up based on five Japanese hiragana characters. Auditory P300 responses give encouragingly longer target vs. non-target latencies during the training phase, however, real-…
▽ More
The aim of this study is to provide a comprehensive test of three spatial speller settings, for the auditory, visual, and audiovisual paradigms. For rigour, the study is conducted with 16 BCI-naïve subjects in an experimental set-up based on five Japanese hiragana characters. Auditory P300 responses give encouragingly longer target vs. non-target latencies during the training phase, however, real-world online BCI experiments in the multimodal setting do not validate this potential advantage. Our case studies indicate that the auditory spatial unimodal paradigm needs further development in order to be a viable alternative to the established visual domain speller applications, as far as BCI-naïve subjects are concerned.
△ Less
Submitted 12 May, 2013; v1 submitted 27 January, 2013;
originally announced January 2013.
-
Multi-command Tactile and Auditory Brain Computer Interface based on Head Position Stimulation
Authors:
H. Mori,
Y. Matsumoto,
Z. R. Struzik,
K. Mori,
S. Makino,
D. Mandic,
T. M. Rutkowski
Abstract:
We study the extent to which vibrotactile stimuli delivered to the head of a subject can serve as a platform for a brain computer interface (BCI) paradigm. Six head positions are used to evoke combined somatosensory and auditory (via the bone conduction effect) brain responses, in order to define a multimodal tactile and auditory brain computer interface (taBCI). Experimental results of subjects p…
▽ More
We study the extent to which vibrotactile stimuli delivered to the head of a subject can serve as a platform for a brain computer interface (BCI) paradigm. Six head positions are used to evoke combined somatosensory and auditory (via the bone conduction effect) brain responses, in order to define a multimodal tactile and auditory brain computer interface (taBCI). Experimental results of subjects performing online taBCI, using stimuli with a moderately fast inter-stimulus interval (ISI), validate the taBCI paradigm, while the feasibility of the concept is illuminated through information transfer rate case studies.
△ Less
Submitted 12 May, 2013; v1 submitted 27 January, 2013;
originally announced January 2013.
-
Multicommand Tactile Brain Computer Interface based on Fingertips or Head Stimulation
Authors:
Hiromu Mori,
Yoshihiro Matsumoto,
Koichi Mori,
Victor Kryssanov,
Shoji Makino,
Zbigniew R. Struzik,
Gen Hori,
Tomasz M. Rutkowski
Abstract:
The paper presents results from a computational neuroscience study conducted to test vibrotactile stimuli delivered to subject fingertips and head areas in order to evoke the somatosensory brain responses utilized in a haptic brain computer interface (hBCI) paradigm. We present the preliminary and very encouraging results, with subjects conducting online hBCI interfacing experiments, ranging from…
▽ More
The paper presents results from a computational neuroscience study conducted to test vibrotactile stimuli delivered to subject fingertips and head areas in order to evoke the somatosensory brain responses utilized in a haptic brain computer interface (hBCI) paradigm. We present the preliminary and very encouraging results, with subjects conducting online hBCI interfacing experiments, ranging from 40% to 90% with a very fast inter-stimulus-interval (ISI) of 250ms. The presented results confirm our hypothesis that the hBCI paradigm concept is valid and it allows for rapid stimuli presentation in order to achieve a satisfactory information-transfer-rate of the novel BCI.
△ Less
Submitted 24 January, 2013; v1 submitted 11 November, 2012;
originally announced November 2012.
