Showing 1–28 of 28 results for author: Rutkowski, T M

Cognitive Assessment Estimation from Behavioral Responses in Emotional Faces Evaluation Task -- AI Regression Approach for Dementia Onset Prediction in Aging Societies

Authors: Tomasz M. Rutkowski, Masato S. Abe, Marcin Koculak, Mihoko Otake-Matsuura

Abstract: We present a practical health-theme machine learning (ML) application concerning `AI for social good' domain for `Producing Good Outcomes' track. In particular, the solution is concerning the problem of a potential elderly adult dementia onset prediction in aging societies. The paper discusses our attempt and encouraging preliminary study results of behavioral responses analysis in a working memor… ▽ More We present a practical health-theme machine learning (ML) application concerning `AI for social good' domain for `Producing Good Outcomes' track. In particular, the solution is concerning the problem of a potential elderly adult dementia onset prediction in aging societies. The paper discusses our attempt and encouraging preliminary study results of behavioral responses analysis in a working memory-based emotional evaluation experiment. We focus on the development of digital biomarkers for dementia progress detection and monitoring. We present a behavioral data collection concept for a subsequent AI-based application together with a range of regression encouraging results of Montreal Cognitive Assessment (MoCA) scores in the leave-one-subject-out cross-validation setup. The regressor input variables include experimental subject's emotional valence and arousal recognition responses, as well as reaction times, together with self-reported education levels and ages, obtained from a group of twenty older adults taking part in the reported data collection project. The presented results showcase the potential social benefits of artificial intelligence application for elderly and establish a step forward to develop ML approaches, for the subsequent application of simple behavioral objective testing for dementia onset diagnostics replacing subjective MoCA. △ Less

Submitted 25 November, 2019; originally announced November 2019.

Comments: 4 pages, 2 figures, accepted for a presentation at AI for Social Good workshop at NeurIPS (2019), Vancouver, Canada

Brain correlates of task-load and dementia elucidation with tensor machine learning using oddball BCI paradigm

Authors: Tomasz M. Rutkowski, Marcin Koculak, Masato S. Abe, Mihoko Otake-Matsuura

Abstract: Dementia in the elderly has recently become the most usual cause of cognitive decline. The proliferation of dementia cases in aging societies creates a remarkable economic as well as medical problems in many communities worldwide. A recently published report by The World Health Organization (WHO) estimates that about 47 million people are suffering from dementia-related neurocognitive declines wor… ▽ More Dementia in the elderly has recently become the most usual cause of cognitive decline. The proliferation of dementia cases in aging societies creates a remarkable economic as well as medical problems in many communities worldwide. A recently published report by The World Health Organization (WHO) estimates that about 47 million people are suffering from dementia-related neurocognitive declines worldwide. The number of dementia cases is predicted by 2050 to triple, which requires the creation of an AI-based technology application to support interventions with early screening for subsequent mental wellbeing checking as well as preservation with digital-pharma (the so-called beyond a pill) therapeutical approaches. We present an attempt and exploratory results of brain signal (EEG) classification to establish digital biomarkers for dementia stage elucidation. We discuss a comparison of various machine learning approaches for automatic event-related potentials (ERPs) classification of a high and low task-load sound stimulus recognition. These ERPs are similar to those in dementia. The proposed winning method using tensor-based machine learning in a deep fully connected neural network setting is a step forward to develop AI-based approaches for a subsequent application for subjective- and mild-cognitive impairment (SCI and MCI) diagnostics. △ Less

Submitted 18 June, 2019; originally announced June 2019.

Comments: In ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 8578-8582, May 2019

AI Neurotechnology for Aging Societies -- Task-load and Dementia EEG Digital Biomarker Development Using Information Geometry Machine Learning Methods

Authors: Tomasz M. Rutkowski, Qibin Zhao, Masao S. Abe, Mihoko Otake

Abstract: Dementia and especially Alzheimer's disease (AD) are the most common causes of cognitive decline in elderly people. A spread of the above mentioned mental health problems in aging societies is causing a significant medical and economic burden in many countries around the world. According to a recent World Health Organization (WHO) report, it is approximated that currently, worldwide, about 47 mill… ▽ More Dementia and especially Alzheimer's disease (AD) are the most common causes of cognitive decline in elderly people. A spread of the above mentioned mental health problems in aging societies is causing a significant medical and economic burden in many countries around the world. According to a recent World Health Organization (WHO) report, it is approximated that currently, worldwide, about 47 million people live with a dementia spectrum of neurocognitive disorders. This number is expected to triple by 2050, which calls for possible application of AI-based technologies to support an early screening for preventive interventions and a subsequent mental wellbeing monitoring as well as maintenance with so-called digital-pharma or beyond a pill therapeutical approaches. This paper discusses our attempt and preliminary results of brainwave (EEG) techniques to develop digital biomarkers for dementia progress detection and monitoring. We present an information geometry-based classification approach for automatic EEG-derived event related responses (ERPs) discrimination of low versus high task-load auditory or tactile stimuli recognition, of which amplitude and latency variabilities are similar to those in dementia. The discussed approach is a step forward to develop AI, and especially machine learning (ML) approaches, for the subsequent application to mild-cognitive impairment (MCI) and AD diagnostics. △ Less

Submitted 30 November, 2018; originally announced November 2018.

Comments: 5 pages, 2 figures, NeurIPS 2018 AI for Social Good Workshop at the Neural Information Processing Systems (NeurIPS = formerly NIPS) 2018. Montreal, Canada

Chromatic and High-frequency cVEP-based BCI Paradigm

Authors: Daiki Aminaka, Shoji Makino, Tomasz M. Rutkowski

Abstract: We present results of an approach to a code-modulated visual evoked potential (cVEP) based brain-computer interface (BCI) paradigm using four high-frequency flashing stimuli. To generate higher frequency stimulation compared to the state-of-the-art cVEP-based BCIs, we propose to use the light-emitting diodes (LEDs) driven from a small micro-controller board hardware generator designed by our team.… ▽ More We present results of an approach to a code-modulated visual evoked potential (cVEP) based brain-computer interface (BCI) paradigm using four high-frequency flashing stimuli. To generate higher frequency stimulation compared to the state-of-the-art cVEP-based BCIs, we propose to use the light-emitting diodes (LEDs) driven from a small micro-controller board hardware generator designed by our team. The high-frequency and green-blue chromatic flashing stimuli are used in the study in order to minimize a danger of a photosensitive epilepsy (PSE). We compare the the green-blue chromatic cVEP-based BCI accuracies with the conventional white-black flicker based interface. △ Less

Submitted 22 June, 2015; v1 submitted 14 June, 2015; originally announced June 2015.

Comments: 4 pages, 4 figures, accepted for EMBC 2015, IEEE copyright

Inter-stimulus Interval Study for the Tactile Point-pressure Brain-computer Interface

Authors: Kensuke Shimizu, Shoji Makino, Tomasz M. Rutkowski

Abstract: The paper presents a study of an inter-stimulus interval (ISI) influence on a tactile point-pressure stimulus-based brain-computer interface's (tpBCI) classification accuracy. A novel tactile pressure generating tpBCI stimulator is also discussed, which is based on a three-by-three pins' matrix prototype. The six pin-linear patterns are presented to the user's palm during the online tpBCI experime… ▽ More The paper presents a study of an inter-stimulus interval (ISI) influence on a tactile point-pressure stimulus-based brain-computer interface's (tpBCI) classification accuracy. A novel tactile pressure generating tpBCI stimulator is also discussed, which is based on a three-by-three pins' matrix prototype. The six pin-linear patterns are presented to the user's palm during the online tpBCI experiments in an oddball style paradigm allowing for "the aha-responses" elucidation, within the event related potential (ERP). A subsequent classification accuracies' comparison is discussed based on two ISI settings in an online tpBCI application. A research hypothesis of classification accuracies' non-significant differences with various ISIs is confirmed based on the two settings of 120 ms and 300 ms, as well as with various numbers of ERP response averaging scenarios. △ Less

Submitted 14 June, 2015; originally announced June 2015.

Comments: 4 pages, 5 figures, accepted for EMBC 2015, IEEE copyright

Head-related Impulse Response Cues for Spatial Auditory Brain-computer Interface

Authors: Chisaki Nakaizumi, Shoji Makino, Tomasz M. Rutkowski

Abstract: This study provides a comprehensive test of a head-related impulse response (HRIR) cues for a spatial auditory brain-computer interface (saBCI) speller paradigm. We present a comparison with the conventional virtual sound headphone-based spatial auditory modality. We propose and optimize the three types of sound spatialization settings using a variable elevation in order to evaluate the HRIR effic… ▽ More This study provides a comprehensive test of a head-related impulse response (HRIR) cues for a spatial auditory brain-computer interface (saBCI) speller paradigm. We present a comparison with the conventional virtual sound headphone-based spatial auditory modality. We propose and optimize the three types of sound spatialization settings using a variable elevation in order to evaluate the HRIR efficacy for the saBCI. Three experienced and seven naive BCI users participated in the three experimental setups based on ten presented Japanese syllables. The obtained EEG auditory evoked potentials (AEP) resulted with encouragingly good and stable P300 responses in online BCI experiments. Our case study indicated that users could perceive elevation in the saBCI experiments generated using the HRIR measured from a general head model. The saBCI accuracy and information transfer rate (ITR) scores have been improved comparing to the classical horizontal plane-based virtual spatial sound reproduction modality, as far as the healthy users in the current pilot study are concerned. △ Less

Submitted 14 June, 2015; originally announced June 2015.

Comments: 4 pages, 4 figures, accepted for EMBC 2015, IEEE copyright

Student Teaching and Research Laboratory Focusing on Brain-computer Interface Paradigms - A Creative Environment for Computer Science Students -

Authors: Tomasz M. Rutkowski

Abstract: This paper presents an applied concept of a brain-computer interface (BCI) student research laboratory (BCI-LAB) at the Life Science Center of TARA, University of Tsukuba, Japan. Several successful case studies of the student projects are reviewed together with the BCI Research Award 2014 winner case. The BCI-LAB design and project-based teaching philosophy is also explained. Future teaching and r… ▽ More This paper presents an applied concept of a brain-computer interface (BCI) student research laboratory (BCI-LAB) at the Life Science Center of TARA, University of Tsukuba, Japan. Several successful case studies of the student projects are reviewed together with the BCI Research Award 2014 winner case. The BCI-LAB design and project-based teaching philosophy is also explained. Future teaching and research directions summarize the review. △ Less

Submitted 13 June, 2015; originally announced June 2015.

Comments: 4 pages, 4 figures, accepted for EMBC 2015, IEEE copyright

Two-step Input Spatial Auditory BCI for Japanese Kana Characters

Authors: Moonjeong Chang, Tomasz M. Rutkowski

Abstract: We present an auditory stimulus optimization and a pilot study of a two-step input speller application combined with a spatial auditory brain-computer interface (saBCI) for paralyzed users. The application has been developed for 45, out of 48 defining the full set, Japanese kana characters in a two-step input procedure setting for an easy-to-use BCI-speller interface. The user first selects the re… ▽ More We present an auditory stimulus optimization and a pilot study of a two-step input speller application combined with a spatial auditory brain-computer interface (saBCI) for paralyzed users. The application has been developed for 45, out of 48 defining the full set, Japanese kana characters in a two-step input procedure setting for an easy-to-use BCI-speller interface. The user first selects the representative letter of a subset, defining the second step. In the second step, the final choice is made. At each interfacing step, the choices are classified based on the P300 event related potential (ERP) responses captured in the EEG, as in the classic oddball paradigm. The BCI online experiment and EEG responses classification results of the pilot study confirm the effectiveness of the proposed spelling method. △ Less

Submitted 10 March, 2015; originally announced March 2015.

Comments: 7 pages, 2 figures, accepted for publication in Advances in Cognitive Neurodynamics Volume 5 -- Proceedings of the 5th International Conference on Cognitive Neurodynamics (ICCN 2015)

ACM Class: H.5.2; H.1.2

Airborne Ultrasonic Tactile Display Brain-computer Interface -- A Small Robotic Arm Online Control Study

Authors: Tomasz M. Rutkowski, Hiromu Mori, Takumi Kodama, Hiroyuki Shinoda

Abstract: We report on an extended robot control application of a contact-less and airborne ultrasonic tactile display (AUTD) stimulus-based brain-computer interface (BCI) paradigm, which received last year The Annual BCI Research Award 2014. In the award winning human communication augmentation paradigm the six palm positions are used to evoke somatosensory brain responses, in order to define a novel conta… ▽ More We report on an extended robot control application of a contact-less and airborne ultrasonic tactile display (AUTD) stimulus-based brain-computer interface (BCI) paradigm, which received last year The Annual BCI Research Award 2014. In the award winning human communication augmentation paradigm the six palm positions are used to evoke somatosensory brain responses, in order to define a novel contactless tactile BCI. An example application of a small robot management is also presented in which the users control a small robot online. △ Less

Submitted 30 January, 2015; originally announced February 2015.

Comments: 2 pages, 1 figure, accepted for 10th AEARU Workshop on Computer Science and Web Technology February 25-27, 2015, University of Tsukuba, Japan

ACM Class: H.5.2; H.1.2

Airborne Ultrasonic Tactile Display BCI

Authors: Katsuhiko Hamada, Hiromu Mori, Hiroyuki Shinoda, Tomasz M. Rutkowski

Abstract: This chapter presents results of our project, which studied whether contactless and airborne ultrasonic tactile display (AUTD) stimuli delivered to a user's palms could serve as a platform for a brain computer interface (BCI) paradigm. We used six palm positions to evoke combined somatosensory brain responses to implement a novel contactless tactile BCI. This achievement was awarded the top prize… ▽ More This chapter presents results of our project, which studied whether contactless and airborne ultrasonic tactile display (AUTD) stimuli delivered to a user's palms could serve as a platform for a brain computer interface (BCI) paradigm. We used six palm positions to evoke combined somatosensory brain responses to implement a novel contactless tactile BCI. This achievement was awarded the top prize in the Annual BCI Research Award 2014 competition. This chapter also presents a comparison with a classical attached vibrotactile transducer-based BCI paradigm. Experiment results from subjects performing online experiments validate the novel BCI paradigm. △ Less

Submitted 2 January, 2016; v1 submitted 6 January, 2015; originally announced January 2015.

Comments: arXiv admin note: substantial text overlap with arXiv:1404.4184

ACM Class: H.5.2, H.1.2

Journal ref: Brain-Computer Interface Research - A State-of-the-Art Summary 4. SpringerBriefs in Electrical and Computer Engineering. 2015. p. 57-65

Spatial Tactile Brain-Computer Interface Paradigm Applying Vibration Stimuli to Large Areas of User's Back

Authors: Takumi Kodama, Shoji Makino, Tomasz M. Rutkowski

Abstract: We aim at an augmentation of communication abilities of amyotrophic lateral sclerosis (ALS) patients by creating a brain-computer interface (BCI) which can control a computer or other device by using only brain activity. As a method, we use a stimulus-driven BCI based on vibration stimuli delivered via a gaming pad to the user's back. We identify P300 responses from brain activity data in response… ▽ More We aim at an augmentation of communication abilities of amyotrophic lateral sclerosis (ALS) patients by creating a brain-computer interface (BCI) which can control a computer or other device by using only brain activity. As a method, we use a stimulus-driven BCI based on vibration stimuli delivered via a gaming pad to the user's back. We identify P300 responses from brain activity data in response to the vibration stimuli. The user's intentions are classified according to the P300 responses recorded in the EEG. From the results of the psychophysical and online BCI experiments, we are able to classify the P300 responses very accurately, which proves the effectiveness of the proposed method. △ Less

Submitted 16 April, 2014; originally announced April 2014.

Comments: 5 pages, 4 figures, submitted to 6th International Brain-Computer Interface Conference 2014, Graz, Austria

Airborne Ultrasonic Tactile Display Brain-computer Interface Paradigm

Authors: Katsuhiko Hamada, Hiromu Mori, Hiroyuki Shinoda, Tomasz M. Rutkowski

Abstract: We study the extent to which contact-less and airborne ultrasonic tactile display (AUTD) stimuli delivered to the palms of a user can serve as a platform for a brain computer interface (BCI) paradigm. Six palm positions are used to evoke combined somatosensory brain responses, in order to define a novel contact-less tactile BCI. A comparison is made with classical attached vibrotactile transducers… ▽ More We study the extent to which contact-less and airborne ultrasonic tactile display (AUTD) stimuli delivered to the palms of a user can serve as a platform for a brain computer interface (BCI) paradigm. Six palm positions are used to evoke combined somatosensory brain responses, in order to define a novel contact-less tactile BCI. A comparison is made with classical attached vibrotactile transducers. Experiment results of subjects performing online experiments validate the novel BCI paradigm. △ Less

Submitted 16 April, 2014; originally announced April 2014.

Comments: 5 pages, 3 figures, submitted to 6th International Brain-Computer Interface Conference 2014, Graz, Austria

Head-related Impulse Response-based Spatial Auditory Brain-computer Interface

Authors: Chisaki Nakaizumi, Toshie Matsui, Koichi Mori, Shoji Makino, Tomasz M. Rutkowski

Abstract: This study provides a comprehensive test of the head-related impulse response (HRIR) to an auditory spatial speller brain-computer interface (BCI) paradigm, including a comparison with a conventional virtual headphone-based spatial auditory modality. Five BCI-naive users participated in an experiment based on five Japanese vowels. The auditory evoked potentials obtained produced encouragingly good… ▽ More This study provides a comprehensive test of the head-related impulse response (HRIR) to an auditory spatial speller brain-computer interface (BCI) paradigm, including a comparison with a conventional virtual headphone-based spatial auditory modality. Five BCI-naive users participated in an experiment based on five Japanese vowels. The auditory evoked potentials obtained produced encouragingly good and stable P300-responses in online BCI experiments. Our case study indicates that the auditory HRIR spatial sound paradigm reproduced with headphones could be a viable alternative to established multi-loudspeaker surround sound BCI-speller applications. △ Less

Submitted 15 April, 2014; originally announced April 2014.

Comments: 5 pages, 1 figure, submitted to 6th International Brain-Computer Interface Conference 2014, Graz, Austria

Auditory Brain-Computer Interface Paradigm with Head Related Impulse Response-based Spatial Cues

Authors: Chisaki Nakaizumi, Koichi Mori, Toshie Matsui, Shoji Makino, Tomasz M. Rutkowski

Abstract: The aim of this study is to provide a comprehensive test of head related impulse response (HRIR) for an auditory spatial speller brain-computer interface (BCI) paradigm. The study is conducted with six users in an experimental set up based on five Japanese hiragana vowels. Auditory evoked potentials resulted with encouragingly good and stable "aha-" or P300-responses in real-world online BCI exper… ▽ More The aim of this study is to provide a comprehensive test of head related impulse response (HRIR) for an auditory spatial speller brain-computer interface (BCI) paradigm. The study is conducted with six users in an experimental set up based on five Japanese hiragana vowels. Auditory evoked potentials resulted with encouragingly good and stable "aha-" or P300-responses in real-world online BCI experiments. Our case study indicated that the auditory HRIR spatial sound reproduction paradigm could be a viable alternative to the established multi-loudspeaker surround sound BCI-speller applications, as far as healthy pilot study users are concerned. △ Less

Submitted 14 December, 2013; originally announced December 2013.

Comments: The final publication is available at IEEE Xplore http://ieeexplore.ieee.org and the copyright of the final version has been transferred to IEEE (c)2013

Journal ref: Proceedings of the 9th International Conference on Signal Image Technology and Internet Based Systems. Kyoto, Japan: IEEE Computer Society; 2013. p. 806-811

EEG Signal Processing and Classification for the Novel Tactile-Force Brain-Computer Interface Paradigm

Authors: Shota Kono, Daiki Aminaka, Shoji Makino, Tomasz M. Rutkowski

Abstract: The presented study explores the extent to which tactile-force stimulus delivered to a hand holding a joystick can serve as a platform for a brain computer interface (BCI). The four pressure directions are used to evoke tactile brain potential responses, thus defining a tactile-force brain computer interface (tfBCI). We present brain signal processing and classification procedures leading to succe… ▽ More The presented study explores the extent to which tactile-force stimulus delivered to a hand holding a joystick can serve as a platform for a brain computer interface (BCI). The four pressure directions are used to evoke tactile brain potential responses, thus defining a tactile-force brain computer interface (tfBCI). We present brain signal processing and classification procedures leading to successful interfacing results. Experimental results with seven subjects performing online BCI experiments provide a validation of the hand location tfBCI paradigm, while the feasibility of the concept is illuminated through remarkable information-transfer rates. △ Less

Submitted 17 October, 2013; v1 submitted 6 October, 2013; originally announced October 2013.

Comments: 6 pages (in conference proceedings original version); 6 figures, submitted to The 9th International Conference on Signal Image Technology & Internet Based Systems, December 2-5, 2013, Kyoto, Japan; to be available at IEEE Xplore; IEEE Copyright 2013

MSC Class: 92C55; 92C50; 92C30 ACM Class: D.2.2; H.5.2

Journal ref: Proceedings of the 9th International Conference on Signal Image Technology and Internet Based Systems, (Kyoto, Japan), pp. 812-817, IEEE Computer Society, December 3-5, 2013

Beyond visual P300 based brain-computer interfacing paradigms

Authors: Tomasz M. Rutkowski

Abstract: The paper reviews and summarizes recent developments in spatial auditory and tactile brain-computer interfacing neurotechology applications. It serves as the latest developments summary in "non-visual" brain-computer interfacing solutions presented in a tutorial delivered by the author at the IICST 2013 workshop. The novel concepts of unimodal auditory or tactile, as well as a bimodal combined par… ▽ More The paper reviews and summarizes recent developments in spatial auditory and tactile brain-computer interfacing neurotechology applications. It serves as the latest developments summary in "non-visual" brain-computer interfacing solutions presented in a tutorial delivered by the author at the IICST 2013 workshop. The novel concepts of unimodal auditory or tactile, as well as a bimodal combined paradigms are described and supported with recent research results from our BCI-lab research group at Life Science Center, University of Tsukuba, Japan. The newly developed experimental paradigms fit perfectly to needs of paralyzed or hearing impaired users, in case of tactile stimulus, as well as for able users who cannot utilize vision in computer or machine interaction (driving or operation of machinery required not disturbed eyesight). We present and review the EEG event related potential responses useful for brain computer interfacing applications beyond state-of-the-art visual paradigms. In conclusion the recent results are discussed and suggestions for further applications are drawn. △ Less

Submitted 9 September, 2013; originally announced September 2013.

Comments: 7 pages, 5 figures, Proceedings of the Third Postgraduate Consortium International Workshop on Innovations in Information and Communication Science and Technology, (E. Cooper, G. A. Kobzev, A. F. Uvarov, and V. V. Kryssanov, eds.), (Tomsk, Russia), pp. 277-283, TUSUR and Ritsumeikan, September 2-5, 2013. ISBN 978-5-86889-7

MSC Class: 92C55; 92C50; 92C30 ACM Class: D.2.2; H.5.2

Novel Virtual Moving Sound-based Spatial Auditory Brain-Computer Interface Paradigm

Authors: Yohann Lelievre, Tomasz M. Rutkowski

Abstract: This paper reports on a study in which a novel virtual moving sound-based spatial auditory brain-computer interface (BCI) paradigm is developed. Classic auditory BCIs rely on spatially static stimuli, which are often boring and difficult to perceive when subjects have non-uniform spatial hearing perception characteristics. The concept of moving sound proposed and tested in the paper allows for the… ▽ More This paper reports on a study in which a novel virtual moving sound-based spatial auditory brain-computer interface (BCI) paradigm is developed. Classic auditory BCIs rely on spatially static stimuli, which are often boring and difficult to perceive when subjects have non-uniform spatial hearing perception characteristics. The concept of moving sound proposed and tested in the paper allows for the creation of a P300 oddball paradigm of necessary target and non-target auditory stimuli, which are more interesting and easier to distinguish. We present a report of our study of seven healthy subjects, which proves the concept of moving sound stimuli usability for a novel BCI. We compare online BCI classification results in static and moving sound paradigms yielding similar accuracy results. The subject preference reports suggest that the proposed moving sound protocol is more comfortable and easier to discriminate with the online BCI. △ Less

Submitted 14 August, 2013; v1 submitted 12 August, 2013; originally announced August 2013.

Comments: 4 pages (in conference proceedings original version); 6 figures, accepted at 6th International IEEE EMBS Conference on Neural Engineering, November 6-8, 2013, Sheraton San Diego Hotel & Marina, San Diego, CA; paper ID 465; to be available at IEEE Xplore; IEEE Copyright 2013

MSC Class: 92C55; 92C50; 92C30 ACM Class: D.2.2; H.5.2

Journal ref: Neural Engineering (NER), 2013 6th International IEEE/EMBS Conference on. IEEE Engineering in Medicine and Biology Society; 2013. p. 9-12

Multi-command Chest Tactile Brain Computer Interface for Small Vehicle Robot Navigation

Authors: Hiromu Mori, Shoji Makino, Tomasz M. Rutkowski

Abstract: The presented study explores the extent to which tactile stimuli delivered to five chest positions of a healthy user can serve as a platform for a brain computer interface (BCI) that could be used in an interactive application such as robotic vehicle operation. The five chest locations are used to evoke tactile brain potential responses, thus defining a tactile brain computer interface (tBCI). Exp… ▽ More The presented study explores the extent to which tactile stimuli delivered to five chest positions of a healthy user can serve as a platform for a brain computer interface (BCI) that could be used in an interactive application such as robotic vehicle operation. The five chest locations are used to evoke tactile brain potential responses, thus defining a tactile brain computer interface (tBCI). Experimental results with five subjects performing online tBCI provide a validation of the chest location tBCI paradigm, while the feasibility of the concept is illuminated through information-transfer rates. Additionally an offline classification improvement with a linear SVM classifier is presented through the case study. △ Less

Submitted 28 July, 2013; originally announced July 2013.

Comments: accepted as a full paper for The 2013 International Conference on Brain and Health Informatics; to appear in Lecture Notes in Computer Science (LNCS), Springer Verlag Berlin Heidelberg, 2013; http://link.springer.com/

Multi-command Tactile Brain Computer Interface: A Feasibility Study

Authors: Hiromu Mori, Yoshihiro Matsumoto, Victor Kryssanov, Eric Cooper, Hitoshi Ogawa, Shoji Makino, Zbigniew R. Struzik, Tomasz M. Rutkowski

Abstract: The study presented explores the extent to which tactile stimuli delivered to the ten digits of a BCI-naive subject can serve as a platform for a brain computer interface (BCI) that could be used in an interactive application such as robotic vehicle operation. The ten fingertips are used to evoke somatosensory brain responses, thus defining a tactile brain computer interface (tBCI). Experimental r… ▽ More The study presented explores the extent to which tactile stimuli delivered to the ten digits of a BCI-naive subject can serve as a platform for a brain computer interface (BCI) that could be used in an interactive application such as robotic vehicle operation. The ten fingertips are used to evoke somatosensory brain responses, thus defining a tactile brain computer interface (tBCI). Experimental results on subjects performing online (real-time) tBCI, using stimuli with a moderately fast inter-stimulus-interval (ISI), provide a validation of the tBCI prototype, while the feasibility of the concept is illuminated through information-transfer rates obtained through the case study. △ Less

Submitted 18 May, 2013; originally announced May 2013.

Comments: Haptic and Audio Interaction Design 2013, Daejeon, Korea, April 18-19, 2013, 15 pages, 4 figures, The final publication will be available at link.springer.com

Comparison of P300 Responses in Auditory, Visual and Audiovisual Spatial Speller BCI Paradigms

Authors: M. Chang, N. Nishikawa, Z. R. Struzik, K. Mori, S. Makino, D. Mandic, T. M. Rutkowski

Abstract: The aim of this study is to provide a comprehensive test of three spatial speller settings, for the auditory, visual, and audiovisual paradigms. For rigour, the study is conducted with 16 BCI-naïve subjects in an experimental set-up based on five Japanese hiragana characters. Auditory P300 responses give encouragingly longer target vs. non-target latencies during the training phase, however, real-… ▽ More The aim of this study is to provide a comprehensive test of three spatial speller settings, for the auditory, visual, and audiovisual paradigms. For rigour, the study is conducted with 16 BCI-naïve subjects in an experimental set-up based on five Japanese hiragana characters. Auditory P300 responses give encouragingly longer target vs. non-target latencies during the training phase, however, real-world online BCI experiments in the multimodal setting do not validate this potential advantage. Our case studies indicate that the auditory spatial unimodal paradigm needs further development in order to be a viable alternative to the established visual domain speller applications, as far as BCI-naïve subjects are concerned. △ Less

Submitted 12 May, 2013; v1 submitted 27 January, 2013; originally announced January 2013.

Comments: Proceedings of the Fifth International Brain-Computer Interface Meeting 2013, 2 pages, 1 figure

Multi-command Tactile and Auditory Brain Computer Interface based on Head Position Stimulation

Authors: H. Mori, Y. Matsumoto, Z. R. Struzik, K. Mori, S. Makino, D. Mandic, T. M. Rutkowski

Abstract: We study the extent to which vibrotactile stimuli delivered to the head of a subject can serve as a platform for a brain computer interface (BCI) paradigm. Six head positions are used to evoke combined somatosensory and auditory (via the bone conduction effect) brain responses, in order to define a multimodal tactile and auditory brain computer interface (taBCI). Experimental results of subjects p… ▽ More We study the extent to which vibrotactile stimuli delivered to the head of a subject can serve as a platform for a brain computer interface (BCI) paradigm. Six head positions are used to evoke combined somatosensory and auditory (via the bone conduction effect) brain responses, in order to define a multimodal tactile and auditory brain computer interface (taBCI). Experimental results of subjects performing online taBCI, using stimuli with a moderately fast inter-stimulus interval (ISI), validate the taBCI paradigm, while the feasibility of the concept is illuminated through information transfer rate case studies. △ Less

Submitted 12 May, 2013; v1 submitted 27 January, 2013; originally announced January 2013.

Comments: Proceedings of the Fifth International Brain-Computer Interface Meeting 2013, 2 pages, 1 figure

Multicommand Tactile Brain Computer Interface based on Fingertips or Head Stimulation

Authors: Hiromu Mori, Yoshihiro Matsumoto, Koichi Mori, Victor Kryssanov, Shoji Makino, Zbigniew R. Struzik, Gen Hori, Tomasz M. Rutkowski

Abstract: The paper presents results from a computational neuroscience study conducted to test vibrotactile stimuli delivered to subject fingertips and head areas in order to evoke the somatosensory brain responses utilized in a haptic brain computer interface (hBCI) paradigm. We present the preliminary and very encouraging results, with subjects conducting online hBCI interfacing experiments, ranging from… ▽ More The paper presents results from a computational neuroscience study conducted to test vibrotactile stimuli delivered to subject fingertips and head areas in order to evoke the somatosensory brain responses utilized in a haptic brain computer interface (hBCI) paradigm. We present the preliminary and very encouraging results, with subjects conducting online hBCI interfacing experiments, ranging from 40% to 90% with a very fast inter-stimulus-interval (ISI) of 250ms. The presented results confirm our hypothesis that the hBCI paradigm concept is valid and it allows for rapid stimuli presentation in order to achieve a satisfactory information-transfer-rate of the novel BCI. △ Less

Submitted 24 January, 2013; v1 submitted 11 November, 2012; originally announced November 2012.

Comments: This paper has been withdrawn by the author due to extension of the research and submission to the other conference

Psychophysical Responses Comparison in Spatial Visual, Audiovisual, and Auditory BCI-Spelling Paradigms

Authors: Moonjeong Chang, Nozomu Nishikawa, Zhenyu Cai, Shoji Makino, Tomasz M. Rutkowski

Abstract: The paper presents a pilot study conducted with spatial visual, audiovisual and auditory brain-computer-interface (BCI) based speller paradigms. The psychophysical experiments are conducted with healthy subjects in order to evaluate a difficulty and a possible response accuracy variability. We also present preliminary EEG results in offline BCI mode. The obtained results validate a thesis, that sp… ▽ More The paper presents a pilot study conducted with spatial visual, audiovisual and auditory brain-computer-interface (BCI) based speller paradigms. The psychophysical experiments are conducted with healthy subjects in order to evaluate a difficulty and a possible response accuracy variability. We also present preliminary EEG results in offline BCI mode. The obtained results validate a thesis, that spatial auditory only paradigm performs as good as the traditional visual and audiovisual speller BCI tasks. △ Less

Submitted 10 October, 2012; originally announced October 2012.

Comments: The 6th International Conference on Soft Computing and Intelligent Systems and The 13th International Symposium on Advanced Intelligent Systems, 2012

The Spatial Real and Virtual Sound Stimuli Optimization for the Auditory BCI

Authors: Nozomu Nishikawa, Yoshihiro Matsumoto, Shoji Makino, Tomasz M. Rutkowski

Abstract: The paper presents results from a project aiming to create horizontally distributed surround sound sources and virtual sound images as auditory BCI (aBCI) stimuli. The purpose is to create evoked brain wave response patterns depending on attended or ignored sound directions. We propose to use a modified version of the vector based amplitude panning (VBAP) approach to achieve the goal. The so creat… ▽ More The paper presents results from a project aiming to create horizontally distributed surround sound sources and virtual sound images as auditory BCI (aBCI) stimuli. The purpose is to create evoked brain wave response patterns depending on attended or ignored sound directions. We propose to use a modified version of the vector based amplitude panning (VBAP) approach to achieve the goal. The so created spatial sound stimulus system for the novel oddball aBCI paradigm allows us to create a multi-command experimental environment with very encouraging results reported in this paper. We also present results showing that a modulation of the sound image depth changes also the subject responses. Finally, we also compare the proposed virtual sound approach with the traditional one based on real sound sources generated from the real loudspeaker directions. The so obtained results confirm the hypothesis of the possibility to modulate independently the brain responses to spatial types and depths of sound sources which allows for the development of the novel multi-command aBCI. △ Less

Submitted 10 October, 2012; originally announced October 2012.

Comments: APSIPA ASC 2012

Spatial Auditory BCI Paradigm Utilizing N200 and P300 Responses

Authors: Zhenyu Cai, Shoji Makino, Takeshi Yamada, Tomasz M. Rutkowski

Abstract: The paper presents our recent results obtained with a new auditory spatial localization based BCI paradigm in which the ERP shape differences at early latencies are employed to enhance the traditional P300 responses in an oddball experimental setting. The concept relies on the recent results in auditory neuroscience showing a possibility to differentiate early anterior contralateral responses to a… ▽ More The paper presents our recent results obtained with a new auditory spatial localization based BCI paradigm in which the ERP shape differences at early latencies are employed to enhance the traditional P300 responses in an oddball experimental setting. The concept relies on the recent results in auditory neuroscience showing a possibility to differentiate early anterior contralateral responses to attended spatial sources. Contemporary stimuli-driven BCI paradigms benefit mostly from the P300 ERP latencies in so called "aha-response" settings. We show the further enhancement of the classification results in spatial auditory paradigms by incorporating the N200 latencies, which differentiate the brain responses to lateral, in relation to the subject head, sound locations in the auditory space. The results reveal that those early spatial auditory ERPs boost online classification results of the BCI application. The online BCI experiments with the multi-command BCI prototype support our research hypothesis with the higher classification results and the improved information-transfer-rates. △ Less

Submitted 10 October, 2012; originally announced October 2012.

Comments: APSIPA ASC 2012

Auditory Steady-State Response Stimuli based BCI Application - The Optimization of the Stimuli Types and Lengths

Authors: Yoshihiro Matsumoto, Nozomu Nishikawa, Takeshi Yamada, Shoji Makino, Tomasz M. Rutkowski

Abstract: We propose a method for an improvement of auditory BCI (aBCI) paradigm based on a combination of ASSR stimuli optimization by choosing the subjects' best responses to AM-, flutter-, AM/FM and click-envelope modulated sounds. As the ASSR response features we propose pairwise phase-locking-values calculated from the EEG and next classified using binary classifier to detect attended and ignored stimu… ▽ More We propose a method for an improvement of auditory BCI (aBCI) paradigm based on a combination of ASSR stimuli optimization by choosing the subjects' best responses to AM-, flutter-, AM/FM and click-envelope modulated sounds. As the ASSR response features we propose pairwise phase-locking-values calculated from the EEG and next classified using binary classifier to detect attended and ignored stimuli. We also report on a possibility to use the stimuli as short as half a second, which is a step forward in ASSR based aBCI. The presented results are helpful for optimization of the aBCI stimuli for each subject. △ Less

Submitted 10 October, 2012; originally announced October 2012.

Comments: APSIPA ASC 2012

Vibrotactile Stimulus Frequency Optimization for the Haptic BCI Prototype

Authors: Hiromu Mori, Yoshihiro Matsumito, Shoji Makino, Victor Kryssanov, Tomasz M. Rutkowski

Abstract: The paper presents results from a psychophysical study conducted to optimize vibrotactile stimuli delivered to subject finger tips in order to evoke the somatosensory responses to be utilized next in a haptic brain computer interface (hBCI) paradigm. We also present the preliminary EEG evoked responses for the chosen stimulating frequency. The obtained results confirm our hypothesis that the hBCI… ▽ More The paper presents results from a psychophysical study conducted to optimize vibrotactile stimuli delivered to subject finger tips in order to evoke the somatosensory responses to be utilized next in a haptic brain computer interface (hBCI) paradigm. We also present the preliminary EEG evoked responses for the chosen stimulating frequency. The obtained results confirm our hypothesis that the hBCI paradigm concept is valid and it will allow for rapid stimuli presentation in order to improve information-transfer-rate (ITR) of the BCI. △ Less

Submitted 10 October, 2012; v1 submitted 10 October, 2012; originally announced October 2012.

Comments: The 6th International Conference on Soft Computing and Intelligent Systems and The 13th International Symposium on Advanced Intelligent Systems, 2012

Haptic BCI Paradigm based on Somatosensory Evoked Potential

Authors: Tomasz M. Rutkowski, Hiromu Mori, Yoshihiro Matsumoto, Zhenyu Cai, Moonjeong Chang, Nozomu Nishikawa, Shoji Makino, Koichi Mori

Abstract: A new concept and an online prototype of haptic BCI paradigm are presented. Our main goal is to develop a new, alternative and low cost paradigm, with open-source hardware and software components. We also report results obtained with the novel dry EEG electrodes based signal acquisition system by g.tec, which further improves experimental comfort. We address the following points: a novel applicati… ▽ More A new concept and an online prototype of haptic BCI paradigm are presented. Our main goal is to develop a new, alternative and low cost paradigm, with open-source hardware and software components. We also report results obtained with the novel dry EEG electrodes based signal acquisition system by g.tec, which further improves experimental comfort. We address the following points: a novel application of the BCI; a new methodological approach used compared to earlier projects; a new benefit for potential users of a BCI; the approach working online/in real-time; development of a novel stimuli delivery hardware and software. The results with five healthy subjects and discussion of future developments conclude this submission. △ Less

Submitted 10 October, 2012; v1 submitted 24 July, 2012; originally announced July 2012.

Comments: 2 pages, 1 figure