Showing 1–28 of 28 results for author: Tachibana, K

LLM-jp: A Cross-organizational Project for the Research and Development of Fully Open Japanese LLMs

Authors: LLM-jp, :, Akiko Aizawa, Eiji Aramaki, Bowen Chen, Fei Cheng, Hiroyuki Deguchi, Rintaro Enomoto, Kazuki Fujii, Kensuke Fukumoto, Takuya Fukushima, Namgi Han, Yuto Harada, Chikara Hashimoto, Tatsuya Hiraoka, Shohei Hisada, Sosuke Hosokawa, Lu Jie, Keisuke Kamata, Teruhito Kanazawa, Hiroki Kanezashi, Hiroshi Kataoka, Satoru Katsumata, Daisuke Kawahara, Seiya Kawano , et al. (57 additional authors not shown)

Abstract: This paper introduces LLM-jp, a cross-organizational project for the research and development of Japanese large language models (LLMs). LLM-jp aims to develop open-source and strong Japanese LLMs, and as of this writing, more than 1,500 participants from academia and industry are working together for this purpose. This paper presents the background of the establishment of LLM-jp, summaries of its… ▽ More This paper introduces LLM-jp, a cross-organizational project for the research and development of Japanese large language models (LLMs). LLM-jp aims to develop open-source and strong Japanese LLMs, and as of this writing, more than 1,500 participants from academia and industry are working together for this purpose. This paper presents the background of the establishment of LLM-jp, summaries of its activities, and technical reports on the LLMs developed by LLM-jp. For the latest activities, visit https://llm-jp.nii.ac.jp/en/. △ Less

Submitted 4 July, 2024; originally announced July 2024.

Search for Majorana Neutrinos with the Complete KamLAND-Zen Dataset

Authors: S. Abe, T. Araki, K. Chiba, T. Eda, M. Eizuka, Y. Funahashi, A. Furuto, A. Gando, Y. Gando, S. Goto, T. Hachiya, K. Hata, K. Ichimura, S. Ieki, H. Ikeda, K. Inoue, K. Ishidoshiro, Y. Kamei, N. Kawada, Y. Kishimoto, M. Koga, A. Marthe, Y. Matsumoto, T. Mitsui, H. Miyake , et al. (48 additional authors not shown)

Abstract: We present a search for neutrinoless double-beta ($0νββ$) decay of $^{136}$Xe using the full KamLAND-Zen 800 dataset with 745 kg of enriched xenon, corresponding to an exposure of $2.097$ ton yr of $^{136}$Xe. This updated search benefits from a more than twofold increase in exposure, recovery of photo-sensor gain, and reduced background from muon-induced spallation of xenon. Combining with the se… ▽ More We present a search for neutrinoless double-beta ($0νββ$) decay of $^{136}$Xe using the full KamLAND-Zen 800 dataset with 745 kg of enriched xenon, corresponding to an exposure of $2.097$ ton yr of $^{136}$Xe. This updated search benefits from a more than twofold increase in exposure, recovery of photo-sensor gain, and reduced background from muon-induced spallation of xenon. Combining with the search in the previous KamLAND-Zen phase, we obtain a lower limit for the $0νββ$ decay half-life of $T_{1/2}^{0ν} > 3.8 \times 10^{26}$ yr at 90% C.L., a factor of 1.7 improvement over the previous limit. The corresponding upper limits on the effective Majorana neutrino mass are in the range 28-122 meV using phenomenological nuclear matrix element calculations. △ Less

Submitted 17 June, 2024; originally announced June 2024.

Comments: arXiv admin note: text overlap with arXiv:2203.02139

Audio-conditioned phonemic and prosodic annotation for building text-to-speech models from unlabeled speech data

Authors: Yuma Shirahata, Byeongseon Park, Ryuichi Yamamoto, Kentaro Tachibana

Abstract: This paper proposes an audio-conditioned phonemic and prosodic annotation model for building text-to-speech (TTS) datasets from unlabeled speech samples. For creating a TTS dataset that consists of label-speech paired data, the proposed annotation model leverages an automatic speech recognition (ASR) model to obtain phonemic and prosodic labels from unlabeled speech samples. By fine-tuning a large… ▽ More This paper proposes an audio-conditioned phonemic and prosodic annotation model for building text-to-speech (TTS) datasets from unlabeled speech samples. For creating a TTS dataset that consists of label-speech paired data, the proposed annotation model leverages an automatic speech recognition (ASR) model to obtain phonemic and prosodic labels from unlabeled speech samples. By fine-tuning a large-scale pre-trained ASR model, we can construct the annotation model using a limited amount of label-speech paired data within an existing TTS dataset. To alleviate the shortage of label-speech paired data for training the annotation model, we generate pseudo label-speech paired data using text-only corpora and an auxiliary TTS model. This TTS model is also trained with the existing TTS dataset. Experimental results show that the TTS model trained with the dataset created by the proposed annotation method can synthesize speech as naturally as the one trained with a fully-labeled dataset. △ Less

Submitted 12 June, 2024; originally announced June 2024.

Comments: Accepted to INTERSPEECH 2024

LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning

Authors: Masaya Kawamura, Ryuichi Yamamoto, Yuma Shirahata, Takuya Hasumi, Kentaro Tachibana

Abstract: We introduce LibriTTS-P, a new corpus based on LibriTTS-R that includes utterance-level descriptions (i.e., prompts) of speaking style and speaker-level prompts of speaker characteristics. We employ a hybrid approach to construct prompt annotations: (1) manual annotations that capture human perceptions of speaker characteristics and (2) synthetic annotations on speaking style. Compared to existing… ▽ More We introduce LibriTTS-P, a new corpus based on LibriTTS-R that includes utterance-level descriptions (i.e., prompts) of speaking style and speaker-level prompts of speaker characteristics. We employ a hybrid approach to construct prompt annotations: (1) manual annotations that capture human perceptions of speaker characteristics and (2) synthetic annotations on speaking style. Compared to existing English prompt datasets, our corpus provides more diverse prompt annotations for all speakers of LibriTTS-R. Experimental results for prompt-based controllable TTS demonstrate that the TTS model trained with LibriTTS-P achieves higher naturalness than the model using the conventional dataset. Furthermore, the results for style captioning tasks show that the model utilizing LibriTTS-P generates 2.5 times more accurate words than the model using a conventional dataset. Our corpus, LibriTTS-P, is available at https://github.com/line/LibriTTS-P. △ Less

Submitted 12 June, 2024; originally announced June 2024.

Comments: Accepted to INTERSPEECH 2024

Noise-Robust Voice Conversion by Conditional Denoising Training Using Latent Variables of Recording Quality and Environment

Authors: Takuto Igarashi, Yuki Saito, Kentaro Seki, Shinnosuke Takamichi, Ryuichi Yamamoto, Kentaro Tachibana, Hiroshi Saruwatari

Abstract: We propose noise-robust voice conversion (VC) which takes into account the recording quality and environment of noisy source speech. Conventional denoising training improves the noise robustness of a VC model by learning noisy-to-clean VC process. However, the naturalness of the converted speech is limited when the noise of the source speech is unseen during the training. To this end, our proposed… ▽ More We propose noise-robust voice conversion (VC) which takes into account the recording quality and environment of noisy source speech. Conventional denoising training improves the noise robustness of a VC model by learning noisy-to-clean VC process. However, the naturalness of the converted speech is limited when the noise of the source speech is unseen during the training. To this end, our proposed training conditions a VC model on two latent variables representing the recording quality and environment of the source speech. These latent variables are derived from deep neural networks pre-trained on recording quality assessment and acoustic scene classification and calculated in an utterance-wise or frame-wise manner. As a result, the trained VC model can explicitly learn information about speech degradation during the training. Objective and subjective evaluations show that our training improves the quality of the converted speech compared to the conventional training. △ Less

Submitted 11 June, 2024; originally announced June 2024.

Comments: 5 pages, accepted for INTERSPEECH 2024, audio samples: http://y-saito.sakura.ne.jp/sython/Corpus/SRC4VC/IS2024_CDT_supplementary/demo_cdt.html

SRC4VC: Smartphone-Recorded Corpus for Voice Conversion Benchmark

Authors: Yuki Saito, Takuto Igarashi, Kentaro Seki, Shinnosuke Takamichi, Ryuichi Yamamoto, Kentaro Tachibana, Hiroshi Saruwatari

Abstract: We present SRC4VC, a new corpus containing 11 hours of speech recorded on smartphones by 100 Japanese speakers. Although high-quality multi-speaker corpora can advance voice conversion (VC) technologies, they are not always suitable for testing VC when low-quality speech recording is given as the input. To this end, we first asked 100 crowdworkers to record their voice samples using smartphones. T… ▽ More We present SRC4VC, a new corpus containing 11 hours of speech recorded on smartphones by 100 Japanese speakers. Although high-quality multi-speaker corpora can advance voice conversion (VC) technologies, they are not always suitable for testing VC when low-quality speech recording is given as the input. To this end, we first asked 100 crowdworkers to record their voice samples using smartphones. Then, we annotated the recorded samples with speaker-wise recording-quality scores and utterance-wise perceived emotion labels. We also benchmark SRC4VC on any-to-any VC, in which we trained a multi-speaker VC model on high-quality speech and used the SRC4VC speakers' voice samples as the source in VC. The results show that the recording quality mismatch between the training and evaluation data significantly degrades the VC performance, which can be improved by applying speech enhancement to the low-quality source speech samples. △ Less

Submitted 11 June, 2024; originally announced June 2024.

Comments: Accepted for INTERSPEECH 2024, corpus project page: https://y-saito.sakura.ne.jp/sython/Corpus/SRC4VC/index.html

A beam profile monitor for GeV photon with high spatial resolution and fast readout capability

Authors: Ryoko Kino, Takeru Akiyama, Hiroyuki Fujioka, Tomomasa Fujiwara, Tatsuhiro Ishige, Kosuke Itabashi, Shunsuke Kajikawa, Masashi Kaneta, Masaya Mizuno, Sho Nagao, Satoshi N. Nakamura, Kotaro Nishi, Ken Nishida, Kazuki Okuyama, Fumiya Oura, Koga Tachibana, Yuichi Toyama, Daigo Watanabe

Abstract: A beam profile monitor (BPM) has been developed to measure photon beams at the BM4 beamline of the Mikamine site, Research Center for Accelerator and Radioisotope Science (RARIS-Mikamine; previously known as ELPH) at Tohoku University. The BPM comprises plastic scintillation fibers and SiPMs, enabling high-precision, real-time measurements of photon beams in the 1 GeV region. Data acquisition util… ▽ More A beam profile monitor (BPM) has been developed to measure photon beams at the BM4 beamline of the Mikamine site, Research Center for Accelerator and Radioisotope Science (RARIS-Mikamine; previously known as ELPH) at Tohoku University. The BPM comprises plastic scintillation fibers and SiPMs, enabling high-precision, real-time measurements of photon beams in the 1 GeV region. Data acquisition utilized streaming TDC, a firmware commonly employed in the J-PARC Hadron-hall, enabling real-time detection of high-intensity photon beams with count rates reaching several tens of MHz. With sufficient statistical data, the BPM achieved a 1 s beam-profiling accuracy of 10 μm. The proposed BPM serves as a valuable resource for future physics experiments at the BM4 photon beamline and will contribute significantly to ongoing accelerator research endeavors. △ Less

Submitted 28 May, 2024; originally announced May 2024.

PromptTTS++: Controlling Speaker Identity in Prompt-Based Text-to-Speech Using Natural Language Descriptions

Authors: Reo Shimizu, Ryuichi Yamamoto, Masaya Kawamura, Yuma Shirahata, Hironori Doi, Tatsuya Komatsu, Kentaro Tachibana

Abstract: We propose PromptTTS++, a prompt-based text-to-speech (TTS) synthesis system that allows control over speaker identity using natural language descriptions. To control speaker identity within the prompt-based TTS framework, we introduce the concept of speaker prompt, which describes voice characteristics (e.g., gender-neutral, young, old, and muffled) designed to be approximately independent of spe… ▽ More We propose PromptTTS++, a prompt-based text-to-speech (TTS) synthesis system that allows control over speaker identity using natural language descriptions. To control speaker identity within the prompt-based TTS framework, we introduce the concept of speaker prompt, which describes voice characteristics (e.g., gender-neutral, young, old, and muffled) designed to be approximately independent of speaking style. Since there is no large-scale dataset containing speaker prompts, we first construct a dataset based on the LibriTTS-R corpus with manually annotated speaker prompts. We then employ a diffusion-based acoustic model with mixture density networks to model diverse speaker factors in the training data. Unlike previous studies that rely on style prompts describing only a limited aspect of speaker individuality, such as pitch, speaking speed, and energy, our method utilizes an additional speaker prompt to effectively learn the mapping from natural language descriptions to the acoustic features of diverse speakers. Our subjective evaluation results show that the proposed method can better control speaker characteristics than the methods without the speaker prompt. Audio samples are available at https://reppy4620.github.io/demo.promptttspp/. △ Less

Submitted 27 December, 2023; v1 submitted 15 September, 2023; originally announced September 2023.

Comments: Accepted to ICASSP 2024

ChatGPT-EDSS: Empathetic Dialogue Speech Synthesis Trained from ChatGPT-derived Context Word Embeddings

Authors: Yuki Saito, Shinnosuke Takamichi, Eiji Iimori, Kentaro Tachibana, Hiroshi Saruwatari

Abstract: We propose ChatGPT-EDSS, an empathetic dialogue speech synthesis (EDSS) method using ChatGPT for extracting dialogue context. ChatGPT is a chatbot that can deeply understand the content and purpose of an input prompt and appropriately respond to the user's request. We focus on ChatGPT's reading comprehension and introduce it to EDSS, a task of synthesizing speech that can empathize with the interl… ▽ More We propose ChatGPT-EDSS, an empathetic dialogue speech synthesis (EDSS) method using ChatGPT for extracting dialogue context. ChatGPT is a chatbot that can deeply understand the content and purpose of an input prompt and appropriately respond to the user's request. We focus on ChatGPT's reading comprehension and introduce it to EDSS, a task of synthesizing speech that can empathize with the interlocutor's emotion. Our method first gives chat history to ChatGPT and asks it to generate three words representing the intention, emotion, and speaking style for each line in the chat. Then, it trains an EDSS model using the embeddings of ChatGPT-derived context words as the conditioning features. The experimental results demonstrate that our method performs comparably to ones using emotion labels or neural network-derived context embeddings learned from chat histories. The collected ChatGPT-derived context information is available at https://sarulab-speech.github.io/demo_ChatGPT_EDSS/. △ Less

Submitted 23 May, 2023; originally announced May 2023.

Comments: 5 pages, accepted for INTERSPEECH 2023

CALLS: Japanese Empathetic Dialogue Speech Corpus of Complaint Handling and Attentive Listening in Customer Center

Authors: Yuki Saito, Eiji Iimori, Shinnosuke Takamichi, Kentaro Tachibana, Hiroshi Saruwatari

Abstract: We present CALLS, a Japanese speech corpus that considers phone calls in a customer center as a new domain of empathetic spoken dialogue. The existing STUDIES corpus covers only empathetic dialogue between a teacher and student in a school. To extend the application range of empathetic dialogue speech synthesis (EDSS), we designed our corpus to include the same female speaker as the STUDIES teache… ▽ More We present CALLS, a Japanese speech corpus that considers phone calls in a customer center as a new domain of empathetic spoken dialogue. The existing STUDIES corpus covers only empathetic dialogue between a teacher and student in a school. To extend the application range of empathetic dialogue speech synthesis (EDSS), we designed our corpus to include the same female speaker as the STUDIES teacher, acting as an operator in simulated phone calls. We describe a corpus construction methodology and analyze the recorded speech. We also conduct EDSS experiments using the CALLS and STUDIES corpora to investigate the effect of domain differences. The results show that mixing the two corpora during training causes biased improvements in the quality of synthetic speech due to the different degrees of expressiveness. Our project page of the corpus is http://sython.org/Corpus/STUDIES-2. △ Less

Submitted 23 May, 2023; originally announced May 2023.

Comments: 5 pages, accepted for INTERSPEECH2023

Lightweight and High-Fidelity End-to-End Text-to-Speech with Multi-Band Generation and Inverse Short-Time Fourier Transform

Authors: Masaya Kawamura, Yuma Shirahata, Ryuichi Yamamoto, Kentaro Tachibana

Abstract: We propose a lightweight end-to-end text-to-speech model using multi-band generation and inverse short-time Fourier transform. Our model is based on VITS, a high-quality end-to-end text-to-speech model, but adopts two changes for more efficient inference: 1) the most computationally expensive component is partially replaced with a simple inverse short-time Fourier transform, and 2) multi-band gene… ▽ More We propose a lightweight end-to-end text-to-speech model using multi-band generation and inverse short-time Fourier transform. Our model is based on VITS, a high-quality end-to-end text-to-speech model, but adopts two changes for more efficient inference: 1) the most computationally expensive component is partially replaced with a simple inverse short-time Fourier transform, and 2) multi-band generation, with fixed or trainable synthesis filters, is used to generate waveforms. Unlike conventional lightweight models, which employ optimization or knowledge distillation separately to train two cascaded components, our method enjoys the full benefits of end-to-end optimization. Experimental results show that our model synthesized speech as natural as that synthesized by VITS, while achieving a real-time factor of 0.066 on an Intel Core i7 CPU, 4.1 times faster than VITS. Moreover, a smaller version of the model significantly outperformed a lightweight baseline model with respect to both naturalness and inference speed. Code and audio samples are available from https://github.com/MasayaKawamura/MB-iSTFT-VITS. △ Less

Submitted 21 February, 2023; v1 submitted 28 October, 2022; originally announced October 2022.

Comments: Accepted to ICASSP 2023

Period VITS: Variational Inference with Explicit Pitch Modeling for End-to-end Emotional Speech Synthesis

Authors: Yuma Shirahata, Ryuichi Yamamoto, Eunwoo Song, Ryo Terashima, Jae-Min Kim, Kentaro Tachibana

Abstract: Several fully end-to-end text-to-speech (TTS) models have been proposed that have shown better performance compared to cascade models (i.e., training acoustic and vocoder models separately). However, they often generate unstable pitch contour with audible artifacts when the dataset contains emotional attributes, i.e., large diversity of pronunciation and prosody. To address this problem, we propos… ▽ More Several fully end-to-end text-to-speech (TTS) models have been proposed that have shown better performance compared to cascade models (i.e., training acoustic and vocoder models separately). However, they often generate unstable pitch contour with audible artifacts when the dataset contains emotional attributes, i.e., large diversity of pronunciation and prosody. To address this problem, we propose Period VITS, a novel end-to-end TTS model that incorporates an explicit periodicity generator. In the proposed method, we introduce a frame pitch predictor that predicts prosodic features, such as pitch and voicing flags, from the input text. From these features, the proposed periodicity generator produces a sample-level sinusoidal source that enables the waveform decoder to accurately reproduce the pitch. Finally, the entire model is jointly optimized in an end-to-end manner with variational inference and adversarial objectives. As a result, the decoder becomes capable of generating more stable, expressive, and natural output waveforms. The experimental results showed that the proposed model significantly outperforms baseline models in terms of naturalness, with improved pitch stability in the generated samples. △ Less

Submitted 21 February, 2023; v1 submitted 28 October, 2022; originally announced October 2022.

Comments: ICASSP 2023

Nonparallel High-Quality Audio Super Resolution with Domain Adaptation and Resampling CycleGANs

Authors: Reo Yoneyama, Ryuichi Yamamoto, Kentaro Tachibana

Abstract: Neural audio super-resolution models are typically trained on low- and high-resolution audio signal pairs. Although these methods achieve highly accurate super-resolution if the acoustic characteristics of the input data are similar to those of the training data, challenges remain: the models suffer from quality degradation for out-of-domain data, and paired data are required for training. To addr… ▽ More Neural audio super-resolution models are typically trained on low- and high-resolution audio signal pairs. Although these methods achieve highly accurate super-resolution if the acoustic characteristics of the input data are similar to those of the training data, challenges remain: the models suffer from quality degradation for out-of-domain data, and paired data are required for training. To address these problems, we propose Dual-CycleGAN, a high-quality audio super-resolution method that can utilize unpaired data based on two connected cycle consistent generative adversarial networks (CycleGAN). Our method decomposes the super-resolution method into domain adaptation and resampling processes to handle acoustic mismatch in the unpaired low- and high-resolution signals. The two processes are then jointly optimized within the CycleGAN framework. Experimental results verify that the proposed method significantly outperforms conventional methods when paired data are not available. Code and audio samples are available from https://chomeyama.github.io/DualCycleGAN-Demo/. △ Less

Submitted 27 February, 2023; v1 submitted 28 October, 2022; originally announced October 2022.

Comments: Acceptted to ICASSP 2023

Acoustic Modeling for End-to-End Empathetic Dialogue Speech Synthesis Using Linguistic and Prosodic Contexts of Dialogue History

Authors: Yuto Nishimura, Yuki Saito, Shinnosuke Takamichi, Kentaro Tachibana, Hiroshi Saruwatari

Abstract: We propose an end-to-end empathetic dialogue speech synthesis (DSS) model that considers both the linguistic and prosodic contexts of dialogue history. Empathy is the active attempt by humans to get inside the interlocutor in dialogue, and empathetic DSS is a technology to implement this act in spoken dialogue systems. Our model is conditioned by the history of linguistic and prosody features for… ▽ More We propose an end-to-end empathetic dialogue speech synthesis (DSS) model that considers both the linguistic and prosodic contexts of dialogue history. Empathy is the active attempt by humans to get inside the interlocutor in dialogue, and empathetic DSS is a technology to implement this act in spoken dialogue systems. Our model is conditioned by the history of linguistic and prosody features for predicting appropriate dialogue context. As such, it can be regarded as an extension of the conventional linguistic-feature-based dialogue history modeling. To train the empathetic DSS model effectively, we investigate 1) a self-supervised learning model pretrained with large speech corpora, 2) a style-guided training using a prosody embedding of the current utterance to be predicted by the dialogue context embedding, 3) a cross-modal attention to combine text and speech modalities, and 4) a sentence-wise embedding to achieve fine-grained prosody modeling rather than utterance-wise modeling. The evaluation results demonstrate that 1) simply considering prosodic contexts of the dialogue history does not improve the quality of speech in empathetic DSS and 2) introducing style-guided training and sentence-wise embedding modeling achieves higher speech quality than that by the conventional method. △ Less

Submitted 16 June, 2022; originally announced June 2022.

Comments: 5 pages, 3 figures, Accepted for INTERSPEECH2022

Cross-Speaker Emotion Transfer for Low-Resource Text-to-Speech Using Non-Parallel Voice Conversion with Pitch-Shift Data Augmentation

Authors: Ryo Terashima, Ryuichi Yamamoto, Eunwoo Song, Yuma Shirahata, Hyun-Wook Yoon, Jae-Min Kim, Kentaro Tachibana

Abstract: Data augmentation via voice conversion (VC) has been successfully applied to low-resource expressive text-to-speech (TTS) when only neutral data for the target speaker are available. Although the quality of VC is crucial for this approach, it is challenging to learn a stable VC model because the amount of data is limited in low-resource scenarios, and highly expressive speech has large acoustic va… ▽ More Data augmentation via voice conversion (VC) has been successfully applied to low-resource expressive text-to-speech (TTS) when only neutral data for the target speaker are available. Although the quality of VC is crucial for this approach, it is challenging to learn a stable VC model because the amount of data is limited in low-resource scenarios, and highly expressive speech has large acoustic variety. To address this issue, we propose a novel data augmentation method that combines pitch-shifting and VC techniques. Because pitch-shift data augmentation enables the coverage of a variety of pitch dynamics, it greatly stabilizes training for both VC and TTS models, even when only 1,000 utterances of the target speaker's neutral data are available. Subjective test results showed that a FastSpeech 2-based emotional TTS system with the proposed method improved naturalness and emotional similarity compared with conventional methods. △ Less

Submitted 5 July, 2022; v1 submitted 21 April, 2022; originally announced April 2022.

Comments: Accepted to INTERSPEECH 2022

DRSpeech: Degradation-Robust Text-to-Speech Synthesis with Frame-Level and Utterance-Level Acoustic Representation Learning

Authors: Takaaki Saeki, Kentaro Tachibana, Ryuichi Yamamoto

Abstract: Most text-to-speech (TTS) methods use high-quality speech corpora recorded in a well-designed environment, incurring a high cost for data collection. To solve this problem, existing noise-robust TTS methods are intended to use noisy speech corpora as training data. However, they only address either time-invariant or time-variant noises. We propose a degradation-robust TTS method, which can be trai… ▽ More Most text-to-speech (TTS) methods use high-quality speech corpora recorded in a well-designed environment, incurring a high cost for data collection. To solve this problem, existing noise-robust TTS methods are intended to use noisy speech corpora as training data. However, they only address either time-invariant or time-variant noises. We propose a degradation-robust TTS method, which can be trained on speech corpora that contain both additive noises and environmental distortions. It jointly represents the time-variant additive noises with a frame-level encoder and the time-invariant environmental distortions with an utterance-level encoder. We also propose a regularization method to attain clean environmental embedding that is disentangled from the utterance-dependent information such as linguistic contents and speaker characteristics. Evaluation results show that our method achieved significantly higher-quality synthetic speech than previous methods in the condition including both additive noise and reverberation. △ Less

Submitted 29 June, 2022; v1 submitted 29 March, 2022; originally announced March 2022.

Comments: Accepted to INTERSPEECH 2022

STUDIES: Corpus of Japanese Empathetic Dialogue Speech Towards Friendly Voice Agent

Authors: Yuki Saito, Yuto Nishimura, Shinnosuke Takamichi, Kentaro Tachibana, Hiroshi Saruwatari

Abstract: We present STUDIES, a new speech corpus for developing a voice agent that can speak in a friendly manner. Humans naturally control their speech prosody to empathize with each other. By incorporating this "empathetic dialogue" behavior into a spoken dialogue system, we can develop a voice agent that can respond to a user more naturally. We designed the STUDIES corpus to include a speaker who speaks… ▽ More We present STUDIES, a new speech corpus for developing a voice agent that can speak in a friendly manner. Humans naturally control their speech prosody to empathize with each other. By incorporating this "empathetic dialogue" behavior into a spoken dialogue system, we can develop a voice agent that can respond to a user more naturally. We designed the STUDIES corpus to include a speaker who speaks with empathy for the interlocutor's emotion explicitly. We describe our methodology to construct an empathetic dialogue speech corpus and report the analysis results of the STUDIES corpus. We conducted a text-to-speech experiment to initially investigate how we can develop more natural voice agent that can tune its speaking style corresponding to the interlocutor's emotion. The results show that the use of interlocutor's emotion label and conversational context embedding can produce speech with the same degree of naturalness as that synthesized by using the agent's emotion label. Our project page of the STUDIES corpus is http://sython.org/Corpus/STUDIES. △ Less

Submitted 16 June, 2022; v1 submitted 28 March, 2022; originally announced March 2022.

Comments: 5 pages, 2 figures, Accepted for INTERSPEECH2022, project page: http://sython.org/Corpus/STUDIES

Systematic treatment of hypernuclear data and application to the hypertriton

Authors: P. Eckert, P. Achenbach, M. Aragones Fontbote, T. Akiyama, M. O. Distler, A. Esser, J. Geratz, M. Hoek, K. Itabashi, M. Kaneta, R. Kino, P. Klag, H. Merkel, M. Mizuno, J. Müller, U. Müller, S. Nagao, S. N. Nakamura, Y. R. Nakamura, K. Okuyama, J. Pochodzalla, B. S. Schlimme, C. Sfienti, R. Spreckels, M. Steinen , et al. (4 additional authors not shown)

Abstract: A database is under construction to provide a complete collection of published basic properties of hypernuclei such as Λ binding energies, lifetimes, or excitation energies. From these values, averages with related errors are computed in a systematic way. For each property, the overall experimental situation is depicted in form of an ideogram showing the combined probability density function of th… ▽ More A database is under construction to provide a complete collection of published basic properties of hypernuclei such as Λ binding energies, lifetimes, or excitation energies. From these values, averages with related errors are computed in a systematic way. For each property, the overall experimental situation is depicted in form of an ideogram showing the combined probability density function of the measurements. The database is accessible via a dynamic website at https://hypernuclei.kph.uni-mainz.de with an user interface offering customizable visualizations, selections, or unit conversions. The capabilities of the database are demonstrated for the puzzling and disputed data situation of the hypertriton. △ Less

Submitted 7 January, 2022; originally announced January 2022.

Comments: 6 pages, 3 figures, HADRON 2021 Proceeding

Phrase break prediction with bidirectional encoder representations in Japanese text-to-speech synthesis

Authors: Kosuke Futamata, Byeongseon Park, Ryuichi Yamamoto, Kentaro Tachibana

Abstract: We propose a novel phrase break prediction method that combines implicit features extracted from a pre-trained large language model, a.k.a BERT, and explicit features extracted from BiLSTM with linguistic features. In conventional BiLSTM based methods, word representations and/or sentence representations are used as independent components. The proposed method takes account of both representations… ▽ More We propose a novel phrase break prediction method that combines implicit features extracted from a pre-trained large language model, a.k.a BERT, and explicit features extracted from BiLSTM with linguistic features. In conventional BiLSTM based methods, word representations and/or sentence representations are used as independent components. The proposed method takes account of both representations to extract the latent semantics, which cannot be captured by previous methods. The objective evaluation results show that the proposed method obtains an absolute improvement of 3.2 points for the F1 score compared with BiLSTM-based conventional methods using linguistic features. Moreover, the perceptual listening test results verify that a TTS system that applied our proposed method achieved a mean opinion score of 4.39 in prosody naturalness, which is highly competitive with the score of 4.37 for synthesized speech with ground-truth phrase breaks. △ Less

Submitted 26 April, 2021; originally announced April 2021.

Comments: Submitted to INTERSPEECH 2021

Evaluation of Kyoto's Event-Driven X-ray Astronomical SOI Pixel Sensor with a Large Imaging Area

Authors: Hideki Hayashi, Takeshi Go Tsuru, Takaaki Tanaka, Hiroyuki Uchida, Hideaki Matsumura, Katsuhiro Tachibana, Sodai Harada, Ayaki Takeda, Koji Mori, Yusuke Nishioka, Nobuaki Takebayashi, Shoma Yokoyama, Kohei Fukuda, Yasuo Arai, Ikuo Kurachi, Shoji Kawahito, Keiichiro Kagawa, Keita Yasutomi, Sumeet Shrestha, Syunta Nakanishi, Hiroki Kamehama, Takayoshi Kohmura, Kouichi Hagino, Kousuke Negishi, Kenji Oono , et al. (1 additional authors not shown)

Abstract: We have been developing monolithic active pixel sensors, named ``XRPIX'', based on the silicon-on-insulator (SOI) pixel technology for future X-ray astronomy satellites. XRPIX has the function of event trigger and hit address outputs. This function allows us to read out analog signals only of hit pixels on trigger timing, which is referred to as the event-driven readout mode. Recently, we processe… ▽ More We have been developing monolithic active pixel sensors, named ``XRPIX'', based on the silicon-on-insulator (SOI) pixel technology for future X-ray astronomy satellites. XRPIX has the function of event trigger and hit address outputs. This function allows us to read out analog signals only of hit pixels on trigger timing, which is referred to as the event-driven readout mode. Recently, we processed ``XRPIX5b'' with the largest imaging area of 21.9~mm $\times$ 13.8~mm in the XRPIX series. X-ray spectra are successfully obtained from all the pixels, and the readout noise is 46~e$^-$~(rms) in the frame readout mode. The gain variation was measured to be 1.2\%~(FWHM) among the pixels. We successfully obtain the X-ray image in the event-driven readout mode. △ Less

Submitted 29 April, 2019; originally announced April 2019.

Comments: 5 pages, 9 figures

Journal ref: Nuclear Inst. and Methods in Physics Research, A 924 (2019) 400-403

Ionization age of iron ejecta in the Galactic Type Ia supernova remnant G306.3-0.9

Authors: Makoto Sawada, Katsuhiro Tachibana, Hiroyuki Uchida, Yuta Ito, Hideaki Matsumura, Aya Bamba, Takeshi Go Tsuru, Takaaki Tanaka

Abstract: We present a 190 ks observation of the Galactic supernova remnant (SNR) G306.3-0.9 with Suzaku. To study ejecta properties of this possible Type Ia SNR, the absolute energy scale at the Fe-K band was calibrated to a level of uncertainty less than 10 eV by a cross-calibration with the Hitomi microcalorimeter using the Perseus cluster spectra. This enabled us for the first time to accurately determi… ▽ More We present a 190 ks observation of the Galactic supernova remnant (SNR) G306.3-0.9 with Suzaku. To study ejecta properties of this possible Type Ia SNR, the absolute energy scale at the Fe-K band was calibrated to a level of uncertainty less than 10 eV by a cross-calibration with the Hitomi microcalorimeter using the Perseus cluster spectra. This enabled us for the first time to accurately determine the ionization state of the Fe K$α$ line of this SNR. The ionization timescale ($τ$) of the Fe ejecta was measured to be $\log_{10} τ$ (cm$^{-3}$ s) $=10.24\pm0.03$, significantly smaller than previous measurements. Marginally detected K$α$ lines of Cr and Mn have consistent ionization timescales with Fe. The global spectrum was well fitted with shocked interstellar matter (ISM) and at least two ejecta components with different ionization timescales for Fe and intermediate mass elements (IME) such as S and Ar. One plausible interpretation of the one-order-of-magnitude shorter timescale of Fe than that of IME ($\log_{10} τ= 11.17\pm0.07$) is a chemically stratified structure of ejecta. By comparing the X-ray absorption column to the HI distribution decomposed along the line of sight, we refined the distance to be $\sim$20 kpc. The large ISM-to-ejecta shocked mass ratio of $\sim$100 and dynamical timescale of $\sim$6 kyr place the SNR in the late Sedov phase. These properties are consistent with a stratified ejecta structure that has survived the mixing processes expected in an evolved supernova remnant. △ Less

Submitted 6 March, 2019; originally announced March 2019.

Comments: 16 pages, 10 figures, 3 tables. Accepted for publication in PASJ

X-ray response evaluation in subpixel level for X-ray SOI pixel detectors

Authors: Kousuke Negishi, Takayoshi Kohmura, Kouichi Hagino, Taku Kogiso, Kenji Oono, Keigo Yarita, Akinori Sasaki, Koki Tamasawa, Takeshi G. Tsuru, Takaaki Tanaka, Hideaki Matsumura, Katsuhiro Tachibana, Hideki Hayashi, Sodai Harada, Koji Mori, Ayaki Takeda, Yusuke Nishioka, Nobuaki Takebayashi, Shoma Yokoyama, Kohei Fukuda, Yasuo Arai, Toshinobu Miyoshi, Shunji Kishimoto, Ikuo Kurachi

Abstract: We have been developing event-driven SOI Pixel Detectors, named `XRPIX' (X-Ray soiPIXel) based on the silicon-on-insulator (SOI) pixel technology, for the future X-ray astronomical satellite with wide band coverage from 0.5 keV to 40 keV. XRPIX has event trigger output function at each pixel to acquire a good time resolution of a few $μ\rm s$ and has Correlated Double Sampling function to reduce e… ▽ More We have been developing event-driven SOI Pixel Detectors, named `XRPIX' (X-Ray soiPIXel) based on the silicon-on-insulator (SOI) pixel technology, for the future X-ray astronomical satellite with wide band coverage from 0.5 keV to 40 keV. XRPIX has event trigger output function at each pixel to acquire a good time resolution of a few $μ\rm s$ and has Correlated Double Sampling function to reduce electric noises. The good time resolution enables the XRPIX to reduce Non X-ray Background in the high energy band above 10\,keV drastically by using anti-coincidence technique with active shield counters surrounding XRPIX. In order to increase the soft X-ray sensitivity, it is necessary to make the dead layer on the X-ray incident surface as thin as possible. Since XRPIX1b, which is a device at the initial stage of development, is a front-illuminated (FI) type of XRPIX, low energy X-ray photons are absorbed in the 8 $\rm μ$m thick circuit layer, lowering the sensitivity in the soft X-ray band. Therefore, we developed a back-illuminated (BI) device XRPIX2b, and confirmed high detection efficiency down to 2.6 keV, below which the efficiency is affected by the readout noise. In order to further improve the detection efficiency in the soft X-ray band, we developed a back-illuminated device XRPIX3b with lower readout noise. In this work, we irradiated 2--5 keV X-ray beam collimated to 4 $\rm μm φ$ to the sensor layer side of the XRPIX3b at 6 $\rm μm$ pitch. In this paper, we reported the uniformity of the relative detection efficiency, gain and energy resolution in the subpixel level for the first time. We also confirmed that the variation in the relative detection efficiency at the subpixel level reported by Matsumura et al. has improved. △ Less

Submitted 25 October, 2018; originally announced October 2018.

Comments: 7 pages, 11 figures, 1 table, accepted for Nuclear Instruments and Methods in Physics Research Section A (NIMA)

Proton Radiation Damage Experiment for X-Ray SOI Pixel Detectors

Authors: Keigo Yarita, Takayoshi Kohmura, Kouichi Hagino, Taku Kogiso, Kenji Oono, Kousuke Negishi, Koki Tamasawa, Akinori Sasaki, Satoshi Yoshiki, Takeshi Go Tsuru, Takaaki Tanaka, Hideaki Matsumura, Katsuhiro Tachibana, Hideki Hayashi, Sodai Harada, Ayaki Takeda, Koji Mori, Yusuke Nishioka, Nobuaki Takebayashi, Shoma Yokoyama, Kohei Fukuda, Yasuo Arai, Toshinobu Miyoshi, Ikuo Kurachi, Tsuyoshi Hamano , et al. (1 additional authors not shown)

Abstract: In low earth orbit, there are many cosmic rays composed primarily of high energy protons. These cosmic rays cause surface and bulk radiation effects, resulting in degradation of detector performance. Quantitative evaluation of radiation hardness is essential in development of X-ray detectors for astronomical satellites. We performed proton irradiation experiments on newly developed X-ray detectors… ▽ More In low earth orbit, there are many cosmic rays composed primarily of high energy protons. These cosmic rays cause surface and bulk radiation effects, resulting in degradation of detector performance. Quantitative evaluation of radiation hardness is essential in development of X-ray detectors for astronomical satellites. We performed proton irradiation experiments on newly developed X-ray detectors called XRPIX based on silicon-on-insulator technology at HIMAC in National Institute of Radiological Sciences. We irradiated 6 MeV protons with a total dose of 0.5 krad, equivalent to 6 years irradiation in orbit. As a result, the gain increases by 0.2% and the energy resolution degrades by 0.5%. Finally we irradiated protons up to 20 krad and found that detector performance degraded significantly at 5 krad. With 5 krad irradiation corresponding to 60 years in orbit, the gain increases by 0.7% and the energy resolution worsens by 10%. By decomposing into noise components, we found that the increase of the circuit noise is dominant in the degradation of the energy resolution. △ Less

Submitted 22 October, 2018; originally announced October 2018.

Comments: 6 pages, 11figures, accepted for Nuclear Instruments and Methods in Physics Research Section A (NIMA)

Performance of the Silicon-On-Insulator Pixel Sensor for X-ray Astronomy, XRPIX6E, Equipped with Pinned Depleted Diode Structure

Authors: Sodai Harada, Takeshi Go Tsuru, Takaaki Tanaka, Hiroyuki Uchida, Hideaki Matsumura, Katsuhiro Tachibana, Hideki Hayashi, Ayaki Takeda, Koji Mori, Yusuke Nishioka, Nobuaki Takebayashi, Shoma Yokoyama, Kohei Fukuda, Yasuo Arai, Ikuo Kurachi, Shoji Kawahito, Keiichiro Kagawa, Keita Yasutomi, Sumeet Shrestha, Syunta Nakanishi, Hiroki Kamehama, Takayoshi Kohmura, Kouichi Hagino, Kousuke Negishi, Kenji Oono , et al. (1 additional authors not shown)

Abstract: We have been developing event driven X-ray Silicon-On-Insulator (SOI) pixel sensors, called "XRPIX", for the next generation of X-ray astronomy satellites. XRPIX is a monolithic active pixel sensor, fabricated using the SOI CMOS technology, and is equipped with the so-called "Event-Driven readout", which allows reading out only hit pixels by using the trigger circuit implemented in each pixel. The… ▽ More We have been developing event driven X-ray Silicon-On-Insulator (SOI) pixel sensors, called "XRPIX", for the next generation of X-ray astronomy satellites. XRPIX is a monolithic active pixel sensor, fabricated using the SOI CMOS technology, and is equipped with the so-called "Event-Driven readout", which allows reading out only hit pixels by using the trigger circuit implemented in each pixel. The current version of XRPIX has lower spectral performance in the Event-Driven readout mode than in the Frame readout mode, which is due to the interference between the sensor layer and the circuit layer. The interference also lowers the gain. In order to suppress the interference, we developed a new device, "XRPIX6E" equipped with the Pinned Depleted Diode structure. A sufficiently highly-doped buried p-well is formed at the interface between the buried oxide layer and the sensor layer, and acts as a shield layer. XRPIX6E exhibits improved spectral performances both in the Event-Driven readout mode and in the Frame readout mode in comparison to previous devices. The energy resolutions in full width at half maximum at 6.4 keV are 236 $\pm$ 1 eV and 335 $\pm$ 4 eV in the Frame and Event-Driven readout modes, respectively. There are differences between the readout noise and the spectral performance in the two modes, which suggests that some mechanism still degrades the performance in the Event-Driven readout mode. △ Less

Submitted 27 September, 2018; originally announced September 2018.

Comments: 13 pages, 5 figures, 1 table, accepted for publication in NIMA on September 27, 2018

Full-body High-resolution Anime Generation with Progressive Structure-conditional Generative Adversarial Networks

Authors: Koichi Hamada, Kentaro Tachibana, Tianqi Li, Hiroto Honda, Yusuke Uchida

Abstract: We propose Progressive Structure-conditional Generative Adversarial Networks (PSGAN), a new framework that can generate full-body and high-resolution character images based on structural information. Recent progress in generative adversarial networks with progressive training has made it possible to generate high-resolution images. However, existing approaches have limitations in achieving both hi… ▽ More We propose Progressive Structure-conditional Generative Adversarial Networks (PSGAN), a new framework that can generate full-body and high-resolution character images based on structural information. Recent progress in generative adversarial networks with progressive training has made it possible to generate high-resolution images. However, existing approaches have limitations in achieving both high image quality and structural consistency at the same time. Our method tackles the limitations by progressively increasing the resolution of both generated images and structural conditions during training. In this paper, we empirically demonstrate the effectiveness of this method by showing the comparison with existing approaches and video generation results of diverse anime characters at 1024x1024 based on target pose sequences. We also create a novel dataset containing full-body 1024x1024 high-resolution images and exact 2D pose keypoints using Unity 3D Avatar models. △ Less

Submitted 6 September, 2018; originally announced September 2018.

Comments: Accepted to ECCV 2018 Workshop: Computer Vision for Fashion, Art and Design. Project page is at https://dena.com/intl/anime-generation

Kyoto's Event-Driven X-ray Astronomy SOI pixel sensor for the FORCE mission

Authors: Takeshi G. Tsuru, Hideki Hayashi, Katsuhiro Tachibana, Sodai Harada, Hiroyuki Uchida, Takaaki Tanaka, Yasuo Arai, Ikuo Kurachi, Koji Mori, Ayaki Takeda, Yusuke Nishioka, Nobuaki Takebayashi, Shoma Yokoyama, Kohei Fukuda, Takayoshi Kohmura, Kouichi Hagino, Kenji Ohno, Kohsuke Negishi, Keigo Yarita, Shoji Kawahito, Keiichiro Kagawa, Keita Yasutomi, Sumeet Shrestha, Shunta Nakanishi, Hiroki Kamehama , et al. (1 additional authors not shown)

Abstract: We have been developing monolithic active pixel sensors, X-ray Astronomy SOI pixel sensors, XRPIXs, based on a Silicon-On-Insulator (SOI) CMOS technology as soft X-ray sensors for a future Japanese mission, FORCE (Focusing On Relativistic universe and Cosmic Evolution). The mission is characterized by broadband (1-80 keV) X-ray imaging spectroscopy with high angular resolution ($<15$~arcsec), with… ▽ More We have been developing monolithic active pixel sensors, X-ray Astronomy SOI pixel sensors, XRPIXs, based on a Silicon-On-Insulator (SOI) CMOS technology as soft X-ray sensors for a future Japanese mission, FORCE (Focusing On Relativistic universe and Cosmic Evolution). The mission is characterized by broadband (1-80 keV) X-ray imaging spectroscopy with high angular resolution ($<15$~arcsec), with which we can achieve about ten times higher sensitivity in comparison to the previous missions above 10~keV. Immediate readout of only those pixels hit by an X-ray is available by an event trigger output function implemented in each pixel with the time resolution higher than $10~{\rm μsec}$ (Event-Driven readout mode). It allows us to do fast timing observation and also reduces non-X-ray background dominating at a high X-ray energy band above 5--10~keV by adopting an anti-coincidence technique. In this paper, we introduce our latest results from the developments of the XRPIXs. (1) We successfully developed a 3-side buttable back-side illumination device with an imaging area size of 21.9~mm$\times$13.8~mm and an pixel size of $36~{\rm μm} \times 36~{\rm μm}$. The X-ray throughput with the device reaches higher than 0.57~kHz in the Event-Driven readout mode. (2) We developed a device using the double SOI structure and found that the structure improves the spectral performance in the Event-Driven readout mode by suppressing the capacitive coupling interference between the sensor and circuit layers. (3) We also developed a new device equipped with the Pinned Depleted Diode structure and confirmed that the structure reduces the dark current generated at the interface region between the sensor and the SiO$_2$ insulator layers. The device shows an energy resolution of 216~eV in FWHM at 6.4~keV in the Event-Driven readout mode. △ Less

Submitted 29 July, 2018; originally announced July 2018.

Comments: 11 pages, 10 figures, Proceedings Volume 10709, High Energy, Optical, and Infrared Detectors for Astronomy VIII

Geometry-dependent constitutive law for granular slow frictional drag

Authors: T. Furuta, K. Katou, S. Itoh, K. Tachibana, S. Ishikawa, H. Katsuragi

Abstract: Frictional constitutive law for very slow vertical withdrawing of a thin rod from a granular bed is experimentally studied. Using a very precise creep meter, geometry-dependent granular frictional constitutive law is particularly examined. In some previous works, a dimensionless number $I=\dotγD_g/\sqrt{p/ρ_g}$ has been used to characterize granular frictional constitutive laws, where $\dotγ$,… ▽ More Frictional constitutive law for very slow vertical withdrawing of a thin rod from a granular bed is experimentally studied. Using a very precise creep meter, geometry-dependent granular frictional constitutive law is particularly examined. In some previous works, a dimensionless number $I=\dotγD_g/\sqrt{p/ρ_g}$ has been used to characterize granular frictional constitutive laws, where $\dotγ$, $D_g$, $p$, and $ρ_g$ are the shear strain rate, grain diameter, confining pressure, and bulk density of granular bed, respectively. It has been considered that granular frictional constitutive law expressed by $I$ is universal (almost geometry-independent) in dense flow regime. In this study, however, we find that the geometry of the system is much more crucial to characterize granular friction in a very slow withdrawing regime. Specifically, the ratio between rod and grain diameters must be an essential parameter to describe the granular frictional constitutive law. Physical meaning of the geometry-dependent constitutive law is discussed on the basis of grains-contact-number dependence of granular behavior. △ Less

Submitted 11 November, 2016; originally announced November 2016.

Comments: 11 pages, 7 figures

Wreath determinants for group-subgroup pairs

Authors: Kei Hamamoto, Kazufumi Kimoto, Kazutoshi Tachibana, Masato Wakayama

Abstract: The aim of the present paper is to generalize the notion of the group determinants for finite groups. For a finite group $G$ of order $kn$ and its subgroup $H$ of order $n$, one may define an $n$ by $kn$ matrix $X=(x_{hg^{-1}})_{h\in H,g\in G}$, where $x_g$ ($g\in G$) are indeterminates indexed by the elements in $G$. Then, we define an invariant $Θ(G,H)$ for a given pair $(G,H)$ by the $k$-wreath… ▽ More The aim of the present paper is to generalize the notion of the group determinants for finite groups. For a finite group $G$ of order $kn$ and its subgroup $H$ of order $n$, one may define an $n$ by $kn$ matrix $X=(x_{hg^{-1}})_{h\in H,g\in G}$, where $x_g$ ($g\in G$) are indeterminates indexed by the elements in $G$. Then, we define an invariant $Θ(G,H)$ for a given pair $(G,H)$ by the $k$-wreath determinant of the matrix $X$, where $k$ is the index of $H$ in $G$. The $k$-wreath determinant of $n$ by $kn$ matrix is a relative invariant of the left action by the general linear group of order $k$ and right action by the wreath product of two symmetric groups of order $k$ and $n$. Since the definition of $Θ(G,H)$ is ordering-sensitive, representation theory of symmetric groups are naturally involved. In this paper, we treat abelian groups with a special choice of indeterminates and give various examples of non-abelian group-subgroup pairs. △ Less

Submitted 10 June, 2014; originally announced June 2014.

Comments: 12 pages, 2 figures