-
Large Language Model-based FMRI Encoding of Language Functions for Subjects with Neurocognitive Disorder
Authors:
Yuejiao Wang,
Xianmin Gong,
Lingwei Meng,
Xixin Wu,
Helen Meng
Abstract:
Functional magnetic resonance imaging (fMRI) is essential for developing encoding models that identify functional changes in language-related brain areas of individuals with Neurocognitive Disorders (NCD). While large language model (LLM)-based fMRI encoding has shown promise, existing studies predominantly focus on healthy, young adults, overlooking older NCD populations and cognitive level corre…
▽ More
Functional magnetic resonance imaging (fMRI) is essential for developing encoding models that identify functional changes in language-related brain areas of individuals with Neurocognitive Disorders (NCD). While large language model (LLM)-based fMRI encoding has shown promise, existing studies predominantly focus on healthy, young adults, overlooking older NCD populations and cognitive level correlations. This paper explores language-related functional changes in older NCD adults using LLM-based fMRI encoding and brain scores, addressing current limitations. We analyze the correlation between brain scores and cognitive scores at both whole-brain and language-related ROI levels. Our findings reveal that higher cognitive abilities correspond to better brain scores, with correlations peaking in the middle temporal gyrus. This study highlights the potential of fMRI encoding models and brain scores for detecting early functional changes in NCD patients.
△ Less
Submitted 14 July, 2024;
originally announced July 2024.
-
Leveraging Pretrained Representations with Task-related Keywords for Alzheimer's Disease Detection
Authors:
Jinchao Li,
Kaitao Song,
Junan Li,
Bo Zheng,
Dongsheng Li,
Xixin Wu,
Xunying Liu,
Helen Meng
Abstract:
With the global population aging rapidly, Alzheimer's disease (AD) is particularly prominent in older adults, which has an insidious onset and leads to a gradual, irreversible deterioration in cognitive domains (memory, communication, etc.). Speech-based AD detection opens up the possibility of widespread screening and timely disease intervention. Recent advances in pre-trained models motivate AD…
▽ More
With the global population aging rapidly, Alzheimer's disease (AD) is particularly prominent in older adults, which has an insidious onset and leads to a gradual, irreversible deterioration in cognitive domains (memory, communication, etc.). Speech-based AD detection opens up the possibility of widespread screening and timely disease intervention. Recent advances in pre-trained models motivate AD detection modeling to shift from low-level features to high-level representations. This paper presents several efficient methods to extract better AD-related cues from high-level acoustic and linguistic features. Based on these features, the paper also proposes a novel task-oriented approach by modeling the relationship between the participants' description and the cognitive task. Experiments are carried out on the ADReSS dataset in a binary classification setup, and models are evaluated on the unseen test set. Results and comparison with recent literature demonstrate the efficiency and superior performance of proposed acoustic, linguistic and task-oriented methods. The findings also show the importance of semantic and syntactic information, and feasibility of automation and generalization with the promising audio-only and task-oriented methods for the AD detection task.
△ Less
Submitted 14 March, 2023;
originally announced March 2023.
-
Speaker Adaptation Using Spectro-Temporal Deep Features for Dysarthric and Elderly Speech Recognition
Authors:
Mengzhe Geng,
Xurong Xie,
Zi Ye,
Tianzi Wang,
Guinan Li,
Shujie Hu,
Xunying Liu,
Helen Meng
Abstract:
Despite the rapid progress of automatic speech recognition (ASR) technologies targeting normal speech in recent decades, accurate recognition of dysarthric and elderly speech remains highly challenging tasks to date. Sources of heterogeneity commonly found in normal speech including accent or gender, when further compounded with the variability over age and speech pathology severity level, create…
▽ More
Despite the rapid progress of automatic speech recognition (ASR) technologies targeting normal speech in recent decades, accurate recognition of dysarthric and elderly speech remains highly challenging tasks to date. Sources of heterogeneity commonly found in normal speech including accent or gender, when further compounded with the variability over age and speech pathology severity level, create large diversity among speakers. To this end, speaker adaptation techniques play a key role in personalization of ASR systems for such users. Motivated by the spectro-temporal level differences between dysarthric, elderly and normal speech that systematically manifest in articulatory imprecision, decreased volume and clarity, slower speaking rates and increased dysfluencies, novel spectrotemporal subspace basis deep embedding features derived using SVD speech spectrum decomposition are proposed in this paper to facilitate auxiliary feature based speaker adaptation of state-of-the-art hybrid DNN/TDNN and end-to-end Conformer speech recognition systems. Experiments were conducted on four tasks: the English UASpeech and TORGO dysarthric speech corpora; the English DementiaBank Pitt and Cantonese JCCOCC MoCA elderly speech datasets. The proposed spectro-temporal deep feature adapted systems outperformed baseline i-Vector and xVector adaptation by up to 2.63% absolute (8.63% relative) reduction in word error rate (WER). Consistent performance improvements were retained after model based speaker adaptation using learning hidden unit contributions (LHUC) was further applied. The best speaker adapted system using the proposed spectral basis embedding features produced the lowest published WER of 25.05% on the UASpeech test set of 16 dysarthric speakers.
△ Less
Submitted 17 March, 2022; v1 submitted 21 February, 2022;
originally announced February 2022.
-
Propagation analysis and prediction of the COVID-19
Authors:
Lixiang Li,
Zihang Yang,
Zhongkai Dang,
Cui Meng,
Jingze Huang,
Hao Tian Meng,
Deyu Wang,
Guanhua Chen,
Jiaxuan Zhang,
Haipeng Peng
Abstract:
Based on the official data modeling, this paper studies the transmission process of the Corona Virus Disease 2019 (COVID-19). The error between the model and the official data curve is within 3%. At the same time, it realized forward prediction and backward inference of the epidemic situation, and the relevant analysis help relevant countries to make decisions.
Based on the official data modeling, this paper studies the transmission process of the Corona Virus Disease 2019 (COVID-19). The error between the model and the official data curve is within 3%. At the same time, it realized forward prediction and backward inference of the epidemic situation, and the relevant analysis help relevant countries to make decisions.
△ Less
Submitted 15 March, 2020;
originally announced March 2020.
-
Independent Noise Synchronizing Networks of Oscillator Networks
Authors:
John Hongyu Meng,
Hermann Riecke
Abstract:
Oscillators coupled in a network can synchronize with each other to yield a coherent population rhythm. If multiple such networks are coupled together, the question arises whether these rhythms will synchronize. We investigate the impact of noise on this synchronization for strong inhibitory pulse-coupling and find that increasing the noise can synchronize the population rhythms, even if the noisy…
▽ More
Oscillators coupled in a network can synchronize with each other to yield a coherent population rhythm. If multiple such networks are coupled together, the question arises whether these rhythms will synchronize. We investigate the impact of noise on this synchronization for strong inhibitory pulse-coupling and find that increasing the noise can synchronize the population rhythms, even if the noisy inputs to different oscillators are completely uncorrelated. Reducing the system to a phenomenological iterated map we show that this synchronization of the rhythms arises from the noise-induced phase heterogeneity of the oscillators. The synchronization of population rhythms is expected to be particularly relevant for brain rhythms.
△ Less
Submitted 20 December, 2016;
originally announced December 2016.
