Showing 1–12 of 12 results for author: Firdaus, M

Computational Politeness in Natural Language Processing: A Survey

Authors: Priyanshu Priya, Mauajama Firdaus, Asif Ekbal

Abstract: Computational approach to politeness is the task of automatically predicting and generating politeness in text. This is a pivotal task for conversational analysis, given the ubiquity and challenges of politeness in interactions. The computational approach to politeness has witnessed great interest from the conversational analysis community. This article is a compilation of past works in computatio… ▽ More Computational approach to politeness is the task of automatically predicting and generating politeness in text. This is a pivotal task for conversational analysis, given the ubiquity and challenges of politeness in interactions. The computational approach to politeness has witnessed great interest from the conversational analysis community. This article is a compilation of past works in computational politeness in natural language processing. We view four milestones in the research so far, viz. supervised and weakly-supervised feature extraction to identify and induce politeness in a given text, incorporation of context beyond the target text, study of politeness across different social factors, and study the relationship between politeness and various sociolinguistic cues. In this article, we describe the datasets, approaches, trends, and issues in computational politeness research. We also discuss representative performance values and provide pointers to future works, as given in the prior works. In terms of resources to understand the state-of-the-art, this survey presents several valuable illustrations, most prominently, a table summarizing the past papers along different dimensions, such as the types of features, annotation techniques, and datasets used. △ Less

Submitted 28 June, 2024; originally announced July 2024.

Comments: Manuscript accepted at the ACM Computing Surveys (DOI: https://doi.org/10.1145/3654660)

Journal ref: ACM Comput. Surv. 56, 9, Article 241 (May 2024)

Personalized Federated Learning for Statistical Heterogeneity

Authors: Muhammad Firdaus, Kyung-Hyune Rhee

Abstract: The popularity of federated learning (FL) is on the rise, along with growing concerns about data privacy in artificial intelligence applications. FL facilitates collaborative multi-party model learning while simultaneously ensuring the preservation of data confidentiality. Nevertheless, the problem of statistical heterogeneity caused by the presence of diverse client data distributions gives rise… ▽ More The popularity of federated learning (FL) is on the rise, along with growing concerns about data privacy in artificial intelligence applications. FL facilitates collaborative multi-party model learning while simultaneously ensuring the preservation of data confidentiality. Nevertheless, the problem of statistical heterogeneity caused by the presence of diverse client data distributions gives rise to certain challenges, such as inadequate personalization and slow convergence. In order to address the above issues, this paper offers a brief summary of the current research progress in the field of personalized federated learning (PFL). It outlines the PFL concept, examines related techniques, and highlights current endeavors. Furthermore, this paper also discusses potential further research and obstacles associated with PFL. △ Less

Submitted 7 February, 2024; originally announced February 2024.

A Unified Framework for Slot based Response Generation in a Multimodal Dialogue System

Authors: Mauajama Firdaus, Avinash Madasu, Asif Ekbal

Abstract: Natural Language Understanding (NLU) and Natural Language Generation (NLG) are the two critical components of every conversational system that handles the task of understanding the user by capturing the necessary information in the form of slots and generating an appropriate response in accordance with the extracted information. Recently, dialogue systems integrated with complementary information… ▽ More Natural Language Understanding (NLU) and Natural Language Generation (NLG) are the two critical components of every conversational system that handles the task of understanding the user by capturing the necessary information in the form of slots and generating an appropriate response in accordance with the extracted information. Recently, dialogue systems integrated with complementary information such as images, audio, or video have gained immense popularity. In this work, we propose an end-to-end framework with the capability to extract necessary slot values from the utterance and generate a coherent response, thereby assisting the user to achieve their desired goals in a multimodal dialogue system having both textual and visual information. The task of extracting the necessary information is dependent not only on the text but also on the visual cues present in the dialogue. Similarly, for the generation, the previous dialog context comprising multimodal information is significant for providing coherent and informative responses. We employ a multimodal hierarchical encoder using pre-trained DialoGPT and also exploit the knowledge base (Kb) to provide a stronger context for both the tasks. Finally, we design a slot attention mechanism to focus on the necessary information in a given utterance. Lastly, a decoder generates the corresponding response for the given dialogue context and the extracted slot values. Experimental results on the Multimodal Dialogue Dataset (MMD) show that the proposed framework outperforms the baselines approaches in both the tasks. The code is available at https://github.com/avinashsai/slot-gpt. △ Less

Submitted 27 May, 2023; originally announced May 2023.

Comments: Published in the journal Multimedia Tools and Applications

Prompt-Based Editing for Text Style Transfer

Authors: Guoqing Luo, Yu Tong Han, Lili Mou, Mauajama Firdaus

Abstract: Prompting approaches have been recently explored in text style transfer, where a textual prompt is used to query a pretrained language model to generate style-transferred texts word by word in an autoregressive manner. However, such a generation process is less controllable and early prediction errors may affect future word predictions. In this paper, we present a prompt-based editing approach for… ▽ More Prompting approaches have been recently explored in text style transfer, where a textual prompt is used to query a pretrained language model to generate style-transferred texts word by word in an autoregressive manner. However, such a generation process is less controllable and early prediction errors may affect future word predictions. In this paper, we present a prompt-based editing approach for text style transfer. Specifically, we prompt a pretrained language model for style classification and use the classification probability to compute a style score. Then, we perform discrete search with word-level editing to maximize a comprehensive scoring function for the style-transfer task. In this way, we transform a prompt-based generation problem into a classification one, which is a training-free process and more controllable than the autoregressive generation of sentences. In our experiments, we performed both automatic and human evaluation on three style-transfer benchmark datasets, and show that our approach largely outperforms the state-of-the-art systems that have 20 times more parameters. Additional empirical analyses further demonstrate the effectiveness of our approach. △ Less

Submitted 22 December, 2023; v1 submitted 27 January, 2023; originally announced January 2023.

Comments: Accepted by EMNLP Findings 2023

A Joint Framework to Privacy-Preserving Edge Intelligence in Vehicular Networks

Authors: Muhammad Firdaus, Kyung-Hyune Rhee

Abstract: The number of internet-connected devices has been exponentially growing with the massive volume of heterogeneous data generated from various devices, resulting in a highly intertwined cyber-physical system. Currently, the Edge Intelligence System (EIS) concept that leverages the merits of edge computing and Artificial Intelligence (AI) is utilized to provide smart cloud services with powerful comp… ▽ More The number of internet-connected devices has been exponentially growing with the massive volume of heterogeneous data generated from various devices, resulting in a highly intertwined cyber-physical system. Currently, the Edge Intelligence System (EIS) concept that leverages the merits of edge computing and Artificial Intelligence (AI) is utilized to provide smart cloud services with powerful computational processing and reduce decision-making delays. Thus, EIS offers a possible solution to realizing future Intelligent Transportation Systems (ITS), especially in a vehicular network framework. However, since the central aggregator server supervises the entire system orchestration, the existing EIS framework faces several challenges and is still potentially susceptible to numerous malicious attacks. Hence, to solve the issues mentioned earlier, this paper presents the notion of secure edge intelligence, merging the benefits of Federated Learning (FL), blockchain, and Local Differential Privacy (LDP). The blockchain-assisted FL approach efficiently improves traffic prediction accuracy and enhances user privacy and security by recording transactions in immutable distributed ledger networks and providing a decentralized reward mechanism system. Furthermore, LDP is empowered to strengthen the confidentiality of data sharing transactions, especially in protecting users' private data from various attacks. The proposed framework has been implemented in two scenarios, i.e., blockchain-based FL to efficiently develop the decentralized traffic management for vehicular networks and LDP-based FL to produce randomized privacy protection using the IBM Library for differential privacy. △ Less

Submitted 18 August, 2022; originally announced August 2022.

Realization of High Frequency Bidirectional Transceiver (Bitx) Radio

Authors: Muhammad Firdaus, Sutrisno, Tata Supriyadi

Abstract: In this paper, we realize the transmitter of high frequency (HF) bidirectional transceiver radio. A bidirectional transceiver (Bitx) consists of a transmitter and receiver, in which some common circuits are used together by the transmitter and receiver. In addition, Bitx radio uses a single conversion superheterodyne transmitter, which only shifts frequency once in a signal generation process. The… ▽ More In this paper, we realize the transmitter of high frequency (HF) bidirectional transceiver radio. A bidirectional transceiver (Bitx) consists of a transmitter and receiver, in which some common circuits are used together by the transmitter and receiver. In addition, Bitx radio uses a single conversion superheterodyne transmitter, which only shifts frequency once in a signal generation process. The measurement result shows that it works at the frequency of 6.8 MHz with 10 MHz BFO, 3,2 MHz VFO, and 50,3 dBm transmit power. The transmitting frequency is obtained from the difference between BFO and VFO oscillator. Bitx radio has a simple circuit and is designed with low-cost components, and it could be an alternative solution for communication in remote areas. △ Less

Submitted 28 June, 2022; originally announced July 2022.

Performance of OFDM System against Different Cyclic Prefix Lengths on Multipath Fading Channels

Authors: Muhammad Firdaus, Yoedy Moegiharto

Abstract: Orthogonal Frequency Division Multiplexing (OFDM) is a transmission technique that uses several subcarrier frequencies (multicarrier) that are perpendicular to each other (orthogonal). This OFDM modulation technique effectively eliminates Intersymbol Interference (ISI) on a channel caused by the effects of multipath fading. To overcome this weakness, OFDM uses a guard interval (cyclic prefix) inse… ▽ More Orthogonal Frequency Division Multiplexing (OFDM) is a transmission technique that uses several subcarrier frequencies (multicarrier) that are perpendicular to each other (orthogonal). This OFDM modulation technique effectively eliminates Intersymbol Interference (ISI) on a channel caused by the effects of multipath fading. To overcome this weakness, OFDM uses a guard interval (cyclic prefix) inserted in its transmission. This paper analyses the effect of different cyclic prefix lengths on OFDM performance on multipath channels using Matlab. Here, the cyclic prefix length as the main parameter is varied for the different number of subscribers. Meanwhile, Bit Error Rate (BER) and Signal Noise Ratio (SNR) values obtained at the receiver are used to see the system's performance. Based on our simulation results, the best value of BER is obtained using a cyclic prefix length of 1/4 with a Fast Fourier Transform (FFT) size of 512. △ Less

Submitted 30 June, 2022; originally announced July 2022.

A Unified Framework for Emotion Identification and Generation in Dialogues

Authors: Avinash Madasu, Mauajama Firdaus, Asif Eqbal

Abstract: Social chatbots have gained immense popularity, and their appeal lies not just in their capacity to respond to the diverse requests from users, but also in the ability to develop an emotional connection with users. To further develop and promote social chatbots, we need to concentrate on increasing user interaction and take into account both the intellectual and emotional quotient in the conversat… ▽ More Social chatbots have gained immense popularity, and their appeal lies not just in their capacity to respond to the diverse requests from users, but also in the ability to develop an emotional connection with users. To further develop and promote social chatbots, we need to concentrate on increasing user interaction and take into account both the intellectual and emotional quotient in the conversational agents. In this paper, we propose a multi-task framework that jointly identifies the emotion of a given dialogue and generates response in accordance to the identified emotion. We employ a BERT based network for creating an empathetic system and use a mixed objective function that trains the end-to-end network with both the classification and generation loss. Experimental results show that our proposed framework outperforms current state-of-the-art models △ Less

Submitted 30 May, 2022; originally announced May 2022.

EmoInHindi: A Multi-label Emotion and Intensity Annotated Dataset in Hindi for Emotion Recognition in Dialogues

Authors: Gopendra Vikram Singh, Priyanshu Priya, Mauajama Firdaus, Asif Ekbal, Pushpak Bhattacharyya

Abstract: The long-standing goal of Artificial Intelligence (AI) has been to create human-like conversational systems. Such systems should have the ability to develop an emotional connection with the users, hence emotion recognition in dialogues is an important task. Emotion detection in dialogues is a challenging task because humans usually convey multiple emotions with varying degrees of intensities in a… ▽ More The long-standing goal of Artificial Intelligence (AI) has been to create human-like conversational systems. Such systems should have the ability to develop an emotional connection with the users, hence emotion recognition in dialogues is an important task. Emotion detection in dialogues is a challenging task because humans usually convey multiple emotions with varying degrees of intensities in a single utterance. Moreover, emotion in an utterance of a dialogue may be dependent on previous utterances making the task more complex. Emotion recognition has always been in great demand. However, most of the existing datasets for multi-label emotion and intensity detection in conversations are in English. To this end, we create a large conversational dataset in Hindi named EmoInHindi for multi-label emotion and intensity recognition in conversations containing 1,814 dialogues with a total of 44,247 utterances. We prepare our dataset in a Wizard-of-Oz manner for mental health and legal counselling of crime victims. Each utterance of the dialogue is annotated with one or more emotion categories from the 16 emotion classes including neutral, and their corresponding intensity values. We further propose strong contextual baselines that can detect emotion(s) and the corresponding intensity of an utterance given the conversational context. △ Less

Submitted 27 May, 2022; originally announced May 2022.

Comments: This paper is accepted at LREC 2022

Weakly Supervised Explainable Phrasal Reasoning with Neural Fuzzy Logic

Authors: Zijun Wu, Zi Xuan Zhang, Atharva Naik, Zhijian Mei, Mauajama Firdaus, Lili Mou

Abstract: Natural language inference (NLI) aims to determine the logical relationship between two sentences, such as Entailment, Contradiction, and Neutral. In recent years, deep learning models have become a prevailing approach to NLI, but they lack interpretability and explainability. In this work, we address the explainability of NLI by weakly supervised logical reasoning, and propose an Explainable Phra… ▽ More Natural language inference (NLI) aims to determine the logical relationship between two sentences, such as Entailment, Contradiction, and Neutral. In recent years, deep learning models have become a prevailing approach to NLI, but they lack interpretability and explainability. In this work, we address the explainability of NLI by weakly supervised logical reasoning, and propose an Explainable Phrasal Reasoning (EPR) approach. Our model first detects phrases as the semantic unit and aligns corresponding phrases in the two sentences. Then, the model predicts the NLI label for the aligned phrases, and induces the sentence label by fuzzy logic formulas. Our EPR is almost everywhere differentiable and thus the system can be trained end to end. In this way, we are able to provide explicit explanations of phrasal logical relationships in a weakly supervised manner. We further show that such reasoning results help textual explanation generation. △ Less

Submitted 22 February, 2023; v1 submitted 18 September, 2021; originally announced September 2021.

Comments: Accepted by ICLR 2023

A Review of Link Aggregation Control Protocol (LACP) as a Link Redundancy in SDN Based Network Using Ryu-Controller

Authors: Ali Ibnun Nurhadi, Guntur Petrus B. K., Muhammad Firdaus, Raditya Muhammad

Abstract: A reliable network is an absolute requirement for telecommunication networks at this time. This is in line with the growing number of users who need a reliable and uninterrupted connection to the server. Link Aggregation is one of the techniques that can be used to provide a reliable network. Link Aggregation System combines two or more links into one logical link, which is characterized by the us… ▽ More A reliable network is an absolute requirement for telecommunication networks at this time. This is in line with the growing number of users who need a reliable and uninterrupted connection to the server. Link Aggregation is one of the techniques that can be used to provide a reliable network. Link Aggregation System combines two or more links into one logical link, which is characterized by the use of a single IP address. During the communication between host and server, whenever the used link is broken or terminated the other active link can act as redundancy to resume that communication. This mechanism is called link redundancy. This mechanism will not run without the existence of another mechanism that monitors the condition of the links, which is either connected or disconnected. That mechanism is called link monitoring. Link monitoring used in this simulation is the Media Independent Interface (MII). In this simulation, we used Ryu-Controller and mininet Simulator to test the reliability of Link Aggregation-based SDN (Software Defined Network). During the simulation, we analyzed failover performance and how the Link Aggregation distributes the connection across the links for every which comes from a different source. From the simulations, we confirmed that link redundancy, the same data rate for every connection, to some degree, worked as intended. △ Less

Submitted 23 May, 2020; originally announced May 2020.

Implementation of Self-Organizing Network (SON) on Cellular Technology base on Big Data Analytic

Authors: Muhammad Firdaus, Raditya Muhammad, Rifqy Hakimi

Abstract: The development of cellular technology will be directly proportional to the increasing requirement in various aspects, such as the speed of data transmission (velocity), data variations (variety), and data storage media (volume). The increase in various aspects will have a direct impact on the growth of internet users worldwide. In relation to that, the demand for increased capacity and coverage b… ▽ More The development of cellular technology will be directly proportional to the increasing requirement in various aspects, such as the speed of data transmission (velocity), data variations (variety), and data storage media (volume). The increase in various aspects will have a direct impact on the growth of internet users worldwide. In relation to that, the demand for increased capacity and coverage becomes a necessity because users access the networks using the same resources by utilizing resource sharing mechanism. Self Organizing Network (SON) is one of the solutions to make the system more efficient with guaranteed Quality of Experiment (QoE). SON can create an automated network with a self-optimization, self-configuration and self-healing mechanism. Big Data is leveraged in the network analytics as a reference for decision-making activities in the network automation process. In this paper, SON using Big Data analytics on 5G network is compared with SON on 4G network as the previous network technology. It is suggested that on 5G networks, Big Data changes the SON detection paradigm from reactive to proactive. Detecting problems starts with data collection and analysis of possible network problems. By predicting network problems early, solving network problems can be done faster. Additionally, by using Multi-hop relay, the distance between User Equipment (EU) and Base Station (BS) will be shorter. Therefore, the aim of increasing capacity and coverage can be fulfilled. △ Less

Submitted 23 May, 2020; originally announced May 2020.