Showing 151–200 of 359 results for author: Khan, H

Towards Developing a Multilingual and Code-Mixed Visual Question Answering System by Knowledge Distillation

Authors: Humair Raj Khan, Deepak Gupta, Asif Ekbal

Abstract: Pre-trained language-vision models have shown remarkable performance on the visual question answering (VQA) task. However, most pre-trained models are trained by only considering monolingual learning, especially the resource-rich language like English. Training such models for multilingual setups demand high computing resources and multilingual language-vision dataset which hinders their applicati… ▽ More Pre-trained language-vision models have shown remarkable performance on the visual question answering (VQA) task. However, most pre-trained models are trained by only considering monolingual learning, especially the resource-rich language like English. Training such models for multilingual setups demand high computing resources and multilingual language-vision dataset which hinders their application in practice. To alleviate these challenges, we propose a knowledge distillation approach to extend an English language-vision model (teacher) into an equally effective multilingual and code-mixed model (student). Unlike the existing knowledge distillation methods, which only use the output from the last layer of the teacher network for distillation, our student model learns and imitates the teacher from multiple intermediate layers (language and vision encoders) with appropriately designed distillation objectives for incremental knowledge extraction. We also create the large-scale multilingual and code-mixed VQA dataset in eleven different language setups considering the multiple Indian and European languages. Experimental results and in-depth analysis show the effectiveness of the proposed VQA model over the pre-trained language-vision models on eleven diverse language setups. △ Less

Submitted 9 September, 2021; originally announced September 2021.

Comments: Accepted in EMNLP-Findings (2021)

Segmentation of Shoulder Muscle MRI Using a New Region and Edge based Deep Auto-Encoder

Authors: Saddam Hussain Khan, Asifullah Khan, Yeon Soo Lee, Mehdi Hassan, Woong Kyo jeong

Abstract: Automatic segmentation of shoulder muscle MRI is challenging due to the high variation in muscle size, shape, texture, and spatial position of tears. Manual segmentation of tear and muscle portion is hard, time-consuming, and subjective to pathological expertise. This work proposes a new Region and Edge-based Deep Auto-Encoder (RE-DAE) for shoulder muscle MRI segmentation. The proposed RE-DAE harm… ▽ More Automatic segmentation of shoulder muscle MRI is challenging due to the high variation in muscle size, shape, texture, and spatial position of tears. Manual segmentation of tear and muscle portion is hard, time-consuming, and subjective to pathological expertise. This work proposes a new Region and Edge-based Deep Auto-Encoder (RE-DAE) for shoulder muscle MRI segmentation. The proposed RE-DAE harmoniously employs average and max-pooling operation in the encoder and decoder blocks of the Convolutional Neural Network (CNN). Region-based segmentation incorporated in the Deep Auto-Encoder (DAE) encourages the network to extract smooth and homogenous regions. In contrast, edge-based segmentation tries to learn the boundary and anatomical information. These two concepts, systematically combined in a DAE, generate a discriminative and sparse hybrid feature space (exploiting both region homogeneity and boundaries). Moreover, the concept of static attention is exploited in the proposed RE-DAE that helps in effectively learning the tear region. The performances of the proposed MRI segmentation based DAE architectures have been tested using a 3D MRI shoulder muscle dataset using the hold-out cross-validation technique. The MRI data has been collected from the Korea University Anam Hospital, Seoul, South Korea. Experimental comparisons have been conducted by employing innovative custom-made and existing pre-trained CNN architectures both using transfer learning and fine-tuning. Objective evaluation on the muscle datasets using the proposed SA-RE-DAE showed a dice similarity of 85.58% and 87.07%, an accuracy of 81.57% and 95.58% for tear and muscle regions, respectively. The high visual quality and the objective result suggest that the proposed SA-RE-DAE is able to correctly segment tear and muscle regions in shoulder muscle MRI for better clinical decisions. △ Less

Submitted 26 August, 2021; originally announced August 2021.

Comments: Pages: 23, 8 Figures, 2 Tables

Analytical solution of the uniaxial extension problem for the relaxed micromorphic continuum and other generalized continua (including full derivations)

Authors: Gianluca Rizzi, Hassam Khan, Ionel-Dumitrel Ghiba, Angela Madeo, Patrizio Neff

Abstract: We derive analytical solutions for the uniaxial extension problem for the relaxed micromorphic continuum and other generalized continua. These solutions may help in the identification of material parameters of generalized continua which are able to disclose size-effects. We derive analytical solutions for the uniaxial extension problem for the relaxed micromorphic continuum and other generalized continua. These solutions may help in the identification of material parameters of generalized continua which are able to disclose size-effects. △ Less

Submitted 19 July, 2021; originally announced July 2021.

Comments: 16 pages, 5 figures. arXiv admin note: substantial text overlap with arXiv:2104.11322

Malware Classification Using Deep Boosted Learning

Authors: Muhammad Asam, Saddam Hussain Khan, Tauseef Jamal, Umme Zahoora, Asifullah Khan

Abstract: Malicious activities in cyberspace have gone further than simply hacking machines and spreading viruses. It has become a challenge for a nations survival and hence has evolved to cyber warfare. Malware is a key component of cyber-crime, and its analysis is the first line of defence against attack. This work proposes a novel deep boosted hybrid learning-based malware classification framework and na… ▽ More Malicious activities in cyberspace have gone further than simply hacking machines and spreading viruses. It has become a challenge for a nations survival and hence has evolved to cyber warfare. Malware is a key component of cyber-crime, and its analysis is the first line of defence against attack. This work proposes a novel deep boosted hybrid learning-based malware classification framework and named as Deep boosted Feature Space-based Malware classification (DFS-MC). In the proposed framework, the discrimination power is enhanced by fusing the feature spaces of the best performing customized CNN architectures models and its discrimination by an SVM for classification. The discrimination capacity of the proposed classification framework is assessed by comparing it against the standard customized CNNs. The customized CNN models are implemented in two ways: softmax classifier and deep hybrid learning-based malware classification. In the hybrid learning, Deep features are extracted from customized CNN architectures and fed into the conventional machine learning classifier to improve the classification performance. We also introduced the concept of transfer learning in a customized CNN architecture based malware classification framework through fine-tuning. The performance of the proposed malware classification approaches are validated on the MalImg malware dataset using the hold-out cross-validation technique. Experimental comparisons were conducted by employing innovative, customized CNN, trained from scratch and fine-tuning the customized CNN using transfer learning. The proposed classification framework DFS-MC showed improved results, Accuracy: 98.61%, F-score: 0.96, Precision: 0.96, and Recall: 0.96. △ Less

Submitted 8 July, 2021; originally announced July 2021.

Output Randomization: A Novel Defense for both White-box and Black-box Adversarial Models

Authors: Daniel Park, Haidar Khan, Azer Khan, Alex Gittens, Bülent Yener

Abstract: Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model in a "white box" setting and to the opposite in a "black box" setting. In this paper, we explore the use of output randomization as a defense against attacks in both the black box and white box models and propose two defenses. In the firs… ▽ More Adversarial examples pose a threat to deep neural network models in a variety of scenarios, from settings where the adversary has complete knowledge of the model in a "white box" setting and to the opposite in a "black box" setting. In this paper, we explore the use of output randomization as a defense against attacks in both the black box and white box models and propose two defenses. In the first defense, we propose output randomization at test time to thwart finite difference attacks in black box settings. Since this type of attack relies on repeated queries to the model to estimate gradients, we investigate the use of randomization to thwart such adversaries from successfully creating adversarial examples. We empirically show that this defense can limit the success rate of a black box adversary using the Zeroth Order Optimization attack to 0%. Secondly, we propose output randomization training as a defense against white box adversaries. Unlike prior approaches that use randomization, our defense does not require its use at test time, eliminating the Backward Pass Differentiable Approximation attack, which was shown to be effective against other randomization defenses. Additionally, this defense has low overhead and is easily implemented, allowing it to be used together with other defenses across various model architectures. We evaluate output randomization training against the Projected Gradient Descent attacker and show that the defense can reduce the PGD attack's success rate down to 12% when using cross-entropy loss. △ Less

Submitted 8 July, 2021; originally announced July 2021.

Comments: This is a substantially changed version of an earlier preprint (arXiv:1905.09871)

Blockchain and 6G: The Future of Secure and Ubiquitous Communication

Authors: Ali Hussain Khan, Naveed UL Hassan, Chau Yuen, Jun Zhao, Dusit Niyato, Yan Zhang, H. Vincent Poor

Abstract: The future communication will be characterized by ubiquitous connectivity and security. These features will be essential requirements for the efficient functioning of the futuristic applications. In this paper, in order to highlight the impact of blockchain and 6G on the future communication systems, we categorize these application requirements into two broad groups. In the first category, called… ▽ More The future communication will be characterized by ubiquitous connectivity and security. These features will be essential requirements for the efficient functioning of the futuristic applications. In this paper, in order to highlight the impact of blockchain and 6G on the future communication systems, we categorize these application requirements into two broad groups. In the first category, called Requirement Group I \mbox{(RG-I)}, we include the performance-related needs on data rates, latency, reliability and massive connectivity, while in the second category, called Requirement Group II \mbox{(RG-II)}, we include the security-related needs on data integrity, non-repudiability, and auditability. With blockchain and 6G, the network decentralization and resource sharing would minimize resource under-utilization thereby facilitating RG-I targets. Furthermore, through appropriate selection of blockchain type and consensus algorithms, RG-II needs of 6G applications can also be readily addressed. Through this study, the combination of blockchain and 6G emerges as an elegant solution for secure and ubiquitous future communication. △ Less

Submitted 10 June, 2021; originally announced June 2021.

Optical calibration of the SNO+ detector in the water phase with deployed sources

Authors: SNO+ Collaboration, :, M. R. Anderson, S. Andringa, M. Askins, D. J. Auty, F. Barão, N. Barros, R. Bayes, E. W. Beier, A. Bialek, S. D. Biller, E. Blucher, M. Boulay, E. Caden, E. J. Callaghan, J. Caravaca, M. Chen, O. Chkvorets, B. Cleveland, D. Cookman, J. Corning, M. A. Cox, C. Deluce, M. M. Depatie , et al. (98 additional authors not shown)

Abstract: SNO+ is a large-scale liquid scintillator experiment with the primary goal of searching for neutrinoless double beta decay, and is located approximately 2 km underground in SNOLAB, Sudbury, Canada. The detector acquired data for two years as a pure water Cherenkov detector, starting in May 2017. During this period, the optical properties of the detector were measured in situ using a deployed light… ▽ More SNO+ is a large-scale liquid scintillator experiment with the primary goal of searching for neutrinoless double beta decay, and is located approximately 2 km underground in SNOLAB, Sudbury, Canada. The detector acquired data for two years as a pure water Cherenkov detector, starting in May 2017. During this period, the optical properties of the detector were measured in situ using a deployed light diffusing sphere, with the goal of improving the detector model and the energy response systematic uncertainties. The measured parameters included the water attenuation coefficients, effective attenuation coefficients for the acrylic vessel, and the angular response of the photomultiplier tubes and their surrounding light concentrators, all across different wavelengths. The calibrated detector model was validated using a deployed tagged gamma source, which showed a 0.6% variation in energy scale across the primary target volume. △ Less

Submitted 4 October, 2021; v1 submitted 7 June, 2021; originally announced June 2021.

Comments: Accepted by JINST (30 pages, 19 figures)

Journal ref: JINST 16 (2021) P10021

First demonstration of in-beam performance of bent Monolithic Active Pixel Sensors

Authors: ALICE ITS project, :, G. Aglieri Rinella, M. Agnello, B. Alessandro, F. Agnese, R. S. Akram, J. Alme, E. Anderssen, D. Andreou, F. Antinori, N. Apadula, P. Atkinson, R. Baccomi, A. Badalà, A. Balbino, C. Bartels, R. Barthel, F. Baruffaldi, I. Belikov, S. Beole, P. Becht, A. Bhatti, M. Bhopal, N. Bianchi , et al. (230 additional authors not shown)

Abstract: A novel approach for designing the next generation of vertex detectors foresees to employ wafer-scale sensors that can be bent to truly cylindrical geometries after thinning them to thicknesses of 20-40$μ$m. To solidify this concept, the feasibility of operating bent MAPS was demonstrated using 1.5$\times$3cm ALPIDE chips. Already with their thickness of 50$μ$m, they can be successfully bent to ra… ▽ More A novel approach for designing the next generation of vertex detectors foresees to employ wafer-scale sensors that can be bent to truly cylindrical geometries after thinning them to thicknesses of 20-40$μ$m. To solidify this concept, the feasibility of operating bent MAPS was demonstrated using 1.5$\times$3cm ALPIDE chips. Already with their thickness of 50$μ$m, they can be successfully bent to radii of about 2cm without any signs of mechanical or electrical damage. During a subsequent characterisation using a 5.4GeV electron beam, it was further confirmed that they preserve their full electrical functionality as well as particle detection performance. In this article, the bending procedure and the setup used for characterisation are detailed. Furthermore, the analysis of the beam test, including the measurement of the detection efficiency as a function of beam position and local inclination angle, is discussed. The results show that the sensors maintain their excellent performance after bending to radii of 2cm, with detection efficiencies above 99.9% at typical operating conditions, paving the way towards a new class of detectors with unprecedented low material budget and ideal geometrical properties. △ Less

Submitted 17 August, 2021; v1 submitted 27 May, 2021; originally announced May 2021.

JAS-GAN: Generative Adversarial Network Based Joint Atrium and Scar Segmentations on Unbalanced Atrial Targets

Authors: Jun Chen, Guang Yang, Habib Khan, Heye Zhang, Yanping Zhang, Shu Zhao, Raad Mohiaddin, Tom Wong, David Firmin, Jennifer Keegan

Abstract: Automated and accurate segmentations of left atrium (LA) and atrial scars from late gadolinium-enhanced cardiac magnetic resonance (LGE CMR) images are in high demand for quantifying atrial scars. The previous quantification of atrial scars relies on a two-phase segmentation for LA and atrial scars due to their large volume difference (unbalanced atrial targets). In this paper, we propose an inter… ▽ More Automated and accurate segmentations of left atrium (LA) and atrial scars from late gadolinium-enhanced cardiac magnetic resonance (LGE CMR) images are in high demand for quantifying atrial scars. The previous quantification of atrial scars relies on a two-phase segmentation for LA and atrial scars due to their large volume difference (unbalanced atrial targets). In this paper, we propose an inter-cascade generative adversarial network, namely JAS-GAN, to segment the unbalanced atrial targets from LGE CMR images automatically and accurately in an end-to-end way. Firstly, JAS-GAN investigates an adaptive attention cascade to automatically correlate the segmentation tasks of the unbalanced atrial targets. The adaptive attention cascade mainly models the inclusion relationship of the two unbalanced atrial targets, where the estimated LA acts as the attention map to adaptively focus on the small atrial scars roughly. Then, an adversarial regularization is applied to the segmentation tasks of the unbalanced atrial targets for making a consistent optimization. It mainly forces the estimated joint distribution of LA and atrial scars to match the real ones. We evaluated the performance of our JAS-GAN on a 3D LGE CMR dataset with 192 scans. Compared with the state-of-the-art methods, our proposed approach yielded better segmentation performance (Average Dice Similarity Coefficient (DSC) values of 0.946 and 0.821 for LA and atrial scars, respectively), which indicated the effectiveness of our proposed approach for segmenting unbalanced atrial targets. △ Less

Submitted 1 May, 2021; originally announced May 2021.

Comments: Accepted by IEEE Journal of Biomedical and Health Informatics

MSC Class: 68T01

Existence and uniqueness of Rayleigh waves in isotropic elastic Cosserat materials and algorithmic aspects

Authors: Hassam Khan, Ionel-Dumitrel Ghiba, Angela Madeo, Patrizio Neff

Abstract: We discuss the propagation of surface waves in an isotropic half space modelled with the linear Cosserat theory of isotropic elastic materials. To this aim we use a method based on the algebraic analysis of the surface impedance matrix and on the algebraic Riccati equation, and which is independent of the common Stroh formalism. Due to this method, a new algorithm which determines the amplitudes a… ▽ More We discuss the propagation of surface waves in an isotropic half space modelled with the linear Cosserat theory of isotropic elastic materials. To this aim we use a method based on the algebraic analysis of the surface impedance matrix and on the algebraic Riccati equation, and which is independent of the common Stroh formalism. Due to this method, a new algorithm which determines the amplitudes and the wave speed in the theory of isotropic elastic Cosserat materials is described. Moreover, the method allows to prove the existence and uniqueness of a subsonic solution of the secular equation, a problem which remains unsolved in almost all generalised linear theories of elastic materials. Since the results are suitable to be used for numerical implementations, we propose two numerical algorithms which are viable for any elastic material. Explicit numerical calculations are made for alumunium-epoxy in the context of the Cosserat model. Since the novel form of the secular equation for isotropic elastic material has not been explicitly derived elsewhere, we establish it in this paper, too. △ Less

Submitted 1 February, 2022; v1 submitted 27 April, 2021; originally announced April 2021.

MSC Class: 74J15; 74M25; 74H05; 74J05

Rich Semantics Improve Few-shot Learning

Authors: Mohamed Afham, Salman Khan, Muhammad Haris Khan, Muzammal Naseer, Fahad Shahbaz Khan

Abstract: Human learning benefits from multi-modal inputs that often appear as rich semantics (e.g., description of an object's attributes while learning about it). This enables us to learn generalizable concepts from very limited visual examples. However, current few-shot learning (FSL) methods use numerical class labels to denote object classes which do not provide rich semantic meanings about the learned… ▽ More Human learning benefits from multi-modal inputs that often appear as rich semantics (e.g., description of an object's attributes while learning about it). This enables us to learn generalizable concepts from very limited visual examples. However, current few-shot learning (FSL) methods use numerical class labels to denote object classes which do not provide rich semantic meanings about the learned concepts. In this work, we show that by using 'class-level' language descriptions, that can be acquired with minimal annotation cost, we can improve the FSL performance. Given a support set and queries, our main idea is to create a bottleneck visual feature (hybrid prototype) which is then used to generate language descriptions of the classes as an auxiliary task during training. We develop a Transformer based forward and backward encoding mechanism to relate visual and semantic tokens that can encode intricate relationships between the two modalities. Forcing the prototypes to retain semantic information about class description acts as a regularizer on the visual features, improving their generalization to novel classes at inference. Furthermore, this strategy imposes a human prior on the learned representations, ensuring that the model is faithfully relating visual and semantic concepts, thereby improving model interpretability. Our experiments on four datasets and ablation studies show the benefit of effectively modeling rich semantics for FSL. △ Less

Submitted 12 November, 2021; v1 submitted 26 April, 2021; originally announced April 2021.

Comments: Accepted to 32nd British Machine Vision Conference (BMVC 2021)

Analytical solution of the cylindrical torsion problem for the relaxed micromorphic continuum and other generalized continua (including full derivations)

Authors: Gianluca Rizzi, Geralf Hütter, Hassam Khan, Ionel Dumitrel Ghiba, Angela Madeo, Patrizio Neff

Abstract: We solve the St.Venant torsion problem for an infinite cylindrical rod whose behaviour is described by a family of isotropic generalized continua, including the relaxed micromorphic and classical micromorphic model. The results can be used to determine the material parameters of these models. Special attention is given to the possible nonphysical stiffness singularity for a vanishing rod diameter,… ▽ More We solve the St.Venant torsion problem for an infinite cylindrical rod whose behaviour is described by a family of isotropic generalized continua, including the relaxed micromorphic and classical micromorphic model. The results can be used to determine the material parameters of these models. Special attention is given to the possible nonphysical stiffness singularity for a vanishing rod diameter, since slender specimens are in general described as stiffer. △ Less

Submitted 7 April, 2021; originally announced April 2021.

Comments: 41 pages, 29 figures

NPE: An FPGA-based Overlay Processor for Natural Language Processing

Authors: Hamza Khan, Asma Khan, Zainab Khan, Lun Bin Huang, Kun Wang, Lei He

Abstract: In recent years, transformer-based models have shown state-of-the-art results for Natural Language Processing (NLP). In particular, the introduction of the BERT language model brought with it breakthroughs in tasks such as question answering and natural language inference, advancing applications that allow humans to interact naturally with embedded devices. FPGA-based overlay processors have been… ▽ More In recent years, transformer-based models have shown state-of-the-art results for Natural Language Processing (NLP). In particular, the introduction of the BERT language model brought with it breakthroughs in tasks such as question answering and natural language inference, advancing applications that allow humans to interact naturally with embedded devices. FPGA-based overlay processors have been shown as effective solutions for edge image and video processing applications, which mostly rely on low precision linear matrix operations. In contrast, transformer-based NLP techniques employ a variety of higher precision nonlinear operations with significantly higher frequency. We present NPE, an FPGA-based overlay processor that can efficiently execute a variety of NLP models. NPE offers software-like programmability to the end user and, unlike FPGA designs that implement specialized accelerators for each nonlinear function, can be upgraded for future NLP models without requiring reconfiguration. We demonstrate that NPE can meet real-time conversational AI latency targets for the BERT language model with $4\times$ lower power than CPUs and $6\times$ lower power than GPUs. We also show NPE uses $3\times$ fewer FPGA resources relative to comparable BERT network-specific accelerators in the literature. NPE provides a cost-effective and power-efficient FPGA-based solution for Natural Language Processing at the edge. △ Less

Submitted 13 April, 2021; originally announced April 2021.

Comments: 11 pages, 6 figures

toon2real: Translating Cartoon Images to Realistic Images

Authors: K. M. Arefeen Sultan, Mohammad Imrul Jubair, MD. Nahidul Islam, Sayed Hossain Khan

Abstract: In terms of Image-to-image translation, Generative Adversarial Networks (GANs) has achieved great success even when it is used in the unsupervised dataset. In this work, we aim to translate cartoon images to photo-realistic images using GAN. We apply several state-of-the-art models to perform this task; however, they fail to perform good quality translations. We observe that the shallow difference… ▽ More In terms of Image-to-image translation, Generative Adversarial Networks (GANs) has achieved great success even when it is used in the unsupervised dataset. In this work, we aim to translate cartoon images to photo-realistic images using GAN. We apply several state-of-the-art models to perform this task; however, they fail to perform good quality translations. We observe that the shallow difference between these two domains causes this issue. Based on this idea, we propose a method based on CycleGAN model for image translation from cartoon domain to photo-realistic domain. To make our model efficient, we implemented Spectral Normalization which added stability in our model. We demonstrate our experimental results and show that our proposed model has achieved the lowest Frechet Inception Distance score and better results compared to another state-of-the-art technique, UNIT. △ Less

Submitted 1 February, 2021; originally announced February 2021.

Comments: Accepted as a short paper at ICTAI 2020

Thermal corrections in Bardeen type regular black holes

Authors: Yawar H. Khan, P. A. Ganai

Abstract: We carry quantum (thermal) corrections to the thermodynamics of regular black holes in detail. Firstly, we discuss the non-extended phase space thermodynamics of regular black holes. We obtain expressions for various thermodynamic quantities like temperature, entropy, internal energy, Helmholtz free energy, pressure, enthalpy, and Gibbs free energy. Then we introduce quantum corrections to the the… ▽ More We carry quantum (thermal) corrections to the thermodynamics of regular black holes in detail. Firstly, we discuss the non-extended phase space thermodynamics of regular black holes. We obtain expressions for various thermodynamic quantities like temperature, entropy, internal energy, Helmholtz free energy, pressure, enthalpy, and Gibbs free energy. Then we introduce quantum corrections to the thermodynamics of Bardeen type (toy model) of regular black holes. The qualitative and quantitative analysis of these corrections is carried by plotting all the corrected thermodynamic quantities. The comparative analysis is then done where the effects of these corrections can be clearly seen. △ Less

Submitted 22 January, 2021; originally announced January 2021.

Network Traffic Control for Multi-homed End-hosts via SDN

Authors: Anees Al-Najjar, Furqan Hameed Khan, Marius Portmann

Abstract: Software Defined Networking (SDN) is an emerging technology of efficiently controlling and managing computer networks, such as in data centres, Wide Area Networks (WANs), as well as in ubiquitous communication. In this paper, we explore the idea of embedding the SDN components, represented by SDN controller and virtual switch, in end-hosts to improve network performance. In particular, we consider… ▽ More Software Defined Networking (SDN) is an emerging technology of efficiently controlling and managing computer networks, such as in data centres, Wide Area Networks (WANs), as well as in ubiquitous communication. In this paper, we explore the idea of embedding the SDN components, represented by SDN controller and virtual switch, in end-hosts to improve network performance. In particular, we consider load balancing across multiple network interfaces on end-hosts with different link capacity scenarios. We have explored and implemented different SDN-based load balancing approaches based on OpenFlow software switches, and have demonstrated the feasibility and the potential of this approach. The proposed system has been evaluated with multipath transmission control protocol (MPTCP). Our results demonstrated the potential of applying the SDN concepts on multi-homed devices resulting in an increase in achieved throughput of 55\% compared to the legacy single network approach and 10\% compared to the MPTCP. △ Less

Submitted 13 December, 2020; originally announced December 2020.

Comments: 13 pages, 26 Figures

ACM Class: D.8.3; D.3.2

COVID-19 Detection in Chest X-Ray Images using a New Channel Boosted CNN

Authors: Saddam Hussain Khan, Anabia Sohail, Asifullah Khan

Abstract: COVID-19 is a highly contagious respiratory infection that has affected a large population across the world and continues with its devastating consequences. It is imperative to detect COVID-19 at the earliest to limit the span of infection. In this work, a new classification technique CB-STM-RENet based on deep Convolutional Neural Network (CNN) and Channel Boosting is proposed for the screening o… ▽ More COVID-19 is a highly contagious respiratory infection that has affected a large population across the world and continues with its devastating consequences. It is imperative to detect COVID-19 at the earliest to limit the span of infection. In this work, a new classification technique CB-STM-RENet based on deep Convolutional Neural Network (CNN) and Channel Boosting is proposed for the screening of COVID-19 in chest X-Rays. In this connection, to learn the COVID-19 specific radiographic patterns, a new convolution block based on split-transform-merge (STM) is developed. This new block systematically incorporates region and edge-based operations at each branch to capture the diverse set of features at various levels, especially those related to region homogeneity, textural variations, and boundaries of the infected region. The learning and discrimination capability of the proposed CNN architecture is enhanced by exploiting the Channel Boosting idea that concatenates the auxiliary channels along with the original channels. The auxiliary channels are generated from the pre-trained CNNs using Transfer Learning. The effectiveness of the proposed technique CB-STM-RENet is evaluated on three different datasets of chest X-Rays namely CoV-Healthy-6k, CoV-NonCoV-10k, and CoV-NonCoV-15k. The performance comparison of the proposed CB-STM-RENet with the existing techniques exhibits high performance both in discriminating COVID-19 chest infections from Healthy, as well as, other types of chest infections. CB-STM-RENet provides the highest performance on all these three datasets; especially on the stringent CoV-NonCoV-15k dataset. The good detection rate (97%), and high precision (93%) of the proposed technique suggest that it can be adapted for the diagnosis of COVID-19 infected patients. The test code is available at https://github.com/PRLAB21/COVID-19-Detection-System-using-Chest-X-Ray-Images. △ Less

Submitted 17 December, 2020; v1 submitted 8 December, 2020; originally announced December 2020.

Comments: Pages: 26 Tables: 3 Figures: 10 Equations: 8

Using multiple ASR hypotheses to boost i18n NLU performance

Authors: Charith Peris, Gokmen Oz, Khadige Abboud, Venkata sai Varada, Prashan Wanigasekara, Haidar Khan

Abstract: Current voice assistants typically use the best hypothesis yielded by their Automatic Speech Recognition (ASR) module as input to their Natural Language Understanding (NLU) module, thereby losing helpful information that might be stored in lower-ranked ASR hypotheses. We explore the change in performance of NLU associated tasks when utilizing five-best ASR hypotheses when compared to status quo fo… ▽ More Current voice assistants typically use the best hypothesis yielded by their Automatic Speech Recognition (ASR) module as input to their Natural Language Understanding (NLU) module, thereby losing helpful information that might be stored in lower-ranked ASR hypotheses. We explore the change in performance of NLU associated tasks when utilizing five-best ASR hypotheses when compared to status quo for two language datasets, German and Portuguese. To harvest information from the ASR five-best, we leverage extractive summarization and joint extractive-abstractive summarization models for Domain Classification (DC) experiments while using a sequence-to-sequence model with a pointer generator network for Intent Classification (IC) and Named Entity Recognition (NER) multi-task experiments. For the DC full test set, we observe significant improvements of up to 7.2% and 15.5% in micro-averaged F1 scores, for German and Portuguese, respectively. In cases where the best ASR hypothesis was not an exact match to the transcribed utterance (mismatched test set), we see improvements of up to 6.7% and 8.8% micro-averaged F1 scores, for German and Portuguese, respectively. For IC and NER multi-task experiments, when evaluating on the mismatched test set, we see improvements across all domains in German and in 17 out of 19 domains in Portuguese (improvements based on change in SeMER scores). Our results suggest that the use of multiple ASR hypotheses, as opposed to one, can lead to significant performance improvements in the DC task for these non-English datasets. In addition, it could lead to significant improvement in the performance of IC and NER tasks in cases where the ASR model makes mistakes. △ Less

Submitted 14 December, 2020; v1 submitted 7 December, 2020; originally announced December 2020.

Comments: 9 pages, 4 Figures, 5 Tables, Accepted to ICON 2020 (17th International Conference on Natural Language Processing)

Braille to Text Translation for Bengali Language: A Geometric Approach

Authors: Minhas Kamal, Dr. Amin Ahsan Ali, Dr. Muhammad Asif Hossain Khan, Dr. Mohammad Shoyaib

Abstract: Braille is the only system to visually impaired people for reading and writing. However, general people cannot read Braille. So, teachers and relatives find it hard to assist them with learning. Almost every major language has software solutions for this translation purpose. However, in Bengali there is an absence of this useful tool. Here, we propose Braille to Text Translator, which takes image… ▽ More Braille is the only system to visually impaired people for reading and writing. However, general people cannot read Braille. So, teachers and relatives find it hard to assist them with learning. Almost every major language has software solutions for this translation purpose. However, in Bengali there is an absence of this useful tool. Here, we propose Braille to Text Translator, which takes image of these tactile alphabets, and translates them to plain text. Image deterioration, scan-time page rotation, and braille dot deformation are the principal issues in this scheme. All of these challenges are directly checked using special image processing and geometric structure analysis. The technique yields 97.25% accuracy in recognizing Braille characters. △ Less

Submitted 2 December, 2020; originally announced December 2020.

Journal ref: In Jahangirnagar University Journal of Information Technology (JJIT), pp. 93-111, 2018

Risk-Informed Participation in T&D Markets

Authors: Hafiz Anwar Ullah Khan, Jip Kim, Yury Dvorkin

Abstract: Power producers can exhibit strategic behavior in electricity markets to maximize their profits. This behavior is more pronounced with the deregulation of distribution markets, which offers an opportunity for profit arbitrage between transmission and distribution (T&D) markets. However, the temporally distinct nature of these two markets introduces a significant risk in profit for such producers.… ▽ More Power producers can exhibit strategic behavior in electricity markets to maximize their profits. This behavior is more pronounced with the deregulation of distribution markets, which offers an opportunity for profit arbitrage between transmission and distribution (T&D) markets. However, the temporally distinct nature of these two markets introduces a significant risk in profit for such producers. This paper derives its motivation from the perspective of a strategic producer and develops a Single Leader Multi-Follower (SLMF) game for deriving its participation strategies in T&D markets, while accounting for different T&D coordination schemes based on the individual market Gate Closure Times (GCT). We compare and contrast joint and sequential market clearing models with regulated and deregulated distribution environments and evaluate the risk of producer by leveraging consistent and coherent risk measures. SLMF game is reformulated as a Mathematical Program with Equilibrium Constraints (MPEC) and is solved using the seminal Scholtes's relaxation scheme. We validate the efficacy of our model and solution approach via the case study carried out on the 11-zone New York ISO, and 7-bus Manhattan power networks, used as transmission and distribution markets, respectively. △ Less

Submitted 15 October, 2020; originally announced October 2020.

Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings

Authors: Prafull Prakash, Saurabh Kumar Shashidhar, Wenlong Zhao, Subendhu Rongali, Haidar Khan, Michael Kayser

Abstract: The current state-of-the-art task-oriented semantic parsing models use BERT or RoBERTa as pretrained encoders; these models have huge memory footprints. This poses a challenge to their deployment for voice assistants such as Amazon Alexa and Google Assistant on edge devices with limited memory budgets. We propose to learn compositional code embeddings to greatly reduce the sizes of BERT-base and R… ▽ More The current state-of-the-art task-oriented semantic parsing models use BERT or RoBERTa as pretrained encoders; these models have huge memory footprints. This poses a challenge to their deployment for voice assistants such as Amazon Alexa and Google Assistant on edge devices with limited memory budgets. We propose to learn compositional code embeddings to greatly reduce the sizes of BERT-base and RoBERTa-base. We also apply the technique to DistilBERT, ALBERT-base, and ALBERT-large, three already compressed BERT variants which attain similar state-of-the-art performances on semantic parsing with much smaller model sizes. We observe 95.15% ~ 98.46% embedding compression rates and 20.47% ~ 34.22% encoder compression rates, while preserving greater than 97.5% semantic parsing performances. We provide the recipe for training and analyze the trade-off between code embedding sizes and downstream performances. △ Less

Submitted 10 October, 2020; originally announced October 2020.

Comments: Accepted at EMNLP 2020 (Findings); 7 Pages

Don't Parse, Insert: Multilingual Semantic Parsing with Insertion Based Decoding

Authors: Qile Zhu, Haidar Khan, Saleh Soltan, Stephen Rawls, Wael Hamza

Abstract: Semantic parsing is one of the key components of natural language understanding systems. A successful parse transforms an input utterance to an action that is easily understood by the system. Many algorithms have been proposed to solve this problem, from conventional rulebased or statistical slot-filling systems to shiftreduce based neural parsers. For complex parsing tasks, the state-of-the-art m… ▽ More Semantic parsing is one of the key components of natural language understanding systems. A successful parse transforms an input utterance to an action that is easily understood by the system. Many algorithms have been proposed to solve this problem, from conventional rulebased or statistical slot-filling systems to shiftreduce based neural parsers. For complex parsing tasks, the state-of-the-art method is based on autoregressive sequence to sequence models to generate the parse directly. This model is slow at inference time, generating parses in O(n) decoding steps (n is the length of the target sequence). In addition, we demonstrate that this method performs poorly in zero-shot cross-lingual transfer learning settings. In this paper, we propose a non-autoregressive parser which is based on the insertion transformer to overcome these two issues. Our approach 1) speeds up decoding by 3x while outperforming the autoregressive model and 2) significantly improves cross-lingual transfer in the low-resource setting by 37% compared to autoregressive baseline. We test our approach on three well-known monolingual datasets: ATIS, SNIPS and TOP. For cross lingual semantic parsing, we use the MultiATIS++ and the multilingual TOP datasets. △ Less

Submitted 7 October, 2020; originally announced October 2020.

Comments: Presented at CoNLL 2020

Stable remnants and quantum gravity effects in non linear electric source Culetu black hole

Authors: Yawar H. Khan, Prince A. Ganai, Sudhaker Upadhyay

Abstract: In this paper, we discuss remnants and quantum gravity effects on thermodynamics of new kind of regular black hole known as Culetu black hole. The black hole results in coupling of gravity to non linear electrodynamic source. We first derive various thermodynamic quantities of interest. We then discuss in detail the existence and stability of remnants. The stability of remnants is analyzed in pres… ▽ More In this paper, we discuss remnants and quantum gravity effects on thermodynamics of new kind of regular black hole known as Culetu black hole. The black hole results in coupling of gravity to non linear electrodynamic source. We first derive various thermodynamic quantities of interest. We then discuss in detail the existence and stability of remnants. The stability of remnants is analyzed in presence of thermal fluctuations and we observe that thermal fluctuations tend to increase the entropy at the horizon radius which is exactly the remnant radius. We then investigate non perturbative quantum gravity effects on the thermodynamics of Culetu black hole up to leading order terms. △ Less

Submitted 30 September, 2020; originally announced October 2020.

Comments: 13 pages, 11 figures, published in EPJP

Journal ref: Eur. Phys. J. Plus 135, 620 (2020)

Experimental Evaluation of LoRaWAN in NS-3

Authors: Furqan Hameed Khan, Marius Portmann

Abstract: Long Range Wide Area Networks (LoRaWAN) is an open medium access control (MAC) layer technology devised for the long range connectivity of massive number of low power network devices. This work gives an overview of the key aspects of LoRaWAN technology and presents results that we achieved via extensive evaluation of Class A LoRaWAN devices in different network settings using the state-of-the-art… ▽ More Long Range Wide Area Networks (LoRaWAN) is an open medium access control (MAC) layer technology devised for the long range connectivity of massive number of low power network devices. This work gives an overview of the key aspects of LoRaWAN technology and presents results that we achieved via extensive evaluation of Class A LoRaWAN devices in different network settings using the state-of-the-art network simulator (NS-3). At first, we focus on a single device and its mobility. We further undertook evaluations in an extended network scenario with a changing number of devices and traffic intensity. In particular, we evaluate the packet delivery ratio (PDR), uplink (UL) throughput, and sub-band utilization for the confirmed and unconfirmed UL transmissions in different environments. Our results give new insights for future efforts to optimize the LoRaWAN performance for different large scale Internet of Things (IoT) applications with low power end devices. △ Less

Submitted 20 September, 2020; originally announced September 2020.

Comments: 8 pages, 11 figures

Journal ref: Proc. 28th Int. Telecommun. Netw. Appl. Conf. (ITNAC), pp. 1-8, Nov. 2019

A Model for Reliable Uplink Transmissions in LoRaWAN

Authors: Furqan Hameed Khan, Raja Jurdak, Marius Portmann

Abstract: Long range wide area networks (LoRaWAN) technology provides a simple solution to enable low-cost services for low power internet-of-things (IoT) networks in various applications. The current evaluation of LoRaWAN networks relies on simulations or early testing, which are typically time consuming and prevent effective exploration of the design space. This paper proposes an analytical model to calcu… ▽ More Long range wide area networks (LoRaWAN) technology provides a simple solution to enable low-cost services for low power internet-of-things (IoT) networks in various applications. The current evaluation of LoRaWAN networks relies on simulations or early testing, which are typically time consuming and prevent effective exploration of the design space. This paper proposes an analytical model to calculate the delay and energy consumed for reliable Uplink (UL) data delivery in Class A LoRaWAN. The analytical model is evaluated using a real network test-bed as well as simulation experiments based on the ns-3 LoRaWAN module. The resulting comparison confirms that the model accurately estimates the delay and energy consumed in the considered environment. The value of the model is demonstrated via its application to evaluate the impact of the number of end-devices and the maximum number of data frame retransmissions on delay and energy consumed for the confirmed UL data delivery in LoRaWAN networks. The model can be used to optimize different transmission parameters in future LoRaWAN networks. △ Less

Submitted 20 September, 2020; originally announced September 2020.

Comments: 11 pages, 8 figures

Journal ref: Marius (2019) 147-156

Classification and Region Analysis of COVID-19 Infection using Lung CT Images and Deep Convolutional Neural Networks

Authors: Saddam Hussain Khan, Anabia Sohail, Asifullah Khan, Yeon Soo Lee

Abstract: COVID-19 is a global health problem. Consequently, early detection and analysis of the infection patterns are crucial for controlling infection spread as well as devising a treatment plan. This work proposes a two-stage deep Convolutional Neural Networks (CNNs) based framework for delineation of COVID-19 infected regions in Lung CT images. In the first stage, initially, COVID-19 specific CT image… ▽ More COVID-19 is a global health problem. Consequently, early detection and analysis of the infection patterns are crucial for controlling infection spread as well as devising a treatment plan. This work proposes a two-stage deep Convolutional Neural Networks (CNNs) based framework for delineation of COVID-19 infected regions in Lung CT images. In the first stage, initially, COVID-19 specific CT image features are enhanced using a two-level discrete wavelet transformation. These enhanced CT images are then classified using the proposed custom-made deep CoV-CTNet. In the second stage, the CT images classified as infectious images are provided to the segmentation models for the identification and analysis of COVID-19 infectious regions. In this regard, we propose a novel semantic segmentation model CoV-RASeg, which systematically uses average and max pooling operations in the encoder and decoder blocks. This systematic utilization of max and average pooling operations helps the proposed CoV-RASeg in simultaneously learning both the boundaries and region homogeneity. Moreover, the idea of attention is incorporated to deal with mildly infected regions. The proposed two-stage framework is evaluated on a standard Lung CT image dataset, and its performance is compared with the existing deep CNN models. The performance of the proposed CoV-CTNet is evaluated using Mathew Correlation Coefficient (MCC) measure (0.98) and that of proposed CoV-RASeg using Dice Similarity (DS) score (0.95). The promising results on an unseen test set suggest that the proposed framework has the potential to help the radiologists in the identification and analysis of COVID-19 infected regions. △ Less

Submitted 15 September, 2020; originally announced September 2020.

Comments: Pages: 32, Tables: 6, Figures: 14

Quantum corrected thermodynamics and $P-V$ criticality of self-gravitating Skyrmion black holes

Authors: Yawar H. Khan, Prince A. Ganai, Sudhaker Upadhyay

Abstract: In this paper, we study the quantum corrected thermodynamics of a class of black holes generated by self-gravitating Skyrmion models. One such black hole solution is Einstein-Skrymion black hole. We first compute the ADM mass of Einstein-Skyrmion black hole using on-shell Hamiltonian formalism present already in the literature. We then consider non-extended phase space thermodynamics and derive ex… ▽ More In this paper, we study the quantum corrected thermodynamics of a class of black holes generated by self-gravitating Skyrmion models. One such black hole solution is Einstein-Skrymion black hole. We first compute the ADM mass of Einstein-Skyrmion black hole using on-shell Hamiltonian formalism present already in the literature. We then consider non-extended phase space thermodynamics and derive expressions for various thermodynamic quantities like the Hawking temperature, entropy, pressure, Gibbs free energy, and heat capacity. Next, we study the effect of quantum corrections on the thermodynamics of the Einstein-Skyrmion black hole. We observe that apart from leading to stability, the quantum correction induce an AdS (anti-de sitter) to dS (de Sitter) phase transition in Einstein-Skrymion black hole. Treating cosmological constant as the pressure, we determine the $P-V$ criticality of the Einstein-Skrymion black hole and observe that the $P-V$ criticality depends on model parameters $λ$ and $K$. The study of $P-V$ criticality done here could help to estimate the experimental bound on the values of parameters $λ$ and $K$. △ Less

Submitted 22 August, 2020; originally announced August 2020.

Comments: 14 pages, 6 figures, to appear in PTEP

Journal ref: Prog. Theor. Exp. Phys. 2020, 103B06 (13 pages)

Widely Reused and Shared, Infrequently Updated, and Sometimes Inherited: A Holistic View of PIN Authentication in Digital Lives and Beyond

Authors: Hassan Khan, Jason Ceci, Jonah Stegman, Adam J. Aviv, Rozita Dara, Ravi Kuber

Abstract: Personal Identification Numbers (PINs) are widely used as an access control mechanism for digital assets (e.g., smartphones), financial assets (e.g., ATM cards), and physical assets (e.g., locks for garage doors or homes). Using semi-structured interviews (n=35), participants reported on PIN usage for different types of assets, including how users choose, share, inherit, and reuse PINs, as well as… ▽ More Personal Identification Numbers (PINs) are widely used as an access control mechanism for digital assets (e.g., smartphones), financial assets (e.g., ATM cards), and physical assets (e.g., locks for garage doors or homes). Using semi-structured interviews (n=35), participants reported on PIN usage for different types of assets, including how users choose, share, inherit, and reuse PINs, as well as behaviour following the compromise of a PIN. We find that memorability is the most important criterion when choosing a PIN, more so than security or concerns of reuse. Updating or changing a PIN is very uncommon, even when a PIN is compromised. Participants reported sharing PINs for one type of asset with acquaintances but inadvertently reused them for other assets, thereby subjecting themselves to potential risks. Participants also reported using PINs originally set by previous homeowners for physical devices (e.g., alarm or keypad door entry systems). While aware of the risks of not updating PINs, this did not always deter participants from using inherited PINs, as they were often missing instructions on how to update them. %While aware of the risks of not updating PINs, participants continued using these PINs, as they were often missing instructions on how to update them.Given the expected increase in PIN-protected assets (e.g., loyalty cards, smart locks, and web apps), we provide suggestions and future research directions to better support users with multiple digital and non-digital assets and more secure human-device interaction when utilizing PINs. △ Less

Submitted 24 August, 2020; originally announced August 2020.

Interpolatory projection technique for Riccati-based feedback stabilization of index-1 descriptor systems

Authors: Mahtab Uddin, M. Monir Uddin, M. A. H. Khan, Md. Motlubar Rahman

Abstract: The work aims to stabilize the unstable index-1 descriptor systems by Riccati-based feedback stabilization via a modified form of Iterative Rational Krylov Algorithm (IRKA), which is a bi-tangential interpolation-based technique. In the basic IRKA, for the stable systems the Reduced Order Models (ROMs) can be found conveniently, but it is unsuitable for the unstable ones. In the proposed technique… ▽ More The work aims to stabilize the unstable index-1 descriptor systems by Riccati-based feedback stabilization via a modified form of Iterative Rational Krylov Algorithm (IRKA), which is a bi-tangential interpolation-based technique. In the basic IRKA, for the stable systems the Reduced Order Models (ROMs) can be found conveniently, but it is unsuitable for the unstable ones. In the proposed technique, the initial feedback is implemented within the construction of the projectors of the IRKA approach. The solution of the Riccati equation is estimated from the ROM achieved by IRKA and hence the low-rank feedback matrix is attained. Using the reverse projecting process, for the full model the optimal feedback matrix is retrieved from the low-rank feedback matrix. Finally, to validate the aptness and competency of the proposed technique it is applied to unstable index-1 descriptor systems. The comparison of the present work with two previous works is narrated. The simulation is done by numerical computation using MATLAB, and both the tabular method and graphical method are used as the supporting tools of comparative analysis. △ Less

Submitted 30 March, 2021; v1 submitted 29 July, 2020; originally announced July 2020.

Comments: 12 pages, 7 figures

Capillary rise in vuggy media

Authors: Hasan J. Khan, Ayaz Mehmani, Maša Prodanović, David DiCarlo, Dayeed J. Khan

Abstract: Carbonates are highly heterogeneous formations with large variations in pore size distribution and pore space topology, which results in complex multiphase flow behavior. Here we investigate the spontaneous imbibition behavior of fluids in vuggy carbonates. Glass beads of 1.0 mm diameter, with dissolvable inclusions, are sintered to form multiple configurations of heterogeneous vuggy core with var… ▽ More Carbonates are highly heterogeneous formations with large variations in pore size distribution and pore space topology, which results in complex multiphase flow behavior. Here we investigate the spontaneous imbibition behavior of fluids in vuggy carbonates. Glass beads of 1.0 mm diameter, with dissolvable inclusions, are sintered to form multiple configurations of heterogeneous vuggy core with variations in matrix porosity, vug size, vug spatial location, and number of vugs. The core fabrication process is repeatable and allows the impact of vug textural properties to be investigated in a controlled manner. Capillary rise experiments are conducted in these proxy vuggy carbonate core and compared with the homogeneous non-vuggy core as reference. Continuous optical imaging is performed to track the position of the air-water interface in the cores. To understand the change in capillary height in the presence of a vug, a volume-of-fluid two-phase numerical simulation is performed in a parallel set of connected and disconnected tubes. Finally x-ray tomography scans are performed to identify the shape of the air-water interface in a select few cores. The results can be summarized as follows: disconnected vugs result in higher capillary rise compared to non-vuggy porous media. The vugs act as capillary barriers, diverting fluid flow to the adjacent connected channels, which ultimately results in a higher overall capillary rise. The results of this work highlight that radius of spontaneous invasion of aqueous phases, such as fracture fluid and hazardous wastes, are affected by vug porosity but not their distribution. △ Less

Submitted 26 June, 2020; originally announced June 2020.

Comments: 22 pages, data available at https://www.digitalrocksportal.org/projects/287

Computationally efficient optimal control for unstable power system models

Authors: Mahtab Uddin, M. Monir Uddin, Md. Abdul Hakim Khan

Abstract: In this article, the focus is mainly on gaining the optimal control for the unstable power system models and stabilizing them through the Riccati-based feedback stabilization process with sparsity-preserving techniques. We are to find the solution of the Continuous-time Algebraic Riccati Equations (CAREs) governed from the unstable power system models derived from the Brazilian Inter-Connected Pow… ▽ More In this article, the focus is mainly on gaining the optimal control for the unstable power system models and stabilizing them through the Riccati-based feedback stabilization process with sparsity-preserving techniques. We are to find the solution of the Continuous-time Algebraic Riccati Equations (CAREs) governed from the unstable power system models derived from the Brazilian Inter-Connected Power System (BIPS) models, which are large-scale sparse index-1 descriptor systems. We propose the projection-based Rational Krylov Subspace Method (RKSM) for the iterative computation of the solution of the CAREs. The novelties of RKSM are sparsity-preserving computations and the implementation of time-convenient adaptive shift parameters. We modify the Low-Rank Cholesky-Factor integrated Alternating Direction Implicit (LRCF-ADI) technique based nested iterative Kleinman-Newton (KN) method to a sparse form and adjust this to solve the desired CAREs. We compare the results achieved by the Kleinman-Newton method with that of using the RKSM. The applicability and adaptability of the proposed techniques are justified numerically with MATLAB simulations. Transient behaviors of the target models are investigated for comparative analysis through the tabular and graphical approaches. △ Less

Submitted 1 September, 2021; v1 submitted 25 June, 2020; originally announced June 2020.

Comments: 28 pages, 15 figures

Human Activity Recognition from Wearable Sensor Data Using Self-Attention

Authors: Saif Mahmud, M Tanjid Hasan Tonmoy, Kishor Kumar Bhaumik, A K M Mahbubur Rahman, M Ashraful Amin, Mohammad Shoyaib, Muhammad Asif Hossain Khan, Amin Ahsan Ali

Abstract: Human Activity Recognition from body-worn sensor data poses an inherent challenge in capturing spatial and temporal dependencies of time-series signals. In this regard, the existing recurrent or convolutional or their hybrid models for activity recognition struggle to capture spatio-temporal context from the feature space of sensor reading sequence. To address this complex problem, we propose a se… ▽ More Human Activity Recognition from body-worn sensor data poses an inherent challenge in capturing spatial and temporal dependencies of time-series signals. In this regard, the existing recurrent or convolutional or their hybrid models for activity recognition struggle to capture spatio-temporal context from the feature space of sensor reading sequence. To address this complex problem, we propose a self-attention based neural network model that foregoes recurrent architectures and utilizes different types of attention mechanisms to generate higher dimensional feature representation used for classification. We performed extensive experiments on four popular publicly available HAR datasets: PAMAP2, Opportunity, Skoda and USC-HAD. Our model achieve significant performance improvement over recent state-of-the-art models in both benchmark test subjects and Leave-one-subject-out evaluation. We also observe that the sensor attention maps produced by our model is able capture the importance of the modality and placement of the sensors in predicting the different activity classes. △ Less

Submitted 17 March, 2020; originally announced March 2020.

Comments: Accepted for publication at the 24th European Conference on Artificial Intelligence (ECAI-2020); 8 pages, 4 figures

Electrical control of single-photon emission in highly-charged individual colloidal quantum dots

Authors: Sergii Morozov, Evangelina L. Pensa, Ali Hossain Khan, Anatolii Polovitsyn, Emiliano Cortes, Stefan A. Maier, Stefano Vezzoli, Iwan Moreels, Riccardo Sapienza

Abstract: Electron transfer to an individual quantum dot promotes the formation of charged excitons with enhanced recombination pathways and reduced lifetimes. Excitons with only one or two extra charges have been observed and exploited for very efficient lasing or single quantum dot LEDs. Here, by room-temperature time-resolved experiments on individual giant-shell CdSe/CdS quantum dots, we show the electr… ▽ More Electron transfer to an individual quantum dot promotes the formation of charged excitons with enhanced recombination pathways and reduced lifetimes. Excitons with only one or two extra charges have been observed and exploited for very efficient lasing or single quantum dot LEDs. Here, by room-temperature time-resolved experiments on individual giant-shell CdSe/CdS quantum dots, we show the electrochemical formation of highly charged excitons containing more than twelve electrons and one hole. We report the control over intensity blinking, along with a deterministic manipulation of quantum dot photodynamics, with an observed 210-fold increase of the decay rate, accompanied by 12-fold decrease of the emission intensity, while preserving single-photon emission characteristics. These results pave the way for deterministic control over the charge state, and room-temperature decay-rate engineering for colloidal quantum dot-based classical and quantum communication technologies. △ Less

Submitted 7 October, 2020; v1 submitted 13 March, 2020; originally announced March 2020.

Report number: eabb1821

Journal ref: Science Advances Vol. 6, no. 38, eabb1821 2020

Deep Learning Assisted CSI Estimation for Joint URLLC and eMBB Resource Allocation

Authors: Hamza Khan, M. Majid Butt, Sumudu Samarakoon, Philippe Sehier, Mehdi Bennis

Abstract: Multiple-input multiple-output (MIMO) is a key for the fifth generation (5G) and beyond wireless communication systems owing to higher spectrum efficiency, spatial gains, and energy efficiency. Reaping the benefits of MIMO transmission can be fully harnessed if the channel state information (CSI) is available at the transmitter side. However, the acquisition of transmitter side CSI entails many ch… ▽ More Multiple-input multiple-output (MIMO) is a key for the fifth generation (5G) and beyond wireless communication systems owing to higher spectrum efficiency, spatial gains, and energy efficiency. Reaping the benefits of MIMO transmission can be fully harnessed if the channel state information (CSI) is available at the transmitter side. However, the acquisition of transmitter side CSI entails many challenges. In this paper, we propose a deep learning assisted CSI estimation technique in highly mobile vehicular networks, based on the fact that the propagation environment (scatterers, reflectors) is almost identical thereby allowing a data driven deep neural network (DNN) to learn the non-linear CSI relations with negligible overhead. Moreover, we formulate and solve a dynamic network slicing based resource allocation problem for vehicular user equipments (VUEs) requesting enhanced mobile broadband (eMBB) and ultra-reliable low latency (URLLC) traffic slices. The formulation considers a threshold rate violation probability minimization for the eMBB slice while satisfying a probabilistic threshold rate criterion for the URLLC slice. Simulation result shows that an overhead reduction of 50% can be achieved with 12% increase in threshold violations compared to an ideal case with perfect CSI knowledge. △ Less

Submitted 12 March, 2020; originally announced March 2020.

Comments: 6 Pages, 5 Figures, Accepted for publication in: IEEE ICC 2020 Workshop on Ultra-high speed, Low latency and Massive Communication for futuristic 6G Networks (ULMC6GN)

Objective-free excitation of quantum emitters with a laser-written micro parabolic mirror

Authors: Sergii Morozov, Stefano Vezzoli, Ali Hossain Khan, Iwan Moreels, Riccardo Sapienza

Abstract: The efficient excitation of quantum sources such as quantum dots or single molecules requires high NA optics which is often a challenge in cryogenics, or in ultrafast optics. Here we propose a 3.2 um wide parabolic mirror, with a 0.8 um focal length, fabricated by direct laser writing on CdSe/CdS colloidal quantum dots, capable of focusing the excitation light to a sub-wavelength spot and to extra… ▽ More The efficient excitation of quantum sources such as quantum dots or single molecules requires high NA optics which is often a challenge in cryogenics, or in ultrafast optics. Here we propose a 3.2 um wide parabolic mirror, with a 0.8 um focal length, fabricated by direct laser writing on CdSe/CdS colloidal quantum dots, capable of focusing the excitation light to a sub-wavelength spot and to extract the generated emission by collimating it into a narrow beam. This mirror is fabricated via in-situ volumetric optical lithography, which can be aligned to individual emitters, and it can be easily adapted to other geometries beyond the paraboloid. This compact solid-state transducer from far-field to the emitter has important applications in objective-free quantum technologies. △ Less

Submitted 30 June, 2020; v1 submitted 6 March, 2020; originally announced March 2020.

Journal ref: APL Photonics 5, 071302 (2020)

Reconfigurable Parallel Architecture of High Speed Round Robin Arbiter

Authors: Arnab Paul, Mamdudul Haque Khan, M. Muktadir Rahman, Tanvir Zaman Khan, Prajoy Podder, Md. Yeasir Akram Khan

Abstract: With a view to managing the increasing traffic in computer networks, round robin arbiter has been proposed to work with packet switching system to have increased speed in providing access and scheduling. Round robin arbiter is a doorway to a particular bus based on request along with equal priority and gives turns to devices connected to it in a cyclic order. Considering the rapid growth in comput… ▽ More With a view to managing the increasing traffic in computer networks, round robin arbiter has been proposed to work with packet switching system to have increased speed in providing access and scheduling. Round robin arbiter is a doorway to a particular bus based on request along with equal priority and gives turns to devices connected to it in a cyclic order. Considering the rapid growth in computer networking and the emergence of computer automation which will need much more access to the existing limited resources, this paper emphasizes on designing a reconfigurable round robin arbiter over FPGA which takes parallel requests and processes them with high efficiency and less delay than existing designs. Proposed round robin arbiter encounters with 4 to 12 devices. Results show that with 200% increment in the number of connected devices, only 2.69% increment has been found in the delay. With less delay, proposed round robin arbiter exhibits high speed performance with higher traffic, which is a new feature in comparison with the existing designs. △ Less

Submitted 3 March, 2020; originally announced March 2020.

Comments: Published in 2015 International Conference on Electrical, Electronics, Signals, Communication and Optimization (EESCO)

Report number: 15438813

Journal ref: 2015 International Conference on Electrical, Electronics, Signals, Communication and Optimization (EESCO)

Computational Study of Defect variant Perovskites A2BX6 for Photovoltaic Applications

Authors: M. Faizan, K. C. Bhamu, S. H. Khan, G. Murtaza, Xin He

Abstract: A comprehensive study of the structural, electronic, and optical properties of lead-free perovskites has been carried out by means of first principles method based on DFT. The calculations are performed for the compound of the type A2BX6 with A=Rb, and Cs; B=Sn, Pd, and Pt; and X=Cl, Br, and I. The calculated structural parameters (lattice constants and bond lengths) agree well with the experiment… ▽ More A comprehensive study of the structural, electronic, and optical properties of lead-free perovskites has been carried out by means of first principles method based on DFT. The calculations are performed for the compound of the type A2BX6 with A=Rb, and Cs; B=Sn, Pd, and Pt; and X=Cl, Br, and I. The calculated structural parameters (lattice constants and bond lengths) agree well with the experiments. The computed band gap reveals a semiconducting profile for all these compounds showing a decreasing trend of the band gap energy by changing the halide ions consecutively from Cl to Br and Br to I. However, for variation in the B-site cation, the band gap increases by changing the cation from Pd to Pt via Sn. The most likely compounds, Rb2PdBr6 and Cs2PtI6, exhibit a band gap within the optimal range of 0.9-1.6 eV for single-junction photovoltaic applications. The optical properties in terms of the optimal value of the dielectric constant, optical conductivity, and absorption coefficient are also investigated upto the photon energy of 10 eV. Our results indicate that upon changing the halogen ions (Cl by Br and Br by I) the optical properties altered significantly. Maximum dielectric constants and high optical absorption are found for Rb2PdI6 and Cs2PtI6. The unique optoelectronic properties such as ideal band gap, high dielectric constants, and optimum absorption of A2BX6 perovskites could be efficiently utilized in designing high performance single and multi-junction perovskite solar cells. △ Less

Submitted 22 April, 2020; v1 submitted 18 February, 2020; originally announced February 2020.

Comments: 25 pages, 12 Figures, 4 Tables

MSC Class: NA

Enhancing Video Streaming in Vehicular Networks via Resource Slicing

Authors: Hamza Khan, Sumudu Samarakoon, Mehdi Bennis

Abstract: Vehicle-to-everything (V2X) communication is a key enabler that connects vehicles to neighboring vehicles, infrastructure and pedestrians. In the past few years, multimedia services have seen an enormous growth and it is expected to increase as more devices will utilize infotainment services in the future i.e. vehicular devices. Therefore, it is important to focus on user centric measures i.e. qua… ▽ More Vehicle-to-everything (V2X) communication is a key enabler that connects vehicles to neighboring vehicles, infrastructure and pedestrians. In the past few years, multimedia services have seen an enormous growth and it is expected to increase as more devices will utilize infotainment services in the future i.e. vehicular devices. Therefore, it is important to focus on user centric measures i.e. quality-of-experience (QoE) such as video quality (resolution) and fluctuations therein. In this paper, a novel joint video quality selection and resource allocation technique is proposed for increasing the QoE of vehicular devices. The proposed approach exploits the queuing dynamics and channel states of vehicular devices, to maximize the QoE while ensuring seamless video playback at the end users with high probability. The network wide QoE maximization problem is decoupled into two subparts. First, a network slicing based clustering algorithm is applied to partition the vehicles into multiple logical networks. Secondly, vehicle scheduling and quality selection is formulated as a stochastic optimization problem which is solved using the Lyapunov drift plus penalty method. Numerical results show that the proposed algorithm ensures high video quality experience compared to the baseline. Simulation results also show that the proposed technique achieves low latency and high-reliability communication. △ Less

Submitted 17 February, 2020; originally announced February 2020.

Comments: 10 Pages, 7 Figures, 2 Tables (Accepted for publication in the special section of the IEEE Transactions on Vehicular Technology)

An Ontology-driven Treatment Article Retrieval System for Precision Oncology

Authors: Zheng Chen, Sadid A. Hasan, Joey Liu, Vivek Datla, Md Shamsuzzaman, Hafiz Khan, Mohammad S Sorower, Gabe Mankovich, Rob van Ommering, Nevenka Dimitrova

Abstract: This paper presents an ontology-driven treatment article retrieval system developed and experimented using the data and ground truths provided by the TREC 2017 precision medicine track. The key aspects of our system include: meaningful integration of various disease, gene, and drug name ontologies, training of a novel perceptron model for article relevance labeling, a ranking module that considers… ▽ More This paper presents an ontology-driven treatment article retrieval system developed and experimented using the data and ground truths provided by the TREC 2017 precision medicine track. The key aspects of our system include: meaningful integration of various disease, gene, and drug name ontologies, training of a novel perceptron model for article relevance labeling, a ranking module that considers additional factors such as journal impact and article publication year, and comprehensive query matching rules. Experimental results demonstrate that our proposed system considerably outperforms the results of the best participating system of the TREC 2017 precision medicine challenge. △ Less

Submitted 13 February, 2020; originally announced February 2020.

ACM Class: H.3.3; I.2.7

Reinforcement Learning Based Vehicle-cell Association Algorithm for Highly Mobile Millimeter Wave Communication

Authors: Hamza Khan, Anis Elgabli, Sumudu Samarakoon, Mehdi Bennis, Choong Seon Hong

Abstract: Vehicle-to-everything (V2X) communication is a growing area of communication with a variety of use cases. This paper investigates the problem of vehicle-cell association in millimeter wave (mmWave) communication networks. The aim is to maximize the time average rate per vehicular user (VUE) while ensuring a target minimum rate for all VUEs with low signaling overhead. We first formulate the user (… ▽ More Vehicle-to-everything (V2X) communication is a growing area of communication with a variety of use cases. This paper investigates the problem of vehicle-cell association in millimeter wave (mmWave) communication networks. The aim is to maximize the time average rate per vehicular user (VUE) while ensuring a target minimum rate for all VUEs with low signaling overhead. We first formulate the user (vehicle) association problem as a discrete non-convex optimization problem. Then, by leveraging tools from machine learning, specifically distributed deep reinforcement learning (DDRL) and the asynchronous actor critic algorithm (A3C), we propose a low complexity algorithm that approximates the solution of the proposed optimization problem. The proposed DDRL-based algorithm endows every road side unit (RSU) with a local RL agent that selects a local action based on the observed input state. Actions of different RSUs are forwarded to a central entity, that computes a global reward which is then fed back to RSUs. It is shown that each independently trained RL performs the vehicle-RSU association action with low control overhead and less computational complexity compared to running an online complex algorithm to solve the non-convex optimization problem. Finally, simulation results show that the proposed solution achieves up to 15\% gains in terms of sum rate and 20\% reduction in VUE outages compared to several baseline designs. △ Less

Submitted 22 January, 2020; originally announced January 2020.

Comments: 13 pages, 14 figures

Journal ref: IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, VOL. 5, NO. 4, DECEMBER 2019

Accuracy vs. Complexity: A Trade-off in Visual Question Answering Models

Authors: Moshiur R. Farazi, Salman H. Khan, Nick Barnes

Abstract: Visual Question Answering (VQA) has emerged as a Visual Turing Test to validate the reasoning ability of AI agents. The pivot to existing VQA models is the joint embedding that is learned by combining the visual features from an image and the semantic features from a given question. Consequently, a large body of literature has focused on developing complex joint embedding strategies coupled with v… ▽ More Visual Question Answering (VQA) has emerged as a Visual Turing Test to validate the reasoning ability of AI agents. The pivot to existing VQA models is the joint embedding that is learned by combining the visual features from an image and the semantic features from a given question. Consequently, a large body of literature has focused on developing complex joint embedding strategies coupled with visual attention mechanisms to effectively capture the interplay between these two modalities. However, modelling the visual and semantic features in a high dimensional (joint embedding) space is computationally expensive, and more complex models often result in trivial improvements in the VQA accuracy. In this work, we systematically study the trade-off between the model complexity and the performance on the VQA task. VQA models have a diverse architecture comprising of pre-processing, feature extraction, multimodal fusion, attention and final classification stages. We specifically focus on the effect of "multi-modal fusion" in VQA models that is typically the most expensive step in a VQA pipeline. Our thorough experimental evaluation leads us to two proposals, one optimized for minimal complexity and the other one optimized for state-of-the-art VQA performance. △ Less

Submitted 20 January, 2020; originally announced January 2020.

Cascaded Structure Tensor Framework for Robust Identification of Heavily Occluded Baggage Items from Multi-Vendor X-ray Scans

Authors: Taimur Hassan, Salman H. Khan, Samet Akcay, Mohammed Bennamoun, Naoufel Werghi

Abstract: In the last two decades, luggage scanning has globally become one of the prime aviation security concerns. Manual screening of the baggage items is a cumbersome, subjective and inefficient process. Hence, many researchers have developed Xray imagery-based autonomous systems to address these shortcomings. However, to the best of our knowledge, there is no framework, up to now, that can recognize he… ▽ More In the last two decades, luggage scanning has globally become one of the prime aviation security concerns. Manual screening of the baggage items is a cumbersome, subjective and inefficient process. Hence, many researchers have developed Xray imagery-based autonomous systems to address these shortcomings. However, to the best of our knowledge, there is no framework, up to now, that can recognize heavily occluded and cluttered baggage items from multi-vendor X-ray scans. This paper presents a cascaded structure tensor framework which can automatically extract and recognize suspicious items irrespective of their position and orientation in the multi-vendor X-ray scans. The proposed framework is unique, as it intelligently extracts each object by iteratively picking contour based transitional information from different orientations and uses only a single feedforward convolutional neural network for the recognition. The proposed framework has been rigorously tested on publicly available GDXray and SIXray datasets containing a total of 1,067,381 X-ray scans where it significantly outperformed the state-of-the-art solutions by achieving the mean average precision score of 0.9343 and 0.9595 for extracting and recognizing suspicious items from GDXray and SIXray scans, respectively. Furthermore, the proposed framework has achieved 15.78% better time △ Less

Submitted 21 January, 2020; v1 submitted 9 December, 2019; originally announced December 2019.

Optimal Mini-Batch Size Selection for Fast Gradient Descent

Authors: Michael P. Perrone, Haidar Khan, Changhoan Kim, Anastasios Kyrillidis, Jerry Quinn, Valentina Salapura

Abstract: This paper presents a methodology for selecting the mini-batch size that minimizes Stochastic Gradient Descent (SGD) learning time for single and multiple learner problems. By decoupling algorithmic analysis issues from hardware and software implementation details, we reveal a robust empirical inverse law between mini-batch size and the average number of SGD updates required to converge to a speci… ▽ More This paper presents a methodology for selecting the mini-batch size that minimizes Stochastic Gradient Descent (SGD) learning time for single and multiple learner problems. By decoupling algorithmic analysis issues from hardware and software implementation details, we reveal a robust empirical inverse law between mini-batch size and the average number of SGD updates required to converge to a specified error threshold. Combining this empirical inverse law with measured system performance, we create an accurate, closed-form model of average training time and show how this model can be used to identify quantifiable implications for both algorithmic and hardware aspects of machine learning. We demonstrate the inverse law empirically, on both image recognition (MNIST, CIFAR10 and CIFAR100) and machine translation (Europarl) tasks, and provide a theoretic justification via proving a novel bound on mini-batch SGD training. △ Less

Submitted 14 November, 2019; originally announced November 2019.

Molecular Bridge Mediated Ultra-Low-Power Gas Sensing

Authors: Aishwaryadev Banerjee, Shakirul H Khan, S. Broadbent, A. Bulbul, K. H Kim, R. Looper, C. H Mastrangelo, H. Kim

Abstract: We report the electrical detection of captured gases through measurement of the tunneling characteristics of gas-mediated molecular junctions formed across nanogaps. The gas sensing nanogap device consists of a pair of vertically stacked gold electrodes separated by an insulating spacer of (~1.5 nm of sputtered amorphous Si and ~4.5 nm ALD SiO2) which is notched ~10 nm along the edges of the top e… ▽ More We report the electrical detection of captured gases through measurement of the tunneling characteristics of gas-mediated molecular junctions formed across nanogaps. The gas sensing nanogap device consists of a pair of vertically stacked gold electrodes separated by an insulating spacer of (~1.5 nm of sputtered amorphous Si and ~4.5 nm ALD SiO2) which is notched ~10 nm along the edges of the top electrode. The exposed gold surface is functionalized with a self-assembled monolayer (SAM) of conjugated thiol linker molecules. When the device is exposed to a target gas (1, 5-diaminopentane), the SAM layer electrostatically captures the target gas molecules forming a molecular bridge across the nanogap. The gas capture lowers the barrier potential for electron tunneling from ~5 eV to ~0.9 eV across the notched edge regions and establishes additional conducting paths for charge transport between the gold electrodes, leading to a substantial decrease in junction resistance. We demonstrated an output resistance change of greater than 100000000 times on exposure to 80 ppm of diamine target gas as well as ultra-low standby power consumption of smaller than 15 pW, confirming electron tunneling through molecular bridges for ultra-low power gas sensing. △ Less

Submitted 14 November, 2019; originally announced November 2019.

Comments: 14 pages, 13 figures

Convexity in G-metric spaces and approximation of fixed points by Mann iterative proces

Authors: Isa Yildirim, Safeer Hussain Khan

Abstract: In this paper, we first define the concept of convexity in G-metric spaces. We then use Mann iterative process in this newly defined convex G-metric space to prove some convergence results for some classes of mappings. In this way, we can extend several existence results to those approximating fixed points. Our results are just new in the setting. In this paper, we first define the concept of convexity in G-metric spaces. We then use Mann iterative process in this newly defined convex G-metric space to prove some convergence results for some classes of mappings. In this way, we can extend several existence results to those approximating fixed points. Our results are just new in the setting. △ Less

Submitted 4 November, 2019; originally announced November 2019.

MSC Class: Primary 47H10; Secondary 65J15

Journal ref: Int. J. Nonlinear Anal. Appl 13(2022)1,1957-1964

Unsupervised adulterated red-chili pepper content transformation for hyperspectral classification

Authors: Muhammad Hussain Khan, Zainab Saleem, Muhammad Ahmad, Ahmed Sohaib, Hamail Ayaz

Abstract: Preserving red-chili quality is of utmost importance in which the authorities demand the quality techniques to detect, classify and prevent it from the impurities. For example, salt, wheat flour, wheat bran, and rice bran contamination in grounded red chili, which typically a food, are a serious threat to people who are allergic to such items. This work presents the feasibility of utilizing visibl… ▽ More Preserving red-chili quality is of utmost importance in which the authorities demand the quality techniques to detect, classify and prevent it from the impurities. For example, salt, wheat flour, wheat bran, and rice bran contamination in grounded red chili, which typically a food, are a serious threat to people who are allergic to such items. This work presents the feasibility of utilizing visible and near-infrared (VNIR) hyperspectral imaging (HSI) to detect and classify the aforementioned adulterants in red chili. However, adulterated red chili data annotation is a big challenge for classification because the acquisition of labeled data for real-time supervised learning is expensive in terms of cost and time. Therefore, this study, for the very first time proposes a novel approach to annotate the red chili samples using a clustering mechanism at 500~nm wavelength spectral response due to its dark appearance at a specified wavelength. Later the spectral samples are classified into pure or adulterated using one-class SVM. The classification performance achieves 99% in case of pure adulterants or red chili whereas 85% for adulterated samples. We further investigate that the single classification model is enough to detect any foreign substance in red chili pepper rather than cascading multiple PLS regression models. △ Less

Submitted 9 November, 2019; originally announced November 2019.

Comments: 10 pages,

Electric Sheep Team Description Paper Humanoid League Kid-Size 2019

Authors: Daniel Barry, Andrew Curtis-Black, Merel Keijsers, Munir Shah, Matthew Young, Humayun Khan, Banon Hopman

Abstract: In this paper we introduce the newly formed New Zealand based RoboCup Humanoid Kid-Size team, Electric Sheep. We describe our developed humanoid robot platform, particularly our unique take on the chassis, electronics and use of several motor types to create a low-cost entry platform. To support this hardware, we discuss our software framework, vision processing, walking and game-play strategy met… ▽ More In this paper we introduce the newly formed New Zealand based RoboCup Humanoid Kid-Size team, Electric Sheep. We describe our developed humanoid robot platform, particularly our unique take on the chassis, electronics and use of several motor types to create a low-cost entry platform. To support this hardware, we discuss our software framework, vision processing, walking and game-play strategy methodology. Lastly we give an overview of future research interests within the team and intentions of future contributions for the league and the goal of RoboCup. △ Less

Submitted 20 October, 2019; originally announced October 2019.

Comments: Technical report

Deep Contextual Attention for Human-Object Interaction Detection

Authors: Tiancai Wang, Rao Muhammad Anwer, Muhammad Haris Khan, Fahad Shahbaz Khan, Yanwei Pang, Ling Shao, Jorma Laaksonen

Abstract: Human-object interaction detection is an important and relatively new class of visual relationship detection tasks, essential for deeper scene understanding. Most existing approaches decompose the problem into object localization and interaction recognition. Despite showing progress, these approaches only rely on the appearances of humans and objects and overlook the available context information,… ▽ More Human-object interaction detection is an important and relatively new class of visual relationship detection tasks, essential for deeper scene understanding. Most existing approaches decompose the problem into object localization and interaction recognition. Despite showing progress, these approaches only rely on the appearances of humans and objects and overlook the available context information, crucial for capturing subtle interactions between them. We propose a contextual attention framework for human-object interaction detection. Our approach leverages context by learning contextually-aware appearance features for human and object instances. The proposed attention module then adaptively selects relevant instance-centric context information to highlight image regions likely to contain human-object interactions. Experiments are performed on three benchmarks: V-COCO, HICO-DET and HCVRD. Our approach outperforms the state-of-the-art on all datasets. On the V-COCO dataset, our method achieves a relative gain of 4.4% in terms of role mean average precision ($mAP_{role}$), compared to the existing best approach. △ Less

Submitted 17 October, 2019; originally announced October 2019.

Comments: Accepted at ICCV 2019

Mask-Guided Attention Network for Occluded Pedestrian Detection

Authors: Yanwei Pang, Jin Xie, Muhammad Haris Khan, Rao Muhammad Anwer, Fahad Shahbaz Khan, Ling Shao

Abstract: Pedestrian detection relying on deep convolution neural networks has made significant progress. Though promising results have been achieved on standard pedestrians, the performance on heavily occluded pedestrians remains far from satisfactory. The main culprits are intra-class occlusions involving other pedestrians and inter-class occlusions caused by other objects, such as cars and bicycles. Thes… ▽ More Pedestrian detection relying on deep convolution neural networks has made significant progress. Though promising results have been achieved on standard pedestrians, the performance on heavily occluded pedestrians remains far from satisfactory. The main culprits are intra-class occlusions involving other pedestrians and inter-class occlusions caused by other objects, such as cars and bicycles. These result in a multitude of occlusion patterns. We propose an approach for occluded pedestrian detection with the following contributions. First, we introduce a novel mask-guided attention network that fits naturally into popular pedestrian detection pipelines. Our attention network emphasizes on visible pedestrian regions while suppressing the occluded ones by modulating full body features. Second, we empirically demonstrate that coarse-level segmentation annotations provide reasonable approximation to their dense pixel-wise counterparts. Experiments are performed on CityPersons and Caltech datasets. Our approach sets a new state-of-the-art on both datasets. Our approach obtains an absolute gain of 9.5% in log-average miss rate, compared to the best reported results on the heavily occluded (HO) pedestrian set of CityPersons test set. Further, on the HO pedestrian set of Caltech dataset, our method achieves an absolute gain of 5.0% in log-average miss rate, compared to the best reported results. Code and models are available at: https://github.com/Leotju/MGAN. △ Less

Submitted 15 October, 2019; v1 submitted 14 October, 2019; originally announced October 2019.

Comments: Accepted at ICCV 2019

xYOLO: A Model For Real-Time Object Detection In Humanoid Soccer On Low-End Hardware

Authors: Daniel Barry, Munir Shah, Merel Keijsers, Humayun Khan, Banon Hopman

Abstract: With the emergence of onboard vision processing for areas such as the internet of things (IoT), edge computing and autonomous robots, there is increasing demand for computationally efficient convolutional neural network (CNN) models to perform real-time object detection on resource constraints hardware devices. Tiny-YOLO is generally considered as one of the faster object detectors for low-end dev… ▽ More With the emergence of onboard vision processing for areas such as the internet of things (IoT), edge computing and autonomous robots, there is increasing demand for computationally efficient convolutional neural network (CNN) models to perform real-time object detection on resource constraints hardware devices. Tiny-YOLO is generally considered as one of the faster object detectors for low-end devices and is the basis for our work. Our experiments on this network have shown that Tiny-YOLO can achieve 0.14 frames per second(FPS) on the Raspberry Pi 3 B, which is too slow for soccer playing autonomous humanoid robots detecting goal and ball objects. In this paper we propose an adaptation to the YOLO CNN model named xYOLO, that can achieve object detection at a speed of 9.66 FPS on the Raspberry Pi 3 B. This is achieved by trading an acceptable amount of accuracy, making the network approximately 70 times faster than Tiny-YOLO. Greater inference speed-ups were also achieved on a desktop CPU and GPU. Additionally we contribute an annotated Darknet dataset for goal and ball detection. △ Less

Submitted 7 October, 2019; originally announced October 2019.

Comments: 6 pages, 5 figures