-
The use of a humanoid robot for older people with dementia in aged care facilities
Authors:
Dongjun Wu,
Lihui Pu,
Jun Jo,
Rene Hexel,
Wendy Moyle
Abstract:
This paper presents an interdisciplinary PhD project using a humanoid robot to encourage interactive activities for people with dementia living in two aged care facilities. The aim of the project was to develop software and use technologies to achieve successful robot-led engagement with older people with dementia. This paper outlines the qualitative findings from the project's feasibility stage.…
▽ More
This paper presents an interdisciplinary PhD project using a humanoid robot to encourage interactive activities for people with dementia living in two aged care facilities. The aim of the project was to develop software and use technologies to achieve successful robot-led engagement with older people with dementia. This paper outlines the qualitative findings from the project's feasibility stage. The researcher's observations, the participants' attitudes and the feedback from carers are presented and discussed.
△ Less
Submitted 29 May, 2024;
originally announced May 2024.
-
TeleChat Technical Report
Authors:
Zhongjiang He,
Zihan Wang,
Xinzhang Liu,
Shixuan Liu,
Yitong Yao,
Yuyao Huang,
Xuelong Li,
Yongxiang Li,
Zhonghao Che,
Zhaoxi Zhang,
Yan Wang,
Xin Wang,
Luwen Pu,
Huinan Xu,
Ruiyu Fang,
Yu Zhao,
Jie Zhang,
Xiaomeng Huang,
Zhilong Lu,
Jiaxin Peng,
Wenjun Zheng,
Shiquan Wang,
Bingkai Yang,
Xuewei he,
Zhuoru Jiang
, et al. (11 additional authors not shown)
Abstract:
In this technical report, we present TeleChat, a collection of large language models (LLMs) with parameters of 3 billion, 7 billion and 12 billion. It includes pretrained language models as well as fine-tuned chat models that is aligned with human preferences. TeleChat is initially pretrained on an extensive corpus containing a diverse collection of texts from both English and Chinese languages, i…
▽ More
In this technical report, we present TeleChat, a collection of large language models (LLMs) with parameters of 3 billion, 7 billion and 12 billion. It includes pretrained language models as well as fine-tuned chat models that is aligned with human preferences. TeleChat is initially pretrained on an extensive corpus containing a diverse collection of texts from both English and Chinese languages, including trillions of tokens. Subsequently, the model undergoes fine-tuning to align with human preferences, following a detailed methodology that we describe. We evaluate the performance of TeleChat on various tasks, including language understanding, mathematics, reasoning, code generation, and knowledge-based question answering. Our findings indicate that TeleChat achieves comparable performance to other open-source models of similar size across a wide range of public benchmarks. To support future research and applications utilizing LLMs, we release the fine-tuned model checkpoints of TeleChat's 7B and 12B variant, along with code and a portion of our pretraining data, to the public community.
△ Less
Submitted 1 April, 2024; v1 submitted 8 January, 2024;
originally announced January 2024.
-
Enhancing In-Situ Structural Health Monitoring through RF Energy-Powered Sensor Nodes and Mobile Platform
Authors:
Yu Luo,
Lina Pu,
Jun Wang,
Isaac Howard
Abstract:
This research contributes to long-term structural health monitoring (SHM) by exploring radio frequency energy-powered sensor nodes (RF-SNs) embedded in concrete. Unlike traditional in-situ monitoring systems relying on batteries or wire-connected power sources, the RF-SN captures radio energy from a mobile radio transmitter for sensing and communication. This offers a cost-effective solution for c…
▽ More
This research contributes to long-term structural health monitoring (SHM) by exploring radio frequency energy-powered sensor nodes (RF-SNs) embedded in concrete. Unlike traditional in-situ monitoring systems relying on batteries or wire-connected power sources, the RF-SN captures radio energy from a mobile radio transmitter for sensing and communication. This offers a cost-effective solution for consistent in-situ perception. To optimize the system performance across various situations, we've explored both active and passive communication methods. For the active RF-SN, we implement a specialized control circuit enabling the node to transmit data through ZigBee protocol at low incident power. For the passive RF-SN, radio energy is not only for power but also as a carrier signal, with data conveyed by modulating the amplitude of the backscattered radio wave. To address the challenge of significant attenuation of the backscattering signal in concrete, we utilize a square chirp-based modulation scheme for passive communication. This scheme allows the receiver to successfully decode the data even under a negative signal-to-noise ratio (SNR) condition. The experimental results indicate that an active RF-SN embedded in concrete at a depth of 13.5 cm can be effectively powered by a 915MHz mobile radio transmitter with an effective isotropic radiated power (EIRP) of 32.5dBm. This setup allows the RF-SN to send over 1 kilobyte of data within 10 seconds, with an additional 1.7 kilobytes every 1.6 seconds of extra charging. For the passive RF-SN buried at the same depth, continuous data transmission at a rate of 224 bps with a 3% bit error rate (BER) is achieved when the EIRP of the transmitter is 23.6 dBm.
△ Less
Submitted 20 August, 2023;
originally announced August 2023.
-
When Computing Power Network Meets Distributed Machine Learning: An Efficient Federated Split Learning Framework
Authors:
Xinjing Yuan,
Lingjun Pu,
Lei Jiao,
Xiaofei Wang,
Meijuan Yang,
Jingdong Xu
Abstract:
In this paper, we advocate CPN-FedSL, a novel and flexible Federated Split Learning (FedSL) framework over Computing Power Network (CPN). We build a dedicated model to capture the basic settings and learning characteristics (e.g., training flow, latency and convergence). Based on this model, we introduce Resource Usage Effectiveness (RUE), a novel performance metric integrating training utility wi…
▽ More
In this paper, we advocate CPN-FedSL, a novel and flexible Federated Split Learning (FedSL) framework over Computing Power Network (CPN). We build a dedicated model to capture the basic settings and learning characteristics (e.g., training flow, latency and convergence). Based on this model, we introduce Resource Usage Effectiveness (RUE), a novel performance metric integrating training utility with system cost, and formulate a multivariate scheduling problem that maxi?mizes RUE by comprehensively taking client admission, model partition, server selection, routing and bandwidth allocation into account (i.e., mixed-integer fractional programming). We design Refinery, an efficient approach that first linearizes the fractional objective and non-convex constraints, and then solves the transformed problem via a greedy based rounding algorithm in multiple iterations. Extensive evaluations corroborate that CPN-FedSL is superior to the standard and state-of-the-art learning frameworks (e.g., FedAvg and SplitFed), and besides Refinery is lightweight and significantly outperforms its variants and de facto heuristic methods under a variety of settings.
△ Less
Submitted 22 May, 2023;
originally announced May 2023.
-
Automated segmentation of 3-D body composition on computed tomography
Authors:
Lucy Pu,
Syed F. Ashraf,
Naciye S Gezer,
Iclal Ocak,
Rajeev Dhupar
Abstract:
Purpose: To develop and validate a computer tool for automatic and simultaneous segmentation of body composition depicted on computed tomography (CT) scans for the following tissues: visceral adipose (VAT), subcutaneous adipose (SAT), intermuscular adipose (IMAT), skeletal muscle (SM), and bone.
Approach: A cohort of 100 CT scans acquired from The Cancer Imaging Archive (TCIA) was used - 50 whol…
▽ More
Purpose: To develop and validate a computer tool for automatic and simultaneous segmentation of body composition depicted on computed tomography (CT) scans for the following tissues: visceral adipose (VAT), subcutaneous adipose (SAT), intermuscular adipose (IMAT), skeletal muscle (SM), and bone.
Approach: A cohort of 100 CT scans acquired from The Cancer Imaging Archive (TCIA) was used - 50 whole-body positron emission tomography (PET)-CTs, 25 chest, and 25 abdominal. Five different body compositions were manually annotated (VAT, SAT, IMAT, SM, and bone). A training-while-annotating strategy was used for efficiency. The UNet model was trained using the already annotated cases. Then, this model was used to enable semi-automatic annotation for the remaining cases. The 10-fold cross-validation method was used to develop and validate the performance of several convolutional neural networks (CNNs), including UNet, Recurrent Residual UNet (R2Unet), and UNet++. A 3-D patch sampling operation was used when training the CNN models. The separately trained CNN models were tested to see if they could achieve a better performance than segmenting them jointly. Paired-samples t-test was used to test for statistical significance.
Results: Among the three CNN models, UNet demonstrated the best overall performance in jointly segmenting the five body compositions with a Dice coefficient of 0.840+/-0.091, 0.908+/-0.067, 0.603+/-0.084, 0.889+/-0.027, and 0.884+/-0.031, and a Jaccard index of 0.734+/-0.119, 0.837+/-0.096, 0.437+/-0.082, 0.800+/-0.042, 0.793+/-0.049, respectively for VAT, SAT, IMAT, SM, and bone.
Conclusion: There were no significant differences among the CNN models in segmenting body composition, but jointly segmenting body compositions achieved a better performance than segmenting them separately.
△ Less
Submitted 16 December, 2021;
originally announced December 2021.
-
Hardware Architecture of Wireless Power Transfer, RFID, and WIPT Systems
Authors:
Yu Luo,
Lina Pu
Abstract:
In this work, we provide an overview of the hardware architecture of wireless power transfer (WPT), RFID, and wireless information and power transfer (WIPT) systems. The historical milestones and structure differences among WPT, RFID, and WIPT are introduced.
In this work, we provide an overview of the hardware architecture of wireless power transfer (WPT), RFID, and wireless information and power transfer (WIPT) systems. The historical milestones and structure differences among WPT, RFID, and WIPT are introduced.
△ Less
Submitted 13 February, 2021;
originally announced February 2021.
-
Detecting, Localising and Classifying Polyps from Colonoscopy Videos using Deep Learning
Authors:
Yu Tian,
Leonardo Zorron Cheng Tao Pu,
Yuyuan Liu,
Gabriel Maicas,
Johan W. Verjans,
Alastair D. Burt,
Seon Ho Shin,
Rajvinder Singh,
Gustavo Carneiro
Abstract:
In this paper, we propose and analyse a system that can automatically detect, localise and classify polyps from colonoscopy videos. The detection of frames with polyps is formulated as a few-shot anomaly classification problem, where the training set is highly imbalanced with the large majority of frames consisting of normal images and a small minority comprising frames with polyps. Colonoscopy vi…
▽ More
In this paper, we propose and analyse a system that can automatically detect, localise and classify polyps from colonoscopy videos. The detection of frames with polyps is formulated as a few-shot anomaly classification problem, where the training set is highly imbalanced with the large majority of frames consisting of normal images and a small minority comprising frames with polyps. Colonoscopy videos may contain blurry images and frames displaying feces and water jet sprays to clean the colon -- such frames can mistakenly be detected as anomalies, so we have implemented a classifier to reject these two types of frames before polyp detection takes place. Next, given a frame containing a polyp, our method localises (with a bounding box around the polyp) and classifies it into five different classes. Furthermore, we study a method to improve the reliability and interpretability of the classification result using uncertainty estimation and classification calibration. Classification uncertainty and calibration not only help improve classification accuracy by rejecting low-confidence and high-uncertain results, but can be used by doctors to decide how to decide on the classification of a polyp. All the proposed detection, localisation and classification methods are tested using large data sets and compared with relevant baseline approaches.
△ Less
Submitted 8 January, 2021;
originally announced January 2021.
-
An Edge Computing-based Photo Crowdsourcing Framework for Real-time 3D Reconstruction
Authors:
Shuai Yu,
Xu Chen,
Shuai Wang,
Lingjun Pu,
Di Wu
Abstract:
Image-based three-dimensional (3D) reconstruction utilizes a set of photos to build 3D model and can be widely used in many emerging applications such as augmented reality (AR) and disaster recovery. Most of existing 3D reconstruction methods require a mobile user to walk around the target area and reconstruct objectives with a hand-held camera, which is inefficient and time-consuming. To meet the…
▽ More
Image-based three-dimensional (3D) reconstruction utilizes a set of photos to build 3D model and can be widely used in many emerging applications such as augmented reality (AR) and disaster recovery. Most of existing 3D reconstruction methods require a mobile user to walk around the target area and reconstruct objectives with a hand-held camera, which is inefficient and time-consuming. To meet the requirements of delay intensive and resource hungry applications in 5G, we propose an edge computing-based photo crowdsourcing (EC-PCS) framework in this paper. The main objective is to collect a set of representative photos from ubiquitous mobile and Internet of Things (IoT) devices at the network edge for real-time 3D model reconstruction, with network resource and monetary cost considerations. Specifically, we first propose a photo pricing mechanism by jointly considering their freshness, resolution and data size. Then, we design a novel photo selection scheme to dynamically select a set of photos with the required target coverage and the minimum monetary cost. We prove the NP-hardness of such problem, and develop an efficient greedy-based approximation algorithm to obtain a near-optimal solution. Moreover, an optimal network resource allocation scheme is presented, in order to minimize the maximum uploading delay of the selected photos to the edge server. Finally, a 3D reconstruction algorithm and a 3D model caching scheme are performed by the edge server in real time. Extensive experimental results based on real-world datasets demonstrate the superior performance of our EC-PCS system over the existing mechanisms.
△ Less
Submitted 3 July, 2020;
originally announced July 2020.
-
Few-Shot Anomaly Detection for Polyp Frames from Colonoscopy
Authors:
Yu Tian,
Gabriel Maicas,
Leonardo Zorron Cheng Tao Pu,
Rajvinder Singh,
Johan W. Verjans,
Gustavo Carneiro
Abstract:
Anomaly detection methods generally target the learning of a normal image distribution (i.e., inliers showing healthy cases) and during testing, samples relatively far from the learned distribution are classified as anomalies (i.e., outliers showing disease cases). These approaches tend to be sensitive to outliers that lie relatively close to inliers (e.g., a colonoscopy image with a small polyp).…
▽ More
Anomaly detection methods generally target the learning of a normal image distribution (i.e., inliers showing healthy cases) and during testing, samples relatively far from the learned distribution are classified as anomalies (i.e., outliers showing disease cases). These approaches tend to be sensitive to outliers that lie relatively close to inliers (e.g., a colonoscopy image with a small polyp). In this paper, we address the inappropriate sensitivity to outliers by also learning from inliers. We propose a new few-shot anomaly detection method based on an encoder trained to maximise the mutual information between feature embeddings and normal images, followed by a few-shot score inference network, trained with a large set of inliers and a substantially smaller set of outliers. We evaluate our proposed method on the clinical problem of detecting frames containing polyps from colonoscopy video sequences, where the training set has 13350 normal images (i.e., without polyps) and less than 100 abnormal images (i.e., with polyps). The results of our proposed model on this data set reveal a state-of-the-art detection result, while the performance based on different number of anomaly samples is relatively stable after approximately 40 abnormal training images.
△ Less
Submitted 26 June, 2020;
originally announced June 2020.
-
Cost-efficient and Skew-aware Data Scheduling for Incremental Learning in 5G Network
Authors:
Lingjun Pu,
Xinjing Yuan,
Xiaohang Xu,
Xu Chen,
Pan Zhou,
Jingdong Xu
Abstract:
To facilitate the emerging applications in 5G networks, mobile network operators will provide many network functions in terms of control and prediction. Recently, they have recognized the power of machine learning (ML) and started to explore its potential to facilitate those network functions. Nevertheless, the current ML models for network functions are often derived in an offline manner, which i…
▽ More
To facilitate the emerging applications in 5G networks, mobile network operators will provide many network functions in terms of control and prediction. Recently, they have recognized the power of machine learning (ML) and started to explore its potential to facilitate those network functions. Nevertheless, the current ML models for network functions are often derived in an offline manner, which is inefficient due to the excessive overhead for transmitting a huge volume of dataset to remote ML training clouds and failing to provide the incremental learning capability for the continuous model updating. As an alternative solution, we propose Cocktail, an incremental learning framework within a reference 5G network architecture. To achieve cost efficiency while increasing trained model accuracy, an efficient online data scheduling policy is essential. To this end, we formulate an online data scheduling problem to optimize the framework cost while alleviating the data skew issue caused by the capacity heterogeneity of training workers from the long-term perspective. We exploit the stochastic gradient descent to devise an online asymptotically optimal algorithm, including two optimal policies based on novel graph constructions for skew-aware data collection and data training. Small-scale testbed and large-scale simulations validate the superior performance of our proposed framework.
△ Less
Submitted 12 September, 2021; v1 submitted 1 April, 2020;
originally announced April 2020.
-
Practical Issues of Energy Harvesting and Data Transmissions in Sustainable IoT
Authors:
Yu Luo,
Lina Pu
Abstract:
The sustainable Internet of Things (IoT) is becoming a promising solution for the green living and smart industries. In this article, we investigate the practical issues in the radio energy harvesting and data communication systems through extensive field experiments. A number of important characteristics of energy harvesting circuits and communication modules have been studied, including the non-…
▽ More
The sustainable Internet of Things (IoT) is becoming a promising solution for the green living and smart industries. In this article, we investigate the practical issues in the radio energy harvesting and data communication systems through extensive field experiments. A number of important characteristics of energy harvesting circuits and communication modules have been studied, including the non-linear energy consumption of the communication system relative to the transmission power, the wake-up time associated with the payload, and the varying system power during consecutive packet transmissions. In order to improve the efficiency of energy harvest and energy utilization, we propose a new model to accurately describe the energy harvesting process and the power consumption for sustainable IoT devices. Experiments are performed using commercial IoT devices and RF energy harvesters to verify the accuracy of the proposed model. The experiment results show that the new model matches the performance of sustainable IoT devices very well in the real scenario.
△ Less
Submitted 31 December, 2019;
originally announced January 2020.
-
Unsupervised Dual Adversarial Learning for Anomaly Detection in Colonoscopy Video Frames
Authors:
Yuyuan Liu,
Yu Tian,
Gabriel Maicas,
Leonardo Z. C. T. Pu,
Rajvinder Singh,
Johan W. Verjans,
Gustavo Carneiro
Abstract:
The automatic detection of frames containing polyps from a colonoscopy video sequence is an important first step for a fully automated colonoscopy analysis tool. Typically, such detection system is built using a large annotated data set of frames with and without polyps, which is expensive to be obtained. In this paper, we introduce a new system that detects frames containing polyps as anomalies f…
▽ More
The automatic detection of frames containing polyps from a colonoscopy video sequence is an important first step for a fully automated colonoscopy analysis tool. Typically, such detection system is built using a large annotated data set of frames with and without polyps, which is expensive to be obtained. In this paper, we introduce a new system that detects frames containing polyps as anomalies from a distribution of frames from exams that do not contain any polyps. The system is trained using a one-class training set consisting of colonoscopy frames without polyps -- such training set is considerably less expensive to obtain, compared to the 2-class data set mentioned above. During inference, the system is only able to reconstruct frames without polyps, and when it tries to reconstruct a frame with polyp, it automatically removes (i.e., photoshop) it from the frame -- the difference between the input and reconstructed frames is used to detect frames with polyps. We name our proposed model as anomaly detection generative adversarial network (ADGAN), comprising a dual GAN with two generators and two discriminators. We show that our proposed approach achieves the state-of-the-art result on this data set, compared with recently proposed anomaly detection systems.
△ Less
Submitted 6 February, 2021; v1 submitted 23 October, 2019;
originally announced October 2019.
-
RF Energy Harvesting Sensor Networks for Healthcare of Animals: Opportunities and Challenges
Authors:
Yu Luo,
Lina Pu,
Yanxiao Zhao
Abstract:
In recent years, the radio frequency (RF) energy harvesting technique is considered as a favorable alternative to supply power for the next-generation wireless sensor networks. Due to the features of energy self-sustainability and long lifetime, the energy harvesting sensor network (RF-EHSN) becomes a promising solution to provide smart healthcare services. Nowadays, many energy harvesting based a…
▽ More
In recent years, the radio frequency (RF) energy harvesting technique is considered as a favorable alternative to supply power for the next-generation wireless sensor networks. Due to the features of energy self-sustainability and long lifetime, the energy harvesting sensor network (RF-EHSN) becomes a promising solution to provide smart healthcare services. Nowadays, many energy harvesting based applications have been developed for monitoring the health status of human beings; how to benefit animals, however, has not yet drawn people's attention. This article explores the potential of applying RF-EHSNs to monitoring the health level of animals. The unique challenges and potential solutions at different layers of an RF-EHSN for animals' healthcare service are studied.
△ Less
Submitted 28 February, 2018;
originally announced March 2018.
-
Exploiting Massive D2D Collaboration for Energy-Efficient Mobile Edge Computing
Authors:
Xu Chen,
Lingjun Pu,
Lin Gao,
Weigang Wu,
Di Wu
Abstract:
In this article we propose a novel Device-to-Device (D2D) Crowd framework for 5G mobile edge computing, where a massive crowd of devices at the network edge leverage the network-assisted D2D collaboration for computation and communication resource sharing among each other. A key objective of this framework is to achieve energy-efficient collaborative task executions at network-edge for mobile user…
▽ More
In this article we propose a novel Device-to-Device (D2D) Crowd framework for 5G mobile edge computing, where a massive crowd of devices at the network edge leverage the network-assisted D2D collaboration for computation and communication resource sharing among each other. A key objective of this framework is to achieve energy-efficient collaborative task executions at network-edge for mobile users. Specifically, we first introduce the D2D Crowd system model in details, and then formulate the energy-efficient D2D Crowd task assignment problem by taking into account the necessary constraints. We next propose a graph matching based optimal task assignment policy, and further evaluate its performance through extensive numerical study, which shows a superior performance of more than 50% energy consumption reduction over the case of local task executions. Finally, we also discuss the directions of extending the D2D Crowd framework by taking into variety of application factors.
△ Less
Submitted 30 March, 2017;
originally announced March 2017.
-
Content Retrieval At the Edge: A Social-aware and Named Data Cooperative Framework
Authors:
Lingjun Pu,
Xu Chen,
Jingdong Xu,
Xiaoming Fu
Abstract:
Recent years with the popularity of mobile devices have witnessed an explosive growth of mobile multimedia contents which dominate more than 50\% of mobile data traffic. This significant growth poses a severe challenge for future cellular networks. As a promising approach to overcome the challenge, we advocate Content Retrieval At the Edge, a content-centric cooperative service paradigm via device…
▽ More
Recent years with the popularity of mobile devices have witnessed an explosive growth of mobile multimedia contents which dominate more than 50\% of mobile data traffic. This significant growth poses a severe challenge for future cellular networks. As a promising approach to overcome the challenge, we advocate Content Retrieval At the Edge, a content-centric cooperative service paradigm via device-to-device (D2D) communications to reduce cellular traffic volume in mobile networks. By leveraging the Named Data Networking (NDN) principle, we propose sNDN, a social-aware named data framework to achieve efficient cooperative content retrieval. Specifically, sNDN introduces Friendship Circle by grouping a user with her close friends of both high mobility similarity and high content similarity. We construct NDN routing tables conditioned on Friendship Circle encounter frequency to navigate a content request and a content reply packet between Friendship Circles, and leverage social properties in Friendship Circle to search for the final target as inner-Friendship Circle routing. The evaluation results demonstrate that sNDN can save cellular capacity greatly and outperform other content retrieval schemes significantly.
△ Less
Submitted 20 June, 2016;
originally announced June 2016.
-
Matrix Computations and Optimization in Apache Spark
Authors:
Reza Bosagh Zadeh,
Xiangrui Meng,
Aaron Staple,
Burak Yavuz,
Li Pu,
Shivaram Venkataraman,
Evan Sparks,
Alexander Ulanov,
Matei Zaharia
Abstract:
We describe matrix computations available in the cluster programming framework, Apache Spark. Out of the box, Spark provides abstractions and implementations for distributed matrices and optimization routines using these matrices. When translating single-node algorithms to run on a distributed cluster, we observe that often a simple idea is enough: separating matrix operations from vector operatio…
▽ More
We describe matrix computations available in the cluster programming framework, Apache Spark. Out of the box, Spark provides abstractions and implementations for distributed matrices and optimization routines using these matrices. When translating single-node algorithms to run on a distributed cluster, we observe that often a simple idea is enough: separating matrix operations from vector operations and shipping the matrix operations to be ran on the cluster, while keeping vector operations local to the driver. In the case of the Singular Value Decomposition, by taking this idea to an extreme, we are able to exploit the computational power of a cluster, while running code written decades ago for a single core. Another example is our Spark port of the popular TFOCS optimization package, originally built for MATLAB, which allows for solving Linear programs as well as a variety of other convex programs. We conclude with a comprehensive set of benchmarks for hardware accelerated matrix computations from the JVM, which is interesting in its own right, as many cluster programming frameworks use the JVM. The contributions described in this paper are already merged into Apache Spark and available on Spark installations by default, and commercially supported by a slew of companies which provide further services.
△ Less
Submitted 12 July, 2016; v1 submitted 8 September, 2015;
originally announced September 2015.
