Search Results (12,233)

Despite significant advancements in CNN-based object detection technology, adverse weather conditions can disrupt imaging sensors’ ability to capture clear images, thereby adversely impacting detection accuracy. Mainstream algorithms for adverse weather object detection enhance detection performance through image restoration methods. Nevertheless, the majority of these approaches are designed for a specific degradation scenario, making it difficult to adapt to diverse weather conditions. To cope with this issue, we put forward a degradation type-aware restoration-assisted object detection network, dubbed DTRDNet. It contains an object detection network with a shared feature encoder (SFE) and object detection decoder, a degradation discrimination image restoration decoder (DDIR), and a degradation category predictor (DCP). In the training phase, we jointly optimize the whole framework on a mixed weather dataset, including degraded images and clean images. Specifically, the degradation type information is incorporated in our DDIR to avoid the interaction between clean images and the restoration module. Furthermore, the DCP makes the SFE possess degradation category awareness ability, enhancing the detector’s adaptability to diverse weather conditions and enabling it to furnish requisite environmental information as required. Both the DCP and the DDIR can be removed according to requirement in the inference stage to retain the real-time performance of the detection algorithm. Extensive experiments on clear, hazy, rainy, and snowy images demonstrate that our DTRDNet outperforms advanced object detection algorithms, achieving an average mAP of 79.38% across the four weather test sets. Full article

In this research, we investigate the power quality of the grid where an Electric Arc Furnace (EAF) with a very high load operates. An Electric Arc Furnace (EAF) is a highly nonlinear load that uses very high and variable currents, causing major power quality issues such as voltage sags, flickers, and harmonic distortions. These disturbances produce electrical grid instability, affect the operation of other equipment, and require strong mitigation measures to reduce their impact. To investigate these issues, data are collected from the Point of Common Coupling where the Electric Arc Furnace is fed. The following three main factors are identified for evaluating power quality: apparent power, active and reactive power, and distorted power. Along with these powers, Total Harmonic Distortion, an important indicator of power quality, is calculated. These data are collected during the full process of producing a complete steel batch. To create a Deep Neural Network that can model and forecast power quality parameters, a network is developed using LSTM layers, Convolutional Layers, and GRU Layers, all of which demonstrate good prediction performance. The results of the prediction models are examined, as well as the primary metrics characterizing the prediction, using the following: MAE, RMSE, R-squared, and sMAPE. Predicting active and reactive power and Total Harmonic Distortion (THD) proves useful for anticipating power quality problems in an Electric Arc Furnace (EAF). By reducing the EAF’s impact on the power system, accurate predictions will anticipate and minimize disturbances, optimize energy consumption, and improve grid stability. This research’s principal scientific contribution is the development of a hybrid deep neural network that integrates Convolutional Neural Networks (CNNs), Long Short-Term Memory (LSTM), and Gated Recurrent Unit (GRU) layers. This deep neural network was designed to predict power quality metrics, including active power, reactive power, distortion power, and Total Harmonic Distortion (THD). The proposed methodology indicates an important step in improving the accuracy of power quality forecasting for Electric Arc Furnaces (EAFs). The hybrid model’s ability for analyzing both time-series data and complex nonlinear patterns improves its predictive accuracy compared to traditional methods. Full article

Biodiversity is a characteristic of ecosystems that plays a crucial role in the study of their evolution, and to estimate it, the species of all plants need to be determined. In this study, we used Unmanned Aerial Vehicles to gather RGB images of mid-to-high-altitude ecosystems in the Zao mountains (Japan). All the data-collection missions took place in autumn so the plants present distinctive seasonal coloration. Patches from single trees and bushes were manually extracted from the collected orthomosaics. Subsequently, Deep Learning image-classification networks were used to automatically determine the species of each tree or bush and estimate biodiversity. Both Convolutional Neural Networks (CNNs) and Transformer-based models were considered (ResNet, RegNet, ConvNeXt, and SwinTransformer). To measure and estimate biodiversity, we relied on the Gini–Simpson Index, the Shannon–Wiener Index, and Species Richness. We present two separate scenarios for evaluating the readiness of the technology for practical use: the first scenario uses a subset of the data with five species and a testing set that has a very similar percentage of each species to those present in the training set. The models studied reach very high performances with over 99 Accuracy and 98 F₁ Score (the harmonic mean of Precision and Recall) for image classification and biodiversity estimates under 1% error. The second scenario uses the full dataset with nine species and large variations in class balance between the training and testing datasets, which is often the case in practical use situations. The results in this case remained fairly high for Accuracy at 90.64% but dropped to 51.77% for F₁ Score. The relatively low F₁ Score value is partly due to a small number of misclassifications having a disproportionate impact in the final measure, but still, the large difference between the Accuracy and F₁ Score highlights the complexity of finely evaluating the classification results of Deep Learning Networks. Even in this very challenging scenario, the biodiversity estimation remained with relatively small (6–14%) errors for the most detailed indices, showcasing the readiness of the technology for practical use. Full article

Oil and gas pipelines are the lifelines of the energy market, but due to long-term use and environmental factors, these pipelines are prone to corrosion and leaks. Offshore oil and gas pipeline leaks, in particular, can lead to severe consequences such as platform fires and explosions. Therefore, it is crucial to accurately and swiftly identify oil and gas leaks on offshore platforms. This is of significant importance for improving early warning systems, enhancing maintenance efficiency, and reducing economic losses. Currently, the efficiency of identifying leaks in offshore platform pipelines still needs improvement. To address this, the present study first established an experimental platform to simulate pipeline leaks in a marine environment. Laboratory leakage signal data were collected, and on-site noise data were gathered from the “Liwan 3-1” offshore oil and gas platform. By integrating leakage signals with on-site noise data, this study aimed to closely mimic real-world application scenarios. Subsequently, several neural network-based leakage identification methods were applied to the integrated dataset, including a probabilistic neural network (PNN) combined with time-domain feature extraction, a Backpropagation Neural Network (BPNN) optimized with simulated annealing and particle swarm optimization, and a Long Short-Term Memory Network (LSTM) combined with Mel-Frequency Cepstral Coefficients (MFCC). Corresponding models were constructed, and the effectiveness of leak detection was validated using test sets. Additionally, this paper proposes an improved convolutional neural network (CNN) leakage detection technology named SART-1DCNN. This technology optimizes the network architecture by introducing attention mechanisms, transformer modules, residual blocks, and combining them with Dropout and optimization algorithms, which significantly enhances data recognition accuracy. It achieves a high accuracy rate of 99.44% on the dataset. This work is capable of detecting pipeline leaks with high accuracy. Full article

In the field of remote sensing (RS), change detection (CD) methods are critical for analyzing the quality of images shot over various geographical areas, particularly for high-resolution images. However, there are some shortcomings of the widely used Convolutional Neural Networks (CNNs) and Transformers-based CD methods. The former is limited by its insufficient long-range modeling capabilities, while the latter is hampered by its computational complexity. Additionally, the commonly used information-fusion methods for pre- and post-change images often lead to information loss or redundancy, resulting in inaccurate edge detection. To address these issues, we propose an Iterative Mamba Diffusion Change Detection (IMDCD) approach to iteratively integrate various pieces of information and efficiently produce fine-grained CD maps. Specifically, the Swin-Mamba-Encoder (SME) within Mamba-CD (MCD) is employed as a semantic feature extractor, capable of modeling long-range relationships with linear computability. Moreover, we introduce the Variable State Space CD (VSS-CD) module, which extracts abundant CD features by training the matrix parameters within the designed State Space Change Detection (SS-CD). The computed high-dimensional CD feature is integrated into the noise predictor using a novel Global Hybrid Attention Transformer (GHAT) while low-dimensional CD features are utilized to calibrate prior CD results at each iterative step, progressively refining the generated outcomes. IMDCD exhibits a high performance across multiple datasets such as the CDD, WHU, LEVIR, and OSCD, marking a significant advancement in the methodologies within the CD field of RS. The code for this work is available on GitHub. Full article

Computer vision, particularly in artificial intelligence (AI), is increasingly being applied in various industries, including livestock farming. Identifying and managing livestock through machine learning is essential to improve efficiency and animal welfare. The aim of this work is to automatically identify individual sheep or goats based on their physical characteristics including muzzle pattern, coat pattern, or ear pattern. The proposed intelligent classifier was built on the Roboflow platform using the YOLOv8 model, trained with 35,204 images. Initially, a Convolutional Neural Network (CNN) model was developed, but its performance was not optimal. The pre-trained VGG16 model was then adapted, and additional fine-tuning was performed using data augmentation techniques. The dataset was split into training (88%), validation (8%), and test (4%) sets. The performance of the classifier was evaluated using precision, recall, and F1-Score metrics, with comparisons against other pre-trained models such as EfficientNet. The YOLOv8 classifier achieved 95.8% accuracy in distinguishing between goat and sheep images. Compared to the CNN and VGG16 models, the YOLOv8-based classifier showed superior performance in terms of both accuracy and computational efficiency. The results confirm that deep learning models, particularly YOLOv8, significantly enhance the accuracy and efficiency of livestock identification and management. Future research could extend this technology to other livestock species and explore real-time monitoring through IoT integration. Full article

As the scale of the power grid rapidly expands, its operation becomes increasingly complex, with higher demands on personnel proficiency, grid stability, equipment safety, and operational efficiency. In this study, a novel power insulator defect detection method based on convolutional neural networks (CNNs) is proposed. This method innovatively combines the feature extraction advantages of deep learning to build an efficient binary classification model capable of accurately detecting defects in power insulators in complex backgrounds. To avoid the impact of a small dataset on model performance, transfer learning was employed during model training to enhance the model’s generalization ability. A combination of Grid Search and Random Search was used for hyperparameter tuning, and the Early Stopping strategy was introduced to effectively prevent the model from overfitting to the training set, ensuring generalization performance on the validation set. Experimental results show that the proposed method achieves an average accuracy of 98.6%, a recall of 96.8%, and an F1 score of 97.7% on the test set. Compared to traditional Faster RCNN and PCA-SVM methods, the proposed CNN model significantly improves detection accuracy and computational efficiency in complex backgrounds, exhibiting superior recognition precision and model generalization ability for efficiently and accurately identifying defective insulators. Full article

In this paper, we propose a lightweight lithography machine learning-based hotspot detection model that integrates the Squeeze-and-Excitation (SE) attention mechanism and the Efficient Channel Attention (ECA) mechanism. These mechanisms can adaptively adjust channel weights, significantly enhancing the model’s ability to extract relevant features of hotspots and non-hotspots through cross-channel interaction without dimensionality reduction. Our model extracts feature vectors through seven convolutional layers and four pooling layers, followed by three fully connected layers that map to the output, thereby simplifying the CNN network structure. Experimental results on our collected layout dataset and the ICCAD 2012 layout dataset demonstrate that our model is more lightweight. By evaluating overall accuracy, recall, and runtime, the comprehensive performance of our model is shown to exceed that of ConvNeXt, Swin transformer, and ResNet 50. Full article

With the development of Convolutional Neural Networks (CNNs), there is a growing requirement for their deployment on edge devices. At the same time, Compute-In-Memory (CIM) technology has gained significant attention in edge CNN applications due to its ability to minimize data movement between memory and computing units. However, the deployment of complex deep neural network models on edge devices with restricted hardware resources continues to be challenged by a lack of adequate storage for intermediate layer data. In this article, we propose an optimized JPEG Lossless Compression (JPEG-LS) algorithm that implements serial context parameter updating alongside parallel encoding. This method is designed for the global prediction and efficient compression of intermediate data layers in neural networks employing CIM techniques. The results indicate average compression ratios of 6.44× for VGG16, 3.62× for ResNet34, 1.67× for MobileNetV2, and 2.31× for InceptionV3. Moreover, the implementation achieves a data throughput of 32 bits per cycle at 600 MHz on the TSMC 28 nm, with a hardware cost of 122 K Gate Count. Full article

Water management is vital for building an adaptive and resilient society. Water demand forecasting aids water management by learning the underlying relationship between consumption and governing variables for optimal supply. In this paper, we propose a week-ahead hourly water demand forecasting technique based on deep learning (DL) utilizing an encoded representation of historical supply data and influencing exogenous variables for a District Metered Area (DMA). We deploy a CNN model with and without attention and evaluate the model’s ability to forecast the supply for different DMAs with varying characteristics. The performances are quantitatively and qualitatively compared against a baseline LSTM. Full article

Pumped storage units serve as a crucial support for power systems to adapt to large-scale and high-proportion renewable energy sources by providing a stable and flexible energy supply. However, due to the coupling effects of electric power load demands and the complex multi-source factors within the water–mechanical–electrical system, the interrelationship between unit parameters becomes more intricate, posing significant threats to the operational reliability and health status of the units. The complexity of fault diagnosis is further aggravated by the intricate and varied nature of fault characteristics, as well as the challenges in signal extraction under conditions of strong electromagnetic interference and high noise levels. To address these issues, this paper proposes a novel data-model hybrid-driven strategy that analyzes vibration signals to achieve rapid and accurate fault diagnosis of the units. Firstly, the spectral kurtosis theory is employed to enhance the traditional empirical mode decomposition, achieving optimal decomposition and noise reduction effects for vibration signals. Secondly, the intrinsic mode functions (IMFs) obtained from the decomposition are reconstructed, and the entropy values of effective IMFs are calculated as fault feature vectors. Subsequently, the CNN-LSTM model is utilized for fault diagnosis. The effectiveness and feasibility of the proposed method are verified through actual operational data from pumped storage units in a specific region. Through analysis, the fault diagnosis accuracy of the method proposed in this paper can be maintained above 95%, demonstrating robustness in complex engineering environments and effectively ensuring the safe and stable operation of pumped storage units. Full article

The joint moment is a key measurement in locomotion analysis. Transferable prediction across different subjects is advantageous for calibration-free, practical clinical applications. However, even for similar gait motions, intersubject variance presents a significant challenge in maintaining reliable prediction performance. The optimal deep learning models for ankle moment prediction during dynamic gait motions remain underexplored for both intrasubject and intersubject usage. This study evaluates the feasibility of different deep-learning models for estimating ankle moments using sEMG data to find an optimal intrasubject model against the inverse dynamic approach. We verified and compared the performance of 1302 intrasubject models per subject on 597 steps from seven subjects using various architectures and feature sets. The best-performing intrasubject models were recurrent convolutional neural networks trained using signal energy features. They were then transferred to realize intersubject ankle moment estimation. Full article

High-quality rainfall data are essential in many water management problems, including stormwater management, water resources management, and more. Due to the high spatial–temporal variations, rainfall measurement could be challenging and costly, especially in urban areas. This could be even more challenging in tropical regions with their typical short-duration and high-intensity rainfall events, as some of the undeveloped or developing countries in those regions lack a dense rain gauge network and have limited resources to use radar and satellite readings. Thus, exploring alternative rainfall estimation methods could be helpful to back up some shortcomings. Recently, a few studies have examined the utilisation of citizen science methods to collect rainfall data as a complement to the existing rain gauge networks. However, these attempts are in the early stages, and limited works have been published on improving the quality of such data. Therefore, this study focuses on image-based rainfall estimation with potential usage in citizen science. For this, a novel convolutional neural network (CNN) model is developed to predict rainfall intensity by processing the images captured by citizens (e.g., by smartphones or security cameras) in an urban area. The developed model is merely a complementary sensing tool (e.g., better spatial coverage) to the existing rain gauge network in an urban area and is not meant to replace it. This study also presents one of the most extensive datasets of rain image data ever published in the literature. The estimated rainfall data by the proposed CNN model of this study using images captured by surveillance cameras and smartphone cameras are compared with observed rainfall by a weather station and exhibit strong R² values of 0.955 and 0.840, respectively. Full article

‘Akizuki’ pear (Pyrus pyrifolia Nakai) corky disease is a physiological disease that strongly affects the fruit quality of ‘Akizuki’ pear and its economic value. In this study, Raman spectroscopy was employed to develop an early diagnosis model by integrating support vector machine (SVM), random forest (RF), gradient boosting decision tree (GBDT), extreme gradient boosting (XGBoost), and convolutional neural network (CNN) modeling techniques. The effects of various pretreatment methods and combinations of methods on modeling results were studied. The relative optimal index formula was utilized to identify the SG and SG+WT as the most effective preprocessing methods. Following the optimal preprocessing method, the performance of the majority of the models was markedly enhanced through the process of model reconditioning, among which XGBoost achieved 80% accuracy under SG+WT pretreatment, and F1 and kappa both performed best. The results show that RF, GBDT, and XGBoost are more sensitive to the pretreatment method, whereas SVM and CNN are more dependent on internal parameter tuning. The results of this study indicate that the early detection of Raman spectroscopy represents a novel approach for the nondestructive identification of asymptomatic ‘Akizuki’ pear corky disease, which is of paramount importance for the realization of large-scale detection across orchards. Full article

The integration of machine learning (ML) with edge computing and wearable devices is rapidly advancing healthcare applications. This study systematically maps the literature in this emerging field, analyzing 171 studies and focusing on 28 key articles after rigorous selection. The research explores the key concepts, techniques, and architectures used in healthcare applications involving ML, edge computing, and wearable devices. The analysis reveals a significant increase in research over the past six years, particularly in the last three years, covering applications such as fall detection, cardiovascular monitoring, and disease prediction. The findings highlight a strong focus on neural network models, especially Convolutional Neural Networks (CNNs) and Long Short-Term Memory Networks (LSTMs), and diverse edge computing platforms like Raspberry Pi and smartphones. Despite the diversity in approaches, the field is still nascent, indicating considerable opportunities for future research. The study emphasizes the need for standardized architectures and the further exploration of both hardware and software to enhance the effectiveness of ML-driven healthcare solutions. The authors conclude by identifying potential research directions that could contribute to continued innovation in healthcare technologies. Full article