Search Results (811)

Rate of penetration (ROP) is crucial for evaluating drilling efficiency, with accurate prediction essential for enhancing performance and optimizing parameters. In practice, complex and variable downhole environments pose significant challenges for mechanistic ROP equations, resulting in prediction difficulties and low accuracy. Recently, data-driven machine learning models have been widely applied to ROP prediction. However, these models often lack mechanistic constraints, limiting their performance to specific conditions and reducing their real-world applicability. Additionally, geological variability across wells further hinders the transferability of conventional intelligent models. Thus, combining mechanistic knowledge with intelligent models and enhancing model stability and transferability are key challenges in ROP prediction research. To address these challenges, this paper proposes a Mechanism-Data Fusion and Transfer Learning method to construct an intelligent prediction model for ROP, achieving accurate ROP predictions. A multilayer perceptron (MLP) was selected as the base model, and training was performed using data from neighboring wells and partial data from the target well. The Two-stage TrAdaBoost.R2 algorithm was employed to enhance model transferability. Additionally, drilling mechanistic knowledge was incorporated into the model’s loss function as a constraint to achieve a fusion of mechanistic knowledge and data-driven approaches. Using MAPE as the measure of accuracy, compared with conventional intelligent models, the proposed ROP prediction model improved prediction accuracy on the target well by 64.51%. The model transfer method proposed in this paper has a field test accuracy of 89.71% in an oilfield in China. These results demonstrate the effectiveness and feasibility of the proposed transfer learning method and mechanistic–data integration approach. Full article

This study presents a novel approach to emergency vehicle classification that leverages a comprehensive set of informative audio features to distinguish between ambulance sirens, fire truck sirens, and traffic noise. A unique contribution lies in combining time domain features, including root mean square (RMS) and zero-crossing rate, to capture the temporal characteristics, like signal energy changes, with frequency domain features derived from short-time Fourier transform (STFT). These include spectral centroid, spectral bandwidth, and spectral roll-off, providing insights into the sound’s frequency content for differentiating siren patterns from traffic noise. Additionally, Mel-frequency cepstral coefficients (MFCCs) are incorporated to capture the human-like auditory perception of the spectral information. This combination captures both temporal and spectral characteristics of the audio signals, enhancing the model’s ability to discriminate between emergency vehicles and traffic noise compared to using features from a single domain. A significant contribution of this study is the integration of data augmentation techniques that replicate real-world conditions, including the Doppler effect and noise environment considerations. This study further investigates the effectiveness of different machine learning algorithms applied to the extracted features, performing a comparative analysis to determine the most effective classifier for this task. This analysis reveals that the support vector machine (SVM) achieves the highest accuracy of 99.5%, followed by random forest (RF) and k-nearest neighbors (KNNs) at 98.5%, while AdaBoost lags at 96.0% and long short-term memory (LSTM) has an accuracy of 93%. We also demonstrate the effectiveness of a stacked ensemble classifier, and utilizing these base learners achieves an accuracy of 99.5%. Furthermore, this study conducted leave-one-out cross-validation (LOOCV) to validate the results, with SVM and RF achieving accuracies of 98.5%, followed by KNN and AdaBoost, which are 97.0% and 90.5%. These findings indicate the superior performance of advanced ML techniques in emergency vehicle classification. Full article

This study explores the fabrication and characterisation of 3D-printed polylactic acid (PLA) scaffolds reinforced with calcium hydroxyapatite (cHAP) for bone tissue engineering applications. By varying the cHAP content, we aimed to enhance PLA scaffolds’ mechanical and thermal properties, making them suitable for load-bearing biomedical applications. The results indicate that increasing cHAP content improves the tensile and compressive strength of the scaffolds, although it also increases brittleness. Notably, incorporating cHAP at 7.5% and 10% significantly enhances thermal stability and mechanical performance, with properties comparable to or exceeding those of human cancellous bone. Furthermore, this study integrates machine learning techniques to predict the mechanical properties of these composites, employing algorithms such as XGBoost and AdaBoost. The models demonstrated high predictive accuracy, with R² scores of 0.9173 and 0.8772 for compressive and tensile strength, respectively. These findings highlight the potential of using data-driven approaches to optimise material properties autonomously, offering significant implications for developing custom-tailored scaffolds in bone tissue engineering and regenerative medicine. The study underscores the promise of PLA/cHAP composites as viable candidates for advanced biomedical applications, particularly in creating patient-specific implants with improved mechanical and thermal characteristics. Full article

Unconfined compressive strength (UCS) is a critical property for assessing the engineering performances of sustainable materials, such as cement–fly ash mortar (CFAM), in the design of construction engineering projects. The experimental determination of UCS is time-consuming and expensive. Therefore, the present study aims to model the UCS of CFAM with boosting machine learning methods. First, an extensive database consisting of 395 experimental data points derived from the literature was developed. Then, three typical boosting machine learning models were employed to model the UCS based on the database, including gradient boosting regressor (GBR), light gradient boosting machine (LGBM), and Ada-Boost regressor (ABR). Additionally, the importance of different input parameters was quantitatively analyzed using the SHapley Additive exPlanations (SHAP) approach. Finally, the best boosting machine learning model’s prediction accuracy was compared to ten other commonly used machine learning models. The results indicate that the GBR model outperformed the LGBM and ABR models in predicting the UCS of the CFAM. The GBR model demonstrated significant accuracy, with no significant difference between the measured and predicted UCS values. The SHAP interpretations revealed that the curing time (T) was the most critical feature influencing the UCS values. At the same time, the chemical composition of the fly ash, particularly Al₂O₃, was more influential than the fly-ash dosage (FAD) or water-to-binder ratio (W/B) in determining the UCS values. Overall, this study demonstrates that SHAP boosting machine learning technology can be a useful tool for modeling and predicting UCS values of CFAM with good accuracy. It could also be helpful for CFAM design by saving time and costs on experimental tests. Full article

Soil consolidation, particularly in fine-grained soils like clay, is crucial in predicting settlement and ensuring the stability of structures. Additionally, the compressibility of fine-grained soils is of critical importance not only in civil engineering but also in various other fields of study. The compression index (C_c), derived from soil properties such as the liquid limit (LL), plastic limit (PL), plasticity index (PI), water content (w), initial void ratio (e₀), and specific gravity (G_s), plays a vital role in understanding soil behavior. This study employs machine learning algorithms—the random forest regressor (RFR), gradient boosting regressor (GBR), and AdaBoost regressor (ABR)—to predict the C_c values based on a dataset comprising 915 samples. The dataset includes LL, PL, W, PI, G_s, and e₀ as the inputs, with C_c as the output parameter. The algorithms are trained and evaluated using metrics such as the coefficient of determination (R²), mean absolute error (MAE), mean squared error (MSE), and root mean squared error (RMSE). Hyperparameter optimization is performed to enhance the model performance. The best-performing model, the GBR model, achieves a training R² of 0.925 and a testing R² of 0.930 with the input combination [w, PL, LL, PI, e₀, G_s]. The RFR model follows closely, with a training R² of 0.970 and a testing R² of 0.926 using the same input combination. The ABR model records a training R² of 0.847 and a testing R² of 0.921 under similar conditions. These results indicate superior predictive accuracy compared to previous studies using traditional statistical and machine learning methods. Machine learning algorithms, specifically the gradient boosting regressor and random forest regressor, demonstrate substantial potential in predicting the C_c value for fine-grained soils based on multiple soil parameters. This study involves leveraging the efficiency and effectiveness of these algorithms in geotechnical engineering applications, offering a promising alternative to traditional oedometer testing methods. Accurately predicting the compression index can significantly aid in the assessment of soil settlement and the design of stable foundations, thereby reducing the time and costs associated with laboratory testing. Full article

With the rapid development of industrialization, the problem of heavy metal wastewater treatment has become increasingly serious, posing a serious threat to the environment and human health. Biochar shows great potential for application in the field of wastewater treatment; however, biochars prepared from different biomass sources and experimental conditions have different physicochemical properties, resulting in differences in their adsorption capacity for uranium, which limits their wide application in wastewater treatment. Therefore, there is an urgent need to deeply explore and optimize the key parameter settings of biochar to significantly improve its adsorption capacity. This paper combines the nonlinear mapping capability of SCN and the ensemble learning advantage of the Adaboost algorithm based on existing experimental data on wastewater treatment. The accuracy of the model is evaluated by metrics such as coefficient of determination (R²) and error rate. It was found that the Adaboost–SCN model showed significant advantages in terms of prediction accuracy, precision, model stability and generalization ability compared to the SCN model alone. In order to further improve the performance of the model, this paper combined Adaboost–SCN with maximum information coefficient (MIC), random forest (RF) and energy valley optimizer (EVO) feature selection methods to construct three models, namely, MIC-Adaboost–SCN, RF-Adaboost–SCN and EVO-Adaboost–SCN. The results show that the prediction model with added feature selection is significantly better than the Adaboost–SCN model without feature selection in each evaluation index, and EVO has the most significant effect on feature selection. Finally, the correlation between biochar adsorption properties and production parameters was discussed through the inversion study of key parameters, and optimal parameter intervals were proposed to improve the adsorption properties. Providing strong support for the wide application of biochar in the field of wastewater treatment helps to solve the urgent environmental problem of heavy metal wastewater treatment. Full article

Enhancing high-performance proton exchange membrane fuel cell (PEMFC) technology is crucial for the widespread adoption of hydrogen energy, a leading renewable resource. In this research, we introduce an innovative and cost-effective data-driven approach using the BP-AdaBoost algorithm to accurately predict the power output of hydrogen fuel cell stacks. The algorithm’s effectiveness was validated with experimental data obtained from an advanced fuel cell testing platform, where the predicted power outputs closely matched the actual results. Our findings demonstrate that the BP-AdaBoost algorithm achieved lower RMSE and MAE, along with higher R², compared to other models, such as Partial Least Squares Regression (PLS), Support Vector Machine (SVM), and back propagation (BP) neural networks, when predicting power output for electric stacks of the same type. However, the algorithm’s performance decreased when applied to electric stacks with varying material compositions, highlighting the need for more sophisticated models to handle such diversity. These results underscore the potential of the BP-AdaBoost algorithm to improve PEMFC efficiency while also emphasizing the necessity for further research to develop models capable of accurately predicting power output across different types of PEMFC stacks. Full article

Energy consumption analysis has often faced challenges such as limited model accuracy and inadequate consideration of the complex interactions between energy usage and meteorological data. This study is presented as a solution to these challenges through a detailed analysis of energy consumption across UBC Campus buildings using a variety of machine learning models, including Neural Networks, Decision Trees, Random Forests, Gradient Boosting, AdaBoost, Linear Regression, Ridge Regression, Lasso Regression, Support Vector Regression, and K-Neighbors. The primary objective is to uncover the complex relationships between energy usage and meteorological data, addressing gaps in understanding how these variables impact consumption patterns in different campus buildings by considering factors such as seasons, hours of the day, and weather conditions. Significant interdependencies among electricity usage, hot water power, gas, and steam volume are revealed, highlighting the need for integrated energy management strategies. Strong negative correlations between Vancouver’s temperature and energy consumption metrics are identified, suggesting opportunities for energy savings through temperature-responsive strategies, especially during warmer periods. Among the regression models evaluated, deep neural networks are found to excel in capturing complex patterns and achieve high predictive accuracy. Valuable insights for improving energy efficiency and sustainability practices are offered, aiding informed decision-making for energy resource management in educational campuses and similar urban environments. Applying advanced machine learning techniques underscores the potential of data-driven energy optimization strategies. Future research could investigate causal relationships between energy consumption and external factors, assess the impact of specific operational interventions, and explore integrating renewable energy sources into the campus energy mix. UBC can advance sustainable energy management through these efforts and can serve as a model for other institutions that aim to reduce their environmental impact. Full article

Software is increasingly vital, with automated systems regulating critical functions. As development demands grow, manual code review becomes more challenging, often making testing more time-consuming than development. A promising approach to improving defect detection at the source code level is the use of artificial intelligence combined with natural language processing (NLP). Source code analysis, leveraging machine-readable instructions, is an effective method for enhancing defect detection and error prevention. This work explores source code analysis through NLP and machine learning, comparing classical and emerging error detection methods. To optimize classifier performance, metaheuristic optimizers are used, and algorithm modifications are introduced to meet the study’s specific needs. The proposed two-tier framework uses a convolutional neural network (CNN) in the first layer to handle large feature spaces, with AdaBoost and XGBoost classifiers in the second layer to improve error identification. Additional experiments using term frequency–inverse document frequency (TF-IDF) encoding in the second layer demonstrate the framework’s versatility. Across five experiments with public datasets, the accuracy of the CNN was 0.768799. The second layer, using AdaBoost and XGBoost, further improved these results to 0.772166 and 0.771044, respectively. Applying NLP techniques yielded exceptional accuracies of 0.979781 and 0.983893 from the AdaBoost and XGBoost optimizers. Full article

Prognostic outcomes for patients with type 2 diabetes in the intensive care unit (ICU), including mortality and readmission rates, are critical for informed clinical decision-making. Although existing research has established a link between type 2 diabetes and adverse outcomes in the ICU, the potential of machine learning techniques for enhancing predictive accuracy has not been fully realized. This study seeks to develop and validate predictive models employing machine learning algorithms to forecast mortality and 30-day post-discharge readmission rates among ICU type 2 diabetes patients, thereby enhancing predictive accuracy and supporting clinical decision-making. Data were extracted and preprocessed from the MIMIC-III database, focusing on 14,222 patients with type 2 diabetes and their corresponding ICU admission records. Comprehensive information, including vital signs, laboratory results, and demographic characteristics, was utilized. Six machine learning algorithms—bagging, AdaBoost, GaussianNB, logistic regression, MLP, and SVC—were developed and evaluated using 10-fold cross-validation to predict mortality at 3 days, 30 days, and 365 days, as well as 30-day post-discharge readmission rates. The machine learning models demonstrated strong predictive performance for both mortality and readmission rates. Notably, the bagging and AdaBoost models showed superior performance in predicting mortality across various time intervals, achieving AUC values up to 0.8112 and an accuracy of 0.8832. In predicting 30-day readmission rates, the MLP and AdaBoost models yielded the highest performance, with AUC values reaching 0.8487 and accuracy rates of 0.9249. The integration of electronic health record data with advanced machine learning techniques significantly enhances the accuracy of mortality and readmission predictions in ICU type 2 diabetes patients. These models facilitate the identification of high-risk patients, enabling timely interventions, improving patient outcomes, and demonstrating the significant potential of machine learning in clinical prediction and decision support. Full article

Diabetes mellitus (DM) presents a critical global health challenge, characterized by persistent hyperglycemia and associated with substantial economic and health-related burdens. This study employs advanced machine-learning techniques to improve the prediction and classification of antidiabetic peptides, with a particular focus on differentiating those effective against T1DM from those targeting T2DM. We integrate feature selection with analysis methods, including logistic regression, support vector machines (SVM), and adaptive boosting (AdaBoost), to classify antidiabetic peptides based on key features. Feature selection through the Lasso-penalized method identifies critical peptide characteristics that significantly influence antidiabetic activity, thereby establishing a robust foundation for future peptide design. A comprehensive evaluation of logistic regression, SVM, and AdaBoost shows that AdaBoost consistently outperforms the other methods, making it the most effective approach for classifying antidiabetic peptides. This research underscores the potential of machine learning in the systematic evaluation of bioactive peptides, contributing to the advancement of peptide-based therapies for diabetes management. Full article

Scientific evaluation of cultivated land quality (CLQ) is necessary for promoting rational utilization of cultivated land and achieving one of the Sustainable Development Goals (SDGs): Zero Hunger. However, the CLQ evaluation system proposed in previous studies was diversified, and the methods were inefficient. In this study, based on China’s first national standard “Cultivated Land Quality Grade” (GB/T 33469-2016), we constructed a unified county-level CLQ evaluation system by selecting 15 indicators from five aspects—site condition, environmental condition, physicochemical property, nutrient status and field management—and used the Delphi method to calculate the membership degree of the indicators. Taking Jimo district of Shandong Province, China, as a case study, we compared the performance of three machine learning models, including random forest, AdaBoost, and support vector regression, to evaluate CLQ using multi-temporal remote sensing data. The comprehensive index method was used to reveal the spatial distribution of CLQ. The results showed that the CLQ evaluation based on multi-temporal remote sensing data and machine learning model was efficient and reliable, and the evaluation results had a significant positive correlation with crop yield (r was 0.44, p < 0.001). The proportions of cultivated land of high-, medium- and poor-quality were 27.43%, 59.37% and 13.20%, respectively. The CLQ in the western part of the study area was better, while it was worse in the eastern and central parts. The main limiting factors include irrigation capacity and texture configuration. Accordingly, a series of targeted measures and policies were suggested, such as strengthening the construction of farmland water conservancy facilities, deep tillage of soil and continuing to construct well-facilitated farmland. This study proposed a fast and reliable method for evaluating CLQ, and the results are helpful to promote the protection of cultivated land and ensure food security. Full article

Autonomous vehicles (AVs) face critical decisions in pedestrian interactions, necessitating ethical considerations such as minimizing harm and prioritizing human life. This study investigates machine learning models to predict human decision making in simulated driving scenarios under varying pedestrian configurations and time constraints. Data were collected from 204 participants across 12 unique simulated driving scenarios, categorized into young (24.7 ± 3.5 years, 38 males, 64 females) and older (71.0 ± 5.7 years, 59 males, 43 females) age groups. Participants’ binary decisions to maintain or change lanes were recorded. Traditional logistic regression models exhibited high precision but consistently low recall, struggling to identify true positive instances requiring intervention. In contrast, the AdaBoost algorithm demonstrated superior accuracy and discriminatory power. Confusion matrix analysis revealed AdaBoost’s ability to achieve high true positive rates (up to 96%) while effectively managing false positives and negatives, even under 1 s time constraints. Learning curve analysis confirmed robust learning without overfitting. AdaBoost consistently outperformed logistic regression, with AUC-ROC values ranging from 0.82 to 0.96. It exhibited strong generalization, with validation accuracy approaching 0.8, underscoring its potential for reliable real-world AV deployment. By consistently identifying critical instances while minimizing errors, AdaBoost can prioritize human safety and align with ethical frameworks essential for responsible AV adoption. Full article

Due to poor road design, challenging terrain, and difficult geological conditions, traffic accidents on mountainous two-lane roads are more frequent and severe. This study aims to address the lack of understanding of key factors affecting accident severity with the goal of improving mountainous traffic safety, thereby contributing to sustainable transportation systems. The focus of this study is to compare the interpretability of model performances with three statistical models (Ordered Logit, Partial Proportional Odds Model, and Multinomial Logit) and six machine learning models (Decision Tree, Random Forest, Gradient Boosting, Extra Trees, AdaBoost, and XGBoost) on two-lane mountain roads in Yunnan Province, China. Additionally, we assessed the ability of these models to uncover underlying causal relationships, particularly how accident causes affect severity. Using the SHapley Additive exPlanations (SHAP) method, we interpreted the influence of risk factors in the machine learning models. Our findings indicate that machine learning models, especially XGBoost, outperform statistical models in predicting accident severity. The results highlight that accident patterns are the most significant determinants of severity, followed by road-related factors and the type of colliding vehicles. Environmental factors like weather, however, have minimal impact. Notably, vehicle falling, head-on collisions, and longitudinal slope sections are linked to more severe accidents, while minor accidents are more frequent on horizontal curve sections and areas that combine curves and slopes. These insights can help traffic management agencies develop targeted measures to reduce accident rates and enhance road safety, which is critical for promoting sustainable transportation in mountainous regions. Full article

This study aims to enhance the navigation capabilities of autonomous tractors by predicting the surface type they are traversing using data collected from BNO055 Inertial Measurement Units (IMU sensors). IMU sensor data were collected from a small mobile robot driven over seven different floor surfaces within a university environment, including tile, carpet, grass, gravel, asphalt, concrete, and sand. Several machine learning models, including Logistic Regression, K-Neighbors, SVC, Decision Tree, Random Forest, Gradient Boosting, AdaBoost, and XGBoost, were trained and evaluated to predict the surface type based on the sensor data. The results indicate that Random Forest and XGBoost achieved the highest accuracy, with scores of 98.5% and 98.7% in K-Fold Cross-Validation, respectively, and 98.8% and 98.6% in an 80/20 Random State split. These findings demonstrate that ensemble methods are highly effective for this classification task. Accurately identifying surface types can prevent operational errors and improve the overall efficiency of autonomous systems. Integrating these models into autonomous tractor systems can significantly enhance adaptability and reliability across various terrains, ensuring safer and more efficient operations. Full article