Search

In this paper, a scalable end-to-end tree boosting system called XGBoost has been applied for predicting the magnitude of an earthquake from the early part of earthquake waveform data. This model uses the features extracted from the early P wave phase of the records as an input. The model's effectiveness has been verified by using data on earthquakes occurring in the Eurasian plate of Japan Islands from 1996 to 2021. Feature engineering has given 29 new features identified from the early P wave phase of the record, which show a high correlation with the magnitude of an earthquake. The comparison of predicted and actual magnitude shows that a trained XGboost model, which uses a single input record for magnitude prediction, gives an average prediction error of 0.004 ± 0.57 for earthquakes in the test dataset. In contrast, the average prediction error of –1.1 ± 0.80 and –0.65 ± 0.69 has been obtained for the magnitude estimated from conventional τc and Pd methods using the same test dataset. It is further seen that the average predicted magnitude of a single earthquake of magnitude 4.5 and 6.1 (MJMA) obtained by using multiple nearfield records using XGBoost model is 4.58 ± 0.33 and 6.32 ± 0.29, which is close to the actual magnitude of the earthquake. The results presented in this paper clearly show that the structured data can be effectively used by complex machine learning or deep learning models to predict earthquake magnitude from single or multiple records. [ABSTRACT FROM AUTHOR]

Forecasting of load is essential for operating power systems. India recently witnessed one of the worst power crisis with the highest ever power demand of 207 GW on April 29, 2022. The demand in the month of May and June 2022 was estimated to reach 215 GW. The peak demand this year 2023, according to the electricity ministry, is predicted to be around 230 GW from April to June. The inability to meet certain fundamental issues as power can take a toll on any country's economy. Proper prediction helps in proper decision making and planning. The main objective of this paper is to predict day ahead electrical load demand for Assam. Statistical and Machine Learning Algorithms has been studied. The study has been carried out using real-time data for the years 2016, 2017 and 2018. The paper presents a detailed analysis of the different hyper parameters of the deep learning models and their effect is seen on the learning efficiency. A novel stacked forecasting model is proposed using neural networks as base learners and CatBoost as the meta-learner. The performance of the proposed model has been evaluated and compared with individual models in terms of training time and accuracy using different error metrics namely MAE, MSE, RMSE, MAPE and R2 score. A comparison of the proposed prediction model with the prediction models available in literature has been presented. The conclusion states that both the statistical and machine learning algorithms used in this study act as useful tools for daily load forecasting with considerable accuracy; yet machine learning algorithm outperforms the statistical methods. The entire work has been done in Google Colaboratory using Python as the programming language. [ABSTRACT FROM AUTHOR]

Modern data mining techniques using machine learning (ML) and deep learning (DL) algorithms have been shown to excel in the regression-based task of materials property prediction using various materials representations. In an attempt to improve the predictive performance of the deep neural network model, researchers have tried to add more layers as well as develop new architectural components to create sophisticated and deep neural network models that can aid in the training process and improve the predictive ability of the final model. However, usually, these modifications require a lot of computational resources, thereby further increasing the already large model training time, which is often not feasible, thereby limiting usage for most researchers. In this paper, we study and propose a deep neural network framework for regression-based problems comprising of fully connected layers that can work with any numerical vector-based materials representations as model input. We present a novel deep regression neural network, iBRNet, with branched skip connections and multiple schedulers, which can reduce the number of parameters used to construct the model, improve the accuracy, and decrease the training time of the predictive model. We perform the model training using composition-based numerical vectors representing the elemental fractions of the respective materials and compare their performance against other traditional ML and several known DL architectures. Using multiple datasets with varying data sizes for training and testing, We show that the proposed iBRNet models outperform the state-of-the-art ML and DL models for all data sizes. We also show that the branched structure and usage of multiple schedulers lead to fewer parameters and faster model training time with better convergence than other neural networks. Scientific contribution: The combination of multiple callback functions in deep neural networks minimizes training time and maximizes accuracy in a controlled computational environment with parametric constraints for the task of materials property prediction. [ABSTRACT FROM AUTHOR]

Gestational diabetes mellitus (GDM) is one of the pregnancy complications that poses a significant risk on mothers and babies as well. GDM usually diagnosed at 22–26 of gestation. However, the early prediction is desirable as it may contribute to decrease the risk. The continuous monitoring for mother's vital signs helps in predicting any deterioration during pregnancy. The originality of this paper is to provide comprehensive framework for pregnancy women monitoring. The proposed Data Replacement and Prediction Framework consists of three layers which are: (i) IoT Layer, (ii) Fog Layer, and (iii) Cloud Layer. The first layer used IOT sensors to aggregate vital sings from pregnancies using invasive and noninvasive sensors. Then the vital signs transmitted to fog nodes to processed and finally stored in the cloud layer. The main contribution in this paper is located in the fog layer producing GDM module to implement two influential tasks which are: (i) Data Finding Methodology (DFM), and (ii) Explainable Prediction Algorithm (EPM) using DNN. First, the DFM is used to replace the unused data to free the cache space for the new incoming data items. The cache replacement is very important in the case of healthcare system as the incoming vital signs are frequent and must be replaced continuously. Second, the EPM is used to predict the incidence of GDM that may occur in the second trimester of the pregnancy. To evaluate our model, we extract data of 16,354 pregnancy women from medical information mart for intensive care (MIMIC III) benchmark dataset. For each woman, vital signs, demographic data and laboratory tests was aggregated. The results of the prediction model superior the state of the art (ACC = 0.957, AUC = 0.942). Regarding to explainability, we utilized Shapley additive explanation framework to provide local and global explanation for the developed models. Overall, the proposed framework is medically intuitive, allow the early prediction of GDM with cost effective solution. [ABSTRACT FROM AUTHOR]

This paper proposes to predict traffic accidents based on IoTs and deep learning to address the current problem of inaccurate traffic accident prediction. Since traditional traffic accident prediction often applies classical prediction algorithms to a small portion of data, the obtained models can only predict a small range of traffic accidents. Most accident prediction models are limited by the lack of data features, do not consider the problems of practical application scenarios, and do not incorporate regional heterogeneity, so the prediction accuracy of accident prediction models is poor. This paper analyzes and summarizes the relationship between traffic accidents and influencing factors from five aspects, such as people, vehicles, roads and environment, and proves the influence of regional heterogeneity on accidents, which paves the way for traffic accident prediction. The data and heterogeneous spatial data are preprocessed and feature selected, respectively. Logistic regression and random forest algorithm are used to train the corresponding prediction models. The results show that the prediction model combined with regional heterogeneity has better comprehensive performance than the original data. [ABSTRACT FROM AUTHOR]

Hyperparameter optimization plays a significant role in the overall performance of machine learning algorithms. However, the computational cost of algorithm evaluation can be extremely high for complex algorithm or large dataset. In this paper, we propose a model-based reinforcement learning with experience variable and meta-learning optimization method to speed up the training process of hyperparameter optimization. Specifically, an RL agent is employed to select hyperparameters and treat the k-fold cross-validation result as a reward signal to update the agent. To guide the agent's policy update, we design an embedding representation called "experience variable" and dynamically update it during the training process. Besides, we employ a predictive model to predict the performance of machine learning algorithm with the selected hyperparameters and limit the model rollout in short horizon to reduce the impact of the inaccuracy of the model. Finally, we use the meta-learning technique to pre-train the model for fast adapting to a new task. To prove the advantages of our method, we conduct experiments on 25 real HPO tasks and the experimental results show that with the limited computational resources, the proposed method outperforms the state-of-the-art Bayesian methods and evolution method. [ABSTRACT FROM AUTHOR]

In today's online market, recommendation systems have become universal and are an aspect of any online shopping portal. The traditional approach uses the subscriber's historical knowledge, and this technique is not adequate for resolving problems with a cold start. These issues include recommendations for non-registered users or newly added customers and new items added. Session-based recommendations based on recurrent neural networks are gaining popularity for product recommendations. This is due to recurrent neural networks' ability to record sequential feature data more effectively throughout the current session, which results in more similarity between consumer behaviour sequences. Nevertheless, most state-of-the-art recurring neural networking systems completely ignore the long-term details of multiple sessions and concentrate solely on short-term communication in a single session. This paper presents a hybrid time-centric prediction model to address research issues that learn the customers' short and long-term behaviours. Experiments on the recsys challenge data set are carried out to assess the efficiency of the hybrid time-centric prediction models over the existing hybrid models in terms of HitRate and Mean-Reciprocal Rate. [ABSTRACT FROM AUTHOR]

As the world population continues to age, chronic diseases are on the rise. One of these diseases is stroke, which is a dangerous disease that can lead to many social and economic difficulties. Strokes can cause persistent neurological sequelae and physical disabilities; in some cases, motor function of the upper or lower body may be impaired, resulting in abnormal walking patterns or a loss of walking ability. These differences can be captured through walking patterns and gait information. There is therefore a need for research examining systems that can quickly detect signs of stroke based on human biosignals collected during daily life, such as motor function and the walking speed of the upper and lower limbs. By accurately predicting the early symptoms of stroke diseases, neural damage can be reduced with timely visits to medical institutions for treatment. In this paper, we designed and implemented a new AI-based system using real-time motion data for predicting stroke in the elderly. Initial data were collected from elderly Koreans while walking with attached wearable sensors. The sensors were placed on both shoulders and quadriceps. The data were processed, and we obtained a total of 12 motion attributes (angles and acceleration information). Predictive models using machine learning and deep learning algorithms were then constructed. The performance of the proposed system was verified with high prediction accuracies of 98.25% for the C4.5 decision tree model, 98.72% for RandomForest, 96.60% for XGBoost, and 98.99% for long short-term memory (LSTM). Hence, this paper provides a method for quickly and accurately predicting the early onset of stroke based on motion attribute values obtained while walking. [ABSTRACT FROM AUTHOR]

The design of a security scheme for beamforming prediction is critical for next-generation wireless networks (5G, 6G, and beyond). However, there is no consensus about protecting beamforming prediction using deep learning algorithms in these networks. This paper presents the security vulnerabilities in deep learning for beamforming prediction using deep neural networks in 6G wireless networks, which treats the beamforming prediction as a multi-output regression problem. It is indicated that the initial DNN model is vulnerable to adversarial attacks, such as Fast Gradient Sign Method , Basic Iterative Method , Projected Gradient Descent , and Momentum Iterative Method , because the initial DNN model is sensitive to the perturbations of the adversarial samples of the training data. This study offers two mitigation methods, such as adversarial training and defensive distillation, for adversarial attacks against artificial intelligence-based models used in the millimeter-wave (mmWave) beamforming prediction. Furthermore, the proposed scheme can be used in situations where the data are corrupted due to the adversarial examples in the training data. Experimental results show that the proposed methods defend the DNN models against adversarial attacks in next-generation wireless networks. [ABSTRACT FROM AUTHOR]

Online social media (OSM) is an integral part of human life these days. Significantly, the young generation spends most of their time on social media in an active and passive state. The exponential growth of OSM has created an atmosphere of increased cybercrime. Although OSM provides a platform to connect people with similar thoughts and interests, it also exposes vulnerable users to mischievous elements in cyberspace. Social media connects and generates a massive amount of human activity-related data. However, the misuse of OSM introduces a novel way of expressing aggression and violence that exclusively happens online. In this research paper, we briefly discuss the background of Cyberbullying and the various machine and deep learning-based models incorporated to deal with it effectively. We also highlight the main challenges in designing a cyberbullying prediction model and address them. [ABSTRACT FROM AUTHOR]

An adversary can use SSH communication as a route for information leakage or hacking. Many studies have focused on TCP header analysis to detect encrypted communication. However, SSH detection using TCP header analysis is limited when changing TCP port information or modifying components of the SSH protocol. Various machine-learning (ML) techniques have been introduced to enhance network traffic classification by analyzing TCP headers. Most ML-based traffic classification research has analyzed network packet flows. However, because of the complex structures and the various implementations of the TCP protocol, a lot of time and resources are required for the recombination of network packet flows. This paper presents a novel contribution to overcome the problems of network packet analysis that employs web proxy session logs, which do not require the recombination of packets to prepare a dataset for analysis. Moreover, we propose a hybrid predictive model that is useful for web proxy session log analysis. In the modeling process, we collected the web proxy logs from an actual network of ICT companies (more than 10,000 employees, Seoul, South Korea) and used the random forest and decision tree algorithms for the supervised learning. The detection rate (DR) for the training dataset was 99.9%, which is similar to or higher than that of other studies using ML and deep learning. Using the dataset of DARPA99, we proved that the DR and FPR for our proposed model were better than those achieved by Alshammari et al.'s model. We expect that the proposed predictive model can be used to block illegal attempts at SSH communication over HTTP CONNECT by changing the destination port and to detect novel illegal communication protocols. [ABSTRACT FROM AUTHOR]

Predicting human visual attention cannot only increase our understanding of the underlying biological mechanisms, but also bring new insights for other computer vision-related tasks such as autonomous driving and human–computer interaction. Current deep learning-based methods often place emphasis on high-level semantic feature for prediction. However, high-level semantic feature lacks fine-scale spatial information. Ideally, a saliency prediction model should include both spatial and semantic features. In this paper, we propose a multi-scale attention gated network (we refer to as MSAGNet) to fuse semantic features with different spatial resolutions for visual saliency prediction. Specifically, we adopt the high-resolution net (HRNet) as the backbone to extract the multi-scales semantic features. A multi-scale attention gating module is designed to adaptively fuse these multi-scale features in a hierarchical way. Different from the conventional way of feature concatenation from multiple layers or multi-scale inputs, this module calculates a spatial attention map from high-level semantic feature and then fuses it with the low-level spatial feature through gating operation. Through the hierarchical gating fusion, final saliency prediction is achieved at the finest scale. Extensive experimental analyses on three benchmark datasets demonstrate the superior performance of the proposed method. [ABSTRACT FROM AUTHOR]

In the past decades, the incidence rate of cancer has steadily risen. Although advances in early and accurate detection have increased cancer survival chances, these patients must cope with physical and psychological sequelae. The lack of personalized support and assistance after discharge may lead to a rapid diminution of their physical abilities, cognitive impairment, and reduced quality of life. This paper proposes a personalized support system for cancer survivors based on a cohort and trajectory analysis (CTA) module integrated within an agent-based personalized chatbot named EREBOTS. The CTA module relies on survival estimation models, machine learning, and deep learning techniques. It provides clinicians with supporting evidence for choosing a personalized treatment, while allowing patients to benefit from tailored suggestions adapted to their conditions and trajectories. The development of the CTA within the EREBOTS framework enables to effectively evaluate the significance of prognostic variables, detect patient's high-risk markers, and support treatment decisions. [ABSTRACT FROM AUTHOR]

The evolution in science and innovation has to lead to an immense volume of information from various agricultural fields to be accumulated in the public domain. As a result, an objective arises from the investigation of the accessible information and incorporating them with processes like foreseeing crop yield, plant diseases examination, crops enhancement, etc. Machine learning has grown with tremendous processing methods to conceive new innovations in the multi-disciplinary agricultural sector. In experimenting with machine learning models, there exist certain limitations like improvident nonlinear mapping between the raw data and crop yield values. Hence, deep learning models are comprehensively used to extricate critical crop parameters for prediction. Foreseeing the crop yield depending on climate, soil and water parameters has been a potential research subject. This paper proposes a hybrid deep learning-based crop yield prediction system using deep belief network (DBN) and fuzzy neural networks system (FNN). DBN is a combination of statistics and probability with neural networks. Though DBN performs better for nonlinear systems, the algorithm alone cannot provide satisfactory results in terms of robustness, model accuracy and learning speed, which is predominantly due to gradient diffusion. Hence, a DBN along with FNN has been proposed to overcome the nonlinearity and gradient diffusion problems. The proposed model initially performs an efficient pre-training technique by DBN for enhanced model development and feature vector generation. This characteristic feature vector is fed as an input to the FNN for further processing. The superiority of the proposed fuzzy neural network-based deep belief network is analyzed by comparing it with other deep learning algorithms. The proposed model efficiently predicts the results outperforming the other models by preserving the original data distribution with an accuracy of 92%. [ABSTRACT FROM AUTHOR]

Deep learning provides a variety of neural network-based models, known as deep neural networks (DNNs), which are being successfully used in several domains to build highly accurate predictors. A key factor which usually makes DNNs to outperform traditional machine learning models is the amount of data that is nowadays accessible and available. Nevertheless, there are other factors linked to DNNs topologies that may also have influence on the predictive performance of DNN models. In particular, fully connected deep neural networks (fc-DNNs) typically struggle in achieving good performance rates when applied to small datasets. This is due to the high number of parameters which need to be learned when training this kind of models, which makes them prone to over-fitting issues. In this paper, authors propose the use of problem-specific information in order to impose constraints to network architecture so that a fc-DNN is transformed into a partially connected DNN (pc-DNN), in such a way that network topology is driven by prior knowledge. This work compares two baseline models, the elastic net and fc-DNNs, to pc-DNNs applied on three synthetic datasets with different number of samples. Synthetic data was generated to estimate the goodness of using problem-specific information to drive network architectures. Furthermore, a similar analysis is performed herein on a real-world problem dataset to show the benefits of pc-DNN models in term of predictive performance. The results of the analysis showed that pc-DNNs with built-in problem-specific information clearly outperformed the elastic net and fc-DNNs in most of the datasets used, in either synthetic or real-world problems. The pc-DNNs turned out to be a useful model, especially when it is applied to small- or medium-size datasets, on which it significantly outperformed the baseline models considered in this study. Specifically, the pc-DNNs achieved AUC and MSE improvement rates of ( 8.21 % , 19.79 % ) and ( 6.65 % , 20.54 % ) in small- and medium-size datasets for both case studies analyzed, the synthetic and real-world problem, respectively. [ABSTRACT FROM AUTHOR]

The application of machine learning (ML) techniques in materials science has attracted significant attention in recent years, due to their impressive ability to efficiently extract data-driven linkages from various input materials representations to their output properties. While the application of traditional ML techniques has become quite ubiquitous, there have been limited applications of more advanced deep learning (DL) techniques, primarily because big materials datasets are relatively rare. Given the demonstrated potential and advantages of DL and the increasing availability of big materials datasets, it is attractive to go for deeper neural networks in a bid to boost model performance, but in reality, it leads to performance degradation due to the vanishing gradient problem. In this paper, we address the question of how to enable deeper learning for cases where big materials data is available. Here, we present a general deep learning framework based on Individual Residual learning (IRNet) composed of very deep neural networks that can work with any vector-based materials representation as input to build accurate property prediction models. We find that the proposed IRNet models can not only successfully alleviate the vanishing gradient problem and enable deeper learning, but also lead to significantly (up to 47%) better model accuracy as compared to plain deep neural networks and traditional ML techniques for a given input materials representation in the presence of big data. [ABSTRACT FROM AUTHOR]

Developments in deep learning for time-series problems have shown promising results for data prediction. Particulate Matter equal or smaller than 10 μm (PM10) have increased importance in the research field due to the negative impact in the respiratory system. PM10 particles show non-linear behavior, hence it is not an easy task to implement techniques to predict subsequent concentration of the particles in the atmosphere. This paper presents a forecasting model using gated Recurrent unit (GRU) and Long-Short Term Memory (LSTM) networks, which are types of a deep recurrent neural network (RNN). The predicted results of PM10 are presented using data of Mexico City as a case study, showing that this type of deep network is feasible for predicting the non-linearities of this type of data. Several experiments were carried out for 12, 24, 48, and 120 h prediction, showing that this method may be applied to accurately forecast the behavior of PM10. [ABSTRACT FROM AUTHOR]

Predicting optimal remanufacturing time is a key point for improving the quality performance and economic effectiveness of multi-life cycle of remanufactured equipment, and knowing the manufacturing cost is a critical point for accurate prediction of optimal remanufacturing time. On the basis of understanding equipment multi-life cycle and cost composition, this paper investigated the correlation between optimal remanufacturing time and remanufacturing cost. Due to the randomness and nondeterminacy of remanufacturing cost, the limitation of available data sample, the insufficiency of shallow learning algorithm, we proposed deep belief networks (DBN) prediction model to improve the prediction accuracy of optimal remanufacturing time. In such model, the planning cost, disposal service cost, remanent value, annual cost increment, parts remanufacturing ratio, parts replacement ratio and technical indexes were adopted as inputs, while optimal remanufacturing time was regarded as output. The proposed algorithm can automatically extract more abstract and more expressive characteristics from sample, thus realizing complex nonlinear mapping between input and output data. In this research, DBN algorithm was used to estimate the training samples and test samples of mechanical transmission, and the predicting error of DBN algorithm was only 27% of the BP training network. The results of our prediction experiments verified the feasibility and effectiveness of the proposed model algorithm method. [ABSTRACT FROM AUTHOR]