Search

Image defect detection of casting parts is a key part of the production process in the machinery manufacturing industry. The traditional methods are ineffective because traditional computer image processing methods require a large number of manual features to be set artificially, and the detection time is too long. In order to save human resources and improve the efficiency of image defect detection, this paper proposes a deep learning-based defect detection method for automobile parts. This paper selects EfficientNetB0 as the backbone framework of the target detection network, which significantly reduces the memory usage of the model and shortens the model inference time, while improving the model detection accuracy. Facing the problem of small samples of defect image dataset, we analyze the image characteristics of the dataset and introduce shape transformation and scale scaling as the basic online data enhancement method according to the industrial field image projection law. Then, it is expected to combine the traditional image processing algorithms according to the characteristics of casting parts with different depth distribution and multiple morphological changes, and develop a special image defect data enhancement method. This further improves the performance of the model and increases the detection accuracy of the algorithm by 22.3% without increasing the data. [ABSTRACT FROM AUTHOR]

In recent years, deep learning has revolutionized natural language processing (NLP) by enabling the development of models that can learn complex representations of language data, leading to significant improvements in performance across a wide range of NLP tasks. Deep learning models for NLP typically use large amounts of data to train deep neural networks, allowing them to learn the patterns and relationships in language data. This is in contrast to traditional NLP approaches, which rely on hand-engineered features and rules to perform NLP tasks. The ability of deep neural networks to learn hierarchical representations of language data, handle variable-length input sequences, and perform well on large datasets makes them well-suited for NLP applications. Driven by the exponential growth of textual data and the increasing demand for condensed, coherent, and informative summaries, text summarization has been a critical research area in the field of NLP. Applying deep learning to text summarization refers to the use of deep neural networks to perform text summarization tasks. In this survey, we begin with a review of fashionable text summarization tasks in recent years, including extractive, abstractive, multi-document, and so on. Next, we discuss most deep learning-based models and their experimental results on these tasks. The paper also covers datasets and data representation for summarization tasks. Finally, we delve into the opportunities and challenges associated with summarization tasks and their corresponding methodologies, aiming to inspire future research efforts to advance the field further. A goal of our survey is to explain how these methods differ in their requirements as understanding them is essential for choosing a technique suited for a specific setting. This survey aims to provide a comprehensive review of existing techniques, evaluation methodologies, and practical applications of automatic text summarization. [ABSTRACT FROM AUTHOR]

Cervical cancer (CC) has become one of the serious and deadly diseases in women around the world. Predicting a CC is at risk because testing is not possible at the early stage. Doctors predict the types of cancer by collecting cervical cells and by intervening in person. This approach affects the level of prediction due to human negligence, high cost, and is time consuming. In this paper, we propose the automatic cancer classification using deep neural network to overcome this problem. The proposed work has four stages namely, pre-processing, outlier elimination, dimensionality reduction, and classification. Initially, the missing test data should be removed. Second, the inconsistent data are eliminated based on identical values. Third, principal component analysis (PCA) is used to overcome the limitations caused by high-volume data. Finally, enter the reduced size database in the proposed neural network (DNN) classifier and classify the input data as normal or abnormal. We implement the suggested method using Python and we inspect the performance in terms of different metrics. [ABSTRACT FROM AUTHOR]

In this paper, an example of an intelligent security system based on deep learning approach has been analyzed and described. Security is an important element in many aspects of human life. Depending on customer requirements, different levels of security may be required and implemented. Nowadays, artificial intelligence is becoming an indispensable part in many areas of human life and accordingly security systems are also based on the new achievements in this field. In this paper, an intelligent security system based on two methods for identifying persons, gait recognition and face recognition, was described. The two methods mentioned above can be used to give persons access to different buildings, facilities, institutions, etc. or to different indoor or outdoor areas. In light of the above, the aforementioned system uses face and gait recognition to identify persons who should be granted access to a facility or a specific area within the facility. Accordingly, two deep learning models for gait and face recognition have been developed and described. The analysis, the settings defined and the results obtained in relation to the models developed were also described. [ABSTRACT FROM AUTHOR]

A novel ensemble machine learning approach for predicting energy consumption in smart appliances is presented in this paper. The main objective is minimizing the number of necessary sensors and improving the prediction accuracy at the same time. The proposed method combines the Fuzzy C-Means method with a multi-stream deep neural network to achieve this goal. The method focuses on prediction accuracy and aims to extract the minimum number of essential features from the dataset corresponding to the required sensors. These selected features are then scatter-reduced and homogenized into subsets. Each subset is used to train a cluster-specific deep neural network designed exclusively for that subset. The final prediction is obtained by computing the fuzzy-weighted sum of these cluster-specific network outputs. Numerical results show that the proposed prediction method outperforms conventional methods in terms of root mean square error and mean absolute percentage error criteria, despite using fewer sensors. This improvement can be attributed to the reduced dataset scatter, which improves the learning speed and model performance. Furthermore, the fuzzy combination of the outputs improves the final prediction accuracy. Overall, the proposed approach provides a more cost-effective and accurate solution for predicting the energy consumed by smart appliances. [ABSTRACT FROM AUTHOR]

In this paper, we analyzed the deep neural network (DNN) model and proposed a DNN-based method to build the training model for professional farmers. This paper aims to construct the vocational farmer cultivation model and seek a better path for transforming farmers into new experienced farmers by analyzing each training body involved in the cultivation of vocational farmers and studying their respective problems and reasons. The conceptual and logical structures of the system database were designed, and MySQL was selected for database implementation to complete the information of professional farmers. The system network topology and logical architecture are created, and the functions of view, control, business logic and data access layers are divided. This paper combines the DNN with the vocational farmer training enhancement decision tree. The experimental results of this model are most intuitive and accurate. This paper reconstructs the neural network model using the global average pooling layer to better model the vocational farmer training model to replace the fully connected layer in the original convolutional neural network. At the same time, to make the network model produce a lower probability of overfitting, a dropout layer is added to the layer after the fully connected layer to improve the efficiency of the neural network further to enhance vocational farmer training. The experimental content of this paper provides a new research direction for the estimation of vocational farmer cultivation. The above modeling is used to improve the vocational farmer cultivation model and accelerate the process of vocational farmer cultivation. [ABSTRACT FROM AUTHOR]

This paper plans to implement a novel detection model of maliciously encrypted internet protocol network flow using the deep structured concept. The major processing levels are (i) data collection, (ii) feature extraction, (iii) optimal feature selection, and (iv) detection. In the beginning, the standard dataset is taken from online databases. The deep convolutional neural network (DCNN) is introduced for the deep feature extraction process. The accurate features are chosen by the crossover decision-based krill herd algorithm (CD-KHA) which helps to minimize the training complexity of the deep structured architecture. These selected features are given to the hybridized deep learning with long short-term memory (LSTM) and deep neural network (DNN). Here, the structural design of the model is improved by the same CD-KHA. Through the comparison and analysis, the accuracy rate of the offered method shows higher performance than the other baseline approaches. [ABSTRACT FROM AUTHOR]

Mobile edge computing (MEC) is one of the efficient technologies to provide satisfying quality of experience (QoE) for emerging computation-intensive applications in internet of things (IoT). However, some new challenges will be encountered when MEC is applied in a large-scale IoT with massive access devices or heavy traffic loads such as load balancing and traffic offloading. Aiming at the solution of these problems, this paper proposes a learning-based traffic control architecture for IoT with MEC. Moreover, a deep-learning-based load balancing framework is developed to control user association in IoT. The user association is determined at each IoT access points (IAP) by the deep neural network (DNN), which is the duplication of the well-trained DNN with the global network information. In addition, we propose a reinforcement-learning-based partial traffic offloading scheme to reduce the traffic origination. The IoT devices are able to independently decide its offloading radio according to the channel quality information, service requirement, and workload of the IAP. Simulation results indicate that the proposed deep-learning-based load balancing scheme is able to achieve uniform traffic distribution, and meanwhile our partial offloading policy can significantly reduce the network traffic. [ABSTRACT FROM AUTHOR]

This paper addresses radiologists' specific diagnosis of cancer disease effectively using integrated framework of deep learning model. Although several existing diagnosis systems have been adopted by a physician, in few cases, it is not so practical to see the infected area from images in the normal eye. Thus, a fully integrated diagnosis framework for disease detection is proposed to find out the infected area from image using deep learning approaches in this paper. In this proposed framework, various components are designed through deep learning approaches such as detection, segmentation, classification etc. based on mass region. The classification technique is used to classify the disease as either benign or malignant. The vital part of this framework is developed by using a full resolution convolutional network (FrCN) that supports different stages of image processing, especially breast cancer disease. Different experimental evaluation is taken to perform on the accuracy, cross-validation tests, and the comparative testing. Since we have taken 4-fold evaluation, the FrCN performs with an average 98.7% Dice index, 97.8% TS/CSI coefficient, 99.1% overall accuracy, and 98.15% MCC. Our experiments demonstrated that the proposed diagnosis system performs on the deep learning approaches at each segmentation stage and classification with good results. [ABSTRACT FROM AUTHOR]

With the growth in services supplied over the internet, network infrastructure has become more exposed to cyber-attacks, particularly Distributed Denial of Service (DDoS) attacks, which can easily cause the disruption of services. The key factor for fighting against these attacks is the earlier separation and detection of the traffic in networks. In this paper, a novel approach, named Half Autoencoder-Stacked DNNs (HAE-SDNN) model, is proposed. We suggest using a Stacked Deep Neural Networks (SDNN) model. as a deep learning model, in order to detect DDoS attacks. Our approach allows feature selection from a preprocessed dataset using a Half AutoEncoder (HAE), resulting in a final set of important features. These features are subsequently used to train the DNNs that are stacked together by applying Softmax layer to combine their outputs. Experiments were performed on a benchmark cybersecurity dataset, named CICDDoS2017, containing various DDoS attack types. The experimental results demonstrate that the introduced model attained an overall accuracy rate of 99.95%. Moreover, the HAE-SDNN model outperformed existing models, highlighting its superiority in accurately classifying attacks. [ABSTRACT FROM AUTHOR]

Financial fraud detection has been an urgent technical demand in cyberspace. It highly relies on clear extraction and deep representation toward complex relationships inside financial social networks. As consequence, this study combines both knowledge graph and deep learning to deal with such issue. Thus, an intelligent financial fraud detection model based on knowledge graph guidance and deep neural network is proposed in this paper. First, a new knowledge graph based on financially related systems is constructed, which includes multiple entities and relationships. Then, an adversarial learning-based neural network structure is formulated to extract financial attributes. Finally, the detection results can be output according to the extracted factors. Empirically, the proposal is implemented on a real-world dataset for performance evaluation. The experimental results show that it has higher accuracy and effectiveness compared to traditional fraud detection methods. The proposed detection model can not only identify known fraudulent behaviors, but also predict potential fraud patterns based on consumer habits, thereby improving the security and reliability of financial transactions. It can also update the knowledge graph in real-time, enabling it to cope with emerging fraud methods and variants. [ABSTRACT FROM AUTHOR]

In this paper, we explore the rich dynamics in the Chen system using Runge–Kutta method and Deep Neural Networks (DNNs). Compared with the Lorenz system, we find that the first return map P of the Chen system exhibits a more complex structure of continuous regions in the Poincaré section. Moreover, the existence of six crossing blocks with respect to the second return map implies that there is a closed invariant set Λ in the Poincaré section such that P 2 | Λ is semi-conjugate to a 6-shift map, thus demonstrating remarkably chaos in the Chen system. [ABSTRACT FROM AUTHOR]

Picture highlights can be separated in different ways based on the shape highlights, shading highlights and surface highlights. There is a wide requirement for fragmenting objects in complex circumstances and recognizable proof of the articles. It has become mind-boggling because of the changeability of articles and the foundation. This paper targets planning a mixture approach called Enhanced Fractal Texture Analysis with Layout Descriptor by breaking down different element extraction and item acknowledgment methods. In this interaction, at first, the Adaptive Switching Median Filter pre-processes the picture. This is accomplished by eliminating commotion that is available in the picture without losing the fine characteristics. Other than the commotion decrease, safeguard edges are tended to a clamour-secured edge identifier. Afterward, in the morphological inclination method, which is the mix of shape and surface slope expulsion is applied for acquiring the characteristics of the picture. This methodology upholds further developing exactness expectations for the item. This planning strategy extricates shape included from the principal stage yield. Different subtleties like smallness, unpredictability and second invariants can be obtained in the methodology. The crossover approach diminishes the execution time when contrasted with the existing methods. This plan is powerful and creates better qualities as far as execution assessment. The term 'coronary sickness' suggests that square veins may provoke the conditions like cardiovascular disappointment, chest torture or stroke. The heart conditions will affect the heart's muscle, valves, brain (cerebral aneurysm) or musicality inciting the heart pollution and sidestepping activity or coronary mediation which is utilized for settling these issues. In this examination work, a sensible cluster-based deep neural network (DNN) approach is proposed to recognize the angiographic coronary sickness (for instance to perceive the patients with half expansiveness abatement of a huge coronary vein). The educational assortment is collected using K-means clustering estimation and a while later the coronary sickness is expected using bunch based significant learning approach. The proposed method is differentiated and has various limits for classifier estimations like DNN, SVM-linear, SVM-polynomial, KNN, ELM, ELM-pack, and to show the system reasonability to the extent precision. [ABSTRACT FROM AUTHOR]

The price of carbon emission rights in the market fluctuates greatly due to various factors from economy, finance, and climate. For an enterprise that needs to conduct carbon trading activities, it is extremely necessary to fully grasp the price of carbon trading in the future period. Thus in this paper, a deep neural network-based assistive decision model for financial risk prediction in carbon trading market is proposed for this purpose. Specifically, the dynamic risk spillover effects of domestic and international carbon trading markets are studied, and a frontier time-varying model is utilized to measure the risk spillover effects. Then, the deep neural network is used for quantitative research and to construct an intelligent decision scheme that outputs financial risk prediction results. Four perspectives, energy price, climate environment, carbon market price, and macroeconomics, are selected as the input to analyze the influence factors of carbon emission rights price. Finally, several linear regression models are adopted as the baseline methods for comparison, and experimental results show that the proposed method can achieve better prediction performance compared with baseline methods. [ABSTRACT FROM AUTHOR]

Forecasting traffic congestion has become an important issue than ever before. Information provided by traffic congestion prediction methods becomes helpful to traffic management agencies to take suitable actions in due time. On the other hand, with prior information, passengers can plan their trip routes accordingly. In this paper, we tackle the problem of mixed traffic congestion prediction and develop a new Bi-State Prediction Network (BiSPNet). Two heads form BiSPNet. Each head information passed through the layers of three-dimensional convolution (Conv3D), two-dimensional convolutional long short-term memory (ConvLSTM2D), and two-dimensional convolution (Conv2D). Then the dense layer merges both head outputs. These layers capacitate the model to capture the characteristics of multiple inputs. The proposed model is validated by the ground truth data collected by the video cameras installed on the roadways in Delhi, India. Experimental results confirm that the prediction accuracy of the BiSPNet model surpasses that of several state-of-the-art benchmark models. In particular, the BiSPNet reduces mean absolute error by 53.23%, 40.95%, and 0.38%, respectively, in congestion score prediction for 5, 10, and 15-min time horizons compared to the mixed deep learning network (MDLNet). The source data and code can be accessed on GitHub at the following link: https://github.com/amanojup/. [ABSTRACT FROM AUTHOR]

Malware developers often employ code obfuscation techniques to conceal their malicious functionality, making it challenging to detect and analyze such software. While various de-obfuscation techniques exist, the majority of them require prior knowledge of the obfuscation tools and techniques in use. Identifying the specific obfuscation tools or algorithms applied to the obfuscated code is thus of vital importance, which, however, typically demands in-depth expert knowledge and substantial efforts. Therefore, this paper presents DeObA, a deep learning (DL) driven approach for the precise and efficient detection of obfuscation algorithms on the fine-grained function-level code snippets. To comprehensively capture unique patterns or features of different obfuscation algorithms from code, DeObA works on multiple distinct code views, encompassing token sequences, abstract syntax trees (AST) and program dependency graphs (PDG), which will reflect the code's lexical morphology, syntactic and structural aspects. After individually collecting obfuscation-indicative features with well-matched DL encoder from each code view, a self-attention-based fusion strategy is performed on these features to produce an integrated, dense, yet feature-rich vector. This vector is then fed into a softmax classification layer for prediction. Due to the lack of a moderately sized dataset, a large obfuscation corpus is curated with 7 different obfuscation tools and a total of 12 obfuscation algorithms on 39,070 C/C + + functions. The experimental evaluations conducted on the dataset exhibit a distinguished detection performance of DeObA, which achieve accuracy rates of 99.90% and 99.19% on the obfuscation tool detection and obfuscation algorithm detection tasks, respectively. The ablation study also confirms the active role of considering multiple distinct code views and the effectiveness of the designed self-attention-based fusion strategy. [ABSTRACT FROM AUTHOR]

Defocus blur detection aims at separating regions on focus from out-of-focus for image processing. With today's popularity of mobile phones with portrait mode, accurate defocus blur detection has received more and more attention. There are many challenges that we currently confront, such as blur boundaries of defocus regions, interference of messy backgrounds and identification of large flat regions. To address these issues, in this paper, we propose a new deep neural network with both global and local pathways for defocus blur detection. In global pathway, we locate the objects on focus by semantical search. In local pathway, we refine the predicted blur regions via multi-scale supervisions. In addition, the refined results in local pathway are fused with searching results in global pathway by a simple concatenation operation. The structure of our new network is developed in a feasible way and its function appears to be quite effective and efficient, which is suitable for the deployment on mobile devices. It takes about 0.2 s per image on a regular personal laptop. Experiments on both CUHK dataset and our newly proposed Defocus400 dataset show that our model outperforms existing state-of-the-art methods. [ABSTRACT FROM AUTHOR]

The usage of the Internet of Things (IoT) in the field of transportation appears to have immense potential. Intelligent vehicle systems can exchange seamless information to assist cars to ensure better traffic control and road safety. The dynamic topology of this network, connecting a large number of vehicles, makes it vulnerable to several threats like authentication, data integrity, confidentiality, etc. These threats jeopardize the safety of vehicles, riders, and the entire system. Researchers are developing several approaches to combat security threats in connected and autonomous vehicles. Artificial Intelligence is being used by both scientists and hackers for protecting and attacking the networks, respectively. Nevertheless, wirelessly coupled cars on the network are in constant peril. This motivated us to develop an intrusion detection model that can be run in low-end devices with low processing and memory capacity and can prevent security threats and protect the connected vehicle network. This research paper presents an Attention-enabled Hierarchical Deep Neural Network (AHDNN) as a solution to detect intrusion and ensure autonomous vehicles' security both at the nodes and at the network level. The proposed AHDNN framework has a very low false negative rate of 0.012 ensuring a very low rate of missing an intrusion in normal communication. This enables enhanced security in vehicular networks. [ABSTRACT FROM AUTHOR]

Deep Neural Networks (DNNs) have been successfully applied to investigations of numerical dynamics of finite-dimensional nonlinear systems such as ODEs instead of finding numerical solutions to ODEs via the traditional Runge–Kutta method and its variants. To show the advantages of DNNs, in this paper, we demonstrate that the DNNs are more efficient in finding topological horseshoes in chaotic dynamical systems. [ABSTRACT FROM AUTHOR]

To improve the recognition ability of clinical named entity recognition (CNER) in a limited number of Chinese electronic medical records, it provides meaningful support for clinical advanced knowledge extraction. In this paper, using CCKS2019 Chinese electronic medical record as an experimental data source, a fusion model enhanced by knowledge graph (KG) is proposed, and the model is applied to specific Chinese CNER tasks. This study consists of three main parts: single-mode model construction and comparison experiment, KG enhancement experiment, and model fusion experiment. The model has achieved good performance in CNER from the results. The accuracy rate, recall rate, and F1 value are 83.825%, 84.705%, and 84.263%, respectively, which is the global optimal, which proves the effectiveness of the model. This provides a good help for further research of medical information. [ABSTRACT FROM AUTHOR]

Catastrophic forgetting is a well-known characteristic of diverse parameterized supervised learning models. Artificial Neural Networks (ANN) face severe catastrophic forgetting or catastrophic interference in the sequential learning of information that is intolerable to both engineering applications and the human memory model. This problem can be solved through the machine learning community. The main intent of this paper is to implement a novel continuous learning model that could overcome the problem of catastrophic forgetting. The stream data from diverse benchmark sources are used for experimenting. The proposed model adopts the Deep Neural Network (DNN) with testing weight updates. When new data are given, the hybrid meta-heuristic algorithm helps to update the weight that manages to prevent the learning from catastrophic forgetting. The weight update strategy for solving the catastrophic forgetting is done by the hybridization of Shark Smell Optimization (SSO) and Jaya Algorithm (JA) that is named as Hybrid Shark Smell with Jaya Optimization (HSS-JO). A multi-objective function concerning the parameters associated with catastrophic forgetting like accuracy and remembering is used for framing the proposed continuous learning. The proof of the proposed model over conventional models on three publicly available datasets is given for final validation. From the analysis, in Table 3, the accuracy of the proposed HSS-JO-DNN is 38%, 0.5%, 0.55%, 0.14%, 0.98%, and 0.5% superior to DT, NB, KNN, SVM, NN, and RNN, respectively. For dataset 2, the FNR of the proposed HSS-JO-DNN is 90% superior to DT, 89% improved than NB, KNN, and NN, 94% improved than SVM, and 24% improved than RNN. Similarly, the proposed HSS-JO performance is higher in all the results. Thus, the proposed HSS-JO performs better than all the other traditional methods. [ABSTRACT FROM AUTHOR]

In the process of learning, learners will express their emotions through a variety of forms, facial expressions and voice are more obvious, which are most easily obtained through computers. In the previous methods, it is mainly based on a single modal, such as expression, speech, text and so on. Due to the diversity of information, the accuracy rate of multimodal recognition is higher than that of single modal recognition. Therefore, this paper proposed a DNN-based multimodal learning emotion analysis method which combines video and speech to detect students' learning emotion in real time. We use this method to automatically identify learning emotions in primary school English classroom. According to different learning emotions, the PAD emotion scale was used to correspond learning emotions with learning states. Teachers can judge students' learning state according to the change of students' learning emotions, so as to adjust teaching methods and strategies in time. [ABSTRACT FROM AUTHOR]

The optimization of the problems significantly improves the solution of the complex problems. The reduction in the feature dimensionality is enormously salient to reduce the redundant features and improve the system accuracy. In this paper, an amalgamation of different concepts is proposed to optimize the features and improve the system classification. The experiment is performed on the facial expression detection application by proposing the amalgamation of deep neural network models with the variants of the gravitational search algorithm. Facial expressions are the movement of the facial components such as lips, nose, eyes that are considered as the features to classify human emotions into different classes. The initial feature extraction is performed with the local binary pattern. The extracted feature set is optimized with the variants of gravitational search algorithm (GSA) as standard gravitational search algorithm (SGSA), binary gravitational search algorithm (BGSA) and fast discrete gravitational search algorithm (FDGSA). The deep neural network models of deep convolutional neural network (DCNN) and extended deep convolutional neural network (EDCNN) are employed for the classification of emotions from imagery datasets of JAFFE and KDEF. The fixed pose images of both the datasets are acquired and comparison based on average recognition accuracy is performed. The comparative analysis of the mentioned techniques and state-of-the-art techniques illustrates the superior recognition accuracy of the FDGSA with the EDCNN technique. [ABSTRACT FROM AUTHOR]

In this paper, an autonomous ensemble approach of improved quantum inspired gravitational search algorithm (IQI-GSA) and hybrid deep neural networks (HDNN) is proposed for the optimization of computational problems. The IQI-GSA is a combinational variant of gravitational search algorithm (GSA) and quantum computing (QC). The improved variant enhances the diversity of mass collection for retaining the stochastic attributes and handling the local trapping of mass agents. Further, the hybrid deep neural network encompasses the convolutional and recurrent neural networks (HDCR-NN) which analyze the relational & temporal dependencies among the different computational components for optimization. The proposed ensemble approach is evaluated for the application of facial expression recognition by experimentation on Karolinska Directed Emotional Faces (KDEF) and Japanese Female Facial Expression (JAFFE) datasets. The experimentation evaluations evidently exhibit the outperformed recognition rate of the proposed ensemble approach in comparison with state-of-the-art techniques. [ABSTRACT FROM AUTHOR]

In this paper, we prove that, in the deep limit, the stochastic gradient descent on a ResNet type deep neural network, where each layer shares the same weight matrix, converges to the stochastic gradient descent for a Neural ODE and that the corresponding value/loss functions converge. Our result gives, in the context of minimization by stochastic gradient descent, a theoretical foundation for considering Neural ODEs as the deep limit of ResNets. Our proof is based on certain decay estimates for associated Fokker–Planck equations. [ABSTRACT FROM AUTHOR]

The human emotion recognition based on facial expression has a significant meaning in the application of intelligent man–machine interaction. However, the human face images vary largely in real environments due to the complex backgrounds and luminance. To solve this problem, this paper proposes a robust face detection method based on skin color enhancement model and a facial expression recognition algorithm with block principal component analysis (PCA). First, the luminance range of human face image is broadened and the contrast ratio of skin color is strengthened by the homomorphic filter. Second, the skin color enhancement model is established using YCbCr color space components to locate the face area. Third, the feature based on differential horizontal integral projection is extracted from the face. Finally, the block PCA with deep neural network is used to accomplish the facial expression recognition. The experimental results indicate that in the case of weaker illumination and more complicated backgrounds, both the face detection and facial expression recognition can be achieved effectively by the proposed algorithm, meanwhile the mean recognition rate obtained by the facial expression recognition method is improved by 2.7% comparing with the traditional Local Binary Patterns (LBPs) method. [ABSTRACT FROM AUTHOR]

Visualization is primarily utilized as a training method to enhance athletic movement quality, increase concentration power, and minimize competition stress on the player while building firm confidence. Physical literacy (PL) provides a valuable lens for analyzing physical activity (PA) movement in more significant social and affective learning processes. This paper presents an Interactive Visualization positioning in physical education (IVPPE) to deal with the signal fluctuations and positioning techniques in visualizing Deep Neural Network (DNN). To ensure the success of their game, athletes are always looking for new ways to improve their health and performance. Using sensors to keep tabs on training and recovery has become more popular among athletes. Currently, sports teams are using sensors to track both the players' internal and external workloads. It illustrates the multilayer localizer (MLL) based on transfer learning to improve the positioning accuracy and physical literacy positioning model (PLPM) as a health determinant. A variety of data augmentation techniques are used to combat signal fluctuations. As a result, the combined effects of motivation-promoting physical activity-based visualization improve the accuracy ratio to 96.7%, prediction ratio to 96.2%, efficiency ratio to 96.8%, and reduce the error rate to 18.7%, stress level (52.8%) compared to other conventional models and have a positive impact on the localizer and positioning, making a difference in physical activity (PA) levels. [ABSTRACT FROM AUTHOR]

In recent technology, there is tremendous growth in computer applications that highlight human–computer interaction (HCI), such as augmented reality (AR), and Internet of Things (IoT). As a consequence, hand gesture recognition was highlighted as a very up-to-date research area in computer vision. The body language is a vital method to communicate between people, as well as emphasis on voice messages, or as a complete message on its own. Thus, automatic hand gestures recognition systems can be used to increase human–computer interaction. Therefore, many approaches for hand gesture recognition systems have been designed. However, most of these methods include hybrid processes such as image pre-processing, segmentation, and classification. This paper describes how to create hand gesture model easily and quickly with a well-tuned deep convolutional neural network. Experiments were performed using the Cambridge Hand Gesture data set for illustration of success and efficiency of the convolutional neural network. The accuracy was achieved as 96.66%, where sensitivity and specificity were found to be 85% and 98.12%, respectively, according to the average values obtained at the end of 20 times of operation. These results were compared with the existing works using the same dataset and it was found to have higher values than the hybrid methods. [ABSTRACT FROM AUTHOR]

The era of big data increases the number and scale of videos day by day, which brings challenges to video target detection. Improving the efficiency and speed of video target detection is of practical significance to image object detection and recognition. Deep learning has been a popular neural network with multilayer structure in recent years. By learning a deep nonlinear network structure, the generalization ability of complex classification problems is improved. In order to achieve higher processing efficiency and accuracy, this topic will study the latest achievements of machine learning method — deep learning — to realize target category detection. In the background extraction step, an improved meaning-based background extraction algorithm and an interest region extraction algorithm to reduce image pixels are proposed. The test results show that the proposed algorithm has good performance of video target detection [ABSTRACT FROM AUTHOR]

In this paper, a speech enhancement method using noise classification and Deep Neural Network (DNN) was proposed. Gaussian mixture model (GMM) was employed to determine the noise type in speech-absent frames. DNN was used to model the relationship between noisy observation and clean speech. Once the noise type was determined, the corresponding DNN model was applied to enhance the noisy speech. GMM was trained with mel-frequency cepstrum coefficients (MFCC) and the parameters were estimated with an iterative expectation-maximization (EM) algorithm. Noise type was updated by spectrum entropy-based voice activity detection (VAD). Experimental results demonstrate that the proposed method could achieve better objective speech quality and smaller distortion under stationary and non-stationary conditions. [ABSTRACT FROM AUTHOR]

Chronic kidney disease (CKD) is a health concern that affects people all over the world. Kidney dysfunction or impaired kidney functions are the causes of CKD. The machine learning-based prediction models are used to determine the risk level of CKD and assist healthcare practitioners in delaying and preventing the disease's progression. The researchers proposed many prediction models for determining the CKD risk level. Although these models performed well, their precision is limited since they do not handle missing values in the clinical dataset adequately. The missing values of a clinical dataset can degrade the training outcomes that leads to false predictions. Thus, imputing missing values increases the prediction model performance. This proposed work developed a novel imputation technique by combining Multiple Imputation by Chained Equations and K -Nearest Neighbors (MICE–KNN) for imputing the missing values. The experimental results show that MICE–KNN accurately predicts the missing values, and the Deep Neural Network (DNN) improves the prediction performance of the CKD model. Various metrics like mean absolute error, accuracy, specificity, Matthews correlation coefficient, the area under the curve, F 1 -score, sensitivity, and precision have been used to evaluate the proposed CKD model performance. The performance analysis exhibits that MICE–KNN with deep learning outperforms other classifiers. According to our experimental study, the MICE–KNN imputation algorithm with DNN is more appropriate for predicting the kidney disease. [ABSTRACT FROM AUTHOR]

Deep neural networks (DNNs) with ReLU activation function are proved to be able to express viscosity solutions of linear partial integrodifferential equations (PIDEs) on state spaces of possibly high dimension d. Admissible PIDEs comprise Kolmogorov equations for high-dimensional diffusion, advection, and for pure jump Lévy processes. We prove for such PIDEs arising from a class of jump-diffusions on ℝ d , that for any suitable measure μ d on ℝ d , there exist constants C , , > 0 such that for every ∈ (0 , 1 ] and for every d ∈ ℕ the DNN L 2 (μ d) -expression error of viscosity solutions of the PIDE is of size with DNN size bounded by C d − . In particular, the constant C > 0 is independent of d ∈ ℕ and of ∈ (0 , 1 ] and depends only on the coefficients in the PIDE and the measure used to quantify the error. This establishes that ReLU DNNs can break the curse of dimensionality (CoD for short) for viscosity solutions of linear, possibly degenerate PIDEs corresponding to suitable Markovian jump-diffusion processes. As a consequence of the employed techniques, we also obtain that expectations of a large class of path-dependent functionals of the underlying jump-diffusion processes can be expressed without the CoD. [ABSTRACT FROM AUTHOR]

Cyber-Physical System (CPS) is an integration of physical components like actuators, sensors and various types of equipment with the Internet possessing computational ability for efficient communication. A Heterogeneous Independent Network (HINT) is a realistic model that is used for the analysis of inter-dependability between the power grid and communications network. In the traditional Deep Q -Learning method, action needs to be stored in the Q table for the prediction. In real case studies, many state and action values affect the performance of the model. Existing Deep Q -Network (DQN) model generates all possible actions for the Q -values and this involves the generation of excessive information that causes the model to overfit. In this research, the Neural Network is applied to estimate the state–action in the DQN and to store the particular state–action value instead of storing all the state–action values as followed in the traditional method. The HINT model provides realistic failure propagation in the network and its state–action value overfits the existing DQN method due to the presence of more information. The proposed DQN with reinforcement learning stores selected state–action values in the Q tables and eliminates irrelevant information that helps to increase the accuracy and reduce the computational time. The DQN with reinforcement learning is applied to adaptively learn the system to select the optimal action in a continuous interaction with a stochastic environment. The proposed DQN model involves the application of reward function to store state–action value with higher probability based on prediction and eliminates other state–action values. Features such as intra-degree, inter-betweenness, substation-betweenness, relay-betweenness and feature vector are extracted and given as input to the DQN to characterize the critical nodes. The proposed DQN method is evaluated on the HINT network and synthetic network to analyze its efficiency in fault detection. The result shows that the HINT network has a lower prediction error compared to the existing Deep Neural Network (DNN) method. The proposed DQN and LSTM models have accuracies of 98% and 93% in fault prediction, respectively. [ABSTRACT FROM AUTHOR]

Automated sentiment analysis is becoming increasingly recognized due to the growing importance of social media and e-commerce platform review websites. Deep neural networks outperform traditional lexicon-based and machine learning methods by effectively exploiting contextual word embeddings to generate dense document representation. However, this representation model is not fully adequate to capture topical semantics and the sentiment polarity of words. To overcome these problems, a novel sentiment analysis model is proposed that utilizes richer document representations of word-emotion associations and topic models, which is the main computational novelty of this study. The sentiment analysis model integrates word embeddings with lexicon-based sentiment and emotion indicators, including negations and emoticons, and to further improve its performance, a topic modeling component is utilized together with a bag-of-words model based on a supervised term weighting scheme. The effectiveness of the proposed model is evaluated using large datasets of Amazon product reviews and hotel reviews. Experimental results prove that the proposed document representation is valid for the sentiment analysis of product and hotel reviews, irrespective of their class imbalance. The results also show that the proposed model improves on existing machine learning methods. [ABSTRACT FROM AUTHOR]

With many applications in high-energy physics, Deep Learning or Deep Neural Network (DNN) has become noticeable and practical in recent years. In this article, a new technique is presented for modeling the charged particles multiplicity distribution P n of Proton-Proton (P P) collisions using an efficient DNN model. The charged particles multiplicity n, the total center of mass energy s , and the pseudorapidity η used as input in DNN model and the desired output is P n . DNN was trained to build a function, which studies the relationship between P n n , s , η . The DNN model showed a high degree of consistency in matching the data distributions. The DNN model is used to predict with P n not included in the training set. The expected P n had effectively merged the experimental data and the values expected indicate a strong agreement with Large Hadron Collider (LHC) for ATLAS measurement at s = 0. 9 , 7 and 8 TeV. [ABSTRACT FROM AUTHOR]

Protein–protein interactions (PPIs) help to elucidate the molecular mechanisms of life activities and have a certain role in promoting disease treatment and new drug development. With the advent of the proteomics era, some PPIs prediction methods have emerged. However, the performances of these PPIs prediction methods still need to be optimized and improved. In order to optimize the performance of the PPIs prediction methods, we used the dropout method to reduce over-fitting by deep neural networks (DNNs), and combined with three types of feature extraction methods, conjoint triad (CT), auto covariance (AC) and local descriptor (LD), to build DNN models based on amino acid sequences. The results showed that the accuracy of the CT, AC and LD increased from 97.11% to 98.12%, 96.84% to 98.17%, and 95.30% to 95.60%, respectively. The loss values of the CT, AC and LD decreased from 27.47% to 14.96%, 65.91% to 17.82% and 36.23% to 15.34%, respectively. Experimental results show that dropout can optimize the performances of the DNN models. The results can provide a resource for scholars in future studies involving the prediction of PPIs. The experimental code is available at https://github.com/smalltalkman/hppi-tensorflow. [ABSTRACT FROM AUTHOR]

Deep neural networks become more popular as its ability to solve very complex pattern recognition problems. However, deep neural networks often need massive computational and memory resources, which is main reason resulting them to be difficult efficiently and entirely running on embedded platforms. This work addresses this problem by saving the computational and memory requirements of deep neural networks by proposing a variance reduced (VR)-based optimization with regularization techniques to compress the requirements of memory of models within fast training process. It is shown theoretically and experimentally that sparsity-inducing regularization can be effectively worked with the VR-based optimization whereby in the optimizer the behaviors of the stochastic element is controlled by a hyper-parameter to solve non-convex problems. [ABSTRACT FROM AUTHOR]

Image retrieval based on content not only relies heavily upon the type of descriptors, but on the steps taken further. This has been an extensively utilized methodology for finding and fetching out images from the big database of images. Nowadays, a number of methodologies have been organized to increase the CBIR performance. This has an ability to recover pictures relying upon their graphical information. In the proposed method, Neuro-Fuzzy classifier and Deep Neural Network classifier are used to classify the pictures from a given dataset. The proposed approach obtained the highest accuracy in terms of Precision, Recall, and F-measure. To show the efficiency and effectiveness of proposed approach, statistical testing is used in terms of standard deviation, skewness, and kurtosis. The results reveal that the proposed algorithm outperforms other approaches using low computational efforts. [ABSTRACT FROM AUTHOR]