Search

Digital technologies sustain today's world. Every part of the world is working towards digital technologies, which none of us can eliminate. Enormous growth is achieved only by unexpected acceleration by digital technologies, including the Internet of Everything (IoE), Artificial Neural Networks (ANN), Machine Learning (ML), Internet of Things (IoT), Artificial Intelligence (AI), Deep Learning (DL), and many more. These technologies started occupying all the engineering sectors, including manufacturing. This paper focuses on tribology analysis related to manufacturing concerning various digital manufacturing technologies. The paper narration includes Tribology using digital technologies wherein the journals and patent landscape analysis abet them. In trend, Tribology utilizes all these technologies today and envisages its growth with the predominant technological invention in the border view. The survey of various literature reveals that only three digital technologies, including AI, ML, and ANN, are used by tribologists around the globe. Other Technologies like Evolutionary Algorithm (EA), Support Vector Machine (SVM), and Adaptive Neuro-Fuzzy Interference Systems (ANFIS) are not used predominantly. [ABSTRACT FROM AUTHOR]

Monitoring and managing litter on the roadways is important not only for preserving the cleanliness and esthetic appeal of our cities but also for safeguarding the overall health and sanitary environment of citizens. With the development of artificial intelligence, it is now possible to design algorithms capable of autonomously assessing the sanitation status of roadways. In this paper, we propose a method for detecting garbage on roads as our solution to tackle the issue. The proposed model is a deep learning model with an attention mechanism introduced to detect garbage in real-time scenarios. Furthermore, the object recognition capability of the model is enhanced through transfer learning to mitigate the influence of irrelevant content during training. The refined network can detect rubbish on roads with higher efficiency than the existing models. Also, compared with other methods, it consumes less amount of data for training. The experimental results demonstrate the efficiency of our proposed model, with a performance boost of 7.62% over the state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Retail demand forecasting is a highly intricate and multilevel problem as it may include numerous products, under multiple categories, and potentially sold in many different stores. Forecasts may also process products in isolation or collectively so as to detect mutual correlations. In technical terms, retail demand forecasting may be broken down to a multivariate time series forecasting problem where the time axis is prevalent and introduces added complexity which necessitates proper usage of advanced methodologies with machine/deep learning backgrounds. Popular boosting regressors, such as XGBoost and LightGBM, are excellent machine learning candidates with extensive bibliographic backgrounds covering multiple scientific fields and applications including generic multivariate time series forecasts. The Temporal Convolutional Network and the Temporal Fusion Transformer are recently proposed deep neural network architectures that found success in specific multivariate scenarios but are yet to be tested in a variety of related fields such as retail demand forecasting. Therefore, within this paper, these novel in-the-field models are compared to the aforementioned boosting approaches alongside popular statistical univariate methods, namely Exponential Smoothing and SARIMA. To properly compare the selected models and attempt to generalize their usability, two separate datasets are analyzed and forecasted; an item sales dataset with 500 time series and a category sales dataset with 540 time series. The findings suggest that the deep learning solutions are the better predictors, with the Transformer model surpassing the Boosting solutions by up to 16.8% sMAPE decrease and the statistical approaches by up to 28.6% decrease, further substantiating the notion that deep learning techniques are exceptionally promising in handling large-scale, non-linear and outlier data whilst suggesting that retail demand forecasting does benefit from multivariate approaches and the application of advanced machine learning methods. [ABSTRACT FROM AUTHOR]

The price of carbon emission rights in the market fluctuates greatly due to various factors from economy, finance, and climate. For an enterprise that needs to conduct carbon trading activities, it is extremely necessary to fully grasp the price of carbon trading in the future period. Thus in this paper, a deep neural network-based assistive decision model for financial risk prediction in carbon trading market is proposed for this purpose. Specifically, the dynamic risk spillover effects of domestic and international carbon trading markets are studied, and a frontier time-varying model is utilized to measure the risk spillover effects. Then, the deep neural network is used for quantitative research and to construct an intelligent decision scheme that outputs financial risk prediction results. Four perspectives, energy price, climate environment, carbon market price, and macroeconomics, are selected as the input to analyze the influence factors of carbon emission rights price. Finally, several linear regression models are adopted as the baseline methods for comparison, and experimental results show that the proposed method can achieve better prediction performance compared with baseline methods. [ABSTRACT FROM AUTHOR]

Several hardware Trojan (HT) detection techniques are available today to ensure the security of hardware systems. However, the existing pre-silicon HT detection techniques have problems such as difficulties in capturing HT path features and poor applicability. To address these challenges, this paper proposes a gate-level HT detection scheme based on a deep learning model. We parse the circuit gate-level netlist and develop an algorithm to extract circuit path sentences based on the signal propagation rule. Path sentences consisting of gate names are extracted as experimental datasets. We apply the theory of natural language processing (NLP) to the task of HT detection and use three neural networks to filter the length of path sentences. Then, based on the deep learning model text convolutional neural network (TextCNN), we propose PS-TextCNN for HT detection. Our approach is verified on seven benchmark circuits of the RS232-series and eight benchmark circuits of the s-series. We achieve an average true positive rate (TPR) of 88.9%. The TPR of the RS232-series reaches a high score of 99.5%. The TPR of the s-series is 79.5%, which is significantly higher than that of the existing gate-level HT detection techniques. [ABSTRACT FROM AUTHOR]

Deep neural network has made surprising achievements in natural language processing, image pattern classification recognition, and other domains in the last few years. It is still tough to apply to hardware-constrained or mobile equipment because of the huge number of parameters, high storage as well as computing costs. In this paper, a new sparse iteration neural network architecture is proposed. First, the pruning method is used to compress the model size and make the network sparse. Then the architecture is iterated on the sparse network model, and the network performance is improved without adding additional parameters. Finally, the hybrid deep learning model was carried out on CV tasks and NLP tasks on ANN, CNN, and Transformer. Compared with the sparse network architecture, we finally found that the accuracy of the MINST, CIFAR10, PASCAL VOC 2012, and SQuAD datasets is improved by 0.47%, 0.64%, 3.75%, and 15.06%, respectively. [ABSTRACT FROM AUTHOR]

Deep learning based on deep neural networks has been very successful in many practical applications, but it lacks enough theoretical understanding due to the network architectures and structures. In this paper, we establish some analysis for linear feature extraction by a deep multi-channel convolutional neural networks (CNNs), which demonstrates the power of deep learning over traditional linear transformations, like Fourier, wavelets, redundant dictionary coding methods. Moreover, we give an exact construction presenting how linear features extraction can be conducted efficiently with multi-channel CNNs. It can be applied to lower the essential dimension for approximating a high-dimensional function. Rates of function approximation by such deep networks implemented with channels and followed by fully connected layers are investigated as well. Harmonic analysis for factorizing linear features into multi-resolution convolutions plays an essential role in our work. Nevertheless, a dedicate vectorization of matrices is constructed, which bridges 1D CNN and 2D CNN and allows us to have corresponding 2D analysis. [ABSTRACT FROM AUTHOR]

In recent years, deep learning has revolutionized natural language processing (NLP) by enabling the development of models that can learn complex representations of language data, leading to significant improvements in performance across a wide range of NLP tasks. Deep learning models for NLP typically use large amounts of data to train deep neural networks, allowing them to learn the patterns and relationships in language data. This is in contrast to traditional NLP approaches, which rely on hand-engineered features and rules to perform NLP tasks. The ability of deep neural networks to learn hierarchical representations of language data, handle variable-length input sequences, and perform well on large datasets makes them well-suited for NLP applications. Driven by the exponential growth of textual data and the increasing demand for condensed, coherent, and informative summaries, text summarization has been a critical research area in the field of NLP. Applying deep learning to text summarization refers to the use of deep neural networks to perform text summarization tasks. In this survey, we begin with a review of fashionable text summarization tasks in recent years, including extractive, abstractive, multi-document, and so on. Next, we discuss most deep learning-based models and their experimental results on these tasks. The paper also covers datasets and data representation for summarization tasks. Finally, we delve into the opportunities and challenges associated with summarization tasks and their corresponding methodologies, aiming to inspire future research efforts to advance the field further. A goal of our survey is to explain how these methods differ in their requirements as understanding them is essential for choosing a technique suited for a specific setting. This survey aims to provide a comprehensive review of existing techniques, evaluation methodologies, and practical applications of automatic text summarization. [ABSTRACT FROM AUTHOR]

This document is a guest editorial for a special issue of the journal "Fluctuation & Noise Letters" on the topic of economic policy uncertainty and the energy stock market. The editorial highlights the importance of stable economic policies for consistent economic growth and discusses the negative correlation between economic policy uncertainty and the energy stock market. It also explores the integration of machine learning and artificial intelligence in finance and their potential to reduce economic policy uncertainty. The special issue includes 14 peer-reviewed papers that cover various aspects of energy economics, energy materials, energy stock market prediction, green energy commercialization, and renewable energy dynamics in society. [Extracted from the article]

The recognition of steel microstructure images plays a crucial role in the metallographic analysis process. Although some progress has been made through the application of artificial intelligence algorithms, several challenges remain. First, existing algorithms exhibit weak nonlinear feature extraction capabilities and noticeable limitations. Second, they overlook the intrinsic noise and redundant interference present in microscopic images. To address these issues, this paper investigates the automatic recognition of metallographic tissues by leveraging residual structures in deep neural networks. An enhanced residual network model based on transfer learning is proposed, which utilizes the pre-trained weights from the ImageNet dataset to facilitate learning with small sample data. This network offers higher classification accuracy and higher F1 scores. In addition, a deep residual shrinkage network model based on an attention mechanism is proposed. This model incorporates an attention sub-network into the original residual module and employs a soft threshold function to eliminate redundant features, including noise. The proposed algorithms are evaluated against various convolutional neural networks using 20 types of metallographic test sets. The experimental results showed that both methods have high accuracy rates of 95% and 94.44%, respectively, and F1 scores of 0.9464 and 0.9419. While maintaining the complexity of the model, there has been a significant improvement in accuracy, and the models exhibit strong generalization capabilities. Our research contributes to enhancing production efficiency, strengthening quality control, and improving material performance through computer vision technology. [ABSTRACT FROM AUTHOR]

Variable selection is one of the most important contents of machine learning research and a large number of variable selection methods have been proposed at present. From deep learning perspective, we propose a new variable selection method based on multi-layer artificial neural networks in this paper. The method propagates errors gained form a trained network model through the network from output layer to input layer and the values gained by input layer give information about the relative contribution. The variables with big contribution value are selected, which we call neural inverse propagation (NIP). Specifically, after training a neural network, the gained errors between the actual network outputs and the desired outputs go through the network from top to down and arrive at the input layer. The absolute values gained by input units provide information about the relative importance (contribution) of input units, which is that the larger the value is, the more important the corresponding input variable is. We remove k variables corresponding to the first k minimum absolute value gained by input units to the predictive variables, to perform variable selection. The efficiency of the proposed method is illustrated through its application to classification and regression tasks on a number of synthetic datasets and a real-world image classification dataset. [ABSTRACT FROM AUTHOR]

The vibration-based identification method has long been used as an alternative to mechanical tests for material characterization. Its non-destructive nature, high efficiency in parameter identification of anisotropic materials and its ability to achieve structure-level homogenization make it very attractive for both academic community and industry. Due to the absence of explicit mapping from the result of vibration test to elastic constants, conventional vibration-based identification approaches generally rely on the minimization of a cost function built on modal properties or Frequency Response Function (FRF) curve. In this paper, a direct relation from FRFs to mechanical properties is established by deep neural network, which offers a new perspective to solve the inverse identification problem. Specifically, this mapping is approximately built with Multilayer Perceptrons (MLPs) and the network's weights are learned from massive training data. The training data-i.e., the FRF curves, is generated by a finite element model whose input parameters are selected by Latin Hypercube Sampling (LHS). After training, the obtained model is validated by dataset unseen during training process and will be further used to predict mechanical properties of materials from FRFs obtained by vibration test. The effectiveness and efficiency of the developed method are demonstrated on the case study of an aluminum plate. Both the Young's modulus and Poisson's ratio are retrieved with high accuracy. [ABSTRACT FROM AUTHOR]

The recognition of steel microstructure images plays a crucial role in the metallographic analysis process. Although some progress has been made through the application of artificial intelligence algorithms, several challenges remain. First, existing algorithms exhibit weak nonlinear feature extraction capabilities and noticeable limitations. Second, they overlook the intrinsic noise and redundant interference present in microscopic images. To address these issues, this paper investigates the automatic recognition of metallographic tissues by leveraging residual structures in deep neural networks. An enhanced residual network model based on transfer learning is proposed, which utilizes the pre-trained weights from the ImageNet dataset to facilitate learning with small sample data. This network offers higher classification accuracy and higher F1 scores. In addition, a deep residual shrinkage network model based on an attention mechanism is proposed. This model incorporates an attention sub-network into the original residual module and employs a soft threshold function to eliminate redundant features, including noise. The proposed algorithms are evaluated against various convolutional neural networks using 20 types of metallographic test sets. The experimental results showed that both methods have high accuracy rates of 95% and 94.44%, respectively, and F1 scores of 0.9464 and 0.9419. While maintaining the complexity of the model, there has been a significant improvement in accuracy, and the models exhibit strong generalization capabilities. Our research contributes to enhancing production efficiency, strengthening quality control, and improving material performance through computer vision technology. [ABSTRACT FROM AUTHOR]

Recent advances in speaker embeddings promote a great development of speaker diarization. However, determining 'who spoke when' in the meeting scenarios is still challenging due to similar speaker voices and unknown speaker quantity. In this paper, this research proposes enhanced discriminative features for speaker diarization, including discriminative speaker-specific features based on Siamese networks, and a speaker re-verification method. With Siamese architecture, SiamTDNN, this research first explores latent representations which is capable of modeling intra-class and inter-class differences between speakers, by training with audio pairs. Then, the re-verification method is introduced with a local-global strategy to identify speakers in a multi-person talking scene. Our method provides a novel speaker embedding with enhanced discriminative power for disambiguated speakers and achieves an elevated upper bound on the number of speakers. The proposed speaker embedding achieved an EER of 1.1% and a minDCF of 0.1192 on VoxCeleb1 for the speaker verification task. Extensive experiments on AiShell-4, ICSI, AMI and VoxConverse demonstrate the effectiveness of the proposed method with an average DER reduction of 3% and an RTF of 0.0792. [ABSTRACT FROM AUTHOR]

This paper aims to propose an improved image classification model to reduce the cost of model construction. Aiming at the problem that network training usually requires the support of a large number of labeled samples, an image classification model based on semi-supervised deep learning is proposed, which uses labeled samples to guide the network to learn unlabeled samples. A convolutional neural network model for simultaneous processing of labeled and unlabeled data is constructed. The tagged data is used to train the Softmax classifier and provide the initial K-means clustering center for the untagged data. The nonsubsampling contourlet layer is used to replace the first convolutional layer of the full convolutional neural network to extract multi-scale depth features, and the nonsubsampling contourlet full convolutional neural network is constructed. The network can extract multi-scale information of the images to be classified, and extract more discriminative deep image features. In addition, the parameters of the nonsubsampled contourlet layers are pre-set and do not require network training. The proposed method has higher classification accuracy than the contrast method on polarimetric SAR images using the nonsubsampled contourlet full convolutional neural network. [ABSTRACT FROM AUTHOR]