Search

The pulp and paper industry is critical to global industrial and economic development. Recently, India's pulp and paper industries have been facing severe competitive challenges. The challenges have impaired the environmental performance and resulted in the closure of several operations. Assessment and prediction of the performance of the Indian pulp and paper industry using various parameters is a critical task for researchers. This study proposes a framework for performance assessment and prediction based on Data Envelopment Analysis (DEA), Artificial Neural Networks, and Deep Learning (DL) to assist industry administration and decision-making. We presented a case study based on eight industries to demonstrate the methodology's applicability. This study analyses and predicts industry performance based on sample data observations over 30 years. The result suggests the DEA-DL-based efficiency prediction has an overall MSE of 0.08 compared with the actual efficiency. Furthermore, the efficiency rankings are compared between the three techniques. The results suggest that the integrated DEA-DL method is primarily accurate in most scenarios with the actual values. The findings of this study provide a comprehensive analysis of environmental performance for policymakers. [ABSTRACT FROM AUTHOR]

The paper introduces a natural language processing system designed to answer natural language questions across knowledge graphs for scientific data applications where no prior training data in the form of question-answer pairs is available. 59 papers, submitted by 243 authors from over 20 countries/regions to SSDBM 2021, have showcased the pervasiveness of AI/ML in the field of scientific and statistical data management, which covered a variety of related topics (among others) including: In-database machine learning. Recent advancement in deep neural networks, combined with the high performance computing power and Big Data, has profoundly brought artificial intelligence (AI) to nearly all fields of scientific disciplines. [Extracted from the article]

This paper explores the suitability of lip-based authentication as a behavioural biometric for mobile devices. Lip-based biometric authentication is the process of verifying an individual based on visual information taken from the lips while speaking. It is particularly suited to mobile devices because it contains unique information; its potential for liveness over existing popular biometrics such as face and fingerprint and lip movements can be captured using a device's front-facing camera, requiring no dedicated hardware. Despite its potential, research and progress into lip-based biometric authentication has been significantly slower than other biometrics such as face, fingerprints, or iris.This paper investigates a state-of-the-art approach using a deep Siamese network, trained with the triplet loss for one-shot lip-based biometric authentication with real-world challenges. The proposed system, LipAuth, is rigourously examined with real-world data and challenges that could be expected on lip-based solution deployed on a mobile device. The work in this paper shows for the first time how a lip-based authentication system performs beyond a closed-set protocol, benchmarking a new open-set protocol with an equal error rates of 1.65% on the XM2VTS dataset.New datasets, qFace and FAVLIPS, were collected for the work in this paper, which push the field forward by enabling systematic testing of the content and quantities of data needed for lip-based biometric authentication and highlight problematic areas for future work. The FAVLIPS dataset was designed to mimic some of the hardest challenges that could be expected in a deployment scenario and include varied spoken content, miming and a wide range of challenging lighting conditions. The datasets captured for this work are available to other university research groups on request. [ABSTRACT FROM AUTHOR]

In the third paper, I Deep transfer learning: a novel glucose prediction framework for new subjects with Type 2 diabetes i , the authors designed a novel cross-subject glucose prediction framework by integrating instance-based and network-based deep transfer learning via segmented continuous glucose monitoring time series. Control and optimization Six papers have devoted to the computational intelligence-based decision-making and analysis of complex systems. Complex systems, which are composed of many interconnected and interactive functional parts, widely exist in the nature and human society. [Extracted from the article]

Overpressure is always considered as a severe problem in the oil industry. Besides creating life risks through serious accidents while drilling, failure to correctly identify high-pressure intervals causes a significant increase in costs and prolongs the drilling process. Kazhdumi Formation in the Abadan Plain is considered as a high-pressure formation in several wells. Various reasons can cause overpressure problem. Hydrocarbon generation is one cause of abnormal pressure in source rocks. Understanding hydrocarbon generation potential can be a helpful approach since the Kazhdumi Formation is considered as a probable source rock in this area. In this paper, in order to better understand the problem of abnormal pressure in Kazhdumi Formation, geochemical concepts and tools have been applied. To that way, 1D petroleum system modeling of five wells was done, and the thermal maturity level of Kazhdumi Formation was determined and then, compared with drilling records. The results indicate that in wells where this formation has sufficient organic matter and has reached an early mature level, there is an abnormal pressure problem. Otherwise, this formation does not show abnormal pressure. Also, geochemical data are not available in all drilled wells, which makes impossible the assessing of hydrocarbon generation role. Therefore, petrophysical well logs (sonic (DT), neutron (NPHI), density (RHOB), spectral gamma ray (SGR), and resistivity (RES)) as well as 137 sets of geochemical data belonging to 13 wells from 7 oilfields in the Abadan Plain were used to predict geochemical indicators. Using artificial neural networks, geochemical data of a well in Abadan Plain were predicted. This selected well has a high-pressure problem in Kazhdumi Formation, but no geochemical data are available in this well. The results of predicted geochemical data show that the high-pressure phenomenon in this well may also be due to hydrocarbon generation. The precise understanding of the abnormal pressure, resulting from hydrocarbons generation, requires comprehensive studies and a full investigation of the studied area. However, the results of this paper help to predict approximately the behavior of the source rocks before drilling. Acquiring this overview will aid in reducing drilling hazards and costs. [ABSTRACT FROM AUTHOR]

De-mining operations are of critical importance for humanitarian efforts and safety in conflict-affected regions. In this paper, we address the challenge of enhancing the accuracy and efficiency of mine detection systems. We present an innovative Deep Learning architecture tailored for pulse induction-based Metallic Mine Detectors (MMD), so called DL-MMD. Our methodology leverages deep neural networks to distinguish amongst nine distinct materials with an exceptional validation accuracy of 93.5%. This high level of precision enables us not only to differentiate between anti-personnel mines, without metal plates but also to detect minuscule 0.2-g vertical paper pins in both mineralized soil and non-mineralized environments. Moreover, through comparative analysis, we demonstrate a substantial 3% and 7% improvement (approx.) in accuracy performance compared to the traditional K-Nearest Neighbors and Support Vector Machine classifiers, respectively. The fusion of deep neural networks with the pulse induction-based MMD not only presents a cost-effective solution but also significantly expedites decision-making processes in de-mining operations, ultimately contributing to improved safety and effectiveness in these critical endeavors. [ABSTRACT FROM AUTHOR]

Accurate prediction of sea level height is critically important for the government in assessing sea level risk in coastal areas. However, due to the nonlinear, time-varying and highly uncertain characteristics of sea level change data, sea level prediction is challenging. To improve the accuracy of sea level prediction, this paper uses a new swarm intelligence algorithm named the sparrow search algorithm (SSA), which can imitate the foraging behavior and antipredation behavior of sparrows, to determine optimal solutions. To avoid the algorithm falling into a local optimal situation, this paper integrates the sine–cosine algorithm and the Cauchy variation strategy into the SSA to obtain an algorithm named the SCSSA. The SCSSA is used to optimize the parameter values of the CNN-BiLSTM (convolutional neural network combined with bidirectional long short-term memory neural network) model; finally, a combined neural network model (named SCSSA-CNN-BiLSTM) is proposed. In this paper, the time series data of seven tidal stations located in coastal China are used for experimental analysis. First, the SCSSA-CNN-BiLSTM model is compared with the CNN-BiLSTM model to predict the time series data of SHANWEI Station. With respect to the training and test sets of data, the SCSSA-CNN-BiLSTM model outperforms the other models on all the evaluation metrics. In addition, the remaining six tide station datasets and five neural network models, including the SCSSA-CNN-BiLSTM model, are used to further study the performance of the proposed prediction model. Four evaluation indices including the root mean squared error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE) and coefficient of determination (R2) are adopted. For six stations, the RMSE, MAE, MAPE and R2 of SCSSA-CNN-BiLSTM model are ranged from 20.9217 ~ 27.8427 mm, 9.4770 ~ 17.8603 mm, 0.1322% ~ 0.2482% and 0.9119 ~ 0.9759, respectively. The experimental analysis results show that the SCSSA-CNN-BiLSTM model makes effective predictions at all stations, and the prediction performance is better than that of the other models. Even though the combination of SCSSA algorithm may increase the complexity of the model, indeed the proposed model is a new prediction method with good accuracy and robustness for predicting sea level change. [ABSTRACT FROM AUTHOR]

Knowledge graph embedding converts knowledge graphs based on symbolic representations into low-dimensional vectors. Effective knowledge graph embedding methods are key to ensuring downstream tasks. Some studies have shown significant performance differences among various knowledge graph embedding models on different datasets. They attribute this issue to the insufficient representation ability of the models. However, what representation ability knowledge graph embedding models possess is still unknown. Therefore, this paper first selects three representative models for analysis: translation and rotation models in distance models, and the Bert model in neural network models. Based on the analysis results, it can be concluded that the translation model focuses on clustering features, the rotation model focuses on hierarchy features, and the Bert model focuses on word co-occurrence features. This paper categorize clustering and hierarchy as structure features, and word co-occurrence as semantic features. Furthermore, a model that solely focuses on a single feature will lead to a lack of accuracy and generality, making it challenging for the model to be applicable to modern large-scale knowledge graphs. Therefore, this paper proposes an ensemble model with structure and semantic features for knowledge graph embedding. Specifically, the ensemble model includes a structure part and a semantic part. The structure part consists of three models: translation, rotation and cross. Translation and rotation models serve as basic feature extraction, while the cross model enhances the interaction between them. The semantic part is built based on Bert and integrated with the structure part after fine-tuning. In addition, this paper also introduces a frequency model to mitigate the training imbalance caused by differences in entity frequencies. Finally, we verify the effectiveness of the model through link prediction. Experiments show that the ensemble model has achieved improvement on FB15k-237 and YAGO3-10, and also has good performance on WN18RR, proving the effectiveness of the model. [ABSTRACT FROM AUTHOR]

The first issue of Artificial Intelligence and Law journal was published in 1992. This paper provides commentaries on landmark papers from the first decade of that journal. The topics discussed include reasoning with cases, argumentation, normative reasoning, dialogue, representing legal knowledge and neural networks. [ABSTRACT FROM AUTHOR]

Automatic modulation classification (AMC) is an important process for future communication systems with prominent applications from spectrum management, and secure communication, to cognitive radio. The requirement for an efficient AMC classifier is due to its capability in blind modulation recognition, which is a difficult task in real scenarios where the limitations of traditional hardware and the complexity of channel impairments are involved. Therefore, this paper proposes a complete real-time AMC system based on software-defined radio and deep learning architecture. The system demodulation performance is verified through simulations and real channel impairment conditions to ensure reliability. With at most 6 times reduced number of parameters, two proposed models convolutional long short-term memory deep neural network and residual long short-term memory neural network also show a general improvement in classification accuracy compared with reference studies. The performance of these models at real-time AMC is tested with suitable processing time for practical applications. [ABSTRACT FROM AUTHOR]

The prevalence of cardiovascular disease (CVD) has surged in recent years, making it the foremost cause of mortality among humans. The Electrocardiogram (ECG), being one of the pivotal diagnostic tools for cardiovascular diseases, is increasingly gaining prominence in the field of machine learning. However, prevailing neural network models frequently disregard the spatial dimension features inherent in ECG signals. In this paper, we propose an ECG autoencoder network architecture incorporating low-rank attention (LRA-autoencoder). It is designed to capture potential spatial features of ECG signals by interpreting the signals from a spatial perspective and extracting correlations between different signal points. Additionally, the low-rank attention block (LRA-block) obtains spatial features of electrocardiogram signals through singular value decomposition, and then assigns these spatial features as weights to the electrocardiogram signals, thereby enhancing the differentiation of features among different categories. Finally, we utilize the ResNet-18 network classifier to assess the performance of the LRA-autoencoder on both the MIT-BIH Arrhythmia and PhysioNet Challenge 2017 datasets. The experimental results reveal that the proposed method demonstrates superior classification performance. The mean accuracy on the MIT-BIH Arrhythmia dataset is as high as 0.997, and the mean accuracy and F 1 -score on the PhysioNet Challenge 2017 dataset are 0.850 and 0.843. [ABSTRACT FROM AUTHOR]

The retinal impulse signal is the basic carrier of visual information. It records the distribution of light on the retina. However, its direct conversion to a scene image is difficult due to the nonlinear characteristics of its distribution. Therefore, the use of artificial neural network to reconstruct the scene from retinal spikes has become an important research area. This paper proposes the architecture of a neural network based on vector quantization, where the feature vectors of spike trains are extracted, compressed, and stored using a feature extraction and compression network. During the decoding process, the nearest neighbour search method is used to find the nearest feature vector corresponding to each feature vector in the feature map. Finally, a reconstruction network is used to decode a new feature map composed of matching feature vectors to obtain a visual scene. This paper also verifies the impact of vector quantization on the characteristics of pulse signals by comparing experiments and visualizing the characteristics before and after vector quantization. The network delivers promising performance when evaluated on different datasets, demonstrating that this research is of great significance for improving relevant applications in the fields of retinal image processing and artificial intelligence. [ABSTRACT FROM AUTHOR]

A neural network model needs to be manually designed for ancient mural dynasty recognition, and this paper proposes an ancient mural dynasty recognition algorithm that is based on a neural architecture search (NAS). First, the structural edge information of mural images is extracted for use by the neural network model in recognizing mural missions. Second, an NAS algorithm that is based on contrast selection (CS) simplifies the architecture search to an incremental CS and then searches for the optimal network architecture on the mural dataset. Finally, the identified optimal network architecture is used for training and testing to complete the mural dynasty recognition task. The results show that the top accuracy of the proposed method on the mural dataset is 88.10%, the recall rate is 87.52%, and the precision rate is 87.69%. Each evaluation index used by the neural network model is superior to that of classical network models such as AlexNet and ResNet-50. Compared with NAS methods such as ASNG and MIGO, the accuracy of mural dynasty recognition is higher by an average of 4.27% when using the proposed method. The proposed method is verified on CIFAR-10, CIFAR-100, ImageNet16-120 and other datasets and achieves a good recognition accuracy in the NAS-bench-201 search space, which averages 93.26%, 70.73% and 45.34%, respectively, on the abovementioned datasets. [ABSTRACT FROM AUTHOR]

Accurately identifying changes in carbon trading prices can provide reasonable reference indicators for a government's macrocontrol and can also help companies more effectively avoid risks brought by carbon emissions and increase the income of carbon assets. Based on the Prophet model, LSTM neural network model, and backpropagation (BP), this paper proposes a method to predict carbon trading prices using the ensemble learning model and uses the Hubei carbon trading market data to predict carbon trading prices. Results show that in terms of accuracy, the Prophet-LSTM-BP ensemble learning model achieves better predictive ability than existing models; its RMSE, MAE, and MAPE are 1.479, 0.951, and 2.135, respectively, which are markedly smaller than the Prophet model's 5.631, 4.471, and 9.661, and the LSTM model's 3.352, 3.105, and 6.880, respectively. Compared with the traditional time series ARIMA model, the MAPE of ARIMA reaches 12.933, which is nearly 1.5 times that of the Prophet model, nearly 2 times that of the LSTM model, and nearly 7 times that of the ensemble learning model. In terms of applicability, when the model is applied to the national carbon trading market, the difference in MAPE compared with the Hubei carbon trading market is only 0.6%, and the other parameters are not more than 16%. The model improves the relevant research on carbon trading price predicting, and concurrently, this method provides ideas for carbon trading price predicting in other carbon trading markets and promotes the sustainable development of the national carbon trading market. [ABSTRACT FROM AUTHOR]

This special issue of the circuits, systems and signal processing journal focuses on recent advances and improvements in leading-edge integrated machine learning algorithms and signal processing systems. Although signal processing has been studied over several decades, the computer industry is only beginning to understand how signal processing techniques can be well integrated for the development of human-machine interfaces with the advancement of machine learning algorithms. As advances in signal processing tools and machine learning algorithms are becoming more powerful in terms of functionality and communicative capabilities, their contribution to the journal of circuits, system and signal processing is becoming more significant. [Extracted from the article]

This special issue of the International Journal of Computer Vision (IJCV) presents the best papers of the 28th British Machine Vision Conference (BMVC) held in Imperial College London, UK, on 4th-7th September 2017. The papers presented in this issue offer a snapshot of some of the best work in the field, on the topics of (1) learning quantised representations by deep neural networks, (2) 3D shape estimation, (3) novel image representations, (4) image descriptors and matching, and (5) data generation. I Image descriptors and matching i by local descriptors or deep neural networks remains an active research topic. [Extracted from the article]

We are pleased to present a special issue of Data Science and Engineering (DSE), which contains a collection of eight extended papers from the ICDM 2019 conference. The eight extended papers in this special issue cover a variety of topics related to data science and engineering. The seventh paper "Contextual Sentiment Neural Network for Document Sentiment Analysis" proposes a novel neural network model that can explain the process of its sentiment analysis prediction in a way that humans find natural and agreeable and can catch-up the summary of the contents. [Extracted from the article]

In this paper, we present the envisioned style and scope of the new topic "Explanation Paradigms Leveraging Analytic Intuition" (ExPLAIn) with the International Journal on Software Tools for Technology Transfer (STTT). Intention behind this new topic is to (1) explicitly address all aspects and issues that arise when trying to, if possible, reveal and then confirm hidden properties of black-box systems, or (2) to enforce vital properties by embedding them into appropriate system contexts. Machine-learned systems, such as Deep Neural Networks, are particularly challenging black-box systems, and there is a wealth of formal methods for analysis and verification waiting to be adapted and applied. The selection of papers of this first Special Section of ExPLAIn, most of which were co-authored by editorial board members, is an illustrative example of the style and scope envisioned: In addition to methodological papers on verification, explanation, and their scalability, case studies, tool papers, literature reviews, and position papers are also welcome. [ABSTRACT FROM AUTHOR]

Rapid and accurate detection of a C-shaped root canal on mandibular second molars can assist dentists in diagnosis and treatment. Oral panoramic radiography is one of the most effective methods of determining the root canal of teeth. There are already some traditional methods based on deep learning to learn the characteristics of C-shaped root canal tooth images. However, previous studies have shown that the accuracy of detecting the C-shaped root canal still needs to be improved. And it is not suitable for implementing these network structures with limited hardware resources. In this paper, a new lightweight convolutional neural network is designed, which combined with receptive field block (RFB) for optimizing feature extraction. In order to optimize the hardware resource requirements of the model, a lightweight, multi-branch, convolutional neural network model was developed in this study. To improve the feature extraction ability of the model for C-shaped root canal tooth images, RFB has been merged with this model. RFB has achieved excellent results in target detection and classification. In the multiscale receptive field block, some small convolution kernels are used to replace the large convolution kernels, which allows the model to extract detailed features and reduce the computational complexity. Finally, the accuracy and area under receiver operating characteristics curve (AUC) values of C-shaped root canals on the image data of our mandibular second molars were 0.9838 and 0.996, respectively. The results show that the deep learning model proposed in this paper is more accurate and has lower computational complexity than many other similar studies. In addition, score-weighted class activation maps (Score-CAM) were generated to localize the internal structure that contributed to the predictions. [ABSTRACT FROM AUTHOR]

Phase-to-height mapping is one of the important processes in three dimensional phase measurement profilometry. But, in traditional phase-to-height mapping method, the measurement accuracy is affected by device attitude, so it needs saving a large amount of mapping equations to achieve high-quality phase-to-height mapping. In order to improve that, this paper proposes an improved phase-to-height mapping method combine with device attitude. Firstly, we get the unwrapped phase of the target. Then, using generalized regression neural network is used to reduce the offset of phase information at the same height due to the randomness of device attitude. Last, the phase-to-height mapping is completed by substituting the unwrapped phase (the difference between having detected object and no detected object) of eliminate the offset into improved phase-to-height mapping method. Experimental results show that the proposed method could achieve high-quality phase-to-height mapping with less mapping equation and less memory space. Compared with the nonlinear phase-to-height mapping method (probabilistic neural network to eliminate phase offset), its accuracy is improved by 44.30%. Compared with the nonlinear phase-to-height mapping method (radial basis function neural network to eliminate phase offset), the accuracy is improved by 39.58%. [ABSTRACT FROM AUTHOR]

One of the main challenges regarding the prediction of groundwater resource changes is the climate change phenomenon and its impacts on quantitative variations of such resources. Groundwater resources are treated as one of the main strategic resources of any region. Given the climate change phenomenon and its impacts on hydrological parameters, it is necessary to evaluate and predict future changes to achieve an appropriate plan to maintain and preserve water resources. In this regard, the present study is put forward by utilizing the Statistical Down-Scaling Model (SDSM) to forecast the main climate variables (i.e., temperature and precipitation) based on new Rcp scenarios for greenhouse gas emissions within a period from 2020 to 2060. The results obtained from the prediction of climate parameters indicate different values in each emission scenario, so the limit, minimum and maximum values occur in the Rcp8.5, Rcp2.6 and Rcp4.5 scenarios, respectively. Also, a model is developed by utilizing the GMDH artificial neural network technique. The developed model predicts the average groundwater level based on the climate variables in such a way that by implementing the climate parameters forecasted by the SDSM model, the groundwater level within a time period from 2020 to 2060 is predicted. The results obtained from the verification and validation of the model imply its proper performance and reasonable accuracy in predicating groundwater level based on the climate variables. The findings derived from the present paper indicate that compared to the years prior to the prediction period, the groundwater level of the Sahneh Plain has dramatically dropped so that based on the Rcp scenarios, the groundwater level values are in their lowest state within the period from 2046 to 2056. The findings of this paper can be used by managers and decision makers as a layout for evaluating climate change effects in the Sahneh Plain. [ABSTRACT FROM AUTHOR]

Bitcoin exchange security is crucial because of MEC's widespread use. Cryptojacking has compromised MEC app security and bitcoin exchange ecosystem functionality. This paper propose a cutting-edge neural network and AdaHessian optimization technique for cryptojacking prediction and defense. We provide a cutting-edge deep neural network (DNN) cryptojacking attack prediction approach employing pruning, post-training quantization, and AdaHessian optimization. To solve these problems, this paper apply pruning, post-training quantization, and AdaHessian optimization. A new framework for quick DNN training utilizing AdaHessian optimization can detect cryptojacking attempts with reduced computational cost. Pruning and post-training quantization improve the model for low-CPU on-edge devices. The proposed approach drastically decreases model parameters without affecting Cryptojacking attack prediction. The model has Recall 98.72%, Precision 98.91%, F1-Score 99.09%, MSE 0.0140, RMSE 0.0137, and MAE 0.0139. Our solution beats state-of-the-art approaches in precision, computational efficiency, and resource consumption, allowing more realistic, trustworthy, and cost-effective machine learning models. We address increasing cybersecurity issues holistically by completing the DNN optimization-security loop. Securing Crypto Exchange Operations delivers scalable and efficient Cryptojacking protection, improving machine learning, cybersecurity, and network management. [ABSTRACT FROM AUTHOR]

With the advent of the big data era, edge cloud computing has developed rapidly. In this era of popular digital music, various technologies have brought great convenience to online music education. But vast databases of digital music prevent educators from making specific-purpose choices. Music recommendation will be a potential development direction for online music education. In this paper, we propose a deep learning model based on multi-source information fusion for music recommendation under the scenario of edge-cloud computing. First, we use the music latent factor vector obtained by the Weighted Matrix Factorization (WMF) algorithm as the ground truth. Second, we build a neural network model to fuse multiple sources of music information, including music spectrum extracted from extra music information to predict the latent spatial features of music. Finally, we predict the user's preference for music through the inner product of the user vector and the music vector for recommendation. Experimental results on public datasets and real music data collected by edge devices demonstrate the effectiveness of the proposed method in music recommendation. [ABSTRACT FROM AUTHOR]

This paper is about the opposite of judgement and calculation. This opposition has been a traditional anchor of critiques concerned with the rise of AI decision making over human judgement. Contrary to these approaches, it is argued that human judgement is not and cannot be replaced by calculation, but that it is human judgement that contextualises computational structures and gives them meaning and purpose. The article focuses on the epistemic structure of algorithms and artificial neural networks to find that they always depend on human judgement to be related to real life objects or purposes. By introducing the philosophical concept of judgement, it becomes clear that the property of judgement to provide meaning and purposiveness is based on the temporality of human life and the ambiguity of language, which quantitative processes lack. A juxtaposition shows that calculations and clustering can be used and referred to in more or less prejudiced and reflecting as well as opaque and transparent ways, but thereby always depend on human judgement. The paper clearly asserts that the transparency of AI is necessary for their autonomous use. This transparency requires the explicitness of the judgements that constitute these computational structures, thereby creating an awareness of the conditionality of such epistemic entities. [ABSTRACT FROM AUTHOR]

Traditional tool condition monitoring methods developed in an ideal environment are not universal in multiple working conditions considering different signal sources and recognition methods. This paper presents a novel tool condition monitoring approach that packages deep learning networks for accurate condition recognition with a cocktail solver library. First, the multisource signals from the machining process are collected and sequenced as the input of the cocktail solver library. The machining signals are transformed into a series of two-dimensional images by a continuous wavelet transform. In addition, ten pretrained networks with transfer learning are rapidly transferred with a finetuning operation, which contributes to a set of monitor networks. Three major processes are integrated by the cocktail solver library, which is the choosing dataset process for multi-signals, the training option process for network training parameters, and the network package process for the basic monitoring model. A Bayesian optimization method is employed to handle a tradeoff for these three processes to improve the prediction accuracy and reduce the recognition time. In the testing experiment, the milling datasets are used to train the model, and the results show that the accuracy of the model proposed in this paper can exceed 90%. The proposed method was also compared with other traditional methods to verify its effectiveness. [ABSTRACT FROM AUTHOR]

The paramount concern of highly accurate energy-efficient computing in machines with significant cognitive capabilities aims to enhance the accuracy and efficiency of bio-inspired Spiking Neural Networks (SNNs). This paper addresses this main objective by introducing a novel spatial power spike-timing-dependent plasticity (Spatial-Pow-STDP) learning rule as a digital block with high accuracy in a bio-inspired SNN model. Motivated by the demand for precise and accelerated computation that reduces high-cost resources in neural network applications, this paper presents a methodology based on COordinate Rotation DIgital Computer (CORDIC) definitions. The proposed designs of CORDIC algorithms for exponential (Exp CORDIC), natural logarithm (Ln CORDIC), and arbitrary power function (Pow CORDIC) are meticulously detailed and evaluated to ensure optimal acceleration and accuracy, which respectively show average errors near 10–9, 10–6, and 10–5 with 4, 4, and 6 iterations. The engineered architectures for the Exp, Ln, and Pow CORDIC implementations are illustrated and assessed, showcasing the efficiency achieved through high frequency, leading to the introduction of a Spatial-Pow-STDP learning block design based on Pow CORDIC that facilitates efficient and accurate hardware computation with 6.93 × 10–3 average error with 9 iterations. The proposed learning mechanism integrates this structure into a large-scale spatiotemporal SNN consisting of three layers with reduced hyper-parameters, enabling unsupervised training in an event-based paradigm using excitatory and inhibitory synapses. As a result, the application of the developed methodology and equations in the computational SNN model for image classification reveals superior accuracy and convergence speed compared to existing spiking networks by achieving up to 97.5%, 97.6%, 93.4%, and 93% accuracy, respectively, when trained on the MNIST, EMNIST digits, EMNIST letters, and CIFAR10 datasets with 6, 2, 2, and 6 training epochs. [ABSTRACT FROM AUTHOR]

Internet of Things (IoT) driven systems have been sharply growing in the recent times but this evolution is hampered by cybersecurity threats like spoofing, denial of service (DoS), distributed denial of service (DDoS) attacks, intrusions, malwares, authentication problems or other fatal attacks. The impacts of these security threats can be diminished by providing protection towards the different IoT security features. Different technological solutions have been presented to cope with the vulnerabilities and providing overall security towards IoT systems operating in numerous environments. In order to attain the full-pledged security of any IoT-driven system the significant contribution presented by artificial neural networks (ANNs) is worthy to be highlighted. Therefore, a systematic approach is presented to unfold the efforts and approaches of ANNs towards the security challenges of IoT. This systematic literature review (SLR) is composed of three (3) research questions (RQs) such that in RQ1, the major focus is to identify security requirements or criteria that defines a full-pledge IoT system. This question also focusses on pinpointing the different types of ANNs approaches that are contributing towards IoT security. In RQ2, we highlighted and discussed the contributions of ANNs approaches for individual security requirement/feature in comprehensive and detailed fashion. In this question, we also determined the various models, frameworks, techniques and algorithms suggested by ANNs for the security advancements of IoT. In RQ3, different security mechanisms presented by ANNs especially towards intrusion detection system (IDS) in IoT along with their performances are comparatively discussed. In this research, 143 research papers have been used for analysis which are providing security solutions towards IoT security issues. A comprehensive and in-depth analysis of selected studies have been made to understand the current research gaps and future research works in this domain. [ABSTRACT FROM AUTHOR]

Link prediction in online social networks is used to determine new interactions among its members which are likely to occur in the future. Link prediction in the co-authorship network has been regarded as one of the main targets in link prediction researches so far. Researchers have focused on analyzing and proposing solutions to give efficient recommendation for authors who can work together in a science project. In order to give precise prediction of links between two ubiquitous authors in a co-authorship network, it is preferable to design a similarity metric between them and then utilizing it to determine the most possible co-author(s). However, the relevant researches did not regard the integration of paper’s content in the metric itself. This is important when considering the collaboration between scientists since it is possible that authors having same research interests are more likely to have a joint paper than those in different researches. In this paper, we propose a new metric for link prediction in the co-authorship network based on the content similarity named as LDAcosin. Mathematical notions of the link prediction in the co-authorship network and a link prediction algorithm based on topic modeling are proposed. The new metric is experimentally validated on the public bibliographic collection. [ABSTRACT FROM AUTHOR]

The motivation for analyzing the impact of deep neural networks on enterprise performance is mainly due to the continuous deepening of enterprise information construction, shifting from traditional paper-based data acquisition methods to electronic data management. The data generated by the sales, production, logistics and other links of enterprises is also becoming increasingly large. How to scientifically and effectively process these massive amounts of data and extract valuable information has become an important issue that enterprises need to solve. The continuous and stable growth of China's economy has promoted the development and growth of enterprises, however, it has also made enterprises face a more complex competitive environment. The question of how to improve the performance of enterprises to enhance their competitiveness in the market has become a major issue to be addressed in the face of fierce competition and to ensure the long-term development of enterprises. In this paper, based on the research of firm performance evaluation, deep neural network is introduced to analyse the influence of ambidextrous innovation and social network on firm performance, and the theories of social network, ambidextrous innovation and deep neural network are sorted out and analysed, and a deep neural network-based firm performance evaluation model is established, and finally the sample data is obtained using crawler technology, and then the response values are analysed. Innovation and the improvement of the mean value of social networks are helpful to firm performance. [ABSTRACT FROM AUTHOR]

SiamFC++ only extracts the object feature of the first frame as a tracking template, and only uses the highest level feature maps in both the classification branch and the regression branch, so that the respective characteristics of the two branches are not fully utilized. In view of this, the present paper proposes an object tracking algorithm based on SiamFC++. The algorithm uses the multi-layer features of the Siamese network to update template. First, FPN is used to extract feature maps from different layers of Backbone for classification branch and regression branch. Second, 3D convolution is used to update the tracking template of the object tracking algorithm. Next, a template update judgment condition is proposed based on mutual information. Finally, AlexNet is used as the backbone and GOT-10K as training set. Compared with SiamFC++, our algorithm obtains improved results on OTB100, VOT2016, VOT2018 and GOT-10k data sets, and the tracking process is real time. [ABSTRACT FROM AUTHOR]

Recent researches demonstrate that Deep Neural Networks (DNN) models are vulnerable to backdoor attacks. The backdoored DNN model will behave maliciously when images containing backdoor triggers arrive. To date, almost all the existing backdoor attacks are single-trigger and single-target attacks, and the triggers of most existing backdoor attacks are obvious thus are easy to be detected or noticed. In this paper, we propose a novel imperceptible and multi-channel backdoor attack method against Deep Neural Networks by exploiting Discrete Cosine Transform (DCT) steganography. The proposed method injects backdoor instances into the training set and does not require controlling the whole training process. Specifically, for a colored image, we utilize DCT steganography to construct and embed trigger into different channels of the image in frequency domain. As a result, the trigger shown in the time domain is stealthy and natural. Then the generated backdoor instances are injected into the training dataset to train the DNN model. Based on the proposed backdoor attack method, we implement two cunning variants of backdoor attacks, imperceptible N-to-N (multi-target) backdoor attack and imperceptible N-to-One (multi-trigger) backdoor attack. Experimental results demonstrate that the attack success rate of the N-to-N backdoor attack is 95.09% on CIFAR-10 dataset, 93.33% on TinyImageNet dataset and 92.45% on ImageNet dataset, respectively. The attack success rate of the N-to-One attack is 90.22% on CIFAR-10 dataset, 89.56% on TinyImageNet dataset and 88.29% on ImageNet dataset, respectively. Meanwhile, the proposed backdoor attack does not affect the classification accuracy of the DNN models. Moreover, the proposed attack is demonstrated to be robust against two state-of-the-art backdoor defenses, including the recent frequency domain defense. [ABSTRACT FROM AUTHOR]

Deep Neural Networks (DNN's) present some of the leading applications of Artificial Intelligence (AI) which have proven suitability on various machine-learning use cases. Forecasting demand of intermittent on-line sales is a task which needs to be carried out automatically for a large number of Stock Keeping Units (SKU's). This paper discusses the intermittent online sales and proposes an AI-based model for forecasting demand. We provide empirical evidence by utilizing data from 17 different sellers with approximately 3000 orders in total. Our findings indicate that thanks to their multi-layered learning structure, the DNN's can provide up to 35% better accuracy than the classic models such as Moving Average, Exponential Smoothing, Croston's method and ARIMA. Also, it was revealed that the time between orders' arrivals follow Exponential distribution and the order sizes also generally follow Exponential distribution. Thus, most of the time, Poisson Exponential distribution can be used for modelling intermittent sales process through online platforms. The analyses show that Poisson Exponential distribution can generate values close to real sales with less than 7% error margin with real data. [ABSTRACT FROM AUTHOR]

In the digital age, social media has emerged as a significant platform, generating a vast amount of raw data daily. This data reflects the opinions of individuals from diverse backgrounds, races, cultures, and age groups, spanning a wide range of topics. Businesses can leverage this data to extract valuable insights, improve their services, and effectively reach a broader audience based on users' expressed opinions on social media platforms. To harness the potential of this extensive and unstructured data, a deep understanding of Natural Language Processing (NLP) is crucial. Existing approaches for sentiment analysis (SA) often rely on word co-occurrence frequencies, which prove inefficient in practical scenarios. Identifying this research gap, this paper presents a framework for concept-level sentiment analysis, aiming to enhance the accuracy of sentiment analysis (SA). A comprehensive Urdu language dataset was constructed by collecting data from YouTube, consisting of various talks and reviews on topics such as movies, politics, and commercial products. The dataset was further enriched by incorporating language rules and Deep Neural Networks (DNN) to optimize polarity detection. For sentiment analysis, the proposed framework employs predefined rules to trigger sentiment flow from words to concepts, leveraging the dependency relations among different words in a sentence based on Urdu language grammatical rules. In cases where predefined patterns are not triggered, the framework seamlessly switches to its sub-symbolic counterpart, passing the data to the DNN for sentence classification. Experimental results demonstrate that the proposed framework surpasses state-of-the-art approaches, including LSTM, CNN, SVM, LR, and MLP, achieving an improvement of 6–7% on Urdu dataset. In conclusion, this research paper introduces a novel framework for concept-level sentiment analysis of Urdu language data sourced from social media platforms. By combining language rules and DNN, the proposed framework demonstrates superior performance compared to existing methodologies, showcasing its effectiveness in accurately analyzing sentiment in Urdu text data. [ABSTRACT FROM AUTHOR]

Deep neural networks have effectively processed substantial quantities of image, text, and speech data. However, they are susceptible to adversarial sample attacks, where slight perturbations modify the input to generate malicious outputs. These attacks pose a severe security risk to deep neural network systems. Prior methods for generating adversarial samples rely on objective L p norm to measure the distance between original and adversarial samples, which can be easily detected by humans. Moreover, these attacks treat perturbations of different pixels equally without considering the sensitivity of the human eye to different pixels. To address these challenges, this paper proposes SenAttack, an adversarial attack method based on perturbation sensitivity and perceptual color distance. SenAttack evaluates perceptual similarity using the perceptual color distance and combines the perturbation sensitivity of image structural information as an additional term in the calculation of the perceptual color distance. Furthermore, it employs an adaptive parameter adjustment algorithm to optimize the iterative process. Experimental results demonstrate that SenAttack achieves a high success rate in white-box attacks on Inception-v3 and ResNet-50 models with few iterations. The average norm distance and perceptual color distance of the adversarial samples are reduced by over 10% and 50% respectively, significantly enhancing their imperceptibility. SenAttack also exhibits superior visual effects in high confidence scenarios and improved robustness against defense models with partial image compression. SenAttack provides a novel approach to adversarial attacks by considering the sensitivity of the human eye and employing perceptual color distance. The results highlight its effectiveness in generating imperceptible adversarial samples and its potential for enhancing the security of deep neural network systems. [ABSTRACT FROM AUTHOR]

Scientific analysis of regional agricultural carbon emission prediction models and empirical studies are of great practical significance to the realization of low-carbon agriculture, which can help revitalize and build up ecological and beautiful countryside in China. This paper takes agriculture in Guangdong Province, China, as the research object, and uses the extended STIPAT model to construct an indicator system for the factors influencing agricultural carbon emissions in Guangdong. Based on this system, a combined Isomap–ACO–ET prediction model combing the isometric mapping algorithm (Isomap), ant colony algorithm (ACO) and extreme random tree algorithm (ET) was used to predict agriculture carbon emissions in Guangdong Province under five scenarios. Effective predictions can be made for agricultural carbon emissions in Guangdong Province, which are expected to fluctuate between 11,142,200 tons and 11,386,000 tons in 2030. And compared with other machine learning and neural network models, the Isomap–ACO–ET model has a better prediction performance with an MSE of 0.00018 and an accuracy of 98.7%. To develop low-carbon agriculture in Guangdong Province, we should improve farming methods, reduce the intensity of agrochemical application, strengthen the development and promotion of agricultural energy-saving and emission reduction technologies and low-carbon energy sources, reduce the intensity of carbon emissions from agricultural energy consumption, optimize the agricultural planting structure, and develop green agricultural products and agro-ecological tourism according to local conditions. This will promote the development of agriculture in Guangdong Province in a green and sustainable direction. [ABSTRACT FROM AUTHOR]

Imbalances in electrolyte concentrations can have severe consequences, but accurate and accessible measurements could improve patient outcomes. The current measurement method based on blood tests is accurate but invasive and time-consuming and is often unavailable for example in remote locations or an ambulance setting. In this paper, we explore the use of deep neural networks (DNNs) for regression tasks to accurately predict continuous electrolyte concentrations from electrocardiograms (ECGs), a quick and widely adopted tool. We analyze our DNN models on a novel dataset of over 290,000 ECGs across four major electrolytes and compare their performance with traditional machine learning models. For improved understanding, we also study the full spectrum from continuous predictions to a binary classification of extreme concentration levels. Finally, we investigate probabilistic regression approaches and explore uncertainty estimates for enhanced clinical usefulness. Our results show that DNNs outperform traditional models but model performance varies significantly across different electrolytes. While discretization leads to good classification performance, it does not address the original problem of continuous concentration level prediction. Probabilistic regression has practical potential, but our uncertainty estimates are not perfectly calibrated. Our study is therefore a first step towards developing an accurate and reliable ECG-based method for electrolyte concentration level prediction—a method with high potential impact within multiple clinical scenarios. [ABSTRACT FROM AUTHOR]

Deep neural networks have achieved remarkable success in various fields. However, training an effective deep neural network still poses challenges. This paper aims to propose a method to optimize the training effectiveness of deep neural networks, with the goal of improving their performance. Firstly, based on the observation that parameters (weights and bias) of deep neural network change in certain rules during training process, the potential of parameters prediction for improving training efficiency is discovered. Secondly, the potential of parameters prediction to improve the performance of deep neural network by noise injection introduced by prediction errors is revealed. And then, considering the limitations comprehensively, a deep neural network Parameters Linear Prediction method is exploit. Finally, performance and hyperparameter sensitivity validations are carried out on some representative backbones. Experimental results show that by employing proposed Parameters Linear Prediction method, as opposed to SGD, has led to an approximate 1% increase in accuracy for optimal model, along with a reduction of about 0.01 in top-1/top-5 error. Moreover, it also exhibits stable performance under various hyperparameter settings, shown the effectiveness of the proposed method and validated its capacity in enhancing network's training efficiency and performance. [ABSTRACT FROM AUTHOR]

We present the first machine learning-based autonomous hyperspectral neutron computed tomography experiment performed at the Spallation Neutron Source. Hyperspectral neutron computed tomography allows the characterization of samples by enabling the reconstruction of crystallographic information and elemental/isotopic composition of objects relevant to materials science. High quality reconstructions using traditional algorithms such as the filtered back projection require a high signal-to-noise ratio across a wide wavelength range combined with a large number of projections. This results in scan times of several days to acquire hundreds of hyperspectral projections, during which end users have minimal feedback. To address these challenges, a golden ratio scanning protocol combined with model-based image reconstruction algorithms have been proposed. This novel approach enables high quality real-time reconstructions from streaming experimental data, thus providing feedback to users, while requiring fewer yet a fixed number of projections compared to the filtered back projection method. In this paper, we propose a novel machine learning criterion that can terminate a streaming neutron tomography scan once sufficient information is obtained based on the current set of measurements. Our decision criterion uses a quality score which combines a reference-free image quality metric computed using a pre-trained deep neural network with a metric that measures differences between consecutive reconstructions. The results show that our method can reduce the measurement time by approximately a factor of five compared to a baseline method based on filtered back projection for the samples we studied while automatically terminating the scans. [ABSTRACT FROM AUTHOR]

When processing language, the brain is thought to deploy specialized computations to construct meaning from complex linguistic structures. Recently, artificial neural networks based on the Transformer architecture have revolutionized the field of natural language processing. Transformers integrate contextual information across words via structured circuit computations. Prior work has focused on the internal representations ("embeddings") generated by these circuits. In this paper, we instead analyze the circuit computations directly: we deconstruct these computations into the functionally-specialized "transformations" that integrate contextual information across words. Using functional MRI data acquired while participants listened to naturalistic stories, we first verify that the transformations account for considerable variance in brain activity across the cortical language network. We then demonstrate that the emergent computations performed by individual, functionally-specialized "attention heads" differentially predict brain activity in specific cortical regions. These heads fall along gradients corresponding to different layers and context lengths in a low-dimensional cortical space. The extent to which transformer-based language models provide a good model of human brain activity during natural language comprehension is unclear. Here, the authors show that the internal transformations performed by the network predict brain activity in cortical language network as measured by fMRI. [ABSTRACT FROM AUTHOR]

One of the focal points in the field of intelligent transportation is the intelligent control of traffic signals (TS), aimed at enhancing the efficiency of urban road networks through specific algorithms. Deep Reinforcement Learning (DRL) algorithms have become mainstream, yet they suffer from inefficient training sample selection, leading to slow convergence. Additionally, enhancing model robustness is crucial for adapting to diverse traffic conditions. Hence, this paper proposes an enhanced method for traffic signal control (TSC) based on DRL. This approach utilizes dueling network and double q-learning to alleviate the overestimation issue of DRL. Additionally, it introduces a priority sampling mechanism to enhance the utilization efficiency of samples in memory. Moreover, noise parameters are integrated into the neural network model during training to bolster its robustness. By representing high-dimensional real-time traffic information as matrices, and employing a phase-cycled action space to guide the decision-making of intelligent agents. Additionally, utilizing a reward function that closely mirrors real-world scenarios to guide model training. Experimental results demonstrate faster convergence and optimal performance in metrics such as queue length and waiting time. Testing experiments further validate the method's robustness across different traffic flow scenarios. [ABSTRACT FROM AUTHOR]

Spectroscopic techniques generate one-dimensional spectra with distinct peaks and specific widths in the frequency domain. These features act as unique identities for material characteristics. Deep neural networks (DNNs) has recently been considered a powerful tool for automatically categorizing experimental spectra data by supervised classification to evaluate material characteristics. However, most existing work assumes balanced spectral data among various classes in the training data, contrary to actual experiments, where the spectral data is usually imbalanced. The imbalanced training data deteriorates the supervised classification performance, hindering understanding of the phase behavior, specifically, sol-gel transition (gelation) of soft materials and glycomaterials. To address this issue, this paper applies a novel data augmentation method based on a generative adversarial network (GAN) proposed by the authors in their prior work. To demonstrate the effectiveness of the proposed method, the actual imbalanced spectral data from Pluronic F-127 hydrogel and Alpha-Cyclodextrin hydrogel are used to classify the phases of data. Specifically, our approach improves 8.8%, 6.4%, and 6.2% of the performance of the existing data augmentation methods regarding the classifier's F-score, Precision, and Recall on average, respectively. Specifically, our method consists of three DNNs: the generator, discriminator, and classifier. The method generates samples that are not only authentic but emphasize the differentiation between material characteristics to provide balanced training data, improving the classification results. Based on these validated results, we expect the method's broader applications in addressing imbalanced measurement data across diverse domains in materials science and chemical engineering. [ABSTRACT FROM AUTHOR]

Safe and efficient navigation is critical for a mobile robot in a highly constrained workspace. Autonomous navigation is to be performed safely and robustly in the environment map with obstacles of various geometric shapes, sizes and colors positioned at random locations. In this paper, we present an approach to perform autonomous navigation by detecting the obstacles in the map and by generating auxiliary collision-free waypoints in obstacle-free space map. In achieving this, the object detection is done using SSDMobileNetV2 model and auxiliary collision-free navigation waypoints are generated using the Deepway neural network model. Further, the RRT path planner is applied to analyze the waypoints generated and to find the a global path between start and goal locations. An optimal local path is achieved using the A* path planner. Extensive simulations of various scenarios are performed and the proposed model is evaluated. The results reveal that the proposed model achieves significant improvements in terms of time, distance and F1-score. [ABSTRACT FROM AUTHOR]

The rising population of millennials, coupled with Digital Assistants (DA) and online purchasing trends among consumers have gained increasing attention by global marketers. The study evaluates the influence of DA attributes on the purchasing intention (PUI) of millennials. A combined approach of PLS-SEM, Artificial Neural Network (ANN) and Fuzzy-set Qualitative Comparative Analysis (fsQCA) is used to predict the PUI of 345 millennials. Also, multi-group analysis is employed to uncover the influence of gender on the relationship between PUI and DA attributes. The findings suggest that DA attributes may amplify purchasing intention among millennials, especially through perceived interactivity and anthropomorphism. Further, the moderating role of gender was found significant on the inter-relationship of perceived interactivity and PUI. This research is a pioneer study in the area of artificial intelligence, conversational commerce, DA and AI-powered chatbots. This study will help marketers and practitioners to predict millennial purchasing intentions. An evaluation of this paper may help them to foster immersive and effective engagement through DA. [ABSTRACT FROM AUTHOR]

Hardware such as multipliers and dividers is necessary for all electronic systems. This paper explores Vedic mathematics techniques for high-speed and low-area multiplication. In the study of multiplication algorithms, various bits-width ranges of the Anurupyena sutra are used. Parallelism is employed to address challenging problems in recent studies. Various designs have been developed for the Field Programmable Gate Array (FPGA) implementation employing Very Large-Scale integration (VLSI) design approaches and parallel computing technology. Signal processing, machine learning, and reconfigurable computing research should be closely monitored as artificial intelligence develops. Multipliers and adders are key components of deep learning algorithms. The multiplier is an energy-intensive component of signal processing in Arithmetic Logic Unit (ALU), Convolutional Neural Networks (CNN), and Deep Neural Networks (DNN). For the DNN, this method introduces the Booth multiplier blocks and the carry-save multiplier in the Anurupyena architecture. Traditional multiplication methods like the array multiplier, Wallace multiplier, and Booth multiplier are contrasted with the Vedic mathematics algorithms. On a specific hardware platform, Vedic algorithms perform faster, use less power, and take up less space. Implementations were carried out using Verilog HDL and Xilinx Vivado 2019.1 on Kintex-7. The area and propagation delay were reduced compared to other multiplier architectures. [ABSTRACT FROM AUTHOR]

Recently, the pandemic caused by COVID-19 is severe in the entire world. The prevention and control of crimes associated with COVID-19 are critical for controlling the pandemic. Therefore, to provide efficient and convenient intelligent legal knowledge services during the pandemic, we develop an intelligent system for legal information retrieval on the WeChat platform in this paper. The data source we used for training our system is "The typical cases of national procuratorial authorities handling crimes against the prevention and control of the new coronary pneumonia pandemic following the law", which is published online by the Supreme People's Procuratorate of the People's Republic of China. We base our system on convolutional neural network and use the semantic matching mechanism to capture inter-sentence relationship information and make a prediction. Moreover, we introduce an auxiliary learning process to help the network better distinguish the relation between two sentences. Finally, the system uses the trained model to identify the information entered by a user and responds to the user with a reference case similar to the query case and gives the reference legal gist applicable to the query case. [ABSTRACT FROM AUTHOR]

Knowledge distillation can transfer the knowledge from the pre-trained teacher model to the student model, thus effectively accomplishing model compression. Previous studies have carefully crafted knowledge representation, targeting loss function design, and distillation location selection, but there have been few studies on the role of classifiers in distillation. Previous experiences have shown that the final classifier of the model has an essential role in making inferences, so this paper attempts to narrow the gap in performance between models by having the student model directly use the classifier of the teacher model for the final inference, which requires an additional projector to help match features of the student encoder with the teacher's classifier. However, a single projector cannot fully align the features, and integrating multiple projectors may result in better performance. Considering the balance between projector size and performance, through experiments, we obtain the size of projectors for different network combinations and propose a simple method for projector integration. In this way, the student model undergoes feature projection and then uses the classifiers of the teacher model for inference, obtaining a similar performance to the teacher model. Through extensive experiments on the CIFAR-100 and Tiny-ImageNet datasets, we show that our approach applies to various teacher–student frameworks simply and effectively. [ABSTRACT FROM AUTHOR]

Identifying and preventing malicious network behavior is a challenge for establishing a secure network communication environment or system. Malicious activities in a network system can seriously threaten users' privacy and potentially jeopardize the entire network infrastructure and functions. Furthermore, cyber-attacks have grown in complexity and number due to the ever-evolving digital landscape of computer and network devices in recent years. Analyzing network traffic using network intrusion detection systems (NIDSs) has become an integral security measure in modern networks to identify malicious and suspicious activities. However, most intrusion detection datasets contain imbalance classes, making it difficult for most existing classifiers to achieve good performance. In this paper, we propose a double-layer feature extraction and feature fusion technique (CNN-GRU-FF), which uses a modified focal loss function instead of the traditional cross-entropy to handle the class imbalance problem in the IDS datasets. We use the NSL-KDD and UNSW-NB15 datasets to evaluate the effectiveness of the proposed model. From the research findings, it is evident our CNN-GRU-FF method obtains a detection rate of 98.22% and 99.68% using the UNSW-NB15 and NSL-KDD datasets, respectively while maintaining low false alarm rates on both datasets. We compared the proposed model's performance with seven baseline algorithms and other published methods in literature. It is evident from the performance results that our proposed method outperforms the state-of-the-art network intrusion detection methods. [ABSTRACT FROM AUTHOR]

Rock strength parameters such as uniaxial compressive strength and modulus of elasticity are crucial parameters in designing rock engineering structures. Owing to the importance of the aforementioned parameters, in this paper, image processing technique is coupled with artificial neural network (ANN) method for assessing the uniaxial compressive strength and modulus of elasticity of sandstones. For this reason, 102 core sandstone samples were prepared. Subsequently petrographic analyses and imaging operation for 102 images were performed. Principal component analysis was then conducted for feature reduction purposes. At last, an ANN model, which received its input data from image processing technique, was constructed for assessing the UCS and E of sandstone samples. Overall, the best performance of the network was obtained when 10 hidden nodes were used. The correlation coefficient (R) values of 0.9722 and 0.97062 for UCS and E, respectively, suggest the feasibility of the proposed model. [ABSTRACT FROM AUTHOR]