Search

Abstract: In this study, the determinability of time related colour changes in prints made using ink that dries on matte coated paper with the offset printing technique and infrared method, has been investigated with artifical neural networks after analysis of the experimental and numerical methods. In the experimental part a ECI 2002 CMYK test scale is printed on a 135g/m2 matte coated. The prints obtained were measured with a spectrophotometer at certain intervals and by converting the reflection data obtained into the CIELAB colour description spectrum, time related changes in printed colours have been determined. In the empirical study however, colour changes in prints made on matte coated paper using inks that dry with the infrared method are modelled numerically. The average deviation has been found to be 0.4%. As a result, artificial neural networks can be used with the aim to digitally calculate time related colour changes in the offset printing system. [Copyright &y& Elsevier]

This paper presents a fuzzy neural network predictive control scheme for studying the coagulation process of wastewater treatment in a paper mill. An adaptive fuzzy neural network is employed to model the nonlinear relationships between the removal rate of pollutants and the chemical dosages, in order to adapt the system to a variety of operating conditions and acquire a more flexible learning ability. The system includes a fuzzy neural network emulator of the reaction process, a fuzzy neural network controller, and an optimization procedure based on a performance function that is used to identify desired control inputs. The gradient descent algorithm method is used to realize the optimization procedure. The results indicate that reasonable forecasting and control performances have been achieved through the developed system. [Copyright &y& Elsevier]

As one of the most critical variables in the hot rolling process, the accuracy of rolling force prediction is directly associated with production stability and product quality. Purely data-driven approaches, however, are severely constrained by the quantity and quality of data, posing challenges for further enhancing the accuracy of rolling force prediction. In this paper, a theory fusion deep neural network (DNN) modelling approach was proposed and applied to the prediction of rolling force during hot plate rolling. In terms of model establishment, the novel NN structure was designed in consideration of the rolling mechanism, and senior variable inputs were added at shallow locations in the network to reduce the loss of critical information. In terms of model training, the method of using rolling theory to guide the initialization of the model was proposed to enable the model to learn the theoretical features more completely in the pre-training phase. Finally, a method to optimize the overall structure of the model using the sparrow search algorithm (SSA) was proposed to ensure the best prediction performance. The model was tested with the data in the developed platform, and the results indicated that the proposed method achieves the best accuracy and stability in this paper, and the response relationship between model inputs and output was consistent with existing theoretical knowledge. Thus, the model can be trusted and flexibly applied to the actual manufacturing processes. [ABSTRACT FROM AUTHOR]

Transformers are Deep Neural Networks (DNN) that utilize a self-attention mechanism to capture contextual relationships within sequential data. Unlike traditional neural networks and variants of Recurrent Neural Networks (RNNs), such as Long Short-Term Memory (LSTM), Transformer models excel at managing long dependencies among input sequence elements and facilitate parallel processing. Consequently, Transformer-based models have garnered significant attention from researchers in the field of artificial intelligence. This is due to their tremendous potential and impressive accomplishments, which extend beyond Natural Language Processing (NLP) tasks to encompass various domains, including Computer Vision (CV), audio and speech processing, healthcare, and the Internet of Things (IoT). Although several survey papers have been published, spotlighting the Transformer's contributions in specific fields, architectural disparities, or performance assessments, there remains a notable absence of a comprehensive survey paper that encompasses its major applications across diverse domains. Therefore, this paper addresses this gap by conducting an extensive survey of proposed Transformer models spanning from 2017 to 2022. Our survey encompasses the identification of the top five application domains for Transformer-based models, namely: NLP, CV, multi-modality, audio and speech processing, and signal processing. We analyze the influence of highly impactful Transformer-based models within these domains and subsequently categorize them according to their respective tasks, employing a novel taxonomy. Our primary objective is to illuminate the existing potential and future prospects of Transformers for researchers who are passionate about this area, thereby contributing to a more comprehensive understanding of this groundbreaking technology. • The paper presents a comprehensive survey on transformers for deep learning tasks. • The paper conducts a thorough analysis on highly effective models in five domains. • The paper classifies the models based on respective tasks using a proposed taxonomy. • The characteristics of the surveyed models are deeply explored and analyzed. • Future directions and challenges for transformer-based models are deciphered. [ABSTRACT FROM AUTHOR]

Breast cancer is one of the serious diseases that threaten the life of many women worldwide. The seriousness of this disease is that it is often discovered in late stages after a period of its occurrence. This causes a wide spread of the disease and difficulty in its treatment. Another important characteristic of this disease is that it can return again after a period of its treatment. Therefore, predicting the occurrence or recurrence of such disease early is the best solution to have a high cure rate. The main objective of this paper is to improve the prediction performance of the breast cancer recurrence. Many methods have been proposed to predict breast cancer recurrence. However, these methods did not achieve the desired results on one of the most famous datasets in the field of breast cancer recurrence's prediction (i.e., Wisconsin Prognosis Breast Cancer (WPBC) dataset). The highest accuracy achieved using the previous methods is 89.89%. Therefore, this paper provides a framework for improving the prediction of breast cancer recurrence. The proposed framework has the ability to overcome many of the challenges in the existing dataset such as: (a) the problem of imbalance between classes using a data over-sampling technique; and (b) the large number of data dimensions using Principal Component Analysis (PCA), and a wrapper dimensionality reduction technique based on Genetic Algorithm (GA). It also uses the neural network algorithm to fuse the results of two individual classifiers (i.e., Random Forest (RF) and Support Vector Machine (SVM)). Our proposed framework evaluation showed a significant improvement in the predication performance. It achieved an accuracy of 98.3%, area under the curve of 99%, and precision, recall, and f1-measure of 98%. [ABSTRACT FROM AUTHOR]

Cardiovascular diseases are currently the major causes of death globally. Among the strategies to prevent cardiovascular issues, the automated classification of heart sound abnormalities is an efficient way to detect early signs of cardiac conditions leading to heart failure or other, even asymptomatic, complications, quite effective for timely interventions. Despite the significant improvements in this field, there are still limitations due to the lack of solutions, available data-sets and poor (mainly binary — normal vs abnormal) classification models and algorithms. This paper presents a Medical Cyber–Physical System (MCPS) for the automatic classification of heart valve diseases onsite, in a timely manner. The proposed MCPS, indeed, can be deployed into personal and mobile devices, addressing the limitations of existing solutions for patients, healthcare practitioners, and researchers, through an efficient and easy accessible tool. It combines different neural network models trained on a new Italian dataset of 132 adult patients covering 9 heart sound categories (1 normal and 8 abnormal), also validated against two main open-access (Physionet/CinC Challenge 2016 and Korean) datasets. The overall MCPS performance (time, processing and energy resource utilization) and the high accuracy of the models (up to 98%) demonstrated the feasibility of the proposed solution, even with few data. The dataset supporting the findings of this paper is available upon request to the authors. • DB of 132 heart sounds of Italian patients in 9 categories, available upon request. • MCPS for automated HVD classification via hierarchical ML model structures. • Compared six ML classifiers (RF, SVM, NB, LR, DNN, LSTM) for HVD and majority voting. • MCPS validated on two open access datasets (Physionet/CinC 2016 and Korean). • Time, processing and energy efficiency of MCPS validated, with usage guidelines. [ABSTRACT FROM AUTHOR]

Marine ecosystems and their fish habitats are becoming increasingly important due to their integral role in providing a valuable food source and conservation outcomes. Due to their remote and difficult to access nature, marine environments and fish habitats are often monitored using underwater cameras to record videos and images for understanding fish life and ecology, as well as for preserve the environment. There are currently many permanent underwater camera systems deployed at different places around the globe. In addition, there exists numerous studies that use temporary cameras to survey fish habitats. These cameras generate a massive volume of digital data, which cannot be efficiently analysed by current manual processing methods, which involve a human observer. Deep Learning (DL) is a cutting-edge Artificial Intelligence (AI) technology that has demonstrated unprecedented performance in analysing visual data. Despite its application to a myriad of domains, its use in underwater fish habitat monitoring remains under explored. In this paper, we provide a tutorial that covers the key concepts of DL, which help the reader grasp a high-level understanding of how DL works. The tutorial also explains a step-by-step procedure on how DL algorithms should be developed for challenging applications such as underwater fish monitoring. In addition, we provide a comprehensive survey of key deep learning techniques for fish habitat monitoring including classification, counting, localisation, and segmentation. Furthermore, we survey publicly available underwater fish datasets, and compare various DL techniques in the underwater fish monitoring domains. We also discuss some challenges and opportunities in the emerging field of deep learning for fish habitat processing. This paper is written to serve as a tutorial for marine scientists who would like to grasp a high-level understanding of DL, develop it for their applications by following our step-by-step tutorial, and see how it is evolving to facilitate their research efforts. At the same time, it is suitable for computer scientists who would like to survey state-of-the-art DL-based methodologies for fish habitat monitoring. • Marine environments and fish habitats are widely surveyed using underwater cameras. • Deep learning (DL) offers an effective solution for processing underwater videos. • We write a tutorial on the key concepts and steps of DL for underwater monitoring. • We provide a survey of key DL-based visual fish monitoring methods/datasets. • We shed light on challenges/opportunities of DL for underwater fish monitoring. [ABSTRACT FROM AUTHOR]

• Proposing MANFA – a customized CNN model for manipulated face detection. • Integrating XGBoost, and AdaBoost with MANFA to cope with the extreme imbalanced dataset. • Proposing a manually collected dataset (8950 images) for altered face detection. Facial image manipulation is a particular instance of digital image tampering, which is done by compositing a region from one facial image into another facial image. Fake images generated by facial image manipulation now spread like wildfire on news websites and social networks, and are considered the greatest threat to press freedom. Previous research relied heavily on handcrafted features to analyze tampered regions which were inefficient and time-consuming. This paper introduces a framework that accurately detects manipulated face image using deep learning approach. The original contributions of this paper include (1) a customized convolutional neural network model for Manipulated Face (MANFA) identification; it contains several convolutional layers that effectively extract features of multi-levels of abstraction from a tampered region. (2) A hybrid framework (HF-MANFA) that uses Adaptive Boosting (AdaBoost) and eXtreme Gradient Boosting (XGBoost) to deal with the imbalanced dataset challenge. (3) A large manipulated face dataset that is manually collected and validated. The results from various experiments proved that proposed models outperformed existing expert and intelligent systems which were usually used for the manipulated face image detection task in terms of area under the curve (AUC), computational complexity, and robustness against imbalanced datasets. As a result, the presented framework will motivate the finding of a more powerful altered face images detection method and encourages the integration of the proposed model in applications that have to deal with manipulated images regularly. [ABSTRACT FROM AUTHOR]

Highlights • This paper suggests two methods based on AI tools for medical image segmentation. • The first method uses CBR to guide a region-growing process for segmentation. • The second method based on Deep Learning performs segmentation with a small data set. • Both methods were tested on CT-scans images from children with tumoral kidneys. • They provided accurate enough results to consider an automatic. segmentation Abstract Most often, image segmentation is not fully automated and a user is required to lead the process in order to obtain correct results. In a medical context, segmentation can furnish much information to surgeons, but this task is rarely executed. Artificial Intelligence (AI) is a powerful approach for devising a viable solution to fully automated treatment. In this paper, we have focused on kidneys deformed by nephroblastoma. However, a frequent medical constraint is encountered which is a lack of sufficient data with which to train our system. In function of this constraint, two AI approaches were used to segment these structures. First, a Case Based Reasoning (CBR) approach was defined which can enhance the growth of regions for segmentation of deformed kidneys using an adaptation phase to modify coordinates of recovered seeds. This CBR approach was confronted with manual region growing and a Convolutional Neural Network (CNN). The CBR system succeeded in performing the best segmentation for the kidney with a mean Dice of 0.83. Deep Learning was then examined as a possible solution, using the latest performing networks for image segmentation. However, for relevant efficiency, this method requires a large data set. An option would be to manually segment only certain representative slices from a patient and then use them to train a Convolutional Neural Network (CNN) how to segment. In this article the authors propose an evaluation of a CNN for medical image segmentation following different training sets with a variable number of manual segmentations. To choose slices to train the CNN, an Overlearning Vector for Valid Sparse SegmentatIONs (OV 2 ASSION) was used, with the notion of gap between two slices from the training set. This protocol made it possible to obtain reliable segmentations of per patient with a small data set and to determine that only 26% of initial segmented slices are required to obtain a complete segmentation of a patient with a mean Dice of 0.897. [ABSTRACT FROM AUTHOR]

The conventional standardized theoretical models (such as Webster, Alcelik, Indo-HCM) used for the delay estimation revolve around the mathematical hypothesis and assumptions, making them static with limitations in accommodating the dynamic traffic behaviors. Recent advances in artificial intelligence make machine learning techniques suitable for estimating vehicle control delay compared to conventional methods. This paper demonstrates the application of several machine learning models developed by focusing on the fluctuations of traffic observed at an intersection having heterogeneous traffic conditions in Ahmedabad city for delay estimation. Several parameters are extracted from on-field and video surveys. However, not all parameters are relevant for accurately estimating vehicle control delay. Hence, a feature selection process consisting of several feature-scoring techniques from filter, wrapper, and embedded methods is applied to all the parameters. This process gave insights into the most statistically relevant independent parameters, and out of all the parameters, cycle time was found to be insignificant, with a feature score of 0 from almost all techniques. Hence, it was removed, and then the prominent parameters were then used to build a vehicle control delay model using support vector regression (SVR), K-nearest neighbor (KNN), artificial neural network (ANN), random forest regression (RF), and decision tree regression (DT). Error distribution, standard deviation of errors, coefficient of Determination (R2), and Root Mean Squared Error (RMSE) are the parameters used for evaluating the performance of the machine learning models. RF outperformed them all with a standard deviation of errors, R2, and RMSE of 11.065, 0.926, and 11.081 on testing data. But ANN, KNN, and DT also performed satisfactorily. Compared with conventional standardized theoretical models, all the machine learning models except SVR performed better. [ABSTRACT FROM AUTHOR]

Medical image analysis, particularly the segmentation of White Blood Cells (WBCs), holds critical importance in scrutinizing the quantity and morphology of these cells in smear images, a pivotal step in disease detection. Existing methodologies often fall short in differentiating between healthy and diseased WBCs, emphasizing color components over internal organizational nuances and external morphologies. This paper presents a pioneering contribution through the introduction of an encoder-decoder deep neural network with an indeterminacy fusion-based model explicitly designed for WBC extraction from blood images. In contrast to prior studies, our approach addresses the inadequacies by delving into the intricacies of WBC structure, characterizing object indeterminacy within the neutrosophic set domain. The encoder-decoder network is fortified by integrating WBC indeterminacy as a fusion component, enabling the segmentation of WBCs into distinct nucleus and cytoplasm regions. The efficacy of our methodology is evaluated across three datasets with varying resolutions. Quantitative metrics such as segmentation accuracy and intersection over union (IoU) are employed to assess the proposed network's performance, which consistently outperforms three original encoder-decoder networks. Notably, our model achieves commendable precision rates, with the highest mean segmentation accuracy reaching 0.95301 across the three datasets. These results underscore the enhanced performance of our segmentation network, attributing its success to the influential role of indeterminacy fusion in augmenting conventional segmentation methods. In summary, this work not only introduces a novel solution for WBC segmentation but establishes its superiority over existing methods. The interpretive insights gained from the results highlight the potential of indeterminacy fusion to drive advancements in the realm of medical image segmentation, emphasizing originality, significance, and superior performance metrics. [ABSTRACT FROM AUTHOR]

Research on automatic translation of sign language to verbal languages has been progressively explored in recent years to assist speech and hearing-impaired people in communicating with non-signers. In this paper, a tiny machine learning (TinyML) solution is proposed for sign language recognition using a low-cost, wearable, internet-of things (IoT) device. A lightweight deep neural network is deployed on the edge device to interpret isolated signs from the Indian sign language using the time-series data collected from the motion sensors of the device. The scarcity of labeled training data is addressed by employing the deep transfer learning approach. Here, the knowledge gained from the data collected using the motion sensors of a different device is used to initialize the model parameters. The performance of the model is assessed in terms of classification accuracy and prediction time for different sampling rates and transferring schemes. The model achieves an average accuracy of 87.18% when all the parameters are retrained with just 4 observations of each sign recorded from the motion sensors of the proposed IoT device. The recognized sign is transmitted to a cloud platform in real-time. A mobile application, SignTalk , is also developed, which wirelessly receives the predicted signs from the cloud and displays it as text. Additionally, text-to-speech conversion is also provided on SignTalk to vocalize the predicted sign for better communication. [ABSTRACT FROM AUTHOR]

Skin diseases are reported to contribute 1.79% of the global burden of disease. The accurate diagnosis of specific skin diseases is known to be a challenging task due, in part, to variations in skin tone, texture, body hair, etc. Classification of skin lesions using machine learning is a demanding task, due to the varying shapes, sizes, colors, and vague boundaries of some lesions. The use of deep learning for the classification of skin lesion images has been shown to help diagnose the disease at its early stages. Recent studies have demonstrated that these models perform well in skin detection tasks, with high accuracy and efficiency. Our paper proposes an end-to-end framework for skin lesion classification, and our contributions are two-fold. Firstly, two fundamentally different algorithms are proposed for segmenting and extracting features from images during image preprocessing. Secondly, we present a deep convolutional neural network model, S-MobileNet that aims to classify 7 different types of skin lesions. We used the HAM10000 dataset, which consists of 10000 dermatoscopic images from different populations and is publicly available through the International Skin Imaging Collaboration (ISIC) Archive. The image data was preprocessed to make it suitable for modeling. Exploratory data analysis (EDA) was performed to understand various attributes and their relationships within the dataset. A modified version of a Gaussian filtering algorithm and SFTA was applied for image segmentation and feature extraction. The processed dataset was then fed into the S-MobileNet model. This model was designed to be lightweight and was analyzed in three dimensions: using the Relu Activation function, the Mish activation function, and applying compression at intermediary layers. In addition, an alternative approach for compressing layers in the S-MobileNet architecture was applied to ensure a lightweight model that does not compromise on performance. The model was trained using several experiments and assessed using various performance measures, including, loss, accuracy, precision, and the F1-score. Our results demonstrate an improvement in model performance when applying a preprocessing technique. The Mish activation function was shown to outperform Relu. Further, the classification accuracy of the compressed S-MobileNet was shown to outperform S-MobileNet. To conclude, our findings have shown that our proposed deep learning-based S-MobileNet model is the optimal approach for classifying skin lesion images in the HAM10000 dataset. In the future, our approach could be adapted and applied to other datasets, and validated to develop a skin lesion framework that can be utilized in real-time. [ABSTRACT FROM AUTHOR]

Sequential recommendation aims to predict future user interactions by analyzing dynamic patterns within their historical behavior sequences. Deep neural networks have recently become popular for learning representations of these sequences in the time domain. However, representing users' intentions in the time domain faces challenges such as noise in interactions and sparsity of data. Contrastive learning and representation learning in the frequency domain can mitigate these issues from different perspectives. In this paper, to fully integrate time-domain sequence representations, frequency-domain sequence representations and contrastive learning based on them, we propose a model called T ime– F requency C onsistency based contrastive learning for S equential Rec ommendation (TFCSRec). TFCSRec utilizes a time-domain encoder with a fully connected network and a filter network to extract high-order features and catch pure sequential patterns. Then, a learnable frequency-domain encoder with a recurrent neural network is designed to capture sequential characteristics in the frequency-domain space. Finally, TFCSRec combines a recommendation task and two contrastive learning tasks to optimize the two user representation encoders. Its contrastive learning is designed to minimize a contrastive regularization loss and a time–frequency consistency loss, which for the first time is constructed directly on the time-domain sequence representation and the frequency-domain sequence representation. Experiments on five benchmark datasets show that the proposed TFCSRec model outperforms other sequential recommendation models based on deep neural networks. • Design a time-domain encoder with a filter to extract sequential patterns. • Devise a learnable frequency-domain encoder to capture sequential characteristics. • Propose a time–frequency consistency based contrastive loss for the first time. [ABSTRACT FROM AUTHOR]

• The proposed method had fused multi-level information compensation and U-Net. • The module designed for multi-level information compensation and compression. • The method had fused compressed features and correlation features. Recently, Deep Convolutional Neural Networks have demonstrated high-quality reconstruction in image super-resolution procedure. In this paper, we propose improved image super-resolution reconstruction via multi-level information compensation and U-Net network to address the problem that the image super-resolution reconstruction algorithm based on deep neural networks tends to lose feature information in the feature extraction process, resulting in the lack of texture and edge details in the reconstructed image. Firstly, we design the U-net like network for image super-resolution reconstruction, which performs multi-level feature extraction and channel compression for the input features through the down-channel branch. It fuses the compressed features and extracts the correlation features of different channels through the bottom module, and performs multi-level feature extraction and channel recovery for the compressed correlation features through the up-channel branch. The multi-level information compensation model is then designed to compensate for the information lost in the channel compression process and the information that is difficult to recover in the channel recovery process of U-net like network. The experimental results can show that the proposed algorithm achieves a significant improvement in Peak Signal-to-Noise Ratio and Structure Similarity Index and visual effect compared with the state-of-arts algorithms. The average experimental results of PSNR from proposed method had improved by 1.63 dB, 1.53 dB, 0.97 dB and 0.94 dB compared to SRCNN, HAT, DAT and CARN, respectively. [ABSTRACT FROM AUTHOR]

Remote sensing applications, such as detection and recognition of objects, need a large number of high spatial resolution (HR) images. As a feasible technique, image fusion is considered to produce HR images. However, most of remote sensing image fusion methods based on deep neural network (DNN) are mainly limited by the extraction of spatial and spectral features. These methods ignore the redundancy among these features, which causes spatial and spectral distortions in the fused image. In this paper, we propose a novel image fusion method based on a triple disentangled network (TDNet) with dual attention to reduce the redundancy in the extracted features. In the proposed method, it is assumed that the information in panchromatic (PAN) and low spatial resolution multispectral (LRMS) images can be encoded as the spatial, spectral, and common features. Specifically, we construct a triple-stream network to extract these features. To efficiently model the spatial and spectral information in PAN and LRMS images, local–global attention and interdependency attention are designed and integrated into the network. Then, the redundancy among these features is reduced by disentangled learning, in which these features are recombined to reconstruct the PAN and LRMS images. Besides, these features should complement each other. So, we utilize the maximal coding rate reduction to balance the redundancy and complementarity among them. Finally, all features are recombined to synthesize the high spatial resolution multispectral image. The experimental results demonstrate that the proposed TDNet has a superior performance in terms of qualitative and quantitative evaluations. The code link is https://github.com/RSMagneto/TDNet. • A triple disentangled network with dual attention is proposed for image fusion. • MCR loss is designed to disentangle spatial, spectral and common features in images. • The local–global spatial similarity is captured by the proposed SLGA module. • The spectral correlation among the LRMS image is modeled by the proposed SID module. [ABSTRACT FROM AUTHOR]

Fine-tuning and mask-tuning (or prompt tuning) are two approaches to construct deep neural networks for entity and relation extraction. Fine-tuning based models optimize neural networks with task-relevant objective, in which pre-trained language models (PLMs) are mainly used as external resources to support word embedding. In mask-tuning models, neural networks is optimized by the same pre-training objective in a PLM, which directly outputs verbalized entity type representations. It is effective to utilize potential knowledge of PLMs. In this paper, we propose a recollect-tuning approach, which jointly makes full use of the mechanisms of both fine-tuning and mask-tuning. In this approach, the recollect-tuning iteratively masks tokens in a possible entity span. The classification is based on both the masked token representation and the entity span representation. It is the same as the process to make a decision based on incomplete information. In the training process, the deep network is optimized by task-relevant objective, which strengthens the semantic representation of each entity span. It is effective to learn entity noise-invariant features and take full advantage of potential knowledge of PLMs. Our method is evaluated on three public benchmarks (the ACE 2004, ACE 2005 and SciERC datasets) for the entity and relation extraction task. The result shows significant improvement in the two tasks, outperforming the state-of-the-art performance on ACE04, ACE05 and SciERC by +0.4%, +0.6%, and +0.5%, respectively. • A unified framework combines fine-tuning and mask-tuning for NER and RE extraction. • A recollect-tuning approach proposed can learn noise-invariant entity features. • A grouped mask attention is designed to model the inter-span token interaction. [ABSTRACT FROM AUTHOR]

Optical Character Recognition (OCR) is a method to convert a scanned photo of"handwritten character recognition (HCR) or printed character recognition (PCR)" into a form of digital text. HCR is a version of OCR, which is remarkably modeled to identify handwritten text, while PCR aims at printed text identification. The identification of handwritten characters and digits is more complicated as compared to PCR because of the diversities in human writing styles, stokes, thickness, and curves of characters. Similarly, achievements in several computer vision tasks consider the Convolutional Neural Networks (CNN) to give an end-to-end solution for HCR with huge success. However, the process of significant feature learning for the identification of images is complicated with little data. Hence, this paper aims to develop a new handwritten character and digit recognition model with the incorporation of a deep learning strategy. Initially, the data related to Indian languages are collected from the standard benchmark datasets. Then, the collected data are given into the feature extraction phase 1, where the ResNet 151 is used for extracting the feature set 1. Similarly, the data gathered are considered in the feature extraction phase 2, where the Optimal Ensemble Pattern extraction approach is developed with Local Binary Pattern (LBP), Local Gradient Patterns (LGP), Local Tetra Pattern (LTrP), and Local Vector Pattern (LVP) for extracting the significant patterns from the language data. These extracted patterns are given into the ResNet 151 for getting the feature set 2. Here, the features from ResNet 151 get optimized with the enhanced optimization algorithm with Fitness-based Sail Fish Optimizer (F-SFO). The obtained feature set 1 and optimal feature set 2 are concatenated for performing final recognition. At last, the HCR is done with the help of developed Bi-LSTM-DNN to achieve the enhanced and accurate recognition of handwritten characters of the Indian languages. The performances of character recognition are further improved with the parameter optimization in Bi-LSTM-DNN with the same enhanced F-SFO. Overall result analysis, the accuracy of the designed method attains 95.12%. [ABSTRACT FROM AUTHOR]

• A scheme to recognize the distraction level was proposed. • MLP-AutoEncoder and DPC algorithms were used to define distraction-level labels. • Factors affecting driver distraction level were explored with mixed-model analyses. • A distraction-level prediction model with stacking ensemble learning was made. Driver distraction-level recognition while performing secondary tasks in full-touch in-vehicle information systems (FTIVISs) is essential for the harmonious co-driving of human and intelligent vehicle systems. However, there has been little research on this topic. To respond to this issue, this paper proposes a distraction-level recognition framework with a combination of semi-supervised learning, unsupervised learning, and supervised learning. First, unsupervised learning and semi-supervised is used to divide the collected unlabeled samples of driving distraction behavior into three categories of distraction levels: high, medium, and low. Second, the factors influencing the distraction level are explored through a mixed model analysis. Finally, a stacking-based ensemble learning model is proposed to recognize the driver distraction level by supervised learning, with the influencing factors of the distraction level used as model input parameters. To improve the recognition performance of the stacking model, four heterogeneous classifiers selected as the base classifiers, and principal component analysis (PCA) is introduced in the base classifier layer, which improves the ability of the meta -classifier to process raw features based on overfitting resistance. We conducted a real road experiment under different road and FTIVIS task conditions, and the proposed model performed better than traditional machine learning models. In addition, the model exhibited the greatest advantage when the deep neural network (DNN) algorithm was used as the meta -classifier of the model, with a recognition accuracy of 92.5%. The study findings are significant for developing a human–machine co-driving control strategy and improving vehicle driving safety. [ABSTRACT FROM AUTHOR]

Highlights • Necessity of information augmentation in neural networks. • New interpretation of information-theoretic methods in neural networks. • New interpretation of SOM in creating new knowledge. • New learning methods for training multi-layered neural networks and for coping with the vanishing information problem. • Demonstration of improved generalization with excessive information. Abstract The present paper aims to show the necessity of information augmentation to cope with the natural decrease in information content in multi-layered neural networks. It is natural to make an effort to collect as much information as possible, because it is impossible to know which information is necessary or useful before learning. Thus, the present paper tries to force neural networks to form new network configurations to have as much information as possible, contrary to the conventional approach of information reduction, such as many types of regularization. For information augmentation, we use the self-organizing map (SOM), which can over-represent inputs and produce as many similar weights as possible. The method was applied to two data sets: the banknote authentication data set and the character recognition data set. In both experimental results, it was confirmed that redundant and excessive information generation in terms of the excessive number of connection weights was connected with improved generalization. [ABSTRACT FROM AUTHOR]

Highlights • An activation function with data-range-segment-wise nonlinear behavior is proposed. • Values of slope coefficients for the proposed function are evaluated empirically. • Proposed activation function is presented in adaptive and non-adaptive variants. • Performance of proposed function is evaluated against state-of-the-art. • Internal activation behavior and convergence characteristics are analyzed. Abstract Activation functions play a crucial role in discriminative capabilities of the deep neural networks. They are also one of the main reasons for revival of the neural networks. Although, recent activation functions provide solution to vanishing and exploding gradient problems, but they do not have sufficient capacity to model non-linear data. This paper proposes a novel activation function, which imparts neural networks with capability to model non-linear dependencies in data. Behavior of proposed activation function remains non-saturating even with non-linear structure. The activation function provides distinct activation behaviors to different data range segments. The paper presents two different variants of proposed function. The first, "linear sigmoidal activation" function is a fixed structure activation function with function coefficients defined at the start of model design. Whereas second, "adaptive linear sigmoidal activation" function is a trainable function which can adapt itself according to the complexity of the given data. Both of the proposed models are tested against the state of the art activation functions on benchmark datasets (CIFAR-10, MNIST, SVHN, FER-2013). The proposed activation function is able to outperforms every known activation functions in all the tests. [ABSTRACT FROM AUTHOR]

Highlights • Mammographic masses classification is dominated by ANN, SVM and KNN. • Grammars and syntactic approaches have not been used so far. • Genetic algorithm was the most used technique to reduce feature dimensionality. • Most of the published papers are database-dependent. • Results are not comparable due to the lack of a common benchmark. Abstract Breast cancer is one of the most common and deadliest cancers that affect mainly women worldwide, and mammography examination is one of the main tools to help early detection. Several papers have been published in the last decades reporting on techniques to automatically recognize breast cancer by analyzing mammograms. These techniques were used to create computer systems to help physicians and radiologists obtain a more precise diagnosis. The objective of this paper is to present an overview regarding the use of machine learning and pattern recognition techniques to discriminate masses in digitized mammograms. The main differences we found in the literature between the present paper and the other reviews are: 1) we used a systematic review method to create this survey; 2) we focused on mass classification problems; 3) the broad scope and spectrum used to investigate this theme, as 129 papers were analyzed to find out whether mass classification in mammograms is a problem solved. In order to achieve this objective, we performed a systematic review process to analyze papers found in the most important digital libraries in the area. We noticed that the three most common techniques used to classify mammographic masses are artificial neural network, support vector machine and k-nearest neighbors. Furthermore, we noticed that mass shape and texture are the most used features in classification, although some papers presented the usage of features provided by specialists, such as BI-RADS descriptors. Moreover, several feature selection techniques were used to reduce the complexity of the classifiers or to increase their accuracies. Additionally, the survey conducted points out some still unexplored research opportunities in this area, for example, we identified that some techniques such as random forest and logistic regression are little explored, while others, such as grammars or syntactic approaches, are not being used to perform this task. [ABSTRACT FROM AUTHOR]

Highlights • We address the hybrid flow shop to minimise makespan. • We propose two memory-based constructive heuristics. • We propose two constructive heuristics based on Johnson’s algorithm. • We conduct a comprehensive evaluation of a total of 20 heuristics. Abstract This paper addresses the hybrid flow shop scheduling problem to minimise makespan, a well-known scheduling problem for which many constructive heuristics have been proposed in the literature. Nevertheless, the state of the art is not clear due to partial or non homogeneous comparisons. In this paper, we review these heuristics and perform a comprehensive computational evaluation to determine which are the most efficient ones. A total of 20 heuristics are implemented and compared in this study. In addition, we propose four new heuristics for the problem. Firstly, two memory-based constructive heuristics are proposed, where a sequence is constructed by inserting jobs one by one in a partial sequence. The most promising insertions tested are kept in a list. However, in contrast to the Tabu search, these insertions are repeated in future iterations instead of forbidding them. Secondly, we propose two constructive heuristics based on Johnson’s algorithm for the permutation flowshop scheduling problem. The computational results carried out on an extensive testbed show that the new proposals outperform the existing heuristics. [ABSTRACT FROM AUTHOR]

Mobile crowdsensing is a recent model in which a group of mobile users uses their smart devices such as smartphones or wearable devices to cooperatively perform a large-scale sensing task. In this paper, a novel model will be introduced for recognizing/classifying human activities that were collected from sensor units on the chest, legs, and arms. The proposed model employed the k -Nearest Neighbor ( k -NN) classifier which is one of the most common classifiers. k -NN has only one parameter, k , to determine the number of selected nearest neighbors to the test or unknown samples for predicting the class labels of the unknown samples. Searching for the value of k which has a great impact on the classification performance is difficult especially with high dimensional data. This paper employs the Particle Swarm Optimization (PSO) algorithm to search for the optimal value of the k parameter in the k -NN Classifier. This paper shows first experimentally how the PSO in the proposed algorithm searches for the optimal value of k parameter to reduce the misclassification rate of the k -NN classifier. Then, in the second experiment, ten standard datasets are utilized to benchmark the performance of the proposed algorithm. For verification, the results of the PSO- k NN algorithm are compared with two well-known algorithms: Genetic Algorithm (GA) and Ant Bee Colony Optimization (ABCO). In the third experiment, the proposed PSO- k NN algorithm was employed for recognizing human activities. The experimental results proved that the PSO- k NN algorithm is able to find the optimal or near optimal value(s) of the k parameter which enhances the accuracy of k -NN classifier. The results also demonstrated lower error rates compared when GA and ABCO algorithms. [ABSTRACT FROM AUTHOR]

Existing viral-marketing network models commonly assume a preliminary phase in which a marketer actively infects a subset of social network’s users, represented by nodes, followed by a passive viral process, in which nodes infect other nodes without external intervention. However, in real-world commercial scenarios, substantial efforts are often invested by companies to promote their products, suggesting that the adoption of products is rarely the consequence of a viral spread alone. Under this observation, this paper proposes a new diffusion model, named Active Viral Marketing, which better fits real-world marketing scenarios, where adoption of products relies on continuous active promotion efforts by the marketer. In the proposed model, the success of a marketing attempt to infect a potential customer (uninfected node), depends on the number of adopting friends (infected neighbors) of this user, assuming a user is more likely to adopt a product if more of his/her friends have already adopted it, while taking into account that social influence diminishes over time due to a memory-loss effect. The paper further proposes a set of heuristics to schedule the marketing attempts. The main idea behind these heuristics is to utilize the information on the dynamic adoption-states of neighbor nodes, in addition to the static social network topology, when choosing the next node to seed. An extensive experimentation demonstrates how the proposed seeding heuristics improve the adoption rate of products by 30%–75% in comparison to existing state-of-the-art methods that mainly rely on the network topology. [ABSTRACT FROM AUTHOR]

Researchers and practitioners have attempted to predict the financial market by analyzing textual (e.g., news articles and social media) and numeric data (e.g., hourly stock prices, and moving averages). Among textual data, while many papers have been published that analyze social media, news content has gained limited attention in predicting the stock market. Acknowledging that news is critical in predicting the stock market, the focus of this systematic review is on papers investigating machine learning and text mining techniques to predict the stock market using news. Using Kitchenham's methodology, we present a systematic review of the literature on intelligent financial market prediction, examining data mining and machine learning approaches and the employed datasets. From five digital libraries, we identified 61 studies from 2015–2022 for synthesis and interpretation. We present notable gaps and barriers to predicting financial markets, then recommend future research scopes. Various input data, including numerical (stock prices and technical indicators) and textual data (news text and sentiment), have been employed for news-based stock market prediction. News data collection can be costly and time-consuming: most studies have used custom crawlers to gather news articles; however, there are financial news databases available that could significantly facilitate news collection. Furthermore, although most datasets have covered fewer than 100K records, deep learning and more sophisticated artificial neural networks can process enormous datasets faster, improving future model performance. There is a growing trend toward using artificial neural networks, particularly recurrent neural networks and deep learning models, from 2018 to 2021. Furthermore, regression and gradient-boosting models have been developed for stock market prediction during the last four years. Although word embedding approaches for feature representation have been employed recently with good accuracy, emerging language models may be a focus for future research. Advanced natural language processing methods like transformers have undeniably contributed to intelligent stock market prediction. However, stock market prediction has not yet taken full advantage of them. • Emerging articles (2015–2021) on news-based stock market prediction are reviewed. • There is a growing trend toward using news headlines for stock market prediction. • Recurrent neural networks are advantageous models for stock market prediction. • Stock market prediction not fully took advantage of Natural language processing yet. • Quarterly and annual reports of companies are authorized credible data sources. [ABSTRACT FROM AUTHOR]

Over the last few years, we have been witnessing a dramatic progress of deep learning in many real world applications. Deep learning concepts have been originated in the area of neural network and show a quantum leap in effective feature learning techniques such as auto-encoders, convolutional neural networks, recurrent neural networks etc. In the case of kernel machines, there are several attempts to model learning machines that mimic deep neural networks. In this direction, Multilayer Kernel Machines (MKMs) was an attempt to build a kernel machine architecture with multiple layers of feature extraction. It composed of many layers of kernel PCA based feature extraction units with support vector machine having arc-cosine kernel as the final classifier. The other approaches like Multiple Kernel Learning (MKL) and deep core vector machines solve the fixed kernel computation problem and scalability aspects of MKMs respectively. In addition to this, there are lot of avenues where the use of unsupervised MKL with both single and multilayer kernels in the multilayer feature extraction framework have to be evaluated. In this context, this paper attempts to build a scalable deep kernel machines with multiple layers of feature extraction. Each kernel PCA based feature extraction layer in this framework is modeled by the combination of both single and multilayer kernels in an unsupervised manner. Core vector machine with arc-cosine kernel is used as the final layer classifier which ensure the scalability in this model. The major contribution of this paper is a novel effort to build a deep structured kernel machine architecture similar to deep neural network architecture for classification. It opens up an extendable research avenue for researchers in deep learning based intelligent system leveraging the principles of kernel theory. Experiments show that the proposed method consistently improves the generalization performances of existing deep core vector machine. [ABSTRACT FROM AUTHOR]

Buildings are an essential part of our social life. People spend a substantial fraction of their time and spend a high amount of energy in them. There is a grand variety of systems and services related to buildings, in order to better control and monitoring. The prompt taking of decisions may prevent costs and contamination. This paper proposes a method for energy consumption forecasting in public buildings, and thus, achieve energy savings, in order to improve the energy efficiency, without affecting the comfort and wellness. The prediction of the energy consumption is indispensable for the intelligent systems operations and planning. We propose an Elman neural network for forecasting such consumption and we use a genetic algorithm to optimize the weight of the models. This paper concludes that the proposed method optimizes the energy consumption forecasting and improves results attained in previous studies. [ABSTRACT FROM AUTHOR]

Lithology identification is a crucial task for reservoir characterization and evaluation. There exists an intricate non-linear response between formation lithology and logging data. However, it is difficult to avoid lithology mislabeling due to human error and interpretation coarsening, and label quality can seriously affect the effectiveness of supervised learning. The presence of noisy labels makes it essential to learn with noisy labels. Noise-filtering methods and noise-robust algorithms only concentrate on a singular aspect of data or algorithm. In this paper, hybrid noise label filtering and correction framework for lithology identification (HNFCL) is proposed. Isolation forest is utilized to detect suspicious data, as it is efficient and fast. Baseline classifiers are built by ensemble tree models. In particular, the labels of abnormal data are removed and Tri-training semi-supervised method is introduced to relabel these data, which minimizes the loss of valid training data. Comprehensive experiments of the HNFCL framework, noise filtering methods and deep neural network methods with optimized loss functions were carried out in the industrial application of logging lithology identification. HNFCL achieved average accuracy of 87.94% and 94.93% in two study wells. These results outperformed the noise filtering methods and showed no significant difference from the state-of-the-art method. The correction of noise by HNFCL will provide a prospect for lithology identification applications. [ABSTRACT FROM AUTHOR]

Emergency Department overcrowding is a well-known problem. The consequences are long waiting times for patients, reduced service quality, and the potential for increased mortality rates. Moreover, this problem is escalating with the aging of the population and the chronification of diseases. Being aware of such concerns, Emergency Departments started to conduct patient accountability years ago, and now they are ready to take advantage of the gathered data to improve the quality of service to citizens. However, to achieve this goal, they need the technology that enables the generation of predictive models from such data to improve the planning of their resources. In this paper, we face the task of forecasting patient admissions by using Deep Neural Networks, particularly a modern Attention-based model. As well, historical records do not provide a full picture of how patients attend the emergency service. Relying on the possibilities given by the attention mechanism, we also propose the use of exogenous information such as calendar data, weather, air quality, allergens, and information extracted from the web via Google Trends to enhance admissions prediction accuracy. In this regard, we have tested different configurations of the exogenous variables to isolate which ones provide relevant information that improves the model. In our experiments, we have seen that the calendar, weather, and air quality provide the most valuable information, meanwhile, allergens and Google Trends data appear to be hindering the models' performance. • Using Attention model for forecasting Emergency Department (ED) patient admissions. • Comparing Attention model with LSTM-based networks for ED patients admissions. • Exogenous variables: weather, calendar, air quality, allergens and Google Trends. • Analyzing the impact of each type of exogenous variable in the forecast. • Attention model with calendar data achieves the best results. [ABSTRACT FROM AUTHOR]

The enhanced answer evaluation system is a cutting-edge automated tool that evaluates subjective answers in various contexts, such as educational assessments, surveys, and feedback forms. The proposed system leverages Natural Language Processing (NLP) and deep learning techniques to analyse subjective answers and provide evaluation scores with precision. Students' answers are evaluated based on various criteria, such as keywords, context, relevance, coherence, and similarity. This paper introduces an architecture for a subjective answer evaluator using three main aspects: detection of keywords, similarity matrix, and presence of named entities. It combines the three aspects and provides a final score. It provides a standardized mechanism to score a given user answer compared to the particular model answer without human prejudice. This research aims to transcend traditional methodologies that predominantly utilize keyword or keyphrase scoring (text-based similarity) to determine the final score of an answer without delving into its technical intricacies. The semantic similarity (vector-based) employs vector data representations for score calculation. This approach necessitates partitioning data into multiple vectors for a comprehensive analysis. While text similarity is effective for short answers, its efficacy diminishes as the length of the answer increases. Therefore, this study emphasizes the critical role of similarity scoring and Named Entity Recognition (NER) scoring in evaluating more extended responses based on the stsb-en-main dataset (short answers) and a custom dataset with 190 records. This research reveals its remarkable performance, which excels through a dynamic three-pronged approach: keyword scoring, semantic similarity, and NER scoring with models like Yet Another Keyword Extractor (YAKE), SimCSE and Camembert. These three independent components synergize to produce unmatched results, establishing a new standard in the field. This enhancement led to Root Mean Square Error (RMSE) scores of 0.031 (optimized error rate) and an impressive 71%+ accuracy for our comprehensive system. This achievement surpasses existing works, which typically reached accuracies ranging between 40%–60% for long answers. • Evaluation using a three-pronged approach of Keyword, Semantic & NER scoring. • Semantic scores enhance similarity matrix grading and impact evaluation. • NER scores address proper noun issues. • Deep Neural Network predicts actual marks effectively. • The best-performing LLM models are YAKE, SimCSE and Camembert. [ABSTRACT FROM AUTHOR]

The state-of-the-art performance on entity disambiguation has been reached by deep neural networks. However, the task remains very challenging due to the complexity of natural language. Moreover, the target data distribution is often different from that of training data. In this paper, we address the limitation of deep entity disambiguation from the perspective of misprediction risk. We propose a knowledge-based approach of risk analysis for entity disambiguation, and leverage it to enable adaptive deep learning. The proposed approach generates risk features by extracting evidences from the knowledge base, and then models them as a linearly-weighted random vector where an attention mechanism is used to focus on the most significant components. Finally, it estimates misprediction risk of the aggregated probability distribution via the Conditional Value-at-Risk metric. Furthermore, we demonstrate how to utilize risk analysis results in adaptive deep learning via two-phase training, the first phase fits on labeled training data while the second one minimizes misprediction risk on unlabeled target data. We evaluate the performance of the proposed approach on benchmark datasets through a comparative study. Our thorough experiments demonstrate that it can detect mispredictions more accurately than existing alternatives and can substantially improve the performance of deep learning models. [ABSTRACT FROM AUTHOR]

The burner combustion tuning is a complex problem that has been studied through flame monitoring and characterization. It has been observed that the flame electromagnetic spectrum and flickering contain specific flame information in combustion processes. This information is helpful for combustion stoichiometry tuning on burners. This paper described a method for selecting the best flame feature subset that can be computed from the scanner signal, in order to get the flame index and induce combustion stoichiometry on burners under specific combustion conditions. We propose a method for selecting a reduced subset with only the useful flame features for flame index classification. To extract the most relevant flame features we use a feature subset selection (FSS) algorithm and to determine the combustion state in burners, five flame indices were defined that represent the most common flame states in oil fuel-fired boilers. FSS includes complete, sequential, and random searches in order to eliminate redundant and noisy flame features to decrease the flame feature set dimension. A probabilistic neural network (PNN) algorithm was implemented for flame feature clustering. Signals from the actual flame scanner system and relevant variables from the boiler data acquisition system were used by the algorithms to calculate the burner flame index. A set of parametric tests was done in a heavy oil-fired boiler under well-known flame and index conditions to train and test the flame classifier. The results showed that only the four more relevant features are enough to classify flames with a good performance (92.3% accuracy), which is useful for burner combustion monitoring and optimization. • A new approach to defining/selecting critical features in the combustion process. • A new approach to classifying flames in industrial heavy oil-fired boilers. • The proposed algorithms are tested & evaluated in a real industrial process. • The overall methodology ensures that the combustion process guarantees safety. [ABSTRACT FROM AUTHOR]

Simulation-driven structural health monitoring (SHM) is crucial for enhancing the safety and reliability of structures. Its primary aim is to utilize numerical simulations to design efficient SHM systems, reducing costs while maintaining effectiveness. However, challenges arise due to disparities between simulations and physical measurements, stemming from uncertainties, noise, and simplifications. These challenges also extend to SHM methods using machine learning, particularly deep neural networks (DNNs). This paper bridges the gap between DNNs trained on simulated data and real-world experiments by investigating three transfer learning (TL) techniques: feature augmentation, direct fine-tuning, and boosting-based fine-tuning. The focus is on guided wave damage interaction coefficients (WDICs) as damage-sensitive features, modeled by DNNs for damage identification in thin plates, commonly found in aerospace structures like aircraft fuselages. This classification task compares measured and predicted WDICs in a common guided wave SHM configuration with one actuator and three sensors. Training and extensive testing datasets are generated using advanced finite element simulations and laser Doppler vibrometer experiments. The study demonstrates that TL techniques significantly enhance DNN prediction accuracy and improve damage identification performance for untrained scenarios compared to purely simulation-based DNNs. Among the TL approaches explored, feature augmentation with appropriate activation functions and boosting-based fine-tuning yield the most promising results. Using four out of twelve TL datasets, feature augmentation reduces the simulation-based mean absolute percentage error from 46.80% to 35.98% and increases coefficient of determination R 2 values from 0.02 to 0.72. With six TL datasets and a boosting-based fine tuning, the mean absolute percentage error decreases from 47.42% to 35.20%, maintaining similar R 2 values. While TL substantially enhances prediction accuracy, its impact on damage identification is slightly less pronounced, with improvements in relative classification accuracy by approximately 5% compared to simulation-based DNNs. These findings highlight the efficacy of TL techniques for damage identification in thin plates using WDICs and DNNs, emphasizing the influence of TL training and DNN model variations. Furthermore, they showcase the potential of TL methods to enhance DNN performance in future SHM applications, particularly emphasizing the promise of feature augmentation and boosting. • Novel simulation-driven structural health monitoring technique using guided waves. • Deep neural network modeling to predict wave damage interaction coefficients. • Bridging disparity between simulations and experiments through transfer learning. • Study of transfer learning techniques based on feature augmentation and fine tuning. • Demonstrated significant enhancement in simulation-based neural network performance. [ABSTRACT FROM AUTHOR]

Accurate and automatic segmentation of individual cell instances in microscopy images is a vital step for quantifying the cellular attributes, which can subsequently lead to new discoveries in biomedical research. In recent years, data-driven deep learning techniques have shown promising results in this task. Despite the success of these techniques, many fail to accurately segment cells in microscopy images with high cell density and low signal-to-noise ratio. In this paper, we propose a novel 3D cell segmentation approach DeepSeeded, a cascaded deep learning architecture that estimates seeds for a classical seeded watershed segmentation. The cascaded architecture enhances the cell interior and border information using Euclidean distance transforms and detects the cell seeds by performing voxel-wise classification. The data-driven seed estimation process proposed here allows segmenting touching cell instances from a dense, intensity-inhomogeneous microscopy image volume. We demonstrate the performance of the proposed method in segmenting 3D microscopy images of a particularly dense cell population called bacterial biofilms. Experimental results on synthetic and two real biofilm datasets suggest that the proposed method leads to superior segmentation results when compared to state-of-the-art deep learning methods and a classical method. • Data-driven seed estimation of a classical seeded watershed for 3D dense cell segmentation. • Enhancement of cell interior and border voxels by predicting Euclidean distance transforms using deep learning. • Multi-scale structural similarity index measure (MS-SSIM) loss for image-to- image mapping with better quality output. • Localization of cell seeds by performing voxel-wise classification using a deep network. [ABSTRACT FROM AUTHOR]

The emotional states of speech have a great impact on the efficiency of speaker recognition (SR) system. Many researchers focus on how to map speech with different emotions to an emotion invariant embedding, which reduces the diversity of data. This paper proposes a new emotion embedding framework with self-attention mechanism for speaker recognition. First, several deep neural networks (DNNs) are trained to classify speakers in different emotional states as emotion embedding extractors during development phase. Then at enrollment stage, these pre-trained models are used to extend emotion embeddings from neutral speech. In order to make the final speaker embedding more representative, the classification model is trained with self-attention mechanism in emotion dimension, so that the framework can automatically annotate the weights of the emotion embeddings. Experiments were carried out on both Mandarin Affective Speech Corpus (MASC) and Crowd-Sourced Emotional Multimodal Actors Dataset (CREMA-D). The results show the proposed method achieves the best of Identification Rate (IR) and Equal Error Rate (EER) which are 59.14%, 15.79% on MASC and 75.98%, 8.14% on CREMA-D compared with state-of-the-art methods. In addition, the cross-database experiments also further demonstrate the practicability of the method in real scenes. • An emotion embedding framework for robust emotional speaker recognition is proposed. • Emotional feature extractors is pre-trained to obtain prior emotional representation. • Various emotion embeddings are extracted by decomposing the emotional features. • Self-attention is introduced to measure the importance of emotion embeddings. • Emotional speaker embedding enriches neutral speech with emotional information. [ABSTRACT FROM AUTHOR]

The aim of this paper is to explore the potential of the class of recurrent neural networks in developing a classification model for the stock market. For this research, the data that replicates the entire Nasdaq stock market limit order book is used. After extracting order book attributes from the raw dataset, feature selection approaches based on conditional entropy and Stochastic Universal Sampling are proposed, in order to highlight potentially informative features for our data classification task. Furthermore, the performances of nine presented recurrent neural network models for classifying the stock market data vector into one of the labels from the set S = {buy, sell, idle} are examined. In this study, the performances of the models based on different networks, namely the gated recurrent unit, the long short-term memory, and the recurrent neural network, are compared. Using a multi-criteria approach it is concluded that the model based on the GRU topology fed with the features selected using the newly proposed feature selection method outperforms other examined models. • The performances of nine different limit order book classification models are examined. • The PROMETHEE method specifies the most suitable model among the observed models. • The proposed feature demonstrates superiority compared to other selection methods. • The models based on different neural network topologies are evaluated. [ABSTRACT FROM AUTHOR]

In this paper, we present a novel dimensionality reduction term (i.e. TripletPCA and ContrastivePCA) designed to enhance the robustness of pair-based loss functions in metric learning against image corruptions. Notably, our approach achieves this without the need for any data preprocessing steps. Our method can be seamlessly integrated into existing models, such as a block with Plug & Play framework. To the best of our knowledge, our TripletPCA and ContrastivePCA represent the first attempts to incorporate dimensionality reduction directly into pair-based metric learning losses for end-to-end metric learning. By projecting image features into low-dimensional vectors, our proposed loss functions effectively retain the essential components of images while mitigating the impact of corrupted features. Consequently, our metric learning loss function accurately computes feature distances through the projection. Experimental results demonstrate that our dimensionality reduction term can be easily incorporated into various types of existing deep neural networks. This integration leads to a substantial improvement in performance on standard benchmark datasets for corrupted image classification tasks. On several corruption datasets, we achieve an average performance improvement of 10.55% compared to existing baseline methods. Our code is available at https://github.com/Juryun/TDRL. [ABSTRACT FROM AUTHOR]

Spiking neural networks (SNNs) have garnered significant attention due to their ultra-high-speed and ultra-low-power operation, rendering them suitable for a range of energy-efficient applications. However, their performance in image generation is relatively mediocre, resulting in a lack of an effective generative replay mechanism to handle sequential probabilistic representations of multiple datasets. Consequently, this limitation often leads to catastrophic forgetting. This paper introduces a novel SNN lifelong learning framework namely Dynamic Lifelong learning with Spiking Generative Networks (DL-SGN), aimed at providing better generation ability while mitigating the problem of catastrophic forgetting in a continual learning scenario. DL-SGN comprises three key components: dynamic experts, a student, and an assistant. The dynamic expert is implemented as a dynamically expanding mixture model, with a proposed network expansion mechanism Dynamic Knowledge Adversarial Fusion (DKAF) facilitating the automatic handling of an increasing number of tasks. the student module adopts an SNN-based Variational Autoencoder (VAE) and classifier, leveraging accumulated knowledge from each expert. To enhance the student's ability to generalize to images, we introduce a discriminator as an assistant module trained using adversarial training. We validate the effectiveness of the proposed by conducting experiments on image generation and classification in a lifelong learning environment, and the results substantiate the effectiveness of DL-SGN. • The DL-SGN framework is proposed to addresses catastrophic forgetting in SNNs. • Our model is based on multiple dynamic experts and adversarial training. • Develop a dynamic knowledge adversarial fusion to expand expert module's capacity. • Employ an assistant module to enhance the student module's generalization ability. [ABSTRACT FROM AUTHOR]

Hardware Trojans (HT) are the most malicious components attacking modern integrated circuits (ICs). Information leakage, incorrect functionality, and overheating are the major effects of HT insertion. Due to the outsourcing of multi-stage digital circuit design and fabrication, HTs can be inserted by rogues at every stage. The types of HTs and insertion methods evolve continuously and their detection becomes more complex. Consequently, designing integrated circuits robust to HT insertion seems efficient. A prerequisite for such a strategy is the evaluation of integrated circuit vulnerability to HT insertion. There are several factors involved in the vulnerability of fabricated integrated circuits such as the distribution of white spaces in the IC layout, the ratio of unutilized routing resources, the amount of activity of the circuit's nodes, the geometrical properties of the circuit's gates, the delay of various paths, and etc. The interrelation of these diverse factors makes IC vulnerability modeling a challenging problem. In this paper, a deep neural network (DNN) based approach is developed to combine all the effective factors in IC vulnerability analysis. Firstly, we generate a comprehensive dataset containing various types and sizes of hardware Trojans inserted into benchmark circuits. The benchmark circuits used in this study are ISCAS 85, ISCAS 89, and ITC 99. Then using the transfer learning concept seven state-of-the-art deep convolutional neural networks are trained and verified using the constructed dataset to classify every integrated circuit into three vulnerability levels (low, moderate, and highly vulnerable classes). Simulation results show that our proposed method achieves almost 95 % accuracy in the most successful case (VGG16). The lowest accuracy belongs to Inception V3 (∼87.65 %) which is much better than the most successful previous studies (72 %). This is mainly because the DNN-based method handles shortcomings (such as incomplete modeling of vulnerability-related factors) in the previous state-of-the-art methods efficiently. [ABSTRACT FROM AUTHOR]

3D point clouds are a crucial type of data collected by LiDAR sensors and widely used in transportation applications due to its concise descriptions and accurate localization. Deep neural networks (DNNs) have achieved remarkable success in processing large amount of disordered and sparse 3D point clouds, especially in various computer vision tasks, such as pedestrian detection and vehicle recognition. Among all the learning paradigms, Self-Supervised Learning (SSL), an unsupervised training paradigm that mines effective information from the data itself, is considered as an essential solution to solve the time-consuming and labor-intensive data labeling problems via smart pre-training task design. This paper provides a comprehensive survey of recent advances on SSL for point clouds. We first present an innovative taxonomy, categorizing the existing SSL methods into four broad categories based on the pretexts' characteristics. Under each category, we then further categorize the methods into more fine-grained groups and summarize the strength and limitations of the representative methods. We also compare the performance of the notable SSL methods in literature on multiple downstream tasks on benchmark datasets both quantitatively and qualitatively. Finally, we propose a number of future research directions based on the identified limitations of existing SSL research on point clouds. [ABSTRACT FROM AUTHOR]

As an emerging digital product, artificial intelligence models face the risk of being modified. Malicious tampering will severely damage model functions, which is different from normal modifications. In addition, tampering localization for targeted repair can effectively reduce the cost. Therefore, it is crucial to achieve model content authentication and locate the tampering location. We proposed a novel semi-fragile neural network watermarking method in this paper to address these issues. Specifically, with the precondition of maintaining model performance, we proposed a method that generates a set of semi-fragile samples for a model to achieve the content authentication and tampering localization. The experiment results show that the content authentication of the model can be achieved by analyzing the output results of the model for the semi-fragile samples. When the model is processed normally, the output results are consistent with the expected label, while when the model is maliciously tampered with, the model produces unstable output. Furthermore, the tamper localization of the model can be further achieved through the information hidden in the semi-fragile samples, resulting in an average accuracy of more than 99.42%. In addition, our method is also effective for other deep neural networks. [ABSTRACT FROM AUTHOR]

Phishing websites distribute unsolicited content and are frequently used to commit email and internet fraud. Detecting them before any user information is submitted is critical. Several efforts have been made to detect these phishing websites in recent years. Most existing approaches use hand-crafted lexical and statistical features from a website's textual content to train classification models to detect phishing web pages. However, these phishing detection approaches have limitations, including (1) the tediousness of extracting hand-crafted features, which require specialized domain knowledge to determine which features are useful for a particular platform; and (2) the difficulties encountered by models built on hand-crafted features to capture the semantic patterns in words and characters in URL and HTML content. To address these challenges, this paper proposes WebPhish, an end-to-end deep neural network trained using embedded raw URLs and HTML content to detect website phishing attacks. First, the proposed model automatically employs an embedding technique to extract the corresponding characters into homologous dense vectors. Then, the concatenation layer merges the URL and HTML embedding matrices. Following that, Convolutional layers are used to model its semantic dependencies. Extensive experiments were conducted with real-world phishing data, which yielded an accuracy of 98.1%, showing that WebPhish outperforms baseline detection approaches in identifying phishing pages. • WebPhish employs both raw URL and HTML content to detect phishing web pages. • WebPhish uses character-level embeddings to enable the feature vectors to generalize to new data. • Extensive experiments conducted on a real-world dataset yields 98.1% accuracy. • Its application on the airline Twitter dataset shows the proposed model's flexibility. [ABSTRACT FROM AUTHOR]

This paper proposes an efficient feature selection system applied to a Facial Expression Recognition (FER) system. This system, capable of recognizing seven prototypical emotions including neutral expression, is based on a histogram of oriented gradient descriptor (HOG) and difference feature vectors. The emotion feature selection was carried out by using an appropriately modified multi-objective differential evolution algorithm. The number of used features was minimized, while the emotion recognition accuracy of the support vector machine classifiers was maximized simultaneously. ‘The emotion-specific features’ and ‘the more discriminative features over all emotions’ selection strategies were developed, whereby the latter strategy proved to be more efficient using the Friedman statistical test. This person-independent FER system with proposed feature selection was validated on three commonly used evaluation databases, where the mean emotion recognition rate was 98.37% on the Cohn Kanade database, 92.75% on the JAFFE database, and 84.07% on the MMI database, while the number of used features lowered up to 89% with respect to the original difference feature vector length. Compared to the state-of-the-art, the proposed FER method offers good results, while also greatly lowering the number of used features, which, in return, minimizes the computational cost of training the classifiers. The optimization proposed in this paper can be generalized easily to a feature selection for an arbitrary multi-objective, as well as many-objective, problem. [ABSTRACT FROM AUTHOR]

The aim of this study is to assist users and to determine how digital proofing systems used in colour management effect print qualities. Also the main theme of this study is to determine the effects of digital proofing systems used in colour management on print quality by artificial neural network (ANN). The R 2 values are obtained 0.99702 and 0.99688 for training data as matte and cuated papers, respectively. Similarly, these values for testing data are 0.994707 and 0.99629, respectively. The ANN approach shows greater accuracy for evaluating colour management. Based on the outputs of the study, ANN model can be used to estimate the effects of digital proofing systems used in colour management on print quality with highly confidence. [Copyright &y& Elsevier]

This paper proposes a novel algorithm for localizing slab identification numbers (SINs) in factory scenes. Automatic identification of product information is important for the process management, and localization of SINs in complex scenes is a major challenge for the recognition. A previous rule-based localization algorithm for SINs requires lots of prior knowledge and heuristic tuning for parameters. In this paper, a deep convolutional neural network (DCNN) is employed to overcome these limitations, and accumulated confidence is proposed to utilize neighboring outputs of the DCNN in a scene. The localization error is remarkably reduced to 1.44% by the proposed algorithm compared to 4.59% in the previous work. The proposed data-driven method can be applied to construct other automatic identification systems with minimal manual handling. [ABSTRACT FROM AUTHOR]

Breakthrough performances have been achieved in computer vision by utilizing deep neural networks. In this paper we propose to use random forest to classify image representations obtained by concatenating multiple layers of learned features of deep convolutional neural networks for scene classification. Specifically, we first use deep convolutional neural networks pre-trained on the large-scale image database Places to extract features from scene images. Then, we concatenate multiple layers of features of the deep neural networks as image representations. After that, we use random forest as the classifier for scene classification. Moreover, to reduce feature redundancy in image representations we derived a novel feature selection method for selecting features that are suitable for random forest classification. Extensive experiments are conducted on two benchmark datasets, i.e. MIT-Indoor and UIUC-Sports. Obtained results demonstrated the effectiveness of the proposed method. The contributions of the paper are as follows. First, by extracting multiple layers of deep neural networks, we can explore more information of image contents for determining their categories. Second, we proposed a novel feature selection method that can be used to reduce redundancy in features obtained by deep neural networks for classification based on random forest. In particular, since deep learning methods can be used to augment expert systems by having the systems essentially training themselves, and the proposed framework is general, which can be easily extended to other intelligent systems that utilize deep learning methods, the proposed method provide a potential way for improving performances of other expert and intelligent systems. [ABSTRACT FROM AUTHOR]

The development of blockchain technology has brought prosperity to the cryptocurrency market and has made the blockchain platform a hotbed of crimes. As one of the most rampant crimes, phishing scam has caused a huge economic loss to blockchain platforms and users. In order to address the threat to the financial security of blockchain, this paper proposes a model based on hybrid deep neural network to detect phishing scam accounts, namely LBPS (LSTM-FCN and BP neural network-based Phishing Scam accounts detection model), and verifies its effectiveness on Ethereum. The LBPS model provides a novel approach to analyse transaction records by adopting the BP neural network to obtain the implicit relationship between features extracted from transaction records and the LSTM-FCN neural network to capture the temporal feature from all transaction records of a target account. The experimental results demonstrate that the features selected in this paper could identify phishing scam accounts effectively. Moreover, the LBPS model performs better than the existing methods and baseline models with an F1-score of 97.86%. • A more effective approach to extract features from transaction records. • A model integrates manual feature engineering and transaction records analysing. • Achieves high F1 on the phishing scam accounts detection on Ethereum. • Outperforming the existing state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Sleep stage scoring is a challenging task. Most of existing sleep stage classification approaches rely on analysing electroencephalography (EEG) signals in time or frequency domain. A novel technique for EEG sleep stages classification is proposed in this paper. The statistical features and the similarities of complex networks are used to classify single channel EEG signals into six sleep stages. Firstly, each EEG segment of 30 s is divided into 75 sub-segments, and then different statistical features are extracted from each sub-segment. In this paper, feature extraction is important to reduce dimensionality of EEG data and the processing time in classification stage. Secondly, each vector of the extracted features, which represents one EEG segment, is transferred into a complex network. Thirdly, the similarity properties of the complex networks are extracted and classified into one of the six sleep stages using a k-means classifier. For further investigation, in the statistical features extraction phase two statistical features sets are tested and ranked based on the performance of the complex networks. To investigate the classification ability of complex networks combined with k-means, the extracted statistical features were also forwarded to a k-means and a support vector machine (SVM) for comparison. We also compare the proposed method with other existing methods in the literature. The experimental results show that the proposed method attains better classification results and a reasonable execution time compared with the SVM, k-means and the other existing methods. The research results in this paper indicate that the proposed method can assist neurologists and sleep specialists in diagnosing and monitoring sleep disorders. [ABSTRACT FROM AUTHOR]

An efficient reversible adaptive video watermarking scheme for multiple watermarks based on Bi-directional Associative Memory (BAM) Neural Networks and Fuzzy Inference System namely, Multi-BAM-FUZ scheme is proposed in this paper. The main goal of this paper is to design a robust video watermarking system which facilitates secure video transmission over a communication channel by maintaining a trade-off among imperceptibility, robustness and watermark capacity or payload. The BAM neural network supports creation of weight matrix (formed out of multiple images) and this matrix is embedded into the DWT uncorrelated mid frequency coefficients of all the components (Y, Cb, Cr) of every frames of the video with varying embedding strength ‘α’. This adaptive embedding strength is generated using the Fuzzy Inference System which takes HVS characteristics such as luminance, texture and edge of each frame as an input in the DWT transform. The simulations performed on various test videos demonstrate that the proposed Multi-BAM-FUZ not only outperforms other existing methods with respect to various video degradation processes, but also maintains a satisfactory image quality, robustness and payload. It is noted that, the implementation of the novel adaptive process enhances the visual quality of about 60.97 dB in terms of PSNR and 0.9998 in terms of SSIM, robustness of about nearly 1.0000 and 0.9999 in terms of Normalized Cross Correlation (NCC) value and Bit Correction Rate (BCR) respectively against various attacks. Moreover, the proposed scheme facilitates high level of payload without affecting the imperceptibility and robustness level. [ABSTRACT FROM AUTHOR]