Search

Natural disasters can be unpredictable and catastrophic. Even after the event, the repercussions are prolonged due to the incompetence of disaster management strategies. To mitigate the effects of a natural hazard, disaster management teams have to rapidly come forth with innovative plans of action. To contain the damage that a disaster causes, the response time, and preparedness of a disaster management team is crucial. Having a forewarning about the nature of the disaster can prove to be beneficial for the management team. Remote/unreachable areas such as deep parts of the forests, far-flung rural areas, oceans and other hard to reach locations are at a higher risk of receiving poorer aid and response due to the lack of communication and connectivity with the rest of the world. Our paper provides a solution for this particular problem by suggesting UAV/Drones for surveillance and monitoring in these inaccessible, disaster struck areas. The drones not only monitor the situation but constantly click pictures and send them to a base station, where the images are used to collect insights about the type of disaster that has to be dealt with. The paper proposes a deep learning model based on feature concatenation for classification of disasters which can be deployed at the base station, and can receive data in the form of images from a UAV/drone hovering over the affected place. The proposed model is efficient and able to achieve a higher accuracy as compared to the leading CNN models and closely related recent works as well. [ABSTRACT FROM AUTHOR]

Named entity recognition (NER) aims to identify the required entities and their types from unstructured text, which can be utilized for the construction of knowledge graphs. Traditional methods heavily rely on manual feature engineering and face challenges in adapting to large datasets within complex linguistic contexts. In recent years, with the development of deep learning, a plethora of NER methods based on deep learning have emerged. This paper begins by providing a succinct introduction to the definition of the problem and the limitations of traditional methods. It enumerates commonly used NER datasets suitable for deep learning methods and categorizes them into three classes based on the complexity of named entities. Then, some typical deep learning-based NER methods are summarized in detail according to the development history of deep learning models. Subsequently, an in-depth analysis and comparison of methods achieving outstanding performance on representative and widely used datasets is conducted. Furthermore, the paper reproduces and analyzes the recognition results of some typical models on three different types of typical datasets. Finally, the paper concludes by offering insights into the future trends of NER development. [ABSTRACT FROM AUTHOR]

IoT devices convert billions of objects into data-generating entities, enabling them to report status and interact with their surroundings. This data comes in various formats, like structured, semi-structured, or unstructured. In addition, it can be collected in batches or in real time. The problem now is how to benefit from all of this data gathered by sensing and monitoring changes like temperature, light, and position. In this paper, we propose a predictive analytics framework constructed on top of open-source technologies such as Apache Spark and Kafka. The framework focuses on forecasting temperature time series data using traditional and deep learning predictive analytics methods. The analysis and prediction tasks were performed using Autoregressive Integrated Moving Average (ARIMA), Seasonal Autoregressive Integrated Moving Average (SARIMA), Long Short-Term Memory (LSTM), and a novel hybrid model based on Convolution Neural Network (CNN) and LSTM. The purpose of this paper is to determine whether and how recently developed deep learning-based models outperform traditional algorithms in the prediction of time series data. The empirical studies conducted and reported in this paper demonstrate that deep learning-based models, specifically LSTM and CNN-LSTM, exhibit superior performance compared to traditional-based algorithms, ARIMA and SARIMA. More specifically, the average reduction in error rates obtained by LSTM and CNN-LSTM models were substantial when compared to other models indicating the superiority of deep learning. Moreover, the CNN-LSTM-based deep learning model exhibits a higher degree of closeness to the actual values when compared to the LSTM-based model. [ABSTRACT FROM AUTHOR]

Microscopic image analysis technology helps solve the inadvertences of artificial traditional methods in disease, wastewater treatment, and environmental change monitoring analysis. Convolutional neural network (CNN) play an important role in microscopic image analysis. Image segmentation, in which U-Net is increasingly applied in microscopic image segmentation, is a crucial step in detection, tracking, monitoring, feature extraction, modelling, and analysis. This paper comprehensively reviews the development history of U-Net, analyses several research results of various segmentation methods since the emergence of U-Net, and conducts a comprehensive review of related papers. This paper summarised the improved methods of U-Net and then listed the existing significance of image segmentation techniques and their improvements introduced over the years. Finally, focusing on the different improvement strategies of U-Net in different papers, the related work of each application target is reviewed according to detailed technical categories to facilitate future research. Researchers can see the dynamics of the transmission of technological development and keep up with future trends in this interdisciplinary field. [ABSTRACT FROM AUTHOR]

This paper presents an intelligent healthcare framework by incorporating modern computing technologies like machine learning and deep learning. The sole motivation of this paper is to predict diabetes status intelligently so that patients can be made aware of their diabetes status regularly. A novel ensemble machine learning-based diabetes prediction framework, namely "iDP", has been proposed in this paper. Six different machine learning approaches have been used for the iDP framework, namely random forest, decision tree, neural network, AdaBoost, support vector machine, and XGBoost. Training and testing of ensemble modeling have been performed based on these learning techniques. A comprehensive preliminary data analysis and screening of statistical analysis have been systematically demonstrated in this paper. The recursive feature elimination and fivefold cross-validation methods have been used to select the best model. All experiments have been performed using R-Studio 1.2.5 with the help of the Rattle library 5.4.0. The preliminary data analytic and Pearson correlation coefficient values have been computed to verify the linearity relationship among the data. Results have been reported in eight performance metrics, including accuracy, specificity, sensitivity, area under curve, area under convex hull, minimum error rate, minimum weighted loss, and precision. The proposed iDP framework improves the results on different aspects in order to compare them with individual learning approaches. Despite this, a comparative performance analysis of the iDP framework has also been performed with state-of-the-art prevailing models. As per experiment, the iDP framework gives better results in most cases, like accuracy: 95.26%, AUC: 91.15%, sensitivity: 96.81%, specificity: 97.72% and precision: 90.72%. [ABSTRACT FROM AUTHOR]

Representation learning aims to extract meaningful features from medical images that are often multimodal, i.e., captured using multiple imaging modalities, to provide a more comprehensive understanding of the underlying anatomy and pathology. The primary objective is to improve the quality of features that can help in accurate diagnosis, disease detection, and treatment planning. With more than one modality, the extracted features must be integrated efficiently to capture the complex relationships between them. Integrating features in medical imaging-based classification problems, such as those involving magnetic resonance imaging-based diagnosis, remains a significant challenge. Current approaches to multimodal medical imaging classification often focus on features from a single modality or concatenate them into a high-dimensional feature vector, resulting in overfitting. Intermediate methods like deep fusion that combine features at a mid-level or deeper level have shown promise in offering a better representation. Depthwise convolution is a promising alternative in the deep learning paradigm that has demonstrated strong performance while requiring less computation. This paper presents a novel method in deep fusion based on depthwise 1D convolution. The proposed architecture is compared with other methods based on different fusion techniques and machine learning classifiers. The effectiveness of this method is demonstrated through experiments involving the brain tumor segmentation (BraTs-21) competition, Task-2, which involves predicting O(6)-methylguanine-DNA methyltransferase promoter status, a biomarker for glioblastoma, as a binary classification problem using multimodal magnetic resonance images. The proposed approach involves calculating radiomic features directly from magnetic resonance images and deep features from pre-trained deep learning models, selecting valuable features from both sets and then deep feature fusion using depthwise 1D convolution followed by fully connected layers for classification. In this approach, the deep fusion and classifier part is trainable. To make the proposed framework generalizable, we have trained and tested the model with the public BraTs-21 dataset and externally tested the model on a public Lumiere dataset. The experimental results show the promising performance of this approach. The proposed method got the best AUC score of 0.748 with minimum BCE loss of 0.62 on BraTs-21 as compared to other methods. [ABSTRACT FROM AUTHOR]

The significant increase in online activities in the wake of recent global events has underlined the importance of biometric person authentication on digital platforms. Although many biometric devices may be used for precise biometric authentication, acquiring the necessary technology, such as 3D sensors or fingerprint scanners, can be prohibitively expensive and logistically challenging. Addressing the demands of online environments, where access to specialized hardware is limited, this paper introduces an innovative approach. In this work, by fusing static and dynamic signature data with facial data captured through regular computer cameras, a dataset of 1750 samples from 25 individuals is constructed. Deep learning models, including convolutional neural networks (CNN), long short-term memory (LSTM), gated recurrent unit (GRU), and temporal convolutional networks (TCN), are employed to craft a robust multi-classification model. This integration of various deep learning algorithms has demonstrated remarkable performance enhancements in biometric authentication. This research also underscores the potential of merging dynamic and static biometric features, derived from readily available sources, to yield a high-performance recognition framework. As online interactions continue to expand, the combination of various biometric modalities holds potential for enhancing the security and usability of virtual environments. [ABSTRACT FROM AUTHOR]

Deep learning has proven to be highly effective for human activity recognition (HAR) when large amount of labelled data is available for the target task. However, training a deep learning model to generalize well on a new task with just-few observations of labelled data is an active area of research. In this paper, a novel few-shot transfer learning (FSTL) approach is proposed for classification of human activities using just few instances (shots) of the data obtained from a wearable system assembled to collect inertial sensor data for different human activities, performed by two users. First, a deep learning model is trained on a large publicly available HAR dataset. The model parameters of such a model are then fine-tuned using the Reptile algorithm to determine the optimal initial parameter set using which, the model will classify activities with just few-shots of data from the target task. The proposed FSTL approach yields an average classification accuracy of 74.86 ± 0.71% and 79.20 ± 1.05% for 3-way, 5-shot classification of new activities performed by a single user and same set of activities performed by a new user, respectively. When the pre-trained weights are used as the initial weights in the Reptile algorithm, the generalization ability of the model improves by about 10% for 3-way, 5-shot classification as compared to using few-shot learning without parameter transfer. [ABSTRACT FROM AUTHOR]

Visual XAI methods enable experts to reveal importance maps highlighting intended classes over input images. This research paper presents a novel approach to visual explainable artificial intelligence (XAI) for object detection in deep learning models. The study investigates the effectiveness of activation maps generated by five different methods, namely GradCAM, GradCAM++, EigenCAM, HayCAM, and a newly proposed method called "HayCAMJ", in detecting objects within images. The experiments were conducted on two datasets (Pascal VOC 2007 and Pascal VOC 2012) and three models (ResNet18, ResNet34, and MobileNet). Zero padding was applied to resize and center the objects due to the large objects in the images. The results show that HayCAMJ performs better than other XAI techniques in detecting small objects. This finding suggests that HayCAMJ has the potential to become a promising new approach for object detection in deep classification models. [ABSTRACT FROM AUTHOR]

Point clouds in the real world are often sparse and incomplete. Point cloud completion aims to restore incomplete point clouds into meaningful shapes. In recent years, point cloud completion has attracted the interest of many researchers. In most existing methods, the efficiency of completion is generally ignored in favor of producing meaningful shapes with adequate details. This paper proposes a fast point completion network (FPCN). FPCN is mainly composed of a multi-scale attention encoder (MSAE) and a structural refinement (SR) module. MSAE first obtains multi-scale geometric information by extracting incomplete inputs at different resolutions. After that, MSAE fuses multi-scale geometric information through cross-attention mechanisms. Compared with existing mainstream encoders, MSAE can extract rich geometric information from input point clouds with low complexity. The SR module aims to extract local information from the coarse point clouds to guide the process of extending points. Furthermore, the process of extending points is achieved by a replication strategy. Compared to existing folding-based decoders, the SR module can produce fine point clouds with more local details. Compared to existing transformer-based decoders, the SR module has a lower calculation price by employing a replication strategy to generate high-resolution point clouds. In conclusion, FPCN can restore partial point clouds into meaningful shapes efficiently, and the outcomes of completion contain sufficient details. Extensive experiments on various datasets demonstrate the performance and efficiency of the FPCN in point cloud completion. Source code is available at https://github.com/doldolOuO/FPCN. [ABSTRACT FROM AUTHOR]

The increasing reliance on internet-based services has heightened the vulnerability of network infrastructure to cyberattacks, particularly distributed denial of service (DDoS) attacks. These attacks can cause severe disruptions and significant financial losses. Early detection of malicious traffic is crucial in effectively combating such threats. This paper presents an innovative approach called the Encoder-Stacked deep neural networks (E-SDNN) model, which leverages Stacked/bagged multi-layer perceptrons (MLP) for accurate DDoS attack detection. The proposed method employs an encoder to select pertinent features from a preprocessed dataset, enabling precise attack detection. Extensive experiments were conducted on benchmark cybersecurity datasets, namely CICDS2017 and CICDDoS2019, encompassing various DDoS attack scenarios. The experimental results demonstrate the superiority of the E-SDNN model compared to state-of-the-art methods. The proposed E-SDNN model achieved an impressive overall accuracy rate of 99.94% and 98.86% for CICDDS2017 and CICDDoS2019, respectively. [ABSTRACT FROM AUTHOR]

Vision-based Human Action Recognition is difficult owing to the variations in the same action performed by various people, the temporal variations in actions, and the difference in viewing angles. Researchers have recently adopted multi-modal visual data fusion strategies to address the limitations of single-modality methodologies. Many researchers strive to produce more discriminative features because most existing techniques' success relies on feature representation in the data modality under consideration. Human action consists of several sub-actions whose duration vary between individuals. This paper proposes a multifarious learning framework employing action data in depth and skeleton formats. Firstly, a novel action representation named Multiple Sub-action Enhanced Depth Motion Map (MS-EDMM), integrating depth features from overlapping sub-actions, is proposed. Secondly, an efficient method is introduced for extracting spatio-temporal features from skeleton data. This is achieved by dividing the skeleton sequence into sub-actions and summarizing skeleton joint information for five distinct human body regions. Next, a multi-stream deep learning model with Attention-guided CNN and residual LSTM is proposed for classification, followed by several score fusion operations to reap the benefits of streams trained with multiple data types. The proposed method demonstrated a superior performance of 1.62% over an existing method that utilized skeleton and depth data, achieving an accuracy 89.76% on a single-view UTD-MHAD dataset. Furthermore, on the multi-view NTU RGB+D dataset demonstrated encouraging performance with an accuracy of 89.75% in cross-view and 83.8% in cross-subject evaluations. [ABSTRACT FROM AUTHOR]

Brain–Computer Interface is tested as a successful method in improving human cognitive functions such as attention and memory. Attention plays a significant role in areas ranging from a person's day-to-day life to educational domain and professional activities. When attention is evaluated using camera-based techniques, the users may suffer privacy issues. Using Brain–Computer Interface (BCI) to obtain a measure of attention will be useful in this regard. The paper proposes a Human Attention Recognition System (HARS) in which EEG signal acquisition is used to obtain the attention of the individual, Renyi's entropy-based mutual information method is used for feature selection and a deep learning-based classifier is used to classify the signals. HADS is not camera-based: therefore, faces of the subjects are not revealed. EEG signals were collected using the Ultracortex Mark III dry electrodes and were visualised using OpenBCI GUI (Graphical User Interface). The experiment is validated using the publicly available Confused Student EEG dataset from Kaggle, giving an accuracy of 99.21%. The results indicate that the proposed method can identify attention levels accurately and can be effectively used in educational systems, biofeedback and medical research. [ABSTRACT FROM AUTHOR]

Limitations in computer-assisted diagnosis include lack of labeled data and inability to model the relation between what experts see and what computers learn. Even though artificial intelligence and machine learning have demonstrated remarkable performances in medical image computing, their accountability and transparency level must be improved to transfer this success into clinical practice. The reliability of machine learning decisions must be explained and interpreted, especially for supporting the medical diagnosis. While deep learning techniques are broad so that unseen information might help learn patterns of interest, human insights to describe objects of interest help in decision-making. This paper proposes a novel approach, DeepCraftFuse, to address the challenge of combining information provided by deep networks with visual-based features to significantly enhance the correct identification of cancerous tissues in patients affected with Barrett's esophagus (BE). We demonstrate that DeepCraftFuse outperforms state-of-the-art techniques on private and public datasets, reaching results of around 95% when distinguishing patients affected by BE that is either positive or negative to esophageal cancer. [ABSTRACT FROM AUTHOR]

This paper proposes a new method to improve the training efficiency of deep convolutional neural networks. During training, the method evaluates scores to measure how much each layer's parameters change and whether the layer will continue learning or not. Based on these scores, the network is scaled down such that the number of parameters to be learned is reduced, yielding a speed-up in training. Unlike state-of-the-art methods that try to compress the network to be used in the inference phase or to limit the number of operations performed in the back-propagation phase, the proposed method is novel in that it focuses on reducing the number of operations performed by the network in the forward propagation during training. The proposed training strategy has been validated on two widely used architecture families: VGG and ResNet. Experiments on MNIST, CIFAR-10 and Imagenette show that, with the proposed method, the training time of the models is more than halved without significantly impacting accuracy. The FLOPs reduction in the forward propagation during training ranges from 17.83% for VGG-11 to 83.74% for ResNet-152. As for the accuracy, the impact depends on the depth of the model and the decrease is between 0.26% and 2.38% for VGGs and between 0.4 and 3.2% for ResNets. These results demonstrate the effectiveness of the proposed technique in speeding up learning of CNNs. The technique will be especially useful in applications where fine-tuning or online training of convolutional models is required, for instance because data arrive sequentially. [ABSTRACT FROM AUTHOR]

Ensuring the safety of workers and machinery during operations is a critical task in the construction sites. However, an inevitable circumstance in construction sites is the complex and dynamic environment, which often leads to occlusions. When detecting occluded objects in construction sites, general vision-based approaches tend to exhibit lower accuracy and may even miss detections, resulting in potential safety hazards. To handle this issue, this paper proposes a vision-based approach for detecting occluded objects in construction sites. Firstly, the proposed detection algorithm adopts the state-of-the-art YOLOv7 as its backbone. To enhance its capability in capturing contextual information of occluded objects, a novel channel attention mechanism is employed. Then, a design scheme for the detector head is provided by integrating a novel loss function Scylla-Intersection over Union (SIoU) and the non-maximum suppression (NMS) strategy. With the help of the loss function SIoU, the network can compute the loss values of occluded objects more accurately. To ensure that the network can select the right predicted box which closely aligns with the ground truth, the Euclidean distance is utilized as spatial penalty factor during the NMS stage. By implementing these two strategies, the proposed method can preserve both the category information and bounding boxes of occluded objects, which makes them possible to be detected. Finally, detailed experiments are done to verify the proposed method. Experimental results demonstrate that the proposed method has the potential for improving the detection accuracy. Moreover, it shows a better performance in detecting occluded objects in the dynamic construction sites compared to the existing baselines. [ABSTRACT FROM AUTHOR]

The data-driven modular deep fuzzy model has demonstrated excellent forecasting performance due to its clear architecture and powerful fuzzy inference ability. However, the fixed structure predesigned for specific types of datasets limits the further improvement of generalization ability, especially when facing high-dimensional datasets with the challenging problem of rule explosion, thereby suffering from the time-consuming training process. To overcome these limitations, a novel randomized fuzzy modules (RFMs) stacked residual deep fuzzy system (RFM-RDFS) is proposed in this study. Firstly, to obtain high-precision outputs, this paper presents a residual deep fuzzy framework by stacking RFMs layer by layer, where the modules in the current layer only learn the residual of the previous layer. Secondly, to improve the design freedom for different applications, the RFM with multiple inputs is raised, where the input variables are allocated by a sliding window along the input spaces of the layers, so the number of the parallel modules in the same layer can be flexibly adjusted. Meanwhile, in the RFM, inspired by the extreme learning machine, the centers and widths of Gaussian membership functions are randomly generated, which can greatly accelerate the training speed. Thirdly, to strengthen the approximation performance, the consequent parameters of the fuzzy rules in each RFM are learned by minimizing the loss function with the regularization terms through the ridge regression algorithm. Finally, extensive experiments on various datasets are conducted to compare the proposed RFM-RDFS with several state-of-the-art shallow and deep models. The detailed comparison results clearly show that the proposed RFM-RDFS is more flexible and compact, and has greater advantages in terms of the interpretability, generalization ability and robustness. [ABSTRACT FROM AUTHOR]

Multi-Object Tracking, also known as Multi-Target Tracking, is an important area of computer vision with various applications in different domains. The advent of deep learning has had a profound impact on this field, forcing researchers to explore innovative avenues. Deep learning methods have become the cornerstone of today's state-of-the-art solutions, consistently delivering exceptional tracking results. However, the significant computational demands of deep learning models require powerful hardware resources that do not always match real-time tracking requirements, limiting their practical applicability in real-world scenarios. Thus, there is an imperative to strike a balance by merging robust deep learning strategies with conventional approaches to enable more accessible, cost-effective solutions that meet real-time requirements. This paper embarks on this endeavor by presenting a hybrid strategy for real-time multi-target tracking. It effectively combines a classical optical flow algorithm with a deep learning architecture tailored for human crowd tracking systems. This hybrid approach achieves a commendable balance between tracking accuracy and computational efficiency. The proposed architecture, subjected to extensive experimentation in various settings, demonstrated notable results, achieving a Mean Object Tracking Accuracy (MOTA) of 0.608. This level of performance placed it as the highest ranking solution on the MOT15 benchmark, surpassing the state-of-the-art benchmark of 0.549, and consistently ranked among the superior models on the MOT17 and MOT20 benchmarks. Additionally, the incorporation of the optical flow phase resulted in a substantial reduction in processing time, nearly halving the duration, while simultaneously maintaining accuracy levels comparable to established techniques. [ABSTRACT FROM AUTHOR]

Over the preceding decade, there has been a discernible surge in the prominence of artificial intelligence, marked by the development of various methodologies, among which deep learning emerges as a particularly auspicious technique. The captivating attribute of deep learning, characterised by its capacity to glean intricate feature representations from data, has served as a catalyst for pioneering approaches and methodologies spanning a multitude of domains. In the face of the burgeoning exponential growth in digital medical image data, the exigency for adept image compression methodologies has become increasingly pronounced. These methodologies are designed to preserve bandwidth and storage resources, thereby ensuring the seamless and efficient transmission of data within medical applications. The critical nature of medical image compression accentuates the imperative to confront the challenges precipitated by the escalating deluge of medical image data. This review paper undertakes a comprehensive examination of medical image compression, with a predominant focus on sophisticated, research-driven deep learning techniques. It delves into a spectrum of approaches, encompassing the amalgamation of deep learning with conventional compression algorithms and the application of deep learning to enhance compression quality. Additionally, the review endeavours to explicate these fundamental concepts, elucidating their inherent characteristics, merits, and limitations. [ABSTRACT FROM AUTHOR]

With the rapid development of data acquisition and storage technology, spatio-temporal (ST) data in various fields are growing explosively, so many ST prediction methods have emerged. The review presented in this paper mainly studies the prediction of ST series. We propose a new taxonomy organized along three dimensions: ST series prediction methods (focusing on time feature learning, focusing on spatial feature learning, and focusing on spatial–temporal feature learning), techniques of ST series prediction (the RNN-, CNN-, and transformer-based models, as well as the CNN-based-composite model and GNN-based-composite models, and the miscellaneous model) and ST series prediction results (single target and multi-target). We first introduce and explain each dimension of the taxonomy in detail. After providing this three-dimensional view, we comprehensively review and compare the recent related ideas in the literature and analyze their advantages and limitations. Moreover, we summarize the key information of the existing literature and provide guidance for researchers to select suitable models. Second, we summarize the different applications of deep learning models in ST series prediction based on current literature and list relevant datasets and download links per application classifications. Lastly, we comprehensively analyze the current innovation and challenges and suggest future directions for researching ST series prediction after comparing and analyzing the computing performance of these forecasting models. In addition, each method or model solves one aspect of the challenge, which means that two or more methods should be combined to solve more challenges at the same time. We hope this article provides readers a broader and deeper understanding of the field of ST series research. [ABSTRACT FROM AUTHOR]

Parkinson's disease (PD) is a condition that degenerates over time and impairs speech and pronunciation because brain cells have died. This research work aims to predict parkinson disease using the voice features extracted from speech signals recorded from PD individuals with dysphonic speech disorders by employing deep learning algorithms. PD is challenging to diagnose early on in the clinical presentation. To address the issue in machine learning methods, this paper proposes a neural network model by processing speech signals to classify PD using the University of California Irvine (UCI) machine learning repository dataset. Initially, a pre-loss reduction module is created by using pre-sampling to make the dataset balanced by reducing the dimensionality and maintaining the size of the space without influencing the learning process for data preparation. The relevant features are derived using a novel multi-agent salp swarm (MASS) algorithm, and a novel Parkinson classification neural network (PCNN) is proposed to classify Parkinson's patients with high accuracy employing these derived features. The result shows that the models that use MASS-PCNN produce higher classification accuracy of 99.1%, precision of 97.8%, recall of 94.7% and F1-score of 0.995 when paralleled to the existing models. As an outcome, the suggested model will perform superior to common convolutional neural networks. [ABSTRACT FROM AUTHOR]

On most e-commerce websites, there are two crucial factors that customers rely on to assess product quality and dependability: customer reviews provided online and related ratings. Reviews offer feedback to customers about the product's merits, reasons for negative reviews, and feelings of satisfaction or dissatisfaction with the provided service. As for ratings, they express customer opinions about the product's quality as numerical values from one to five (one or two for the worst opinion, three for the neutral opinion, and four or five for the best opinion). Usually, the customer reviews may be inconsistent with their relevant ratings; the customer may write the worst review despite providing a four- or five-star rating or write the best review with only a one- or two-star rating. Due to this inconsistency, customers may need help to identify relevant information. Therefore, it is required to develop a model that can classify reviews as either positive or negative, depending on the polarity of thoughts, to demonstrate if there is an inconsistency between customer reviews and their actual ratings by comparing them with the ratings resulting from the model. This paper proposes an efficient deep learning (DL) model for classifying customer reviews and assessing whether there is inconsistency. The recommended model's performance and stability are examined on a large dataset of product reviews from Amazon e-commerce. The experimental findings showed that the proposed model dominates and significantly outperforms its peers regarding prediction accuracy and other performance measures. [ABSTRACT FROM AUTHOR]

Forecasting solar power production accurately is critical for effectively planning and managing renewable energy systems. This paper introduces and investigates novel hybrid deep learning models for solar power forecasting using time series data. The research analyzes the efficacy of various models for capturing the complex patterns present in solar power data. In this study, all of the possible combinations of convolutional neural network (CNN), long short-term memory (LSTM), and transformer (TF) models are experimented. These hybrid models also compared with the single CNN, LSTM and TF models with respect to different kinds of optimizers. Three different evaluation metrics are also employed for performance analysis. Results show that the CNN–LSTM–TF hybrid model outperforms the other models, with a mean absolute error (MAE) of 0.551% when using the Nadam optimizer. However, the TF–LSTM model has relatively low performance, with an MAE of 16.17%, highlighting the difficulties in making reliable predictions of solar power. This result provides valuable insights for optimizing and planning renewable energy systems, highlighting the significance of selecting appropriate models and optimizers for accurate solar power forecasting. This is the first time such a comprehensive work presented that also involves transformer networks in hybrid models for solar power forecasting. [ABSTRACT FROM AUTHOR]

Normal and stable operations of hydraulic systems are of great importance to the safety and efficiency of industrial production processes. Accurate and prompt diagnosis of fault types and degrees can ensure hydraulic systems return to normal in the early stage of faults and thus can prevent serious accidents. However, the structure of hydraulic systems is complex, and some faults may occur simultaneously. In addition, many hydraulic systems have multi-rate data collected from different sensors. Such problems cause great challenges to fault diagnosis in hydraulic systems. Motivated by the above issues, this paper proposes a deep learning method to diagnose faults and identify fault degrees in hydraulic systems using fully convolutional networks (FCNs) and deep feature fusion. The main contributions are twofold: (1) A new fault diagnosis framework is designed to identify both the fault types and degrees in the presence of multiple faults; and (2) deep feature extractors composed of multiple superimposed convolutional blocks are designed to extract deep features from multi-rate time series, and such features are then fused via flattening and concatenating and fed into the fault diagnosis model. Case studies based on a hydraulic system test bed are provided to demonstrate the effectiveness and superiority of the proposed fault diagnosis method. [ABSTRACT FROM AUTHOR]

Breast cancer, a widespread global disease, represents a significant threat to women's health and lives. Many researchers have proposed computer-aided diagnosis systems for classifying breast cancer. The majority of the approaches primarily utilize deep learning methods, which overlook the crucial necessity of incorporating both local information for precise tumor detection. In addition, available breast cancer datasets are imbalanced in nature. Therefore, this paper presents the hybrid breast network (HBNet) for detection of breast cancer, designed to address two critical challenges: class imbalance and incorporation of both global and local information in achieving precise tumor classification. To overcome the problem of class imbalance, HBNet incorporates the borderline synthetic minority oversampling technique. Simultaneously, it employs a feature fusion approach to combine deep and handcrafted features extracted by utilizing ResNet50 and HOG which incorporates global and local information. Moreover, the proposed method integrates the block-matching and 3D denoising filter to effectively eliminate multiplicative noise that has enhanced the performance of the system. The proposed HBNet is evaluated with BUSI and UDIAT datasets and achieved an average accuracy of 95.824% and 90.37%, respectively. [ABSTRACT FROM AUTHOR]

One of the most popular techniques for changing the purpose of an image or resizing a digital image with content awareness is the seam-carving method. The performance of image resizing algorithms based on seam machining shows that these algorithms are highly dependent on the extraction of importance map techniques and the detection of salient objects. So far, various algorithms have been proposed to extract the importance map. In this paper, a new method based on Rényi entropy is proposed to extract the importance map. Also, a deep learning network has been used to detect salient objects. The simulator results showed that combining Rényi's importance map with a deep network of salient object detection performed better than classical seam-carving and other extended seam-carving algorithms based on deep learning. [ABSTRACT FROM AUTHOR]

In this paper, we study the post-hoc calibration of modern neural networks, a problem that has drawn a lot of attention in recent years. Despite the plethora of calibration methods proposed, there is no consensus yet on the inherent complexity of the task and, while some authors claim that simple functions solve the problem, others suggest that more expressive models are needed to capture misscalibration. As a first approach, we focus on the task of confidence scaling, specifically on post-hoc methods that generalize Temperature Scaling, which we refer to as the Adaptive Temperature Scaling family. We begin by demonstrating that while complex models like neural networks provide an advantage when there is ample data, they fail in scenarios where it is limited, notably common in fields like medical diagnosis. We then show how under this ideal data conditions the more expressive methods learn a relationship between the entropy of a prediction and its level of overconfidence, and based on this observation, we propose Entropy-based Temperature Scaling, a simple method that scales the confidence of a prediction according to this relationship. Results show that our method obtains state-of-the-art performance and is robust against data scarcity. Moreover, our proposed model enables a deeper understanding of the calibration process by the interpretation of the entropy as a measure of uncertainty in the network outputs. [ABSTRACT FROM AUTHOR]

The rapid developing deep learning is highly required by resources and computing resources, which easily leads to backdoor learnings. It is difficult for existing schemes to strike a balance among trigger concealment, the effect and the stability. Sometimes, simple manipulation of the image may disable the trigger. In this paper, we propose an invisible backdoor learning scheme in regional transform domain. The high-frequency region remains unchanged while the left region is transformed so that the trigger is added in the high frequency. Experimental results show that the attack success rate (ASR) of our scheme reaches more than 99%, while the accuracy of the model (BA) decreases by less than 1%. Our scheme can resist common defense methods and the samples; visual quality of our scheme is better than others. [ABSTRACT FROM AUTHOR]

Cloud and snow in remote sensing images typically block the underlying surface information and interfere with the extraction of available information, so detecting cloud and snow becomes a critical problem in remotely sensed image processing. The current methods for detecting clouds and snow are susceptible to interference from complex background, making it difficult to recover cloud edge details and causing missing and false detection phenomena. To address these issues, a cross-dimensional feature attention aggregation network is suggested to realize the segmentation of clouds and snow. To address the problem of interference induced by the similar spectral characteristics of clouds and snow, the context attention aggregation module is added to conflate feature maps of various dimensions and screen the information. Multi-scale strip convolution module (MSSCM) and its improved version MSSCMs are used to extract edge characteristics at different scales and improve the harsh segmentation border. Also, adding deep feature semantic information extraction module to deep features to guide the classification of the model to avoid the interference of complex background. Finally, a 'los beatles' module is used to replace the traditional linear combination in the decoding stage, and the feature information of different granularity is fused and extracted to enhance the model's detection efficiency. In this paper, experiments are carried out on the public datasets: CSWV, HRC _ WHU and L8 _ SPARCS. The MIOU scores on the three datasets are 89.507 % , 91.674 % and 80.722 % , respectively. Comparative experiment findings demonstrate that the network presented in this article can attain the highest detection accuracy and good detection efficiency with low parameters. [ABSTRACT FROM AUTHOR]

Gliomas are the most common and aggressive form of all brain tumors, with a median survival rate of fewer than two years, especially for the highest-grade glioma patient. Accurate and reproducible brain tumor segmentation is essential for an effective treatment plan and diagnosis to reduce the risk of further spread. Automated brain tumor segmentation is challenging because it can appear in the brain with variations in shape, size, and position from one patient to another. Several deep learning architectures have been created to handle automatic segmentation with good performance results on 3D MRI images. However, these architectures are generally large and require high hardware specifications and a large amount of memory and storage. This paper proposes a lightweight modified 3D UNet architecture with an outstanding performance level called Yaru3DFPN. The architecture is built based on the UNet. The block used is ResNet and is modified to use pre-activation strategies and GroupNormalization for batch normalization. In the expanding section, features are arranged into pyramid features. The final output is thresholded using the combining thresholding method. This architecture is light and fast. This proposal was tested using BraTS datasets with the highest dice performance of 80.90%, 86.27%, and 92.02% for ET, TC, and WT areas, respectively. This result outperformed all other comparative architectures and promised to be developed for clinical application. [ABSTRACT FROM AUTHOR]

Assessing the strength of complex networks is crucial for evaluating their functionality and monitoring system security. Two primary perspectives for measuring network robustness are connectivity and controllability, which quantify how well a network maintains connectivity and controllability after experiencing complete attacks. However, conventional robustness calculation methods that use simulation attacks can be impractical for large-scale networks. Recent research has explored the use of deep learning methods for network robustness prediction, including PCR (short for predictor of controllability robustness), which uses a VGG (short for visual geometry group)-based convolutional neural network (CNN) and a linear filter. However, PCR has limitations, including inaccurate edge importance differentiation and fluctuating output curves. This paper presents ATTRP, an attention-based robustness predictor, which addresses these limitations. ATTRP uses a novel convolutional neural network with channel and spatial attention mechanisms to improve prediction accuracy and a robustness filter based on Savitzky–Golay smoothing to rectify the robustness curve. Experimental studies demonstrate that ATTRP outperforms other predictors, with much lower errors, while its computational speed is far superior to that of traditional attacking simulation. Overall, our research provides a more effective and efficient means of predicting network robustness, with potential applications in monitoring system security. [ABSTRACT FROM AUTHOR]

Automatic speech recognition systems based on end-to-end models (E2E-ASRs) can achieve comparable performance to conventional ASR systems while reproducing all their essential parts automatically, from speech units to the language model. However, they hide the underlying perceptual processes modelled, if any, and they have lower adaptability to multiple application contexts, and, furthermore, they require powerful hardware and an extensive amount of training data. Model-explainability techniques can explore the internal dynamics of these ASR systems and possibly understand and explain the processes conducting to their decisions and outputs. Understanding these processes can help enhance ASR performance and reduce the required training data and hardware significantly. In this paper, we probe the internal dynamics of three E2E-ASRs pre-trained for English by building an acoustic-syllable boundary detector for Italian and Spanish based on the E2E-ASRs' internal encoding layer outputs. We demonstrate that the shallower E2E-ASR layers spontaneously form a rhythmic component correlated with prominent syllables, central in human speech processing. This finding highlights a parallel between the analysed E2E-ASRs and human speech recognition. Our results contribute to the body of knowledge by providing a human-explainable insight into behaviours encoded in popular E2E-ASR systems. [ABSTRACT FROM AUTHOR]

Small object detection is widely used in a variety of fields such as automatic driving, UAV-based object detection, and aerial image detection. However, small objects carry limited information, making it difficult for detectors to detect small objects. In recent years, the development of deep learning has significantly improved the performance of small object detection. This paper provides a comprehensive review to help further the development of small target detection. We summarize the challenges related to small object detection and analyze solutions to these challenges in existing works, including integrating the feature at different layers, enriching available information, balancing the number of positive and negative samples for small objects, and increasing sufficient small object instances. We discuss related methods developed in three application areas, including automatic driving, UAV search and rescue, and aerial image detection. In addition, we thoroughly analyze the performance of typical small object detection methods on popular datasets. Finally, based on the comprehensive review of small object detection methods, we point out possible research directions for future studies. [ABSTRACT FROM AUTHOR]

Implant prosthesis is the most appropriate treatment for dentition defect or dentition loss, which usually involves a surgical guide design process to decide the implant position. However, such design heavily relies on the subjective experiences of dentists. In this paper, a transformer-based Implant Position Regression Network, ImplantFormer, is proposed to automatically predict the implant position based on the oral CBCT data. We creatively propose to predict the implant position using the 2D axial view of the tooth crown area and fit a centerline of the implant to obtain the actual implant position at the tooth root. Convolutional stem and decoder are designed to coarsely extract image features before the operation of patch embedding and integrate multi-level feature maps for robust prediction, respectively. As both long-range relationship and local features are involved, our approach can better represent global information and achieves better location performance. Extensive experiments on a dental implant dataset through fivefold cross-validation demonstrated that the proposed ImplantFormer achieves superior performance than existing methods. [ABSTRACT FROM AUTHOR]

Breast cancer detection is considered a challenging task for the average experienced radiologist due to the variation of the lesions' size and shape, especially with the existence of high fibro-glandular tissues. The revolution of deep learning and computer vision contributes recently in introducing systems that can provide an automated diagnosis for breast cancer that can act as a second opinion for doctors/radiologists. The most of previously proposed deep learning-based Computer-Aided Diagnosis (CAD) systems mainly utilized Convolutional Neural Networks (CNN) that focuses on local features. Recently, vision transformers (ViT) have shown great potential in image classification tasks due to its ability in learning the local and global spatial features. This paper proposes a fully automated CAD framework based on YOLOv4 network and ViT transformers for mass detection and classification of Contrast Enhanced Spectral Mammography (CESM) images. CESM is an evolution type of Full Field Digital Mammography (FFDM) images that provides enhanced visualization for breast tissues. Different experiments were conducted to evaluate the proposed framework on two different datasets that are INbreast and CDD-CESM that provides both FFDM and CESM images. The model achieved at mass detection a mean Average Precision (mAP) score of 98.69%, 81.52%, and 71.65% and mass classification accuracy of 95.65%, 97.61%, and 80% for INbreast, CE-CESM, and DM-CESM, respectively. The proposed framework showed competitive results regarding the state-of-the-art models in INbreast. It outperformed the previous work in the literature in terms of the F1-score by almost 5% for mass detection in CESM. Moreover, the experiments showed that the CESM could provide more morphological features that can be more informative, especially with the highly dense breast tissues. [ABSTRACT FROM AUTHOR]

In areas with high tuberculosis (TB) prevalence, high mortality rate has significantly increased over the past few decades. Even though tuberculosis can be treated, areas with high disease burden continue to have insufficient screening tools, leading to diagnostic delays and incorrect diagnoses. As a result of these challenges, a computer-aided diagnostics (CAD) system has been developed that can automatically detect tuberculosis. There are few different methods that can be used to screen for tuberculosis; however, chest X-ray (CXR) is most commonly used and strongly suggested because it is so effective in identifying lung irregularities. Over past ten years, we have seen a meteoric rise in amount of research conducted into application of machine learning strategies to examination of chest X-ray images for screening regarding pulmonary abnormalities. Particularly, we have also noticed significant interest in testing for TB. This attentiveness has increased in tandem with phenomenal progress that has been made in deep learning (DL), which is predominately founded on convolutional neural networks (CNNs). Because of these advancements, significant research contributions have been made in field of DL techniques for TB screening by utilizing CXR images. The main focus of this paper is to emphasize favorable methods and data collection, as well as methodological contributions, identify data collections, and identify challenges. [ABSTRACT FROM AUTHOR]

Reinforcement learning is a compelling area of research within machine learning because it enables the improvement of control strategies for future manipulation of dynamic systems, leveraging previous data even without a precise model of the system. It usually makes complex, model-free predictions from data alone, which is actually consistent with the purpose of control in that they both aim to design systems using richly structured perceptions to execute planning and control strategies that adequately adapt to changing environments. The robust trajectory tracking control of intricate mechanical systems presents a challenging problem that necessitates effective control methods. In this paper, we propose a novel nonlinear control strategy based on deep reinforcement learning to solve the trajectory tracking problem of a 3-degree-of-freedom (3-DOF) control moment gyroscope (CMG). First, dynamic modeling of the 3-DOF CMG is used as a policy solver for the reinforcement learning training environment, and transfer learning is employed to bridge the reality gap. Then, the hyperparameters and reward functions of the neural network are optimized using the asynchronous successive halving algorithm. Ultimately, the twin delay depth determination policy gradient algorithm is trained in simulation to yield an agent capable of tracking user-defined trajectory routes as a nonlinear controller for the system. Both simulation and experimental results show that the proposed method works well for both high-frequency and low-frequency varying trajectory tracking control, and that the proposed method has better response speed and robustness than classic linear parameter-varying control methods and the state-of-the-art nonlinear parameter-varying method and the neural network-based feedback linearization adaptive control method. [ABSTRACT FROM AUTHOR]

Deep learning integration in cancer diagnosis enhances accuracy and diagnosis speed which helps clinical decision-making and improves health outcomes. Despite all these benefits in cancer diagnosis, the present AI models in urology cancer diagnosis have not been sufficiently reviewed systematically. This paper reviews the artificial intelligence approaches used in cancer diagnosis, prediction, and treatment of urology cancer. AI models and their applications in urology subspecialties are evaluated and discussed. The Scopus, Microsoft Academic and PubMed/MEDLINE databases were searched in November 2022 using the terms "artificial intelligence", "neural network", "machine learning," or "deep learning" combined with the phrase "urology cancers". The search was limited to publications published within the previous 20 years to identify cutting-edge deep-learning applications published in English. Irrelevant review articles and publications were eliminated. The included research involves two kinds of research analysis: quantitative and qualitative. 48 articles were included in this survey. 25 studies proposed several approaches for prostate cancers, while 15 were for bladder cancers. 8 studies discussed renal cell carcinoma and kidney cancer. The models presented to detect urology cancers have achieved high detection accuracy (77–95%). Deep learning approaches that use convolutional neural networks have achieved the highest accuracy among other techniques. Although it is still progressing, the development of AI models for urology cancer detection, prediction, and therapy has shown significant promise. Additional research is required to employ more extensive, higher-quality, and more recent datasets to the clinical performance of the proposed AI models in urology cancer applications. [ABSTRACT FROM AUTHOR]

Approximation approaches have been developed for very large-scale integration architecture to limit power consumption and increase effective throughput. The full adder (FA) and block-based designs are the approximate adder designs widely used in the existing techniques to accelerate the additions by partitioning a long carry propagation chain. However, these techniques require more power and area than the standard FA-based techniques. To overcome this issue, this paper presents an error-reduced carry prediction approximate full adder (ERCPAA) technique to achieve faster additions and performance by adding a constant truncation mechanism with an error reduction strategy. Deep learning and neural network technology had made great progress in recent years for field programmable gate array implementation and real-time object detection. It is essential to maintain high accuracy rates in image processing applications, as any errors introduced during the processing can significantly impact the quality of the output image and impact the hardware implementation. Therefore, we propose an ERCPAA that utilizes a lightweight convolutional neural network (ERCPAA–lightweight CNN) to fit well in a fixed-point CNN accelerator architecture. A lightweight CNN that is both thin (with fewer feature maps per layer) and deep (four layers) with just one fully connected hidden layer can enable faster training while achieving higher accuracy. In addition, in a few positions of the higher-order bits of the incorrect part, a full adder (FA) cell is used to simplify the traditional one-bit FA cell, creating an approximate summation and carry. The proposed method is verified by randomly selecting specific images from the Fruit 360, ImageNet, and the Caltech 256 Image Dataset. The proposed model offers an normalized mean error distance, error rate, and mean relative error distance values of 0.154, 6.55%, and 4.6E-4. The recognition accuracy of the proposed model in the ImageNet database is 96% with an execution time of 1420 µs. [ABSTRACT FROM AUTHOR]

An artificial neural network (ANN) in information technology is a system of hardware or software modeled after the operation of neurons in the human brain. ANNs, often known as "neural networks," are a form of deep learning technology that falls under the umbrella of Artificial Intelligence (AI). Commercial applications of these technologies typically focus on optimization and solving complex signal processing and pattern recognition problems. Multiple types of optimization techniques are utilized to determine the optimal neural network for a model. These procedures help determine and define the model's accuracy, dependability, functionality, and capacity. The convergence of the neural network helps determine the number of training iterations required to generate the fewest errors. In this paper, we investigate an activation function to help reduce the training time of the analog-to-digital converter (ADC). A new Hopfield ADC model is proposed by using the proteretic activation function property. We supported our research by simulating the new ADC converter and comparing the traditional Hopfield ADC, the hysteretic ADC, and the proteretic ADC. Experiment and simulation demonstrate that the proteretic function provides a faster rate of convergence than other functions, thereby enhancing the performance of the ADC application. [ABSTRACT FROM AUTHOR]

Nowadays, machine learning (ML) has attained a high level of achievement in many contexts. Considering the significance of ML in medical and bioinformatics owing to its accuracy, many investigators discussed multiple solutions for developing the function of medical and bioinformatics challenges using deep learning (DL) techniques. The importance of DL in Internet of Things (IoT)-based bio- and medical informatics lies in its ability to analyze and interpret large amounts of complex and diverse data in real time, providing insights that can improve healthcare outcomes and increase efficiency in the healthcare industry. Several applications of DL in IoT-based bio- and medical informatics include diagnosis, treatment recommendation, clinical decision support, image analysis, wearable monitoring, and drug discovery. The review aims to comprehensively evaluate and synthesize the existing body of the literature on applying deep learning in the intersection of the IoT with bio- and medical informatics. In this paper, we categorized the most cutting-edge DL solutions for medical and bioinformatics issues into five categories based on the DL technique utilized: convolutional neural network, recurrent neural network, generative adversarial network, multilayer perception, and hybrid methods. A systematic literature review was applied to study each one in terms of effective properties, like the main idea, benefits, drawbacks, methods, simulation environment, and datasets. After that, cutting-edge research on DL approaches and applications for bioinformatics concerns was emphasized. In addition, several challenges that contributed to DL implementation for medical and bioinformatics have been addressed, which are predicted to motivate more studies to develop medical and bioinformatics research progressively. According to the findings, most articles are evaluated using features like accuracy, sensitivity, specificity, F-score, latency, adaptability, and scalability. [ABSTRACT FROM AUTHOR]

A fabric inspection system is a sophisticated computer vision system that detects fabric defects, automatically. In recent years, human visual inspection has traditionally been used to detect fabric defects. However, this trend is inaccurate and may be expensive due to the need for highly-trained personnel. This paper describes a deep-learning-based fabric inspection system for detecting fabric defects instead of the dependence on personnel. To find the Region of Interest (RoI) in fabric images, the system depends on a saliency-based region detection technique to localize the defected areas in fabric images. The fabric images are then classified into defect-free and defective images using a Convolutional Neural Network (CNN). Four convolutional layers and four max-pooling layers are arranged in the suggested model. A fully-connected layer and a Softmax activation function are also used in the classification task. The results of the experiments indicate that the proposed system exceeds some other state-of-the-art systems in terms of both quality and robustness. The proposed system achieves an average accuracy of 95.8%. Hence, it can be used in applications related to fabric industry. [ABSTRACT FROM AUTHOR]

Multimodal Human Action Recognition (MHAR) is an important research topic in computer vision and event recognition fields. In this work, we address the problem of MHAR by developing a novel audio-image and video fusion-based deep learning framework that we call Multimodal Audio-Image and Video Action Recognizer (MAiVAR). We extract temporal information using image representations of audio signals and spatial information from video modality with the help of Convolutional Neutral Networks (CNN)-based feature extractors and fuse these features to recognize respective action classes. We apply a high-level weights assignment algorithm for improving audio-visual interaction and convergence. This proposed fusion-based framework utilizes the influence of audio and video feature maps and uses them to classify an action. Compared with state-of-the-art audio-visual MHAR techniques, the proposed approach features a simpler yet more accurate and more generalizable architecture, one that performs better with different audio-image representations. The system achieves an accuracy 87.9% and 79.0% on UCF51 and Kinetics Sounds datasets, respectively. All code and models for this paper will be available at https://tinyurl.com/4ps2ux6n. [ABSTRACT FROM AUTHOR]

Colorectal cancer (CRC) is a malignant condition that affects the colon or rectum, and it is distinguished by abnormal cell growth in these areas. Colon polyps, which are abnormalities, can turn into cancer. To stop the spread of cancer, early polyp detection is essential. The timely removal of polyps without submitting a sample for histology is made possible by computer-assisted polyp classification. In addition to Locally Shared Features (LSF) and ensemble learning majority voting, this paper introduces a computer-aided decision support system named PolyDSS to assist endoscopists in segmenting and classifying various polyp classes using deep learning models like ResUNet and ResUNet++ and transfer learning models like EfficientNet. The PICCOLO dataset is used to train and test the PolyDSS model. To address the issue of class imbalance, data augmentation techniques were used on the dataset. To investigate the impact of each technique on the model, extensive experiments were conducted. While the classification module achieved the highest accuracy of 0.9425 by utilizing the strength of ensemble learning using majority voting, the proposed segmenting module achieved the highest Dice Similarity Coefficient (DSC) of 0.9244 using ResUNet++ and LSF. In conjunction with the Paris classification system, the PolyDSS model, with its significant results, can assist clinicians in identifying polyps early and choosing the best approach to treatment. [ABSTRACT FROM AUTHOR]

Knee ligament tear injury is frequent in many volleyball, football, basketball, and cricket players. In the past, various deep learning-based ACL tear detection schemes using knee magnetic resonance imaging (MRI) have been presented. It has shown challenges in ACL tear detection performance due to class imbalance issue arising due to uneven training samples and poor feature representation. This paper presents a simple and effective ACL knee ligament tear detection method with a convolutional neural network (ATD-CNN) to lessen the intricacy of the network. Further, the self-attention mechanism is used to improve the feature representation of MRI image information, neglect the irrelevant information in deep features, and enhance the classification accuracy. To diminish the class imbalance issue, generative adversarial network (GAN) is used to construct the synthetic database. The performance of the ATD-CNN with self-attention is assessed on the MRNet database using precision, accuracy, F1-score, and recall. ATD-CNN provides an accuracy of 90.10% for the original and 93.93% and augmented datasets. However, the ATD-CNN without attention mechanism resulted in 89.60% and 92.30% accuracy for original and augmented dataset. The proposed ATD-CNN model indicates that it can be utilized to detect ACL tears automatically and outperforms the existing schemes for tear detection. [ABSTRACT FROM AUTHOR]

Customers churn is an important issue that is always concerned by banks, and is put at the forefront of the bank's policies. The fact that banks can identify customers who are intending to leave the service can help banks promptly make policies to retain customers. In this paper, we propose a combined deep learning network models to predict customers leaving or staying at the bank. The proposed model consists of two levels, Level 0 consists of three basic models using three Deep Learning Neural Networks, and Level 1 is a logistic regression model. The proposed model has obtained evaluation results with accuracy metrics of 96.60%, precision metrics of 90.26%, recall metrics of 91.91% and F1 score of 91.07% on the dataset "Bank Customer Churn Prediction". [ABSTRACT FROM AUTHOR]

One of the primary means of sea exploration is autonomous underwater vehicles (AUVs). To perform these tasks, AUVs must navigate the rough challenging sea environment. AUVs usually employ an inertial navigation system (INS), aided by a Doppler velocity log (DVL), to provide the required navigation accuracy. The DVL transmits four acoustic beams to the seafloor, and by measuring changes in the frequency of the returning beams, the DVL can estimate the AUV velocity vector. However, in practical scenarios, not all the beams are successfully reflected. When only three beams are available, the accuracy of the velocity vector is degraded. When fewer than three beams are reflected, the DVL cannot estimate the AUV velocity vector. For such situations, only model-based approaches have been proposed to estimate missing beams. This paper presents a data-driven approach, MissBeamNet, to regress the missing beams in partial DVL beam measurement cases. To that end, a deep neural network (DNN) model is designed to process the available beams along with past DVL measurements to regress the missing beams. The AUV velocity vector is estimated using the available measured and regressed beams. To validate the proposed approach, sea experiments were made with the "Snapir" AUV, resulting in an 11 h dataset of DVL measurements. Our results show that the proposed system can accurately estimate velocity vectors in situations of missing beam measurements. Our dataset and codebase implementing the described framework is available at: https://github.com/ansfl/MissBeamNet. [ABSTRACT FROM AUTHOR]

The cost function gradient vanishing or exploding problem and slow convergence speed are key issues when training deep neural networks (DNNs). In this paper, we investigate the forward and backward propagation processes of DNN training and explore the properties of the activation function and derivative function (ADF) employed. The outputs' distribution of ADF with near-zero mean is proposed to reduce gradient problems. Additionally, the constant energy transfer of propagating data in the training process is also proposed to speed up convergence further. Based on wavelet frame theory, we derive a novel ADF, i.e., tight frame wavelet activation function (TFWAF) and tight frame wavelet derivative function (TFWDF) of the Mexican hat wavelet, to stabilize and accelerate DNN training. The nonlinearity of wavelet functions can strengthen the learning capacity of DNN models, while the sparse property of wavelets derived can reduce the overfitting problem and enhance the robustness of models. Experiments demonstrate that the proposed method stabilizes the DNN training process and accelerates convergence. [ABSTRACT FROM AUTHOR]

Alzheimer's disease (AD) is the most frequent type of dementia that has no effective cure, except early discovery and treatment that may help patients to include successful years in patient's lives. Currently, mini-mental state examination (MMSE) score and manual examination of magnetic resource imaging (MRI) scan along with machine learning techniques are used to diagnose the disease; however, they possess certain accuracy limits. Therefore, this paper proposes a deep learning-based multilayered framework for AD classification using transfer learned Alexnet and LSTM for multiclass and binary classification of MR images. However, the deep learning models used in the current study necessitate a large training dataset to produce better outcomes. As a result, this work also utilizes generative adversarial network (GAN) as a data augmentation tool to improve the classification results and further to solve the problem of overfitting. The study uses Alzheimer's disease neuroimaging initiative (ADNI) dataset of 60 AD, 73 mild cognitive impairment (MCI) and 67 cognitively normal (CN) patients from which 2 D MR image scans are extracted. Furthermore, the proposed method achieved the classification accuracy on AD–CN at 98.13%, AD–MCI at 99.38% and CN–MCI at 99.37%, respectively. Also, the multiclass classification shows the promising accuracy of 96.83% for the proposed framework. Finally, the proposed model's performance is compared to other state-of-the-art techniques and the experimental results show that the proposed model outperforms in terms of accuracy, sensitivity and hypothesis testing. [ABSTRACT FROM AUTHOR]

Document classification is becoming increasingly essential for the vast number of documents available in digital libraries, emails, the Internet, etc. Textual records frequently contain non-discriminative (noisy and irrelevant) terms that are also high-dimensional, resulting in higher computing costs and poorer learning performance in Text Classification (TC). Feature selection (FS), which tries to discover discriminate terms or features from the textual data, is one of the most effective tasks for this issue. This paper introduces a novel multi-stage term-weighting scheme-based FS model designed for the single-label TC system to obtain the optimal set of features. We have also developed a hybrid deep learning fine-tuning network based on Bidirectional Long Short-Term Memory (BiLSTM) and Convolutional Neural Network (CNN) for the classification stage. The FS approach is worked on two-stage criteria. The filter model is used in the first stage, and the multi-objective wrapper model, an upgraded version of the Whale Optimization Algorithm (WOA) with Particle Swarm Optimization (PSO), is used in the second stage. The objective function in the above wrapper model is based on a tri-objective principle. It uses the Pareto front technique to discover the optimal set of features. Here in the wrapper model, a novel selection strategy has been introduced to select the whale instead of the random whale. The proposed work is evaluated on four popular benchmark text corpora, of which two are binary class, and two are multi-class. The suggested FS technique is compared against classic Machine Learning (ML) and deep learning classifiers. The results of the experiments reveal that the recommended FS technique is more effective in obtaining better results than the other results. [ABSTRACT FROM AUTHOR]