Search

The purpose of this paper is to help people with auditory and speech disabilities to communicate with others and for controlling computers and machines. This paper proposes two different methods for identifying six distinctive hand gestures and sign language for divergent environmental conditions. The first method is based on the hand feature extraction i.e., convexity defects. For that, initially, the hand region is detected by HSV skin color conversion process. Contour and convex hull of hand are extracted from the hand region. Finally, convexity defects are determined to identify the hand gestures. The second method is deep learning based YOLOv3 model that uses DARKNET-53 convolutional neural network (CNN) as its backbone. The model is trained on a large annotated dataset. Experimental results reveal that the deep-leaning method outperforms the hand feature approach and obtain 98.92% and 95.57% accuracy for deep learning and hand feature-based model respectively. [ABSTRACT FROM AUTHOR]

Previously, single classification models were mainly studied to classify human protein cell images, i.e., to identify a certain protein based on a set of different cells. However, a classifier can identify only one protein, in fact, a single cell usually consists of multiple proteins, and the proteins are not completely independent of each other. In this paper, we build a human protein cell classification model by multi-label learning. The logical relationship and distribution characteristics among the labels are analyzed to determine the different proteins contained in a set of different cells (i.e., containing multiple elements in the output space). In this paper, using human protein image data, we conducted comparison experiments on pre-trained Xception and InceptionResnet V2 to optimize the two models in terms of data augmentation, channel settings, and model structure. The results show that the Optimized InceptionResnet V2 model achieves high performance in the classification task. The final accuracy of the Optimized InceptionResnet V2 model we obtained reached 96.1%, which is a 2.82% improvement relative to that before the optimized model. [ABSTRACT FROM AUTHOR]

In this paper, we explore the problem of direction-of-arrival (DOA) estimation for a non-uniform linear array (NULA) under strong noise. The compressed sensing (CS)-based methods are widely used in NULA DOA estimations. However, these methods commonly rely on the tuning of parameters, which are hard to fine-tune. Additionally, these methods lack robustness under strong noise. To address these issues, this paper proposes a novel DOA estimation approach using a deep neural network (DNN) for a NULA in a low SNR. The proposed network is designed based on the denoising convolutional neural network (DnCNN) and the alternating direction method of multipliers (ADMM), which is dubbed as LDnADMM-Net. First, we construct an unfolded DNN architecture that mimics the behavior of the iterative processing of an ADMM. In this way, the parameters of an ADMM can be transformed into the network weights, and thus we can adaptively optimize these parameters through network training. Then, we employ the DnCNN to develop a denoising module (DnM) and integrate it into the unfolded DNN. Using this DnM, we can enhance the anti-noise ability of the proposed network and obtain a robust DOA estimation in a low SNR. The simulation and experimental results show that the proposed LDnADMM-Net can obtain high-accuracy and super-resolution DOA estimations for a NULA with strong robustness in a low signal-to-noise ratio (SNR). [ABSTRACT FROM AUTHOR]

Autonomous spacecraft relative navigation via monocular images became a hot topic in the past few years and, recently, received a further push thanks to the constantly growing field of artificial neural networks and the publication of several spaceborne image datasets. Despite the proliferation of spacecraft relative-state initialization algorithms developed, most architectures adopt computationally expensive solutions relying on convolutional neural networks (CNNs) that provide accurate output at the cost of a high computational burden that seems unfeasible for current spaceborne hardware. The paper addresses this issue by proposing a novel pose initialization algorithm based on lightweight CNNs. Inspired by previous state-of-the-art algorithms, the developed architecture leverages a fast and accurate target detection CNN followed by a line segment detection CNN capable of running with low inference time on mobile devices. The line segments and their junctions are grouped into complex geometrical groups, reducing the solution search space, and subsequently, they are adopted to extract the final pose estimate. As a main outcome, the analyses demonstrate that the lightweight architecture developed scores high accuracy in the pose estimation task, with a mean estimation error of less than 10 cm in translation and 2.5°in rotation. The baseline algorithm scores a mean SLAB error of 0.04552 with a standard deviation of 0.22972 in the test dataset. Detailed analyses demonstrate that the uncertainties on the overall pose score are driven mainly by errors in the relative attitude, which gives the highest contribution to the pose error metric adopted. The analyses on the error distributions point out that the uncertainties on the estimated relative position are higher in the camera boresight axis direction. Concerning the relative attitude, the algorithm proposed has higher uncertainties in estimating directions of the target x and y axes due to ambiguities related to the target geometry. Notably, the target detection CNN trained in this work outperforms the previous top scores in the benchmark dataset. The performances of the proposed algorithm have been investigated further by analyzing the effects on the accuracy due to the relative distance and the presence of background in the images. Lastly, the paper delves into the possibility of adopting a sub-portion of the 2D-to-3D match matrix made by the most complex perceptual groups identified that positively affects the overall run-time, pointing out the performances in terms of accuracy of the estimates and providing a comparison of both the baseline and the reduced match matrix versions against state-of-the-art algorithms concerning relative position and attitude errors and solution availability, highlighting the high accuracy and solution availability of the proposed architectures. • New relative pose initialization algorithm based on the detection of line segments. • Detailed literature review and description of available spaceborne image datasets. • Improvement of state of the art in spacecraft detection using lightweight CNN. • Assessment of accuracy of the proposed architecture and error sources analyses. • Proven feasibility of the approach via comparison with other architectures. [ABSTRACT FROM AUTHOR]

Objectives: The quality of network structure is the key to obtain excellent classification performance. Most of existing deep models are designed by the trial-and-error method. When the same model processes different hyperspectral images (HSIs), different network hyperparameters need to be set artificially to adapt to the data characteristics of different images, greatly increasing the difficulty of network design. Aiming at the problem of deep learning model design in hyperspectral image classification, this paper proposes an automatic network structure search method for HSI classification. Methods: In the proposed method, the differentiable structure search technology is first used to search the network structure on the source HSI data sets, then the deep network model is constructed by stacking cells, and finally the classification performance is evaluated on the target HSIs. It should be pointed out that, the proposed method only conducts one search on the source HSI data sets, and the obtained deep model can be applied to other target HSI classification tasks, which can effectively improve the utilization rate of the model. To improve the generalization ability and classification accuracy of the model, multi-source and multi-resolution HSIs are employed to construct the precollected data set, and the partial channel connection operation is introduced to further improve the search efficiency. Results: Three HSIs inculding Houston, Chikusei and Pavia Center are selected as source data. Four HSIs including University of Pavia, Indian Pines, Salinas and Houston 2018 are selected as the target HSIs. The source data is used to determine the network model and the target HSIs are used to evaluate the classification performance. Experimental results show that the proposed method can automatically search out a universal deep network model suitable for HSI classification task, and this model can achieve better classification performance than the conventional deep learning models. The overall classification accuracies of University of Pavia, Indian Pines, Salinas and Houston 2018 are 98.15%, 98.74%, 97.30% and 74.47%, respectively. Conclusions: Compared with other deep models, the model in this paper is automatically determined by differentiable architecture search algorithm according to the data characteristics of HSIs, effectively improving the classification accuracy of target HSIs while avoiding complex network design. Extensive experiments verify the applicability and effectiveness of the proposed method in HSI classification. [ABSTRACT FROM AUTHOR]

In order to alleviate the inherent information differences between different user social spaces and interest spaces in recommendation systems and the problem of ignoring high-order neighbors, this paper proposed AGCRSR. Firstly, the algorithm used a mapping matrix in the embedding layer to convert the initial feature vectors into adaptive embedding. Secondly, it intro- duced an attention mechanism to aggregate different aspects of user embeddings, and used a graph convolutional network to li- nearly learn the potential representations of users and items. Finally, it used the adaptive module to aggregate user representations and predict the final recommendation results of users for the project using the inner product function. This paper conducted comparative experiments on the LastFM and Ciao datasets and compared with other baseline algorithms. The experimental results show that the recommendation performance of the AGCRSR is significantly improved compared to other algorithms. [ABSTRACT FROM AUTHOR]

Since the objects in remote sensing images have the characteristics of arbitrary direction, dense distribution and large scale differences, object detection in remote sensing images has become a challenging problem. Aiming at this problem, this paper systematically reviewed the work related to rotating object detection in deep learning remote sensing images in recent three years. Firstly, this paper introduced the representation method and characteristics of rotated bounding box. Then, it analyzed the existing methods of rotating object detection in remote sensing images from four aspects: the feature extraction network, the generation of rotating anchor and candidate bounding box, the label allocation and sampling strategy, and the loss function. Next, it introduced the commonly used remote sensing image datasets for rotated object detection, and compared the performance of different algorithms. Finally, this paper prospected rotating object detection in remote sensing images. [ABSTRACT FROM AUTHOR]

Automated and accurate detection of power quality (PQ) events is important from the point of view of safety as well as maintaining the reliability of the power transmission and distribution network. However, detection of multiple PQ events in a noisy environment is challenging task. Another important issue is the choice of meaningful features that can directly influence the accuracy of PQ detection. Considering these two aforesaid facts, this paper presents a novel framework for automated classification of PQ signals in a noisy environment employing cross Stockwell Transform (XST). The XST proposed in this paper has better noise suppression capability compared to conventional Stockwell Transform. Here, XST was used to convert 1D PQ signals to 2D time–frequency (T–F) images. To improve the accuracy of PQ detection, an automated feature extraction method employing deep learning is implemented in this work. The noise free T–F images obtained using XST were fed as inputs to several pre-trained convolutional neural networks (CNNs) for deep feature extraction. Transfer learning technique was implemented to reduce the computational cost. The extracted deep features were further undergone selection using one-way analysis of variance test followed by false discovery rate correction. The statistically significant deep features were subsequently fed to three benchmark machine learning classifiers for classification of PQ signals. In addition, tests were also carried out on real-life PQ signals to verify the practicability of the proposed framework. Investigations revealed that the proposed method returned mean accuracy of 99.72% and 96.45% for classification of simulated and real-life PQ signals, respectively. [ABSTRACT FROM AUTHOR]

This paper proposes an image compression algorithm based on Swin Transformer and residual network (STRN), aiming to reduce blurring and distortions in traditionally compressed images. The algorithm utilizes a dual-channel mechanism to remove artifacts from the image, which takes advantage of the complementary features of the transform and residual networks. The Swin Transformer networks address the issue of long-range dependency, leading to an enhanced and improved reconstructed image quality. The residual network is an effective network that mitigates gradient loss and recovers image details during the image compression process. The paper demonstrates that image compression can be achieved by training a convolutional network based on a transformer and residuals network, which significantly reduces artifacts and provides better reconstructed image quality compared to previously used and current mainstream methods based on traditional convolutional neural networks. The proposed approach can remove blocking artifacts by subtracting estimated artifacts from the input image, while still preserving most of the original details. Therefore, our proposed method is highly effective in improving image quality and reducing visual artifacts caused by traditional compression methods. Moreover, this method is useful for enhancing image transmission and storage efficiency in various computer vision systems that employ digital visual codecs. [ABSTRACT FROM AUTHOR]

Based on optical image enhancement, this paper uses convolutional neural network to detect key points of swimming posture. In swimming posture analysis, key point detection can provide information about posture accuracy and evaluation. However, due to the change of illumination conditions, the reduction of image quality and occlusion, the accuracy and stability of key point detection are limited. In order to solve this problem, an optical image enhancement method based on convolutional neural network is proposed in this paper. First, a specific convolutional neural network architecture is used to extract features from input images. Then optical image enhancement technology is used to preprocess the input image to improve the image quality. Next, the trained convolutional neural network model is used to detect key points. Experimental results show that the proposed method has good performance under different illumination conditions and image quality. Therefore, this study provides a new idea and method for the application of optical image enhancement in the detection of key points in swimming posture analysis. [ABSTRACT FROM AUTHOR]

Estimation of vivo muscle forces during human motion is important for understanding human motion control mechanisms and joint mechanics. This paper combined the advantages of the convolutional neural network (CNN) and long-short-term memory (LSTM) and proposed a novel muscle force estimation method based on CNN–LSTM. A wearable sensor system was also developed to collect the angles and angular velocities of the hip, knee, and ankle joints in the sagittal plane during walking, and the collected kinematic data were used as the input for the neural network model. In this paper, the muscle forces calculated using OpenSim based on the Static Optimization (SO) method were used as the standard value to train the neural network model. Four lower limb muscles of the left leg, including gluteus maximus (GM), rectus femoris (RF), gastrocnemius (GAST), and soleus (SOL), were selected as the studying objects in this paper. The experiment results showed that compared to the standard CNN and the standard LSTM, the CNN–LSTM performed better in muscle forces estimation under slow (1.2 m/s), medium (1.5 m/s), and fast walking speeds (1.8 m/s). The average correlation coefficients between true and estimated values of four muscle forces under slow, medium, and fast walking speeds were 0.9801, 0.9829, and 0.9809, respectively. The average correlation coefficients had smaller fluctuations under different walking speeds, which indicated that the model had good robustness. The external testing experiment showed that the CNN–LSTM also had good generalization. The model performed well when the estimated object was not included in the training sample. This article proposed a convenient method for estimating muscle forces, which could provide theoretical assistance for the quantitative analysis of human motion and muscle injury. The method has established the relationship between joint kinematic signals and muscle forces during walking based on a neural network model; compared to the SO method to calculate muscle forces in OpenSim, it is more convenient and efficient in clinical analysis or engineering applications. [ABSTRACT FROM AUTHOR]

Under the conditions of a mechanical fault in a motor, mechanical vibration of a specific frequency can be generated. The electrical contact points directly connected to the motor can vibrate at the same frequency. The electrical contact points with poor contact can easily produce a series arc fault under vibration conditions, which affects the reliability of the power supply. In order to detect the series arc fault under different vibration conditions, the arc fault generator is connected between the back end of the frequency converter and the motor. An arc fault experiment under different vibration conditions was carried out and the fault phase current and arc voltage signals were collected. In this paper, the noise-assisted multivariate empirical mode decomposition and the correlation coefficient between each intrinsic mode function are used to select the fault feature signals. Then, the reconstructed signal is input into the series arc fault model combining a multi-scale convolutional neural network and a bidirectional long short-term memory network for training. The research results show that the series arc fault detection method proposed in this paper can effectively detect the series arc fault and can preliminarily identify the type of motor fault causing the mechanical vibration of the motor; the model has good noise immunity and generalization. [ABSTRACT FROM AUTHOR]

The main purpose of this paper is to provide information on how to create a convolutional neural network (CNN) for extracting features from EEG signals. Our task was to understand the primary aspects of creating and fine-tuning CNNs for various application scenarios. We considered the characteristics of EEG signals, coupled with an exploration of various signal processing and data preparation techniques. These techniques include noise reduction, filtering, encoding, decoding, and dimension reduction, among others. In addition, we conduct an in-depth analysis of well-known CNN architectures, categorizing them into four distinct groups: standard implementation, recurrent convolutional, decoder architecture, and combined architecture. This paper further offers a comprehensive evaluation of these architectures, covering accuracy metrics, hyperparameters, and an appendix that contains a table outlining the parameters of commonly used CNN architectures for feature extraction from EEG signals. [ABSTRACT FROM AUTHOR]

This paper is on the autonomous detection of humans in off-limits mountains. In off-limits mountains, a human rarely exists, thus human detection is an extremely rare event. Due to the advances in artificial intelligence, object detection–classification algorithms based on a Convolution Neural Network (CNN) can be used for this application. However, considering off-limits mountains, there should be no person in general. Thus, it is not desirable to run object detection–classification algorithms continuously, since they are computationally heavy. This paper addresses a time-efficient human detector system, based on both motion detection and object classification. The proposed scheme is to run a motion detection algorithm from time to time. In the camera image, we define a feasible human space where a human can appear. Once motion is detected inside the feasible human space, one enables the object classification, only inside the bounding box where motion is detected. Since motion detection inside the feasible human space runs much faster than an object detection–classification method, the proposed approach is suitable for real-time human detection with low computational loads. As far as we know, no paper in the literature used the feasible human space, as in our paper. The outperformance of our human detector system is verified by comparing it with other state-of-the-art object detection–classification algorithms (HOG detector, YOLOv7 and YOLOv7-tiny) under experiments. This paper demonstrates that the accuracy of the proposed human detector system is comparable to other state-of-the-art algorithms, while outperforming in computational speed. Our experiments show that in environments with no humans, the proposed human detector runs 62 times faster than YOLOv7 method, while showing comparable accuracy. [ABSTRACT FROM AUTHOR]

This paper proposes a method that considers the bus net Fuzzy control strategy quickly and accurately for power. Due to the intermittent and fluctuating characteristics of distributed generation units in microgrid, the power quality will be reduced and the normal operation of microgrid will be affected. In this paper, empirical modal analysis fused with convolutional neural network algorithm is applied to the power control strategy of microgrid energy storage system to improve the economy and reliability of microgrid. The design process of the controller is analyzed, and fuzzy rules and membership functions are designed according to the effect requirements of the controller. Then, the center of gravity method is used to obtain the output power of the energy storage system. The simulation results show that the configuration scheme based on the optimization of the hybrid energy storage system in the whole life cycle in this paper not only ensures the stability of the energy storage system but also effectively avoids power fluctuations and stabilizes the peak shaving and valley filling rate. While improving the economy of the energy storage system, it also increases the service life of the energy storage system. [ABSTRACT FROM AUTHOR]

The recognition of food images is of great significance for nutrition monitoring, food retrieval and food recommendation. However, the accuracy of recognition had not been high enough due to the complex background of food images and the characteristics of small inter-class differences and large intra-class differences. To solve these problems, this paper proposed a food image recognition method based on transfer learning and ensemble learning. Firstly, generic image features were extracted by using the convolutional neural network models (VGG19, ResNet50, MobileNet V2, AlexNet) pre-trained on the ImageNet dataset. Secondly, the 4 pre-trained models were transferred to the food image dataset for model fine-tuning. Finally, different basic learner combination strategies were adopted to establish the ensemble model and classify feature information. In this paper, several kinds of experiments were performed to compare the results of food image recognition between single models and ensemble models on food-11 dataset. The experimental results demonstrated that the accuracy of the ensemble model was the highest, reaching 96.88%, which was superior to any base learner. Therefore, the convolutional neural network model based on transfer learning and ensemble learning has strong learning ability and generalization ability, and it is feasible and practical to apply the method to food image recognition. [ABSTRACT FROM AUTHOR]

In recent years, the rapid advancement of artificial intelligence (AI) technology has made remarkable strides in the music industry, profoundly impacting various aspects of our lives. This progress has extended to revolutionizing industries, streamlining processes, and enhancing personalization in music. AI's expanding capabilities have driven computer vision, natural language processing, and machine learning breakthroughs. As music enthusiasts increasingly turn to online platforms, the need for effective recommendation systems has become more pressing. The exponential growth of musical content poses a challenge in discovering music tailored to individual tastes. This paper proposed a personalized music recommendation system powered by deep learning, explicitly utilizing convolutional neural networks (CNNs) to address the challenges posed by expanding music libraries and diverse song resources. In today's era of ever-growing music databases and increasing content diversity, more than traditional retrieval methods are needed to efficiently connect users with their preferred track. Traditional music platforms rely solely on retrieval mechanisms, necessitating manual inputs such as artist names and titles to locate specific songs. However, this approach needs in-depth music data analysis and delivers personalized recommendations generated by various deep learning-based algorithms. This paper bridges this gap by harnessing deep learning algorithms for comprehensive music data analysis and personalized song suggestions. The proposed CNN-based recommendation system explores the domains of deep learning and content-based approaches, empowering users to discover their favorite tunes swiftly. This innovative mechanism leverages CNNs and deep learning algorithms to offer efficient, personalized, and data-driven music recommendations, transforming the user experience with their music collections. In experimental results, the proposed CNN model is compared with various deep learning algorithms, including DNN, RNN, and LSTM, as well as traditional algorithms like SVM, KNN, RF, and DT. Impressively, the CNN model achieved the highest accuracy at 95%, surpassing all other algorithms. [ABSTRACT FROM AUTHOR]

This paper proposes a method for the intelligent detection of high-frequency surface wave radar (HFSWR) targets. This method cascades the adaptive constant false alarm (CFAR) detector variability index (VI) with the convolutional neural network (CNN) to form a cascade detector (VI)CFAR-CNN. First, the (VI)CFAR algorithm is used for the first-level detection of the range–Doppler (RD) spectrum; based on this result, the two-dimensional window slice data are extracted using the window with the position of the target on the RD spectrum as the center, and input into the CNN model to carry out further target and clutter identification. When the detection rate of the detector reaches a certain level and cannot be further improved due to the convergence of the CNN model, this paper uses a dual-detection maps fusion method to compensate for the loss of detection performance. First, the optimized parameters are used to perform the weighted fusion of the dual-detection maps, and then, the connected components in the fused detection map are further processed to achieve an independent (VI)CFAR to compensate for the (VI)CFAR-CNN detection results. Due to the difficulty in obtaining HFSWR data that include comprehensive and accurate target truth values, this paper adopts a method of embedding targets into the measured background to construct the RD spectrum dataset for HFSWR. At the same time, the proposed method is compared with various other methods to demonstrate its superiority. Additionally, a small amount of automatic identification system (AIS) and radar correlation data are used to verify the effectiveness and feasibility of this method on completely measured HFSWR data. [ABSTRACT FROM AUTHOR]

This paper aims to propose a table tennis target detection (TD) method based on deep learning (DL) and multi-scale feature fusion (MFF) to improve the detection accuracy of the ball in table tennis competition, optimize the training process of athletes, and improve the technical level. In this paper, DL technology is used to improve the accuracy of table tennis TD through MFF guidance. Initially, based on the FAST Region-based Convolutional Neural Network (FAST R-CNN), the TD is carried out in the table tennis match. Then, through the method of MFF guidance, different levels of feature information are fused, which improves the accuracy of TD. Through the experimental verification on the test set, it is found that the mean Average Precision (mAP) value of the target detection algorithm (TDA) proposed here reaches 87.3%, which is obviously superior to other TDAs and has higher robustness. The DL TDA combined with the proposed MFF can be applied to various detection fields and can help the application of TD in real life. [ABSTRACT FROM AUTHOR]

To enhance the accuracy of theft detection for electricity consumers, this paper introduces a novel strategy based on the fusion of the dual-time feature and deep learning methods. Initially, considering electricity-consumption features at dual temporal scales, the paper employs temporal convolutional networks (TCN) with a long short-term memory (LSTM) multi-level feature extraction module (LSTM-TCN) and deep convolutional neural network (DCNN) to parallelly extract features at these scales. Subsequently, the extracted features are coupled and input into a fully connected (FC) layer for classification, enabling the precise detection of theft users. To validate the method's effectiveness, real electricity-consumption data from the State Grid Corporation of China (SGCC) is used for testing. The experimental results demonstrate that the proposed method achieves a remarkable detection accuracy of up to 94.7% during testing, showcasing excellent performance across various evaluation metrics. Specifically, it attained values of 0.932, 0.964, 0.948, and 0.986 for precision, recall, F1 score, and AUC, respectively. Additionally, the paper conducts a comparative analysis with mainstream theft identification approaches. In the comparison of training processes, the proposed method exhibits significant advantages in terms of identification accuracy and fitting degree. Moreover, with adjustments to the training set proportions, the proposed method shows minimal impact, indicating robustness. [ABSTRACT FROM AUTHOR]

Multilabel remote sensing image classification (MLRSIC) has received increasing research interest. Taking the co-occurrence relationship of multiple labels as additional information helps to improve the overall performance. However, current methods only focus on using it to constrain the final feature which is output from a convolutional neural network (CNN). On the one hand, these methods need to exploit the potential of label correlation in feature representation fully. On the other hand, they increase the label noise sensitivity of the system, resulting in poor robustness. In this paper, a novel method called 'Semantic Interleaving Global chaNnel Attention' (SIGNA) is proposed for MLRSIC. First, the label co-occurrence graph is obtained according to the statistical information of the training set and fed into a graph neural network (GNN) to generate optimal semantic feature representations of each label. Next, the semantic features are interleaved with visual features which are extracted by CNNs to guide the overall features of the input image transform from the original feature space to the semantic feature space with embedded label relations. Then, global attention triggered by semantic interleaving is used to emphasize visual features in important channels. Finally, to make SIGNA easier to use and more optimized, multihead SIGNA-based feature adaptive weighting networks are proposed as plug-in blocks to plug into any layers of a CNN. For remote sensing images, better classification performance can be achieved by inserting the plug-in blocks into the shallow layers of CNNs. We conducted extensive experimental comparisons on three data sets: UCM, AID and DFC15. Experimental results demonstrate that the proposed SIGNA achieves superior classification performance compared to state-of-the-art (SOTA) methods. Notes that the codes of this paper will be open to the community for reproducibility research. [ABSTRACT FROM AUTHOR]

Plant diseases have a significant impact on leaves, with each disease exhibiting specific spots characterized by unique colors and locations. Therefore, it is crucial to develop a method for detecting these diseases based on spot shape, color, and location within the leaves. While Convolutional Neural Networks (CNNs) have been widely used in deep learning applications, they suffer from limitations in capturing relative spatial and orientation relationships. This paper presents a computer vision methodology that utilizes an optimized capsule neural network (CapsNet) to detect and classify ten tomato leaf diseases using standard dataset images. To mitigate overfitting, data augmentation, and preprocessing techniques were employed during the training phase. CapsNet was chosen over CNNs due to its superior ability to capture spatial positioning within the image. The proposed CapsNet approach achieved an accuracy of 96.39% with minimal loss, relying on a 0.00001 Adam optimizer. By comparing the results with existing state-of-the-art approaches, the study demonstrates the effectiveness of CapsNet in accurately identifying and classifying tomato leaf diseases based on spot shape, color, and location. The findings highlight the potential of CapsNet as an alternative to CNNs for improving disease detection and classification in plant pathology research. Highlights: This paper is interested in tracking plant diseases such as leaf disease in Tomatoes, based on optimized Deep Learning Capsule Net. Early detection of the most common diseases based on leaf images can help us track and enhance food quality. Capsule Networks is an optimized alternative method more efficient than traditional CNN for detecting all leaf images and determining all locations. However, it tackles the shortage of conventional CNN. [ABSTRACT FROM AUTHOR]

The emergence of data-driven analytics and intelligent monitoring systems is radically transforming the world of competitive sports. However, robust real-time activity recognition remains elusive for rapid-paced sports like table tennis due to the complexity of strokes and quick maneuvering. This paper tries to overcome this challenge through an innovative cloud-supported system integrating the Internet of Things (IoT), machine learning, and wearable sensors for automated analysis of table tennis gameplay. We strategically set up a multi-camera IoT system around a table tennis court to compile a rich labeled image dataset encapsulating over 15,000 frames. To improve model generalization, the images captured various playing styles, lighting conditions, and camera angles. We developed tailored SVM and CNN architectures optimized for table tennis activity classification. The models were trained on GPU-accelerated platforms using the curated dataset. After hyperparameter tuning and cross-validation, the CNN model achieved 96.2% accuracy, a precision value of 96.3%, a recall value of 95.2%, and an F1-score of 96.3% in classifying standard strokes and serves. Additionally, the models exhibited impressive processing speeds of 22–34 fps, enabling real-time utilization. Our proposed model outperformed the latest models in this field with higher accuracy, recall values, F1-score, and precision. While expanding the dataset diversity and testing variations of deep network architectures could further enhance performance, this paper demonstrates a crucial leap toward helping real-time analytics in table tennis using an AI-powered computer vision approach. The hybrid system combining IoT, wearables, and machine learning establishes a framework to transform data into actionable and timely insights for table tennis players and coaches. [ABSTRACT FROM AUTHOR]

With the rapid development of information technology, electronic signature plays an increasingly important role in people's production practice. However, there are a large number of hackers maliciously stealing information in the network. In order to avoid this phenomenon, we urgently need to strengthen the research on online electronic signature recognition technology. Based on the sparse classification technology of neural model, this paper constructs an online electronic signature recognition model by using convolutional neural network and sparse classification technology. We first extract the local features of online electronic signatures, construct feature vectors and perform sparse representation. Sub-model we construct a scheme for online electronic signature recognition based on neural models and sparse classification techniques using a combination of algorithms. We first extract the local features of online electronic signatures, construct feature vectors and perform sparse representation. At the same time, the features in the training image set are extracted, local feature sets are constructed, feature dictionaries are created, and the vectors in the feature dictionaries are matched with the global sparse vectors constructed by the electronic signatures to be detected, and the matching results are finally obtained. At the same time, the features in the training image set are extracted, the local feature set is constructed, the feature dictionary is created, and the vector in the feature dictionary is matched with the global sparse vector constructed by the electronic signature to be detected, and finally the matching result is obtained. In order to verify the accuracy of the model, we first extracted 1000 respondents for online e-signature recognition experimental results show that the recognition accuracy of online e-signature has been significantly improved. Finally, in order to determine the optimal number of training sets for the model constructed in this experiment, we analyzed the correlation between training and sample size and recognition accuracy. Finally, it was concluded that the recognition accuracy increased with the increase of the number of training samples. Electronic signatures can quickly examine the signature results, and electronic signature recognition can be used to fix and tamper-proof evidence to enhance the security and trustworthiness of signatures, and it is imperative to improve the security of electronic signatures. In this paper, we study online electronic signature recognition technology, using neural model and sparse classification to construct an efficient and accurate recognition model. Experiments show that the model is effective and the number of training samples affects the recognition accuracy. This paper provides a new approach for the development of this technique. When the training samples are greater than 1300, the recognition accuracy is stable at 95%. This research has certain theoretical and practical significance, and promotes the rapid development of online electronic signature recognition. [ABSTRACT FROM AUTHOR]

The IETE Journal of Research's first issue of Volume 70 covers a wide range of topics in communications, electromagnetics, opto-electronics, computers and computing, control engineering, electronic circuits, devices and components, instrumentation and measurement, medical electronics, and power electronics. The articles in this issue discuss various subjects, including improved network performance in wireless sensor networks, machine learning-based classification of cervical cancer, optimal energy reduction in 5G communication systems, and secure data transmission in the Internet of Things. The issue also includes papers on photonic sensors, detection of diabetic retinopathy, optimisation models for home health care scheduling and wind-integrated power systems, and efficient task scheduling in cloud computing environments. One research paper introduces a smartwatch-based machine learning model for monitoring epilepsy and detecting seizures, achieving a high accuracy of 99.40% in cross-validation. The document provides a summary of articles published in the journal, with authors who are experts in their fields and provide experimental findings and simulations to support their research. [Extracted from the article]

Millions of traffic accidents occur worldwide each year, resulting in tens of thousands of deaths. The primary cause is the distracted behavior of drivers during the driving process. If the distracted behaviors of drivers during driving can be detected and recognized in time, drivers can regulate their driving and the goal of reducing the number of traffic fatalities can be achieved. A deep learning model is proposed to detect driver distractions in this paper. The model can identify ten behaviors including one normal driving behavior and nine distracted driving behaviors. The proposed model consists of two modules. In the first module, the cross-domain complementary learning (CDCL) algorithm is used to detect driver body parts in the input images, which reduces the impact of environmental factors in vehicles on the convolutional neural network. Then the output images of the first module are sent to the second module. The Resnet50 and Vanilla networks are ensembled in the second module, and then the driver behavior can be classified. The ensemble architecture used in the second module can reduce the sensitivity of only a single network on the data, and then the detection accuracy can be improved. Through the experiments, it can be seen that the proposed model in this paper can achieve an average accuracy of 99.0%. [ABSTRACT FROM AUTHOR]

This paper proposes a novel approach, BTC-SAGAN-CHA-MRI, for the classification of brain tumors using a SAGAN optimized with a Color Harmony Algorithm. Brain cancer, with its high fatality rate worldwide, especially in the case of brain tumors, necessitates more accurate and efficient classification methods. While existing deep learning approaches for brain tumor classification have been suggested, they often lack precision and require substantial computational time.The proposed method begins by gathering input brain MR images from the BRATS dataset, followed by a pre-processing step using a Mean Curvature Flow-based approach to eliminate noise. The pre-processed images then undergo the Improved Non-Sub sampled Shearlet Transform (INSST) for extracting radiomic features. These features are fed into the SAGAN, which is optimized with a Color Harmony Algorithm to categorize the brain images into different tumor types, including Gliomas, Meningioma, and Pituitary tumors. This innovative approach shows promise in enhancing the precision and efficiency of brain tumor classification, holding potential for improved diagnostic outcomes in the field of medical imaging. The accuracy acquired for the brain tumor identification from the proposed method is 99.29%. The proposed BTC-SAGAN-CHA-MRI technique achieves 18.29%, 14.09% and 7.34% higher accuracy and 67.92%,54.04%, and 59.08% less Computation Time when analyzed to the existing models, like Brain tumor diagnosis utilizing deep learning convolutional neural network with transfer learning approach (BTC-KNN-SVM-MRI); M3BTCNet: multi model brain tumor categorization under metaheuristic deep neural network features optimization (BTC-CNN-DEMFOA-MRI), and efficient method depending upon hierarchical deep learning neural network classifier for brain tumour categorization (BTC-Hie DNN-MRI) respectively. This paper proposes a novel approach, BTC-SAGAN-CHA-MRI, for the classification of brain tumors using a Self-Attention based Generative Adversarial Network (SAGAN) optimized with a Color Harmony Algorithm. Brain cancer, with its high fatality rate worldwide, especially in the case of brain tumors, necessitates more accurate and efficient classification methods. While existing deep learning approaches for brain tumor classification have been suggested, they often lack precision and require substantial computational time. The proposed method begins by gathering input brain MR images from the BRATS dataset, followed by a pre-processing step using a Mean Curvature Flow-based approach to eliminate noise. The pre-processed images then undergo the Improved Non-Sub sampled Shearlet Transform (INSST) for extracting radiomic features. These features are fed into the SAGAN, which is optimized with a Color Harmony Algorithm to categorize the brain images into different tumor types, including Gliomas, Meningioma, and Pituitary tumors. This innovative approach shows promise in enhancing the precision and efficiency of brain tumor classification, holding potential for improved diagnostic outcomes in the field of medical imaging. [ABSTRACT FROM AUTHOR]

In the current state of the art of process industries/manufacturing technologies, computer‐instrumented and computer‐controlled autonomous techniques are necessary for damage diagnosis and prognosis in operating machinery. From this perspective, the paper addresses the issue of fatigue damage that is one of the most encountered sources of degradation in polycrystalline‐alloy structures of machinery components. In this paper, the convolutional neural networks (CNNs) are applied to synergistic combinations of ultrasonic measurements and images from a confocal microscope (Alicona) to detect and evaluate the risk of fatigue damage. The database of the Alicona has been used to calibrate the ultrasonic database and to provide the ground truth for fatigue damage assessment. The results show that both the ultrasonic data and Alicona images are capable of classifying the fatigue damage into their respective classes with considerably high accuracy. However, the ultrasonic CNN model yields better accuracy than the Alicona CNN model by almost 9%. Highlights: This paper shows the role of artificial intelligence in evaluating the severity of the fatigue damage.A comparison between two convolutional neural network (CNN) models has been demonstrated in this paper.The ultrasonic CNN model provides better performance than microscope CNN model. [ABSTRACT FROM AUTHOR]

Cancer is a condition in which abnormal cells uncontrollably split and damage the body tissues. Hence, detecting cancer at an early stage is highly essential. Currently, medical images play an indispensable role in detecting various cancers; however, manual interpretation of these images by radiologists is observer-dependent, time-consuming, and tedious. An automatic decision-making process is thus an essential need for cancer detection and diagnosis. This paper presents a comprehensive survey on automated cancer detection in various human body organs, namely, the breast, lung, liver, prostate, brain, skin, and colon, using convolutional neural networks (CNN) and medical imaging techniques. It also includes a brief discussion about deep learning based on state-of-the-art cancer detection methods, their outcomes, and the possible medical imaging data used. Eventually, the description of the dataset used for cancer detection, the limitations of the existing solutions, future trends, and challenges in this domain are discussed. The utmost goal of this paper is to provide a piece of comprehensive and insightful information to researchers who have a keen interest in developing CNN-based models for cancer detection. [ABSTRACT FROM AUTHOR]

Deep neural networks have achieved outstanding performance in computer vision tasks. Convolutional Neural Networks (CNNs) typically operate in the spatial domain with raw images, but in practice, images are usually stored and transmitted in their compressed representation where JPEG is one of the most widely used encoder. Also, these networks are computationally intensive and slow. This paper proposes performing the learning and inference processes in the compressed domain in order to reduce the computational complexity and improve the speed of popular CNNs. For this purpose, a novel graph-based frequency channel selection method is proposed to identify and select the most important frequency channels. The computational complexity is reduced by retaining the important frequency components and discarding the insignificant ones as well as eliminating the unnecessary layers of the network. Experimental results show that the modified ResNet-50 operating in the compressed domain is up to 70% faster than the spatial-based traditional ResNet-50 while resulting in similar classification accuracy. Moreover, this paper proposes a preprocessing step with partial encoding to improve the resilience to distortions caused by low-quality encoded images. Finally, we show that training a network with highly compressed data can achieve a good classification accuracy with up to 93% reduction in the storage requirements of the training data. [ABSTRACT FROM AUTHOR]

With the development of artificial intelligence, robots are widely used in various fields, grasping detection has been the focus of intelligent robot research. A dual manipulator grasping detection model based on Markov decision process is proposed to realize the stable grasping with complex multiple objects in this paper. Based on the principle of Markov decision process, the cross entropy convolutional neural network and full convolutional neural network are used to parameterize the grasping detection model of dual manipulators which are two-finger manipulator and vacuum sucker manipulator for multi-objective unknown objects. The data set generated in the simulated environment is used to train the two grasping detection networks. By comparing the grasping quality of the detection network output the best grasping by the two grasping methods, the network with better detection effect corresponding to the two grasping methods of two-finger and vacuum sucker is determined, and the dual manipulator grasping detection model is constructed in this paper. Robot grasping experiments are carried out, and the experimental results show that the proposed dual manipulator grasping detection method achieves 90.6% success rate, which is much higher than the other groups of experiments. The feasibility and superiority of the dual manipulator grasping detection method based on Markov decision process are verified. [ABSTRACT FROM AUTHOR]

The theme of the paper is to emphasize the detection and classification of faults and their site location in the transmission line using machine learning techniques which help to indemnify the foul-up of the humans in identifying the site and type of occurrence of fault. Moreover, the transient stability is a supreme one in power systems and so the disturbances like faults are required to be separated to preserve the transient stability. In general, the protection of the transmission line includes the installation of relays at both ends of the line that constantly monitor voltages and currents and operate unless a fault occurs on a line. Therefore, this paper intends to introduce a novel transmission line protection model by exploiting the hybrid optimization concept to train the Convolutional Neural Network (CNN). Here, the fault detection, classification and site location are diagnosed by using CNN which is trained and tested by making use of diverse synthetic field data derived from the simulation models of distinct types of transmission lines. Hence, the location and the type of faults will be predicted by the CNN depending on the fault signal characteristics which are optimally trained by a new hybrid algorithm named Chicken Swarm Insisted Spotted Hyena (CSI-SH) Algorithm that hybrids both the concept of Spotted Hyena Optimization (SHO) and Chicken Swarm Optimization (CSO). Finally, the proposed method based on CNN for fault classification and site location of transmission lines is implemented in MATLAB/Simulink and the performances are compared with various measures like classification accuracy, fault detection rate and so on. [ABSTRACT FROM AUTHOR]

This paper constructs a dataset of handwritten Indus signs employing a social approach. A writing system called the Indus script was created in the Indus civilization. It has been decoded numerous times throughout the years, but it has not yet been fully deciphered. Due to a lack of information and the scarcity of evidence, the mystery of the Indus signs has not yet been fully solved. Recently, there has been an increase in demand for huge datasets in order to use cutting-edge machine learning techniques. Considering the restricted availability of images of authentic Indus signs, this paper proposes creating an Indus signs dataset by asking participants to draw the Indus signs while referring to the image of the original Indus signs. A web application was developed and used to collect the 44 participants' handwritten images of ten Indus signs. To show the availability of the constructed dataset, it is used to train convolutional neural networks. The experimental result demonstrates that the model can classify the images of original Indus script with 70% accuracy. [ABSTRACT FROM AUTHOR]

The document is an editorial from the Intelligent Data Analysis (IDA) Journal, introducing the third issue of volume 28. The issue includes papers on various theoretical and applied topics in the field of Intelligent Data Analysis. The first half of the issue focuses on theoretical contributions, including papers on multilabel image classification and extended image data analysis. The second half covers papers on adaptive and active learning, data extraction and transformation, recommendation systems, medical applications, code search, and generating magazine layouts. The issue concludes with a paper on a new training dataset for Named Entity Recognition tasks. [Extracted from the article]

This document discusses the challenges of achieving high-power quality in modern power grids with a large share of distributed power production, particularly due to the integration of renewable energy sources (RES). The variable nature of RES can lead to disturbances and power quality degradation. The document highlights the importance of voltage source converters and control systems in enabling the flexible operation of RES. It also mentions the concept of microgrids, which are closely connected to power quality and other factors such as the Internet of Things and cyber security. The document includes eight research papers covering various topics related to power quality analysis and control of renewable energy sources in power grids. These topics include power factor correction, supercapacitor parameters identification, pulse width modulation, disturbance analysis, vibration analysis of motors, control of converters, phasor measurement units, and optimization of controller parameters. The document concludes by expressing gratitude to the authors, staff, and reviewers involved in the research papers. [Extracted from the article]

• AI improves infectious waste management. • Ensemble model exceeds 97.81% accuracy. • Reinforcement learning optimizes classification. • Geometric augmentation boosts model robustness. • Study addresses urgent urban waste challenges. This research paper focuses on effective infectious municipal waste management in urban settings, highlighting a dearth of dedicated research in this domain. Unlike general or specific waste types, infectious waste poses distinct health and environmental risks. Leveraging advanced artificial intelligence techniques, we prioritize infectious waste categorization and optimization, integrating metaheuristics into optimization methods to create a robust dual-ensemble framework. Our model, the "Enhanced Artificial Intelligence for Infectious Municipal Waste Classification System," combines ensemble image segmentation methods and diverse convolutional neural network models. Innovative geometric image augmentation enhances model robustness, diversifies training data, and improves accuracy across waste types. A pivotal aspect is the integration of a reinforcement learning-differential evolution algorithm as a decision fusion strategy, optimizing classification by harmonizing outputs from ensemble methods and convolutional neural network models. Computational results, using a newly collected dataset, demonstrate our model's accuracy exceeding 96.54% while using the existing solid waste dataset we achieve the accuracy of 97.81%, outperforming advanced approaches by margins ranging from 2.02% to 8.80%. This research significantly advances sustainable waste management, showcasing artificial intelligence's transformative potential in addressing intricate waste challenges. It establishes a foundational framework prioritizing efficiency, effectiveness, and sustainability for future waste management solutions. Acknowledging the importance of diverse datasets, customization for urban contexts, and practical integration into existing infrastructures, our work contributes to the broader discourse on the role of artificial intelligence in evolving waste management practices. [ABSTRACT FROM AUTHOR]

High‐fidelity segmentation of blood vessels plays a pivotal role in numerous biomedical applications, such as injection assistance, cancer detection, various surgeries, and vein authentication. Near‐infrared (NIR) transillumination imaging is an effective and safe method to visualize the subcutaneous blood vessel network. However, such images are severely blurred because of the light scattering in body tissues. Inspired by the Vision Transformer model, this paper proposes a novel deep learning network known as transformer connection (TRC)‐Unet to capture global blurred and local clear correlations while using multi‐layer attention. Our method mainly consists of two blocks, thereby aiming to remap skip connection information flow and fuse different domain features. Specifically, the TRC extracts global blurred information from multiple layers and suppresses scattering to increase the clarity of vessel features. Transformer feature fusion eliminates the domain gap between the highly semantic feature maps of the convolutional neural network backbone and the adaptive self‐attention maps of TRCs. Benefiting from the long‐range dependencies of transformers, we achieved competitive results in relation to various competing methods on different data sets, including retinal vessel segmentation, simulated blur image segmentation, and real NIR blood vessel image segmentation. Moreover, our method remarkably improved the segmentation results of simulated blur image data sets and a real NIR vessel image data set. The quantitative results of ablation studies and visualizations are also reported to demonstrate the superiority of the TRC‐Unet design. © 2024 The Author(s). IEEJ Transactions on Electrical and Electronic Engineering published by Institute of Electrical Engineers of Japan and Wiley Periodicals LLC. [ABSTRACT FROM AUTHOR]

Deep learning shows great promise for medical image analysis but often lacks explainability, hindering its adoption in healthcare. Attribution techniques that explain model reasoning can potentially increase trust in deep learning among clinical stakeholders. In the literature, much of the research on attribution in medical imaging focuses on visual inspection rather than statistical quantitative analysis. In this paper, we proposed an image-based saliency framework to enhance the explainability of deep learning models in medical image analysis. We use adaptive path-based gradient integration, gradient-free techniques, and class activation mapping along with its derivatives to attribute predictions from brain tumor MRI and COVID-19 chest X-ray datasets made by recent deep convolutional neural network models. The proposed framework integrates qualitative and statistical quantitative assessments, employing Accuracy Information Curves (AICs) and Softmax Information Curves (SICs) to measure the effectiveness of saliency methods in retaining critical image information and their correlation with model predictions. Visual inspections indicate that methods such as ScoreCAM, XRAI, GradCAM, and GradCAM++ consistently produce focused and clinically interpretable attribution maps. These methods highlighted possible biomarkers, exposed model biases, and offered insights into the links between input features and predictions, demonstrating their ability to elucidate model reasoning on these datasets. Empirical evaluations reveal that ScoreCAM and XRAI are particularly effective in retaining relevant image regions, as reflected in their higher AUC values. However, SICs highlight variability, with instances of random saliency masks outperforming established methods, emphasizing the need for combining visual and empirical metrics for a comprehensive evaluation. The results underscore the importance of selecting appropriate saliency methods for specific medical imaging tasks and suggest that combining qualitative and quantitative approaches can enhance the transparency, trustworthiness, and clinical adoption of deep learning models in healthcare. This study advances model explainability to increase trust in deep learning among healthcare stakeholders by revealing the rationale behind predictions. Future research should refine empirical metrics for stability and reliability, include more diverse imaging modalities, and focus on improving model explainability to support clinical decision-making. [ABSTRACT FROM AUTHOR]