Search

Image semantic segmentation technology is one of the core research contents in the field of computer vision. With the improvement of computer performance and the continuous development of deep learning technology, researchers have more and more enthusiasm to study the actual effect and performance of image semantic segmentation. The results of deep semantic segmentation allow computers to have a more detailed and accurate understanding of images, and have a wide range of application needs in the fields of autonomous driving, intelligent security, medical imaging, remote sensing images, etc. However, the existing image semantic segmentation algorithms have the disadvantages of easy discontinuous results and insufficient prediction accuracy. In this paper, we take deep learning-based image semantic segmentation technology as the research object to explore the improvement of the image semantic segmentation algorithm and its application in road scenarios. First, this paper proposes MCU-Net method based on residual fusion and multi-scale contextual information. MCU-Net uses residual fusion module to deepen the network structure and improve the ability of U-Net to acquire deeper features. Then a top-down and bottom-up path is constructed for feature information between different levels, and the spatial and semantic information contained in shallow and deep features in the network is fully utilized by fusing features from different levels. In addition, an enhanced void space pyramid pooling module is added for feature information between the same levels, which enables the output features to have a larger range of semantic information. Second, this paper proposes the DAMCU-Net method based on attention mechanism and edge detection based on MCU-Net. DAMCU-Net extracts global contextual information by the attention mechanism optimization module, while fusing features using dense jump connections to facilitate the network to recover more spatial detail information during upsampling, and uses the FReLU activation function to improve the segmentation capability of the network for complex targets. For the edge information lost in the feature extraction process, the edge detection branch is added to supplement the feature information of the main path by feature fusion to achieve the optimization of the edge information. [ABSTRACT FROM AUTHOR]

This paper focuses on deep vision sensing-assisted gesture recognition for athletes in dynamic scenes. Although many research attention had been devoted to this field in recent years, most of existing works failed to fully take characteristics of dynamic scenes into consideration. To deal with this challenge, this paper proposes a diffusion convolution neural network-based multiview gesture recognition approach in dynamic scenes. For one thing, the dynamic spatiotemporal slice position selection based on the body mask heatmap is adopted to calculate positions of horizontal and vertical slices. Thus, the dynamic selection of slice positions in two directions can be realized, and then the extraction of bi-directional spatiotemporal slice images can be completed. For another, action sequences through the 3D residual neural network are learned, and the spatiotemporal information among frames are mined through recurrent networks. Through their combination, a multi-view gesture recognition approach for athletes is constructed. In the experiments, two standard datasets UCF101 and HMDB51 are utilized to establish simulation environment. The proposed method can reach the accuracy beyond 95% on the two datasets. Compared with several typical recognition methods, the proposed method shows higher accuracy. [ABSTRACT FROM AUTHOR]

This paper proposes an image compression algorithm based on Swin Transformer and residual network (STRN), aiming to reduce blurring and distortions in traditionally compressed images. The algorithm utilizes a dual-channel mechanism to remove artifacts from the image, which takes advantage of the complementary features of the transform and residual networks. The Swin Transformer networks address the issue of long-range dependency, leading to an enhanced and improved reconstructed image quality. The residual network is an effective network that mitigates gradient loss and recovers image details during the image compression process. The paper demonstrates that image compression can be achieved by training a convolutional network based on a transformer and residuals network, which significantly reduces artifacts and provides better reconstructed image quality compared to previously used and current mainstream methods based on traditional convolutional neural networks. The proposed approach can remove blocking artifacts by subtracting estimated artifacts from the input image, while still preserving most of the original details. Therefore, our proposed method is highly effective in improving image quality and reducing visual artifacts caused by traditional compression methods. Moreover, this method is useful for enhancing image transmission and storage efficiency in various computer vision systems that employ digital visual codecs. [ABSTRACT FROM AUTHOR]

This paper proposes a method that considers the bus net Fuzzy control strategy quickly and accurately for power. Due to the intermittent and fluctuating characteristics of distributed generation units in microgrid, the power quality will be reduced and the normal operation of microgrid will be affected. In this paper, empirical modal analysis fused with convolutional neural network algorithm is applied to the power control strategy of microgrid energy storage system to improve the economy and reliability of microgrid. The design process of the controller is analyzed, and fuzzy rules and membership functions are designed according to the effect requirements of the controller. Then, the center of gravity method is used to obtain the output power of the energy storage system. The simulation results show that the configuration scheme based on the optimization of the hybrid energy storage system in the whole life cycle in this paper not only ensures the stability of the energy storage system but also effectively avoids power fluctuations and stabilizes the peak shaving and valley filling rate. While improving the economy of the energy storage system, it also increases the service life of the energy storage system. [ABSTRACT FROM AUTHOR]

The theme of the paper is to emphasize the detection and classification of faults and their site location in the transmission line using machine learning techniques which help to indemnify the foul-up of the humans in identifying the site and type of occurrence of fault. Moreover, the transient stability is a supreme one in power systems and so the disturbances like faults are required to be separated to preserve the transient stability. In general, the protection of the transmission line includes the installation of relays at both ends of the line that constantly monitor voltages and currents and operate unless a fault occurs on a line. Therefore, this paper intends to introduce a novel transmission line protection model by exploiting the hybrid optimization concept to train the Convolutional Neural Network (CNN). Here, the fault detection, classification and site location are diagnosed by using CNN which is trained and tested by making use of diverse synthetic field data derived from the simulation models of distinct types of transmission lines. Hence, the location and the type of faults will be predicted by the CNN depending on the fault signal characteristics which are optimally trained by a new hybrid algorithm named Chicken Swarm Insisted Spotted Hyena (CSI-SH) Algorithm that hybrids both the concept of Spotted Hyena Optimization (SHO) and Chicken Swarm Optimization (CSO). Finally, the proposed method based on CNN for fault classification and site location of transmission lines is implemented in MATLAB/Simulink and the performances are compared with various measures like classification accuracy, fault detection rate and so on. [ABSTRACT FROM AUTHOR]

With the development of convolutional neural networks (CNNs), deep learning-based face super-resolution (FSR) approaches have achieved remarkable results in recent years. However, existing FSR methods often rely on face prior knowledge, which greatly increases network complexity and computation. In this paper, we propose DAFNet, a dual attention fusion-based FSR network comprising numerous face attention fusion modules (FAFMs). FAFM is a residual structure containing attention mechanism, which is divided into feature branches and attention branches. The feature branch introduces an hourglass block to extract multi-scale information, while the attention branch incorporates channel attention and spatial attention in series. This design ensures that the network prioritizes important information and effectively recovers detailed facial features. Luminance-chrominance error loss and gradient loss are introduced to guide the training process. Additionally, adversarial loss and perceptual loss are incorporated to enhance the recovery of visually realistic face images. Notably, our method can produce clear faces at a high-scale factor of eight times without relying on any facial prior information, effectively reducing network complexity. Quantitative and qualitative experiments conducted on the CelebA and Helen datasets underscore the effectiveness of the proposed model. [ABSTRACT FROM AUTHOR]

This paper proposed a quantum state tomography approach based on the extreme learning machine (ELM), which is available in the reconstruction of quantum states via a lightweight neural network. The key step of the proposed tomography approach is to employ the ELM to approximate the complex mapping between the measurement values sequence and the real density matrix. After obtaining the output of the ELM-based estimator, a matrix transformation technique is used to make the network outputs satisfy quantum state constraints. Compared with deep learning-based tomography approaches, our proposed ELM-based approach enables both high-fidelity and high-efficiency quantum state tomography with only one training process under the condition of very few numbers of training samples, network layers and hidden layer nodes. In addition, the proposed tomography approach is robust to noisy measurement values, since the ELM-based estimator is quite lightweight. Simulations on the tomography of eigenstates, superposition states and mixed states are presented to verify our theoretical findings. Also, the superiority of the ELM-based tomography approach is demonstrated in comparison with that based on the radial basis function network, convolutional neural network and maximum likelihood estimation approach. [ABSTRACT FROM AUTHOR]

Nowadays, computational intelligence-assisted autonomous assessment of education quality has become a more and more general concern in the area of smart education management. As education quality assessment is a complicated process with multiple heterogeneous factors, it remains challenging to make effective assessment using simple information modality and criteria. To deal with this issue, this paper introduces multiscale deep learning, and proposes a novel data-driven autonomous assessment framework for education quality. In particular, four aspects of heterogeneous indicators are selected as the basic indexes and a dilated convolutional neural network structure is formulated to perform multiscale feature extraction. Then, the structural equation is adopted to make multivariate characterization and output the final assessment results. At last, some simulations are carried out on realistic education operation data to evaluate the efficiency of the proposed autonomous assessment framework. Two aspects of findings can be deduced from the results. For one thing, multisource fusion of multiple indicators well makes sense to autonomous education assessment. For another, multiscale deep learning can provide some beneficial promotion to assessment efficiency. [ABSTRACT FROM AUTHOR]

In this paper, a novel image reconstruction method for printmaking is proposed via the combination of nonlinear diffusion filtering and convolution neural network. Nonlinear diffusion filtering based on a partial differential equation abstracts the input image to extract color features and texture features of images by nonlinear structured tensors. The image color features and texture features are combined to obtain a feature vector, and the feature vector is fed into the model as the input data. Then, the pre-trained deep learning model VGG-19 is utilized as the backbone network for further feature representation, and the extracted feature maps of each layer of the VGG19 model can be visualized for image reconstruction. The quality of the reconstructed images of prints is improved with the powerful feature extraction and combination ability of neural networks, which has the advantages of fast reconstruction speed and high quality of reconstructed images. Finally, the simulation experiments can demonstrate that the proposed reconstruction approach can achieve relatively ideal reconstruction performance in scenes of printmaking. [ABSTRACT FROM AUTHOR]

In this paper, we construct a deep framework for full-reference image quality assessment (FR-IQA) by combining convolution and self-attention features; this approach effectively uses multiscale features to mimic the image evaluation in human eyes. We achieve the integration of information from local to global. First, convolutional neural network (CNN) and encoder of Swin transformer are used to extract multiscale paired features. Second, for each type of features, we fuse them after converting them to a fixed number of channels. For the fused features, we use the square of the difference between two pixel values at the corresponding channel positions to represent the features of the distortion degree. Then, we introduce a recurrent neural network (RNN) to capture the global features. Finally, for the two types of features, we use the full connection (FC) layer to regress two scores and then add the weights to compute the ultimate perceived score. By training and testing on publicly available FR-IQA datasets, experimental results further validate the superiority of our approach. [ABSTRACT FROM AUTHOR]

Several hardware Trojan (HT) detection techniques are available today to ensure the security of hardware systems. However, the existing pre-silicon HT detection techniques have problems such as difficulties in capturing HT path features and poor applicability. To address these challenges, this paper proposes a gate-level HT detection scheme based on a deep learning model. We parse the circuit gate-level netlist and develop an algorithm to extract circuit path sentences based on the signal propagation rule. Path sentences consisting of gate names are extracted as experimental datasets. We apply the theory of natural language processing (NLP) to the task of HT detection and use three neural networks to filter the length of path sentences. Then, based on the deep learning model text convolutional neural network (TextCNN), we propose PS-TextCNN for HT detection. Our approach is verified on seven benchmark circuits of the RS232-series and eight benchmark circuits of the s-series. We achieve an average true positive rate (TPR) of 88.9%. The TPR of the RS232-series reaches a high score of 99.5%. The TPR of the s-series is 79.5%, which is significantly higher than that of the existing gate-level HT detection techniques. [ABSTRACT FROM AUTHOR]

When gathering optical satellite pictures, light reflected from the surface due to water vapor, snow, fog, haze, and more tiny particles in the environment is generally seen as a gap in the propagation process. Haze has a greater number of suspended particles like aerosols and water droplets. These particles have absorption effects and scattering in the light. Although haze translucency grants a chance for image restoration, a well-organized and broadly relevant haze removal procedure for holding several hazes is quite an extensive provocation. To address this issue, this paper proposed an Optimal Contrast Limited Adaptive Histogram Equalization (OCLAHE) to capture further intricate features and patterns connected to haze, enabling more accurate haze detection and removal. The deeper network can learn complicated descriptions and recognize between hazy and nonhazy regions with higher precision. The proposed method is validated in I-Haze and O-Haze datasets, and its performance is quantified by various performance metrics such as MSE, SSIM, PSNR, WPSNR, and Running time. The experimental consequences demonstrate that the developed model performs better than other techniques and attains an MSE from both datasets as 0.0054 and 0.0051. Overall, the proposed model amends the accuracy and reliability of haze detection in images. [ABSTRACT FROM AUTHOR]

The fast scenario transfer for portrait styles has been a universal concern in the area of image processing. Conventionally, it was realized mostly by manual manipulation based on expertise experience, which costs a large amount of human labor. To fit the growing business volume in the era of Internet 4.0, it is supposed to investigate reliable autonomous workflow that generates portrait-style results via intelligent algorithms. Therefore, this paper proposes a fast scenario transfer method for portrait styles through collaborative awareness of convolutional neural network (CNN) and generative learning (GAL). On the one hand, a CNN structure is designed to make feature extraction towards the initial images, which can be used for following image generation. On the other hand, the GAL is utilized to generate new images with post-transferred scenario styles, so that the expected scenario style transfer results can be output by generating new images through long-term iterations. Especially, the loss function is designed by simultaneously considering local and global characteristics. Finally, the analysis and experimental results show that the correction process can be completed by injecting the extracted input face features into the feature maps of corresponding sizes in the generation process using a pre-trained feature extractor. Thus, the face conversion efficiency can be improved. [ABSTRACT FROM AUTHOR]

Deep convolutional neural networks have shown advanced performance in accurately segmenting images. In this paper, an SNP-like convolutional neuron structure is introduced, abstracted from the nonlinear mechanism in nonlinear spiking neural P (NSNP) systems. Then, a U-shaped convolutional neural network named SNP-like parallel-convolutional network, or SPC-Net, is constructed for segmentation tasks. The dual-convolution concatenate (DCC) and dual-convolution addition (DCA) network blocks are designed, respectively, in the encoder and decoder stages. The two blocks employ parallel convolution with different kernel sizes to improve feature representation ability and make full use of spatial detail information. Meanwhile, different feature fusion strategies are used to fuse their features to achieve feature complementarity and augmentation. Furthermore, a dual-scale pooling (DSP) module in the bottleneck is designed to improve the feature extraction capability, which can extract multi-scale contextual information and reduce information loss while extracting salient features. The SPC-Net is applied in medical image segmentation tasks and is compared with several recent segmentation methods on the GlaS and CRAG datasets. The proposed SPC-Net achieves 90.77% DICE coefficient, 83.76% IoU score and 83.93% F1 score, 86.33% ObjDice coefficient, 135.60 Obj-Hausdorff distance, respectively. The experimental results show that the proposed model can achieve good segmentation performance. [ABSTRACT FROM AUTHOR]

Tumors in the brain represent a general and serious disease that leads to small life expectancy. Hence, effective diagnosis preparation is indispensable to enhance the life quality of patients. This paper utilizes MRI for diagnosing the tumor in the brain. However, the MRI thwarts manual classification and poses drawbacks regarding precise quantitative measurements. Thus, automated cataloging of brain tumors is a crucial task. The main aim of this research is to provide an optimized deep model for multi-level classification with the help of MRI. The adaptive Wiener filter and Region Of Interest (ROI) mining are used to perform denoising to make an accurate diagnosis. The first-level classification is accomplished with Shepard Convolutional Neural Network (ShCNN) and its training is done with Tasmanian Devil Anti-Coronavirus Optimization (TDACVO), which categorizes suitably. If an abnormality is found, Deep Q-Network (DQN) and Exponential Tasmanian Devil Anti-Coronavirus Optimization (ETDACVO) are used to execute the second-level classification. The proposed ETDACVO-DQN provided better competence with an utmost accuracy of 93%, precision of 91.8%, and recall of 92.7%. [ABSTRACT FROM AUTHOR]

Diabetic retinopathy (DR) is one of the leading causes of blindness in a significant portion of the working population, and its damage on vision is irreversible. Therefore, rapid diagnosis on DR is crucial for saving the patient's eyesight. Since Transformer shows superior performance in the field of computer vision compared with Convolutional Neural Networks (CNNs), it has been proposed and applied in computer aided diagnosis of DR. However, a large number of images should be used for training due to the lack of inductive bias in Transformers. It has been demonstrated that the retinal vessels follow self-similar fractal scaling law, and the fractal dimension of DR patients shows an evident difference from that of normal people. Based on this, the fractal dimension is introduced as a prior into Transformers to mitigate the adverse influence of lack of inductive bias on model performance. A new Transformer method pretrained with Masked Autoencoders and fractal dimension (MAEFD) is developed and proposed in this paper. The experiments on the APTOS dataset show that the classification performance for DR by the proposed MAEFD can be substantially improved. Additionally, the present model pretrained with 100,000 retinal images outperforms that pretrained with 1 million natural images in terms of DR classification performance. [ABSTRACT FROM AUTHOR]

Scene recognition is an important computer vision task that has evolved from the study of the biological visual system. Its applications range from video surveillance, autopilot systems, to robotics. The early works were based on feature engineering that involved the computation and aggregation of global and local image descriptors. Several popular image features such as SIFT, SURF, HOG, ORB, LBP, KAZE, etc. have been proposed and applied to the task with successful results.Features can be either computed from the entire image on a global scale, or extracted from local sub-regions and aggregated across the image. Suitable classifier models are deployed that learn to classify these features. This review paper analyzes several of these handcrafted features that have been applied to the scene recognition task over the past decades, and tracks the transition from the traditional feature engineering to deep learning which forms the current state of the art in computer vision. Deep learning is now deemed to have overtaken feature engineering in several computer vision applications. Deep convolutional neural networks and vision transformers are the current state of the art for object recognition. However, scenes from urban landscapes are bound to contain similar objects posing a challenge to deep learning solutions for scene recognition. In our study, a critical analysis of feature engineering and deep learning methodologies for scene recognition is provided, and results on benchmark scene datasets are presented, concluding with a discussion on challenges and possible solutions that may facilitate more accurate scene recognition. [ABSTRACT FROM AUTHOR]

Deep learning based on deep neural networks has been very successful in many practical applications, but it lacks enough theoretical understanding due to the network architectures and structures. In this paper, we establish some analysis for linear feature extraction by a deep multi-channel convolutional neural networks (CNNs), which demonstrates the power of deep learning over traditional linear transformations, like Fourier, wavelets, redundant dictionary coding methods. Moreover, we give an exact construction presenting how linear features extraction can be conducted efficiently with multi-channel CNNs. It can be applied to lower the essential dimension for approximating a high-dimensional function. Rates of function approximation by such deep networks implemented with channels and followed by fully connected layers are investigated as well. Harmonic analysis for factorizing linear features into multi-resolution convolutions plays an essential role in our work. Nevertheless, a dedicate vectorization of matrices is constructed, which bridges 1D CNN and 2D CNN and allows us to have corresponding 2D analysis. [ABSTRACT FROM AUTHOR]

Applications for the stock market that can be relied upon to provide the information regular and professional investors need to make better-informed purchases are a boon to both. A well-thought-out sales approach may help buyers mitigate risk, zero in on the companies most likely to provide the highest returns, and increase their chances of making a purchase. Due to numerous interrelationships between various company values, executing stock market research utilizing batch processing methods provides an exceptionally tough task. Technology advancements, such as the licensing of global processes, usher in a new age for stock market forecasting. The present market climate has increased the significance of data applications. An interesting and new contribution made by this work is the proposal of a deep learning-based resilience time series model for forecasting future market values. By analyzing financial time series, this study aimed to build a sophisticated strategy for forecasting stock market prices. The use of artificial intelligence (AI) to forecast future market behavior is one of the most intriguing developments in this generation of technological breakthroughs. Particularly promising results have been found when applying deep learning techniques to the task of predicting the actions of market players. In this paper, we propose a method for forecasting the final prices of publicly traded firms like Tesla, Inc. and Apple, Inc. by merging a convolutional neural network with long short-term memory (LSTM). These two methods were both developed with the help of deep learning techniques. The time frame covered by statistics used in these projections is two years. To evaluate the performance of our deep learning models, we compared their market predictions using several different metrics, including mean squared error (MSE), root mean squared error (RMSE), normalized root mean squared error (NRMSE), and Pearson's R. When compared to the options, the CNN-LSTM deep learning algorithm did the best. When comparing convolution neural networks CNN-LSTM model to the normal LSTM and a simpler deep learning variant, the latter showed to be more effective at forecasting stock market values. This was the case when examining all three variants together. [ABSTRACT FROM AUTHOR]

Image sharpening detection, as a crucial branch of image forensics research, has attained a satisfactory level of performance with the assistance of deep learning. However, due to the nature of convolutional neural network (CNN) models, adversarial examples synthesized by generative adversarial networks (GANs) can easily attack existing forensics models. Therefore, deep learning-based forensics faces new challenges. In this paper, a novel architecture inspired by ConvNext is proposed to detect synthesized adversarial USM sharpening images. Through practical demonstration, our proposed technique achieves satisfying performance in recognizing adversarial samples that outperform previous sharpened image forensic systems. In addition, we have undertaken an ablation analysis of our suggested network topology and analyzed the efficacy of different enhancements. [ABSTRACT FROM AUTHOR]

Mathematical morphology and convolution operators are two different methods to extract the characteristics and structures of images. Over the past decades, Deep Convolutional Neural Networks (DCNN) have been proven to be more powerful than traditional image-processing approaches. In this paper, we propose a novel structure called Deep Hybrid Neural Network (DHNN) by taking advantage of the convolution and morphological neural layers. Its practical application to polyp detection in medical images is illustrated. For experimental completeness, we adopt nine polyp image datasets, including publicly available data and our own collected data. For performance comparisons, we select three backbone models. Experimental results show that our DHNN achieves the best performance in comparisons in terms of computational complexity and accurate performance. [ABSTRACT FROM AUTHOR]

This paper suggests a text emotion analysis approach built on the BMCBMA model for use in an online education environment aiming at the issues of poor text utilization, challenge in effective information extraction, and a failure to effectively recognize word polysemy in existing text emotion analysis task research. Initially, a language model is constructed using Bidirectional Encoder Representations from Transformers (BERT) pre-training. The word vector trained by BERT pre-training is selected to supplant the word vector trained in the conventional manner, and the semantic vector is generated dynamically using the context of the word. Second, the Bi-directional Long Short-Term Memory (BiLSTM) model is employed to record semantic information by simultaneously integrating both positive and negative orientations to assess the emotional polarity information for every text in its entirety. The Multi-channel Convolutional Neural Networks (CNN) model is then utilized to derive textual local feature information of text. Lastly, the attention mechanism is used to cause all types of features to interact and to derive a deeper semantic association within the context. Experiments indicate that the suggested method has accuracy, F1, recall, and precision values of 0.915, 0.911, 0.915 and 0.908, correspondingly. The suggested approach performs significantly better in text emotion analysis than the comparison method. [ABSTRACT FROM AUTHOR]

It is a practical issue to make professional resource planning towards low light environment such as museums, so as to achieve the optimal visual experience. This work aims at such scenes, and manages to deal with them from the perspective of vision computing-based optimal planning. Therefore, a smart optimal resource planning method for low light environment in museum based on convolutional vision computing network, is proposed in this paper. Based on the expected visual effect and light environment adaptation data in realistic situation, a convolution operations-based neural computing structure is developed to implement extraction and fusion of visual characteristics. And output of this part is further utilized for following digital evaluation of visual effect. At last, simulation experiments of the proposal are conducted to assess running effect of the proposal. The results show that time efficiency of proposal is reduced by 23.8% and the accuracy rate is improved by 12% compared with the U-net model. It is concluded that the proposal can be utilized in realist engineering applications to implement such tasks. [ABSTRACT FROM AUTHOR]

The recognition of steel microstructure images plays a crucial role in the metallographic analysis process. Although some progress has been made through the application of artificial intelligence algorithms, several challenges remain. First, existing algorithms exhibit weak nonlinear feature extraction capabilities and noticeable limitations. Second, they overlook the intrinsic noise and redundant interference present in microscopic images. To address these issues, this paper investigates the automatic recognition of metallographic tissues by leveraging residual structures in deep neural networks. An enhanced residual network model based on transfer learning is proposed, which utilizes the pre-trained weights from the ImageNet dataset to facilitate learning with small sample data. This network offers higher classification accuracy and higher F1 scores. In addition, a deep residual shrinkage network model based on an attention mechanism is proposed. This model incorporates an attention sub-network into the original residual module and employs a soft threshold function to eliminate redundant features, including noise. The proposed algorithms are evaluated against various convolutional neural networks using 20 types of metallographic test sets. The experimental results showed that both methods have high accuracy rates of 95% and 94.44%, respectively, and F1 scores of 0.9464 and 0.9419. While maintaining the complexity of the model, there has been a significant improvement in accuracy, and the models exhibit strong generalization capabilities. Our research contributes to enhancing production efficiency, strengthening quality control, and improving material performance through computer vision technology. [ABSTRACT FROM AUTHOR]

Ecological garden is one of the important links of urban ecosystem. Accurate and effective analysis of temporal and spatial changes of garden vegetation is conducive to the sustainable development of urban resources and environment. However, the elements of garden vegetation are close to each other, and the current analysis methods can't support the remote sensing image analysis in the ecological garden scene. To solve this problem, this paper introduces a new method for recognition and classification based on deep learning networks. Firstly, radiometric correction and geometric correction are used to preprocess the data collected by unmanned aerial vehicle (UAV); the ecological garden remote sensing image analysis network is constructed based on three-dimensional convolutional neural network (3D-CNN), which adopts double convolution pool structure, To address the issue of pixel misclassification due to similar features in landscape vegetation classification, a deep learning network can be used for high-dimensional feature extraction. On this basis, the multiple label conditional random field (MLCRF) algorithm can be applied for global optimization, effectively solving the misclassification problem caused by similar features of vegetation. This method not only improves classification accuracy but also is suitable for large-scale image classification tasks in complex scenes. The simulation results show that the overall recognition accuracy of the proposed 3D-CNN-MLCRF identification method is 97.83% and the Kappa coefficient is 97.18%, which can accurately and effectively realize the task of ecological garden scene classification. [ABSTRACT FROM AUTHOR]

Uncertainties are significant in the early vibroacoustic development, e.g., of a car body, to prevent costly modifications close to the start of production. First, engineers must know which uncertain parameters are sensitive: Our previous work identified 170 uncertain parameters being sensitive out of a complex finite element model with 1,300 uncertain parameters – a parameter reduction of approximately 87%. Second, engineers aim to find reliable distributions of these sensitive input parameters for finite element simulations. Finding these distributions is very demanding in a large-scale vibroacoustic model with several connecting parameters, as research already acknowledges regarding simplified connections. In this paper, we address this challenge with neural networks. For this, we use data in the frequency domain. Due to the curse of dimensionality, it is difficult to determine the parameter set of 170 parameters with a neural network. Therefore, we examine the influence of the number of parameters on the performance of neural networks. Furthermore, we train a fully connected feed-forward neural network and compare this to a one-dimensional convolutional neural network. The latter exhibits a better performance. Finally, we show how to determine distributions of the analyzed parameters based on artificial measurement data. Due to this process, we can significantly improve our finite element simulations and show how to deal with the challenge of determining uncertain parameters in a large-scale vibroacoustic finite element model based on data in the frequency domain. [ABSTRACT FROM AUTHOR]

With the rapid development of deep learning technology, object detection algorithms have made significant breakthroughs in the field of computer vision. However, due to the complexity and computational requirements of deep Convolutional Neural Network (CNN), these models face many challenges in practical applications, especially on resource-constrained edge devices. To address this problem, researchers have proposed many lightweight methods that aim to reduce the model size and computational complexity while maintaining high performance. The popularity of mobile devices and embedded systems has led to an increasing demand for lightweight models. However, existing lightweight methods often lead to accuracy loss, limiting their feasibility in practical applications. Therefore, how to realize the light weight of the model while maintaining high accuracy has become an urgent problem to be solved. To address this challenge, this paper proposes a lightweight YOLOv7 method based on PConv, Squeeze-and-Excitation (SE) attention mechanism and Wise-IoU (WIoU), which we refer to as YOLOv7-PSW. PConv can effectively reduce the number of parameters and computational complexity. The SE can help the model focus on important feature information, thereby improving performance. WIoU is introduced to measure the similarity between the detection box and the Ground Truth, so that the model can effectively reduce the False Positive rate. By applying these advanced techniques to the YOLOv7, we achieve a lightweight model while maintaining a high detection accuracy. Experimental results on PASCAL VOC dataset show that YOLOv7-PSW performs better than the original YOLOv7 on object detection tasks. The number of parameters is reduced by 12.3%, FLOPs is reduced by 18.86%, and the accuracy is improved by about 0.5%. While the detection accuracy is not decreased or even slightly improved, the number of FLOPs and parameters is greatly reduced, which realizes lightweight to a certain extent. The proposed method can provide new ideas and directions for the subsequent research on lightweight object detection, and is expected to promote its application on edge devices. Meanwhile, YOLOv7-PSW can also be applied to other computer vision tasks to improve its performance and efficiency. In summary, the proposed YOLOv7-PSW lightweight method realizes the light weight of the model while maintaining high accuracy. This is of great significance for promoting the application of object detection algorithms on edge devices. [ABSTRACT FROM AUTHOR]

Automatic sleep staging offers a quick and objective assessment for quantitatively interpreting sleep stages in neonates. However, most of the existing studies either do not encompass any temporal information, or simply apply neural networks to exploit temporal information at the expense of high computational overhead and modeling ambiguity. This limits the application of these methods to multiple scenarios. In this paper, a sequential end-to-end sleep staging model, SeqEESleepNet, which is competent for parallelly processing sequential epochs and has a fast training rate to adapt to different scenarios, is proposed. SeqEESleepNet consists of a sequence epoch generation (SEG) module, a sequential multi-scale convolution neural network (SMSCNN) and squeeze and excitation (SE) blocks. The SEG module expands independent epochs into sequential signals, enabling the model to learn the temporal information between sleep stages. SMSCNN is a multi-scale convolution neural network that can extract both multi-scale features and temporal information from the signal. Subsequently, the followed SE block can reassign the weights of features through mapping and pooling. Experimental results exhibit that in a clinical dataset, the proposed method outperforms the state-of-the-art approaches, achieving an overall accuracy, F1-score, and Kappa coefficient of 71.8%, 71.8%, and 0.684 on a three-class classification task with a single channel EEG signal. Based on our overall results, we believe the proposed method could pave the way for convenient multi-scenario neonatal sleep staging methods. [ABSTRACT FROM AUTHOR]

The recognition of steel microstructure images plays a crucial role in the metallographic analysis process. Although some progress has been made through the application of artificial intelligence algorithms, several challenges remain. First, existing algorithms exhibit weak nonlinear feature extraction capabilities and noticeable limitations. Second, they overlook the intrinsic noise and redundant interference present in microscopic images. To address these issues, this paper investigates the automatic recognition of metallographic tissues by leveraging residual structures in deep neural networks. An enhanced residual network model based on transfer learning is proposed, which utilizes the pre-trained weights from the ImageNet dataset to facilitate learning with small sample data. This network offers higher classification accuracy and higher F1 scores. In addition, a deep residual shrinkage network model based on an attention mechanism is proposed. This model incorporates an attention sub-network into the original residual module and employs a soft threshold function to eliminate redundant features, including noise. The proposed algorithms are evaluated against various convolutional neural networks using 20 types of metallographic test sets. The experimental results showed that both methods have high accuracy rates of 95% and 94.44%, respectively, and F1 scores of 0.9464 and 0.9419. While maintaining the complexity of the model, there has been a significant improvement in accuracy, and the models exhibit strong generalization capabilities. Our research contributes to enhancing production efficiency, strengthening quality control, and improving material performance through computer vision technology. [ABSTRACT FROM AUTHOR]

This document is a preface to a special section in the Journal of Mechanics in Medicine & Biology that focuses on the application and progress of biomechanics in medicine. It highlights 29 papers that cover a wide range of topics, including aortic response to blunt side impacts, acupuncture treatment for depressive insomnia, blood flow in carotid arteries, consumer sentiment analysis in e-commerce, epilepsy diagnosis using EEG signals, disability grading in the elderly, medical image retrieval, emotion recognition using EEG signals, tongue region segmentation in traditional Chinese medicine, human posture recognition, EEG-based emotion recognition, human bone movement identification in ice sports, hypertension-related gene expression analysis, acupuncture for lipid reduction in obese rats, epilepsy EEG recognition, bladder wall segmentation and cancer assessment, artificial intelligence in thyroid cancer diagnosis, aerobic fitness and brain-limb synchronization, MR image denoising, early warning model for mental illnesses, mind-body activation in stroke rehabilitation, EEG-based emotion recognition using deep learning, biomedical image segmentation, motion-stimulated EEG signal recognition, joint dynamics in speed skating, center of gravity manipulation in running shoes, gait pattern reconstruction, surgical navigation system for oral and maxillofacial procedures, lower limb kinematics during squatting, and the latest findings and methodologies in biomechanics research. The preface concludes by emphasizing the importance of collaboration and translation of scientific discoveries for improving human health. [Extracted from the article]

Background and Objective: Alzheimer's disease is nowadays the most common cause of dementia. It is a degenerative neurological pathology affecting the brain, progressively leading the patient to a state of total dependence, thus creating a very complex and difficult situation for the family that has to assist him/her. Early diagnosis is a primary objective and constitutes the hope of being able to intervene in the development phase of the disease. Methods: In this paper, a method to automatically detect the presence of Alzheimer's disease, by exploiting deep learning, is proposed. Five different convolutional neural networks are considered: ALEX_NET, VGG16, FAB_CONVNET, STANDARD_CNN and FCNN. The first two networks are state-of-the-art models, while the last three are designed by authors. We classify brain images into one of the following classes: non-demented, very mild demented and mild demented. Moreover, we highlight on the image the areas symptomatic of Alzheimer presence, thus providing a visual explanation behind the model diagnosis. Results: The experimental analysis, conducted on more than 6000 magnetic resonance images, demonstrated the effectiveness of the proposed neural networks in the comparison with the state-of-the-art models in Alzheimer's disease diagnosis and localization. The best results in terms of metrics are the best with STANDARD_CNN and FCNN with accuracy, precision and recall between 98% and 95%. Excellent results also from a qualitative point of view are obtained with the Grad-CAM for localization and visual explainability. Conclusions: The analysis of the heatmaps produced by the Grad-CAM algorithm shows that in almost all cases the heatmaps highlight regions such as ventricles and cerebral cortex. Future work will focus on the realization of a network capable of analyzing the three anatomical views simultaneously. [ABSTRACT FROM AUTHOR]

Accurate identification of vehicles and estimating density in traffic surveillance systems is a challenging task, particularly in scenarios with closely spaced lanes. Single Shot MultiBox Detector (SSD) is introduced in vehicle detection and classification due to its speed and accuracy. It utilizes a transfer learning technique that enables them to utilize features from pretrained Convolutional Neural Networks (CNNs). Although the utilization of multi-scale feature maps in SSD has achieved efficient results in vehicle detection, it struggles to identify key features of vehicles due to its one-stage detection approach. Furthermore, the use of VGG16 as the backbone network in these approaches leads to the loss of fine-grained details, posing challenges in accurately localizing and classifying small vehicles. Also, there is no interaction between high- and low-level features, which restricts the networks ability to effectively integrate and utilize both features for accurate vehicle detection. To overcome these limitations, an improved SSD approach is introduced in this paper, leveraging interactive multi-scale attention characteristics to accurately detect and classify vehicles. This approach utilizes ResNet50 as the network backbone to overcome the limitations of traditional SSDs in detecting small vehicles. Also, an attention block is incorporated into it to focus on key details and assign higher attention to relevant pixels within the feature map. Also, the network employs a parallel detection framework and shares multi-scale layers (both high and low), enabling efficient detection of vehicles with various sizes. Then, traffic density is estimated based on the weights assigned to the categorized vehicles obtained from the improved SSD and the recorded area. Finally, traffic is classified as high, low, or moderate by comparing the estimated density to a threshold value. By adding attention characteristics of different scales to the original detection branch and replacing the VGG16 with ResNet50 of the SSD technique using our method, the feature representation capability and detection accuracy are both significantly improved. [ABSTRACT FROM AUTHOR]

In recent years, deep learning-based networks have been able to achieve state-of-the-art performance in medical image segmentation. U-Net, one of the currently available networks, has proven to be effective when applied to the segmentation of medical images. A Convolutional Neural Network's (CNN) performance is heavily dependent on the network's architecture and associated parameters. There are many layers and parameters that need to be set up in order to manually create a CNN, making it a complex procedure. Designing a network is made more difficult by using a variety of connections to increase the network's complexity. Evolutionary computation can be used to set the parameters of CNN and/or organize the CNN layers as an optimization strategy. This paper proposes an automatic evolutionary method for detecting an optimal network topology and its parameters for the segmentation of clinical image using Grey Wolf Optimization algorithm. Also, Bi-Directional LSTM integrated in the skip connection to extract dense feature characteristics of image by combining feature maps extracted from encoded and previous decoded path in nonlinear way (MIS-GW-U-Net-BiDCLSTM) is proposed. The experimental results demonstrate that the proposed method attains 98.49% accuracy with minimal parameters, which is much better than that of the other methods. [ABSTRACT FROM AUTHOR]

This paper proposes an efficient method for rectifying distorted document images via deep learning, ultimately improving the legibility of graphics and text in documents. The framework comprises two interconnected UNets, working in tandem to predict a 3D coordinate map and a forward map for the input distorted document image, respectively. At the beginning of the process, a page mask is predicted and used as input to both U-Nets to help improve the performance of their tasks. In the last step, the predicted forward map is transformed into a corresponding backward map, which is utilized to rectify the distorted image. The experimental results not only reveal that the predicted page masks and 3D coordinate maps significantly enhance the accuracy of predicting forward maps for subsequent rectification but also demonstrate satisfactory results both globally and locally. [ABSTRACT FROM AUTHOR]

This paper aims to propose an improved image classification model to reduce the cost of model construction. Aiming at the problem that network training usually requires the support of a large number of labeled samples, an image classification model based on semi-supervised deep learning is proposed, which uses labeled samples to guide the network to learn unlabeled samples. A convolutional neural network model for simultaneous processing of labeled and unlabeled data is constructed. The tagged data is used to train the Softmax classifier and provide the initial K-means clustering center for the untagged data. The nonsubsampling contourlet layer is used to replace the first convolutional layer of the full convolutional neural network to extract multi-scale depth features, and the nonsubsampling contourlet full convolutional neural network is constructed. The network can extract multi-scale information of the images to be classified, and extract more discriminative deep image features. In addition, the parameters of the nonsubsampled contourlet layers are pre-set and do not require network training. The proposed method has higher classification accuracy than the contrast method on polarimetric SAR images using the nonsubsampled contourlet full convolutional neural network. [ABSTRACT FROM AUTHOR]

To accurately describe the thermal comfort of indoor occupant used to regulate heating, ventilation and air conditioning (HVAC) system is a key goal to reduce energy consumption in intelligent buildings. In this paper, we propose a noncontact measurement of occupant thermal discomfort behavior as an index of thermal comfort. The method takes the existing monitoring image data in the building as the input to infer the occupant thermal discomfort directly, which saves the cost because there is no need to install new sensors in the building and the occupant does not need to wear additional equipment. The framework combined three channels of body posture, motion and performance information to infer occupant thermal discomfort behavior, it consists of a human detection and crop module, a posture analysis module, an optical flow extraction module and a 3D convolutional neural network module. The three channels describe the actions from different perspectives, and the proposed method makes full use of the complementarity of the three modalities to identify the occupant's thermal discomfort behaviors. Sixteen postures related to thermal discomfort were identified through a questionnaire, and 14,800 video clips containing these postures were collected for experimental evaluation. The results demonstrate the superior performances of our approach to the state-of-the-art techniques. The framework achieves noninvasive, cost-effective thermal comfort evaluation, and has potential value in improving energy efficiency of HVAC systems. [ABSTRACT FROM AUTHOR]

This paper proposes a point-of-interest (POI) sequence recommendation algorithm based on BERT-ACNN-GRU to address the issues faced by the existing POI recommendation model in social network large data, such as the difficulty in extracting deep feature information and the low recommendation performance. Firstly, the semantic relationship between a word and its context in the text is combined using the bidirectional encoder representation from transformers (BERT) model to effectively eliminate the influence of word distance and obtain the contextualized word vector. Secondly, a convolutional neural network (CNN) utilizing a gated recurrent unit (GRU) is employed to capture the feature information of the text. Lastly, the attention method is utilized to assign weight scores to various terms in order to provide more attention to particular words and boost the precision of recommendations. The experiments demonstrate that the precision, recall rate, F1 score and mean average precision (mAP) of the proposed method are 0.097, 0.26, 0.103, and 0.085 on the Gowalla dataset when the recommendation list has a length of 10, respectively. On the Yelp dataset, the precision is 0.093, the recall rate is 0.26, F1 is 0.099, and MAP is 0.089. Hence, the proposed method can effectively enhance the performance of the POI recommendation system. [ABSTRACT FROM AUTHOR]

Computational fluid dynamics (CFD) plays a critical role in many scientific and engineering applications, with aerodynamic design optimization being a primary area of interest. Recently, there has been much interest in using artificial intelligence approaches to accelerate this process. One promising method is the graph convolutional neural network (GCN), a deep learning method based on artificial neural networks (ANNs). In this paper, we propose a novel GCN-based aerodynamic design optimization acceleration framework, GCN-based aerodynamic design optimization acceleration framework. The framework significantly improves processing efficiency by optimizing data flow and data representation. We also introduce a network model called GCN4CFD that uses the GCF framework to create a compact data representation of the flow field and an encoder–decoder structure to extract features. This approach enables the model to learn underlying physical laws in a space-time efficient manner. We then evaluate the proposed method on an airfoil aerodynamic design optimization task and show that GCN4CFD provides a significant speedup compared to traditional CFD solvers while maintaining accuracy. Our experimental results demonstrate the robustness of the proposed framework and network model, achieving a speedup average of 3. 0 ×. [ABSTRACT FROM AUTHOR]

Single image super-resolution (SR) is a technique that reconstructs a high-resolution (HR) image from a single low-resolution (LR) input image. The main objective of super-resolution algorithms is to achieve a high-resolution image that is consistent with the input low-resolution image but has enhanced spectral properties. In this review, several research papers and their corresponding algorithms have been reviewed and are classified based on their methodology. The principal objective of this review is to understand the evolution of SISR techniques from basic interpolation techniques to sophisticated convolutional neural networks. This article also presents design considerations for future advancements. [ABSTRACT FROM AUTHOR]

With the widespread adoption of virtual reality and 360-degree video, there is a pressing need for objective metrics to assess quality in this immersive panoramic format reliably. However, existing image quality assessment models developed for traditional fixed-viewpoint content do not fully consider the specific perceptual issues involved in 360-degree viewing. This paper proposes a 360-degree image full-reference quality assessment (FR-IQA) methodology based on a multi-channel architecture. The proposed 360-degree FR-IQA method further optimizes and identifies the distorted image quality using two easily obtained useful saliency and depth-aware image features. The convolutional neural network (CNN) is designed for training. Furthermore, the proposed method accounts for predicting user viewing behaviors within 360-degree images, which will further benefit the multi-channel CNN architecture and enable the weighted average pooling of the predicted FR-IQA scores. The performance is evaluated on publicly available databases to demonstrate the advantages brought by the proposed multi-channel model in performance evaluation and cross-database evaluation experiments, where it outperforms other state-of-the-art ones. Moreover, an ablation study exhibits good generalization ability and robustness. [ABSTRACT FROM AUTHOR]

Deep learning-based video coding methods have demonstrated superior performance compared to classical video coding standards in recent years. The vast majority of the existing deep video coding (DVC) networks are based on convolutional neural networks (CNNs), and their main drawback is that since CNNs are affected by the size of the receptive field, they cannot effectively handle long-range dependencies and local detail recovery. Therefore, how to better capture and process the overall structure as well as local texture information in the video coding task is the core issue. Notably, the transformer employs a self-attention mechanism that captures dependencies between any two positions in the input sequence without being constrained by distance limitations. This is an effective solution to the problem described above. In this paper, we propose end-to-end transformer-based adaptive video coding (TAVC). First, we compress the motion vector and residuals through a compression network built on the vision transformer (ViT) and design the motion compensation network based on ViT. Second, based on the requirement of video coding to adapt to different resolution inputs, we introduce a position encoding generator (PEG) as adaptive position encoding (APE) to maintain its translation invariance across different resolution video coding tasks. The experiment shows that for multiscale structural similarity index measurement (MS-SSIM) metrics, this method exhibits significant performance gaps compared to conventional engineering codecs, such as × 2 6 4 , × 2 6 5 , and VTM-15.2. We also achieved a good performance improvement compared to the CNN-based DVC methods. In the case of peak signal-to-noise ratio (PSNR) evaluation metrics, TAVC also achieves good performance. [ABSTRACT FROM AUTHOR]