Search

As an important stage of life cycle management, machinery PHM (prognostics and health management), an emerging subject in mechanical engineering, has seen a huge amount of research. Here the authors present a comprehensive overview that details previous and current efforts in PHM from an industrial big data perspective. The authors first analyze the historical development of industrial big data and its distinction from big data of other domains and summarize the sources, types, and processing modes of industrial big data. Then, the authors provide an overview of common representation and fusion (data pre-processing) methods of industrial big data. Next, the authors comprehensively review common PHM methods in the data-driven context, focusing on the application of deep learning. Finally, two industrial cases from our previous studies are included in this paper to demonstrate how the PHM technique may facilitate the manufacturing industry. Furthermore, a visual bibliography is developed for displaying current results of PHM in an appropriate theme. The bibliography is open source at "https://mango-hund.github.io/". The authors believe that future research endeavors will require an understanding of this previous work, and our efforts in this paper will make it possible to customize and integrate PHM systems quickly for a variety of applications. [ABSTRACT FROM AUTHOR]

Development in the medical field is getting fast every day. People's interest in improving their expectancy of life, their life quality, and the significant investments in medical laboratories modify the diagnosis methods, application protocols, and surgical techniques. One of the most significant milestones in the medical field have been incorporating computers to improve data analysis during the last years. Nowadays, it is a fact that computers can help physicians, i.e., the use of artificial intelligence techniques. This paper proposes a multistage prediction-based approach and a rule-based system for the treatment of abdominal aortic aneurysms. The first step is to develop a neural network model to predict 30-day mortality during and after aortic endovascular procedures. The second step aims to infer a rule-based system from the previous model. The results show that with only eight features the final predictive model can obtain an accuracy of around 87%. Furthermore, a decision tree with the same accuracy can be inferred from this model using three features and four rules [ABSTRACT FROM AUTHOR]

As an essential part of geocoding, address matching has gained increasing research attention. Due to the long-distance dependency and unstructured property, existing address-matching methods hardly capture the contextual and implicit semantic information of unstructured text addresses. This paper presents a Contrastive Learning model based on Global and Local representation Interaction for Address Matching (referred to as CLGLIAM), which introduces a novel global and local interaction network to enhance the discrimination ability of the model on the hard negative address by associating the relationship between the global and local address representation explicitly. Simultaneously, to improve the generalization and transferability of the model, we utilize contrastive learning to enrich the data sample and extricate the model from task-specific knowledge. Furthermore, extensive experiments are conducted on Shenzhen and national address datasets to verify the effectiveness of our approach. Our model achieves state-of-the-art F1 scores of 99.26 and 98.50 on the two datasets, respectively. And the extended hard negative experiments further demonstrate the better performance of CLGLIAM in terms of semantic discrimination. [ABSTRACT FROM AUTHOR]

In order to solve the problem that traditional two-way decision based malicious code detection methods fail to consider the influence of decision making under the condition of insufficient information when facing complex and massive data in dynamic environment, this paper proposes a malicious code detection model based on sequential three-way decision. This model introduces sequential three-way decision into the domain of malicious code to avoid the risk of possible error detection due to insufficient information. In order to improve the overall performance of the detection model and eliminate the subjectivity of threshold selection, this paper designs a multi-objective sequential three-way decision model based on the above model, while considering the decision efficiency and decision accuracy of the model. In addition, the multi-objective optimization algorithm is used to solve the model. The simulation results show that the model not only guarantees the detection performance, but also improves the decision efficiency effectively. The real dynamic detection environment is better fitted. [ABSTRACT FROM AUTHOR]

Intelligent monitoring of machine chips can help the machine tool to remove chip accumulation in time. Based on chip shape information, real-time monitoring of the machine tool is also possible. Although image segmentation algorithms have been widely used in industry, they still need to improve. These methods still have some limitations in effectively combining global and local information of industrial images, and there needs to be an image segmentation algorithm specifically for machine tool chips. In this paper, we propose a deep learning-based algorithm for lightweight chip image segmentation named Hybridformer. First, the algorithm generates scale-aware semantic features using feature maps of different scales as the input part. Then, we use the cross specification and SelfNorm to improve the generalization robustness of the model in terms of distribution bias. Finally, the network extracts global contextual information fusing EfficientNetv2 features to achieve accurate localization. Widespread experimental results show that Hybridformer outperforms both CNN and Transformer algorithms in terms of comprehensive performance on multiple chip image datasets, and it can achieve a good balance between accuracy and size of parameters. [ABSTRACT FROM AUTHOR]

For humans to trust in artificial intelligence (AI) systems, it is essential for machine learning (ML) models to be interpretable to users. For example, the judicial process requires that AI conclusions must be rigorous and absolutely interpretable. In this paper, we propose a novel approach, VAE-SLIME, for providing stable local interpretable model-agnostic explanations (SLIME) based on a variational autoencoder (VAE). LIME is a technique that explains the predictions of any classifier in an interpretable and faithful manner. Despite the great success of LIME, the most popular method in this category, it has several disadvantages due to its random perturbation-based sampling method. The VAE-SLIME proposed in this paper is specifically designed to address the lack of stability and local fidelity exhibited by LIME for tabular data. VAE-SLIME first employs fixed noise to replace the random Gaussian noise used by the reparameterization trick of the VAE. Then, it uses this new VAE model instead of random perturbation method to generate stable samples. By considering the sequential relationship and flipping of features, a novel explanation stability evaluation metric, the feature sequence stability index (FSSI), is introduced to accurately evaluate the stability of explanations. In a comparison with 6 state-of-the-art approaches on 7 commonly used tabular datasets, the experimental results show beyond doubt that the explanations produced by our approach are most stable, and its local fidelity is 65.17% higher than that of other approaches on average. [ABSTRACT FROM AUTHOR]

In this paper, a novel technique for detecting female breast anomalous tissues is presented and validated through numerical simulations. The technique, to a high degree, resembles X-ray mammography; however, instead of using X-rays for obtaining images of the breast, low-frequency electromagnetic fields are leveraged. To capture breast impressions, a metasurface, which can be thought of as analogous to X-rays film, has been employed. To achieve deep and sufficient penetration within the breast tissues, the source of excitation is a simple narrow-band dipole antenna operating at 200 MHz. The metasurface is designed to operate at the same frequency. The detection mechanism is based on comparing the impressions obtained from the breast under examination to the reference case (healthy breasts) using machine learning techniques. Using this system, not only would it be possible to detect tumors (benign or malignant), but one can also determine the location and size of the tumors. Remarkably, deep learning models were found to achieve very high classification accuracy. [ABSTRACT FROM AUTHOR]

Distributed learning, as the most popular solution for training large-scale data for deep learning, consists of multiple participants collaborating on data training tasks. However, the malicious behavior of some during the training process, like Byzantine participants who would interrupt or control the learning process, will trigger the crisis of data security. Although recent existing defense mechanisms use the variability of Byzantine node gradients to clear Byzantine values, it is still unable to identify and then clear the delicate disturbance/attack. To address this critical issue, we propose an algorithm named consensus aggregation in this paper. This algorithm allows computational nodes to use the information of verification nodes to verify the effectiveness of the gradient in the perturbation attack, reaching a consensus based on the effective verification of the gradient. Then the server node uses the gradient as the valid gradient for gradient aggregation calculation through the consensus reached by other computing nodes. On the MNIST and CIFAR10 datasets, when faced with Drift attacks, the proposed algorithm outperforms common existing aggregation algorithms (Krum, Trimmed Mean, Bulyan), with accuracies of 93.3%, 94.06% (MNIST dataset), and 48.66%, 51.55% (CIFAR10 dataset), respectively. This is an improvement of 3.0%, 3.8% (MNIST dataset), and 19.0%, 26.1% (CIFAR10 dataset) over the current state-of-the-art methods, and successfully defended against other attack methods. [ABSTRACT FROM AUTHOR]

Road manhole covers are crucial components of urban infrastructure; however, inadequate maintenance or poor marking can pose safety risks to vehicular traffic. This paper presents a method for detecting road manhole covers using a stereo depth camera and the MGB-YOLO model. We curated a robust image dataset and performed image enhancement and annotation. The MGB-YOLO model was developed by optimizing the YOLOv5s network with MobileNet-V3, Global Attention Mechanism (GAM), and BottleneckCSP, striking a balance between detection accuracy and model efficiency. Our method achieved an impressive accuracy of 96.6%, surpassing the performance of Faster RCNN, SSD, YOLOv5s, YOLOv7 and YOLOv8s models with an increased mean average precision (mAP) of 15.6%, 6.9%, 0.7%, 0.5% and 0.5%, respectively. Additionally, we have reduced the model's size and the number of parameters, making it highly suitable for deployment on in-vehicle embedded devices. These results underscore the effectiveness of our approach in detecting road manhole covers, offering valuable insights for vehicle-based manhole cover detection and contributing to the reduction of accidents and enhanced driving comfort. [ABSTRACT FROM AUTHOR]

In recent years, surveillance systems have significantly increased in various environments. The Internet of Things (IoT), which interconnects objects through the Internet, enhances the capabilities of these systems. Typically, in IoT-enabled surveillance systems, the recorded videos should be processed and stored in cloud servers, which increases the system response time. Sending the videos to a cloud data center through the infrastructure network may also cause performance issues such as delay, jitter, and packet loss. Usually, edge computing is a viable solution to overcome these problems. This paper proposes a deep learning-based network traffic management policy for IoT-enabled surveillance systems in which the user's quality of experience (QoE) is a performance metric. For this purpose, first, a host in the edge data center preprocesses the video to reduce the video file size. Next, we designed a QoE-aware routing algorithm that uses a minimum delay-maximum mean opinion score heuristic algorithm to create a dataset that contains optimal routes with high QoE values. Then, it trains a sequential deep recurrent neural network (deep-RNN) on this dataset, and the trained model predicts the optimal routes between a source edge data center and a destination cloud center. Because software-defined networks (SDN) facilitate the execution of intelligent algorithms in networks, we implemented the proposed policy in the SDN controller of the infrastructure network. The simulation results showed that the proposed method could reduce the end-to-end packet loss ratio and increase the QoE values in IoT-enabled surveillance systems. Furthermore, converting the video codec on the edge layer reduces the video size, reducing the network latency by 50%. The experimental results also showed 94% accuracy using the proposed sequential deep RNN model. [ABSTRACT FROM AUTHOR]

Improve the scientific level of the goose breeding industry and help the development of intelligent agriculture. Instance Segmentation has a pivotal role when the breeders make decisions about geese breeding. It can be used for disease prevention, body size estimation and behavioural prediction, etc. However, instance segmentation requires high performance computing devices to run smoothly due to its rich output. To ameliorate this problem, this paper constructs a novel encoder-decoder module and proposes the SDSCNet model. The reasonable use of depth-separable convolution in the module reduces the number and size of model parameters and increase execution speed. Finally, SDSCNet model enables real-time identification and segmentation of individual geese with the accuracy reached 0.933.We compare this model with numerous mainstream instance segmentation models, and the final results demonstrate the excellent performance of our model.Furthermore, deploying SDSCNet model on the embedded device Raspberry Pi 4 Model B can achieve effective detection of continuous moving scenes. [ABSTRACT FROM AUTHOR]

Politicians have used the web and social media to circumvent the gatekeeping behavior of traditional mass media by directly communicating with supporters in their accounts. This paper is aimed at understanding communication strategies used by politicians and campaigns, focusing on the role of gender cues in their visual self-presentation and their impact on election outcomes. Previous research has discussed the importance of visual portrayals of leaders in campaigns. These studies, however, have been mainly based on manual coding and are limited in scale and scope. This paper aims to fill the research gap by introducing a multi task method that infers perceived gender-stereotypical visual traits from social media images. We analyze 77,861 photographs collected from the Facebook accounts of 554 US politicians who ran in the 2018 elections. Regression analyses discover the positive association of the masculinity trait for electoral outcomes. We also identify an empirical evidence that the effect of gender stereotypes could vary according to the gender and party combinations of the candidates in a race. In the intersectional analysis, we found that the win of female democrats against the same gendered opponent was positively correlated with the femininity trait score. This study provides methodological foundations and empirical contributions to the understanding of politicians' campaign behaviors via photographs shared on social media and their relation to electoral success. [ABSTRACT FROM AUTHOR]

To assist ophthalmologists in diagnosing retinal abnormalities, Computer Aided Diagnosis has played a significant role. In this paper, a particular Convolutional Neural Network based on Wavelet Scattering Transform (WST) is used to detect one to four retinal abnormalities from Optical Coherence Tomography (OCT) images. Predefined wavelet filters in this network decrease the computation complexity and processing time compared to deep learning methods. We use two layers of the WST network to obtain a direct and efficient model. WST generates a sparse representation of the images which is translation-invariant and stable concerning local deformations. Next, a Principal Component Analysis classifies the extracted features. We evaluate the model using four publicly available datasets to have a comprehensive comparison with the literature. The accuracies of classifying the OCT images of the OCTID dataset into two and five classes were 100 % and 82.5 % , respectively. We achieved an accuracy of 96.6 % in detecting Diabetic Macular Edema from Normal ones using the TOPCON device-based dataset. Heidelberg and Duke datasets contain DME, Age-related Macular Degeneration, and Normal classes, in which we achieved accuracy of 97.1 % and 94.4 % , respectively. A comparison of our results with the state-of-the-art models shows that our model outperforms these models for some assessments or achieves nearly the best results reported so far while having a much smaller computational complexity. [ABSTRACT FROM AUTHOR]

Conventional machine learning models have been widely used for reservoir inflow and rainfall prediction. Nowadays, researchers focus on a new computing architecture in the area of AI, namely, deep learning for hydrological forecasting parameters. This review paper tends to broadcast more of the intriguing interest in reservoir inflow prediction utilizing deep learning and machine learning algorithms. The AI models utilized for different hydrology sectors, as well as the most prevalent machine learning techniques, will be explored in this thorough study, which divides AI techniques into two primary categories: deep learning and machine learning. In this study, we look at the long short-term memory deep learning method as well as three traditional machine learning algorithms: support vector machine, random forest, and boosted regression tree. Under each part, a summary of the findings is provided. For convenience of reference, some of the benefits and drawbacks discovered through literature reviews have been listed. Finally, future recommendations and overall conclusions based on research findings are given. This review focuses on papers from high-impact factor periodicals published over a 4 years period beginning in 2018 onwards. [ABSTRACT FROM AUTHOR]

Several machine learning-based methods are available in the literature to find anomalies in large log sequences. Recently, deep learning based solutions demonstrated promising performance in this domain. The majority of these methods formulate the problem as a classification task, where the final layer of the neural network model is a softmax layer. This paper presents a different, regression-based approach. The input of the model is a sequence of numeric vectors representing the semantic information of the log lines, and the output is also a numeric vector corresponding to the expected log line. To cope with the inherent uncertainty of log sequences, we introduce "Top-K" layers, allowing the model to emit multiple predictions, from which the best one is chosen. This feature, together with the "Top-K" loss function, makes it possible to develop an unsupervised, fully template-less model that can also handle log lines it has never seen during the training phase, which is essential for online applications. On benchmark data sets we demonstrate that the model achieves competitive performance. [ABSTRACT FROM AUTHOR]

3D point cloud registration related to rigid transformation is a fundamental yet crucial task in computer vision and graphics. For rigid registration, the local alignment of two-point clouds is equivalent to a global alignment. Since sufficient information exchange is an effective way to enhance mutual understanding, it is necessary to design a reasonable and sufficient feature interaction across two-point clouds to to obtain discriminative features and explore overlapping points. Recently, although a series of learning-based registration methods have been explored, most of the existing methods lack attention to multi-level feature interactions. In addition, there seems to be no paper that explicitly proposes a method for two-stage registration. However, intermediate constraints can be set in the two-stage registration to supervise the coarse registration and better refine the fine registration. To this end, this paper proposes a multi-level interaction perception method for two-stage partial-to-partial point cloud registration that can hierarchically capture discriminative structural features by the interaction of local details and global features from different dimensions, as well as improve the perception of locality in the early information exchange. Also, a spatial overlap-aware transformer is constructed to highlight the common regions while perceiving the global information of the point cloud. Thus, overlap constraints with high confidence between source and target point clouds can be obtained. The registration evaluation is performed on numerous partial 3D point clouds with Gaussian noise, and the results reveal that our method can achieve superior performance. [ABSTRACT FROM AUTHOR]

Visual odometry (VO) estimates the robot's current position based on feature matching or brightness variation between images, making it primarily suitable for well-lit environments with good image quality. Consequently, existing visual odometry methods exhibit degraded performance in low-light or highly dynamic environments, limiting their operational efficiency in outdoor settings. To overcome these challenges, research has been conducted to enhance low-light images to improve odometry performance. Recent advancements in deep learning have facilitated extensive research on image enhancement, including low-light conditions. Utilizing generative adversarial networks (GANs) and techniques like CycleGAN, researchers have achieved robust improvements in various lighting conditions and enhanced odometry performance in low-light environments. However, these methods are typically trained on single images, compromising the structural consistency between consecutive images. In this paper, we propose learning-based low-light image enhancement and the preservation of structural consistency between consecutive images for monocular visual odometry. The proposed model utilizes the CycleGAN approach for domain transformation between different illumination levels, effectively avoiding the failure of visual odometry in low-light environments. To handle diverse lighting conditions within images, a local discriminator is employed to enhance local brightness. Additionally, a structure loss is introduced using sequence images to ensure structural consistency between the original and generated images. This method simultaneously improves low-light conditions and preserves structural consistency, leading to enhanced visual odometry performance in low-light environments. [ABSTRACT FROM AUTHOR]

The existence of class imbalance in a dataset can greatly bias the classifier towards majority classification. This discrepancy can pose a serious problem for deep learning models, which require copious and diverse amounts of data to learn patterns and output classifications. Traditionally, data-level and algorithm-level techniques have been instrumental in mitigating the adverse effect of class imbalance. With the recent development and proliferation of Generative Adversarial Networks (GANs), researchers across a variety of disciplines have adapted the architecture of GANs and implemented them on imbalanced datasets to generate instances of the underrepresented class(es). Though the bulk of research has been centered on the application of this methodology in computer vision tasks, GANs are likewise being appropriated for use in tabular data, or data consisting of rows and columns with traditional structured data types. In this survey paper, we assess the methodology and efficacy of these modifications on tabular datasets, across domains such network traffic classification and financial transactions over the past seven years. We examine what methodologies and experimental factors have resulted in the greatest machine learning efficacy, as well as the research works and frameworks which have proven most influential in the development of the application of GANs in tabular data settings. Specifically, we note the prevalence of the CGAN architecture, the optimality of novel methods with CNN learners and minority-class sensitive measures such as F1 score, the popularity of SMOTE as a baseline technique, and the improved performance in the year-over-year use of GANs in imbalanced tabular datasets. [ABSTRACT FROM AUTHOR]

Mentorship in science is crucial for topic choice, career decisions, and the success of mentees and mentors. Typically, researchers who study mentorship use article co-authorship and doctoral dissertation datasets. However, available datasets of this type focus on narrow selections of fields and miss out on early career and non-publication-related interactions. Here, we describe Mentorship, a crowdsourced dataset of 743176 mentorship relationships among 738989 scientists primarily in biosciences that avoids these shortcomings. Our dataset enriches the Academic Family Tree project by adding publication data from the Microsoft Academic Graph and "semantic" representations of research using deep learning content analysis. Because gender and race have become critical dimensions when analyzing mentorship and disparities in science, we also provide estimations of these factors. We perform extensive validations of the profile–publication matching, semantic content, and demographic inferences, which mostly cover neuroscience and biomedical sciences. We anticipate this dataset will spur the study of mentorship in science and deepen our understanding of its role in scientists' career outcomes. Measurement(s) Semantics • Gender • Race Technology Type(s) unsupervised machine learning • supervised machine learning Factor Type(s) FirstName • FullName • MAGPaperID • DOI • PMID • TFIDFVector • SpecterVector • PID • NeighborPID • SpecterDistance • MiddleName • LastName • Institution • InstitutionMAGID • ResearchArea • ORCID • MAGAuthorID • MenteeID • MentorID • MentorshipType • StartYear • StopYear • gender • race • CID [ABSTRACT FROM AUTHOR]

Engineering and manufacturing processes and systems designs involve many challenges, such as dynamism, chaotic behaviours, and complexity. Of late, the arrival of big data, high computational speed, cloud computing and artificial intelligence techniques (like machine learning and deep learning) has reformed how many engineering and manufacturing professionals approach their work. These technologies offer thrilling innovative ways for engineers and manufacturers to tackle real-life challenges. On the other hand, the field of Artificial Intelligence (AI) is extensive. Several diverse theories, algorithms, and methods are available, which presents a challenge and a barrier in choosing the right AI technique for the appropriate engineering process or manufacturing process and environments. Besides, the pertinent literature is disseminated over various journals, conference proceedings, and research communities. Hence, conducting a systematic survey to scrutinise and classify the existing literature is worthwhile. However, it is challenging, but previous review studies have not adequately addressed AI's use and advancement in engineering and manufacturing (EM). Besides, some concentrated on single AI models, and others focused on a specific area in EM. This paper presents a comprehensive systematic review of studies on AI and its application in EM. To limit the scope of the current study, we conducted a keyword search in official publisher websites and academic databases, such as Springer, Elsevier, Scopus, Science Publication, Taylor & Francis, Directory of Open Access Journals (DOAJ), Association for Computing Machinery (ACM), Wiley online library, Inderscience and Google scholar. The search results (173 articles) were filtered according to a proposed framework, which resulted in ninety-one (91) relevant research articles. We reviewed the articles based on a proposed taxonomy (the year of publication, the AI algorithm and machine learning task adopted, the application area in EM, the train and test split of data, the error, and accuracy metrics used, the potential benefits). Our assessment using the proposed taxonomy gave a helpful insight into the literature's anatomy on various AI applications in engineering and manufacturing. Also, we identified opportunities for future research in AI application in the field of EM. [ABSTRACT FROM AUTHOR]

With the advancement of science and technology, coal-washing plants are transitioning to intelligent, information-based, and professional sorting systems. This shift accelerates the construction a modern economic system characterized by green and low-carbon development, thereby promoting the high-quality advancement of the coal industry. Traditional manual gangue picking and multi-axis robotic arm gangue selection currently suffer from low recognition accuracy, slow sorting efficiency, and high worker labor intensity. This paper proposes a deep learning-based, non-contact gangue recognition and pneumatic intelligent sorting system. The system constructs a dynamic database containing key feature information such as the target gangue's contour, quality, and center of mass. The system elucidates the relationships between ejection speed, mass, volume, angle of incidence, and the impact energy matching mechanism. Demonstration experiments using the system prototype for coal gangue sorting reveal that, compared to existing robotic arm sorting methods in coal washing plants, this system achieves a gangue identification accuracy exceeding 97%, a sorting rate above 91%, and a separation time of less than 3 s from identification to separation, thereby effectively enhancing raw coal purity. [ABSTRACT FROM AUTHOR]

The volume of data transferred across communication infrastructures has recently increased due to technological advancements in cloud computing, the Internet of Things (IoT), and automobile networks. The network systems transmit diverse and heterogeneous data in dispersed environments as communication technology develops. The communications using these networks and daily interactions depend on network security systems to provide secure and reliable information. On the other hand, attackers have increased their efforts to render systems on networks susceptible. An efficient intrusion detection system is essential since technological advancements embark on new kinds of attacks and security limitations. This paper implements a hybrid model for Intrusion Detection (ID) with Machine Learning (ML) and Deep Learning (DL) techniques to tackle these limitations. The proposed model makes use of Extreme Gradient Boosting (XGBoost) and convolutional neural networks (CNN) for feature extraction and then combines each of these with long short-term memory networks (LSTM) for classification. Four benchmark datasets CIC IDS 2017, UNSW NB15, NSL KDD, and WSN DS were used to train the model for binary and multi-class classification. With the increase in feature dimensions, current intrusion detection systems have trouble identifying new threats due to low test accuracy scores. To narrow down each dataset's feature space, XGBoost, and CNN feature selection algorithms are used in this work for each separate model. The experimental findings demonstrate a high detection rate and good accuracy with a relatively low False Acceptance Rate (FAR) to prove the usefulness of the proposed hybrid model. [ABSTRACT FROM AUTHOR]

Due to the large computational overhead, underutilization of features, and high bandwidth consumption in traditional SDN environments for DDoS attack detection and mitigation methods, this paper proposes a two-stage detection and mitigation method for DDoS attacks in SDN based on multi-dimensional characteristics. Firstly, an analysis of the traffic statistics from the SDN switch ports is performed, which aids in conducting a coarse-grained detection of DDoS attacks within the network. Subsequently, a Multi-Dimensional Deep Convolutional Classifier (MDDCC) is constructed using wavelet decomposition and convolutional neural networks to extract multi-dimensional characteristics from the traffic data passing through suspicious switches. Based on these extracted multi-dimensional characteristics, a simple classifier can be employed to accurately detect attack samples. Finally, by integrating graph theory with restrictive strategies, the source of attacks in SDN networks can be effectively traced and isolated. The experimental results indicate that the proposed method, which utilizes a minimal amount of statistical information, can quickly and accurately detect attacks within the SDN network. It demonstrates superior accuracy and generalization capabilities compared to traditional detection methods, especially when tested on both simulated and public datasets. Furthermore, by isolating the affected nodes, the method effectively mitigates the impact of the attacks, ensuring the normal transmission of legitimate traffic during network attacks. This approach not only enhances the detection capabilities but also provides a robust mechanism for containing the spread of cyber threats, thereby safeguarding the integrity and performance of the network. [ABSTRACT FROM AUTHOR]

Kolkata, renowned as the City of Joy, boasts a rich tapestry of cultural heritage spanning centuries. Despite the significance of its architectural marvels, accessing comprehensive visual documentation of Kolkata's heritage sites remains a challenge. In online searches, limited imagery often fails to provide a detailed understanding of these historical landmarks. To address this gap, this paper introduces MonuNet, a high-performance deep-learning network specifically designed for the classification of heritage images from Kolkata. The development of MonuNet addresses the critical need for efficient and accurate identification of Kolkata's architectural marvels, which are significant tangible cultural heritages. The dataset used to train MonuNet is organized by heritage sites, each category within the dataset represents distinct sites. It includes images from 13 prominent heritage sites in Kolkata. For each of these sites, there are 50 images, making it a structured collection where each category (heritage site) is equally represented. The proposed network utilizes a unique architecture incorporating a Dense channel attention module and a Parallel-spatial channel attention module to capture intricate architectural details and spatial relationships within the images. Experimental evaluations demonstrate the superior performance of MonuNet in classifying Kolkata heritage images with an accuracy of 89%, Precision of 87.77%, and Recall of 86.61%. The successful deployment of MonuNet holds significant implications for cultural preservation, tourism enhancement, and urban planning in Kolkata, aligning with the United Nations Sustainable Development Goals (SDGs) for sustainable city development. By providing a robust tool for the automatic identification and classification of heritage images, MonuNet promises to enrich online repositories with detailed visual documentation, thereby enhancing accessibility to Kolkata's cultural heritage for researchers, tourists, and urban planners alike. [ABSTRACT FROM AUTHOR]

Motivation: Retrosynthesis planning poses a formidable challenge in the organic chemical industry, particularly in pharmaceuticals. Single-step retrosynthesis prediction, a crucial step in the planning process, has witnessed a surge in interest in recent years due to advancements in AI for science. Various deep learning-based methods have been proposed for this task in recent years, incorporating diverse levels of additional chemical knowledge dependency. Results: This paper introduces UAlign, a template-free graph-to-sequence pipeline for retrosynthesis prediction. By combining graph neural networks and Transformers, our method can more effectively leverage the inherent graph structure of molecules. Based on the fact that the majority of molecule structures remain unchanged during a chemical reaction, we propose a simple yet effective SMILES alignment technique to facilitate the reuse of unchanged structures for reactant generation. Extensive experiments show that our method substantially outperforms state-of-the-art template-free and semi-template-based approaches. Importantly, our template-free method achieves effectiveness comparable to, or even surpasses, established powerful template-based methods. Scientific contribution: We present a novel graph-to-sequence template-free retrosynthesis prediction pipeline that overcomes the limitations of Transformer-based methods in molecular representation learning and insufficient utilization of chemical information. We propose an unsupervised learning mechanism for establishing product-atom correspondence with reactant SMILES tokens, achieving even better results than supervised SMILES alignment methods. Extensive experiments demonstrate that UAlign significantly outperforms state-of-the-art template-free methods and rivals or surpasses template-based approaches, with up to 5% (top-5) and 5.4% (top-10) increased accuracy over the strongest baseline. [ABSTRACT FROM AUTHOR]

Employing deep learning techniques for the semantic segmentation of remote sensing images has emerged as a prevalent approach for acquiring information about water bodies. Yet, current models frequently fall short in accurately extracting water bodies from high-resolution remote sensing images, as these images often present intricate details of terrestrial objects and complex backgrounds. Vegetation, shadows, and other objects close to water boundaries have increased similarity to water bodies. Moreover, water bodies in high-resolution images have different boundary complexities, shapes, and sizes. This situation makes it somewhat challenging to accurately distinguish water bodies in high-resolution images. To overcome these difficulties, this paper presents a novel network model named EU-Net, specifically designed to extract water bodies from high-resolution remote sensing images. The proposed EU-Net model, with U-net as the backbone network, incorporates improved residual connections and attention mechanisms, and designs multi-scale dilated convolution and multi-scale feature fusion modules to enhance water body extraction performance in complex scenarios. Specifically, in the proposed model, improved residual connections are introduced to enable the learning of more complex features; the attention mechanism is employed to improve the model's discriminative ability by focusing on important channels and spatial areas. The implemented multi-scale dilated convolution technique enhances the model's receptive field while maintaining the same number of parameters. The designed multi-scale feature fusion module is capable of processing both small-scale details and large-scale structures in images, while simultaneously modeling the spatial context relationships of features at different scales. Experimental results validate the superior performance of EU-Net in accurately identifying water bodies from high-resolution remote sensing images, outperforming current models in terms of water extraction accuracy. [ABSTRACT FROM AUTHOR]

Hepatitis C virus (HCV) is a major global health concern, affecting millions of individuals worldwide. While existing literature predominantly focuses on disease classification using clinical data, there exists a critical research gap concerning HCV genotyping based on genomic sequences. Accurate HCV genotyping is essential for patient management and treatment decisions. While the neural models excel at capturing complex patterns, they still face challenges, such as data scarcity, that exist a lot in computational genomics. To overcome this challenges, this paper introduces an advanced deep learning approach for HCV genotyping based on the graphical representation of nucleotide sequences that outperforms classical approaches. Notably, it is effective for both partial and complete HCV genomes and addresses challenges associated with imbalanced datasets. In this work, ten HCV genotypes: 1a, 1b, 2a, 2b, 2c, 3a, 3b, 4, 5, and 6 were used in the analysis. This study utilizes Chaos Game Representation for 2D mapping of genomic sequences, employing self-supervised learning using convolutional autoencoder for deep feature extraction, resulting in an outstanding performance for HCV genotyping compared to various machine learning and deep learning models. This baseline provides a benchmark against which the performance of the proposed approach and other models can be evaluated. The experimental results showcase a remarkable classification accuracy of over 99%, outperforming traditional deep learning models. This performance demonstrates the capability of the proposed model to accurately identify HCV genotypes in both partial and complete sequences and in dealing with data scarcity for certain genotypes. The results of the proposed model are compared to NCBI genotyping tool. [ABSTRACT FROM AUTHOR]

Water conservation has become a global problem as the population increases. In many densely populated cities in China, leaks from century-old pipe works have been widespread. However, entirely eradicating the issues involves replacing all water networks, which is costly and time-consuming. This paper proposed an AI-enabled water-saving control system with three control modes: time division control, flow regulation, and critical point control according to actual flow. Firstly, based on the current leaking situation of water supply networks in China and the capability level of China's water management, a water-saving technology integrating PID control and a series of deep learning algorithms was proposed. Secondly, a multi-jet control valve was designed to control pressure and reduce water distribution network cavitation. This technology has been successfully applied in industrial settings in China and has achieved gratifying water-saving results. [ABSTRACT FROM AUTHOR]

The hippocampus is a critical component of the brain and is associated with many neurological disorders. It can be further subdivided into several subfields, and accurate segmentation of these subfields is of great significance for diagnosis and research. However, the structures of hippocampal subfields are irregular and have complex boundaries, and their voxel values are close to surrounding brain tissues, making the segmentation task highly challenging. Currently, many automatic segmentation tools exist for hippocampal subfield segmentation, but they suffer from high time costs and low segmentation accuracy. In this paper, we propose a new dual-branch segmentation network structure (DSnet) based on deep learning for hippocampal subfield segmentation. While traditional convolutional neural network-based methods are effective in capturing hierarchical structures, they struggle to establish long-term dependencies. The DSnet integrates the Transformer architecture and a hybrid attention mechanism, enhancing the network's global perceptual capabilities. Moreover, the dual-branch structure of DSnet leverages the segmentation results of the hippocampal region to facilitate the segmentation of its subfields. We validate the efficacy of our algorithm on the public Kulaga-Yoskovitz dataset. Experimental results indicate that our method is more effective in segmenting hippocampal subfields than conventional single-branch network structures. Compared to the classic 3D U-Net, our proposed DSnet improves the average Dice accuracy of hippocampal subfield segmentation by 0.57%. [ABSTRACT FROM AUTHOR]

Early detection of the adenocarcinoma cancer in colon tissue by means of explainable deep learning, by classifying histological images and providing visual explainability on model prediction. Considering that in recent years, deep learning techniques have emerged as powerful techniques in medical image analysis, offering unprecedented accuracy and efficiency, in this paper we propose a method to automatically detect the presence of cancerous cells in colon tissue images. Various deep learning architectures are considered, with the aim of considering the best one in terms of quantitative and qualitative results. As a matter of fact, we consider qualitative results by taking into account the so-called prediction explainability, by providing a way to highlight on the tissue images the areas that from the model point of view are related to the presence of colon cancer. The experimental analysis, performed on 10,000 colon issue images, showed the effectiveness of the proposed method by obtaining an accuracy equal to 0.99. The experimental analysis shows that the proposed method can be successfully exploited for colon cancer detection and localisation from tissue images. [ABSTRACT FROM AUTHOR]

Alzheimer's disease (AD), the predominant form of dementia, is a growing global challenge, emphasizing the urgent need for accurate and early diagnosis. Current clinical diagnoses rely on radiologist expert interpretation, which is prone to human error. Deep learning has thus far shown promise for early AD diagnosis. However, existing methods often overlook focal structural atrophy critical for enhanced understanding of the cerebral cortex neurodegeneration. This paper proposes a deep learning framework that includes a novel structure-focused neurodegeneration CNN architecture named SNeurodCNN and an image brightness enhancement preprocessor using gamma correction. The SNeurodCNN architecture takes as input the focal structural atrophy features resulting from segmentation of brain structures captured through magnetic resonance imaging (MRI). As a result, the architecture considers only necessary CNN components, which comprises of two downsampling convolutional blocks and two fully connected layers, for achieving the desired classification task, and utilises regularisation techniques to regularise learnable parameters. Leveraging mid-sagittal and para-sagittal brain image viewpoints from the Alzheimer's disease neuroimaging initiative (ADNI) dataset, our framework demonstrated exceptional performance. The para-sagittal viewpoint achieved 97.8% accuracy, 97.0% specificity, and 98.5% sensitivity, while the mid-sagittal viewpoint offered deeper insights with 98.1% accuracy, 97.2% specificity, and 99.0% sensitivity. Model analysis revealed the ability of SNeurodCNN to capture the structural dynamics of mild cognitive impairment (MCI) and AD in the frontal lobe, occipital lobe, cerebellum, temporal, and parietal lobe, suggesting its potential as a brain structural change digi-biomarker for early AD diagnosis. This work can be reproduced using code we made available on GitHub. [ABSTRACT FROM AUTHOR]

Blinding eye diseases are often related to changes in retinal structure, which can be detected by analysing retinal blood vessels in fundus images. However, existing techniques struggle to accurately segment these delicate vessels. Although deep learning has shown promise in medical image segmentation, its reliance on specific operations can limit its ability to capture crucial details such as the edges of the vessel. This paper introduces LMBiS-Net, a lightweight convolutional neural network designed for the segmentation of retinal vessels. LMBiS-Net achieves exceptional performance with a remarkably low number of learnable parameters (only 0.172 million). The network used multipath feature extraction blocks and incorporates bidirectional skip connections for the information flow between the encoder and decoder. In addition, we have optimised the efficiency of the model by carefully selecting the number of filters to avoid filter overlap. This optimisation significantly reduces training time and improves computational efficiency. To assess LMBiS-Net's robustness and ability to generalise to unseen data, we conducted comprehensive evaluations on four publicly available datasets: DRIVE, STARE, CHASE_DB1, and HRF The proposed LMBiS-Net achieves significant performance metrics in various datasets. It obtains sensitivity values of 83.60%, 84.37%, 86.05%, and 83.48%, specificity values of 98.83%, 98.77%, 98.96%, and 98.77%, accuracy (acc) scores of 97.08%, 97.69%, 97.75%, and 96.90%, and AUC values of 98.80%, 98.82%, 98.71%, and 88.77% on the DRIVE, STARE, CHEASE_DB, and HRF datasets, respectively. In addition, it records F1 scores of 83.43%, 84.44%, 83.54%, and 78.73% on the same datasets. Our evaluations demonstrate that LMBiS-Net achieves high segmentation accuracy (acc) while exhibiting both robustness and generalisability across various retinal image datasets. This combination of qualities makes LMBiS-Net a promising tool for various clinical applications. [ABSTRACT FROM AUTHOR]

Depth maps produced by consumer-grade sensors suffer from inaccurate measurements and missing data from either system or scene-specific sources. Data-driven denoising algorithms can mitigate such problems; however, they require vast amounts of ground truth depth data. Recent research has tackled this limitation using self-supervised learning techniques, but it requires multiple RGB-D sensors. Moreover, most existing approaches focus on denoising single isolated depth maps or specific subjects of interest highlighting a need for methods that can effectively denoise depth maps in real-time dynamic environments. This paper extends state-of-the-art approaches for depth-denoising commodity depth devices, proposing SelfReDepth, a self-supervised deep learning technique for depth restoration, via denoising and hole-filling by inpainting of full-depth maps captured with RGB-D sensors. The algorithm targets depth data in video streams, utilizing multiple sequential depth frames coupled with color data to achieve high-quality depth videos with temporal coherence. Finally, SelfReDepth is designed to be compatible with various RGB-D sensors and usable in real-time scenarios as a pre-processing step before applying other depth-dependent algorithms. Our results demonstrate our approach’s real-time performance on real-world datasets shows that it outperforms state-of-the-art methods in denoising and restoration performance at over 30 fps on Commercial Depth Cameras, with potential benefits for augmented and mixed-reality applications. [ABSTRACT FROM AUTHOR]

Spatio-temporal feature extraction and fusion are crucial to traffic prediction accuracy. However, the complicated spatio-temporal correlations and dependencies between traffic nodes make the problem quite challenging. In this paper, a multi-scale spatio-temporal network (MSSTN) is proposed to exploit complicated local and nonlocal correlations in traffic flow for traffic prediction. In the proposed method, a convolutional neural network, a self-attention module, and a graph convolution network (GCN) are integrated to extract and fuse multi-scale temporal and spatial features to make predictions. Specifically, a self-adaption temporal convolutional neural network (SATCN) is first employed to extract local temporal correlations between adjacent time slices. Furthermore, a self-attention module is applied to capture the long-range nonlocal traffic dependence in the temporal dimension and fuse it with the local features. Then, a graph convolutional network module is utilized to learn spatio-temporal features of the traffic flow to exploit the mutual dependencies between traffic nodes. Experimental results on public traffic datasets demonstrate the superiority of our method over compared state-of-the-art methods. The ablation experiments confirm the effectiveness of each component of the proposed model. Our implementation on Pytorch is publicly available at https://github.com/csust-sonie/MSSTN. [ABSTRACT FROM AUTHOR]

With the intensification of ocean exploration and development in recent years, the navigation equipment in the marine environment has become increasingly diversified, making the marine environment more complex. Traditional methods for underwater target recognition are gradually becoming less applicable and unable to achieve better results. With the application of deep learning in underwater target recognition, the robustness of deep learning models used for underwater target recognition is crucial due to the significant environmental interference in underwater target data and the susceptibility of deep learning models to adversarial samples. This paper proposes an error sample feature compensation method for improving the robustness of deep learning models for underwater target recognition, focusing on the problem of the significant impact of sample data quality on the robustness of deep learning models for underwater target recognition. The method innovatively divides error samples into difficult-to-improve samples and easy-to-improve samples and proposes an adversarial training method combined with classification conditions. At the same time, the method uses a weighted index of model accuracy to combine adversarial training models with feature compensation methods, further improving the robustness of deep learning models for underwater target recognition tasks. Finally, the method is validated on an underwater dataset, and the results show that the proposed method improves the robustness of deep learning models used for underwater target recognition. [ABSTRACT FROM AUTHOR]

Global Navigation Satellite Systems (GNSS)-based positioning plays a crucial role in various applications, including navigation, transportation, logistics, mapping, and emergency services. Traditional GNSS positioning methods are model-based, utilizing satellite geometry and the known properties of satellite signals. However, model-based methods have limitations in challenging environments and often lack adaptability to uncertain noise models. This paper highlights recent advances in machine learning (ML) and its potential to address these limitations. It covers a broad range of ML methods, including supervised learning, unsupervised learning, deep learning, and hybrid approaches. The survey provides insights into positioning applications related to GNSS, such as signal analysis, anomaly detection, multi-sensor integration, prediction, and accuracy enhancement using ML. It discusses the strengths, limitations, and challenges of current ML-based approaches for GNSS positioning, providing a comprehensive overview of the field. [ABSTRACT FROM AUTHOR]

Radio frequency fingerprint identification (RFFI) can distinguish highly similar wireless communication devices to protect physical layer security and improve the security of wireless networks effectively, which has been widely used for spectrum management and physical layer secure communication. However, most RFFI methods show a degradation of performance under low signal-to-noise ratio (SNR) environments. In this paper, we propose a RSBU-LSTM network relying on multiple features to improve the identification accuracy with low SNR. Firstly, we use multiple features of in-phase (I), quadrature (Q), and phase as inputs. Then, we use multiple Residual Shrinkage Building Units (RSBUs) to extract the correlation features within the cycle of signals and preserve as many features as possible in low SNR environments. Finally, we use the long short-term memory (LSTM) to extract the relevant features of the signals of non-adjacent cycles. The experimental results show that the proposed network can effectively complete RFFI in low SNR environments and show better performance than other models used for comparison. [ABSTRACT FROM AUTHOR]

Technology offers a lot of potential that is being used to improve the integrity and efficiency of infrastructures. Crack is one of the major concerns that can affect the integrity or usability of any structure. Oftentimes, the use of manual inspection methods leads to delays which can worsen the situation. Automated crack detection has become very necessary for efficient management and inspection of critical infrastructures. Previous research in crack detection employed classification and localization-based models using Deep Convolutional Neural Networks (DCNNs). This study suggests and compares the effectiveness of transfer learned DCNNs for crack detection as a classification model and as a feature extractor to overcome this restriction. The main objective of this paper is to present various methods of crack detection on surfaces and compare their performance over 3 different datasets. Experiments conducted in this work are threefold: initially, the effectiveness of 12 transfer learned DCNN models for crack detection is analyzed on three publicly available datasets: SDNET, CCIC and BSD. With an accuracy of 53.40%, ResNet101 outperformed other models on the SDNET dataset. EfficientNetB0 was the most accurate (98.8%) model on the BSD dataset, and ResNet50 performed better with an accuracy of 99.8% on the CCIC dataset. Secondly, two image enhancement methods are employed to enhance the images and are transferred learned on the 12 DCNNs in pursuance of improving the performance of the SDNET dataset. The results from the experiments show that the enhanced images improved the accuracy of transfer-learned crack detection models significantly. Furthermore, deep features extracted from the last fully connected layer of the DCNNs are used to train the Support Vector Machine (SVM). The integration of deep features with SVM enhanced the detection accuracy across all the DCNN-dataset combinations, according to analysis in terms of accuracy, precision, recall, and F1-score. [ABSTRACT FROM AUTHOR]

This paper proposes an innovative global solution which is a pioneering work applying automated machine learning algorithms to remarkable precision sparse underwater direction-of-arrival (DOA) estimation that views the subaquatic sparse-sampling DOA estimation problem as a classification prediction task. The proposed solution, termed automated multi-layer perceptron discriminative neural network (AutoMPDNN), is built upon a Bayesian optimization framework. AutoMPDNN transforms sparsely sampled time-domain signals into the complex domain, preserving essential components in a one-source single-snapshot scenario. Leveraging Bayesian optimization principles, the algorithm embeds necessary hyperparameters into the loss function, effectively defining it as a maximum likelihood problem using the upper confidence bound function and incorporating sparse signal features. We also explore the model space architecture and introduce variants of AutoMPDNN, denoted as AutoMPDNNs_ln (n = 2,3,4). Through a series of plane wave simulation experiments, it is demonstrated that AutoMPDNN achieves the highest prediction performance for one-source single-snapshot scenarios compared to classical DOA estimation algorithms that incorporate sparse representation approaches, as well as contemporary deep learning DOA methods under varying conditions. [ABSTRACT FROM AUTHOR]

While deep learning technologies have made remarkable progress in generating deepfakes, their misuse has become a well-known concern. As a result, the ubiquitous usage of deepfakes for increasing false information poses significant risks to the security and privacy of individuals. The primary objective of audio spoofing detection is to identify audio generated through numerous AI-based techniques. Several techniques for fake audio detection already exist using machine learning algorithms. However, they lack generalization and may not identify all types of AI-synthesized audios such as replay attacks, voice conversion, and text-to-speech (TTS). In this paper, a deep layered model, i.e., VGGish, along with an attention block, namely Convolutional Block Attention Module (CBAM) for spoofing detection, is introduced. Our suggested model successfully classifies input audio into two classes: Fake and Real, converting them into mel-spectrograms, and extracting their most representative features due to the attention block. Our model is a significant technique to utilize for audio spoofing detection due to a simple layered architecture. It captures complex relationships in audio signals due to both spatial and channel features present in an attention module. To evaluate the effectiveness of our model, we have conducted in-depth testing using the ASVspoof 2019 dataset. The proposed technique achieved an EER of 0.52% for Physical Access (PA) attacks and 0.07 % for Logical Access (LA) attacks. [ABSTRACT FROM AUTHOR]

Automated medical image analysis systems often require large amounts of training data with high quality labels, which are difficult and time consuming to generate. This paper introduces Radiology Object in COntext version 2 (ROCOv2), a multimodal dataset consisting of radiological images and associated medical concepts and captions extracted from the PMC Open Access subset. It is an updated version of the ROCO dataset published in 2018, and adds 35,705 new images added to PMC since 2018. It further provides manually curated concepts for imaging modalities with additional anatomical and directional concepts for X-rays. The dataset consists of 79,789 images and has been used, with minor modifications, in the concept detection and caption prediction tasks of ImageCLEFmedical Caption 2023. The dataset is suitable for training image annotation models based on image-caption pairs, or for multi-label image classification using Unified Medical Language System (UMLS) concepts provided with each image. In addition, it can serve for pre-training of medical domain models, and evaluation of deep learning models for multi-task learning. [ABSTRACT FROM AUTHOR]

Gossen's First Law describes the law of diminishing marginal utility. This paper aims to further verify the proposed hypothesis that Gossen's First Law also holds in the modeling for Demand Side Management (DSM) with a thorough heat pump case study. The proposed hypothesis states that in general the complexity-utility relationship in the field of DSM modeling could be represented by a diminishing marginal utility curve. On the other hand, in data based modeling, when utilizing a large dataset for validation, the data integrity is critical to the reliability of the results. However, the absence of partial time series data may occur during the measurement due to missing sensors or IT related issues. In this work, an extensive real-world open dataset of a ground source heat pump is utilized for the case study. In the raw data, one key variable namely the flow rate is missing. Thus, three different algorithms based on machine learning and deep learning architectures namely Random Forest (RF), Long Short-Term Memory (LSTM) and Transformer are applied to predict the flow rate by utilizing an open loop forecasting. The raw data are first pre-processed with a time interval of one hour and then used for training, validation and forecast. Furthermore, a modified persistence model as the baseline is also defined. The predicted flow rate using LSTM yields the lowest error of 7.47 % nMAE and 10.56 % nRMSE respectively. The forecast results are then utilized in the following step of modeling of a heat pump use case. With the introduced quantification method for complexity and a modified version for utility, we further verify the proposed hypothesis with a longer time horizon of 7 days. [ABSTRACT FROM AUTHOR]

Audio classification related to military activities is a challenging task due to the high levels of background noise and the lack of suitable and publicly available datasets. To bridge this gap, this paper constructs and introduces a new military audio dataset, named MAD, which is suitable for training and evaluating audio classification systems. The proposed MAD dataset is extracted from various military videos and contains 8,075 sound samples from 7 classes corresponding to approximately 12 hours, exhibiting distinctive characteristics not presented in academic datasets typically used for machine learning research. We present a comprehensive description of the dataset, including its acoustic statistics and examples. We further conduct a comprehensive sound classification study of various deep learning algorithms on the MAD dataset. We are also releasing the source code to make it easy to build these systems. The presented dataset will be a valuable resource for evaluating the performance of existing algorithms and for advancing research in the field of acoustic-based hazardous situation surveillance systems. [ABSTRACT FROM AUTHOR]

This research paper presents a comprehensive investigation into the utilization of color image processing technologies and deep learning algorithms in the development of a robot vision system specifically designed for 8-ball billiards. The sport of billiards, with its various games and ball arrangements, presents unique challenges for robotic vision systems. The proposed methodology addresses these challenges through two main components: object detection and ball pattern recognition. Initially, a robust algorithm is employed to detect the billiard balls using color space transformation and thresholding techniques. This is followed by determining the position of the billiard table through strategic cropping and isolation of the primary table area. The crucial phase involves the intricate task of recognizing ball patterns to differentiate between solid and striped balls. To achieve this, a modified convolutional neural network is utilized, leveraging the Xception network optimized by an innovative algorithm known as the Improved Chaos African Vulture Optimization (ICAVO) algorithm. The ICAVO algorithm enhances the Xception network's performance by efficiently exploring the solution space and avoiding local optima. The results of this study demonstrate a significant enhancement in recognition accuracy, with the Xception/ICAVO model achieving remarkable recognition rates for both solid and striped balls. This paves the way for the development of more sophisticated and efficient billiards robots. The implications of this research extend beyond 8-ball billiards, highlighting the potential for advanced robotic vision systems in various applications. The successful integration of color image processing, deep learning, and optimization algorithms shows the effectiveness of the proposed methodology. This research has far-reaching implications that go beyond just billiards. The cutting-edge robotic vision technology can be utilized for detecting and tracking objects in different sectors, transforming industrial automation and surveillance setups. By combining color image processing, deep learning, and optimization algorithms, the system proves its effectiveness and flexibility. The innovative approach sets the stage for creating advanced and productive robotic vision systems in various industries. [ABSTRACT FROM AUTHOR]

In the globalization trend, China's cultural heritage is in danger of gradually disappearing. The protection and inheritance of these precious cultural resources has become a critical task. This paper focuses on the Miao batik culture in Guizhou Province, China, and explores the application of knowledge graphs, natural language processing, and deep learning techniques in the promotion and protection of batik culture. We propose a dual-channel mechanism that integrates semantic and visual information, aiming to connect batik pattern features with cultural connotations. First, we use natural language processing techniques to automatically extract batik-related entities and relationships from the literature, and construct and visualize a structured batik pattern knowledge graph. Based on this knowledge graph, users can textually search and understand the images, meanings, taboos, and other cultural information of specific patterns. Second, for the batik pattern classification, we propose an improved ResNet34 model. By embedding average pooling and convolutional operations into the residual blocks and introducing long-range residual connections, the classification performance is enhanced. By inputting pattern images into this model, their categories can be accurately identified, and then the underlying cultural connotations can be understood. Experimental results show that our model outperforms other mainstream models in evaluation metrics such as accuracy, precision, recall, and F1-score, achieving 94.46%, 94.47%, 93.62%, and 93.8%, respectively. This research provides new ideas for the digital protection of batik culture and demonstrates the great potential of artificial intelligence technology in cultural heritage protection. [ABSTRACT FROM AUTHOR]

Accurate power load forecasting is crucial for the sustainable operation of smart grids. However, the complexity and uncertainty of load, along with the large-scale and high-dimensional energy information, present challenges in handling intricate dynamic features and long-term dependencies. This paper proposes a computational approach to address these challenges in short-term power load forecasting and energy information management, with the goal of accurately predicting future load demand. The study introduces a hybrid method that combines multiple deep learning models, the Gated Recurrent Unit (GRU) is employed to capture long-term dependencies in time series data, while the Temporal Convolutional Network (TCN) efficiently learns patterns and features in load data. Additionally, the attention mechanism is incorporated to automatically focus on the input components most relevant to the load prediction task, further enhancing model performance. According to the experimental evaluation conducted on four public datasets, including GEFCom2014, the proposed algorithm outperforms the baseline models on various metrics such as prediction accuracy, efficiency, and stability. Notably, on the GEFCom2014 dataset, FLOP is reduced by over 48.8%, inference time is shortened by more than 46.7%, and MAPE is improved by 39%. The proposed method significantly enhances the reliability, stability, and cost-effectiveness of smart grids, which facilitates risk assessment optimization and operational planning under the context of information management for smart grid systems. [ABSTRACT FROM AUTHOR]

Over the past decades, the software industry has expanded to include all industries. Since stakeholders tend to use it to get their work done, software houses seek to estimate the cost of the software, which includes calculating the effort, time, and resources required. Although many researchers have worked to estimate it, the prediction accuracy results are still inaccurate and unstable. Estimating it requires a lot of effort. Therefore, there is an urgent need for modern techniques that contribute to cost estimation. This paper seeks to present a model based on deep learning and machine learning techniques by combining convolutional neural networks (CNN) and the particle swarm algorithm (PSO) in the context of time series forecasting, which enables feature extraction and automatic tuning of hyperparameters, which reduces the manual effort of selecting parameters and contributes to fine-tuning. The use of PSO also enhances the robustness and generalization ability of the CNN model and its iterative nature allows for efficient discovery of hyperparameter similarity. The model was trained and tested on 13 different benchmark datasets and evaluated through six metrics: mean absolute error (MAE), mean square error (MSE), mean magnitude relative error (MMRE), root mean square error (RMSE), median magnitude relative error (MdMRE), and prediction accuracy (PRED). Comparative results reveal that the performance of the proposed model is better than other methods for all datasets and evaluation criteria. The results were very promising for predicting software cost estimation. [ABSTRACT FROM AUTHOR]

As an important renewable resource, wood is widely used in various industries. When addressing wood defects that limit the amount of wood used during processing, manual inspection and other technologies are not suitable for automated production scenarios. In this paper, we first establish our own dataset, which includes information about multiple tree species and multiple defects types, to enhance the overall applicability of the proposed model. Second, target detection technology involving deep learning is used for defect detection. The conditional parametric convolution (CondConv), Wise-IoU, and BiFormer modules are used to improve upon the latest YOLOv8 algorithm. Based on the experimental findings, the suggested approach exhibits notable improvements in terms of both the mAP@0.5 index and the mAP@0.5:0.95 index, surpassing the performance of the YOLOv8 algorithm by 3.5% and 5.8%, respectively. It also has advantages over other target detection algorithms. The proposed method can effectively improve wood utilization and automated wood processing technology. [ABSTRACT FROM AUTHOR]

Twitter is a powerful platform for communication and information sharing but is also susceptible to spreading false information. This false information has adverse consequences for society and can significantly impact public perception, decision-making, and political outcomes. Therefore, there is an urgent need to build a fake news detection system that can accurately catch false information before it is disseminated. Building such a system requires the existence of good quality and trustworthy labeled datasets. The limitations of the existing datasets are undeniable. Most of them are not updated to reflect the advanced generation patterns of the new fake news creators. Thanks to Truth Seeker research team, who offered a large-scale fake news dataset that was labeled based on Amazon Mechanical Turk. The dataset was collected between 2009 and 2022 and then validated according to a robust procedure to ensure its quality and reliability. However, the credibility and trustability of this dataset is still questionable. In this paper, we study and analyze the feasibility of building a fake news detection model based on deep learning using Truth seeker dataset. Mainly we investigated the impact of different text representation techniques on the accuracy of deep learning models. Also, we investigated the importance of hand-crafted features associated with the dataset in the final results. The results have shown that using truth seeker dataset show potential to help social media platforms in detecting fake news. on the other hand, using deep contextualized text representation produced more accurate results compared to word2vec and TF-IDF techniques. The impact of hand-crafted features on the final performance of deep learning models is often negligible, and it is suggested to be excluded from the final models. [ABSTRACT FROM AUTHOR]

The precise reconstruction of properties of photons and electrons in modern high energy physics detectors, such as the CMS or ATLAS experiments, plays a crucial role in numerous physics results. Conventional geometrical algorithms are used to reconstruct the energy and position of these particles from the showers they induce in the electromagnetic calorimeter. Despite their accuracy and efficiency, these methods still suffer from several limitations, such as low-energy background and limited capacity to reconstruct close-by particles. This paper introduces an innovative machine-learning technique to measure the energy and position of photons and electrons based on convolutional and graph neural networks, taking the geometry of the CMS electromagnetic calorimeter as an example. The developed network demonstrates a significant improvement in resolution both for photon energy and position predictions compared to the algorithm used in CMS. Notably, one of the main advantages of this new approach is its ability to better distinguish between multiple close-by electromagnetic showers. [ABSTRACT FROM AUTHOR]