Search

Neural language representation models such as GPT, pre-trained on large-scale corpora, can effectively capture rich semantic patterns from plain text and be fine-tuned to consistently improve natural language generation performance. However, existing pre-trained language models used to generate lyrics rarely consider rhyme information, which is crucial in lyrics. Using a pre-trained model directly results in poor performance. To enhance the rhyming quality of generated lyrics, we incorporate integrated rhyme information into our model, thereby improving lyric generation performance.

Sparse query-based paradigms have achieved significant success in multi-view 3D detection for autonomous vehicles. Current research faces challenges in balancing between enlarging receptive fields and reducing interference when aggregating multi-view features. Moreover, different poses of cameras present challenges in training global attention models. To address these problems, this paper proposes a divided view method, in which features are modeled globally via the visibility crossattention mechanism, but interact only with partial features in a divided local virtual space. This effectively reduces interference from other irrelevant features and alleviates the training difficulties of the transformer by decoupling the position embedding from camera poses. Additionally, 2D historical RoI features are incorporated into the object-centric temporal modeling to utilize highlevel visual semantic information. The model is trained using a one-to-many assignment strategy to facilitate stability. Our framework, named DVPE, achieves state-of-the-art performance (57.2% mAP and 64.5% NDS) on the nuScenes test set. Codes will be available at https://github.com/dop0/DVPE.

This research aims to explore the application of deep learning in autonomous driving computer vision technology and its impact on improving system performance. By using advanced technologies such as convolutional neural networks (CNN), multi-task joint learning methods, and deep reinforcement learning, this article analyzes in detail the application of deep learning in image recognition, real-time target tracking and classification, environment perception and decision support, and path planning and navigation. Application process in key areas. Research results show that the proposed system has an accuracy of over 98% in image recognition, target tracking and classification, and also demonstrates efficient performance and practicality in environmental perception and decision support, path planning and navigation. The conclusion points out that deep learning technology can significantly improve the accuracy and real-time response capabilities of autonomous driving systems. Although there are still challenges in environmental perception and decision support, with the advancement of technology, it is expected to achieve wider applications and greater capabilities in the future. potential.

Generative Adversarial Networks (GANs) have significantly advanced image processing, with Pix2Pix being a notable framework for image-to-image translation. This paper explores a novel application of Pix2Pix to transform abstract map images into realistic ground truth images, addressing the scarcity of such images crucial for domains like urban planning and autonomous vehicle training. We detail the Pix2Pix model's utilization for generating high-fidelity datasets, supported by a dataset of paired map and aerial images, and enhanced by a tailored training regimen. The results demonstrate the model's capability to accurately render complex urban features, establishing its efficacy and potential for broad real-world applications.

In this paper, a tool for detecting LLM AI text generation is developed based on the Transformer model, aiming to improve the accuracy of AI text generation detection and provide reference for subsequent research. Firstly the text is Unicode normalised, converted to lowercase form, characters other than non-alphabetic characters and punctuation marks are removed by regular expressions, spaces are added around punctuation marks, first and last spaces are removed, consecutive ellipses are replaced with single spaces and the text is connected using the specified delimiter. Next remove non-alphabetic characters and extra whitespace characters, replace multiple consecutive whitespace characters with a single space and again convert to lowercase form. The deep learning model combines layers such as LSTM, Transformer and CNN for text classification or sequence labelling tasks. The training and validation sets show that the model loss decreases from 0.127 to 0.005 and accuracy increases from 94.96 to 99.8, indicating that the model has good detection and classification ability for AI generated text. The test set confusion matrix and accuracy show that the model has 99% prediction accuracy for AI-generated text, with a precision of 0.99, a recall of 1, and an f1 score of 0.99, achieving a very high classification accuracy. Looking forward, it has the prospect of wide application in the field of AI text detection., Comment: 6 pages

Change detection is a fundamental task in computer vision that processes a bi-temporal image pair to differentiate between semantically altered and unaltered regions. Large language models (LLMs) have been utilized in various domains for their exceptional feature extraction capabilities and have shown promise in numerous downstream applications. In this study, we harness the power of a pre-trained LLM, extracting feature maps from extensive datasets, and employ an auxiliary network to detect changes. Unlike existing LLM-based change detection methods that solely focus on deriving high-quality feature maps, our approach emphasizes the manipulation of these feature maps to enhance semantic relevance., Comment: This version is not our full version based on our new progress, related data, and methodology we are dealing with, and based on the rules and the laws, we are adjusting our current version

This study conducts a thorough examination of malware detection using machine learning techniques, focusing on the evaluation of various classification models using the Mal-API-2019 dataset. The aim is to advance cybersecurity capabilities by identifying and mitigating threats more effectively. Both ensemble and non-ensemble machine learning methods, such as Random Forest, XGBoost, K Nearest Neighbor (KNN), and Neural Networks, are explored. Special emphasis is placed on the importance of data pre-processing techniques, particularly TF-IDF representation and Principal Component Analysis, in improving model performance. Results indicate that ensemble methods, particularly Random Forest and XGBoost, exhibit superior accuracy, precision, and recall compared to others, highlighting their effectiveness in malware detection. The paper also discusses limitations and potential future directions, emphasizing the need for continuous adaptation to address the evolving nature of malware. This research contributes to ongoing discussions in cybersecurity and provides practical insights for developing more robust malware detection systems in the digital era.

Open-world object detection (OWOD) is a challenging problem that combines object detection with incremental learning and open-set learning. Compared to standard object detection, the OWOD setting is task to: 1) detect objects seen during training while identifying unseen classes, and 2) incrementally learn the knowledge of the identified unknown objects when the corresponding annotations is available. We propose a novel and efficient OWOD solution from a prototype perspective, which we call OCPL: Open-world object detection via discriminative Class Prototype Learning, which consists of a Proposal Embedding Aggregator (PEA), an Embedding Space Compressor (ESC) and a Cosine Similarity-based Classifier (CSC). All our proposed modules aim to learn the discriminative embeddings of known classes in the feature space to minimize the overlapping distributions of known and unknown classes, which is beneficial to differentiate known and unknown classes. Extensive experiments performed on PASCAL VOC and MS-COCO benchmark demonstrate the effectiveness of our proposed method., Comment: 4 pages, 3 figures, ICIP2022

Numerous sleep disorders are characterised by movement during sleep, these include rapid-eye movement sleep behaviour disorder (RBD) and periodic limb movement disorder. The process of diagnosing movement related sleep disorders requires laborious and time-consuming visual analysis of sleep recordings. This process involves sleep clinicians visually inspecting electromyogram (EMG) signals to identify abnormal movements. The distribution of characteristics that represent movement can be diverse and varied, ranging from brief moments of tensing to violent outbursts. This study proposes a framework for automated limb-movement detection by fusing data from two EMG sensors (from the left and right limb) through a Dirichlet process mixture model. Several features are extracted from 10 second mini-epochs, where each mini-epoch has been classified as 'leg-movement' or 'no leg-movement' based on annotations of movement from sleep clinicians. The distributions of the features from each category can be estimated accurately using Gaussian mixture models with the Dirichlet process as a prior. The available dataset includes 36 participants that have all been diagnosed with RBD. The performance of this framework was evaluated by a 10-fold cross validation scheme (participant independent). The study was compared to a random forest model and outperformed it with a mean accuracy, sensitivity, and specificity of 94\%, 48\%, and 95\%, respectively. These results demonstrate the ability of this framework to automate the detection of limb movement for the potential application of assisting clinical diagnosis and decision-making.

The current knowledge on the $D^{\ast}$ mesons are still inadequate. Encouraged by the positive development prospects of high-luminosity and high-precision experiments, the Cabibbo-favored nonleptonic $D^{\ast}$ ${\to}$ $\bar{K}{\pi}^{+}$, $\bar{K}^{\ast}{\pi}^{+}$, $\bar{K}{\rho}^{+}$ weak decays are studied with the naive factorization approach. It is found that branching ratios of these processes can reach up to ${\cal O}(10^{-10})$ or more, and can be accessible at STCF, CEPC, FCC-ee and LHCb@HL-LHC experiments in the future. It might even be possible to search for the $D^{{\ast}0}$ ${\to}$ $K^{{\ast}-}{\pi}^{+}$ and $K^{-}{\rho}^{+}$ decays at the running SuperKEKB experiments., Comment: 17 pages, 2 figures

The current knowledge on the $D_{s}^{\ast}$ meson are very limited. Besides the dominant electromagnetic decays, the $D_{s}^{\ast}$ weak decays are legal and offer the valuable opportunities to explore the wanted $D_{s}^{\ast}$ meson. In this paper, the $D_{s}^{\ast}$ ${\to}$ ${\phi}{\pi}$ decay was studied with the factorization approach. It is found that the branching ratio ${\cal B}(D_{s}^{\ast}{\to}{\phi}{\pi})$ ${\sim}$ ${\cal O}(10^{-7})$, which corresponds to several thousands of events at the $e^{+}e^{-}$ collider experiments including STCF, SuperKEKB, CEPC and FCC-ee, and several millions of events at the hadron collider experiments, such as LHCb@HL-LHC. It is feasible to experimentally study the $D_{s}^{\ast}$ ${\to}$ ${\phi}{\pi}$ weak decay in the future, even considering the identification efficiency., Comment: 11 pages

The study of the purely leptonic decays of the ground charged vector mesons is very interesting and significant in determining the CKM matrix elements, obtaining the decay constant of vector mesons, examining the lepton flavor universality, and searching for new physics beyond the standard model. These purely leptonic decays of the ground charged vector mesons are induced by the weak interactions within the standard model, and usually have very small branching ratios, ${\cal B}({\rho}^{-}{\to}{\ell}^{-}{\nu}_{\ell})$ ${\sim}$ ${\cal O}(10^{-13})$, ${\cal B}(K^{{\ast}-}{\to}{\ell}^{-}{\nu}_{\ell})$ ${\sim}$ ${\cal O}(10^{-13})$, ${\cal B}(D_{d}^{{\ast}-}{\to}{\ell}^{-}{\nu}_{\ell})$ ${\sim}$ ${\cal O}(10^{-10})$, ${\cal B}(B_{u}^{{\ast}-}{\to}{\ell}^{-}{\nu}_{\ell})$ ${\sim}$ ${\cal O}(10^{-10})$, ${\cal B}(D_{s}^{{\ast}-}{\to}{\ell}^{-}{\nu}_{\ell})$ ${\sim}$ ${\cal O}(10^{-6})$ and ${\cal B}(B_{c}^{{\ast}-}{\to}{\ell}^{-}{\nu}_{\ell})$ ${\sim}$ ${\cal O}(10^{-6})$. Inspired by the potential prospects of LHCb, Belle-II, STCF, CEPC and FCC-ee experiments, we discussed the probabilities of experimental investigation on these purely leptonic decays. It is found that the measurements of these decays might be possible and feasible with the improvement of data statistics, analytical technique, and measurement precision in the future. (1) With the hadron-hadron collisions, the purely leptonic decays of ${\rho}^{-}$, $K^{{\ast}-}$, $D_{d,s}^{{\ast}-}$ and $B_{u,c}^{{\ast}-}$ mesons might be accessible at LHC experiments. (2) With the $e^{+}e^{-}$ collisions, the purely leptonic decays of $D_{d,s}^{{\ast}-}$ and $B_{u,c}^{{\ast}-}$ mesons might be measurable with over $10^{12}$ $Z^{0}$ bosons available at CEPC and FCC-ee experiments. In addition, the $D_{d,s}^{{\ast}-}$ ${\to}$ ${\ell}^{-}{\nu}_{\ell}$ decays could also be studied at Belle-II and SCTF experiments., Comment: 34 pages, 6 figures, 7 tables

A deep learning approach based on big data is proposed to locate broadband acoustic sources using a single hydrophone in ocean waveguides with uncertain bottom parameters. Several 50-layer residual neural networks, trained on a huge number of sound field replicas generated by an acoustic propagation model, are used to handle the bottom uncertainty in source localization. A two-step training strategy is presented to improve the training of the deep models. First, the range is discretized in a coarse (5 km) grid. Subsequently, the source range within the selected interval and source depth are discretized on a finer (0.1 km and 2 m) grid. The deep learning methods were demonstrated for simulated magnitude-only multi-frequency data in uncertain environments. Experimental data from the China Yellow Sea also validated the approach., Comment: It has been published on the Journal of the Acoustical Society of America