Search

Quasi double Casoratian solutions are derived for a bilinear system reformulated from the coupled semi-discrete modified Korteweg-de Vries equations with nonzero backgrounds. These solutions, when applied with the classical and nonlocal reduction techniques, also satisfy the corresponding classical and nonlocal semi-discrete modified Korteweg-de Vries equations with nonzero backgrounds. They can be expressed explicitly, allowing for an easy investigation of the dynamics of systems. As illustrative examples, the dynamics of solitonic, periodic and rational solutions with a plane wave background are examined for the focusing semi-discrete Korteweg-de Vries equation and the defocusing reverse-space-time complex semi-discrete Korteweg-de Vries equation.

The gas-phase metallicity distribution within galaxies records critical information about galactic evolution. In this work we investigate how active galactic nuclei (AGN) influence this distribution by measuring the two-point correlation functions of gas-phase metallicity in 95 non-AGN and 37 AGN-host galaxies from the Calar Alto Legacy Integral Field spectroscopy Area integral field spectrographic survey. We measure metallicity using a novel Bayesian method that properly includes both stellar and AGN contributions to emission line fluxes and allows us to measure metallicities in both AGN-host and non-AGN galaxies in a single, consistent framework. We find that the two-point correlation functions of both AGN-host and non-AGN galaxies are well-fit by a simple injection-diffusion model, and that the correlation lengths $l_\mathrm{corr}$ we derive for the non-AGN galaxies are reasonably consistent with those obtained in earlier work. The AGN-host galaxies generally have smaller $l_\mathrm{corr}$ than non-AGN galaxies at fixed stellar mass, but similar $l_\mathrm{corr}$ at fixed star formation rate (SFR), suggesting that the primary effect of hosting an AGN in this sample is a reduction in SFR at fixed stellar mass, and that this in turn suppresses the correlation length. Our findings further indicate that, while both SFR and stellar mass are positively correlated with metallicity correlation length $l_\mathrm{corr}$, the former is more fundamental, implying that fluctuations in the metallicity distribution within galaxies are driven more by short-term responses to physical processes such as star formation that can change much faster than a Hubble time., Comment: 13 pages, 10 figures, submitted to MNRAS

The state space models, employing recursively propagated features, demonstrate strong representation capabilities comparable to Transformer models and superior efficiency. However, constrained by the inherent geometric constraints of sequences, it still falls short in modeling long-range dependencies. To address this issue, we propose the GrootVL network, which first dynamically generates a tree topology based on spatial relationships and input features. Then, feature propagation is performed based on this graph, thereby breaking the original sequence constraints to achieve stronger representation capabilities. Additionally, we introduce a linear complexity dynamic programming algorithm to enhance long-range interactions without increasing computational cost. GrootVL is a versatile multimodal framework that can be applied to both visual and textual tasks. Extensive experiments demonstrate that our method significantly outperforms existing structured state space models on image classification, object detection and segmentation. Besides, by fine-tuning large language models, our approach achieves consistent improvements in multiple textual tasks at minor training cost., Comment: The code is available at https://github.com/EasonXiao-888/GrootVL

The rapid evolution of multimodal foundation model has demonstrated significant progresses in vision-language understanding and generation, e.g., our previous work SEED-LLaMA. However, there remains a gap between its capability and the real-world applicability, primarily due to the model's limited capacity to effectively respond to various user instructions and interact with diverse visual data. In this work, we focus on bridging this gap through integrating two enhanced features: (1) comprehending images of arbitrary sizes and ratios, and (2) enabling multi-granularity image generation. We present a unified and versatile foundation model, namely, SEED-X, which is able to model multi-granularity visual semantics for comprehension and generation tasks. Besides the competitive results on public benchmarks, SEED-X demonstrates its effectiveness in handling real-world applications across various domains after instruction tuning. We hope that our work will inspire future research into what can be achieved by versatile multimodal foundation models in real-world applications. The models, codes, and datasets will be released in https://github.com/AILab-CVC/SEED-X., Comment: Project released at: https://github.com/AILab-CVC/SEED-X

Cauchy matrix approach for the discrete Ablowitz-Kaup-Newell-Segur equations is reconsidered, where two `proper' discrete Ablowitz-Kaup-Newell-Segur equations and two `unproper' discrete Ablowitz-Kaup-Newell-Segur equations are derived. The `proper' equations admit local reduction, while the `unproper' equations admit nonlocal reduction. By imposing the local and nonlocal complex reductions on the obtained discrete Ablowitz-Kaup-Newell-Segur equations, two local and nonlocal discrete complex modified Korteweg-de Vries equations are constructed. For the obtained local and nonlocal discrete complex modified Korteweg-de Vries equations, soliton solutions and Jordan-block solutions are presented by solving the determining equation set. The dynamical behaviors of 1-soliton solution are analyzed and illustrated. Continuum limits of the resulting local and nonlocal discrete complex modified Korteweg-de Vries equations are discussed., Comment: This paper contains 18 pages and 14 figures

As local and nonlocal reductions of a discrete second-order Ablowitz-Kaup-Newell-Segur equation, two discrete nonlinear Schr\"odinger type equations are considered. Through the bilinearization reduction method, we construct double Casoratian solutions of the reduced discrete nonlinear Schr\"odinger type equations, including soliton solutions and Jordan-block solutions.Dynamics of the obtained one-soliton and two-soliton solutions are analyzed and illustrated. Moreover,both semi-continuous limit and full continuous limit, are applied to obtain solutions of the local and nonlocal semi-discrete nonlinear Schr\"odinger type equations, as well as the local and nonlocal continuous nonlinear Schr\"odinger type equations., Comment: This paper contains 24 pages and 37 figures

Galaxies' stellar masses, gas-phase oxygen abundances (metallicity), and star formation rates (SFRs) obey a series of empirical correlations, most notably the mass-metallicity relation (MZR) and fundamental metallicity relation (FZR), which relates oxygen abundance to a combination of stellar mass and SFR. However, due to the difficulty of measuring oxygen abundances and SFRs in galaxies that host powerful active galactic nuclei (AGN), to date it is unknown to what extent AGN-host galaxies also follow these correlations. In this work, we apply Bayesian methods to the MaNGA integral field spectrographic (IFS) survey that allow us to measure oxygen abundances and SFRs in AGN hosts, and use these measurements to explore how the MZR and FZR differ between galaxies that do and do not host AGN. We find similar MZRs at stellar masses above $10^{10.5} \mathrm{M}_\odot$, but that at lower stellar masses AGN hosts show up to $\sim 0.2$ dex higher oxygen abundances. The offset in the FZR is significantly smaller, suggesting that the larger deviation in the MZR is a result of AGN-host galaxies having systematically lower SFRs at fixed stellar mass. However, within the AGN-host sample there is little correlation between SFR and oxygen abundance. These findings support a scenario in which an AGN can halt efficient gas accretion, which drives non-AGN host galaxies to both higher SFR and lower oxygen abundance, resulting in the galaxy evolving off the star-forming main sequence (SFMS). As a consequence, as the SFR declines for an individual system its metallicity remains mostly unchanged., Comment: 18 pages, 14 figures, accepted for publication in MNRAS

We identify a fading AGN SDSS J220141.64+115124.3 from the internal Product Launch-11 (MPL-11) in Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) survey. The central region with a projected radius of $\sim$2.4 kpc is characterized as LINER-like line ratios while the outskirts extended to $\sim$15 kpc show Seyfert-like line ratios. The [OIII]$\lambda$5007 luminosity of the Seyfert regions is a factor of 37 (2) higher than the LINER regions without (with) dust attenuation correction, suggesting that the AGN activity decreases at least $\sim$8 $\times$ 10$^3$ yrs ($\sim$2.4 kpc/light-speed) ago. We model the emission line spectra in the central region with double Gaussian components (a narrow core and a broad wing) and analyze the properties of each component. The narrow core component mostly co-rotates with the stellar disc, whereas the broad wing component with a median of the velocity dispersion $\sim$300 km s$^{-1}$ is related to a wind outflow. The kinematic position angle (PA) of the ionized gas shows a $\sim$20{\deg} twist from the galaxy center to 1.5 effective radius. The median of the PA difference between the gas and stellar components is as large as $\sim$50{\deg} within 0.4 effective radius. The tidal feature in DESI image and star-gas misalignment suggest this galaxy is a merger remnant. Combining all these observational results as well as public available X-ray and MIR luminosities, we confirm this is a fading AGN, the merger process kick-started the central engine to quasar phase which ionized gas composed of tidal debris, and now the activity of the central black hole decreases. The discontinuity in [OIII]$\lambda$5007 flux and EQW maps is due to multiple AGN outbursts triggered by merger remnant gas inflows., Comment: Accepted for publication in MNRAS. 12 pages, 10 figures, 1 table

This paper introduces a novel numerical approach to achieving smooth lane-change trajectories in autonomous driving scenarios. Our trajectory generation approach leverages particle swarm optimization (PSO) techniques, incorporating Neural Network (NN) predictions for trajectory refinement. The generation of smooth and dynamically feasible trajectories for the lane change maneuver is facilitated by combining polynomial curve fitting with particle propagation, which can account for vehicle dynamics. The proposed planning algorithm is capable of determining feasible trajectories with real-time computation capability. We conduct comparative analyses with two baseline methods for lane changing, involving analytic solutions and heuristic techniques in numerical simulations. The simulation results validate the efficacy and effectiveness of our proposed approach.

The You Only Look Once (YOLO) series of detectors have established themselves as efficient and practical tools. However, their reliance on predefined and trained object categories limits their applicability in open scenarios. Addressing this limitation, we introduce YOLO-World, an innovative approach that enhances YOLO with open-vocabulary detection capabilities through vision-language modeling and pre-training on large-scale datasets. Specifically, we propose a new Re-parameterizable Vision-Language Path Aggregation Network (RepVL-PAN) and region-text contrastive loss to facilitate the interaction between visual and linguistic information. Our method excels in detecting a wide range of objects in a zero-shot manner with high efficiency. On the challenging LVIS dataset, YOLO-World achieves 35.4 AP with 52.0 FPS on V100, which outperforms many state-of-the-art methods in terms of both accuracy and speed. Furthermore, the fine-tuned YOLO-World achieves remarkable performance on several downstream tasks, including object detection and open-vocabulary instance segmentation., Comment: Work still in progress. Code & models are available at: https://github.com/AILab-CVC/YOLO-World

Large-kernel convolutional neural networks (ConvNets) have recently received extensive research attention, but two unresolved and critical issues demand further investigation. 1) The architectures of existing large-kernel ConvNets largely follow the design principles of conventional ConvNets or transformers, while the architectural design for large-kernel ConvNets remains under-addressed. 2) As transformers have dominated multiple modalities, it remains to be investigated whether ConvNets also have a strong universal perception ability in domains beyond vision. In this paper, we contribute from two aspects. 1) We propose four architectural guidelines for designing large-kernel ConvNets, the core of which is to exploit the essential characteristics of large kernels that distinguish them from small kernels - they can see wide without going deep. Following such guidelines, our proposed large-kernel ConvNet shows leading performance in image recognition (ImageNet accuracy of 88.0%, ADE20K mIoU of 55.6%, and COCO box AP of 56.4%), demonstrating better performance and higher speed than the recent powerful competitors. 2) We discover large kernels are the key to unlocking the exceptional performance of ConvNets in domains where they were originally not proficient. With certain modality-related preprocessing approaches, the proposed model achieves state-of-the-art performance on time-series forecasting and audio recognition tasks even without modality-specific customization to the architecture. All the code and models are publicly available on GitHub and Huggingface., Comment: CVPR 2024. Code, all the models, reproducible training scripts at https://github.com/AILab-CVC/UniRepLKNet

The contrastive vision-language pre-training, known as CLIP, demonstrates remarkable potential in perceiving open-world visual concepts, enabling effective zero-shot image recognition. Nevertheless, few-shot learning methods based on CLIP typically require offline fine-tuning of the parameters on few-shot samples, resulting in longer inference time and the risk of over-fitting in certain domains. To tackle these challenges, we propose the Meta-Adapter, a lightweight residual-style adapter, to refine the CLIP features guided by the few-shot samples in an online manner. With a few training samples, our method can enable effective few-shot learning capabilities and generalize to unseen data or tasks without additional fine-tuning, achieving competitive performance and high efficiency. Without bells and whistles, our approach outperforms the state-of-the-art online few-shot learning method by an average of 3.6\% on eight image classification datasets with higher inference speed. Furthermore, our model is simple and flexible, serving as a plug-and-play module directly applicable to downstream tasks. Without further fine-tuning, Meta-Adapter obtains notable performance improvements in open-vocabulary object detection and segmentation tasks., Comment: Accepted by NeurIPS 2023

We propose InstructDET, a data-centric method for referring object detection (ROD) that localizes target objects based on user instructions. While deriving from referring expressions (REC), the instructions we leverage are greatly diversified to encompass common user intentions related to object detection. For one image, we produce tremendous instructions that refer to every single object and different combinations of multiple objects. Each instruction and its corresponding object bounding boxes (bbxs) constitute one training data pair. In order to encompass common detection expressions, we involve emerging vision-language model (VLM) and large language model (LLM) to generate instructions guided by text prompts and object bbxs, as the generalizations of foundation models are effective to produce human-like expressions (e.g., describing object property, category, and relationship). We name our constructed dataset as InDET. It contains images, bbxs and generalized instructions that are from foundation models. Our InDET is developed from existing REC datasets and object detection datasets, with the expanding potential that any image with object bbxs can be incorporated through using our InstructDET method. By using our InDET dataset, we show that a conventional ROD model surpasses existing methods on standard REC datasets and our InDET test set. Our data-centric method InstructDET, with automatic data expansion by leveraging foundation models, directs a promising field that ROD can be greatly diversified to execute common object detection instructions., Comment: 29 pages (include Appendix) Published in ICLR

Depth perception is a crucial component of monoc-ular 3D detection tasks that typically involve ill-posed problems. In light of the success of sample mining techniques in 2D object detection, we propose a simple yet effective mining strategy for improving depth perception in 3D object detection. Concretely, we introduce a plain metric to evaluate the quality of depth predictions, which chooses the mined sample for the model. Moreover, we propose a Gradient-aware and Model-perceive Mining strategy (GMM) for depth learning, which exploits the predicted depth quality for better depth learning through easy mining. GMM is a general strategy that can be readily applied to several state-of-the-art monocular 3D detectors, improving the accuracy of depth prediction. Extensive experiments on the nuScenes dataset demonstrate that the proposed methods significantly improve the performance of 3D object detection while outperforming other state-of-the-art sample mining techniques by a considerable margin. On the nuScenes benchmark, GMM achieved the state-of-the-art (42.1% mAP and 47.3% NDS) performance in monocular object detection., Comment: 8 pages, 4 figures

The spatially precise integration of arrays of micro-patterned two-dimensional (2D) crystals onto three-dimensionally structured Si/SiO$_2$ substrates represents an attractive strategy towards the low-cost system-on-chip integration of extended functions in silicon microelectronics. However, the reliable integration of the arrays of 2D materials on non-flat surfaces has thus far proved extremely challenging due to their poor adhesion to underlying substrates as ruled by weak van der Waals interactions. Here we report on a novel fabrication method based on nano-subsidence which enables the precise and reliable integration of the micro-patterned 2D materials/silicon photodiode arrays exhibiting high uniformity. Our devices display peak sensitivity as high as 0.35 A/W and external quantum efficiency (EQE) of ca. 90%, outperforming most commercial photodiodes. The nano-subsidence technique opens a viable path to on-chip integrate 2D crystals onto silicon for beyond-silicon microelectronics., Comment: 41 pages, 5 figures, with SI

Stickers have become a ubiquitous part of modern-day communication, conveying complex emotions through visual imagery. To facilitate the development of more powerful algorithms for analyzing stickers, we propose a large-scale Chinese sticker dataset, namely Sticker820K, which consists of 820k image-text pairs. Each sticker has rich and high-quality textual annotations, including descriptions, optical characters, emotional labels, and style classifications. Although vision-language tasks in the domain of natural images have been well studied, directly applying the those models, such as CLIP, to sticker data is not an optimal solution due to the discrepant nature between natural and emotive image data. Therefore, we propose StickerCLIP as a benchmark model on the Sticker820K dataset. For the text-to-image retrieval task, our StickerCLIP demonstrates strong superiority over the CLIP, which achieves an absolute gain of 66.0\% in mean recall on the Sticker820K test set. Additionally, we endeavor to extend the recently popularized LLM by means of prompt tuning, integrating its ability for sticker retrieval and allowing users to retrieve stickers through instructions. We validate the feasibility of this method, demonstrating the immense potential of prompt tuning in expanding LLM abilities while not affecting the quality of upstream tasks.

Solutions for all Adler-Bobenko-Suris equations excluding Q4 and several lattice Boussinesq-type equations are reconsidered by employing the Cauchy matrix approach. Through introducing a ``fake'' nonautonomous plane wave factor, we derive soliton solutions, oscillatory solutions, and semi-oscillatory solutions, for the target lattice equations. Unlike the conventional soliton solutions, the oscillatory solutions take constant values on all elementary quadrilaterals on Z^2, which demonstrate periodic structure., Comment: 26 pages, 12 figures

This paper aims to efficiently enable Large Language Models (LLMs) to use multimodal tools. Advanced proprietary LLMs, such as ChatGPT and GPT-4, have shown great potential for tool usage through sophisticated prompt engineering. Nevertheless, these models typically rely on prohibitive computational costs and publicly inaccessible data. To address these challenges, we propose the GPT4Tools based on self-instruct to enable open-source LLMs, such as LLaMA and OPT, to use tools. It generates an instruction-following dataset by prompting an advanced teacher with various multi-modal contexts. By using the Low-Rank Adaptation (LoRA) optimization, our approach facilitates the open-source LLMs to solve a range of visual problems, including visual comprehension and image generation. Moreover, we provide a benchmark to evaluate the ability of LLMs to use tools, which is performed in both zero-shot and fine-tuning ways. Extensive experiments demonstrate the effectiveness of our method on various language models, which not only significantly improves the accuracy of invoking seen tools, but also enables the zero-shot capacity for unseen tools. The code and demo are available at https://github.com/StevenGrove/GPT4Tools.

$L_1$ adaptive control ($L_1$AC) is a control design technique that can handle a broad class of system uncertainties and provide transient performance guarantees. In this work-in-progress abstract, we discuss how existing formal verification tools can be applied to check the performance of $L_1$AC systems. We show that the theoretical transient performance and robustness guarantees of an $L_1$ adaptive controller for an 18-dimensional quadrotor system can be verified using the recently developed Verse reachability analysis tool. We will further consider the performance verification of $L_1$AC on systems with learning-enabled components., Comment: accepted to ICCPS-wip 2023

Box-supervised instance segmentation has gained much attention as it requires only simple box annotations instead of costly mask or polygon annotations. However, existing box-supervised instance segmentation models mainly focus on mask-based frameworks. We propose a new end-to-end training technique, termed BoxSnake, to achieve effective polygonal instance segmentation using only box annotations for the first time. Our method consists of two loss functions: (1) a point-based unary loss that constrains the bounding box of predicted polygons to achieve coarse-grained segmentation; and (2) a distance-aware pairwise loss that encourages the predicted polygons to fit the object boundaries. Compared with the mask-based weakly-supervised methods, BoxSnake further reduces the performance gap between the predicted segmentation and the bounding box, and shows significant superiority on the Cityscapes dataset. The code has been available publicly., Comment: ICCV 2023

In this paper, we take advantage of the bilinearization reduction method to consider the local and nonlocal reduction of a discrete Ablowitz-Kaup-Newell-Segur equation. Exact solutions in double Casoratian form to the reduced nonlocal discrete modified Korteweg de-Vries equations are constructed. The dynamics of soliton solutions are analyzed and illustrated by asymptotic analysis. Moreover, both semi-continuous limit and full continuous limit, are applied to obtain the local and nonlocal semi-discrete modified Korteweg de-Vries equations, as well as the local and nonlocal continuous modified Korteweg de-Vries equations., Comment: 15 pages, 11 figures