Search

With the development of intelligent connected vehicle technology, human-machine shared control has gained popularity in vehicle following due to its effectiveness in driver assistance. However, traditional vehicle following systems struggle to maintain stability when driver reaction time fluctuates, as these variations require different levels of system intervention. To address this issue, the proposed human-machine shared vehicle following assistance system (HM-VFAS) integrates driver outputs under various states with the assistance system. The system employs an intelligent driver model that accounts for reaction time delays, simulating time-varying driver outputs. A control authority allocation strategy is designed to dynamically adjust the level of intervention based on real-time driver state assessment. To handle instability from driver authority switching, the proposed solution includes a two-layer adaptive finite time sliding mode controller (A-FTSMC). The first layer is an integral sliding mode adaptive controller that ensures robustness by compensating for uncertainties in the driver output. The second layer is a fast non-singular terminal sliding mode controller designed to accelerate convergence for rapid stabilization. Using real driver videos as inputs, the performance of the HM-VFAS was evaluated. Results show that the proposed control strategy maintains a safe distance under time-varying driver states, with the actual acceleration error relative to the target acceleration maintained within 0.5m/s~2 and the maximum acceleration error reduced by 1.2m/s~2. Compared to traditional controllers, the A-FTSMC controller offers faster convergence and less vibration, reducing the stabilization time by 27.3%.

There has been a growing trend that activities relating to clinical trials take place at locations other than traditional trial sites (hence decentralized clinical trials or DCTs), some of which are at settings of real-world clinical practice. Although there are numerous benefits of DCTs, this also brings some implications on a number of issues relating to the design, conduct, and analysis of DCTs. The Real-World Evidence Scientific Working Group of the American Statistical Association Biopharmaceutical Section has been reviewing the field of DCTs and provides in this paper considerations for decentralized trials from a statistical perspective. This paper first discusses selected critical decentralized elements that may have statistical implications on the trial and then summarizes regulatory guidance, framework, and initiatives on DCTs. More discussions are presented by focusing on the design (including construction of estimand), implementation, statistical analysis plan (including missing data handling), and reporting of safety events. Some additional considerations (e.g., ethical considerations, technology infrastructure, study oversight, data security and privacy, and regulatory compliance) are also briefly discussed. This paper is intended to provide statistical considerations for decentralized trials of medical products to support regulatory decision-making.

Domain-specific Named Entity Recognition (NER), whose goal is to recognize domain-specific entities and their categories, provides an important support for constructing domain knowledge graphs. Currently, deep learning-based methods are widely used and effective in NER tasks, but due to the reliance on large-scale labeled data. As a result, the scarcity of labeled data in a specific domain will limit its application.Therefore, many researches started to introduce few-shot methods and achieved some results. However, the entity structures in specific domains are often complex, and the current few-shot methods are difficult to adapt to NER tasks with complex features.Taking the Chinese coal chemical industry domain as an example,there exists a complex structure of multiple entities sharing a single entity, as well as multiple relationships for the same pair of entities, which affects the NER task under the sample less condition.In this paper, we propose a Large Language Models (LLMs)-based entity recognition framework LLM-DER for the domain-specific entity recognition problem in Chinese, which enriches the entity information by generating a list of relationships containing entity types through LLMs, and designing a plausibility and consistency evaluation method to remove misrecognized entities, which can effectively solve the complex structural entity recognition problem in a specific domain.The experimental results of this paper on the Resume dataset and the self-constructed coal chemical dataset Coal show that LLM-DER performs outstandingly in domain-specific entity recognition, not only outperforming the existing GPT-3.5-turbo baseline, but also exceeding the fully-supervised baseline, verifying its effectiveness in entity recognition.

On top of a $D$-dimensional gapped bulk state, Low Entanglement Excitations (LEE) on $d$($

Large Language Models (LLMs) exhibit high inference latency due to their autoregressive decoding nature. While the draft head in speculative decoding mitigates this issue, its full potential remains unexplored. In this paper, we introduce KOALA (K-layer Optimized Adversarial Learning Architecture), an orthogonal approach to the draft head. By transforming the conventional single-layer draft head into a multi-layer architecture and incorporating adversarial learning into the traditional supervised training, KOALA significantly improves the accuracy of the draft head in predicting subsequent tokens, thus more closely mirroring the functionality of LLMs. Although this improvement comes at the cost of slightly increased drafting overhead, KOALA substantially unlocks the draft head's potential, greatly enhancing speculative decoding. We conducted comprehensive evaluations of KOALA, including both autoregressive and non-autoregressive draft heads across various tasks, demonstrating a latency speedup ratio improvement of 0.24x-0.41x, which is 10.57%-14.09% faster than the original draft heads.

In enterprise data pipelines, data insertions occur periodically and may impact downstream services if data quality issues are not addressed. Typically, such problems can be investigated and fixed by on-call engineers, but locating the cause of such problems and fixing errors are often time-consuming. Therefore, automatic data validation is a better solution to defend the system and downstream services by enabling early detection of errors and providing detailed error messages for quick resolution. This paper proposes a self-validate data management system with automatic pattern discovery techniques to verify the correctness of semi-structural string data in enterprise data pipelines. Our solution extracts patterns from historical data and detects erroneous incoming data in a top-down fashion. High-level information of historical data is analyzed to discover the format skeleton of correct values. Fine-grained semantic patterns are then extracted to strike a balance between generalization and specification of the discovered pattern, thus covering as many correct values as possible while avoiding over-fitting. To tackle cold start and rapid data growth, we propose an incremental update strategy and example generalization strategy. Experiments on large-scale industrial and public datasets demonstrate the effectiveness and efficiency of our method compared to alternative solutions. Furthermore, a case study on an industrial platform (Ant Group Inc.) with thousands of applications shows that our system captures meaningful data patterns in daily operations and helps engineers quickly identify errors.

The ground state of the bipartite $t$-$J$ model must satisfy a specific sign structure, based on which the single-hole and two-hole ground state $Ans\ddot{a}tze$ on honeycomb lattice are constructed and studied by a variational Monte Carlo (VMC) method. The VMC results are in good agreement with the exact diagonalization (ED) calculation. For the single-hole case, the degenerate ground states are characterized by quantum numbers of a spin-1/2 and an orbital angular momentum $L_z=\pm 2$. The latter is associated with the emergent chiral spin/hole currents mutually surrounding the hole/spin-1/2 as a composite object or ``twisted hole''. A vanishing quasiparticle spectral weight is shown in the large-sample limit. In the two-hole ground state, the holes form a spin-singlet pairing with $d$+$id$ symmetry in the Cooper channel, but are of $s$-wave symmetry as a tightly bound pair of the ``twisted holes''. Such a pairing mechanism of dichotomy can be attributed to eliminating the local spin currents which has nothing to do with the long-range antiferromagnetic correlation. Superconducting ground state at finite doping is briefly discussed in terms of the tightly bound hole pairs as the building blocks., Comment: 14 pages, 11 figures

Energy-efficient spintronic devices require a large spin-orbit torque (SOT) and low damping to excite magnetic precession. In conventional devices with heavy-metal/ferromagnet bilayers, reducing the ferromagnet thickness to $\sim$1 nm enhances the SOT but dramatically increases damping. Here, we investigate an alternative approach based on a 10 nm thick single-layer ferromagnet to attain both low damping and a sizable SOT. Instead of relying on a single interface, we continuously break the bulk inversion symmetry with a vertical compositional gradient of two ferromagnetic elements: Fe with low intrinsic damping and Ni with sizable spin-orbit coupling. We find low effective damping parameters of $\alpha_\mathrm{eff} < 5\times10^{-3}$ in the FeNi alloy films, despite the steep compositional gradients. Moreover, we reveal a sizable anti-damping SOT efficiency of $\theta_\mathrm{AD} \approx 0.05$, even without an intentional compositional gradient. Through depth-resolved x-ray diffraction, we identify a lattice strain gradient as crucial symmetry breaking that underpins the SOT. Our findings provide fresh insights into damping and SOTs in single-layer ferromagnets for power-efficient spintronic devices.

With the exponential growth of data and evolving use cases, petabyte-scale OLAP data platforms are increasingly adopting a model that decouples compute from storage. This shift, evident in organizations like Uber and Meta, introduces operational challenges including massive, read-heavy I/O traffic with potential throttling, as well as skewed and fragmented data access patterns. Addressing these challenges, this paper introduces the Alluxio local (edge) cache, a highly effective architectural optimization tailored for such environments. This embeddable cache, optimized for petabyte-scale data analytics, leverages local SSD resources to alleviate network I/O and API call pressures, significantly improving data transfer efficiency. Integrated with OLAP systems like Presto and storage services like HDFS, the Alluxio local cache has demonstrated its effectiveness in handling large-scale, enterprise-grade workloads over three years of deployment at Uber and Meta. We share insights and operational experiences in implementing these optimizations, providing valuable perspectives on managing modern, massive-scale OLAP workloads., Comment: Accepted to the USENIX Annual Technical Conference (USENIX ATC) 2024

Coherent supercontinuum radiation in the extreme-ultraviolet (XUV) range is indispensable for synthesizing attosecond light pulses and for exploring transient atomic structures. Here, we report the striking observations of coherent XUV supercontinuum (XSC) extended from below to far above the ionization threshold, which exhibits completely different temporal and spatial properties comparing to the conventional rescattering induced high harmonic generation (HHG). We demonstrate that the strong-field created coherence among bound orbitals strongly distort the atomic transition energies during the pulse, leading to coherent emission spanning tens of electron-volts, in contrast to the line emission via free-induction decay occurring after the pulse. The supposed non-radiating bound dark states contribute as well by emitting dressed energy through dark-to-bright emission mechanism. All the processes modulated at sub-cycle time scale jointly form this new-type coherent XSC. This work achieves the strong-field attosecond control of the exotic atomic radiation dynamics and provides the means of simultaneous generation of separated attosecond sources, i.e., XSC and HHG, with potential advancing attosecond interferometry.

In traditional human living environment landscape design, the establishment of three-dimensional models is an essential step for designers to intuitively present the spatial relationships of design elements, as well as a foundation for conducting landscape analysis on the site. Rapidly and effectively generating beautiful and realistic landscape spaces is a significant challenge faced by designers. Although generative design has been widely applied in related fields, they mostly generate three-dimensional models through the restriction of indicator parameters. However, the elements of landscape design are complex and have unique requirements, making it difficult to generate designs from the perspective of indicator limitations. To address these issues, this study proposes a park space generative design system based on deep learning technology. This system generates design plans based on the topological relationships of landscape elements, then vectorizes the plan element information, and uses Grasshopper to generate three-dimensional models while synchronously fine-tuning parameters, rapidly completing the entire process from basic site conditions to model effect analysis. Experimental results show that: (1) the system, with the aid of AI-assisted technology, can rapidly generate space green space schemes that meet the designer's perspective based on site conditions; (2) this study has vectorized and three-dimensionalized various types of landscape design elements based on semantic information; (3) the analysis and visualization module constructed in this study can perform landscape analysis on the generated three-dimensional models and produce node effect diagrams, allowing users to modify the design in real time based on the effects, thus enhancing the system's interactivity., Comment: 14 pages,8 figures

Parameter-efficient finetuning (PEFT) is a key technique for adapting large language models (LLMs) to downstream tasks. In this paper, we study leveraging knowledge graph embeddings to improve the effectiveness of PEFT. We propose a knowledgeable adaptation method called KnowLA. It inserts an adaptation layer into an LLM to integrate the embeddings of entities appearing in the input text. The adaptation layer is trained in combination with LoRA on instruction data. Experiments on six benchmarks with two popular LLMs and three knowledge graphs demonstrate the effectiveness and robustness of KnowLA. We show that \modelname can help activate the relevant parameterized knowledge in an LLM to answer a question without changing its parameters or input prompts., Comment: Accepted in the 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL 2024)

Due to the influence of imaging equipment and complex imaging environments, most images in daily life have features of intensity inhomogeneity and noise. Therefore, many scholars have designed many image segmentation algorithms to address these issues. Among them, the active contour model is one of the most effective image segmentation algorithms.This paper proposes an active contour model driven by the hybrid signed pressure function that combines global and local information construction. Firstly, a new global region-based signed pressure function is introduced by combining the average intensity of the inner and outer regions of the curve with the median intensity of the inner region of the evolution curve. Then, the paper uses the energy differences between the inner and outer regions of the curve in the local region to design the signed pressure function of the local term. Combine the two SPF function to obtain a new signed pressure function and get the evolution equation of the new model. Finally, experiments and numerical analysis show that the model has excellent segmentation performance for both intensity inhomogeneous images and noisy images.

We investigate the production of spin-3/2 hadrons in semi-inclusive deep inelastic lepton-nucleon scatterings. The complete differential cross section is derived through the kinematic analysis and expressed in terms of 288 structure functions, corresponding to all polarization configurations and azimuthal modulations. For an unpolarized lepton beam, half of the 192 structure functions have nonzero leading order contributions in the parton model, among which 42 are from rank-3 tensor polarized fragmentation functions of the hadron. For a polarized lepton beam, one third of the 96 structure functions contribute at the leading order and 14 of them are from rank-3 tensor polarized fragmentation functions. In addition to the formalism, we perform a model estimation of the spin transfer to a $S_{hLLL}$ polarized hadron and sizable asymmetry is expected. Therefore, these newly defined observables for the production of a spin-3/2 hadron in a deep inelastic scattering process can be explored in future experiments to understand nucleon spin structures and spin-dependent fragmentation functions., Comment: 48 pages, 3 figures

This study aims to explore the complex relationship between perceptual and cognitive interactions in multimodal data analysis,with a specific emphasis on spatial experience design in overseas Chinese gardens. It is found that evaluation content and images on social media can reflect individuals' concerns and sentiment responses, providing a rich data base for cognitive research that contains both sentimental and image-based cognitive information. Leveraging deep learning techniques, we analyze textual and visual data from social media, thereby unveiling the relationship between people's perceptions and sentiment cognition within the context of overseas Chinese gardens. In addition, our study introduces a multi-agent system (MAS)alongside AI agents. Each agent explores the laws of aesthetic cognition through chat scene simulation combined with web search. This study goes beyond the traditional approach of translating perceptions into sentiment scores, allowing for an extension of the research methodology in terms of directly analyzing texts and digging deeper into opinion data. This study provides new perspectives for understanding aesthetic experience and its impact on architecture and landscape design across diverse cultural contexts, which is an essential contribution to the field of cultural communication and aesthetic understanding., Comment: 16 figures,1 table

In this paper we deal with a first order evolution inclusion involving a multivalued term generated by a Clarke subdifferential of a locally Lipschitz potential. For this problem we construct a double step time-semidiscrete approximation, known as the Rothe scheme. We study a sequence of solutions of the semidiscrete approximate problems and provide its weak convergence to a limit element that is a solution of the original problem., Comment: arXiv admin note: substantial text overlap with arXiv:2312.15723

To improve the environment of the ecosystem, China has implemented the Green-forGrain Program for two decades, which has resulted in an imbalance among ecology.economy and food. This study focuses on the "ecology-food" imbalance problem.taking Sichuan-Chongqing Region as an example, to set up future scenarios topredicate the distribution of ESs. We first forecast land use/cover change in 2050under four different scenarios: Natural Development Scenarios; Arable LandConservation Scenarios; Ecological Priority Scenarios; Ecology-Arable LandHarmonization Scenarios. Then we assess changes in five ESs: habitat quality ,cropproduction, soil conservation, water yield, and carbon storage from 1990 to 2020 and2050. Finally, we reveal the spacial distribution of ESs. The following conclusions areobtained: (1) From 1990-2020, CS, SC, and HQ reveal an increasing trend with growthrates of 1.68%, 0.08%, and 0.46%: CP reveals a reduce rate of 2.75% . (2) S4 has anincrease in arable land, and CP has increased by 7.56% compared to S1, reversingthe trend of reduced CP under S1. (3) The high-high anomalies area of CP under S4 isoasically the same as that under S2, which proves that S4 is a scenario policy that canbe referred to for future development., Comment: 9 figures, and 7 tables

This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultra model advances the state of the art in 30 of 32 of these benchmarks - notably being the first model to achieve human-expert performance on the well-studied exam benchmark MMLU, and improving the state of the art in every one of the 20 multimodal benchmarks we examined. We believe that the new capabilities of the Gemini family in cross-modal reasoning and language understanding will enable a wide variety of use cases. We discuss our approach toward post-training and deploying Gemini models responsibly to users through services including Gemini, Gemini Advanced, Google AI Studio, and Cloud Vertex AI.

The development of generative design driven by artificial intelligence algorithms is speedy. There are two research gaps in the current research: 1) Most studies only focus on the relationship between design elements and pay little attention to the external information of the site; 2) GAN and other traditional generative algorithms generate results with low resolution and insufficient details. To address these two problems, we integrate GAN, Stable diffusion multimodal large-scale image pre-training model to construct a full-process park generative design method: 1) First, construct a high-precision remote sensing object extraction system for automated extraction of urban environmental information; 2) Secondly, use GAN to construct a park design generation system based on the external environment, which can quickly infer and generate design schemes from urban environmental information; 3) Finally, introduce Stable Diffusion to optimize the design plan, fill in details, and expand the resolution of the plan by 64 times. This method can achieve a fully unmanned design automation workflow. The research results show that: 1) The relationship between the inside and outside of the site will affect the algorithm generation results. 2) Compared with traditional GAN algorithms, Stable diffusion significantly improve the information richness of the generated results.

Face plays an important role in humans visual perception, and reconstructing perceived faces from brain activities is challenging because of its difficulty in extracting high-level features and maintaining consistency of multiple face attributes, such as expression, identity, gender, etc. In this study, we proposed a novel reconstruction framework, which we called Double-Flow GAN, that can enhance the capability of discriminator and handle imbalances in images from certain domains that are too easy for generators. We also designed a pretraining process that uses features extracted from images as conditions for making it possible to pretrain the conditional reconstruction model from fMRI in a larger pure image dataset. Moreover, we developed a simple pretrained model for fMRI alignment to alleviate the problem of cross-subject reconstruction due to the variations of brain structure among different subjects. We conducted experiments by using our proposed method and traditional reconstruction models. Results showed that the proposed method is significant at accurately reconstructing multiple face attributes, outperforms the previous reconstruction models, and exhibited state-of-the-art reconstruction abilities.

This paper explores a prevailing trend in the industry: migrating data-intensive analytics applications from on-premises to cloud-native environments. We find that the unique cost models associated with cloud-based storage necessitate a more nuanced understanding of optimizing performance. Specifically, based on traces collected from Uber's Presto fleet in production, we argue that common I/O optimizations, such as table scan and filter, and broadcast join, may lead to unexpected costs when naively applied in the cloud. This is because traditional I/O optimizations mainly focus on improving throughput or latency in on-premises settings, without taking into account the monetary costs associated with storage API calls. In cloud environments, these costs can be significant, potentially involving billions of API calls per day just for Presto workloads at Uber scale. Presented as a case study, this paper serves as a starting point for further research to design efficient I/O strategies specifically tailored for data-intensive applications in cloud settings., Comment: 6 pages, 3 figures

Multimodal time series (MTS) anomaly detection is crucial for maintaining the safety and stability of working devices (e.g., water treatment system and spacecraft), whose data are characterized by multivariate time series with diverse modalities. Although recent deep learning methods show great potential in anomaly detection, they do not explicitly capture spatial-temporal relationships between univariate time series of different modalities, resulting in more false negatives and false positives. In this paper, we propose a multimodal spatial-temporal graph attention network (MST-GAT) to tackle this problem. MST-GAT first employs a multimodal graph attention network (M-GAT) and a temporal convolution network to capture the spatial-temporal correlation in multimodal time series. Specifically, M-GAT uses a multi-head attention module and two relational attention modules (i.e., intra- and inter-modal attention) to model modal correlations explicitly. Furthermore, MST-GAT optimizes the reconstruction and prediction modules simultaneously. Experimental results on four multimodal benchmarks demonstrate that MST-GAT outperforms the state-of-the-art baselines. Further analysis indicates that MST-GAT strengthens the interpretability of detected anomalies by locating the most anomalous univariate time series., Comment: Information Fusion 2023 accepted

The coupled electronic-vibrational dynamics of nitrogen ions induced by strong-field ionization is investigated theoretically to corroborate the recent transient X-ray K-edge absorption experiment [PRL 129, 123002 (2022)], where the population distribution of three electronic states in air lasing of N2+ was determined for the first time. By extending the ionization-coupling model to include the transient absorption, we successfully reproduce the time-resolved X-ray absorption spectra of nitrogen ions observed in the experiment. By identifying the contributions from different electronic states, the study provides different interpretation revealing the significant role of excited state A arising from the strong coupling between vibrational states in strong laser fields. It indicates that the electronic population inversion occurs at least for certain alignment of nitrogen molecules. The theory helps uncovering new features of absorption from forbidden transitions during ionization and confirming that the vibration coherence at each electronic channel induces the modulation of absorbance after strong field ionization. A new scheme is proposed to determine the population transfer at different probing geometry to avoid the spectral overlap. This work offers valuable insights into the intricate interplay between electronic and vibrational dynamics and helps to resolve the debate on nitrogen air lasing.

The internal structure of doped holes in the Mott insulator may provide important insight into the physics of doped cuprates. Its observability via a single-particle probe by scanning tunneling spectroscopy (STS) and angle-resolved photo-emission spectroscopy (ARPES) is explored in this paper. Specifically we study the single-particle spectral function based on a two-hole variational ground state wavefunction [Phys. Rev. X 12, 011062 (2022)] in the $t$-$J$ model. The latter as a strongly correlated state possesses a dichotomy of $d$-wave Cooper pairing and $s$-wave ``twisted'' hole pairing. This pairing structure will give rise to two branches of local spectral function at finite energies. The low-lying one corresponds to a nodal-like quasiparticle excitation and the higher branch is associated with the pair breaking of ``twisted'' quasiparticles, with the threshold energy resembling a pseudogap, which is consistent with the recent STS observation. It can be further extended into energy spectra in momentum space measurable by ARPES, where the low-energy dispersion is also shown to agree well with the Quantum Monte Carlo numerical result for a single hole. It implies that the dominant pairing force arises from the ``twisted'' holes showing up in the high-energy branch. The effect of the next nearest neighbor hopping integral $t'$ is also examined, which shows interesting distinction between $t'/t > 0$ and $t'/t \leq 0$ with a dramatic shift of the low-lying excitation from the nodal region to the antinodal region, but with the high-energy branch remaining insensitive to $t'$. Finally, a possible ``orthogonality catastrophe'' effect, namely, a ``dark matter'' component in the strongly correlated wavefunction that cannot be directly detected by the single-electron spectroscopy, is briefly discussed., Comment: 11 pages, 7 figures

A class of quasi-variational-hemivariational inequalities in reflexive Banach spaces is studied. The inequalities contain a convex potential, a locally Lipschitz superpotential, and an implicit obstacle set of constraints. Results on the well posedness are established including existence, uniqueness, dependence of solution on the data, and the compactness of the solution set in the strong topology. The applicability of the results is illustrated by the steady-state Stokes model of a generalized Newtonian incompressible fluid with a nonmonotone slip boundary condition., Comment: 21 pages

One of scenarios in data-sharing applications is that files are managed by multiple owners, and the list of file owners may change dynamically. However, most existing solutions to this problem rely on trusted third parties and have complicated signature permission processes, resulting in additional overhead. Therefore, we propose a verifiable data-sharing scheme (VDS-DM) that can support dynamic multi-owner scenarios. We introduce a management entity that combines linear secret-sharing technology, multi-owner signature generation, and an aggregation technique to allow multi-owner file sharing. Without the help of trusted third parties, VDS-DM can update file signatures for dynamically changing file owners, which helps save communication overhead. Moreover, users independently verify the integrity of files without resorting to a third party. We analyse the security of VDS-DM through a security game. Finally, we conduct enough simulation experiments and the outcomes of experimental demonstrate the feasibility of VDS-DM.

End-to-end region-based object detectors like Sparse R-CNN usually have multiple cascade bounding box decoding stages, which refine the current predictions according to their previous results. Model parameters within each stage are independent, evolving a huge cost. In this paper, we find the general setting of decoding stages is actually redundant. By simply sharing parameters and making a recursive decoder, the detector already obtains a significant improvement. The recursive decoder can be further enhanced by positional encoding (PE) of the proposal box, which makes it aware of the exact locations and sizes of input bounding boxes, thus becoming adaptive to proposals from different stages during the recursion. Moreover, we also design centerness-based PE to distinguish the RoI feature element and dynamic convolution kernels at different positions within the bounding box. To validate the effectiveness of the proposed method, we conduct intensive ablations and build the full model on three recent mainstream region-based detectors. The RecusiveDet is able to achieve obvious performance boosts with even fewer model parameters and slightly increased computation cost. Codes are available at https://github.com/bravezzzzzz/RecursiveDet., Comment: Accepted by ICCV 2023

In this paper, for solving a broad class of large-scale nonconvex and nonsmooth optimization problems, we propose a stochastic two step inertial Bregman proximal alternating linearized minimization (STiBPALM) algorithm with variance-reduced stochastic gradient estimators. And we show that SAGA and SARAH are variance-reduced gradient estimators. Under expectation conditions with the Kurdyka-Lojasiewicz property and some suitable conditions on the parameters, we obtain that the sequence generated by the proposed algorithm converges to a critical point. And the general convergence rate is also provided. Numerical experiments on sparse nonnegative matrix factorization and blind image-deblurring are presented to demonstrate the performance of the proposed algorithm., Comment: arXiv admin note: text overlap with arXiv:2002.12266 by other authors

We present precise photometric estimates of stellar parameters, including effective temperature, metallicity, luminosity classification, distance, and stellar age, for nearly 26 million stars using the methodology developed in the first paper of this series, based on the stellar colors from the Stellar Abundances and Galactic Evolution Survey (SAGES) DR1 and Gaia EDR3. The optimal design of stellar-parameter sensitive $uv$ filters by SAGES has enabled us to determine photometric-metallicity estimates down to $-3.5$, similar to our previous results with the SkyMapper Southern Survey (SMSS), yielding a large sample of over five million metal-poor (MP; [Fe/H]$\le -1.0$) stars and nearly one million very metal-poor (VMP; [Fe/H]$\le -2.0$) stars. The typical precision is around $0.1$ dex for both dwarf and giant stars with [Fe/H]$>-1.0$, and 0.15-0.25/0.3-0.4 dex for dwarf/giant stars with [Fe/H]$<-1.0$. Using the precise parallax measurements and stellar colors from Gaia, effective temperature, luminosity classification, distance and stellar age are further derived for our sample stars. This huge data set in the Northern sky from SAGES, together with similar data in the Southern sky from SMSS, will greatly advance our understanding of the Milky Way, in particular its formation and evolution., Comment: 14 pages, 14 figures, 3 tables, accepted by ApJ. arXiv admin note: text overlap with arXiv:2104.14154

Finite-depth quantum circuits preserve the long-range entanglement structure in quantum states and map between states within a gapped phase. To map between states of different gapped phases, we can use Sequential Quantum Circuits which apply unitary transformations to local patches, strips, or other sub-regions of a system in a sequential way. The sequential structure of the circuit on the one hand preserves entanglement area law and hence the gapped-ness of the quantum states. On the other hand, the circuit has generically a linear depth, hence it is capable of changing the long-range correlation and entanglement of quantum states and the phase they belong to. In this paper, we discuss systematically the definition, basic properties, and prototypical examples of sequential quantum circuits that map product states to GHZ states, symmetry-protected topological states, intrinsic topological states, and fracton states. We discuss the physical interpretation of the power of the circuits through connection to condensation, Kramers-Wannier duality, and the notion of foliation for fracton phases., Comment: 22 pages, 14 figures

We study population distributions and lasing actions of N_2^+ driven by femtosecond lasers with various wavelengths, and uncover an efficient ionic excitation mechanism induced by synchronized ionization and multiphoton resonance. Our results show that the strongest N_2^+ lasing appears around 1000 nm pump wavelength. At the optimal wavelength, the pump-energy threshold for air lasing generation is reduced by five folds compared with that required by the previous 800 nm pump laser. Simulations based on the ionization-coupling model indicate that although the Stark-assisted three-photon resonance can be satisfied within a broad pump wavelength range, the optimal pump wavelength arises when the dynamic three-photon resonance temporally synchronizes with the ionization injection. In this case, the ionic dipoles created at each half optical cycle have the same phase. The dipole phase locking promotes the continuous population transfer from ionic ground state to the excited state, giving rise to a dramatic increase of excited-state population. This work provides new insight on the photoexcitation mechanism of ions in strong laser fields, and opens up a route for optimizing ionic radiations.

We provide a detailed analysis on tidal tails of the globular cluster M3 (NGC 5272). We first discover clear extra-tidal structures with slight S-shape near the cluster. This inspires us to examine the existence of its long tidal tails. We highlight potential stream stars using proper motions (PMs) of a model stream combined with the cluster's locus in a color-magnitude diagram (CMD). A 35 deg long leading tail and a 21 deg long trailing tail are successfully detected at the same time. Their corresponding overdensities can be recognized in CMD and PM space after subtracting background. We estimate stream width, star number density and surface brightness for both tails, as well as the distance variation along the entire stream. We then verify the connection of M3 and the Sv\"{o}l stream. Finally, we tabulate 11 member stars belonging to the M3 tidal stream with available spectroscopic observations., Comment: 17 pages, 13 figures, 1 table, accepted for publication in The Astrophysical Journal

In this paper, we study an algorithm for solving a class of nonconvex and nonsmooth nonseparable optimization problems. Based on proximal alternating linearized minimization (PALM), we propose a new iterative algorithm which combines two-step inertial extrapolation and Bregman distance. By constructing appropriate benefit function, with the help of Kurdyka--{\L}ojasiewicz property we establish the convergence of the whole sequence generated by proposed algorithm. We apply the algorithm to signal recovery, quadratic fractional programming problem and show the effectiveness of proposed algorithm., Comment: 28 pages, 8 figures, 4 tables. arXiv admin note: text overlap with arXiv:2306.04208

In the paper, we introduce several accelerate iterative algorithms for solving the multiple-set split common fixed-point problem of quasi-nonexpansive operators in real Hilbert space. Based on primal-dual method, we construct several iterative algorithms in a way that combines inertial technology and the self-adaptive stepsize such that the implementation of the algorithms doesn't need any prior information about bounded linear operator norm. Under suitable assumptions, weak convergence of the proposed algorithms is established. As applications, we obtain relative iterative algorithms to solve the multiple-set split feasibility problem. Finally, the performance of the proposed algorithms is illustrated by numerical experiments.

Classifier-free guidance is an effective sampling technique in diffusion models that has been widely adopted. The main idea is to extrapolate the model in the direction of text guidance and away from null-text guidance. In this paper, we demonstrate that null-text guidance in diffusion models is secretly a cartoon-style creator, i.e., the generated images can be efficiently transformed into cartoons by simply perturbing the null-text guidance. Specifically, we proposed two disturbance methods, i.e., Rollback disturbance (Back-D) and Image disturbance (Image-D), to construct misalignment between the noisy images used for predicting null-text guidance and text guidance (subsequently referred to as \textbf{null-text noisy image} and \textbf{text noisy image} respectively) in the sampling process. Back-D achieves cartoonization by altering the noise level of null-text noisy image via replacing $x_t$ with $x_{t+\Delta t}$. Image-D, alternatively, produces high-fidelity, diverse cartoons by defining $x_t$ as a clean input image, which further improves the incorporation of finer image details. Through comprehensive experiments, we delved into the principle of noise disturbing for null-text and uncovered that the efficacy of disturbance depends on the correlation between the null-text noisy image and the source image. Moreover, our proposed techniques, which can generate cartoon images and cartoonize specific ones, are training-free and easily integrated as a plug-and-play component in any classifier-free guided diffusion model. Project page is available at \url{https://nulltextforcartoon.github.io/}., Comment: Accepted by ACM MM 2023

The advent of open-source AI communities has produced a cornucopia of powerful text-guided diffusion models that are trained on various datasets. While few explorations have been conducted on ensembling such models to combine their strengths. In this work, we propose a simple yet effective method called Saliency-aware Noise Blending (SNB) that can empower the fused text-guided diffusion models to achieve more controllable generation. Specifically, we experimentally find that the responses of classifier-free guidance are highly related to the saliency of generated images. Thus we propose to trust different models in their areas of expertise by blending the predicted noises of two diffusion models in a saliency-aware manner. SNB is training-free and can be completed within a DDIM sampling process. Additionally, it can automatically align the semantics of two noise spaces without requiring additional annotations such as masks. Extensive experiments show the impressive effectiveness of SNB in various applications. Project page is available at https://magicfusion.github.io/., Comment: Accepted by ICCV 2023

We report the discovery of a new stream (dubbed as Yangtze) detected in $Gaia$ Data Release 3. The stream is at a heliocentric distance of $\sim$ 9.12 kpc and spans nearly 27$\deg$ by 1.9$\deg$ on sky. The colour-magnitude diagram of Yangtze indicates a stellar population of Age $\sim$ 11 Gyr and [M/H] $\sim$ -0.7 dex. It has a number density of about 5.5 stars degree$^{-2}$ along with a surface brightness of $\Sigma_G \simeq$ 34.9 mag arcsec$^{-2}$. The dynamics and metallicity estimate suggest that Yangtze may be closely related to Palomar 1 and the Anticenter stream., Comment: 8 pages, 4 figures, accepted by ApJL. arXiv admin note: substantial text overlap with arXiv:2208.05176

Recently, the success of pre-training in text domain has been fully extended to vision, audio, and cross-modal scenarios. The proposed pre-training models of different modalities are showing a rising trend of homogeneity in their model structures, which brings the opportunity to implement different pre-training models within a uniform framework. In this paper, we present TencentPretrain, a toolkit supporting pre-training models of different modalities. The core feature of TencentPretrain is the modular design. The toolkit uniformly divides pre-training models into 5 components: embedding, encoder, target embedding, decoder, and target. As almost all of common modules are provided in each component, users can choose the desired modules from different components to build a complete pre-training model. The modular design enables users to efficiently reproduce existing pre-training models or build brand-new one. We test the toolkit on text, vision, and audio benchmarks and show that it can match the performance of the original implementations.

Conventional autoregressive left-to-right (L2R) sequence generation faces two issues during decoding: limited to unidirectional target sequence modeling, and constrained on strong local dependencies. To address the aforementioned problem, we propose P$^3$LM, a probabilistically permuted prophet language model, which strengthens the modeling of bidirectional information and long token dependencies for sequence generation. Specifically, P$^3$LM learns to generate tokens in permuted order upon an order-aware transformer decoder, as well as to generate the corresponding future $N$ tokens with a multi-stream attention mechanism. Extensive experiments are conducted on the GLGE benchmark, which includes four datasets for summarization, two for question generation, one for conversational question answering, and one for dialog response generation, where P$^3$LM achieves state-of-the-art results compared with strong publicly available generative pre-training methods., Comment: Accepted to EMNLP(Findings) 2022

We examine a wavefunction ansatz in which a doped hole can experience a quantum transition from a charge $+e$ Landau quasiparticle to a neutral spinon as a function of the underlying spin-spin correlation. As shown variationally, such a wavefunction accurately captures all the essential features revealed by exact diagonalization and density matrix renormalization group simulations in a two-leg $t$-$J$ ladder. Hence its analytic form can provide an explicit understanding of the mechanism for the unconventional ground state. The transition in the phase diagram is accompanied by a change of the hole composite from a tight charge-spin binding to a loosely-bound hole-spin pair. In the latter, the hole carries a \emph{finite} spin current but with vanishing charge current in the degenerate ground states. We show that the charge of the hole composite here is dynamically diminished due to an internal relative hole-spin motion, which is fundamentally distinct from a simple charge-spin separation in a one-dimensional case. We further show that the same effect is also responsible for a strong pairing between two doped holes in such a non-Landau quasiparticle regime., Comment: 18 pages, 11 figures, comments are welcome

Without densely tiled anchor boxes or grid points in the image, sparse R-CNN achieves promising results through a set of object queries and proposal boxes updated in the cascaded training manner. However, due to the sparse nature and the one-to-one relation between the query and its attending region, it heavily depends on the self attention, which is usually inaccurate in the early training stage. Moreover, in a scene of dense objects, the object query interacts with many irrelevant ones, reducing its uniqueness and harming the performance. This paper proposes to use IoU between different boxes as a prior for the value routing in self attention. The original attention matrix multiplies the same size matrix computed from the IoU of proposal boxes, and they determine the routing scheme so that the irrelevant features can be suppressed. Furthermore, to accurately extract features for both classification and regression, we add two lightweight projection heads to provide the dynamic channel masks based on object query, and they multiply with the output from dynamic convs, making the results suitable for the two different tasks. We validate the proposed scheme on different datasets, including MS-COCO and CrowdHuman, showing that it significantly improves the performance and increases the model convergence speed., Comment: ACCV2022

Context. Several dynamically cold streams have been associated with certain globular clusters (GCs) based on orbital energies and angular momenta. Some of these streams are surprisingly far apart from their progenitors and one such pair is Triangulum and NGC 5824. Triangulum can be considered as a piece of NGC 5824 leading tail since the cluster's future orbit matches with the stream's track well. The existence of the leading tail for NGC 5824 is the motivation behind the search for its trailing tail. Aims. Our goal is to confirm the connection between Triangulum and NGC 5824 and seek the trailing tail of the cluster. Methods. The selection of member stars of Triangulum is made through various cuts in metallicity, proper motions (PMs), radial velocity and color-magnitude diagram (CMD). The selected members are compared in phase space to a mock stream which models the disruption of NGC 5824. We then try to detect the trailing tail of the cluster based on a modified matched-filter technique. Stars are assigned weights using their color differences from the cluster's locus in CMD. These weights are further scaled based on stars' departures from expected PMs of the model stream. Results. A total of 26 member stars for Triangulum are obtained and 16 of them are newly identified. These members are consistent with the mock stream in the phase space and their metalicity and position on the CMD are in good agreements with NGC 5824. By applying the matched-filter, a tenuous trailing tail of the cluster is detected, spanning $\sim$ 50$^\circ$ long on sky. The signature matches with the mock stream's trajectory well. Conclusions. Our results support that Triangulum stream acts as a part of the leading tail for NGC 5824. On the trailing side, we have detected a 50$^\circ$ tail extended from the cluster. The existence of both leading and trailing tails for the GC NGC 5824 is verified., Comment: Accepted for publication in A&A

We report the discovery of a cold stream near the southern Galactic pole (dubbed as SGP-S) detected in $Gaia$ Early Data Release 3. The stream is at a heliocentric distance of $\sim$ 9.5 kpc and spans nearly 58$^\circ$ by 0.6$^\circ$ on sky. The colour-magnitude diagram of SGP-S indicates an old and metal-poor (age $\sim$ 12 Gyr, [M/H] $\sim$ -2.0 dex) stellar population. The stream's surface brightness reaches an exceedingly low level of $\Sigma_G \simeq$ 36.2 mag arcsec$^{-2}$. Neither extant globular clusters nor other known streams are associated with SGP-S.

In the semi-supervised learning field, Graph Convolution Network (GCN), as a variant model of GNN, has achieved promising results for non-Euclidean data by introducing convolution into GNN. However, GCN and its variant models fail to safely use the information of risk unlabeled data, which will degrade the performance of semi-supervised learning. Therefore, we propose a Safe GCN framework (Safe-GCN) to improve the learning performance. In the Safe-GCN, we design an iterative process to label the unlabeled data. In each iteration, a GCN and its supervised version(S-GCN) are learned to find the unlabeled data with high confidence. The high-confidence unlabeled data and their pseudo labels are then added to the label set. Finally, both added unlabeled data and labeled ones are used to train a S-GCN which can achieve the safe exploration of the risk unlabeled data and enable safe use of large numbers of unlabeled data. The performance of Safe-GCN is evaluated on three well-known citation network datasets and the obtained results demonstrate the effectiveness of the proposed framework over several graph-based semi-supervised learning methods.

This paper describes the THUEE team's speech recognition system for the IARPA Open Automatic Speech Recognition Challenge (OpenASR21), with further experiment explorations. We achieve outstanding results under both the Constrained and Constrained-plus training conditions. For the Constrained training condition, we construct our basic ASR system based on the standard hybrid architecture. To alleviate the Out-Of-Vocabulary (OOV) problem, we extend the pronunciation lexicon using Grapheme-to-Phoneme (G2P) techniques for both OOV and potential new words. Standard acoustic model structures such as CNN-TDNN-F and CNN-TDNN-F-A are adopted. In addition, multiple data augmentation techniques are applied. For the Constrained-plus training condition, we use the self-supervised learning framework wav2vec2.0. We experiment with various fine-tuning techniques with the Connectionist Temporal Classification (CTC) criterion on top of the publicly available pre-trained model XLSR-53. We find that the frontend feature extractor plays an important role when applying the wav2vec2.0 pre-trained model to the encoder-decoder based CTC/Attention ASR architecture. Extra improvements can be achieved by using the CTC model finetuned in the target language as the frontend feature extractor., Comment: accepted by INTERSPEECH 2022

We investigate the inclusive and semi-inclusive productions of spin-3/2 hadrons, such as $\Omega$, in unpolarized $e^+ e^-$ annihilation. The general differential cross sections are expressed in terms of structure functions in accordance to the polarization of the hadron and the azimuthal modulations. We derive a complete definition of quark transverse momentum dependent (TMD) fragmentation functions (FFs) to spin-3/2 hadrons for the first time from the decomposition of the quark-quark correlation matrix at leading twist, 14 of which are newly defined corresponding to rank-3 tensor polarized hadron. The collinear FFs are obtained from the $k_T$-integrated correlation matrix, and only two TMD FFs with rank-3 tensor polarization have nonvanishing collinear counterparts. Then we perform a leading order calculation of the unpolarized differential cross sections. In the single-hadron inclusive production, only two structure functions are found nonzero and none of the rank-3 tensor polarized FFs contributes. For the nearly back-to-back two-hadron production, half of the 48 structure functions are found nonzero even if the spin of the second hadron is not analyzed, and ten of the rank-3 tensor polarized TMD FFs contribute. Therefore, one can study the rank-3 tensor polarized FFs via the production of a spin-3/2 hadron and an unpolarized hadron in unpolarized $e^+ e^-$ collision experiments. These newly defined FFs can be further applied in semi-inclusive deep inelastic scattering processes for the study of nucleon structures., Comment: 42 pages, 4 figures, matching the published version in Physical Review D

Quantum interference occurs frequently in the interaction of laser radiation with materials, leading to a series of fascinating effects such as lasing without inversion, electromagnetically induced transparency, Fano resonance, etc. Such quantum interference effects are mostly enabled by single-photon resonance with transitions in the matter, regardless of how many optical frequencies are involved. Here, we demonstrate quantum interference driven by multiple photons in the emission spectroscopy of nitrogen ions that are resonantly pumped by ultrafast infrared laser pulses. In the spectral domain, Fano resonance is observed in the emission spectrum, where a laser-assisted dynamic Stark effect creates the continuum. In the time domain, the fast-evolving emission is measured, revealing the nature of free-induction decay (FID) arising from quantum radiation and molecular cooperativity. These findings clarify the mechanism of coherent emission of nitrogen ions pumped with MIR pump laser and are likely to be universal. The present work opens a route to explore the important role of quantum interference during the interaction of intense laser pulses with materials near multiple photon resonance., Comment: 20 pages, 8 figures

Dialogue state tracking (DST) aims to predict the current dialogue state given the dialogue history. Existing methods generally exploit the utterances of all dialogue turns to assign value for each slot. This could lead to suboptimal results due to the information introduced from irrelevant utterances in the dialogue history, which may be useless and can even cause confusion. To address this problem, we propose LUNA, a sLot-tUrN Alignment enhanced approach. It first explicitly aligns each slot with its most relevant utterance, then further predicts the corresponding value based on this aligned utterance instead of all dialogue utterances. Furthermore, we design a slot ranking auxiliary task to learn the temporal correlation among slots which could facilitate the alignment. Comprehensive experiments are conducted on multi-domain task-oriented dialogue datasets, i.e., MultiWOZ 2.0, MultiWOZ 2.1, and MultiWOZ 2.2. The results show that LUNA achieves new state-of-the-art results on these datasets., Comment: Accepted to NAACL 2022

Machine reading comprehension (MRC) that requires discrete reasoning involving symbolic operations, e.g., addition, sorting, and counting, is a challenging task. According to this nature, semantic parsing-based methods predict interpretable but complex logical forms. However, logical form generation is nontrivial and even a little perturbation in a logical form will lead to wrong answers. To alleviate this issue, multi-predictor -based methods are proposed to directly predict different types of answers and achieve improvements. However, they ignore the utilization of symbolic operations and encounter a lack of reasoning ability and interpretability. To inherit the advantages of these two types of methods, we propose OPERA, an operation-pivoted discrete reasoning framework, where lightweight symbolic operations (compared with logical forms) as neural modules are utilized to facilitate the reasoning ability and interpretability. Specifically, operations are first selected and then softly executed to simulate the answer reasoning procedure. Extensive experiments on both DROP and RACENum datasets show the reasoning ability of OPERA. Moreover, further analysis verifies its interpretability., Comment: Accepted to NAACL 2022

It is a great discovery in physics of the twentieth century that the elementary particles in Nature are dictated by gauge forces, characterized by a nonintegrable phase factor that an elementary particle of charge $q$ acquires from A to B points: $$P \exp\left(i\frac{q}{\hbar c} \int_A^B A_\mu dx^\mu\right)$$ where $A_\mu$ is the gauge potential and $P$ stands for path ordering. In a many-body system of strongly correlated electrons, if the so-called Mott gap is opened up by interaction, the corresponding Hilbert space will be fundamentally changed. A novel nonintegrable phase factor known as phase-string will appear and replace the conventional Fermi statistics to dictate the low-lying physics. Protected by the Mott gap, which is clearly identified in the high-$T_c$ cuprate with a magnitude > 1.5 eV, such a singular phase factor can enforce a fractionalization of the electrons, leading to a dual world of exotic elementary particles with a topological gauge structure. A non-Fermi-liquid "parent" state will emerge, in which the gapless Landau quasiparticle is only partially robust around the so-called Fermi arc regions, while the main dynamics are dominated by two types of gapped spinons. Antiferromagnetism, superconductivity, and a Fermi liquid with full Fermi surface can be regarded as the low-temperature instabilities of this new parent state. Both numerics and experiments provide direct evidence for such an emergent physics of the Mottness, which lies in the core of a high-$T_c$ superconducting mechanism., Comment: 16 pages, 5 figures, comments are welcome