Search

We present the first HI mass function (HIMF) measurement for the recent FAST All Sky HI (FASHI) survey and the most complete measurements of HIMF in the local universe so far by combining the HI catalogues from HI Parkes All Sky Survey (HIPASS), Arecibo Legacy Fast ALFA (ALFALFA) and FASHI surveys at redshift 0 < z < 0.05, covering 76% of the entire sky. We adopt the same methods to estimate distances, calculate sample completeness, and determine the HIMF for all three surveys. The best-fitting Schechter function for the total HIMF has a low-mass slope parameter alpha = -1.30 and a knee mass log(Ms) = 9.86 and a normalization phi_s = 0.00658. This gives the cosmic HI abundance omega_HI= 0.000454. We find that a double Schechter function with the same slope alpha better describes our HIMF, and the two different knee masses are log(Ms1) = 9.96 and log(Ms2) = 9.65. We verify that the measured HIMF is marginally affected by the choice of distance estimates. The effect of cosmic variance is significantly suppressed by combining the three surveys and it provides a unique opportunity to obtain an unbiased estimate of the HIMF in the local universe., Comment: 10 pages, 7 figures, submitted to A&A

Large Language Models for Code (LLMs4Code) have been found to exhibit outstanding performance in the software engineering domain, especially the remarkable performance in coding tasks. However, even the most advanced LLMs4Code can inevitably contain incorrect or outdated code knowledge. Due to the high cost of training LLMs4Code, it is impractical to re-train the models for fixing these problematic code knowledge. Model editing is a new technical field for effectively and efficiently correcting erroneous knowledge in LLMs, where various model editing techniques and benchmarks have been proposed recently. Despite that, a comprehensive study that thoroughly compares and analyzes the performance of the state-of-the-art model editing techniques for adapting the knowledge within LLMs4Code across various code-related tasks is notably absent. To bridge this gap, we perform the first systematic study on applying state-of-the-art model editing approaches to repair the inaccuracy of LLMs4Code. To that end, we introduce a benchmark named CLMEEval, which consists of two datasets, i.e., CoNaLa-Edit (CNLE) with 21K+ code generation samples and CodeSearchNet-Edit (CSNE) with 16K+ code summarization samples. With the help of CLMEEval, we evaluate six advanced model editing techniques on three LLMs4Code: CodeLlama (7B), CodeQwen1.5 (7B), and Stable-Code (3B). Our findings include that the external memorization-based GRACE approach achieves the best knowledge editing effectiveness and specificity (the editing does not influence untargeted knowledge), while generalization (whether the editing can generalize to other semantically-identical inputs) is a universal challenge for existing techniques. Furthermore, building on in-depth case analysis, we introduce an enhanced version of GRACE called A-GRACE, which incorporates contrastive learning to better capture the semantics of the inputs., Comment: Accepted by ICSE2025. The code is available at: https://github.com/xpq-tech/code-llmedit.git

The Mixture-of-Experts (MoE) architecture has demonstrated significant advantages in the era of Large Language Models (LLMs), offering enhanced capabilities with reduced inference costs. However, deploying MoE-based LLMs on memoryconstrained edge devices remains challenging due to their substantial memory requirements. While existing expertoffloading methods alleviate the memory requirements, they often incur significant expert-loading costs or compromise model accuracy. We present HOBBIT, a mixed precision expert offloading system to enable flexible and efficient MoE inference. Our key insight is that dynamically replacing less critical cache-miss experts with low precision versions can substantially reduce expert-loading latency while preserving model accuracy. HOBBIT introduces three innovative techniques that map the natural hierarchy of MoE computation: (1) a token-level dynamic expert loading mechanism, (2) a layer-level adaptive expert prefetching technique, and (3) a sequence-level multidimensional expert caching policy. These innovations fully leverage the benefits of mixedprecision expert inference. By implementing HOBBIT on top of the renowned LLM inference framework Llama.cpp, we evaluate its performance across different edge devices with representative MoE models. The results demonstrate that HOBBIT achieves up to a 9.93x speedup in decoding compared to state-of-the-art MoE offloading systems.

Creativity, both in human and diffusion models, remains an inherently abstract concept; thus, simply adding "creative" to a prompt does not yield reliable semantic recognition by the model. In this work, we concretize the abstract notion of "creative" through the TP2O task, which aims to merge two unrelated concepts, and introduce CreTok, redefining "creative" as the token $\texttt{}$. This redefinition offers a more concrete and universally adaptable representation for concept blending. This redefinition occurs continuously, involving the repeated random sampling of text pairs with different concepts and optimizing cosine similarity between target and constant prompts. This approach enables $\texttt{}$ to learn a method for creative concept fusion. Extensive experiments demonstrate that the creative capability enabled by $\texttt{}$ substantially surpasses recent SOTA diffusion models and achieves superior creative generation. CreTok exhibits greater flexibility and reduced time overhead, as $\texttt{}$ can function as a universal token for any concept, facilitating creative generation without retraining.

Galaxy interactions can significantly affect the star formation in galaxies, but it remains a challenge to achieve a consensus on the star formation rate (SFR) enhancement in galaxy pairs. Here, we investigate the SFR enhancement of gas-rich galaxy pairs detected by the Widefield ASKAP L-band Legacy All-sky Blind surveY (WALLABY). We construct a sample of 278 paired galaxies spanning a stellar mass ($M_\ast$) range from $10^{7.6}$ to $10^{11.2}M_\odot$. We obtain individual masses of atomic hydrogen (HI) for these paired galaxies, using a novel deblending algorithm for HI data cubes. Quantifying the interaction stages and strengths with parameters motivated by first principles, we find that at fixed stellar and HI mass, the alteration in SFR of galaxy pairs starts when their dark matter halos encounter. For galaxies with stellar mass lower than $10^9M_\odot$, their SFRs show tentative suppression of 1.4 sigma after the halo encounter, and then become enhanced when their HI disks overlap, regardless of mass ratios. In contrast, the SFRs of galaxies with $M_\ast > 10^9M_\odot$ increase monotonically toward smaller projected distances and radial velocity offsets. When a close companion is present, a pronounced SFR enhancement is found for the most HI-poor high-mass galaxies in our sample. Collecting the observational evidence, we provide a coherent picture of the evolution of galaxy pairs, and discuss how the tidal effects and hydrodynamic processes shape the SFR enhancement. Our results provide a coherent picture of gas-rich galaxy interactions and impose constraints on the underlying physical processes., Comment: 25 pages, 15 figures, accepted for publication in ApJ

In this study, we introduce a novel implementation of density functional theory integrated with single-site dynamical mean-field theory to investigate the complex properties of strongly correlated materials. This comprehensive first-principles many-body computational toolkit, termed $\texttt{Zen}$, utilizes the Vienna $\textit{ab initio}$ simulation package and the $\texttt{Quantum ESPRESSO}$ code to perform density functional theory calculations and generate band structures for realistic materials. The challenges associated with correlated electron systems are addressed through two distinct yet complementary quantum impurity solvers: the natural orbitals renormalization group solver for zero temperature and the hybridization expansion continuous-time quantum Monte Carlo solver for finite temperature. Additionally, this newly developed toolkit incorporates several valuable post-processing tools, such as $\texttt{ACFlow}$, which employs the maximum entropy method and the stochastic pole expansion method for the analytic continuation of Matsubara Green's functions and self-energy functions. To validate the performance of this toolkit, we examine three representative cases: the correlated metal SrVO$_{3}$, the nickel-based unconventional superconductor La$_{3}$Ni$_{2}$O$_{7}$, and the wide-gap Mott insulator MnO. The results obtained demonstrate strong agreement with experimental findings and previously available theoretical results. Notably, we successfully elucidate the quasiparticle peak and band renormalization in SrVO$_{3}$, the dominance of Hund correlation in La$_{3}$Ni$_{2}$O$_{7}$, and the pressure-driven insulator-metal transition as well as the high-spin to low-spin transition in MnO. These findings suggest that $\texttt{Zen}$ is proficient in accurately describing the electronic structures of $d$-electron correlated materials., Comment: 14 pages, 8 figures, 1 table

Previous studies have highlighted significant advancements in multimodal fusion. Nevertheless, such methods often encounter challenges regarding the efficacy of feature extraction, data integrity, consistency of feature dimensions, and adaptability across various downstream tasks. This paper proposes a generalized multimodal fusion method (GMF) via the Poisson-Nernst-Planck (PNP) equation, which adeptly addresses the aforementioned issues. Theoretically, the optimization objective for traditional multimodal tasks is formulated and redefined by integrating information entropy and the flow of gradient backward step. Leveraging these theoretical insights, the PNP equation is applied to feature fusion, rethinking multimodal features through the framework of charged particles in physics and controlling their movement through dissociation, concentration, and reconstruction. Building on these theoretical foundations, GMF disassociated features which extracted by the unimodal feature extractor into modality-specific and modality-invariant subspaces, thereby reducing mutual information and subsequently lowering the entropy of downstream tasks. The identifiability of the feature's origin enables our approach to function independently as a frontend, seamlessly integrated with a simple concatenation backend, or serve as a prerequisite for other modules. Experimental results on multiple downstream tasks show that the proposed GMF achieves performance close to the state-of-the-art (SOTA) accuracy while utilizing fewer parameters and computational resources. Furthermore, by integrating GMF with advanced fusion methods, we surpass the SOTA results., Comment: NeurIPS 2024 Rejected paper, 28 pages

Non-axisymmetric structures, such as bars and spiral arms, are known to concentrate molecular gas and star formation in galaxy centers, actively building up the pseudo-bulges. However, a direct link between the neutral (i.e., molecular and atomic) gas distribution and the exerted torque forces over a broader radial range of galactic disks still remains to be explored. In the present work, we investigate this link by carefully evaluating the torque force field using the $3.6\, \mathrm{\mu m}$ images for 17 The H I Nearby Galaxy Survey (THINGS) galaxies, and measuring neutral gas distribution on resolved atomic and molecular line maps. We find that galaxies with stronger torque forces show a more concentrated neutral gas distribution over the disk-scale, defined as half the isophotal radius at $25.5\, \mathrm{mag\, arcsec^{-2}}$. The correlation holds regardless of whether the neutral gas fraction, or the effective stellar mass surface density is controlled for. In addition, $\mathrm{kpc}$-scale neutral gas over-densities tend to be located close to the local maxima of torque forces. Most of these correlations involving the torque forces are comparatively stronger than those using the traditional Fourier amplitudes to quantify the non-axisymmetric structures. These results are consistent with the scenario that non-axisymmetric structures exert torque forces, and trigger dissipative processes to transport gas inward, not only to build the pseudo-bulges, but also fuel the inner disk growth. In this regard, non-axisymmetric structures inducing stronger torque forces appear to be more efficient in these processes., Comment: Accepted for publication in ApJ, 16 pages (main text), 14 figures, 4 tables

Label Distribution Learning (LDL) is a novel machine learning paradigm that addresses the problem of label ambiguity and has found widespread applications. Obtaining complete label distributions in real-world scenarios is challenging, which has led to the emergence of Incomplete Label Distribution Learning (InLDL). However, the existing InLDL methods overlook a crucial aspect of LDL data: the inherent imbalance in label distributions. To address this limitation, we propose \textbf{Incomplete and Imbalance Label Distribution Learning (I\(^2\)LDL)}, a framework that simultaneously handles incomplete labels and imbalanced label distributions. Our method decomposes the label distribution matrix into a low-rank component for frequent labels and a sparse component for rare labels, effectively capturing the structure of both head and tail labels. We optimize the model using the Alternating Direction Method of Multipliers (ADMM) and derive generalization error bounds via Rademacher complexity, providing strong theoretical guarantees. Extensive experiments on 15 real-world datasets demonstrate the effectiveness and robustness of our proposed framework compared to existing InLDL methods.

Disk galaxies viewed as thin planar structures resulting from the conservation of angular momentum of an initially rotating pre-galactic cloud allow merely a first-order model of galaxy formation. Still, the presence of vertically extended structures has allowed us to gather a deeper understanding of the richness in astrophysical processes (e.g., minor mergers, secular evolution) that ultimately result in the observed diversity in disk galaxies and their vertical extensions. We measure the stellar disk scale height of 46 edge-on spiral galaxies from the Spitzer Survey of Stellar Structure in Galaxies (S$^{4}$G) project. This paper aims to investigate the radial variation of the stellar disk vertical scale height and the existence of the so-called thick disk component in our sample. The measurements were done using one-, two-, and three-dimensional profile fitting techniques using simple models. We found that two-thirds of our sample shows the presence of a thick disk, suggesting that these galaxies have been accreting gaseous material from their surroundings. We found an average thick-to-thin disk scale height ratio of 2.65, which agrees with previous studies. Our findings also support the disk flaring model, which suggests that the vertical scale height increases with radius. We further found good correlations: between the scale height $h_{z}$ and the scale length and between $h_z$ and the optical de Vaucouleurs radius $R_{25}$., Comment: 28 pages, 24 figures, 4 tables, accepted for publication in ApJ

In a recent paper arXiv:2409.01034, Gong et al. studied the disorder effects in nodal-knot semimetal through Wilson momentum-shell renormalization group (RG) method. They stated that various nodal-knot transitions emerge driven by disorders. However, we notice that there are serious problems in this paper. First, in this paper, the RG analysis is not performed in the momentum space around the Fermi surface but in an incorrect momentum space around the point $k=0$. Accordingly, the RG equations are completely unreliable. Second, the criterion for phase transition employed in this paper is invalid. Accroding to the criterion in this paper, we can find that the various phase transitions stated in this paper even emerge in clean nodal-knot semimetal system! Thus, the conclusions in this paper are unfounded., Comment: Comment on arXiv:2409.01034

Diffusion models often face slow convergence, and existing efficient training techniques, such as Parameter-Efficient Fine-Tuning (PEFT), are primarily designed for fine-tuning pre-trained models. However, these methods are limited in adapting models to variable sizes for real-world deployment, where no corresponding pre-trained models exist. To address this, we introduce FINE, a method based on the Learngene framework, to initializing downstream networks leveraging pre-trained models, while considering both model sizes and task-specific requirements. FINE decomposes pre-trained knowledge into the product of matrices (i.e., $U$, $\Sigma$, and $V$), where $U$ and $V$ are shared across network blocks as ``learngenes'', and $\Sigma$ remains layer-specific. During initialization, FINE trains only $\Sigma$ using a small subset of data, while keeping the learngene parameters fixed, marking it the first approach to integrate both size and task considerations in initialization. We provide a comprehensive benchmark for learngene-based methods in image generation tasks, and extensive experiments demonstrate that FINE consistently outperforms direct pre-training, particularly for smaller models, achieving state-of-the-art results across variable model sizes. FINE also offers significant computational and storage savings, reducing training steps by approximately $3N\times$ and storage by $5\times$, where $N$ is the number of models. Additionally, FINE's adaptability to tasks yields an average performance improvement of 4.29 and 3.30 in FID and sFID across multiple downstream datasets, highlighting its versatility and efficiency.

We showcase the plain diffusion models with Transformers are effective predictors of fluid dynamics under various working conditions, e.g., Darcy flow and high Reynolds number. Unlike traditional fluid dynamical solvers that depend on complex architectures to extract intricate correlations and learn underlying physical states, our approach formulates the prediction of flow dynamics as the image translation problem and accordingly leverage the plain diffusion model to tackle the problem. This reduction in model design complexity does not compromise its ability to capture complex physical states and geometric features of fluid dynamical equations, leading to high-precision solutions. In preliminary tests on various fluid-related benchmarks, our DiffFluid achieves consistent state-of-the-art performance, particularly in solving the Navier-Stokes equations in fluid dynamics, with a relative precision improvement of +44.8%. In addition, we achieved relative improvements of +14.0% and +11.3% in the Darcy flow equation and the airfoil problem with Euler's equation, respectively. Code will be released at https://github.com/DongyuLUO/DiffFluid upon acceptance.

Since hybrid beamforming (HBF) can approach the performance of fully-digital beamforming (FDBF) with much lower hardware complexity, we investigate the HBF design for beam-hopping (BH) low earth orbit (LEO) satellite communications (SatComs). Aiming at maximizing the sum-rate of totally illuminated beam positions during the whole BH period, we consider joint beamforming and illumination pattern design subject to the HBF constraints and sum-rate requirements. To address the non-convexity of the HBF constraints, we temporarily replace the HBF constraints with the FDBF constraints. Then we propose an FDBF and illumination pattern random search (FDBF-IPRS) scheme to optimize illumination patterns and fully-digital beamformers using constrained random search and fractional programming methods. To further reduce the computational complexity, we propose an FDBF and illumination pattern alternating optimization (FDBF-IPAO) scheme, where we relax the integer illumination pattern to continuous variables and after finishing all the iterations we quantize the continuous variables into integer ones. Based on the fully-digital beamformers designed by the FDBF-IPRS or FDBF-IPAO scheme, we propose an HBF alternating minimization algorithm to design the hybrid beamformers. Simulation results show that the proposed schemes can achieve satisfactory sum-rate performance for BH LEO SatComs.

This paper selected eight totally eclipsing contact binaries for photometric and spectroscopic studies, spectral data were analyzed by ULySS, and photometric data were analyzed using PHOEBE through MCMC sampling. We used two methods to calculate the initial values for running MCMC: one method is a new approach proposed by ourselves to model light curves without spots, while the other method is the genetic algorithm (GA) which can determine physical parameters with spot. Due to the results, these eight targets are all small mass ratio contact binary stars with a mass ratio below 0.25. There are four systems exhibiting O'Connell effect. By adding a dark spot on the primary component, the ideal fitting can be obtained. Meanwhile, it was found that two systems are shallow contact binaries, while the remaining six are moderate contact binaries. An O-C analysis of the eight eclipsing binary stars revealed that seven of them exhibit long-term changes. Four of them display a long-term decreasing trend, while the other three show a long-term increasing trend, and two targets exhibit periodic variations. The decrease in period may be caused by the transfer of matter from the more massive component to the less massive component, while the increase in period may be caused by the transfer of matter from the less massive component to the more massive component. The absolute physical parameters, orbital angular momentum, initial masses, and ages of these eight systems were calculated. Additionally, their mass-luminosity and mass-radius distributions were analyzed., Comment: 20 pages, 9 figures, and 12 tables, accepted by ApJ

Diamond particles have many interesting properties and possible applications. However, producing diamond particles with well-defined shapes at scale is challenging because diamonds are chemically inert and extremely hard. Here, we show air oxidation, a routine method for purifying diamonds, can be used to precisely shape diamond particles at scale. By exploiting the distinct reactivities of different crystal facets and defects inside the diamond, layer-by-layer outward-to-inward and inward-to-outward oxidation produced diverse diamond shapes including sphere, twisted surface, pyramidal islands, inverted pyramids, nano-flowers, and hollow polygons. The nanosculpted diamonds had more and finer features that enabled them to outperform the original raw diamonds in various applications. Using experimental observations and Monte Carlo simulations, we built a shape library that guides the design and fabrication of diamond particles with well-defined shapes and functional value. Our study presents a simple, economical and scalable way to produce shape-customized diamonds for various photonics, catalysis, quantum and information technology applications.

Employing the renormalization group approach, we carefully investigate the critical behavior of two-dimensional tilted semi-Dirac semimetals induced by the fermion-fermion interactions in the low-energy regime. After incorporating all one-loop corrections, we derive the coupled RG equations of all related parameters and introduce two distinct strategies, named as Strategy I and Strategy II, to describe different scenarios. A detailed numerical analysis yields several interesting behavior in the low-energy limit. At first, we notice that the fermion-fermion interactions either vanish or diverge in the Strategy I, depending on the initial values of the tilting parameter and the fermionic couplings, whereas these interactions in the Strategy II always diverge at a certain critical energy scale, which is associated with the initial conditions. Next, the microstructural parameter $\alpha$ and the fermion velocity $v_F$ in the Strategy I share the similar behavior with their Strategy II counterparts. It is observed that fermion-fermion interactions lead to an increase in $\alpha$ while driving a decrease in $v_F$. Furthermore, the system can either be attracted by the Gaussian fixed point (GFP) or certain relatively fixed point (RFP) in the Strategy I. However, it always flow towards the RFP in the Strategy II at the lowest-energy limit. These results would provide helpful insights into the studies on observable quantities and phase transitions in the two-dimensional tilted semi-Dirac semimetals and the analogous semimetals., Comment: 14 pages, 11 figures

Let $T_{4p}=\langle a,b\mid a^{2p}=1,a^p=b^2, b^{-1}ab=a^{-1}\rangle$ be the dicyclic group of order $4p$. A Cayley digraph over $T_{4p}$ is called a dicirculant digraph. In this paper, we calculate the number of (connected) dicirculant digraphs of order $4p$ ($p$ prime) up to isomorphism by using the P\'olya Enumeration Theorem. Moreover, we get the number of (connected) dicirculant digraphs of order $4p$ ($p$ prime) and out-degree $k$ for every $k$.

The global self-attention mechanism in diffusion transformers involves redundant computation due to the sparse and redundant nature of visual information, and the attention map of tokens within a spatial window shows significant similarity. To address this redundancy, we propose the Proxy-Tokenized Diffusion Transformer (PT-DiT), which employs sparse representative token attention (where the number of representative tokens is much smaller than the total number of tokens) to model global visual information efficiently. Specifically, within each transformer block, we compute an averaging token from each spatial-temporal window to serve as a proxy token for that region. The global semantics are captured through the self-attention of these proxy tokens and then injected into all latent tokens via cross-attention. Simultaneously, we introduce window and shift window attention to address the limitations in detail modeling caused by the sparse attention mechanism. Building on the well-designed PT-DiT, we further develop the Qihoo-T2X family, which includes a variety of models for T2I, T2V, and T2MV tasks. Experimental results show that PT-DiT achieves competitive performance while reducing the computational complexity in both image and video generation tasks (e.g., a 49% reduction compared to DiT and a 34% reduction compared to PixArt-$\alpha$). The visual exhibition and source code of Qihoo-T2X is available at https://360cvgroup.github.io/Qihoo-T2X/.

In recent years, deep learning has significantly advanced the MIDI domain, solidifying music generation as a key application of artificial intelligence. However, existing research primarily focuses on Western music and encounters challenges in generating melodies for Chinese traditional music, especially in capturing modal characteristics and emotional expression. To address these issues, we propose a new architecture, the Dual-Feature Modeling Module, which integrates the long-range dependency modeling of the Mamba Block with the global structure capturing capabilities of the Transformer Block. Additionally, we introduce the Bidirectional Mamba Fusion Layer, which integrates local details and global structures through bidirectional scanning, enhancing the modeling of complex sequences. Building on this architecture, we propose the REMI-M representation, which more accurately captures and generates modal information in melodies. To support this research, we developed FolkDB, a high-quality Chinese traditional music dataset encompassing various styles and totaling over 11 hours of music. Experimental results demonstrate that the proposed architecture excels in generating melodies with Chinese traditional music characteristics, offering a new and effective solution for music generation.

We theoretically propose that van der Waals monolayer Re(Ag$X_3$)$_2$ ($X=$ Cl, Br, I) have four consecutive flat Chern bands in the 120$^\circ$ spiral antiferromagnetic ground state. The nontrivial topology of these Chern bands emerges from the synergy between Re $t_{2g}$ band folding with non-collinear spin configuration and spin-orbit coupling. By constructing maximally localized Wannier functions directly from first-principles calculations, the tight-binding model is developed to describe the consecutive Chern bands. Exact diagonalization suggests that $1/3$ filling of these Chern bands host correlated states such as fractional Chern insulator and charge density wave state. Interestingly, the spin configurations and band topology of Chern bands are tunable by external magnetic field. The general physics from the $d$ orbitals here applies to a large class materials such as Re(Cu$X_3$)$_2$ and Re(Au$X_3$)$_2$. These interesting predictions, if realized experimentally, could greatly promote the research and application of topological quantum physics at elevated temperature.

Coherent information quantifies the transmittable quantum information through a channel and is directly linked to the channel's quantum capacity. In the context of dynamical purification transitions, scrambling dynamics sustain extensive and positive coherent information at low measurement rates, but noises can suppress it to zero or negative values. Here we introduce quantum-enhanced operations into a noisy monitored quantum circuit. This circuit, viewed as a quantum channel, undergoes a phase transition in coherent information from a recoverable phase with positive values to an irrecoverable phase with negative values. This transition is modulated by the relative frequency of noise and quantum-enhanced operations. The existence of a recoverable phase implies that quantum-enhanced operations can facilitate reliable quantum information transmission in the presence of diverse noises. Remarkably, we propose a resource-efficient protocol to characterize this phase transition, effectively avoiding post-selection by utilizing every run of the quantum simulation. This approach bridges the gap between theoretical insights and practical implementation, making the phase transition feasible to demonstrate on realistic noisy intermediate-scale quantum devices.

Text-driven diffusion models have achieved remarkable success in image editing, but a crucial component in these models-text embeddings-has not been fully explored. The entanglement and opacity of text embeddings present significant challenges to achieving precise image editing. In this paper, we provide a comprehensive and in-depth analysis of text embeddings in Stable Diffusion XL, offering three key insights. First, while the 'aug_embedding' captures the full semantic content of the text, its contribution to the final image generation is relatively minor. Second, 'BOS' and 'Padding_embedding' do not contain any semantic information. Lastly, the 'EOS' holds the semantic information of all words and contains the most style features. Each word embedding plays a unique role without interfering with one another. Based on these insights, we propose a novel approach for controllable image editing using a free-text embedding control method called PSP (Prompt-Softbox-Prompt). PSP enables precise image editing by inserting or adding text embeddings within the cross-attention layers and using Softbox to define and control the specific area for semantic injection. This technique allows for obejct additions and replacements while preserving other areas of the image. Additionally, PSP can achieve style transfer by simply replacing text embeddings. Extensive experimental results show that PSP achieves significant results in tasks such as object replacement, object addition, and style transfer.

Synthesizing motion-rich and temporally consistent videos remains a challenge in artificial intelligence, especially when dealing with extended durations. Existing text-to-video (T2V) models commonly employ spatial cross-attention for text control, equivalently guiding different frame generations without frame-specific textual guidance. Thus, the model's capacity to comprehend the temporal logic conveyed in prompts and generate videos with coherent motion is restricted. To tackle this limitation, we introduce FancyVideo, an innovative video generator that improves the existing text-control mechanism with the well-designed Cross-frame Textual Guidance Module (CTGM). Specifically, CTGM incorporates the Temporal Information Injector (TII), Temporal Affinity Refiner (TAR), and Temporal Feature Booster (TFB) at the beginning, middle, and end of cross-attention, respectively, to achieve frame-specific textual guidance. Firstly, TII injects frame-specific information from latent features into text conditions, thereby obtaining cross-frame textual conditions. Then, TAR refines the correlation matrix between cross-frame textual conditions and latent features along the time dimension. Lastly, TFB boosts the temporal consistency of latent features. Extensive experiments comprising both quantitative and qualitative evaluations demonstrate the effectiveness of FancyVideo. Our video demo, code and model are available at https://360cvgroup.github.io/FancyVideo/.

Pre-trained models have become the preferred backbone due to the expansion of model parameters, with techniques like Parameter-Efficient Fine-Tuning (PEFTs) typically fixing the parameters of these models. However, pre-trained models may not always be optimal, especially when there are discrepancies between training tasks and target tasks, potentially resulting in negative transfer. To address this, we introduce \textbf{KIND}, which performs \textbf{K}nowledge \textbf{IN}tegration and \textbf{D}iversion in diffusion models. KIND first integrates knowledge by decomposing parameter matrices of models using $U$, $\Sigma$, and $V$ matrices, formally inspired by singular value decomposition (SVD). Then it explicitly partitions the components of these matrices into \textbf{learngenes} and \textbf{tailors} to condense common and class-specific knowledge, respectively, through a class gate. In this way, KIND redefines traditional pre-training methods by adjusting training objectives from maximizing model performance on current tasks to condensing transferable common knowledge, leveraging the \textit{Learngene} framework. We conduct experiments on ImageNet-1K and compare KIND with PEFT and other learngene methods. Results indicate that KIND achieves state-of-the-art performance compared to other PEFT and learngene methods. Specifically, the images generated by KIND achieves more than 6.54 and 1.07 decrease in FID and sFID on DiT-L/2, utilizing only 45.4M trainable parameters and saving at least 35.4G FLOPs in computational cost.

Abstract Background: Pulmonary function tests (PFTs) and computed tomography (CT) imaging are vital in diagnosing, managing, and monitoring lung diseases. A common issue in practice is the lack of access to recorded pulmonary functions despite available chest CT scans. Purpose: To develop and validate a deep learning algorithm for predicting pulmonary function directly from chest CT scans. Methods: The development cohort came from the Pittsburgh Lung Screening Study (PLuSS) (n=3619). The validation cohort came from the Specialized Centers of Clinically Oriented Research (SCCOR) in COPD (n=662). A deep learning model called BeyondCT, combining a three-dimensional (3D) convolutional neural network (CNN) and Vision Transformer (ViT) architecture, was used to predict forced vital capacity (FVC) and forced expiratory volume in one second (FEV1) from non-contrasted inspiratory chest CT scans. A 3D CNN model without ViT was used for comparison. Subject demographics (age, gender, smoking status) were also incorporated into the model. Performance was compared to actual PFTs using mean absolute error (MAE, L), percentage error, and R square. Results: The 3D-CNN model achieved MAEs of 0.395 L and 0.383 L, percentage errors of 13.84% and 18.85%, and R square of 0.665 and 0.679 for FVC and FEV1, respectively. The BeyondCT model without demographics had MAEs of 0.362 L and 0.371 L, percentage errors of 10.89% and 14.96%, and R square of 0.719 and 0.727, respectively. Including demographics improved performance (p<0.05), with MAEs of 0.356 L and 0.353 L, percentage errors of 10.79% and 14.82%, and R square of 0.77 and 0.739 for FVC and FEV1 in the test set. Conclusion: The BeyondCT model showed robust performance in predicting lung function from non-contrast inspiratory chest CT scans., Comment: 5 tables, 7 figures,22 pages

We analyze the properties of a rare population, the strongly bulge-dominated early-type galaxies (referred to as sBDEs) with significant HI gas, using the databases from the FAST All Sky HI survey (FASHI) and the Arecibo Legacy Fast ALFA (ALFALFA) survey. We select the sBDEs from the Sloan Digital Sky Survey (SDSS) and cross-match with the FASHI-ALFALFA combined HI sample, resulting in 104 HI-rich sBDEs. These sBDEs tend to have extremely high HI reservoirs, which is rare in previous studies such as ATLAS$^{3D}$. 70% of the selected sBDEs are classified as quiescent galaxies, even though they have a large HI reservoir. We study the properties of these sBDEs from five main aspects: stellar population, gas-phase metallicity, stacked HI spectra, environment, and spatially resolved MaNGA data. The majority of HI-rich sBDEs appear to show lower gas-phase metallicity and are located in significantly lower-density environments, suggesting an external origin for their HI gas. We find that star-forming sBDEs exhibit statistically higher star formation efficiency and slightly older stellar populations compared to normal star-forming galaxies, suggesting a recent star formation on Gyr-timescale. They also show narrower and more concentrated HI profiles compared to control star-forming galaxies, which may explain their higher star formation efficiency., Comment: 18 pages, 14 figures, 1 table. Accepted for publication in ApJ

The neutron star starts to cool down shortly after its birth by emitting neutrinos. When it is cold enough, the Cooper pairs of neutrons are formed, which triggers a superfluid transition. Previous works on neutron superfluidity are focused on the finite-temperature transition. Little attention is paid to the potentially important quantum critical phenomena associated with superfluidity. Here, we provide the first theoretical analysis of superfluid quantum criticality, concentrating on its impact on neutron star cooling. Extensive calculations found that superfluidity occurs within a finite range of nuclear density $\rho$. The density serves as a non-thermal parameter for superfluid quantum phase transition. In a broad quantum critical region, there is a strong coupling between the gapless neutrons and the quantum critical fluctuations of superfluid order parameter. We handle this coupling by using perturbation theory and renormalization group method, and show that it leads to non-Fermi liquid behavior, which yields a logarithmic $T\ln(1/T)$ correction to the Fermi-liquid specific heat $c_{n}\propto T$ and also markedly alters the neutrino emissivity. Quantum critical phenomena emerge at a time much earlier than the onset of superfluidity and persist throughout almost the entire life of a neutron star. At a low $T$, such phenomena coexist with superfluidity in the neutron star interior, yet occupying different layers. We include superfluid quantum criticality into the theoretical description of neutron star cooling and find that it obviously prolongs the thermal relaxation time. By varying the strength of superfluid fluctuations and other quantities, we obtain an excellent fit to the observed cooling data of a variety of neutron stars. Our results indicate the existence of an intriguing correlation between superfluid quantum criticality and the thermal evolution of neutron stars., Comment: 25 pages, 3 figure, comments welcome

In a series of papers, we have proposed a non-perturbative field-theoretic approach to deal with strong electron-phonon and strong Coulomb interactions. The key ingredient of such an approach is to determine the full fermion-boson vertex corrections by solving a number of self-consistent Ward-Takahashi identities. Palle (see Phys. Rev. B 110, 026501 (2024), arXiv:2404.02918) argued that our Ward-Takahashi identities failed to include some important additional terms and thus are incorrect. We agree that our Ward-Takahashi identities have ignored some potentially important contributions and here give some remarks on the role played by the additional terms., Comment: Reply to arXiv:2404.02918, which is published as Phys. Rev. B 110, 026501 (2024), by Palle, commenting on arXiv:1911.05528

The spectral Tur\'an theorem states that the $k$-partite Tur\'an graph is the unique graph attaining the maximum adjacency spectral radius among all graphs of order $n$ containing no the complete graph $K_{k+1}$ as a subgraph. This result is known to be stronger than the classical Tur\'an theorem. In this paper, we consider hypergraph extensions of spectral Tur\'an theorem. For $k\geq r\geq 2$, let $H_{k+1}^{(r)}$ be the $r$-uniform hypergraph obtained from $K_{k+1}$ by enlarging each edge with a new set of $(r-2)$ vertices. Let $F_{k+1}^{(r)}$ be the $r$-uniform hypergraph with edges: $\{1,2,\ldots,r\} =: [r]$ and $E_{ij} \cup\{i,j\}$ over all pairs $\{i,j\}\in \binom{[k+1]}{2}\setminus\binom{[r]}{2}$, where $E_{ij}$ are pairwise disjoint $(r-2)$-sets disjoint from $[k+1]$. Generalizing the Tur\'an theorem to hypergraphs, Pikhurko [J. Combin. Theory Ser. B, 103 (2013) 220--225] and Mubayi and Pikhurko [J. Combin. Theory Ser. B, 97 (2007) 669--678] respectively determined the exact Tur\'an number of $H_{k+1}^{(r)}$ and $F_{k+1}^{(r)}$, and characterized the corresponding extremal hypergraphs. Our main results show that $T_r(n,k)$, the complete $k$-partite $r$-uniform hypergraph on $n$ vertices where no two parts differ by more than one in size, is the unique hypergraph having the maximum $p$-spectral radius among all $n$-vertex $H_{k+1}^{(r)}$-free (resp. $F_{k+1}^{(r)}$-free) $r$-uniform hypergraphs for sufficiently large $n$. These findings are obtained by establishing $p$-spectral version of the stability theorems. Our results offer $p$-spectral analogues of the results by Mubayi and Pikhurko, and connect both hypergraph Tur\'an theorem and hypergraph spectral Tur\'an theorem in a unified form via the $p$-spectral radius., Comment: 34 pages

The conversion of biomass-derived materials into value-added products via photocatalysis holds significant promise in driving the development of renewable resources. However, since catalytic processes often require high temperatures and pressures, most catalysts are quite difficult to meet the requirements of high selectivity and high activity simultaneously. Herein, a plasmon-promoted photocatalyst, integrating Ag nanowires with metal-organic frameworks (MOFs)-confined Pd nanoparticles, is rationally designed to afford AgNWs/ZIF-8/Pd which achieve highly selective and efficient catalytic hydrogenation toward 2(5H)-Furanone under mild conditions. The plasmonic AgNWs/ZIF-8/Pd exhibited much stronger photocatalytic activity and higher selectivity compared with AgNWS/ZIF-8 and ZIF-8/Pd. The enhanced activity can be attributed to the synergistic coupling between Pd nanoparticles and AgNWs, and the possible reaction mechanism is proposed. This work provides a new approach to constructing efficient photocatalysts and offers new insights into the understanding of the influence of the plasmonic effect on photocatalytic hydrogenation reactions.

Neutral hydrogen (HI) is the primary component of the cool interstellar medium (ISM) and is the reservoir of fuel for star formation. Owing to the sensitivity of existing radio telescopes, our understanding of the evolution of the ISM in galaxies remains limited, as it is based on only a few hundred galaxies detected in HI beyond the local Universe. With the high sensitivity of the Five-hundred-meter Aperture Spherical radio Telescope (FAST), we carried out a blind HI search, the FAST Ultra-Deep Survey (FUDS), which extends to redshifts up to 0.42 and a sensitivity of 50 $\rm \mu Jy \cdot beam^{-1}$. Here, we report the first discovery of six galaxies in HI at $z>0.38$. For these galaxies, the FAST angular resolution of $\sim\,4'$ corresponds to a mean linear size of $\sim1.3\,h_{70}^{-1}\,$Mpc. These galaxies are among the most distant HI emission detections known, with one having the most massive HI content ($10^{10.93 \pm 0.04}~h_{70}^{-2}\, \rm M_\odot$). Using recent data from the DESI survey, and new observations with the Hale, BTA, and Keck telescopes, optical counterparts are detected for all galaxies within the 3-$\sigma$ positional uncertainty ($0.5\,h_{70}^{-1}\,$Mpc) and $\rm 200\,km \cdot s^{-1}$ in recession velocity. Assuming that the dominant source of HI is the identified optical counterpart, we find an evidence of evolution in the HI content of galaxies over the last 4.2 Gyr. Our new high-redshift HI galaxy sample provides the opportunity to better investigate the evolution of cool gas in galaxies. A larger sample size in the future will allow us to refine our knowledge of the formation and evolution of galaxies., Comment: 14 pages, 6 figures, 3 tables

Ultrasound imaging reveals eye morphology and aids in diagnosing and treating eye diseases. However, interpreting diagnostic reports requires specialized physicians. We present a labeled ophthalmic dataset for the precise analysis and the automated exploration of medical images along with their associated reports. It collects three modal data, including the ultrasound images, blood flow information and examination reports from 2,417 patients at an ophthalmology hospital in Shenyang, China, during the year 2018, in which the patient information is de-identified for privacy protection. To the best of our knowledge, it is the only ophthalmic dataset that contains the three modal information simultaneously. It incrementally consists of 4,858 images with the corresponding free-text reports, which describe 15 typical imaging findings of intraocular diseases and the corresponding anatomical locations. Each image shows three kinds of blood flow indices at three specific arteries, i.e., nine parameter values to describe the spectral characteristics of blood flow distribution. The reports were written by ophthalmologists during the clinical care. The proposed dataset is applied to generate medical report based on the cross-modal deep learning model. The experimental results demonstrate that our dataset is suitable for training supervised models concerning cross-modal medical data.

Underwater monocular depth estimation serves as the foundation for tasks such as 3D reconstruction of underwater scenes. However, due to the influence of light and medium, the underwater environment undergoes a distinctive imaging process, which presents challenges in accurately estimating depth from a single image. The existing methods fail to consider the unique characteristics of underwater environments, leading to inadequate estimation results and limited generalization performance. Furthermore, underwater depth estimation requires extracting and fusing both local and global features, which is not fully explored in existing methods. In this paper, an end-to-end learning framework for underwater monocular depth estimation called UMono is presented, which incorporates underwater image formation model characteristics into network architecture, and effectively utilize both local and global features of underwater image. Experimental results demonstrate that the proposed method is effective for underwater monocular depth estimation and outperforms the existing methods in both quantitative and qualitative analyses.

Recently, great progress has been made in the entanglement of multiple photons at various wavelengths and in different degrees of freedom for optical quantum information applied in diverse scenarios. However, multi-photon entanglement in the transmission window of green light under the water has not been reported yet. Here, by combining femtosecond laser based multi-photon entanglement and entanglement-maintaining frequency upconversion techniques, we successfully generate a green two-photon polarization-entangled Bell state and a green three-photon Greenberger-Horne-Zeilinger (GHZ) state, whose state fidelities are 0.893$\mathbf{\pm}$0.002 and 0.595$\mathbf{\pm}$0.023, respectively. Our result provides a scalable method to prepare green multi-photon entanglement, which may have wide applications in underwater quantum information., Comment: 8 pages, 4 figures

High-dimensional encoding of quantum information holds the potential to greatly increase the computational power of existing devices by enlarging the accessible state space for fixed register size and by reducing the number of required entangling gates. However, qudit-based quantum computation remains far less developed than conventional qubit-based approaches, in particular for photons, which represent natural multi-level information carriers that play a crucial role in the development of quantum networks. A major obstacle for realizing quantum gates between two individual photons is the restriction of direct interaction between photons in linear media. In particular, essential logic components for quantum operations such as native qudit-qudit entangling gates are still missing for optical quantum information processing. Here we address this challenge by presenting a protocol for realizing an entangling gate -- the controlled phase-flip (CPF) gate -- for two photonic qudits in arbitrary dimension. We experimentally demonstrate this protocol by realizing a four-dimensional qudit-qudit CPF gate, whose decomposition would require at least 13 two-qubit entangling gates. Our photonic qudits are encoded in orbital angular momentum (OAM) and we have developed a new active high-precision phase-locking technology to construct a high-dimensional OAM beam splitter that increases the stability of the CPF gate, resulting in a process fidelity within a range of $ [0.64 \pm 0.01, 0.82 \pm 0.01]$. Our experiment represents a significant advance for high-dimensional optical quantum information processing and has the potential for wider applications beyond optical system., Comment: 14 pages, 7 figures

We update the HI surface density measurements for a subset of 17 THINGS galaxies by dealing with the short-spacing problem of the original VLA HI images. It is the same sample that Bigiel et al. (2010) used to study the relation between HI surface densities and star formation rate surface densities in galaxy outer disks, which are beyond the optical radius r25. For ten galaxies, the update is based on combining original THINGS VLA HI images with HI images taken by the single-dish FAST in the FEASTS program. The median increment of HI surface densities in outer disks is 0.15 to 0.4 dex at a given new HI surface density. Several galaxies change significantly in the shape of radial profiles HI surface densities, and seven galaxies are now more than 1-$\sigma$ below the HI size-mass relation. We update the HI star formation laws in outer disks. The median relation between HI surface densities and star formation rate surface densities based on pixelwise measurements shifts downward by around 0.15 dex because the HI surface density values shift rightward, and the scatter increases significantly. The scatter of the relation, indicating the star forming efficiency, exhibits a much stronger positive correlation with the stellar mass surface density than before. Thus, detecting the previously missed, diffuse HI due to short-spacing problem of the VLA observation is important in revealing the true condition and variation of star formation possibly regulated by stellar feedbacks in localized environment of outer disks., Comment: 27 pages, the second paper of "FEASTS Combined with Interferometry". Data is available on the page http://kavli.pku.edu.cn/~jwang/FEASTS_data.html

We report on the first measurement of the elemental fragmentation cross sections (EFCSs) of $^{29-33}\mathrm{Si}$ on a carbon target at $\sim$230~MeV/nucleon. The experimental data covering charge changes of $\Delta Z$ = 1-4 are reproduced well by the isospin-dependent quantum molecular dynamics (IQMD) coupled with the evaporation GEMINI (IQMD+GEMINI) model. We further explore the mechanisms underlying the single-proton removal reaction in this model framework. We conclude that the cross sections from direct proton knockout exhibit a overall weak dependence on the mass number of $\mathrm{Si}$ projectiles. The proton evaporation induced after the projectile excitation significantly affects the cross sections for neutron-deficient $\mathrm{Si}$ isotopes, while neutron evaporation plays a crucial role in the reactions of neutron-rich $\mathrm{Si}$ isotopes. It is presented that the relative magnitude of one-proton and one-neutron separation energies is an essential factor that influences evaporation processes., Comment: 7 pages, 4 figures

In 2018, Chen and Godsil proposed the concept of Laplacian perfect pair state transfer which is a brilliant generalization of Laplacian perfect state transfer. In this paper, we study the existence of Laplacian perfect pair state transfer in the Q-graph of an $r$-regular graph for $r\ge2$. We prove that the Q-graph of an $r$-regular graph does not have Laplacian perfect pair state transfer when $r+1$ is prime or a power of $2$. We also give a sufficient condition for Q-graph to have Laplacian pretty good pair state transfer.

We study the optical effect of chiral topological superconductors in two dimensions. The linear optical response from chiral Bogoliubov edge modes in clean superconductors has in-gap resonances, which is originated from the transitions within the edge particle-hole pair bands. Interestingly, the number of resonance peaks is determined by the Bogoliubov-de Gennes Chern number of topological superconductors. Such a sharply distinctive feature in optical absorption offers a simple way to distinguish topological superconductors with different Chern numbers. We further demonstrate that linear optical effect could probe different topological phases in quantum anomalous Hall insulator-superconductor junction devices. This finding provides an applicable method to detect chiral Bogoliubov edge states and is distinguishable from collective modes in superconductors and possible trivial explanations., Comment: 7 pages, 3 figures

We study heat kernel rigidity for the Lie group $\operatorname{SU}\left( 2 \right)$ kernel equipped with a sub-Riemannian structure. We prove that a metric measure space equipped with a heat kernel of a special form is bundle-isometric to the Hopf fibration $\operatorname{U}\left( 1 \right)\to \operatorname{SU}\left( 2 \right)\to \mathbb{CP}^1$, which coincides with the sub-Riemannian sphere $\operatorname{SU}\left( 2 \right)$.

Background: Accurate short-term readmission prediction of ICU patients is significant in improving the efficiency of resource assignment by assisting physicians in making discharge decisions. Clinically, both individual static static and multivariate temporal data collected from ICU monitors play critical roles in short-term readmission prediction. Informative static and multivariate temporal feature representation capturing and fusion present challenges for accurate readmission prediction. Methods:We propose a novel static and multivariate-temporal attentive fusion transformer (SMTAFormer) to predict short-term readmission of ICU patients by fully leveraging the potential of demographic and dynamic temporal data. In SMTAFormer, we first apply an MLP network and a temporal transformer network to learn useful static and temporal feature representations, respectively. Then, the well-designed static and multivariate temporal feature fusion module is applied to fuse static and temporal feature representations by modeling intra-correlation among multivariate temporal features and constructing inter-correlation between static and multivariate temporal features. Results: We construct a readmission risk assessment (RRA) dataset based on the MIMIC-III dataset. The extensive experiments show that SMTAFormer outperforms advanced methods, in which the accuracy of our proposed method is up to 86.6%, and the area under the receiver operating characteristic curve (AUC) is up to 0.717. Conclusion: Our proposed SMTAFormer can efficiently capture and fuse static and multivariate temporal feature representations. The results show that SMTAFormer significantly improves the short-term readmission prediction performance of ICU patients through comparisons to strong baselines.

M-type stars are the ones that flare most frequently, but how big their maximum flare energy can reach is still unknown. We present 163 flares from 162 individual M2 through L1-type stars that triggered the GWAC, with flare energies ranging from $10^{32.2}$ to $10^{36.4}$ erg . The flare amplitudes range from $\triangle G = 0.84$ to $\sim 10$ mag. Flare energy increases with stellar surface temperature ($T_{\rm eff}$) but both $\triangle G$ and equivalent duration $\log_{10}(ED)$ seem to be independent of $T_{\rm eff}$. Combining periods detected from light curves of TESS and K2, spectra from LAMOST, SDSS and the 2.16 m Telescope, and the Gaia DR3 data, we found that these GWAC flare stars are young. For the stars that have spectra, we found that these stars are in or very near to the saturation region, and $\log_{10}(L_{\rm H\alpha}/L_{\rm bol})$ is lower for M7-L1 stars than for M2-M6 stars. We also studied the relation between GWAC flare bolometric energy $E_{\rm bol}$ and stellar hemispherical area $S$, and found that $\log_{10}E_{\rm bol}$ (in erg) increases with increasing $S$ (in cm$^2$), and the maximum flare energy $\log_{10}E_{\rm bol, max} \geqslant \log_{10}S + 14.25$. For M7-L1 stars, there seem to be other factors limiting their maximum flare energies in addition to stellar hemispherical area., Comment: 18 pages, 11 figures, 4 tables

In this paper, we propose the task of \textit{Ranked Video Moment Retrieval} (RVMR) to locate a ranked list of matching moments from a collection of videos, through queries in natural language. Although a few related tasks have been proposed and studied by CV, NLP, and IR communities, RVMR is the task that best reflects the practical setting of moment search. To facilitate research in RVMR, we develop the TVR-Ranking dataset, based on the raw videos and existing moment annotations provided in the TVR dataset. Our key contribution is the manual annotation of relevance levels for 94,442 query-moment pairs. We then develop the $NDCG@K, IoU\geq \mu$ evaluation metric for this new task and conduct experiments to evaluate three baseline models. Our experiments show that the new RVMR task brings new challenges to existing models and we believe this new dataset contributes to the research on multi-modality search. The dataset is available at \url{https://github.com/Ranking-VMR/TVR-Ranking}

With the growth of high-quality data and advancement in visual pre-training paradigms, Video Foundation Models (VFMs) have made significant progress recently, demonstrating their remarkable performance on traditional video understanding benchmarks. However, the existing benchmarks (e.g. Kinetics) and their evaluation protocols are often limited by relatively poor diversity, high evaluation costs, and saturated performance metrics. In this paper, we build a comprehensive benchmark suite to address these issues, namely VideoEval. Specifically, we establish the Video Task Adaption Benchmark (VidTAB) and the Video Embedding Benchmark (VidEB) from two perspectives: evaluating the task adaptability of VFMs under few-shot conditions and assessing their representation power by directly applying to downstream tasks. With VideoEval, we conduct a large-scale study on 20 popular open-source vision foundation models. Our study reveals some insightful findings on VFMs: 1) overall, current VFMs exhibit weak generalization across diverse tasks, 2) increasing video data, whether labeled or weakly-labeled video-text pairs, does not necessarily improve task performance, 3) the effectiveness of some pre-training paradigms may not be fully validated in previous benchmarks, and 4) combining different pre-training paradigms can help improve the generalization capabilities. We believe this study serves as an important complement to the current evaluation for VFMs and offers valuable insights for the future research.

Given the current visual observations, the traditional procedure planning task in instructional videos requires a model to generate goal-directed plans within a given action space. All previous methods for this task conduct training and inference under the same action space, and they can only plan for pre-defined events in the training set. We argue this setting is not applicable for human assistance in real lives and aim to propose a more general and practical planning paradigm. Specifically, in this paper, we introduce a new task named Open-event Procedure Planning (OEPP), which extends the traditional procedure planning to the open-event setting. OEPP aims to verify whether a planner can transfer the learned knowledge to similar events that have not been seen during training. We rebuild a new benchmark of OpenEvent for this task based on existing datasets and divide the events involved into base and novel parts. During the data collection process, we carefully ensure the transfer ability of procedural knowledge for base and novel events by evaluating the similarity between the descriptions of different event steps with multiple stages. Based on the collected data, we further propose a simple and general framework specifically designed for OEPP, and conduct extensive study with various baseline methods, providing a detailed and insightful analysis on the results for this task., Comment: 9 pages(main text), 6 figures, 10 tables

The explainability of recommendation systems is crucial for enhancing user trust and satisfaction. Leveraging large language models (LLMs) offers new opportunities for comprehensive recommendation logic generation. However, in existing related studies, fine-tuning LLM models for recommendation tasks incurs high computational costs and alignment issues with existing systems, limiting the application potential of proven proprietary/closed-source LLM models, such as GPT-4. In this work, our proposed effective strategy LANE aligns LLMs with online recommendation systems without additional LLMs tuning, reducing costs and improving explainability. This innovative approach addresses key challenges in integrating language models with recommendation systems while fully utilizing the capabilities of powerful proprietary models. Specifically, our strategy operates through several key components: semantic embedding, user multi-preference extraction using zero-shot prompting, semantic alignment, and explainable recommendation generation using Chain of Thought (CoT) prompting. By embedding item titles instead of IDs and utilizing multi-head attention mechanisms, our approach aligns the semantic features of user preferences with those of candidate items, ensuring coherent and user-aligned recommendations. Sufficient experimental results including performance comparison, questionnaire voting, and visualization cases prove that our method can not only ensure recommendation performance, but also provide easy-to-understand and reasonable recommendation logic.

Data-driven generative models have emerged as promising approaches towards achieving efficient mechanical inverse design. However, due to prohibitively high cost in time and money, there is still lack of open-source and large-scale benchmarks in this field. It is mainly the case for airfoil inverse design, which requires to generate and edit diverse geometric-qualified and aerodynamic-qualified airfoils following the multimodal instructions, \emph{i.e.,} dragging points and physical parameters. This paper presents the open-source endeavors in airfoil inverse design, \emph{AFBench}, including a large-scale dataset with 200 thousand airfoils and high-quality aerodynamic and geometric labels, two novel and practical airfoil inverse design tasks, \emph{i.e.,} conditional generation on multimodal physical parameters, controllable editing, and comprehensive metrics to evaluate various existing airfoil inverse design methods. Our aim is to establish \emph{AFBench} as an ecosystem for training and evaluating airfoil inverse design methods, with a specific focus on data-driven controllable inverse design models by multimodal instructions capable of bridging the gap between ideas and execution, the academic research and industrial applications. We have provided baseline models, comprehensive experimental observations, and analysis to accelerate future research. Our baseline model is trained on an RTX 3090 GPU within 16 hours. The codebase, datasets and benchmarks will be available at \url{https://hitcslj.github.io/afbench/}., Comment: NeurIPS 2024 Dataset & Benchmark Track

The expansion of model parameters underscores the significance of pre-trained models; however, the constraints encountered during model deployment necessitate models of variable sizes. Consequently, the traditional pre-training and fine-tuning paradigm fails to address the initialization problem when target models are incompatible with pre-trained models. We tackle this issue from a multitasking perspective and introduce \textbf{WAVE}, which incorporates a set of shared \textbf{W}eight templates for \textbf{A}daptive initialization of \textbf{V}ariable-siz\textbf{E}d Models. During initialization, target models will initialize the corresponding weight scalers tailored to their model size, which are sufficient to learn the connection rules of weight templates based on the Kronecker product from a limited amount of data. For the construction of the weight templates, WAVE utilizes the \textit{Learngene} framework, which structurally condenses common knowledge from ancestry models into weight templates as the learngenes through knowledge distillation. This process allows the integration of pre-trained models' knowledge into structured knowledge according to the rules of weight templates. We provide a comprehensive benchmark for the learngenes, and extensive experiments demonstrate the efficacy of WAVE. The results show that WAVE achieves state-of-the-art performance when initializing models with various depth and width, and even outperforms the direct pre-training of $n$ entire models, particularly for smaller models, saving approximately $n\times$ and $5\times$ in computational and storage resources, respectively. WAVE simultaneously achieves the most efficient knowledge transfer across a series of datasets, specifically achieving an average improvement of 1.8\% and 1.2\% on 7 downstream datasets.

Measurement-induced phase transition (MIPT) is a novel non-equilibrium phase transition characterized by entanglement entropy. The scrambling dynamics induced by random unitary gates can protect information from low-rate measurements. However, common decoherence noises, such as dephasing, are detrimental to the volume law phase, posing a significant challenge for observing MIPT in current noisy intermediate-scale quantum devices. Here, we demonstrate that incorporating quantum-enhanced operations can effectively protect MIPT from environmental noise. The conditional entanglement entropy is associated with a statistical mechanics model wherein noise and quantum-enhanced operations act as two competing external random fields. Then we show that an average apparatus-environment exchange symmetry ensures the conditional entanglement entropy is a valid probe of entanglement. Furthermore, we provide numerical evidence on a (2+1)-d quantum circuit under dephasing noise, demonstrating that MIPT can indeed be observed with the aid of quantum-enhanced operations. This result not only serves as a concrete example of the power of quantum enhancement in combating noise but also holds experimental relevance, as the protocol is straightforward to implement in practice., Comment: 7+10 pages, 4+7 figures