Search

Transport properties of cold and dense nucleon matter are important for both nuclear and astrophysics but are relatively less studied than those at finite temperatures. In this paper, we present a primary study of bulk and shear viscosities in the limit $T/\mu_B \ll 1$, where $T$ and $\mu_B$ are the temperature and the baryon chemical potential. The analysis is performed for a generic system where nucleons are dressed by the condensation of both scalar and vector interactions. Under the relaxation time approximation of the Boltzmann equation, we compute the viscosities of the system to leading power in $T/\mu_B$ expansion and establish a relation between the thermodynamic potential and transport coefficients, including bulk viscosity ($\zeta$) and shear viscosity ($\eta$). It is found that hydrodynamic stability ($\zeta>0$) imposes additional constraints on the thermodynamic potential. As an example, these relations are applied to the Walecka model. The fluid properties of the cold and dense nucleon matter are characterized by the dimensionless combination of viscosities times the quasi-Fermi momentum over the enthalpy. Furthermore, we discuss the implication of the stability condition on the range of applicability of the model., Comment: 27 pages, 6 figures. Feedback and comments are welcome

Particles with high anisotropy in their magnetic properties and shape are of increasing interest for mechanobiology, where transducing a remotely applied magnetic field vector to a local mechanical response is crucial. An outstanding challenge is quantifying the mechanical torque of a single nanoparticle, typically in the range of atto- to femto-Newton-meters (Nm). The magneto-mechanical torque manifests due to a misalignment of the external magnetic field vector with the built-in magnetic anisotropy axis, as opposed to a magnetic force, and complicates the measurement scheme. In this work, we developed a method using a commercially available Atomic Force Microscopy setup and cantilevers to quantify the torque generated by a single synthetic antiferromagnetic (SAF) nanoplatelet with high perpendicular magnetic anisotropy. Specifically, we measured 1.6$\pm$0.6$\cdot$10$^{-15}$ Nm torque while applying 373$\pm$5 mT field at 12$\pm$2 degrees to the built-in anisotropy axis exerted by a single circular SAF nanoplatelet with 1.88 $\mu$m diameter and 72 nm thickness, naively translating to a $\approx$ 1.7 nN maximum force at the nanoplatelet apex. This measured torque and derived force of the SAF nanoplatelets is strong enough for most applications in mechanobiology; for example, it can be used to rupture (cancer) cell membranes. Moreover, SAF nanoplatelets open a route for easy tuning of the built-in magnetic anisotropy and size, reducing the torque and allowing for small mechanical stimuli for ion channel activation. This work presents a straightforward and widely applicable method for characterizing magnetic particles' mechanical transduction, which is applied to SAF nanoplatelets with a high PMA.

Event cameras record visual information as asynchronous pixel change streams, excelling at scene perception under unsatisfactory lighting or high-dynamic conditions. Existing multimodal large language models (MLLMs) concentrate on natural RGB images, failing in scenarios where event data fits better. In this paper, we introduce EventGPT, the first MLLM for event stream understanding, to the best of our knowledge, marking a pioneering attempt to integrate large language models (LLMs) with event stream comprehension. To mitigate the huge domain gaps, we develop a three-stage optimization paradigm to gradually equip a pre-trained LLM with the capability of understanding event-based scenes. Our EventGPT comprises an event encoder, followed by a spatio-temporal aggregator, a linear projector, an event-language adapter, and an LLM. Firstly, RGB image-text pairs generated by GPT are leveraged to warm up the linear projector, referring to LLaVA, as the gap between natural image and language modalities is relatively smaller. Secondly, we construct a synthetic yet large dataset, N-ImageNet-Chat, consisting of event frames and corresponding texts to enable the use of the spatio-temporal aggregator and to train the event-language adapter, thereby aligning event features more closely with the language space. Finally, we gather an instruction dataset, Event-Chat, which contains extensive real-world data to fine-tune the entire model, further enhancing its generalization ability. We construct a comprehensive benchmark, and experiments show that EventGPT surpasses previous state-of-the-art MLLMs in generation quality, descriptive accuracy, and reasoning capability.

Combining the complementary benefits of frames and events has been widely used for object detection in challenging scenarios. However, most object detection methods use two independent Artificial Neural Network (ANN) branches, limiting cross-modality information interaction across the two visual streams and encountering challenges in extracting temporal cues from event streams with low power consumption. To address these challenges, we propose HDI-Former, a Hybrid Dynamic Interaction ANN-SNN Transformer, marking the first trial to design a directly trained hybrid ANN-SNN architecture for high-accuracy and energy-efficient object detection using frames and events. Technically, we first present a novel semantic-enhanced self-attention mechanism that strengthens the correlation between image encoding tokens within the ANN Transformer branch for better performance. Then, we design a Spiking Swin Transformer branch to model temporal cues from event streams with low power consumption. Finally, we propose a bio-inspired dynamic interaction mechanism between ANN and SNN sub-networks for cross-modality information interaction. The results demonstrate that our HDI-Former outperforms eleven state-of-the-art methods and our four baselines by a large margin. Our SNN branch also shows comparable performance to the ANN with the same architecture while consuming 10.57$\times$ less energy on the DSEC-Detection dataset. Our open-source code is available in the supplementary material., Comment: 17 pages, 11 figures

Sign Language Translation (SLT) is a core task in the field of AI-assisted disability. Unlike traditional SLT based on visible light videos, which is easily affected by factors such as lighting, rapid hand movements, and privacy breaches, this paper proposes the use of high-definition Event streams for SLT, effectively mitigating the aforementioned issues. This is primarily because Event streams have a high dynamic range and dense temporal signals, which can withstand low illumination and motion blur well. Additionally, due to their sparsity in space, they effectively protect the privacy of the target person. More specifically, we propose a new high-resolution Event stream sign language dataset, termed Event-CSL, which effectively fills the data gap in this area of research. It contains 14,827 videos, 14,821 glosses, and 2,544 Chinese words in the text vocabulary. These samples are collected in a variety of indoor and outdoor scenes, encompassing multiple angles, light intensities, and camera movements. We have benchmarked existing mainstream SLT works to enable fair comparison for future efforts. Based on this dataset and several other large-scale datasets, we propose a novel baseline method that fully leverages the Mamba model's ability to integrate temporal information of CNN features, resulting in improved sign language translation outcomes. Both the benchmark dataset and source code will be released on https://github.com/Event-AHU/OpenESL, Comment: First Large-scale and High-Definition Benchmark Dataset for Event-based Sign Language Translation

Adversarial purification is one of the promising approaches to defend neural networks against adversarial attacks. Recently, methods utilizing diffusion probabilistic models have achieved great success for adversarial purification in image classification tasks. However, such methods fall into the dilemma of balancing the needs for noise removal and information preservation. This paper points out that existing adversarial purification methods based on diffusion models gradually lose sample information during the core denoising process, causing occasional label shift in subsequent classification tasks. As a remedy, we suggest to suppress such information loss by introducing guidance from the classifier confidence. Specifically, we propose Classifier-cOnfidence gUided Purification (COUP) algorithm, which purifies adversarial examples while keeping away from the classifier decision boundary. Experimental results show that COUP can achieve better adversarial robustness under strong attack methods., Comment: Accepted by ECAI 2024

Transformer-based large language models have achieved remarkable performance across various natural language processing tasks. However, they often struggle with seemingly easy tasks like arithmetic despite their vast capabilities. This stark disparity raise human's concerns about their safe and ethical use, hinder their widespread adoption.In this paper, we focus on a typical arithmetic task, integer multiplication, to explore and explain the imperfection of transformers in this domain. We provide comprehensive analysis of a vanilla transformer trained to perform n-digit integer multiplication. Our observations indicate that the model decomposes multiplication task into multiple parallel subtasks, sequentially optimizing each subtask for each digit to complete the final multiplication. Based on observation and analysis, we infer the reasons of transformers deficiencies in multiplication tasks lies in their difficulty in calculating successive carryovers and caching intermediate results, and confirmed this inference through experiments. Guided by these findings, we propose improvements to enhance transformers performance on multiplication tasks. These enhancements are validated through rigorous testing and mathematical modeling, not only enhance transformer's interpretability, but also improve its performance, e.g., we achieve over 99.9% accuracy on 5-digit integer multiplication with a tiny transformer, outperform LLMs GPT-4. Our method contributes to the broader fields of model understanding and interpretability, paving the way for analyzing more complex tasks and Transformer models. This work underscores the importance of explainable AI, helping to build trust in large language models and promoting their adoption in critical applications., Comment: 8 pages, 5 figures

Human pose estimation remains a multifaceted challenge in computer vision, pivotal across diverse domains such as behavior recognition, human-computer interaction, and pedestrian tracking. This paper proposes an improved method based on the spatial-temporal graph convolution net-work (UGCN) to address the issue of missing human posture skeleton sequences in single-view videos. We present the improved UGCN, which allows the network to process 3D human pose data and improves the 3D human pose skeleton sequence, thereby resolving the occlusion issue., Comment: Proceedings of IEEE AICON2024

Single pulse all-optical switching of magnetization (AOS) in Co/Gd based synthetic ferrimagnets carries promises for hybrid spintronic-photonic integration. A crucial next step progressing towards this vision is to gain insight into AOS and multi-domain state (MDS) behavior using longer pulses, which is compatible with state-of-the-art integrated photonics. In this work, we present our studies on the AOS and MDS of [Co/Gd]n (n = 1, 2) using ps optical pulses across a large composition range. We theoretically and experimentally show that a large Gd layer thickness can enhance the AOS energy efficiency and maximum pulse duration. We have identified two augmenting roles of Gd in extending the maximum pulse duration. On the inter-atomic level, we found that more Gd offers a prolonged angular momentum supply to Co. On the micromagnetic level, a higher Gd content brings the system to be closer to magnetic compensation in the equilibrized hot state, thereby reducing the driving force for thermally assisted nucleation of domain walls, combating the formation of a MDS. Our study presents a composition overview of AOS in [Co/Gd]n and offers useful physical insights regarding AOS fundamentals as well as the projected photonic integration.

The intersection of physics-based vision and deep learning presents an exciting frontier for advancing computer vision technologies. By leveraging the principles of physics to inform and enhance deep learning models, we can develop more robust and accurate vision systems. Physics-based vision aims to invert the processes to recover scene properties such as shape, reflectance, light distribution, and medium properties from images. In recent years, deep learning has shown promising improvements for various vision tasks, and when combined with physics-based vision, these approaches can enhance the robustness and accuracy of vision systems. This technical report summarizes the outcomes of the Physics-Based Vision Meets Deep Learning (PBDL) 2024 challenge, held in CVPR 2024 workshop. The challenge consisted of eight tracks, focusing on Low-Light Enhancement and Detection as well as High Dynamic Range (HDR) Imaging. This report details the objectives, methodologies, and results of each track, highlighting the top-performing solutions and their innovative approaches., Comment: CVPR 2024 PBDL Challenges: https://pbdl-ws.github.io/pbdl2024/challenge/index.html

Current approaches in pose estimation primarily concentrate on enhancing model architectures, often overlooking the importance of comprehensively understanding the rationale behind model decisions. In this paper, we propose XPose, a novel framework that incorporates Explainable AI (XAI) principles into pose estimation. This integration aims to elucidate the individual contribution of each keypoint to final prediction, thereby elevating the model's transparency and interpretability. Conventional XAI techniques have predominantly addressed tasks with single-target tasks like classification. Additionally, the application of Shapley value, a common measure in XAI, to pose estimation has been hindered by prohibitive computational demands. To address these challenges, this work introduces an innovative concept called Group Shapley Value (GSV). This approach strategically organizes keypoints into clusters based on their interdependencies. Within these clusters, GSV meticulously calculates Shapley value for keypoints, while for inter-cluster keypoints, it opts for a more holistic group-level valuation. This dual-level computation framework meticulously assesses keypoint contributions to the final outcome, optimizing computational efficiency. Building on the insights into keypoint interactions, we devise a novel data augmentation technique known as Group-based Keypoint Removal (GKR). This method ingeniously removes individual keypoints during training phases, deliberately preserving those with strong mutual connections, thereby refining the model's predictive prowess for non-visible keypoints. The empirical validation of GKR across a spectrum of standard approaches attests to its efficacy. GKR's success demonstrates how using Explainable AI (XAI) can directly enhance pose estimation models.

Multi-modal large language models (MLLMs) have demonstrated remarkable vision-language capabilities, primarily due to the exceptional in-context understanding and multi-task learning strengths of large language models (LLMs). The advent of visual instruction tuning has further enhanced MLLMs' performance in vision-language understanding. However, while existing MLLMs adeptly recognize \textit{what} objects are in an image, they still face challenges in effectively discerning \textit{where} these objects are, particularly along the distance (scene depth) axis. To overcome this limitation in MLLMs, we introduce Proximity Question Answering (Proximity QA), a novel framework designed to enable MLLMs to infer the proximity relationship between objects in images. The framework operates in two phases: the first phase focuses on guiding the models to understand the relative depth of objects, and the second phase further encourages the models to infer the proximity relationships between objects based on their depth perceptions. We also propose a VQA dataset called Proximity-110K, containing additional instructions that incorporate depth information and the proximity relationships of objects. We have conducted extensive experiments to validate Proximity QA's superior ability in depth perception and proximity analysis, outperforming other state-of-the-art MLLMs. Code and dataset will be released at \textcolor{magenta}{https://github.com/NorthSummer/ProximityQA.git}., Comment: 15 pages,version 1

Utilizing rapidity-dependent measurements to map the QCD phase diagram provides a complementary approach to traditional beam-energy-dependent measurements around midrapidity. The changing nature of thermodynamic properties of QCD matter along the beam axis in heavy-ion collisions at low collision energies both motivates and poses challenges for this method. In this study, we derive the analytical cumulant-generating function for subsystems within distinct rapidity windows, while accounting for global net-baryon charge conservation of the full system. Rapidity-dependent net-baryon cumulants are then calculated for a system exhibiting inhomogeneity along the beam axis, and their sensitivity to finite acceptances through changing rapidity bin widths is explored. We highlight the nontrivial behaviors exhibited by these cumulants, underscoring their importance in establishing a noncritical baseline for interpreting net-proton cumulants in the search for the QCD critical point. Finally, we discuss the implications of the rapidity scan for mapping the QCD phase diagram within the current context., Comment: 16 pages, 9 figures. Content, figures, and references are updated to the publication version

DAVIS camera, streaming two complementary sensing modalities of asynchronous events and frames, has gradually been used to address major object detection challenges (e.g., fast motion blur and low-light). However, how to effectively leverage rich temporal cues and fuse two heterogeneous visual streams remains a challenging endeavor. To address this challenge, we propose a novel streaming object detector with Transformer, namely SODFormer, which first integrates events and frames to continuously detect objects in an asynchronous manner. Technically, we first build a large-scale multimodal neuromorphic object detection dataset (i.e., PKU-DAVIS-SOD) over 1080.1k manual labels. Then, we design a spatiotemporal Transformer architecture to detect objects via an end-to-end sequence prediction problem, where the novel temporal Transformer module leverages rich temporal cues from two visual streams to improve the detection performance. Finally, an asynchronous attention-based fusion module is proposed to integrate two heterogeneous sensing modalities and take complementary advantages from each end, which can be queried at any time to locate objects and break through the limited output frequency from synchronized frame-based fusion strategies. The results show that the proposed SODFormer outperforms four state-of-the-art methods and our eight baselines by a significant margin. We also show that our unifying framework works well even in cases where the conventional frame-based camera fails, e.g., high-speed motion and low-light conditions. Our dataset and code can be available at https://github.com/dianzl/SODFormer., Comment: 18 pages, 15 figures, in IEEE Transactions on Pattern Analysis and Machine Intelligence

Spiking neural networks (SNNs) are brain-inspired energy-efficient models that encode information in spatiotemporal dynamics. Recently, deep SNNs trained directly have shown great success in achieving high performance on classification tasks with very few time steps. However, how to design a directly-trained SNN for the regression task of object detection still remains a challenging problem. To address this problem, we propose EMS-YOLO, a novel directly-trained SNN framework for object detection, which is the first trial to train a deep SNN with surrogate gradients for object detection rather than ANN-SNN conversion strategies. Specifically, we design a full-spike residual block, EMS-ResNet, which can effectively extend the depth of the directly-trained SNN with low power consumption. Furthermore, we theoretically analyze and prove the EMS-ResNet could avoid gradient vanishing or exploding. The results demonstrate that our approach outperforms the state-of-the-art ANN-SNN conversion methods (at least 500 time steps) in extremely fewer time steps (only 4 time steps). It is shown that our model could achieve comparable performance to the ANN with the same architecture while consuming 5.83 times less energy on the frame-based COCO Dataset and the event-based Gen1 Dataset., Comment: Accepted by ICCV2023

Given an untrimmed video, repetitive actions counting aims to estimate the number of repetitions of class-agnostic actions. To handle the various length of videos and repetitive actions, also optimization challenges in end-to-end video model training, down-sampling is commonly utilized in recent state-of-the-art methods, leading to ignorance of several repetitive samples. In this paper, we attempt to understand repetitive actions from a full temporal resolution view, by combining offline feature extraction and temporal convolution networks. The former step enables us to train repetition counting network without down-sampling while preserving all repetition regardless of the video length and action frequency, and the later network models all frames in a flexible and dynamically expanding temporal receptive field to retrieve all repetitions with a global aspect. We experimentally demonstrate that our method achieves better or comparable performance in three public datasets, i.e., TransRAC, UCFRep and QUVA. We expect this work will encourage our community to think about the importance of full temporal resolution., Comment: 12 pages and 4 figures and 17 conferences

Uncertainty estimation is critical for numerous applications of deep neural networks and draws growing attention from researchers. Here, we demonstrate an uncertainty quantification approach for deep neural networks used in inverse problems based on cycle consistency. We build forward-backward cycles using the physical forward model available and a trained deep neural network solving the inverse problem at hand, and accordingly derive uncertainty estimators through regression analysis on the consistency of these forward-backward cycles. We theoretically analyze cycle consistency metrics and derive their relationship with respect to uncertainty, bias, and robustness of the neural network inference. To demonstrate the effectiveness of these cycle consistency-based uncertainty estimators, we classified corrupted and out-of-distribution input image data using some of the widely used image deblurring and super-resolution neural networks as testbeds. The blind testing of our method outperformed other models in identifying unseen input data corruption and distribution shifts. This work provides a simple-to-implement and rapid uncertainty quantification method that can be universally applied to various neural networks used for solving inverse problems., Comment: 28 Pages, 4 Figures, 1 Table

Within the two-flavor Nambu--Jona-Lasinio model, we derive a self-consistent thermodynamic potential $\Omega$ for a QCD matter in an external magnetic field $B$. To be consistent with Schwinger's renormalization spirit, counter terms with vacuum quark mass are introduced into $\Omega$ and then the explicit $B$-dependent parts can be regularized in a cutoff-free way. Following that, explicit expressions of gap equation and magnetization can be consistently obtained according to the standard thermodynamic relations. The formalism is able to reproduce the paramagnetic feature of a QCD matter without ambiguity. For more realistic study, a running coupling constant is also adopted to account for the inverse magnetic catalysis effect. It turns out that the running coupling would greatly suppress magnetization at large $B$ and is important to reproduce the temperature enhancement effect to magnetization. The case with finite baryon chemical potential is also explored: no sign of first-order transition is found by varying $B$ for the running coupling and the de Haas-van Alphen oscillation shows up in the small $B$ region.

Event cameras, offering high temporal resolutions and high dynamic ranges, have brought a new perspective to address common challenges (e.g., motion blur and low light) in monocular depth estimation. However, how to effectively exploit the sparse spatial information and rich temporal cues from asynchronous events remains a challenging endeavor. To this end, we propose a novel event-based monocular depth estimator with recurrent transformers, namely EReFormer, which is the first pure transformer with a recursive mechanism to process continuous event streams. Technically, for spatial modeling, a novel transformer-based encoder-decoder with a spatial transformer fusion module is presented, having better global context information modeling capabilities than CNN-based methods. For temporal modeling, we design a gate recurrent vision transformer unit that introduces a recursive mechanism into transformers, improving temporal modeling capabilities while alleviating the expensive GPU memory cost. The experimental results show that our EReFormer outperforms state-of-the-art methods by a margin on both synthetic and real-world datasets. We hope that our work will attract further research to develop stunning transformers in the event-based vision community. Our open-source code can be found in the supplemental material., Comment: 10 pages, 5 figures

Recently, Bird's-Eye-View (BEV) representation has gained increasing attention in multi-view 3D object detection, which has demonstrated promising applications in autonomous driving. Although multi-view camera systems can be deployed at low cost, the lack of depth information makes current approaches adopt large models for good performance. Therefore, it is essential to improve the efficiency of BEV 3D object detection. Knowledge Distillation (KD) is one of the most practical techniques to train efficient yet accurate models. However, BEV KD is still under-explored to the best of our knowledge. Different from image classification tasks, BEV 3D object detection approaches are more complicated and consist of several components. In this paper, we propose a unified framework named BEV-LGKD to transfer the knowledge in the teacher-student manner. However, directly applying the teacher-student paradigm to BEV features fails to achieve satisfying results due to heavy background information in RGB cameras. To solve this problem, we propose to leverage the localization advantage of LiDAR points. Specifically, we transform the LiDAR points to BEV space and generate the foreground mask and view-dependent mask for the teacher-student paradigm. It is to be noted that our method only uses LiDAR points to guide the KD between RGB models. As the quality of depth estimation is crucial for BEV perception, we further introduce depth distillation to our framework. Our unified framework is simple yet effective and achieves a significant performance boost. Code will be released., Comment: 12pages

In the framework of the improved chromomagnetic interaction model, we complete a systematic study of the $S$-wave tetraquark states $Qq\bar{Q}\bar{q}$ ($Q=c,b$, and $q=u,d,s$) with different quantum numbers, $J^{PC}=0^{+(+)}$, $1^{+(\pm)}$, and $2^{+(+)}$. The mass spectra of tetraquark states are predicted and the possible decay channels are analyzed by considering both the angular momentum and $\mathcal{C}$-parity conservation. The recently observed hidden-charm tetraquark states with strangeness, such as $Z_{cs}(3985)^-$, $X(3960)$, and $Z_{cs}(4220)^+$, can be well explained in our model. Besides, based on the wave function of each tetraquark state, we find that the low-lying states of each $Qq\bar{Q}\bar{q}$ configuration have a large overlap to the $Q\bar Q$ and $q\bar q$ meson basis, instead of $Q\bar q$ and $q\bar Q$ meson basis. This indicates one can search these tetraquark states in future experiments via the channel of $Q\bar Q$ and $q\bar q$ mesons., Comment: 11 pages, 9 figures, and 4 tables; accepted for publication in Chinese Physics C

We study the relation between chiral and $U_A(1)$ symmetries in the quark-meson model. Although quarks and mesons are described in mean field approximation, the topological susceptibility characterizing the $U_A(1)$ breaking comprises two components: one controlled by the condensate and the other by the meson fluctuation. The $U_A(1)$ restoration is governed by the competition of these components. In a hot medium, the condensates melt. However, the fluctuation is enhanced. Therefore, the $U_A(1)$ symmetry cannot be solely restored via the temperature effect. Nevertheless, the baryon density reduces the condensates and fluctuation, and thereby, the $U_A(1)$ symmetry can only be restored in a dense or dense and hot medium. The strange condensate plays a weak role in the susceptibility, and the chiral and $U_A(1)$ symmetry restorations occur almost at the same critical point., Comment: 9 pages, 4 figures. Published version

Transversely loaded bidimensional-magneto-optical-traps (2D-MOT) have been recently developed as high flux sources for cold strontium atoms to realize a new generation of compact experimental setups. Here, we discuss on the implementation of a cross-polarized bi-color slower for a strontium atomic beam improving the 2D-MOT loading, and increasing the number of atoms in a final MOT by eleven times. Our slowing scheme addresses simultaneously two excited Zeeman substates of the 88Sr 1S0->1P1 transition at 461 nm. We also realized a 3-axis active feedback control of the magnetic field down to the microgauss regime. Such a compensation is performed thanks to a network of eight magnetic field probes arranged in a cuboid configuration around the atomic cold sample, and a pair of coils in Helmholtz configuration along each of three Cartesian directions. Our active feedback is capable of efficiently suppressing most of the magnetically-induced position fluctuations of the 689~nm intercombination-line MOT., Comment: 8 pages, 6 figures