Search

We derive universal formulae for integrating out heavy degrees of freedom in scalar field theories up to one-loop level in terms of covariant quantities associated with the geometry of the field manifold. The universal matching results can be readily applied to phenomenologically interesting extensions of the Standard Model, as we demonstrate using a singlet scalar example. We also discuss the role of field redefinitions in effective field theory matching and simplifications resulting from going to a field basis where interactions are encoded in a nontrivial metric on the field manifold., Comment: 42 pages

In this work, we introduce Gemma 2, a new addition to the Gemma family of lightweight, state-of-the-art open models, ranging in scale from 2 billion to 27 billion parameters. In this new version, we apply several known technical modifications to the Transformer architecture, such as interleaving local-global attentions (Beltagy et al., 2020a) and group-query attention (Ainslie et al., 2023). We also train the 2B and 9B models with knowledge distillation (Hinton et al., 2015) instead of next token prediction. The resulting models deliver the best performance for their size, and even offer competitive alternatives to models that are 2-3 times bigger. We release all our models to the community.

In this technical report, we detail our first-place solution for the 2024 Waymo Open Dataset Challenge's semantic segmentation track. We significantly enhanced the performance of Point Transformer V3 on the Waymo benchmark by implementing cutting-edge, plug-and-play training and inference technologies. Notably, our advanced version, Point Transformer V3 Extreme, leverages multi-frame training and a no-clipping-point policy, achieving substantial gains over the original PTv3 performance. Additionally, employing a straightforward model ensemble strategy further boosted our results. This approach secured us the top position on the Waymo Open Dataset semantic segmentation leaderboard, markedly outperforming other entries., Comment: 1st Place Solution for 2024 Waymo Open Dataset Challenge in Semantic Segmentation

In the realm of autonomous driving, accurate 3D perception is the foundation. However, developing such models relies on extensive human annotations -- a process that is both costly and labor-intensive. To address this challenge from a data representation learning perspective, we introduce SuperFlow, a novel framework designed to harness consecutive LiDAR-camera pairs for establishing spatiotemporal pretraining objectives. SuperFlow stands out by integrating two key designs: 1) a dense-to-sparse consistency regularization, which promotes insensitivity to point cloud density variations during feature learning, and 2) a flow-based contrastive learning module, carefully crafted to extract meaningful temporal cues from readily available sensor calibrations. To further boost learning efficiency, we incorporate a plug-and-play view consistency module that enhances the alignment of the knowledge distilled from camera views. Extensive comparative and ablation studies across 11 heterogeneous LiDAR datasets validate our effectiveness and superiority. Additionally, we observe several interesting emerging properties by scaling up the 2D and 3D backbones during pretraining, shedding light on the future research of 3D foundation models for LiDAR-based perception., Comment: ECCV 2024; 36 pages, 11 figures, 11 tables; Code at https://github.com/Xiangxu-0103/SuperFlow

Despite extensive exploration of acoustic vortices carrying orbital angular momentum (OAM), the generation of acoustic vortices with OAM orientations beyond the conventional longitudinal direction remains largely unexplored. Spatiotemporal (ST) vortices, featuring spiral phase twisting in the ST domain and carrying transverse OAM, have recently attracted considerable interest in optics and acoustics. Here, we report the generation of three-dimensional (3D) ST acoustic vortices with arbitrarily oriented OAM, thereby opening up a new dimension in acoustic OAM control. By utilizing a two-dimensional (2D) acoustic phased array, we introduce two approaches to manipulate the orientation of OAM: through the direct rotation of vortices in 3D space and the intersection of vortices carrying distinct types of OAM. These methods enable unprecedented control over the orientation of acoustic OAM, providing a new degree of freedom in the manipulation of acoustic waves. The arbitrarily oriented OAM holds promise for enhancing acoustic communication by broadening capacity and enabling more complex particle manipulation techniques. Our work establishes a foundation for future explorations into the complex dynamics of novel structured acoustic fields in the ST domain.

The yield stress anomaly of L12 intermetallics such as Ni3Al or Ni3Ga is controlled by the so-called Kear-Wilsdorf lock (KWL), of which the formation and unlocking are governed by dislocation cross-slip. Despite the importance of L12 intermetallics for strengthening Ni-based superalloys, microscopic understanding of the KWL is limited. Here, molecular dynamics simulations are conducted by employing a dedicated machine-learning interatomic potential derived via physically-informed active-learning. The potential facilitates modelling of the dislocation behavior in Ni3Al with near ab initio accuracy. KWL formation and unlocking are observed and analyzed. The unlocking stress demonstrates a pronounced temperature dependence, contradicting the assumptions of existing analytical models. A phenomenological model is proposed to effectively describe the atomistic unlocking stresses and extrapolate them to the macroscopic scale. The model is general and applicable to other L12 intermetallics. The acquired knowledge of KWLs provides a deeper understanding on the origin of the yield stress anomaly.

Protecting digital identities of human face from various attack vectors is paramount, and face anti-spoofing plays a crucial role in this endeavor. Current approaches primarily focus on detecting spoofing attempts within individual frames to detect presentation attacks. However, the emergence of hyper-realistic generative models capable of real-time operation has heightened the risk of digitally generated attacks. In light of these evolving threats, this paper aims to address two key aspects. First, it sheds light on the vulnerabilities of state-of-the-art face anti-spoofing methods against digital attacks. Second, it presents a comprehensive taxonomy of common threats encountered in face anti-spoofing systems. Through a series of experiments, we demonstrate the limitations of current face anti-spoofing detection techniques and their failure to generalize to novel digital attack scenarios. Notably, the existing models struggle with digital injection attacks including adversarial noise, realistic deepfake attacks, and digital replay attacks. To aid in the design and implementation of robust face anti-spoofing systems resilient to these emerging vulnerabilities, the paper proposes key design principles from model accuracy and robustness to pipeline robustness and even platform robustness. Especially, we suggest to implement the proactive face anti-spoofing system using active sensors to significant reduce the risks for unseen attack vectors and improve the user experience., Comment: Under review

In the rapidly evolving field of autonomous driving, precise segmentation of LiDAR data is crucial for understanding complex 3D environments. Traditional approaches often rely on disparate, standalone codebases, hindering unified advancements and fair benchmarking across models. To address these challenges, we introduce MMDetection3D-lidarseg, a comprehensive toolbox designed for the efficient training and evaluation of state-of-the-art LiDAR segmentation models. We support a wide range of segmentation models and integrate advanced data augmentation techniques to enhance robustness and generalization. Additionally, the toolbox provides support for multiple leading sparse convolution backends, optimizing computational efficiency and performance. By fostering a unified framework, MMDetection3D-lidarseg streamlines development and benchmarking, setting new standards for research and application. Our extensive benchmark experiments on widely-used datasets demonstrate the effectiveness of the toolbox. The codebase and trained models have been publicly available, promoting further research and innovation in the field of LiDAR segmentation for autonomous driving., Comment: Preprint; 17 pages, 4 figures, 7 tables; Code at https://github.com/open-mmlab/mmdetection3d

Mutual localization serves as the foundation for collaborative perception and task assignment in multi-robot systems. Effectively utilizing limited onboard sensors for mutual localization between marker-less robots is a worthwhile goal. However, due to inadequate consideration of large scale variations of the observed robot and localization refinement, previous work has shown limited accuracy when robots are equipped only with RGB cameras. To enhance the precision of localization, this paper proposes a novel rendezvous-based hierarchical architecture for mutual localization (RHAML). Firstly, to learn multi-scale robot features, anisotropic convolutions are introduced into the network, yielding initial localization results. Then, the iterative refinement module with rendering is employed to adjust the observed robot poses. Finally, the pose graph is conducted to globally optimize all localization results, which takes into account multi-frame observations. Therefore, a flexible architecture is provided that allows for the selection of appropriate modules based on requirements. Simulations demonstrate that RHAML effectively addresses the problem of multi-robot mutual localization, achieving translation errors below 2 cm and rotation errors below 0.5 degrees when robots exhibit 5 m of depth variation. Moreover, its practical utility is validated by applying it to map fusion when multi-robots explore unknown environments., Comment: 8 pages, 8 figures, submitted to RA-L

Efficient data utilization is crucial for advancing 3D scene understanding in autonomous driving, where reliance on heavily human-annotated LiDAR point clouds challenges fully supervised methods. Addressing this, our study extends into semi-supervised learning for LiDAR semantic segmentation, leveraging the intrinsic spatial priors of driving scenes and multi-sensor complements to augment the efficacy of unlabeled datasets. We introduce LaserMix++, an evolved framework that integrates laser beam manipulations from disparate LiDAR scans and incorporates LiDAR-camera correspondences to further assist data-efficient learning. Our framework is tailored to enhance 3D scene consistency regularization by incorporating multi-modality, including 1) multi-modal LaserMix operation for fine-grained cross-sensor interactions; 2) camera-to-LiDAR feature distillation that enhances LiDAR feature learning; and 3) language-driven knowledge guidance generating auxiliary supervisions using open-vocabulary models. The versatility of LaserMix++ enables applications across LiDAR representations, establishing it as a universally applicable solution. Our framework is rigorously validated through theoretical analysis and extensive experiments on popular driving perception datasets. Results demonstrate that LaserMix++ markedly outperforms fully supervised alternatives, achieving comparable accuracy with five times fewer annotations and significantly improving the supervised-only baselines. This substantial advancement underscores the potential of semi-supervised approaches in reducing the reliance on extensive labeled data in LiDAR-based 3D scene understanding systems., Comment: Preprint; 17 pages, 6 figures, 8 tables; Code at https://github.com/ldkong1205/LaserMix

Safety-critical 3D scene understanding tasks necessitate not only accurate but also confident predictions from 3D perception models. This study introduces Calib3D, a pioneering effort to benchmark and scrutinize the reliability of 3D scene understanding models from an uncertainty estimation viewpoint. We comprehensively evaluate 28 state-of-the-art models across 10 diverse 3D datasets, uncovering insightful phenomena that cope with both the aleatoric and epistemic uncertainties in 3D scene understanding. We discover that despite achieving impressive levels of accuracy, existing models frequently fail to provide reliable uncertainty estimates -- a pitfall that critically undermines their applicability in safety-sensitive contexts. Through extensive analysis of key factors such as network capacity, LiDAR representations, rasterization resolutions, and 3D data augmentation techniques, we correlate these aspects directly with the model calibration efficacy. Furthermore, we introduce DeptS, a novel depth-aware scaling approach aimed at enhancing 3D model calibration. Extensive experiments across a wide range of configurations validate the superiority of our method. We hope this work could serve as a cornerstone for fostering reliable 3D scene understanding. Code and benchmark toolkits are publicly available., Comment: Preprint; 37 pages, 8 figures, 11 tables; Code at https://github.com/ldkong1205/Calib3D

We present stability estimates for the inverse source problem of the stochastic Helmholtz equation in two and three dimensions by either near-field or far-field data. The random source is assumed to be a microlocally isotropic generalized Gaussian random function. For the direct problem, by exploring the regularity of the Green function, we demonstrate that the direct problem admits a unique bounded solution with an explicit integral representation, which enhances the existing regularity result. For the case using near-field data, the analysis of the inverse problem employs microlocal analysis to achieve an estimate for the Fourier transform of the micro-correlation strength by the near-field correlation data and a high-frequency tail. The stability follows by showing the analyticity of the data and applying a novel analytic continuation principle. The stability estimate by far-field data is derived by investigating the correlation of the far-field data. The stability estimate consists of the Lipschitz type data discrepancy and the logarithmic stability. The latter decreases as the upper bound of the frequency increases, which exhibits the phenomenon of increasing stability., Comment: 19pages

Accurate prediction of dissolved oxygen (DO) concentrations in lakes requires a comprehensive study of phenological patterns across ecosystems, highlighting the need for precise selection of interactions amongst external factors and internal physical-chemical-biological variables. This paper presents the Multi-population Cognitive Evolutionary Search (MCES), a novel evolutionary algorithm for complex feature interaction selection problems. MCES allows models within every population to evolve adaptively, selecting relevant feature interactions for different lake types and tasks. Evaluated on diverse lakes in the Midwestern USA, MCES not only consistently produces accurate predictions with few observed labels but also, through gene maps of models, reveals sophisticated phenological patterns of different lake types, embodying the innovative concept of "AI from nature, for nature".

In this paper, we investigate well-posedness of time-harmonic scattering of elastic waves by unbounded rigid rough surfaces in three dimensions. The elastic scattering is caused by an $L^2$ function with a compact support in the $x_3$-direction, and both deterministic and random surfaces are investigated via the variational approach. The rough surface in a deterministic setting is assumed to be Lipschitz and lie within a finite distance of a flat plane, and the scattering is caused by an inhomogeneous term in the elastic wave equation whose support lies within some finite distance of the boundary. For the deterministic case, a stability estimate of elastic scattering by rough surface is shown at an arbitrary frequency. It is noticed that all constants in {\it a priori} bounds are bounded by explicit functions of the frequency and geometry of rough surfaces. Furthermore, based on this explicit dependence on the frequency together with the measurability and $\mathbb{P}$-essentially separability of the randomness, we obtain a similar bound for the solution of the scattering by random surfaces.

This paper presents BrepGen, a diffusion-based generative approach that directly outputs a Boundary representation (B-rep) Computer-Aided Design (CAD) model. BrepGen represents a B-rep model as a novel structured latent geometry in a hierarchical tree. With the root node representing a whole CAD solid, each element of a B-rep model (i.e., a face, an edge, or a vertex) progressively turns into a child-node from top to bottom. B-rep geometry information goes into the nodes as the global bounding box of each primitive along with a latent code describing the local geometric shape. The B-rep topology information is implicitly represented by node duplication. When two faces share an edge, the edge curve will appear twice in the tree, and a T-junction vertex with three incident edges appears six times in the tree with identical node features. Starting from the root and progressing to the leaf, BrepGen employs Transformer-based diffusion models to sequentially denoise node features while duplicated nodes are detected and merged, recovering the B-Rep topology information. Extensive experiments show that BrepGen advances the task of CAD B-rep generation, surpassing existing methods on various benchmarks. Results on our newly collected furniture dataset further showcase its exceptional capability in generating complicated geometry. While previous methods were limited to generating simple prismatic shapes, BrepGen incorporates free-form and doubly-curved surfaces for the first time. Additional applications of BrepGen include CAD autocomplete and design interpolation. The code, pretrained models, and dataset are available at https://github.com/samxuxiang/BrepGen., Comment: Accepted to ACM SIGGRAPH 2024. Code at https://github.com/samxuxiang/BrepGen

LiDAR segmentation has become a crucial component in advanced autonomous driving systems. Recent range-view LiDAR segmentation approaches show promise for real-time processing. However, they inevitably suffer from corrupted contextual information and rely heavily on post-processing techniques for prediction refinement. In this work, we propose FRNet, a simple yet powerful method aimed at restoring the contextual information of range image pixels using corresponding frustum LiDAR points. Firstly, a frustum feature encoder module is used to extract per-point features within the frustum region, which preserves scene consistency and is crucial for point-level predictions. Next, a frustum-point fusion module is introduced to update per-point features hierarchically, enabling each point to extract more surrounding information via the frustum features. Finally, a head fusion module is used to fuse features at different levels for final semantic prediction. Extensive experiments conducted on four popular LiDAR segmentation benchmarks under various task setups demonstrate the superiority of FRNet. Notably, FRNet achieves 73.3% and 82.5% mIoU scores on the testing sets of SemanticKITTI and nuScenes. While achieving competitive performance, FRNet operates 5 times faster than state-of-the-art approaches. Such high efficiency opens up new possibilities for more scalable LiDAR segmentation. The code has been made publicly available at https://github.com/Xiangxu-0103/FRNet., Comment: Preprint; 16 pages, 8 figures, 10 tables; Code at https://github.com/Xiangxu-0103/FRNet

The sequential recommendation system has been widely studied for its promising effectiveness in capturing dynamic preferences buried in users' sequential behaviors. Despite the considerable achievements, existing methods usually focus on intra-sequence modeling while overlooking exploiting global collaborative information by inter-sequence modeling, resulting in inferior recommendation performance. Therefore, previous works attempt to tackle this problem with a global collaborative item graph constructed by pre-defined rules. However, these methods neglect two crucial properties when capturing global collaborative information, i.e., adaptiveness and personalization, yielding sub-optimal user representations. To this end, we propose a graph-driven framework, named Adaptive and Personalized Graph Learning for Sequential Recommendation (APGL4SR), that incorporates adaptive and personalized global collaborative information into sequential recommendation systems. Specifically, we first learn an adaptive global graph among all items and capture global collaborative information with it in a self-supervised fashion, whose computational burden can be further alleviated by the proposed SVD-based accelerator. Furthermore, based on the graph, we propose to extract and utilize personalized item correlations in the form of relative positional encoding, which is a highly compatible manner of personalizing the utilization of global collaborative information. Finally, the entire framework is optimized in a multi-task learning paradigm, thus each part of APGL4SR can be mutually reinforced. As a generic framework, APGL4SR can outperform other baselines with significant margins. The code is available at https://github.com/Graph-Team/APGL4SR.

Topological maps are favorable for their small storage compared to geometric map. However, they are limited in relocalization and path planning capabilities. To solve this problem, a feature-based hierarchical topological map (FHT-Map) is proposed along with a real-time map construction algorithm for robot exploration. Specifically, the FHT-Map utilizes both RGB cameras and LiDAR information and consists of two types of nodes: main node and support node. Main nodes will store visual information compressed by convolutional neural network and local laser scan data to enhance subsequent relocalization capability. Support nodes retain a minimal amount of data to ensure storage efficiency while facilitating path planning. After map construction with robot exploration, the FHT-Map can be used by other robots for relocalization and path planning. Experiments are conducted in Gazebo simulator, and the results demonstrate that the proposed FHT-Map can effectively improve relocalization and path planning capability compared with other topological maps. Moreover, experiments on hierarchical architecture are implemented to show the necessity of two types of nodes., Comment: 8 pages, 7figures, 2 tables

Finding all possible UV resonances of effective operators is an important task in the bottom-up approach of effective field theory. We present all the tree-level UV resonances for the dimension-5, -6 and -7 operators in the Standard Model effective field theory (SMEFT), and then obtain the correspondence between the UV resonances and the effective operators from the relations among their Wilson coefficients, through the functional matching and operator reduction procedure. This provides a cross-dimension UV/IR dictionary for the SMEFT at tree-level, and the methods used here, especially the on-shell construction of general UV Lagrangian and the systematic reduction of operators, are extendable for UV resonances of $d \geq 8$ operators in SMEFT and other EFTs., Comment: 55 pages, 1 figure, 12 tables

This paper presents a novel generative model for Computer Aided Design (CAD) that 1) represents high-level design concepts of a CAD model as a three-level hierarchical tree of neural codes, from global part arrangement down to local curve geometry; and 2) controls the generation or completion of CAD models by specifying the target design using a code tree. Concretely, a novel variant of a vector quantized VAE with "masked skip connection" extracts design variations as neural codebooks at three levels. Two-stage cascaded auto-regressive transformers learn to generate code trees from incomplete CAD models and then complete CAD models following the intended design. Extensive experiments demonstrate superior performance on conventional tasks such as random generation while enabling novel interaction capabilities on conditional generation tasks. The code is available at https://github.com/samxuxiang/hnc-cad., Comment: Accepted to ICML 2023. Project website at https://hnc-cad.github.io/

POI tagging aims to annotate a point of interest (POI) with some informative tags, which facilitates many services related to POIs, including search, recommendation, and so on. Most of the existing solutions neglect the significance of POI images and seldom fuse the textual and visual features of POIs, resulting in suboptimal tagging performance. In this paper, we propose a novel Multi-Modal Model for POI Tagging, namely M3PT, which achieves enhanced POI tagging through fusing the target POI's textual and visual features, and the precise matching between the multi-modal representations. Specifically, we first devise a domain-adaptive image encoder (DIE) to obtain the image embeddings aligned to their gold tags' semantics. Then, in M3PT's text-image fusion module (TIF), the textual and visual representations are fully fused into the POIs' content embeddings for the subsequent matching. In addition, we adopt a contrastive learning strategy to further bridge the gap between the representations of different modalities. To evaluate the tagging models' performance, we have constructed two high-quality POI tagging datasets from the real-world business scenario of Ali Fliggy. Upon the datasets, we conducted the extensive experiments to demonstrate our model's advantage over the baselines of uni-modality and multi-modality, and verify the effectiveness of important components in M3PT, including DIE, TIF and the contrastive learning strategy., Comment: Accepted by KDD 2023

The Stirling engine, which possesses external combustion characteristics, a simple structure, and high theoretical thermal efficiency, has excellent potential for utilizing finite waste heat and cold resources. However, practical applications of this technology suffered from thermal inefficiency due to the discontinuity and instability of waste resources. Despite advances in energy storage technology, temperature variations in the heat-exchanging fluids at the hot and cold ends of the Stirling engine remained significant obstacles. In this work, convective meta-thermal concentration (CMTC) was introduced between the heating (cooling) fluids and the hot (cold) end of the Stirling engine, employing alternating isotropic materials with high and low thermal conductivities. It was demonstrated that CMTC effectively enhanced the temperature difference between the hot and cold ends, leading to a remarkable improvement in Stirling engine efficiency. Particularly, when the Stirling engine efficiency tended to zero due to the limited availability of waste heat and cold resources, CMTC overcame this limitation, surpassing existing optimization technology. Further analysis under various operating conditions showed that CMTC achieved a significant thermal efficiency improvement of up to 1460%. This work expanded the application of thermal metamaterials to heat engine systems, offering an exciting avenue for sustainable energy utilization.

In this paper, by constructing the weight functions, a global Carleman estimate for the Schrodinger equation on a tree is established, with a strong assumption on the solution. And the estimate is able to be applied to derive the Lipschitz stability for an inverse coefficients problem.

The main purpose of this work is to study an inverse coefficient problem for the telegrapher's equations on a tree-shaped network. To analyze the stability for this inverse problem, Carleman estimate is established first. Based upon this estimate, a Lipschitz stability is further derived with additional data given on partial boundary.