Search

Time series self-supervised learning (SSL) aims to exploit unlabeled data for pre-training to mitigate the reliance on labels. Despite the great success in recent years, there is limited discussion on the potential noise in the time series, which can severely impair the performance of existing SSL methods. To mitigate the noise, the de facto strategy is to apply conventional denoising methods before model training. However, this pre-processing approach may not fully eliminate the effect of noise in SSL for two reasons: (i) the diverse types of noise in time series make it difficult to automatically determine suitable denoising methods; (ii) noise can be amplified after mapping raw data into latent space. In this paper, we propose denoising-aware contrastive learning (DECL), which uses contrastive learning objectives to mitigate the noise in the representation and automatically selects suitable denoising methods for every sample. Extensive experiments on various datasets verify the effectiveness of our method. The code is open-sourced., Comment: Accepted to 33rd International Joint Conference on Artificial Intelligence (IJCAI 2024)

Room-temperature (RT) two-dimensional (2D) van der Waals (vdW) ferromagnets hold immense promise for next-generation spintronic devices for information storage and processing. To achieve high-density energy-efficient spintronic devices, it is essential to understand local magnetic properties of RT 2D vdW magnets. In this work, we realize noninvasive in situ magnetic detection in vdW-layered ferromagnet Fe3GaTe2 using divacancy spins quantum sensor in silicon carbide (SiC) at RT. The structural features and magnetic properties of the Fe3GaTe2 are characterized utilizing Raman spectrum, magnetization and magneto-transport measurements. Further detailed analysis of temperature- and magnetic field-dependent optically detected magnetic resonances of the PL6 divacancy near the Fe3GaTe2 reveal that, the Curie temperature (Tc) of Fe3GaTe2 is ~360K, and the magnetization increases with external magnetic fields. Additionally, spin relaxometry technology is employed to probe the magnetic fluctuations of Fe3GaTe2, revealing a peak in the spin relaxation rate around Tc. These experiments give insights into the intriguing local magnetic properties of 2D vdW RT ferromagnet Fe3GaTe2 and pave the way for the application of SiC quantum sensors in noninvasive in situ magnetic detection of related 2D vdW magnets., Comment: 15 pages, 4 figures

As hydrogen is touted as a key player in the decarbonization of modern society, it is critical to enable quantitative H analysis at high spatial resolution, if possible at the atomic scale. Indeed, H has a known deleterious impact on the mechanical properties (strength, ductility, toughness) of most materials that can hinder their use as part of the infrastructure of a hydrogen-based economy. Enabling H mapping, including local hydrogen concentration analyses at specific microstructural features, is essential for understanding the multiple ways that H affect the properties of materials, including for instance embrittlement mechanisms and their synergies, but also spatial mapping and quantification of hydrogen isotopes is essential to accurately predict tritium inventory of future fusion power plants, ensuring their safe and efficient operation for example. Atom probe tomography (APT) has the intrinsic capabilities for detecting hydrogen (H), and deuterium (D), and in principle the capacity for performing quantitative mapping of H within a material's microstructure. Yet the accuracy and precision of H analysis by APT remain affected by the influence of residual hydrogen from the ultra-high vacuum chamber that can obscure the signal of H from within the material, along with a complex field evaporation behavior. The present article reports the essence of discussions at a focused workshop held at the Max-Planck Institute for Sustainable Materials in April 2024. The workshop was organized to pave the way to establishing best practices in reporting APT data for the analysis of H. We first summarize the key aspects of the intricacies of H analysis by APT and propose a path for better reporting of the relevant data to support interpretation of APT-based H analysis in materials.

Future wireless networks will integrate sensing, learning and communication to provide new services beyond communication and to become more resilient. Sensors at the network infrastructure, sensors on the user equipment, and the sensing capability of the communication signal itself provide a new source of data that connects the physical and radio frequency environments. A wireless network that harnesses all these sensing data can not only enable additional sensing services, but also become more resilient to channel-dependent effects like blockage and better support adaptation in dynamic environments as networks reconfigure. In this paper, we provide a vision for integrated sensing and communication (ISAC) networks and an overview of how signal processing, optimization and machine learning techniques can be leveraged to make them a reality in the context of 6G. We also include some examples of the performance of several of these strategies when evaluated using a simulation framework based on a combination of ray tracing measurements and mathematical models that mix the digital and physical worlds.

Graph learning plays a pivotal role and has gained significant attention in various application scenarios, from social network analysis to recommendation systems, for its effectiveness in modeling complex data relations represented by graph structural data. In reality, the real-world graph data typically show dynamics over time, with changing node attributes and edge structure, leading to the severe graph data distribution shift issue. This issue is compounded by the diverse and complex nature of distribution shifts, which can significantly impact the performance of graph learning methods in degraded generalization and adaptation capabilities, posing a substantial challenge to their effectiveness. In this survey, we provide a comprehensive review and summary of the latest approaches, strategies, and insights that address distribution shifts within the context of graph learning. Concretely, according to the observability of distributions in the inference stage and the availability of sufficient supervision information in the training stage, we categorize existing graph learning methods into several essential scenarios, including graph domain adaptation learning, graph out-of-distribution learning, and graph continual learning. For each scenario, a detailed taxonomy is proposed, with specific descriptions and discussions of existing progress made in distribution-shifted graph learning. Additionally, we discuss the potential applications and future directions for graph learning under distribution shifts with a systematic analysis of the current state in this field. The survey is positioned to provide general guidance for the development of effective graph learning algorithms in handling graph distribution shifts, and to stimulate future research and advancements in this area.

The study of transversal fluctuation of the optimal path has been a crucial aspect of the Kadar-Parisi-Zhang (KPZ) universality class. In this paper, we establish a new probability lower bound, with optimal exponential order, for the rare event in which a given level of the optimal path has a large transversal fluctuation. We present our results in both zero and positive temperature settings. The previously known lower bounds were obtained in zero temperature models, and they hold for the maximum transversal fluctuation along the entire geodesic (Hammond-Sarkar'20) or the starting portion of the geodesic at a local scale (Agarwal'23). Our result improves upon these as now the rare event can demand where the large fluctuation occurs exactly along the optimal path, on both local and global scales. Our proof utilizes the coupling method: we first obtain a version of the estimate in the semi-infinite setting using duality and then transfer the result to finite paths using planar monotonicity. Our method differs from the previous works (Agarwal'23, Hammond-Sarkar'20), and in fact, we do not require fine information about the left tail moderate deviation, which played a crucial role in (Agarwal'23, Hammond-Sarkar'20)., Comment: 25 pages, 4 figures

The nature of the insulator-to-metal phase transition in vanadium dioxide (VO2) is one of the longest-standing problems in condensed-matter physics. Ultrafast spectroscopy has long promised to determine whether the transition is primarily driven by the electronic or structural degree of freedom, but measurements to date have been stymied by their sensitivity to only one of these components and/or their limited temporal resolution. Here we use ultra-broadband few-femtosecond pump-probe spectroscopy to resolve the electronic and structural phase transitions in VO2 at their fundamental time scales. We find that the system transforms into a bad-metallic phase within 10 fs after photoexcitation, but requires another 100 fs to complete the transition, during which we observe electronic oscillations and a partial re-opening of the bandgap, signalling a transient semi-metallic state. Comparisons with tensor-network simulations and density-functional theory calculations show these features originate from oscillations around the equilibrium high-symmetry atomic positions during an unprecedentedly fast structural transition, in which the vanadium dimers separate and untwist with two different timescales. Our results resolve the complete structural and electronic nature of the light-induced phase transition in VO2 and establish ultra-broadband few-femtosecond spectroscopy as a powerful new tool for studying quantum materials out of equilibrium., Comment: 20 pages, 12 figures

Electromagnetic Ion Cyclotron (EMIC) waves can drive radiation belt depletion and Low-Earth Orbit (LEO) satellites can detect the resulting electron and proton precipitation. The ELFIN (Electron Losses and Fields InvestigatioN) CubeSats provide an excellent opportunity to study the properties of EMIC-driven electron precipitation with much higher energy and pitch-angle resolution than previously allowed. We collect EMIC-driven electron precipitation events from ELFIN observations and use POES (Polar Orbiting Environmental Satellites) to search for 10s-100s keV proton precipitation nearby as a proxy of EMIC wave activity. Electron precipitation mainly occurs on localized radial scales (0.3 L), over 15-24 MLT and 5-8 L shells, stronger at MeV energies and weaker down to 100-200 keV. Additionally, the observed loss cone pitch-angle distribution agrees with quasilinear predictions at >250 keV (more filled loss cone with increasing energy), while additional mechanisms are needed to explain the observed low-energy precipitation., Comment: This manuscript has been accepted by Geophysical Research Letters in June 2023, currently pending publication. The version here is the accepted version

Label scarcity in a graph is frequently encountered in real-world applications due to the high cost of data labeling. To this end, semi-supervised domain adaptation (SSDA) on graphs aims to leverage the knowledge of a labeled source graph to aid in node classification on a target graph with limited labels. SSDA tasks need to overcome the domain gap between the source and target graphs. However, to date, this challenging research problem has yet to be formally considered by the existing approaches designed for cross-graph node classification. This paper proposes a novel method called SemiGCL to tackle the graph \textbf{Semi}-supervised domain adaptation with \textbf{G}raph \textbf{C}ontrastive \textbf{L}earning and minimax entropy training. SemiGCL generates informative node representations by contrasting the representations learned from a graph's local and global views. Additionally, SemiGCL is adversarially optimized with the entropy loss of unlabeled target nodes to reduce domain divergence. Experimental results on benchmark datasets demonstrate that SemiGCL outperforms the state-of-the-art baselines on the SSDA tasks. The source codes of SemiGCL are publicly available at https://github.com/ JiarenX/SemiGCL.

Graph neural networks (GNNs) have shown great ability in modeling graphs, however, their performance would significantly degrade when there are noisy edges connecting nodes from different classes. To alleviate negative effect of noisy edges on neighborhood aggregation, some recent GNNs propose to predict the label agreement between node pairs within a single network. However, predicting the label agreement of edges across different networks has not been investigated yet. Our work makes the pioneering attempt to study a novel problem of cross-network homophilous and heterophilous edge classification (CNHHEC), and proposes a novel domain-adaptive graph attention-supervised network (DGASN) to effectively tackle the CNHHEC problem. Firstly, DGASN adopts multi-head GAT as the GNN encoder, which jointly trains node embeddings and edge embeddings via the node classification and edge classification losses. As a result, label-discriminative embeddings can be obtained to distinguish homophilous edges from heterophilous edges. In addition, DGASN applies direct supervision on graph attention learning based on the observed edge labels from the source network, thus lowering the negative effects of heterophilous edges while enlarging the positive effects of homophilous edges during neighborhood aggregation. To facilitate knowledge transfer across networks, DGASN employs adversarial domain adaptation to mitigate domain divergence. Extensive experiments on real-world benchmark datasets demonstrate that the proposed DGASN achieves the state-of-the-art performance in CNHHEC., Comment: IEEE Transactions on Neural Networks and Learning Systems, 2023

We consider i.i.d. first-passage percolation (FPP) on the two-dimensional square lattice, in the critical case where edge-weights take the value zero with probability $1/2$. Critical FPP is unique in that the Euclidean lengths of geodesics are superlinear, rather than linear, in the distance between their endpoints. This fact was speculated by Kesten in 1986 but not confirmed until 2019 by Damron and Tang, who showed a lower bound on geodesic length that is polynomial with degree strictly greater than $1$. In this paper we establish the first non-trivial upper bound. Namely, we prove that for a large class of critical edge-weight distributions, the shortest geodesic from the origin to a box of radius $R$ uses at most $R^{2+\epsilon}\pi_3(R)$ edges with high probability, for any $\epsilon > 0$. Here $\pi_3(R)$ is the polychromatic 3-arm probability from classical Bernoulli percolation; upon inserting its conjectural asymptotic, our bound converts to $R^{4/3 + \epsilon}$. In any case, it is known that $\pi_3(R) \lesssim R^{-\delta}$ for some $\delta > 0$, and so our bound gives an exponent strictly less than $2$. In the special case of Bernoulli($1/2$) edge-weights, we replace the additional factor of $R^\epsilon$ with a constant and give an expectation bound., Comment: 62 pages, 14 figures

Cross-network node classification (CNNC), which aims to classify nodes in a label-deficient target network by transferring the knowledge from a source network with abundant labels, draws increasing attention recently. To address CNNC, we propose a domain-adaptive message passing graph neural network (DM-GNN), which integrates graph neural network (GNN) with conditional adversarial domain adaptation. DM-GNN is capable of learning informative representations for node classification that are also transferrable across networks. Firstly, a GNN encoder is constructed by dual feature extractors to separate ego-embedding learning from neighbor-embedding learning so as to jointly capture commonality and discrimination between connected nodes. Secondly, a label propagation node classifier is proposed to refine each node's label prediction by combining its own prediction and its neighbors' prediction. In addition, a label-aware propagation scheme is devised for the labeled source network to promote intra-class propagation while avoiding inter-class propagation, thus yielding label-discriminative source embeddings. Thirdly, conditional adversarial domain adaptation is performed to take the neighborhood-refined class-label information into account during adversarial domain adaptation, so that the class-conditional distributions across networks can be better matched. Comparisons with eleven state-of-the-art methods demonstrate the effectiveness of the proposed DM-GNN., Comment: This version rectifies the numerical inaccuracies of Table 3 and 4 in the printed version (https://doi.org/10.1016/j.neunet.2023.04.038). See our corrigendum at https://doi.org/10.1016/j.neunet.2023.09.026

We study a class of long-range solvable models in IR limit which corresponds to a one-dimensional long-range conformal manifold. This class of long-range model can be interpreted as the non-unitary interpolation between the Sachdev-Ye-Kiteav-like model and the free theory. We investigate the chaos and information scrambling of the model by analyzing its out-of-time order correlators. We find the suppression of the Lyapunov exponent by the long-range interaction and a slowdown in butterfly velocity in the emergent light cone which can be interpreted as the contribution from the anomalous dimension of the stress tensor in the spectrum. We further study a Yukawa-SYK model located in a 3-dimensional boundary with a free field living in a 4-dimensional bulk. The boundary IR spectrum of the model contains a tower of the spinning operators protected by the higher spin symmetry of the bulk. We evaluate the central charge and the Lyapunov exponent of the model., Comment: 12 pages, 10 figures, comments are welcome

The study of Kadar-Parsi-Zhang (KPZ) universality class has been a subject of great interest among mathematicians and physicists over the past three decades. A notably successful approach for analyzing KPZ models is the coupling method, which hinges on understanding random growth from stationary initial conditions defined by Busemann functions. To advance in this direction, we investigate the independence property of the Busemann function across multiple directions in various exactly solvable KPZ models. These models encompass the corner growth model, the inverse-gamma polymer, Brownian last-passage percolation, the O'Connell-Yor polymer, the KPZ equation, and the directed landscape. In the context of the corner growth model, our result states that disjoint Busemann increments in different directions along a down-right path are independent, as long as their associated semi-infinite geodesics have nonempty intersections almost surely. The proof for the independence utilizes the queueing representation of the Busemann process developed by Sepp\"al\"ainen et al. As an application, our independence result yields a near-optimal probability upper bound (missing by a logarithmic factor) for the rare event where the endpoint of a point-to-line inverse-gamma polymer is close to the diagonal., Comment: 25 pages, 4 figures

Temporal correlation for randomly growing interfaces in the KPZ universality class is a topic of recent interest. Most of the works so far have been concentrated on the zero temperature model of exponential last passage percolation, and three special initial conditions, namely droplet, flat and stationary. We focus on studying the time correlation problem for generic random initial conditions with diffusive growth. We formulate our results in terms of the positive temperature exactly solvable model of the inverse-gamma polymer and obtain up to constant upper and lower bounds for the correlation between the free energy of two polymers whose endpoints are close together or far apart. Our proofs apply almost verbatim to the zero temperature set-up of exponential LPP and are valid for a broad class of initial conditions. Our work complements and completes the partial results obtained in (Ferrari-Occelli'19), following the conjectures of (Ferrari-Spohn'16). Moreover, our arguments rely on the one-point moderate deviation estimates which have recently been obtained using stationary polymer techniques and thus do not depend on complicated exact formulae., Comment: 47 pages, 3 figures

Integrated sensing and communication (ISAC) has been proposed as a promising paradigm in the future wireless networks, where the spectral and hardware resources are shared to provide a considerable performance gain. It is essential to understand how sensing and communication (S\&C) influences each other to guide the practical algorithm and system design in ISAC. In this paper, we investigate the performance tradeoff between S\&C in a single-input single-output (SISO) ISAC system with finite blocklength. In particular, we present the system model and the ISAC scheme, after which the rate-error tradeoff is introduced as the performance metric. Then we derive the achievability and converse bounds for the rate-error tradeoff, determining the boundary of the joint S\&C performance. Furthermore, we develop the asymptotic analysis at large blocklength regime, where the performance tradeoff between S\&C is proved to vanish as the blocklength tends to infinity. Finally, our theoretical analysis is consolidated by simulation results., Comment: Accepted by ICC 2023

Understanding the decay of correlations in time for (1+1)-dimensional polymer models in the KPZ universality class has been a challenging topic. Following numerical studies by physicists, concrete conjectures were formulated by Ferrari and Spohn (Ferrari-Spohn '16) in the context of planar exponential last passage percolation. These have mostly been resolved by various authors. In the context of positive temperature lattice models, however, these questions have remained open. We consider the time correlation problem for the exactly solvable inverse-gamma polymer in $\mathbb{Z}^2$. We establish, up to constant factors, upper and lower bounds on the correlation between free energy functions for two polymers rooted at the origin (droplet initial condition) when the endpoints are either close together or far apart. We find the same exponents as predicted in (Ferrari-Spohn '16). Our arguments rely on the understanding of stationary polymers, coupling, and random walk comparison. We use recently established moderate deviation estimates for the free energy. In particular, we do not require asymptotic analysis of complicated exact formulae., Comment: 68 pages, 7 figures, updated references in V2

We show that two semi-infinite positive temperature polymers coalesce on the scale predicted by KPZ (Kardar-Parisi-Zhang) universality. The two polymer paths have the same asymptotic direction and evolve in the same environment, independently until coalescence. If they start at distance $k$ apart, their coalescence occurs on the scale $k^{3/2}$. It follows that the total variation distance of two semi-infinite polymer measures decays on this same scale. Our results are upper and lower bounds on probabilities and expectations that match, up to constant factors and occasional logarithmic corrections. Our proofs are done in the context of the solvable inverse-gamma polymer model, but without appeal to integrable probability. With minor modifications, our proofs give also bounds on transversal fluctuations of the polymer path. Since the free energy of a directed polymer is a discretization of a stochastically forced viscous Hamilton-Jacobi equation, our results suggest that the hyperbolicity phenomenon of such equations obeys the KPZ exponent., Comment: 48 pages, 16 figures

We present the calculation of the next-to-leading order (NLO) electroweak (EW) corrections proportional to the Higgs trilinear self-coupling ($\lambda_{HHH}$) for Higgs boson plus one jet production at the Large Hadron Collider (LHC). We use the method of large top quark mass expansion to tackle the most challenging two-loop virtual amplitude, and apply the Pad\'{e} approximation to extend the region of convergence of the expansion. We find that the NLO EW corrections is $0.66\%$ for the total cross section. For the invariant mass distribution and Higgs boson transverse momentum distribution, the NLO corrections are almost flat with their values similar in size. Our results can be used to set extra constraints on $\lambda_{HHH}$ at the LHC., Comment: 9 pages, 5 figures, 2 tables

Recent years, graph contrastive learning (GCL), which aims to learn representations from unlabeled graphs, has made great progress. However, the existing GCL methods mostly adopt human-designed graph augmentations, which are sensitive to various graph datasets. In addition, the contrastive losses originally developed in computer vision have been directly applied to graph data, where the neighboring nodes are regarded as negatives and consequently pushed far apart from the anchor. However, this is contradictory with the homophily assumption of networks that connected nodes often belong to the same class and should be close to each other. In this work, we propose an end-to-end automatic GCL method, named NCLA to apply neighbor contrastive learning on learnable graph augmentation. Several graph augmented views with adaptive topology are automatically learned by the multi-head graph attention mechanism, which can be compatible with various graph datasets without prior domain knowledge. In addition, a neighbor contrastive loss is devised to allow multiple positives per anchor by taking network topology as the supervised signals. Both augmentations and embeddings are learned end-to-end in the proposed NCLA. Extensive experiments on the benchmark datasets demonstrate that NCLA yields the state-of-the-art node classification performance on self-supervised GCL and even exceeds the supervised ones, when the labels are extremely limited. Our code is released at https://github.com/shenxiaocam/NCLA.

The first two-dimensional (2D) polymorphs of antimony dioxide, namely, $\gamma$-Sb$_2$O$_4$ and $\delta$-Sb$_2$O$_4$, are predicted using the evolutionary algorithm combined with first-principles density functional theory (DFT) calculations. Out-of-plane ferroelectricity is found in $\gamma$-Sb$_2$O$_4$, while in-plane ferroelectricity is found in $\delta$-Sb$_2$O$_4$. The predicted dipole moments of $\gamma$-Sb$_2$O$_4$ and $\delta$-Sb$_2$O$_4$ phases are 36.63 and 14.96 e\r{A}, respectively, implying that they can be good candidates for making ferroelectric devices. The calculations show that doping with other group V elements or applying strain can lower the switching energy barriers and thus facilitate switching. Results from GW calculations show indirect band gaps of 5.51 and 3.39 eV for $\gamma$-Sb$_2$O$_4$ and $\delta$-Sb$_2$O$_4$ in their monolayers, respectively. Raman spectra are calculated to facilitate the experimental investigation of the predicted structures. The existence of both in-plane and out-of-plane 2D ferroelectricity and the large band gaps make this material system particularly interesting for potential applications.

First-passage percolation is a random growth model defined on $\mathbb{Z}^d$ using i.i.d. nonnegative weights $(\tau_e)$ on the edges. Letting $T(x,y)$ be the distance between vertices $x$ and $y$ induced by the weights, we study the random ball of radius $t$ centered at the origin, $B(t) = \{x \in \mathbb{Z}^d : T(0,x) \leq t\}$. It is known that for all such $\tau_e$, the number of vertices (volume) of $B(t)$ is at least order $t^d$, and under mild conditions on $\tau_e$, this volume grows like a deterministic constant times $t^d$. Defining a hole in $B(t)$ to be a bounded component of the complement $B(t)^c$, we prove that if $\tau_e$ is not deterministic, then a.s., for all large $t$, $B(t)$ has at least $ct^{d-1}$ many holes, and the maximal volume of any hole is at least $c\log t$. Conditionally on the (unproved) uniform curvature assumption, we prove that a.s., for all large $t$, the number of holes is at most $(\log t)^C t^{d-1}$, and for $d=2$, no hole in $B(t)$ has volume larger than $(\log t)^C$. Without curvature, we show that no hole has volume larger than $Ct \log t$., Comment: 28 pages, 8 figures

Ferroelectric (FE) metals have been attracting attention as they possess both metallicity and ferroelectricity, the two seemingly incompatible physical properties. An important problem for both fundamental research and potential applications is how to realize a strong FE metal. One strategy is to dope a strong FE insulator into an FE metal provided that the induced free electrons do not destroy FE distortion. Strained EuTiO$_{3}$ film is a strong FE ferromagnet and a promising candidate for such a strategy. Here, we calculate the structural, electronic, and polarization properties of Nb-doped strained EuTiO$_{3}$ film using the hybrid density-functional theory. The results show that the strained EuTi$_{0.875}$Nb$_{0.125}$O$_{3}$ film is a strong FE metal as the Nb doping induces metallicity without weakening the FE distortion. The underlying atomistic mechanism of the coexistence of metallicity and strong ferroelectricity is discussed. The findings show that combining doping and strain engineering is a promising way to realize new EuTiO$_{3}$-based strong FE metals and may be used in other materials as well.