Search

We measured the full complex ac conductance of two-dimensional granular In/InO$_x$ composites using the mutual inductance technique to explore the transition from a "failed-superconductor-turned anomalous metal" to a robust superconductor. In this system, room-temperature annealing was adopted to tune the InO$_x$-mediated coupling between In grains, allowing for the observation of both a "true" superconductor-to-insulator transition and the emergence of an intervening anomalous metallic state. In this paper, we show that further annealing increases the inter-grain coupling, which eliminates the anomalous metallic phase, but at the same time prevent the emergence of strong Bose-dominated insulating phase. The complex ac conductance revealed a $T\to0$ saturating dissipative response in a finite magnetic field, coexisting with a robust superfluid density. The anomalous power-law spectra for the dissipative response appear to indicate quantum critical behavior proximate to a quantum superconductor to anomalous-metal transition as probed in the kilo-Hertz range, and point to signatures of gapless superconductivity in our granular superconducting system., Comment: Main text: 9 pages, 6 figures; supplementary: 5 pages, 3 figures

We report an extensive extensive study of the noncentrosymmetric half-Heusler topological superconductor YPtBi, revealing unusual relation between bulk superconductivity and the appearance of surface superconductivity at temperatures up to 3 times the bulk transition temperature. Transport measurements confirmed the low carrier density of the material and its bulk superconducting transition, which was also observed in ac susceptibility through mutual inductance (MI) measurements. However, a weak signature of superconductivity in the MI measurements appeared much above the bulk transition temperature, which was further observed in scanning tunneling spectroscopy. Polar Kerr effect measurements suggest that while the bulk superconductor may exhibit an unusual nodal superconducting state, only the surface state breaks time reversal symmetry. Complementary tunneling measurements on LuPtBi are used to establish the observations on YPtBi, while density-functional theory (DFT) calculations may shed light on the origin of this unusual surface state., Comment: 11 pages, 10 figures

We study rotating compact stars that are mixtures of the ordinary nuclear matter in a neutron star and fermionic dark matter. After deriving equations describing a slowly rotating system made up of an arbitrary number of perfect fluids, we specialize to the two-fluid case, where the first fluid describes ordinary matter and the second fluid describes dark matter. Electromagnetic observations of the moment of inertia and angular momentum directly probe ordinary matter and not dark matter. Upon taking this into account, we show that the I-Love-Q relations for dark matter admixed neutrons stars can deviate significantly from the standard single-fluid relationships., Comment: 16 pages, 3 figures

Layer compositing is one of the most popular image editing workflows among both amateurs and professionals. Motivated by the success of diffusion models, we explore layer compositing from a layered image generation perspective. Instead of generating an image, we propose to generate background, foreground, layer mask, and the composed image simultaneously. To achieve layered image generation, we train an autoencoder that is able to reconstruct layered images and train diffusion models on the latent representation. One benefit of the proposed problem is to enable better compositing workflows in addition to the high-quality image output. Another benefit is producing higher-quality layer masks compared to masks produced by a separate step of image segmentation. Experimental results show that the proposed method is able to generate high-quality layered images and initiates a benchmark for future work., Comment: Preprint. Work in progress

The screening response of vortices in kagome superconductor CsV$_3$Sb$_5$ was measured using the ac mutual inductance technique. Besides confirming the absence of gapless quasiparticles in zero external magnetic field, we observe the peak effect, manifested in enhanced vortex pinning strength and critical current, in a broad intermediate range of magnetic field. The peaks are followed by another crossover from strong to weak pinning, unlike the usual peak effect that diminishes smoothly at $H_{c2}$. Hysteresis in the screening response allows the identification of a vortex glass phase which strongly correlates with the onset of the peaks. A variety of features in the temperature- and field-dependence of the screening response, corroborated by resistance and dc magnetization measurements, have allowed us to extract an $H$-$T$ phase diagram of the vortex states and to infer the irreversibility line $H_\text{irr}(T)$., Comment: Main text: 6 pages, 4 figures; supplementary: 10 pages, 8 figures

A real-world text corpus sometimes comprises not only text documents but also semantic links between them (e.g., academic papers in a bibliographic network are linked by citations and co-authorships). Text documents and semantic connections form a text-rich network, which empowers a wide range of downstream tasks such as classification and retrieval. However, pretraining methods for such structures are still lacking, making it difficult to build one generic model that can be adapted to various tasks on text-rich networks. Current pretraining objectives, such as masked language modeling, purely model texts and do not take inter-document structure information into consideration. To this end, we propose our PretrAining on TexT-Rich NetwOrk framework Patton. Patton includes two pretraining strategies: network-contextualized masked language modeling and masked node prediction, to capture the inherent dependency between textual attributes and network structure. We conduct experiments on four downstream tasks in five datasets from both academic and e-commerce domains, where Patton outperforms baselines significantly and consistently., Comment: ACL 2023. (Code: https://github.com/PeterGriffinJin/Patton)

Traditional federated classification methods, even those designed for non-IID clients, assume that each client annotates its local data with respect to the same universal class set. In this paper, we focus on a more general yet practical setting, non-identical client class sets, where clients focus on their own (different or even non-overlapping) class sets and seek a global model that works for the union of these classes. If one views classification as finding the best match between representations produced by data/label encoder, such heterogeneity in client class sets poses a new significant challenge -- local encoders at different clients may operate in different and even independent latent spaces, making it hard to aggregate at the server. We propose a novel framework, FedAlign, to align the latent spaces across clients from both label and data perspectives. From a label perspective, we leverage the expressive natural language class names as a common ground for label encoders to anchor class representations and guide the data encoder learning across clients. From a data perspective, during local training, we regard the global class representations as anchors and leverage the data points that are close/far enough to the anchors of locally-unaware classes to align the data encoders across clients. Our theoretical analysis of the generalization performance and extensive experiments on four real-world datasets of different tasks confirm that FedAlign outperforms various state-of-the-art (non-IID) federated classification methods., Comment: Accepted by KDD 2023

Pre-trained language models (PLMs) are fundamental for natural language processing applications. Most existing PLMs are not tailored to the noisy user-generated text on social media, and the pre-training does not factor in the valuable social engagement logs available in a social network. We present TwHIN-BERT, a multilingual language model productionized at Twitter, trained on in-domain data from the popular social network. TwHIN-BERT differs from prior pre-trained language models as it is trained with not only text-based self-supervision, but also with a social objective based on the rich social engagements within a Twitter heterogeneous information network (TwHIN). Our model is trained on 7 billion tweets covering over 100 distinct languages, providing a valuable representation to model short, noisy, user-generated text. We evaluate our model on various multilingual social recommendation and semantic understanding tasks and demonstrate significant metric improvement over established pre-trained language models. We open-source TwHIN-BERT and our curated hashtag prediction and social engagement benchmark datasets to the research community.

Automatic extraction of product attributes from their textual descriptions is essential for online shopper experience. One inherent challenge of this task is the emerging nature of e-commerce products -- we see new types of products with their unique set of new attributes constantly. Most prior works on this matter mine new values for a set of known attributes but cannot handle new attributes that arose from constantly changing data. In this work, we study the attribute mining problem in an open-world setting to extract novel attributes and their values. Instead of providing comprehensive training data, the user only needs to provide a few examples for a few known attribute types as weak supervision. We propose a principled framework that first generates attribute value candidates and then groups them into clusters of attributes. The candidate generation step probes a pre-trained language model to extract phrases from product titles. Then, an attribute-aware fine-tuning method optimizes a multitask objective and shapes the language model representation to be attribute-discriminative. Finally, we discover new attributes and values through the self-ensemble of our framework, which handles the open-world challenge. We run extensive experiments on a large distantly annotated development set and a gold standard human-annotated test set that we collected. Our model significantly outperforms strong baselines and can generalize to unseen attributes and product types., Comment: WWW 2022

Autonomous Driving (AD) systems rely on AI components to make safety and correct driving decisions. Unfortunately, today's AI algorithms are known to be generally vulnerable to adversarial attacks. However, for such AI component-level vulnerabilities to be semantically impactful at the system level, it needs to address non-trivial semantic gaps both (1) from the system-level attack input spaces to those at AI component level, and (2) from AI component-level attack impacts to those at the system level. In this paper, we define such research space as semantic AI security as opposed to generic AI security. Over the past 5 years, increasingly more research works are performed to tackle such semantic AI security challenges in AD context, which has started to show an exponential growth trend. In this paper, we perform the first systematization of knowledge of such growing semantic AD AI security research space. In total, we collect and analyze 53 such papers, and systematically taxonomize them based on research aspects critical for the security field. We summarize 6 most substantial scientific gaps observed based on quantitative comparisons both vertically among existing AD AI security works and horizontally with security works from closely-related domains. With these, we are able to provide insights and potential future directions not only at the design level, but also at the research goal, methodology, and community levels. To address the most critical scientific methodology-level gap, we take the initiative to develop an open-source, uniform, and extensible system-driven evaluation platform, named PASS, for the semantic AD AI security research community. We also use our implemented platform prototype to showcase the capabilities and benefits of such a platform using representative semantic AD AI attacks., Comment: Project website: https://sites.google.com/view/cav-sec/pass

Resistivity saturation is found on both superconducting and insulating sides of an "avoided" magnetic-field-tuned superconductor-to-insulator transition (H-SIT) in a two-dimensional In/InO$_x$ composite, where the anomalous metallic behaviors cut off conductivity or resistivity divergence in the zero-temperature limit. The granular morphology of the material implies a system of Josephson junctions (JJ) with a broad distribution of Josephson coupling E$_J$ and charging energy E$_C$ , with a H-SIT determined by the competition between E$_J$ and E$_C$ . By virtue of self-duality across the true H-SIT, we invoke macroscopic quantum tunneling effects to explain the temperature-independent resistance where the "failed superconductor" side is a consequence of phase fluctuations and the "failed insulator" side results from charge fluctuations. While true self-duality is lost in the avoided transition, its vestiges are argued to persist, owing to the incipient duality of the percolative nature of the dissipative path in the underlying random JJ system., Comment: 10 pages, 7 figures, including supplementary

Advanced Driver-Assistance Systems (ADAS) have been thriving and widely deployed in recent years. In general, these systems receive sensor data, compute driving decisions, and output control signals to the vehicles. To smooth out the uncertainties brought by sensor outputs, they usually leverage multi-sensor fusion (MSF) to fuse the sensor outputs and produce a more reliable understanding of the surroundings. However, MSF cannot completely eliminate the uncertainties since it lacks the knowledge about which sensor provides the most accurate data and how to optimally integrate the data provided by the sensors. As a result, critical consequences might happen unexpectedly. In this work, we observed that the popular MSF methods in an industry-grade ADAS can mislead the car control and result in serious safety hazards. We define the failures (e.g., car crashes) caused by the faulty MSF as fusion errors and develop a novel evolutionary-based domain-specific search framework, FusED, for the efficient detection of fusion errors. We further apply causality analysis to show that the found fusion errors are indeed caused by the MSF method. We evaluate our framework on two widely used MSF methods in two driving environments. Experimental results show that FusED identifies more than 150 fusion errors. Finally, we provide several suggestions to improve the MSF methods we study.

Text categorization is an essential task in Web content analysis. Considering the ever-evolving Web data and new emerging categories, instead of the laborious supervised setting, in this paper, we focus on the minimally-supervised setting that aims to categorize documents effectively, with a couple of seed documents annotated per category. We recognize that texts collected from the Web are often structure-rich, i.e., accompanied by various metadata. One can easily organize the corpus into a text-rich network, joining raw text documents with document attributes, high-quality phrases, label surface names as nodes, and their associations as edges. Such a network provides a holistic view of the corpus' heterogeneous data sources and enables a joint optimization for network-based analysis and deep textual model training. We therefore propose a novel framework for minimally supervised categorization by learning from the text-rich network. Specifically, we jointly train two modules with different inductive biases -- a text analysis module for text understanding and a network learning module for class-discriminative, scalable network learning. Each module generates pseudo training labels from the unlabeled document set, and both modules mutually enhance each other by co-training using pooled pseudo labels. We test our model on two real-world datasets. On the challenging e-commerce product categorization dataset with 683 categories, our experiments show that given only three seed documents per category, our framework can achieve an accuracy of about 92%, significantly outperforming all compared methods; our accuracy is only less than 2% away from the supervised BERT model trained on about 50K labeled documents., Comment: WWW'21

Providing explanations for deep neural networks (DNNs) is essential for their use in domains wherein the interpretability of decisions is a critical prerequisite. Despite the plethora of work on interpreting DNNs, most existing solutions offer interpretability in an ad hoc, one-shot, and static manner, without accounting for the perception, understanding, or response of end-users, resulting in their poor usability in practice. In this paper, we argue that DNN interpretability should be implemented as the interactions between users and models. We present i-Algebra, a first-of-its-kind interactive framework for interpreting DNNs. At its core is a library of atomic, composable operators, which explain model behaviors at varying input granularity, during different inference stages, and from distinct interpretation perspectives. Leveraging a declarative query language, users are enabled to build various analysis tools (e.g., "drill-down", "comparative", "what-if" analysis) via flexibly composing such operators. We prototype i-Algebra and conduct user studies in a set of representative analysis tasks, including inspecting adversarial inputs, resolving model inconsistency, and cleansing contaminated data, all demonstrating its promising usability., Comment: Accepted by the 35th AAAI Conference on Artificial Intelligence (AAAI '21)

Many experiments investigating magnetic field tuned superconductor-insulator transition (H-SIT), often exhibit low-temperature resistance saturation, which is interpreted as an anomalous metallic phase emerging from a "failed superconductor," thus challenging conventional theory. Here we study a random granular array of indium islands grown on a gateable layer of indium-oxide. By tuning the intergrain couplings, we reveal a wide range of magnetic fields where resistance saturation is observed, under conditions of careful electromagnetic filtering and within a wide range of linear response. Exposure to external broadband noise or microwave radiation is shown to strengthen the tendency of superconductivity, where at low field a global superconducting phase is restored. Increasing magnetic field unveils an "avoided H-SIT," that exhibits granularity-induced logarithmic divergence of the resistance/conductance above/below that transition, pointing to possible vestiges of the original emergent duality observed in a true H-SIT. We conclude that anomalous metallic phase is intimately associated with inherent inhomogeneities, exhibiting robust behavior at attainable temperatures for strongly granular two-dimensional systems., Comment: 14 pages, 12 figures; after minor revision and error corrections

Recent years have witnessed the emergence of a new paradigm of building natural language processing (NLP) systems: general-purpose, pre-trained language models (LMs) are composed with simple downstream models and fine-tuned for a variety of NLP tasks. This paradigm shift significantly simplifies the system development cycles. However, as many LMs are provided by untrusted third parties, their lack of standardization or regulation entails profound security implications, which are largely unexplored. To bridge this gap, this work studies the security threats posed by malicious LMs to NLP systems. Specifically, we present TROJAN-LM, a new class of trojaning attacks in which maliciously crafted LMs trigger host NLP systems to malfunction in a highly predictable manner. By empirically studying three state-of-the-art LMs (BERT, GPT-2, XLNet) in a range of security-critical NLP tasks (toxic comment detection, question answering, text completion) as well as user studies on crowdsourcing platforms, we demonstrate that TROJAN-LM possesses the following properties: (i) flexibility - the adversary is able to flexibly dene logical combinations (e.g., 'and', 'or', 'xor') of arbitrary words as triggers, (ii) efficacy - the host systems misbehave as desired by the adversary with high probability when trigger-embedded inputs are present, (iii) specificity - the trojan LMs function indistinguishably from their benign counterparts on clean inputs, and (iv) fluency - the trigger-embedded inputs appear as fluent natural language and highly relevant to their surrounding contexts. We provide analytical justification for the practicality of TROJAN-LM, and further discuss potential countermeasures and their challenges, which lead to several promising research directions., Comment: Additional experiments and text editing; To appear in 2021 6th IEEE European Symposium on Security and Privacy

Deep neural networks (DNNs) are inherently susceptible to adversarial attacks even under black-box settings, in which the adversary only has query access to the target models. In practice, while it may be possible to effectively detect such attacks (e.g., observing massive similar but non-identical queries), it is often challenging to exactly infer the adversary intent (e.g., the target class of the adversarial example the adversary attempts to craft) especially during early stages of the attacks, which is crucial for performing effective deterrence and remediation of the threats in many scenarios. In this paper, we present AdvMind, a new class of estimation models that infer the adversary intent of black-box adversarial attacks in a robust and prompt manner. Specifically, to achieve robust detection, AdvMind accounts for the adversary adaptiveness such that her attempt to conceal the target will significantly increase the attack cost (e.g., in terms of the number of queries); to achieve prompt detection, AdvMind proactively synthesizes plausible query results to solicit subsequent queries from the adversary that maximally expose her intent. Through extensive empirical evaluation on benchmark datasets and state-of-the-art black-box attacks, we demonstrate that on average AdvMind detects the adversary intent with over 75% accuracy after observing less than 3 query batches and meanwhile increases the cost of adaptive attacks by over 60%. We further discuss the possible synergy between AdvMind and other defense methods against black-box adversarial attacks, pointing to several promising research directions., Comment: Accepted as a full paper at KDD 2020

Magnetic-field tuned superconductor to insulator transition was observed in a novel hybrid system of granular superconducting indium, deposited on indium oxide thin film, which exhibits global superconductivity at low magnetic fields. We have used annealing to tune the coupling to lie just at the borderline where superconductivity in the underlying InOx is suppressed, which is also close to the metal-insulator transition of the InOx. The hybrid system exhibits a "giant" magnetoresistance above the H-SIT, with critical behavior that manifests the duality between Cooper pairs and vortices., Comment: 5 pages, 6 figures

Recent years have witnessed tremendous interest in understanding and predicting information spread on social media platforms such as Twitter, Facebook, etc. Existing diffusion prediction methods primarily exploit the sequential order of influenced users by projecting diffusion cascades onto their local social neighborhoods. However, this fails to capture global social structures that do not explicitly manifest in any of the cascades, resulting in poor performance for inactive users with limited historical activities. In this paper, we present a novel variational autoencoder framework (Inf-VAE) to jointly embed homophily and influence through proximity-preserving social and position-encoded temporal latent variables. To model social homophily, Inf-VAE utilizes powerful graph neural network architectures to learn social variables that selectively exploit the social connections of users. Given a sequence of seed user activations, Inf-VAE uses a novel expressive co-attentive fusion network that jointly attends over their social and temporal variables to predict the set of all influenced users. Our experimental results on multiple real-world social network datasets, including Digg, Weibo, and Stack-Exchanges demonstrate significant gains (22% MAP@10) for Inf-VAE over state-of-the-art diffusion prediction models; we achieve massive gains for users with sparse activities, and users who lack direct social neighbors in seed sets., Comment: International Conference on Web Search and Data Mining (WSDM 2020)

Despite their tremendous success in a range of domains, deep learning systems are inherently susceptible to two types of manipulations: adversarial inputs -- maliciously crafted samples that deceive target deep neural network (DNN) models, and poisoned models -- adversely forged DNNs that misbehave on pre-defined inputs. While prior work has intensively studied the two attack vectors in parallel, there is still a lack of understanding about their fundamental connections: what are the dynamic interactions between the two attack vectors? what are the implications of such interactions for optimizing existing attacks? what are the potential countermeasures against the enhanced attacks? Answering these key questions is crucial for assessing and mitigating the holistic vulnerabilities of DNNs deployed in realistic settings. Here we take a solid step towards this goal by conducting the first systematic study of the two attack vectors within a unified framework. Specifically, (i) we develop a new attack model that jointly optimizes adversarial inputs and poisoned models; (ii) with both analytical and empirical evidence, we reveal that there exist intriguing "mutual reinforcement" effects between the two attack vectors -- leveraging one vector significantly amplifies the effectiveness of the other; (iii) we demonstrate that such effects enable a large design spectrum for the adversary to enhance the existing attacks that exploit both vectors (e.g., backdoor attacks), such as maximizing the attack evasiveness with respect to various detection methods; (iv) finally, we discuss potential countermeasures against such optimized attacks and their technical challenges, pointing to several promising research directions., Comment: Accepted as a full paper at ACM CCS 2020