Search

Chirality or handedness manifests in all fields of science, ranging from cell biology, molecular interaction, and catalysis to different branches of physics. In condensed matter physics, chirality is intrinsic to enigmatic quantum phases, such as chiral charge density waves and chiral superconductivity. Here, the underlying chiral response is subtle and leads to broken symmetries in the ground state. Detection of subtle broken symmetries is the key to understand these quantum states but they are extremely challenging to expose leading to debate and controversy. Here, using second-order optical response, we uncover the broken symmetries of a chiral charge density wave in the Kagome lattice KV3Sb5, revealing the relevant broken symmetries of its charge order. KV3Sb5 undergoes a phase transition to a charge-ordered state at low temperatures. Our polarization-dependent mid-infrared photocurrent microscopy reveals an intrinsic, longitudinal helicity-dependent photocurrent associated with the charge order. Our measurements, supported by our theoretical analysis, provide direct evidence for broken inversion and mirror symmetries at the charge order transition, indicating a chiral charge ordered state. On the other hand, we do not observe a circular photogalvanic effect along the direction perpendicular to that of the incident light, imposing stringent constraints on the rotational and point group symmetries of the charge order. Our study not only visualizes the chiral nature of the Kagome charge order revealing its broken symmetries, but also highlights the nonlinear photogalvanic effect as a sensitive probe for detecting subtle symmetry breakings., Comment: in press

Recently, promising progress has been made by open-source vision-language models (VLMs) in bringing their capabilities closer to those of proprietary frontier models. However, most open-source models only publish their final model weights, leaving the critical details of data strategies and implementation largely opaque. In this work, we address VLM post-training from a data-centric perspective, showing the key role of data strategy in developing frontier VLMs. By studying and building our post-training data strategy from scratch, we share detailed insights into the development processes, aiming to benefit the development of competitive models for the open-source community. Our introduced data strategy, together with training recipes and model design, leads to a family of performant VLMs named Eagle2. Specifically, Eagle2-9B achieves state-of-the-art results across various multimodal benchmarks, matching certain competitive models with up to 70B parameters.

Quantum materials governed by emergent topological fermions have become a cornerstone of physics. Dirac fermions in graphene form the basis for moir\'e quantum matter, and Dirac fermions in magnetic topological insulators enabled the discovery of the quantum anomalous Hall effect. In contrast, there are few materials whose electromagnetic response is dominated by emergent Weyl fermions. Nearly all known Weyl materials are overwhelmingly metallic, and are largely governed by irrelevant, conventional electrons. Here we theoretically predict and experimentally observe a semimetallic Weyl ferromagnet in van der Waals (Cr,Bi)$_2$Te$_3$. In transport, we find a record bulk anomalous Hall angle $> 0.5$ along with non-metallic conductivity, a regime sharply distinct from conventional ferromagnets. Together with symmetry analysis, our data suggest a semimetallic Fermi surface composed of two Weyl points, with a giant separation $> 75\%$ of the linear dimension of the bulk Brillouin zone, and no other electronic states. Using state-of-the-art crystal synthesis techniques, we widely tune the electronic structure, allowing us to annihilate the Weyl state and visualize a unique topological phase diagram exhibiting broad Chern insulating, Weyl semimetallic and magnetic semiconducting regions. Our observation of a semimetallic Weyl ferromagnet offers an avenue toward novel correlated states and non-linear phenomena, as well as zero-magnetic-field Weyl spintronic and optical devices., Comment: Nature, in press

Implementing and tuning chirality is fundamental in physics, chemistry, and material science. Chiral charge density waves (CDWs), where chirality arises from correlated charge orders, are attracting intense interest due to their exotic transport and optical properties. However, a general framework for predicting chiral CDW materials is lacking, primarily because the underlying mechanisms remain elusive. Here, we address this challenge by developing the first comprehensive predictive framework, systematically identifying chiral CDW materials via first-principles calculations. The key lies in the previously overlooked phase difference of the CDW Q-vectors between layers, which is linked to opposite collective atomic displacements across different layers. This phase difference induces a spiral arrangement of the Q-vectors, ultimately giving rise to a chiral structure in real space. We validate our framework by applying it to the kagome lattice AV$_{3}$Sb$_{5}$ (A = K, Rb, Cs), successfully predicting emergent structural chirality. To demonstrate the generality of our approach, we extend it to predict chiral CDWs in the triangular-lattice NbSe$_{2}$. Beyond material predictions, our theory uncovers a universal and unprecedented Hall effect in chiral CDW materials, occurring without external magnetic fields or intrinsic magnetization. Our experiments on CsV$_{3}$Sb$_{5}$ confirm this prediction, observing a unique signature where the Hall conductivity's sign reverses when the input current is reversed, a phenomenon distinct from known Hall effects. Our findings elucidate the mechanisms behind chiral CDWs and open new avenues for discovering materials with unconventional quantum properties, with potential applications in next-generation electronic and spintronic devices.

Humor is a culturally nuanced aspect of human language that presents challenges for understanding and generation, requiring participants to possess good creativity and strong associative thinking. Similar to reasoning tasks like solving math problems, humor generation requires continuous reflection and revision to foster creative thinking, rather than relying on a sudden flash of inspiration like Creative Leap-of-Thought (CLoT) paradigm. Although CLoT can realize the ability of remote association generation, this paradigm fails to generate humor content. Therefore, in this paper, we propose a systematic way of thinking about generating humor and based on it, we built Creative Leap of Structured Thought (CLoST) frame. First, a reward model is necessary achieve the purpose of being able to correct errors, since there is currently no expert model of humor and a usable rule to determine whether a piece of content is humorous. Judgement-oriented instructions are designed to improve the capability of a model, and we also propose an open-domain instruction evolutionary method to fully unleash the potential. Then, through reinforcement learning, the model learns to hone its rationales of the thought chain and refine the strategies it uses. Thus, it learns to recognize and correct its mistakes, and finally generate the most humorous and creative answer. These findings deepen our understanding of the creative capabilities of LLMs and provide ways to enhance LLMs' creative abilities for cross-domain innovative applications.

Utilizing tools with Large Language Models (LLMs) is essential for grounding AI agents in real-world applications. The prevailing approach involves few-shot prompting with demonstrations or fine-tuning with expert annotations. However, mere in-context demonstrations may fail to cover sufficient knowledge for complex tools and tasks. Training on solution paths is also hindered by the high cost of expert annotations and generalizing to new tools. A core challenge of generalizable tool use lies in understanding the "meta", or fundamental natures of tools that are transferable across tasks, such as causality and constraints. In this paper, we present MetaTool, a novel tool learning methodology designed to generalize across any reusable toolset. Our approach incorporates a self-supervised augmentation technique derived from a series of meta-tasks. This involves predicting masked elements in the tool execution process. The self-supervised procedure enables scalable generation of high-quality QA data, which is handy for supervising tool understanding. By incorporating meta-task data into task-oriented training, our method significantly enhances the performance of open-source LLMs, achieving results comparable to ChatGPT in both tool-based planning and chatting scenarios. Through large-scale instruction tuning, the MetaTool model demonstrates impressive zero-shot generalizability on new tasks., Comment: 9 pages, 4 figures

Vision-language pre-training has significantly elevated performance across a wide range of image-language applications. Yet, the pre-training process for video-related tasks demands exceptionally large computational and data resources, which hinders the progress of video-language models. This paper investigates a straight-forward, highly efficient, and resource-light approach to adapting an existing image-language pre-trained model for dense video understanding. Our preliminary experiments reveal that directly fine-tuning pre-trained image-language models with multiple frames as inputs on video datasets leads to performance saturation or even a drop. Our further investigation reveals that it is largely attributed to the bias of learned high-norm visual features. Motivated by this finding, we propose a simple but effective pooling strategy to smooth the feature distribution along the temporal dimension and thus reduce the dominant impacts from the extreme features. The new model is termed Pooling LLaVA, or PLLaVA in short. PLLaVA achieves new state-of-the-art performance on modern benchmark datasets for both video question-answer and captioning tasks. Notably, on the recent popular VideoChatGPT benchmark, PLLaVA achieves a score of 3.48 out of 5 on average of five evaluated dimensions, exceeding the previous SOTA results from GPT4V (IG-VLM) by 9%. On the latest multi-choice benchmark MVBench, PLLaVA achieves 58.1% accuracy on average across 20 sub-tasks, 14.5% higher than GPT4V (IG-VLM). Code is available at https://pllava.github.io/

In this technical report, we target generating anthropomorphized personas for LLM-based characters in an online manner, including visual appearance, personality and tones, with only text descriptions. To achieve this, we first leverage the in-context learning capability of LLMs for personality generation by carefully designing a set of system prompts. We then propose two novel concepts: the mixture of voices (MoV) and the mixture of diffusers (MoD) for diverse voice and appearance generation. For MoV, we utilize the text-to-speech (TTS) algorithms with a variety of pre-defined tones and select the most matching one based on the user-provided text description automatically. For MoD, we combine the recent popular text-to-image generation techniques and talking head algorithms to streamline the process of generating talking objects. We termed the whole framework as ChatAnything. With it, users could be able to animate anything with any personas that are anthropomorphic using just a few text inputs. However, we have observed that the anthropomorphic objects produced by current generative models are often undetectable by pre-trained face landmark detectors, leading to failure of the face motion generation, even if these faces possess human-like appearances because those images are nearly seen during the training (e.g., OOD samples). To address this issue, we incorporate pixel-level guidance to infuse human face landmarks during the image generation phase. To benchmark these metrics, we have built an evaluation dataset. Based on it, we verify that the detection rate of the face landmark is significantly increased from 57.0% to 92.5% thus allowing automatic face animation based on generated speech content. The code and more results can be found at https://chatanything.github.io/.

Multi-choice Machine Reading Comprehension (MRC) is a major and challenging task for machines to answer questions according to provided options. Answers in multi-choice MRC cannot be directly extracted in the given passages, and essentially require machines capable of reasoning from accurate extracted evidence. However, the critical evidence may be as simple as just one word or phrase, while it is hidden in the given redundant, noisy passage with multiple linguistic hierarchies from phrase, fragment, sentence until the entire passage. We thus propose a novel general-purpose model enhancement which integrates multi-grained evidence comprehensively, named Multi-grained evidence inferencer (Mugen), to make up for the inability. Mugen extracts three different granularities of evidence: coarse-, middle- and fine-grained evidence, and integrates evidence with the original passages, achieving significant and consistent performance improvement on four multi-choice MRC benchmarks., Comment: Accepted by TASLP 2023, vol. 31, pp. 3896-3907

A topological insulator is a quantum material which possesses conducting surfaces and an insulating bulk. Despite extensive researches on the properties of Dirac surface states, the characteristics of bulk states have remained largely unexplored. Here we report the observation of spinor-dominated magnetoresistance anomalies in the topological insulator $\beta $-Ag$_2$Se, induced by a magnetic-field-driven band topological phase transition. These anomalies are caused by intrinsic orthogonality in the wave-function spinors of the last Landau bands of the bulk states, in which backscattering is strictly forbidden during a band topological phase transition. This new type of longitudinal magnetoresistance, purely controlled by the wave-function spinors of the last Landau bands, highlights a unique signature of electrical transport around the band topological phase transition. With further reducing the quantum limit and gap size in $\beta $-Ag$_2$Se, our results may also suggest possible device applications based on this spinor-dominated mechanism and signify a rare case where topology enters the realm of magnetoresistance control., Comment: 16 pages, 4 figures; Version of original submission

Nonlinear optical responses of quantum materials have recently undergone dramatic developments to unveil nontrivial geometry and topology. A remarkable example is the quantized longitudinal circular photogalvanic effect (CPGE) associated with the Chern number of Weyl fermions, while the physics of transverse CPGE in Weyl semimetals remains exclusive. Here, we show that the transverse CPGE of Lorentz invariant Weyl fermions is forced to be zero. We find that the transverse photocurrents of Weyl fermions are associated not only with the Chern numbers but also with the degree of Lorentz-symmetry breaking in condensed matter systems. Based on the generic two-band model analysis, we provide a new powerful equation to calculate the transverse CPGE based on the tilting and warping terms of Weyl fermions. Our results are more capable in designing large transverse CPGE of Weyl semimetals in experiments and are applied to more than tens of Weyl materials to estimate their photocurrents. Our method paves the way to study the CPGE of massless or massive quasiparticles to design next-generation quantum optoelectronics.