Search

Magnetic kagome materials provide a fascinating playground for exploring the interplay of magnetism, correlation and topology. Many magnetic kagome systems have been reported including the binary FemXn (X=Sn, Ge; m:n = 3:1, 3:2, 1:1) family and the rare earth RMn6Sn6 (R = rare earth) family, where their kagome flat bands are calculated to be near the Fermi level in the paramagnetic phase. While partially filling a kagome flat band is predicted to give rise to a Stoner-type ferromagnetism, experimental visualization of the magnetic splitting across the ordering temperature has not been reported for any of these systems due to the high ordering temperatures, hence leaving the nature of magnetism in kagome magnets an open question. Here, we probe the electronic structure with angle-resolved photoemission spectroscopy in a kagome magnet thin film FeSn synthesized using molecular beam epitaxy. We identify the exchange-split kagome flat bands, whose splitting persists above the magnetic ordering temperature, indicative of a local moment picture. Such local moments in the presence of the topological flat band are consistent with the compact molecular orbitals predicted in theory. We further observe a large spin-orbital selective band renormalization in the Fe d_xy+d_(x^2-y^2 ) spin majority channel reminiscent of the orbital selective correlation effects in the iron-based superconductors. Our discovery of the coexistence of local moments with topological flat bands in a kagome system echoes similar findings in magic-angle twisted bilayer graphene, and provides a basis for theoretical effort towards modeling correlation effects in magnetic flat band systems.

Large language models (LLMs) exhibit varying strengths and weaknesses across different tasks, prompting recent studies to explore the benefits of ensembling models to leverage their complementary advantages. However, existing LLM ensembling methods often overlook model compatibility and struggle with inefficient alignment of probabilities across the entire vocabulary. In this study, we empirically investigate the factors influencing ensemble performance, identifying model performance, vocabulary size, and response style as key determinants, revealing that compatibility among models is essential for effective ensembling. This analysis leads to the development of a simple yet effective model selection strategy that identifies compatible models. Additionally, we introduce the \textsc{Uni}on \textsc{T}op-$k$ \textsc{E}nsembling (\textsc{UniTE}), a novel approach that efficiently combines models by focusing on the union of the top-k tokens from each model, thereby avoiding the need for full vocabulary alignment and reducing computational overhead. Extensive evaluations across multiple benchmarks demonstrate that \textsc{UniTE} significantly enhances performance compared to existing methods, offering a more efficient framework for LLM ensembling.

Deductive coding is a common discourse analysis method widely used by learning science and learning analytics researchers for understanding teaching and learning interactions. It often requires researchers to manually label all discourses to be analyzed according to a theoretically guided coding scheme, which is time-consuming and labor-intensive. The emergence of large language models such as GPT has opened a new avenue for automatic deductive coding to overcome the limitations of traditional deductive coding. To evaluate the usefulness of large language models in automatic deductive coding, we employed three different classification methods driven by different artificial intelligence technologies, including the traditional text classification method with text feature engineering, BERT-like pretrained language model and GPT-like pretrained large language model (LLM). We applied these methods to two different datasets and explored the potential of GPT and prompt engineering in automatic deductive coding. By analyzing and comparing the accuracy and Kappa values of these three classification methods, we found that GPT with prompt engineering outperformed the other two methods on both datasets with limited number of training samples. By providing detailed prompt structures, the reported work demonstrated how large language models can be used in the implementation of automatic deductive coding., Comment: 20 pages

Base on a conjecture, we prove that for any smooth separated stack of finite type over a number field, its descent obstruction equals its iterated descent obstruction. As a consequence, we show that for any algebraic stack over a number field that has a finite etale covering of a smooth geometrically integral variety, its descent obstruction equals its iterated descent obstruction.

Topological insulators are materials with an insulating bulk interior while maintaining gapless boundary states against back scattering. Bi$_2$Se$_3$ is a prototypical topological insulator with a Dirac-cone surface state around $\Gamma$. Here, we present a controlled methodology to gradually remove Se atoms from the surface Se-Bi-Se-Bi-Se quintuple layers, eventually forming bilayer-Bi on top of the quintuple bulk. Our method allows us to track the topological surface state and confirm its robustness throughout the surface modification. Importantly, we report a relocation of the topological Dirac cone in both real space and momentum space, as the top surface layer transitions from quintuple Se-Bi-Se-Bi-Se to bilayer-Bi. Additionally, charge transfer among different surface layers is identified. Our study provides a precise method to manipulate surface configurations, allowing for the fine-tuning of the topological surface states in Bi$_2$Se$_3$, which represents a significant advancement towards nano-engineering of topological states., Comment: 21 pages, 5 figures, accepted for publication in Nano Letters

The deployment of multimodal large language models (MLLMs) has demonstrated remarkable success in engaging in conversations involving visual inputs, thanks to the superior power of large language models (LLMs). Those MLLMs are typically built based on the LLMs, with an image encoder to process images into the token embedding space of the LLMs. However, the integration of visual modality has introduced a unique vulnerability: the MLLM becomes susceptible to malicious visual inputs and prone to generating sensitive or harmful responses, even though the LLM has been trained on textual dataset to align with human value. In this paper, we first raise the question: ``Do the MLLMs possess safety-awareness against malicious image inputs?". We find that after adding a principle that specifies the safety requirement into the input of the MLLM, the model's safety awareness becomes boosted. This phenomenon verifies the existence of MLLM's safety-awareness against image inputs, it is only weakened by the modality gap. We then introduce a simple yet effective technique termed CoCA, which amplifies the safety-awareness of the MLLM by calibrating its output distribution. Our proposed strategy helps the model reclaim its original safety awareness without losing its original capabilities. We verify the effectiveness of our approach on both multimodal safety and understanding benchmarks., Comment: 10 pages, COLM-2024

High-power broadband tunable long-wavelength infrared (LWIR) femtosecond lasers operating at fingerprint wavelengths of 7-14 {\mu}m hold significant promise across a range of applications, including molecular hyperspectral imaging, strong-field light-matter interaction, and resonant tissue ablation. Here we present 6-12 {\mu}m broadband tunable parametric amplifier based on LiGaS2 or BaGa4S7, generating new record output power of 2.4 W at 7.5 {\mu}m, and 1.5 W at 9.5 {\mu}m, pumped by a simple and effective thin-square-rod Yb:YAG amplifier producing 110 W 274 fs output pulses. As a proof of concept, we showcase efficient resonant ablation and microstructure fabrication on enamel at the hydroxyapatite resonant wavelength of 9.5 {\mu}m, with a laser intensity two orders-of-magnitude lower than that required by non-resonant femtosecond lasers, which could foster more precision surgical applications with superior biosafety.

Motivated by the discovery of high-temperature superconductivity in bilayer nickelate La$_3$Ni$_2$O$_7$ under pressure, we investigate the ground-state phase diagram and correlation effects using determinant quantum Monte Carlo simulations in a simplified bilayer two-orbital Hubbard model at half filling. Our results reveal the emergence of a nonmagnetic weakly insulating phase at weak on-site Hubbard interactions, transitioning to an antiferromagnetic Mott insulating phase as the interaction strength exceeds a critical value $U/t_1^x\approx 4.15$. This phase transition is consistent with the 3D O(3) Heisenberg universality class. Additionally, we analyze dynamical properties such as the single-particle spectral function and dynamic spin structure factor. The pronounced inter-layer correlation of $d_{3z^2-r^2}$ orbitals results in a downward trend and an extended flatness in the $\gamma$ band, mirroring the angle-resolved photoemission spectroscopy findings under ambient pressure. Our numerical results provide important clues for understanding the strong correlation effects in La$_3$Ni$_2$O$_7$., Comment: 9 pages, 11 figures

The roton-triggered charge-density-wave (CDW)is widely studied in fractional quantum Hall (FQH) and fractional Chern insulator (FCI) systems, and there also exist field theoretical and numerical realizations of continuous transition from FCI to superfluid (SF). However, the theory and numerical explorations of the transition between FCI and supersolid (SS) are still lacking. In this work, we study the topological flat-band lattice models with $\nu$ = 1/2 hard-core bosons, where the previous studies have discovered the existence of FCI states and possible direct FCI-SS transitions. While the FCI is robust, we find the direct FCI-SS transition is absent, and there exist more intriguing scenarios. In the case of checkerboard lattice, we find an intermediate gapless CDW state without SF, sandwiched between FCI and SS. This novel state is triggered by the roton instability in FCI and it further continuously brings about the intertwined finite-momentum SF fluctuation when the CDW order is strong enough, eventually transiting into an unconventional finite-momentum SS state. The intermediate gapless CDW state is a vestige from the SS state, since the increasing quantum fluctuation melts only the Larkin-Ovchinnikov-type SF order in SS but its (secondary) product -- the CDW order -- survives. On honeycomb lattice, we find no evidence of SS, but discover an interesting sequence of FCI-Solid I-Solid II transitions, with both solids incompressible. Moreover, in contrast to previous single-roton condensation, this sequence of FCI-Solid I-Solid II transitions is triggered by the softening of multi-roton modes in FCI. Considering the intertwined wave vectors of the CDW orders, Solid I is a vestige of Solid II. Our work provides new horizon not only for the quantum phase transitions in FCI but also for the intertwined orders and gapless states in bosonic systems, which will inspire future studies.

In data-driven applications, preserving user privacy while enabling valuable computations remains a critical challenge. Technologies like Differential Privacy (DP) have been pivotal in addressing these concerns. The shuffle model of DP requires no trusted curators and can achieve high utility by leveraging the privacy amplification effect yielded from shuffling. These benefits have led to significant interest in the shuffle model. However, the computation tasks in the shuffle model are limited to statistical estimation, making the shuffle model inapplicable to real-world scenarios in which each user requires a personalized output. This paper introduces a novel paradigm termed Private Individual Computation (PIC), expanding the shuffle model to support a broader range of permutation-equivariant computations. PIC enables personalized outputs while preserving privacy, and enjoys privacy amplification through shuffling. We propose a concrete protocol that realizes PIC. By using one-time public keys, our protocol enables users to receive their outputs without compromising anonymity, which is essential for privacy amplification. Additionally, we present an optimal randomizer, the Minkowski Response, designed for the PIC model to enhance utility. We formally prove the security and privacy properties of the PIC protocol. Theoretical analysis and empirical evaluations demonstrate PIC's capability in handling non-statistical computation tasks, and the efficacy of PIC and the Minkowski randomizer in achieving superior utility compared to existing solutions.

Machine Translation (MT) has developed rapidly since the release of Large Language Models and current MT evaluation is performed through comparison with reference human translations or by predicting quality scores from human-labeled data. However, these mainstream evaluation methods mainly focus on fluency and factual reliability, whilst paying little attention to figurative quality. In this paper, we investigate the figurative quality of MT and propose a set of human evaluation metrics focused on the translation of figurative language. We additionally present a multilingual parallel metaphor corpus generated by post-editing. Our evaluation protocol is designed to estimate four aspects of MT: Metaphorical Equivalence, Emotion, Authenticity, and Quality. In doing so, we observe that translations of figurative expressions display different traits from literal ones.

Automated cephalometric landmark detection is crucial in real-world orthodontic diagnosis. Current studies mainly focus on only adult subjects, neglecting the clinically crucial scenario presented by adolescents whose landmarks often exhibit significantly different appearances compared to adults. Hence, an open question arises about how to develop a unified and effective detection algorithm across various age groups, including adolescents and adults. In this paper, we propose CeLDA, the first work for Cephalometric Landmark Detection across Ages. Our method leverages a prototypical network for landmark detection by comparing image features with landmark prototypes. To tackle the appearance discrepancy of landmarks between age groups, we design new strategies for CeLDA to improve prototype alignment and obtain a holistic estimation of landmark prototypes from a large set of training images. Moreover, a novel prototype relation mining paradigm is introduced to exploit the anatomical relations between the landmark prototypes. Extensive experiments validate the superiority of CeLDA in detecting cephalometric landmarks on both adult and adolescent subjects. To our knowledge, this is the first effort toward developing a unified solution and dataset for cephalometric landmark detection across age groups. Our code and dataset will be made public on https://github.com/ShanghaiTech-IMPACT/Cephalometric-Landmark-Detection-across-Ages-with-Prototypical-Network, Comment: MICCAI 2024

In the quest for novel quantum states driven by topology and correlation, kagome lattice materials have garnered significant interest due to their distinctive electronic band structures, featuring flat bands (FBs) arising from the quantum destructive interference of the electronic wave function. The tuning of the FBs to the chemical potential would lead to the possibility of liberating electronic instabilities that lead to emergent electronic orders. Despite extensive studies, direct evidence of FBs tuned to the chemical potential and their participation in emergent electronic orders have been lacking in bulk quantum materials. Here using a combination of Angle-Resolved Photoemission Spectroscopy (ARPES) and Density Functional Theory (DFT), we reveal that the low-energy electronic structure of the recently discovered Cr-based kagome metal superconductor CsCr3Sb5 is dominated by a pervasive FB in close proximity to, and below the Fermi level. A comparative analysis with orbital-projected DFT and polarization dependence measurement uncovers that an orbital-selective renormalization mechanism is needed to reconcile the discrepancy with the DFT calculations, which predict the FB to appear 200 meV above the Fermi level. Furthermore, we observe the FB to shift away from the Fermi level by 20 meV in the low-temperature density wave-ordered phase, highlighting the role of the FB in the emergent electronic order. Our results reveal CsCr3Sb5 to stand out as a promising platform for further exploration into the effects of FBs near the Fermi level on kagome lattices, and their role in emergent orders in bulk quantum materials.

Cross-modal transformers have demonstrated superiority in various vision tasks by effectively integrating different modalities. This paper first critiques prior token exchange methods which replace less informative tokens with inter-modal features, and demonstrate exchange based methods underperform cross-attention mechanisms, while the computational demand of the latter inevitably restricts its use with longer sequences. To surmount the computational challenges, we propose GeminiFusion, a pixel-wise fusion approach that capitalizes on aligned cross-modal representations. GeminiFusion elegantly combines intra-modal and inter-modal attentions, dynamically integrating complementary information across modalities. We employ a layer-adaptive noise to adaptively control their interplay on a per-layer basis, thereby achieving a harmonized fusion process. Notably, GeminiFusion maintains linear complexity with respect to the number of input tokens, ensuring this multimodal framework operates with efficiency comparable to unimodal networks. Comprehensive evaluations across multimodal image-to-image translation, 3D object detection and arbitrary-modal semantic segmentation tasks, including RGB, depth, LiDAR, event data, etc. demonstrate the superior performance of our GeminiFusion against leading-edge techniques. The PyTorch code is available at https://github.com/JiaDingCN/GeminiFusion, Comment: Accepted by ICML 2024, code and models are available at https://github.com/JiaDingCN/GeminiFusion

If millicharged particles (MCPs) exist they can be created in the atmosphere when high energy cosmic rays collide with nuclei and could subsequently be detected at neutrino experiments. We extend previous work, which considered MCPs from decays of light mesons and proton bremsstrahlung, by including production from $\Upsilon$ meson decays and the Drell-Yan process. MCPs with masses below a GeV primarily arise from proton bremsstrahlung, while heavier MCPs predominantly originate from heavy meson decays and Drell-Yan. We analyse the resulting single scatter and multiple scatter signals at SuperK and JUNO. Searches for low energy coincident signals at JUNO will be sensitive to MCPs with milli-charges up to an order of magnitude beyond current constraints for MCP masses between 2 GeV and 10 GeV., Comment: 13 pages, 8 figures

The properties of fractional Chern insulator (FCI) phases and the phase transitions between FCI and Mott insulators (MI) in bosonic systems are well studied. The continuous transitions between FCI and superfluid (SF), however, despite the inspiring field theoretical predictions, have not been directly verified. The existing numerical results of the FCI-SF transition are either indirect or clearly first-order. Here, by simply tuning the bandwidth of the Haldane honeycomb lattice model, we find direct transitions from a bosonic FCI at $\nu=1/2$ filling of a flat Chern band to two SF states with bosons condensed at momenta M or $\Gamma$, respectively. While the FCI-SF(M) transition is first-order, the FCI-SF($\Gamma$) transition is found continuous, and the bipartite entanglement entropy at the critical point with the area-law scaling is consistent with the critical theories. Through finite size criticality analysis, the obtained critical exponents $\beta\approx$ 0.35(5) and $\nu\approx$ 0.62(12) are both compatible with those of the 3D XY universality class within numerical uncertainty and possibly more exotic beyond-Landau ones. This letter thence presents a direct numerical demonstration of a continuous FCI-SF transition between topologically ordered phase and spontaneous continuous symmetry-breaking phase, and further indicates the zero-field bosonic FCI might be realized from a SF state by gradually flattening the dispersion of the Chern band, through the (quasi)adiabatic preparation in ultracold atom systems.

The recent developments in twisted MoTe$_2$ and rhombohedral multilayer graphene have generated widespread attention to the general features of fractional quantum anomalous Hall (FQAH) states, including their possible coexistence with and transition to various symmetry breaking charge ordered states. These attentions are pushing forward our knowledge of the relation between the topological order in FQAH states and the Landau-type of symmetry breaking order such as the 1D smectic electronic liquid crystal and 2D charge-density-wave (CDW) solid. Although the transitions from topological states to symmetry breaking states with trivial topology have been discussed, the road from one topological ordered state to another with the same Hall conductance and broken translational symmetry has not been found. Here we show the intriguing evidence that the FQAH to FQAH Smectic (FQAHS) transition is robustly realizable in the archetypal correlated flat Chern-band model at filling $\nu$ = 2/3. This transition is novel in that: i) the FQAHS acquires the same fractional Hall conductance as FQAH, which cannot be explained by mean-field band folding. The formation of smectic order can be viewed as perturbation around the transition point, and thus, do not destroy or change the original topology; ii) the charge excitation remains gapped across the transition although the neutral gap is closed at transition point; and iii) the transition is triggered by the softening of roton mode with the same wave vector as the smectic order. Our discovery opens countless new possibilities, both theoretical and experimental, in the fast-growing field of robust fractional Chern insulators.

Large language models (LLMs) have demonstrated outstanding performance across various tasks, yet they still exhibit limitations such as hallucination, unfaithful reasoning, and toxic content. One potential approach to mitigate these issues is learning from human or external feedback (e.g. tools). In this paper, we introduce an intrinsic self-correct reasoning framework for LLMs that eliminates the need for human feedback, external tools, and handcraft prompts. The proposed framework, based on a multi-step reasoning paradigm \textbf{Le}arning from \textbf{Co}rrectness (\textsc{LeCo}), improves reasoning performance without needing to learn from errors. This paradigm prioritizes learning from correct reasoning steps, and a unique method to measure confidence for each reasoning step based on generation logits. Experimental results across various multi-step reasoning tasks demonstrate the effectiveness of the framework in improving reasoning performance with reduced token consumption., Comment: Accepted to COLM 2024

Hafnia-based ferroelectrics have become a valuable class of electronic functional materials at the nanoscale, showing great potential for next-generation memory and logic devices. However, more robust ferroelectric properties and better understanding of the polarization mechanisms are currently needed both in technology and science. Herein, we report the properties of oxygen-deficient Hf0.5Zr0.5O2 films with ultralarge remanent polarization (Pr) of 387 uC cm-2 at room temperature (1 kHz). Structure characterizations identify a new ferroelectric monoclinic Pc phase in these Hf0.5Zr0.5O2 films. The in-situ STEM measurements evidence polar displacements of the oxygen atoms, which move up and down in the Pc structure under applied DC bias fields, showing a huge displacement (1.6 A). DFT calculations optimized the Pc structure and also predicted a large polarization. The coexistence of the ferroelectric monoclinic (Pc) phases and orthorhombic (Pca21) is responsible for this superior ferroelectric properties. These findings are promising for hafnia-based ferroelectric applications in integrated ferroelectric devices, energy harvesting and actuators, etc.

Birefringence phase-matching based \c{hi}(2) ZnGeP2 (ZGP) waveguide platform has been recently reported for excellent mid-infrared laser generation. Here, a detailed theoretical characterization of mode transmission taking waveguide anisotropy and substrate material absorption into account in a micrometer ZGP waveguide platform (ZGP-on-SiO2) is conducted. Benefited from high-index contrast between ZGP and substrate (SiO2/Air), Transverse electric and magnetic (TM and TE) mode transmission loss at interested wavelengths range of 2 - 12 {\mu}m is calculated to be less than 4 dB/cm and 1.5 dB/cm, respectively, in the designed ZGP waveguide. Notably, non-obvious oscillation of mode transmission loss versus phase-matching angles is observed, which is different from that in the previously reported weakly guided anisotropic waveguide. A vital phenomenon named mode crossing at some wavelengths in TM polarization is also exhibited in our waveguide platforms, which jeopardizes waveguide performances and could be avoided by changing the phase-matching angle in practice. This work provides a significant indication of ZGP waveguide design optimization in future and also exhibits extendibility to other birefringent crystal waveguide platforms.

Single-frame infrared small target (SIRST) detection aims to recognize small targets from clutter backgrounds. Recently, convolutional neural networks have achieved significant advantages in general object detection. With the development of Transformer, the scale of SIRST models is constantly increasing. Due to the limited training samples, performance has not been improved accordingly. The quality, quantity, and diversity of the infrared dataset are critical to the detection of small targets. To highlight this issue, we propose a negative sample augmentation method in this paper. Specifically, a negative augmentation approach is proposed to generate massive negatives for self-supervised learning. Firstly, we perform a sequential noise modeling technology to generate realistic infrared data. Secondly, we fuse the extracted noise with the original data to facilitate diversity and fidelity in the generated data. Lastly, we proposed a negative augmentation strategy to enrich diversity as well as maintain semantic invariance. The proposed algorithm produces a synthetic SIRST-5K dataset, which contains massive pseudo-data and corresponding labels. With a rich diversity of infrared small target data, our algorithm significantly improves the model performance and convergence speed. Compared with other state-of-the-art (SOTA) methods, our method achieves outstanding performance in terms of probability of detection (Pd), false-alarm rate (Fa), and intersection over union (IoU)., Comment: We address the quality, quantity, and diversity of the infrared data in SIRST, the dataset is available at: https://github.com/luy0222/SIRST-5K

The interplay of topological order and charge order exhibits rich physics. Recent experiments that succesfully realized the frational quantum anomalous Hall (FQAH) effect in twisted MoTe$_2$ bilayers and rhombohedral multilayer graphene without external magnetic field further call for deeper understanding of the relation between topological order and charge order in quantum moir\'e materials. In the archetypal correlated flat-band model on checkerboard lattice, a FQAH smectic state with coexistent topological order and smectic charge order has been numerically discovered at filling $\nu$ = 2/3. In this work, we explore the global ground-state phase diagram of the model with competing interactions and find a C = 2/3 FQAH phase surrounded by four different charge density wave (CDW) phases. In particular, we identify a FQAH-CDW transition triggered by roton condensation, in that, the minimal roton gap continues to decrease at the same finite momentum, along with the diverging density flucuations at the transition point, after which the system enters into a CDW metal phase with the same ordered wavevector. Our discovery points out that the charge-neutral roton modes can play a significant role in a transition from FQAH topological order to CDW symmetry-breaking order, discussed in FQH literature while severely neglected in FQAH systems.

In real-world environments, outdoor imaging systems are often affected by disturbances such as rain degradation. Especially, in nighttime driving scenes, insufficient and uneven lighting shrouds the scenes in darkness, resulting degradation of both the image quality and visibility. Particularly, in the field of autonomous driving, the visual perception ability of RGB sensors experiences a sharp decline in such harsh scenarios. Additionally, driving assistance systems suffer from reduced capabilities in capturing and discerning the surrounding environment, posing a threat to driving safety. Single-view information captured by single-modal sensors cannot comprehensively depict the entire scene. To address these challenges, we developed an image de-raining framework tailored for rainy nighttime driving scenes. It aims to remove rain artifacts, enrich scene representation, and restore useful information. Specifically, we introduce cooperative learning between visible and infrared images captured by different sensors. By cross-view fusion of these multi-source data, the scene within the images gains richer texture details and enhanced contrast. We constructed an information cleaning module called CleanNet as the first stage of our framework. Moreover, we designed an information fusion module called FusionNet as the second stage to fuse the clean visible images with infrared images. Using this stage-by-stage learning strategy, we obtain de-rained fusion images with higher quality and better visual perception. Extensive experiments demonstrate the effectiveness of our proposed Cross-View Cooperative Learning (CVCL) in adverse driving scenarios in low-light rainy environments. The proposed approach addresses the gap in the utilization of existing rain removal algorithms in specific low-light conditions.

Training general-purpose vision models on purely sequential visual data, eschewing linguistic inputs, has heralded a new frontier in visual understanding. These models are intended to not only comprehend but also seamlessly transit to out-of-domain tasks. However, current endeavors are hamstrung by an over-reliance on colossal models, exemplified by models with upwards of 3B parameters, and the necessity for an extensive corpus of visual data, often comprising a staggering 400B tokens. In this paper, we delve into the development of an efficient, autoregression-based vision model, innovatively architected to operate on a limited dataset. We meticulously demonstrate how this model achieves proficiency in a spectrum of visual tasks spanning both high-level and low-level semantic understanding during the testing phase. Our empirical evaluations underscore the model's agility in adapting to various tasks, heralding a significant reduction in the parameter footprint, and a marked decrease in training data requirements, thereby paving the way for more sustainable and accessible advancements in the field of generalist vision models. The code is available at https://github.com/ggjy/DeLVM., Comment: 15 pages

Motivated by recent advancements in theoretical and experimental studies on the high-energy excitations, we theoretically explore the quantum phase transition and composite dynamics of the antiferromagnetic trimer chains in a magnetic field using the exact diagonalization, density matrix renormalization group, time-dependent variational principle and cluster perturbation theory. We measure the entanglement entropy to uncover the phase diagram, encompassing the XY-I, $1/3$ magnetization plateau, XY-II and ferromagnetic phases. Both critical XY-I and XY-II phases are both described by the conformal field theory with the central charge $c \simeq 1$. By analyzing the dynamical structure factor, we elucidate the distinct features of spin dynamics across different phases. In the regime of weak intertrimer interaction, we identify the intermediate-energy and high-energy modes in the XY-I and $1/3$ magnetization plateau phases as the internal trimer excitations, corresponding to the propagation of doublon and quarton, respectively. Notably, the application of a magnetic field splits the high-energy spectra into two branches labeled as the upper quarton and lower quarton. Furthermore, we also explore the spin dynamics of a trimerized model closely related to the quantum magnet \ce{Na_2Cu_3Ge_4O_12}, and discuss the possibility of the quarton Bose-Einstein condensation. Our results can be verified in the inelastic neutron scattering experiments and provide deep insights for exploring the high-energy exotic excitations., Comment: 14+7 pages, 16 figures

We study the spin-$1/2$ Heisenberg model on the square lattice with the first and second nearest-neighbor antiferromagnetic couplings $J_1$, $J_2$, as well as the three-spin scalar chiral coupling $J_{\chi}$. Using density matrix renormalization group calculations, we obtain a quantum phase diagram of this system for $0 \leq J_2/J_1 \leq 1.0$ and $0 \leq J_{\chi}/J_1 \leq 1.5$. We identify the N\'eel and stripe magnetic order phase at small $J_{\chi}$ coupling. With growing $J_{\chi}$, we identify the emergent chiral spin liquid (CSL) phase characterized by the quantized spin Chern number $C = 1/2$ and entanglement spectrum with the quasidegenerate group of levels agreeing with chiral SU(2)$_1$ conformal field theory, which is an analog of the $\nu = 1/2$ Laughlin state in spin system. In the vicinity of the N\'eel and CSL phase boundary, our numerical results do not find evidence to support the phase coexistence of N\'eel order and topological order that was conjectured by mean-field calculations. In the larger $J_2$ and $J_{\chi}$ coupling regime, the entanglement spectrum of the ground state also exhibits the chiral quasidegeneracy consistent with a CSL, but the adiabatic flux insertion simulations fail to obtain the quantized Chern number. By analyzing the finite-size scaling of magnetic order parameter, we find the vanished magnetic order suggesting a magnetic disorder phase, whose nature needs further studies. Different from the spin-$1$ $J_1$-$J_2$-$J_\chi$ model, we do not find the coexistent stripe magnetic order and topological order. We also investigate the $J_{\chi}$ dominant regime and find a strong tendency of the system to develop a dimer order rather than the chiral spin magnetic order observed in the spin-$1$ model., Comment: 16 pages, 17 figures

We investigate the magnetic excitations of the trimerized Heisenberg models with intra-trimer interaction $J_1$ and inter-trimer interaction $J_2$ on four different two-dimensional lattices using a combination of stochastic series expansion quantum Monte Carlo (SSE QMC) and stochastic analytic continuation methods (SAC), complemented by cluster perturbation theory (CPT). These models exhibit quasi-particle-like excitations when $g=J_2/J_1$ is small, characterized by low-energy magnons, intermediate-energy doublons, and high-energy quartons. The low-energy magnons are associated with the magnetic ground states. They can be described by the linear spin wave theory (LSWT) of the effective block spin model and the original spin model. Doublons and quartons emerge from the corresponding internal excitations of the trimers with distinct energy levels, which can be effectively analyzed using perturbation theory when the ratio of exchange interactions $g$ is small. In this small $g$ regime, we observe a clear separation between the magnon and higher-energy spectra. However, as $g$ increases, these three spectra gradually merge into the magnon modes or continua. Nevertheless, the LSWT fails to provide quantitative descriptions of the higher-energy excitation bands due to significant quantum fluctuations. Notably, in the Collinear II and trimerized hexagon lattice, a broad continuum emerges above the single-magnon spectrum, originating from the quasi-1D physics due to the dilute connections between chains. Our numerical analysis of these 2D trimers yields valuable theoretical predictions and explanations for the inelastic neutron scattering (INS) spectra of 2D magnetic materials featuring trimerized lattices.

Symmetry-breaking orders can not only compete with each other, but also be interwined, and the interwined topological and symmetry-breaking orders make the situation more intriguing. This work examines the archetypal correlated flat band model on a checkerboard lattice at filling $\nu=2/3$ and we find the unique interplay between smectic charge order and topological order gives rise to two novel quantum states. As the interaction strength increases, the system first transitions from a Fermi liquid into FQAH smectic (FQAHS) state, where FQAH topological order coexists cooperatively with smectic charge order with enlarged ground-state degeneracy and interestingly, the Hall conductivity is $\sigma_{xy}=\nu=2/3$, different from the band-folding or doping scenarios. Further increasing the interaction strength, the system undergoes another quantum phase transition and evolves into a polar smectic metal (PSM) state. This emergent PSM is an anisotropic non-Fermi liquid, whose interstripe tunneling is irrelevant while it is metallic inside each stripe. Different from the FQAHS and conventional smectic orders, this PSM spontaneously breaks the two-fold rotational symmetry, resulting in a nonzero electric dipole moment and ferroelectric order. In addition to the exotic ground states, large-scale numerical simulations are also used to study low-energy excitations and thermodynamic characteristics. We find the onset temperature of the incompressible FQAHS state, which also coincides with the onset of non-polar smectic order, is dictated by the magneto-roton modes. Above this onset temperature, the PSM state exists at intermediate-temperature regime. Although the T = 0 quantum phase transition between PSM and FQAHS is first order, the thermal FQAHS-PSM transition could be continuous. We expect the features of the exotic states and thermal phase transitions could be accessed in future experiments.

Employing the projective formalism of determinant quantum Monte Carlo (DQMC) simulations, we meticulously explore the ground-state phase diagram and critical behavior of the half-filled Hubbard model on a square-hexagon-octagon (SHO) lattice. This lattice, a two-dimensional (2D) structure comprising squares, hexagons, and octagons, is representative of the biphenylene network (BPN). Our findings reveal an intriguing ground-state phase diagram, featuring an antiferromagnetic (AFM) Mott insulating phase enveloped by three valence-bond solid-like (VBS-like) insulating phases. Analyzing the single-particle gap, spin gap, and single-particle spectral function, we observe that the metallic state in the noninteracting case becomes unstable under the influence of Hubbard U. This interaction drives the system into a hexagon insulating phase before transitioning into an AFM Mott insulating phase. To quantify the critical exponents, we use finite-size scaling techniques. The critical exponents of quantum critical points between the AFM Mott insulating phase and two insulating phases, plaquette insulator and ethylene insulator, closely align with the 3D O(3) universality class. However, the critical exponents of quantum critical points between the hexagon insulating phase and the AFM Mott insulating phase deviate from the 3D O(3) universality class. This deviation is a finite-size effect and can be attributed to the coupling between the fluctuations of magnetic order parameter and very low-energy fermionic excitations. Our comprehensive study not only advances the understanding of correlation effects on the SHO lattice but also sheds light on the less-explored critical exponents in weakly insulating quantum critical point.

The two-dimensional (2D) material Cr$_2$Ge$_2$Te$_6$ is a member of the class of insulating van der Waals magnets. Here, using high resolution angle-resolved photoemission spectroscopy in a detailed temperature dependence study, we identify a clear response of the electronic structure to a dimensional crossover in the form of two distinct temperature scales marking onsets of modifications in the electronic structure. Specifically, we observe Te $p$-orbital-dominated bands to undergo changes at the Curie transition temperature T$_C$ while the Cr $d$-orbital-dominated bands begin evolving at a higher temperature scale. Combined with neutron scattering, density functional theory calculations, and Monte Carlo simulations, we find that the electronic system can be consistently understood to respond sequentially to the distinct temperatures at which in-plane and out-of-plane spin correlations exceed a characteristic length scale. Our findings reveal the sensitivity of the orbital-selective electronic structure for probing the dynamical evolution of local moment correlations in vdW insulating magnets., Comment: PRB, in press

Contrastive Language-Image Pre-training (CLIP), a simple yet effective pre-training paradigm, successfully introduces text supervision to vision models. It has shown promising results across various tasks, attributable to its generalizability and interpretability. The use of CLIP has recently gained increasing interest in the medical imaging domain, serving both as a pre-training paradigm for aligning medical vision and language, and as a critical component in diverse clinical tasks. With the aim of facilitating a deeper understanding of this promising direction, this survey offers an in-depth exploration of the CLIP paradigm within the domain of medical imaging, regarding both refined CLIP pre-training and CLIP-driven applications. In this study, We (1) start with a brief introduction to the fundamentals of CLIP methodology. (2) Then, we investigate the adaptation of CLIP pre-training in the medical domain, focusing on how to optimize CLIP given characteristics of medical images and reports. (3) Furthermore, we explore the practical utilization of CLIP pre-trained models in various tasks, including classification, dense prediction, and cross-modal tasks. (4) Finally, we discuss existing limitations of CLIP in the context of medical imaging and propose forward-looking directions to address the demands of medical imaging domain. We expect that this comprehensive survey will provide researchers in the field of medical image analysis with a holistic understanding of the CLIP paradigm and its potential implications. The project page can be found on https://github.com/zhaozh10/Awesome-CLIP-in-Medical-Imaging., Comment: Project page available at https://github.com/zhaozh10/Awesome-CLIP-in-Medical-Imaging