Search

In this paper, we review legal testing methods based on Large Language Models (LLMs), using the OPENAI o1 model as a case study to evaluate the performance of large models in applying legal provisions. We compare current state-of-the-art LLMs, including open-source, closed-source, and legal-specific models trained specifically for the legal domain. Systematic tests are conducted on English and Chinese legal cases, and the results are analyzed in depth. Through systematic testing of legal cases from common law systems and China, this paper explores the strengths and weaknesses of LLMs in understanding and applying legal texts, reasoning through legal issues, and predicting judgments. The experimental results highlight both the potential and limitations of LLMs in legal applications, particularly in terms of challenges related to the interpretation of legal language and the accuracy of legal reasoning. Finally, the paper provides a comprehensive analysis of the advantages and disadvantages of various types of models, offering valuable insights and references for the future application of AI in the legal field.

Motivated by the key role of shear induced polarization in understanding the local spin polarization puzzle of $\Lambda$ hyperons in heavy ion collisions, we perform a complete analysis of spin polarization of massive fermion in a quantum electrodynamic plasma with shear flow. Apart from the well-known spin-shear coupling in free theory, we include two more collision dependent contributions: one is a non-dynamical contribution fixed by shifted spin-averaged distribution in steady state; the other is a dynamical contribution following from spin evolution. Despite of the dependencies on collision, we find the dependencies on coupling drop out in the final results. These contributions can lead to significant enhancement of the spin-shear coupling in phenomenologically interesting regime., Comment: 18 pages, 5 figures

The high computational, memory, and energy demands of Deep Learning (DL) applications often exceed the capabilities of battery-powered edge devices, creating difficulties in meeting task deadlines and accuracy requirements. Unlike previous solutions that optimize a single metric (e.g., accuracy or energy efficiency), HE2C framework is designed to holistically address the latency, memory, accuracy, throughput, and energy demands of DL applications across edge-cloud continuum, thereby, delivering a more comprehensive and effective user experience. HE2C comprises three key modules: (a) a "feasibility-check module that evaluates the likelihood of meeting deadlines across both edge and cloud resources; (b) a "resource allocation strategy" that maximizes energy efficiency without sacrificing the inference accuracy; and (c) a "rescue module" that enhances throughput by leveraging approximate computing to trade accuracy for latency when necessary. Our primary objective is to maximize system prolong battery lifespan, throughput, and accuracy while adhering to strict latency constraints. Experimental evaluations in the context of wearable technologies for blind and visually impaired users demonstrate that HE2C significantly improves task throughput via completing a larger number of tasks within their specified deadlines, while preserving edge device battery and maintaining prediction accuracy with minimal latency impact. These results underscore HE2C's potential as a robust solution for resource management in latency-sensitive, energy-constrained edge-to-cloud environments., Comment: Accepted in Utility Cloud Computing (UCC '24) Conference

Changing-look active galactic nuclei (CL-AGNs), characterized by emerging or disappearing of broad lines accompanied with extreme continuum flux variability, have drawn much attention for their potential of revealing physical processes underlying AGN evolution. We perform seven-season spectroscopic monitoring on Mrk~1018, one of the earliest identified CL-AGN. Around 2020, we detect a full-cycle changing-look transition of Mrk~1018 within one year, associated with a nucleus outburst, which likely arise from the disk instability in the transition region between the outer standard rotation-dominated disk and inner advection-dominated accretion flow. Over the past forty-five years, the accretion rate of Mrk~1018 changed 1000 times and the maximum Eddington ratio reached 0.02. By investigating the relation between broad-line properties and Eddington ratio ($L_{\rm bol}/L_{\rm Edd}$), we find strong evidence that the full-cycle type transition is regulated by accretion. There exists a turnover point in the Balmer decrement, which is observed for the first time. The broad Balmer lines change from a single peak in Type 1.0-1.2 to double peaks in Type 1.5-1.8 and the double-peak separation decreases with increasing accretion rate. We also find that the full width at half maximum (FWHM) of the broad Balmer lines obeys FWHM$\propto (L_{\rm bol}/L_{\rm Edd})^{-0.27}$, as expected for a virialized BLR. The velocity dispersion $\sigma_{\rm line}$ follows a similar trend in Type 1.5-1.8, but displays a sharp increases in Type 1.0-1.2, resulting in a dramatic drop of FWHM/$\sigma_{\rm line}$. These findings suggest that a virialized BLR together with accretion-dependent turbulent motions might be responsible for the diversity of BLR phenomena across AGN population., Comment: 24pages, 12figures, accepted by ApJS

The exceptionally low mass of $0.77_{-0.17}^{+0.2} M_{\odot}$ for the central compact object (CCO) XMMU J173203.3 -- 344518 (XMMU J1732) in the supernova remnant (SNR) HESS J1731 -- 347 challenges standard neutron star (NS) formation models. The nearby post-AGB star IRAS 17287 -- 3443 ($\approx 0.6 M_\odot$), also within the SNR, enriches the scenario. To address this puzzle, we advance the possibility that the gravitational collapse of a rotating pre-SN iron core ($\approx 1.2 M_\odot$) could result in a low-mass NS. We show that angular momentum conservation during the collapse of an iron core rotating at $\approx 45\%$ of the Keplerian limit results in a mass loss of $\approx 0.3 M_\odot$, producing a stable newborn NS of $\approx 0.9 M_\odot$. Considering the possible spin-down, this indicates that the NS is now slowly rotating, thus fulfilling the observed mass-radius relation. Additionally, the NS's surface temperature ($\approx 2 \times 10^6$ K) aligns with canonical thermal evolution for its $\approx 4.5$ kyr age. We propose the pre -- SN star, likely an ultra-stripped core of $\approx 4.2 M_\odot$, formed a tidally locked binary with IRAS 17287 -- 3443, having a 1.43-day orbital period. The supernova led to a $\approx 3 M_\odot$ mass loss, imparting a kick velocity $\lesssim 670$ km s$^{-1}$, which disrupted the binary. This scenario explains the observed 0.3 pc offset between XMMU J1732 and IRAS 17287 -- 3443 and supports the possibility of CCOs forming in binaries, with rotation playing a key role in core-collapse, and the CCO XMMU J1732 being the lightest NS ever observed., Comment: Accepted for publication in ApJ, comments are welcome!

Quantum coherence, a fundamental aspect of quantum mechanics, plays a crucial role in various quantum information tasks. However, preserving coherence under extreme conditions, such as relativistic acceleration, poses significant challenges. In this paper, we investigate the influence of Unruh temperature and energy levels on the evolution of maximal steered coherence (MSC) for different initial states. Our results reveal that MSC is strongly dependent on Unruh temperature, exhibiting behaviors ranging from monotonic decline to non-monotonic recovery, depending on the initial state parameter. Notably, when \Delta=1, MSC is generated as Unruh temperature increases. Additionally, we observe that higher energy levels help preserve or enhance MSC in the presence of Unruh effects. These findings offer valuable insights into the intricate relationship between relativistic effects and quantum coherence, with potential applications in developing robust quantum technologies for non-inertial environments., Comment: 6 pages, 2 figures

Event-based Action Recognition (EAR) possesses the advantages of high-temporal resolution capturing and privacy preservation compared with traditional action recognition. Current leading EAR solutions typically follow two regimes: project unconstructed event streams into dense constructed event frames and adopt powerful frame-specific networks, or employ lightweight point-specific networks to handle sparse unconstructed event points directly. However, such two regimes are blind to a fundamental issue: failing to accommodate the unique dense temporal and sparse spatial properties of asynchronous event data. In this article, we present a synergy-aware framework, i.e., EventCrab, that adeptly integrates the "lighter" frame-specific networks for dense event frames with the "heavier" point-specific networks for sparse event points, balancing accuracy and efficiency. Furthermore, we establish a joint frame-text-point representation space to bridge distinct event frames and points. In specific, to better exploit the unique spatiotemporal relationships inherent in asynchronous event points, we devise two strategies for the "heavier" point-specific embedding: i) a Spiking-like Context Learner (SCL) that extracts contextualized event points from raw event streams. ii) an Event Point Encoder (EPE) that further explores event-point long spatiotemporal features in a Hilbert-scan way. Experiments on four datasets demonstrate the significant performance of our proposed EventCrab, particularly gaining improvements of 5.17% on SeAct and 7.01% on HARDVS.

Many real-world user queries (e.g. "How do to make egg fried rice?") could benefit from systems capable of generating responses with both textual steps with accompanying images, similar to a cookbook. Models designed to generate interleaved text and images face challenges in ensuring consistency within and across these modalities. To address these challenges, we present ISG, a comprehensive evaluation framework for interleaved text-and-image generation. ISG leverages a scene graph structure to capture relationships between text and image blocks, evaluating responses on four levels of granularity: holistic, structural, block-level, and image-specific. This multi-tiered evaluation allows for a nuanced assessment of consistency, coherence, and accuracy, and provides interpretable question-answer feedback. In conjunction with ISG, we introduce a benchmark, ISG-Bench, encompassing 1,150 samples across 8 categories and 21 subcategories. This benchmark dataset includes complex language-vision dependencies and golden answers to evaluate models effectively on vision-centric tasks such as style transfer, a challenging area for current models. Using ISG-Bench, we demonstrate that recent unified vision-language models perform poorly on generating interleaved content. While compositional approaches that combine separate language and image models show a 111% improvement over unified models at the holistic level, their performance remains suboptimal at both block and image levels. To facilitate future work, we develop ISG-Agent, a baseline agent employing a "plan-execute-refine" pipeline to invoke tools, achieving a 122% performance improvement.

Streamflow plays an essential role in the sustainable planning and management of national water resources. Traditional hydrologic modeling approaches simulate streamflow by establishing connections across multiple physical processes, such as rainfall and runoff. These data, inherently connected both spatially and temporally, possess intrinsic causal relations that can be leveraged for robust and accurate forecasting. Recently, spatio-temporal graph neural networks (STGNNs) have been adopted, excelling in various domains, such as urban traffic management, weather forecasting, and pandemic control, and they also promise advances in streamflow management. However, learning causal relationships directly from vast observational data is theoretically and computationally challenging. In this study, we employ a river flow graph as prior knowledge to facilitate the learning of the causal structure and then use the learned causal graph to predict streamflow at targeted sites. The proposed model, Causal Streamflow Forecasting (CSF) is tested in a real-world study in the Brazos River basin in Texas. Our results demonstrate that our method outperforms regular spatio-temporal graph neural networks and achieves higher computational efficiency compared to traditional simulation methods. By effectively integrating river flow graphs with STGNNs, this research offers a novel approach to streamflow prediction, showcasing the potential of combining advanced neural network techniques with domain-specific knowledge for enhanced performance in hydrologic modeling., Comment: To be published at IEEE Big Data 2024

Oracle bone script (OBS), as China's earliest mature writing system, present significant challenges in automatic recognition due to their complex pictographic structures and divergence from modern Chinese characters. We introduce OracleSage, a novel cross-modal framework that integrates hierarchical visual understanding with graph-based semantic reasoning. Specifically, we propose (1) a Hierarchical Visual-Semantic Understanding module that enables multi-granularity feature extraction through progressive fine-tuning of LLaVA's visual backbone, (2) a Graph-based Semantic Reasoning Framework that captures relationships between visual components and semantic concepts through dynamic message passing, and (3) OracleSem, a semantically enriched OBS dataset with comprehensive pictographic and semantic annotations. Experimental results demonstrate that OracleSage significantly outperforms state-of-the-art vision-language models. This research establishes a new paradigm for ancient text interpretation while providing valuable technical support for archaeological studies.

The evolving landscape of edge computing envisions platforms operating as dynamic intermediaries between application providers and edge servers (ESs), where task offloading is coupled with payments for computational services. Ensuring efficient resource utilization and meeting stringent Quality of Service (QoS) requirements necessitates incentivizing ESs while optimizing the platforms operational objectives. This paper investigates a multi-agent system where both the platform and ESs are self-interested entities, addressing the joint optimization of revenue maximization, resource allocation, and task offloading. We propose a novel Stackelberg game-based framework to model interactions between stakeholders and solve the optimization problem using a Bayesian Optimization-based centralized algorithm. Recognizing practical challenges in information collection due to privacy concerns, we further design a decentralized solution leveraging neural network optimization and a privacy-preserving information exchange protocol. Extensive numerical evaluations demonstrate the effectiveness of the proposed mechanisms in achieving superior performance compared to existing baselines.

Diffusion models achieve impressive performance in human motion generation. However, current approaches typically ignore the significance of frequency-domain information in capturing fine-grained motions within the latent space (e.g., low frequencies correlate with static poses, and high frequencies align with fine-grained motions). Additionally, there is a semantic discrepancy between text and motion, leading to inconsistency between the generated motions and the text descriptions. In this work, we propose a novel diffusion-based FTMoMamba framework equipped with a Frequency State Space Model (FreqSSM) and a Text State Space Model (TextSSM). Specifically, to learn fine-grained representation, FreqSSM decomposes sequences into low-frequency and high-frequency components, guiding the generation of static pose (e.g., sits, lay) and fine-grained motions (e.g., transition, stumble), respectively. To ensure the consistency between text and motion, TextSSM encodes text features at the sentence level, aligning textual semantics with sequential features. Extensive experiments show that FTMoMamba achieves superior performance on the text-to-motion generation task, especially gaining the lowest FID of 0.181 (rather lower than 0.421 of MLD) on the HumanML3D dataset., Comment: 8 pages, 6 figures

Recent observations have challenged the long-held opinion that the duration of gamma-ray burst (GRB) prompt emission is determined by the activity epochs of the central engine. Specifically, the observations of GRB 230307A have revealed a different scenario in which the duration of the prompt emission is predominantly governed by the energy dissipation process following a brief initial energy injection from the central engine. In this paper, we explore a mechanism where the energy injection from the central engine initially causes turbulence in a small region and radiates locally. This turbulence then propagates to more distant regions and radiates. Consequently, the emission regions form concentric rings that extend outward. Using an idealized toy model, we show that such a mechanism, initiated by a pulsed energy injection, can produce a prompt emission light curve resembling a single broad pulse exhibiting the typical softer-wider/softer-later feature. Under some parameters, the main characteristics of the GRB 230307A spectra and light curves can be reproduced by the toy model., Comment: submitted to ApJL

The task of 4D content generation involves creating dynamic 3D models that evolve over time in response to specific input conditions, such as images. Existing methods rely heavily on pre-trained video diffusion models to guide 4D content dynamics, but these approaches often fail to capture essential physical principles, as video diffusion models lack a robust understanding of real-world physics. Moreover, these models face challenges in providing fine-grained control over dynamics and exhibit high computational costs. In this work, we propose Phys4DGen, a novel, high-efficiency framework that generates physics-compliant 4D content from a single image with enhanced control capabilities. Our approach uniquely integrates physical simulations into the 4D generation pipeline, ensuring adherence to fundamental physical laws. Inspired by the human ability to infer physical properties visually, we introduce a Physical Perception Module (PPM) that discerns the material properties and structural components of the 3D object from the input image, facilitating accurate downstream simulations. Phys4DGen significantly accelerates the 4D generation process by eliminating iterative optimization steps in the dynamics modeling phase. It allows users to intuitively control the movement speed and direction of generated 4D content by adjusting external forces, achieving finely tunable, physically plausible animations. Extensive evaluations show that Phys4DGen outperforms existing methods in both inference speed and physical realism, producing high-quality, controllable 4D content. Our project page is available at the link: \url{https://jiajinglin.github.io/Phys4DGen/}.

Assessment and evaluation have long been critical challenges in artificial intelligence (AI) and natural language processing (NLP). However, traditional methods, whether matching-based or embedding-based, often fall short of judging subtle attributes and delivering satisfactory results. Recent advancements in Large Language Models (LLMs) inspire the "LLM-as-a-judge" paradigm, where LLMs are leveraged to perform scoring, ranking, or selection across various tasks and applications. This paper provides a comprehensive survey of LLM-based judgment and assessment, offering an in-depth overview to advance this emerging field. We begin by giving detailed definitions from both input and output perspectives. Then we introduce a comprehensive taxonomy to explore LLM-as-a-judge from three dimensions: what to judge, how to judge and where to judge. Finally, we compile benchmarks for evaluating LLM-as-a-judge and highlight key challenges and promising directions, aiming to provide valuable insights and inspire future research in this promising research area. Paper list and more resources about LLM-as-a-judge can be found at \url{https://github.com/llm-as-a-judge/Awesome-LLM-as-a-judge} and \url{https://llm-as-a-judge.github.io}., Comment: 32 pages, 5 figures

Vision-and-Language Navigation (VLN), where an agent follows instructions to reach a target destination, has recently seen significant advancements. In contrast to navigation in discrete environments with predefined trajectories, VLN in Continuous Environments (VLN-CE) presents greater challenges, as the agent is free to navigate any unobstructed location and is more vulnerable to visual occlusions or blind spots. Recent approaches have attempted to address this by imagining future environments, either through predicted future visual images or semantic features, rather than relying solely on current observations. However, these RGB-based and feature-based methods lack intuitive appearance-level information or high-level semantic complexity crucial for effective navigation. To overcome these limitations, we introduce a novel, generalizable 3DGS-based pre-training paradigm, called UnitedVLN, which enables agents to better explore future environments by unitedly rendering high-fidelity 360 visual images and semantic features. UnitedVLN employs two key schemes: search-then-query sampling and separate-then-united rendering, which facilitate efficient exploitation of neural primitives, helping to integrate both appearance and semantic information for more robust navigation. Extensive experiments demonstrate that UnitedVLN outperforms state-of-the-art methods on existing VLN-CE benchmarks.

The X-ray afterglows of some gamma-ray bursts (GRBs) exhibit plateaus, which can be explained by the internal dissipation of a newborn millisecond magnetar wind. In the early phase of these newborn magnetars, the magnetic inclination angle undergoes periodic changes due to precession, leading to periodic modulation of the injection luminosity due to magnetic dipole radiation. This may result in quasi-periodic oscillations (QPOs) on the plateaus. In this paper, we identify four GRBs with regular flux variations on their X-ray afterglow plateaus from Swift/XRT data before November 2023, three of which exhibit periodicity. Based on the likelihood of supporting a precessing magnetar as the central engine, we classify them into three categories: Gold (GRB 060202 and GRB 180620A), Silver (GRB 050730), and Bronze (GRB 210610A). We invoke a model of magnetic dipole radiation emitted by a triaxially freely precessing magnetar whose spin-down is dominated by electromagnetic radiation, to fit the light curves. Our model successfully reproduces the light curves of these four GRBs, including the regular flux variations on the plateaus and their periodicity (if present). Our work provides further evidence for early precession in newborn millisecond magnetars in GRBs., Comment: 25 pages, 10 figures, accepted for publication in ApJ

Contact-rich tasks present significant challenges for robotic manipulation policies due to the complex dynamics of contact and the need for precise control. Vision-based policies often struggle with the skill required for such tasks, as they typically lack critical contact feedback modalities like force/torque information. To address this issue, we propose FoAR, a force-aware reactive policy that combines high-frequency force/torque sensing with visual inputs to enhance the performance in contact-rich manipulation. Built upon the RISE policy, FoAR incorporates a multimodal feature fusion mechanism guided by a future contact predictor, enabling dynamic adjustment of force/torque data usage between non-contact and contact phases. Its reactive control strategy also allows FoAR to accomplish contact-rich tasks accurately through simple position control. Experimental results demonstrate that FoAR significantly outperforms all baselines across various challenging contact-rich tasks while maintaining robust performance under unexpected dynamic disturbances. Project website: https://tonyfang.net/FoAR/, Comment: 9 pages, 5 figures

We investigate the convergence of a backward Euler finite element discretization applied to a multi-domain and multi-scale elliptic-parabolic system, derived from the Doyle-Fuller-Newman model for lithium-ion batteries. Our analysis establishes optimal-order error estimates for variables in the norms $l^2(H^1)$ and $l^2(L^2(H^q_r))$, $q=0,1$. To enhance computational efficiency, we introduce a novel scale-decoupled solver that balances rapid convergence with reduced memory requirements. Numerical experiments using realistic battery parameters validate the theoretical error rates and highlight the superior performance of the proposed solver compared to existing algorithms.

Real-time computer vision (CV) plays a crucial role in various real-world applications, whose performance is highly dependent on communication networks. Nonetheless, the data-oriented characteristics of conventional communications often do not align with the special needs of real-time CV tasks. To alleviate this issue, the recently emerged semantic communications only transmit task-related semantic information and exhibit a promising landscape to address this problem. However, the communication challenges associated with Semantic Facial Editing, one of the most important real-time CV applications on social media, still remain largely unexplored. In this paper, we fill this gap by proposing Editable-DeepSC, a novel cross-modal semantic communication approach for facial editing. Firstly, we theoretically discuss different transmission schemes that separately handle communications and editings, and emphasize the necessity of Joint Editing-Channel Coding (JECC) via iterative attributes matching, which integrates editings into the communication chain to preserve more semantic mutual information. To compactly represent the high-dimensional data, we leverage inversion methods via pre-trained StyleGAN priors for semantic coding. To tackle the dynamic channel noise conditions, we propose SNR-aware channel coding via model fine-tuning. Extensive experiments indicate that Editable-DeepSC can achieve superior editings while significantly saving the transmission bandwidth, even under high-resolution and out-of-distribution (OOD) settings.

The Mamba-based image restoration backbones have recently demonstrated significant potential in balancing global reception and computational efficiency. However, the inherent causal modeling limitation of Mamba, where each token depends solely on its predecessors in the scanned sequence, restricts the full utilization of pixels across the image and thus presents new challenges in image restoration. In this work, we propose MambaIRv2, which equips Mamba with the non-causal modeling ability similar to ViTs to reach the attentive state space restoration model. Specifically, the proposed attentive state-space equation allows to attend beyond the scanned sequence and facilitate image unfolding with just one single scan. Moreover, we further introduce a semantic-guided neighboring mechanism to encourage interaction between distant but similar pixels. Extensive experiments show our MambaIRv2 outperforms SRFormer by \textbf{even 0.35dB} PSNR for lightweight SR even with \textbf{9.3\% less} parameters and suppresses HAT on classic SR by \textbf{up to 0.29dB}. Code is available at \url{https://github.com/csguoh/MambaIR}., Comment: Technical report

With the advancement of large language models (LLMs), researchers have explored various methods to optimally leverage their comprehension and generation capabilities in sequential recommendation scenarios. However, several challenges persist in this endeavor. Firstly, most existing approaches rely on the input-output prompting paradigm, which can result in irrelevant or inaccurate responses. Secondly, while there have been attempts to enhance LLMs using prompting strategies such as chain-of-thought (CoT), these efforts have not fully harnessed the reasoning abilities of LLMs or effectively captured the multifaceted information contained within user sequences. To address these limitations, we propose GOT4Rec, a sequential recommendation method that utilizes the graph of thoughts (GoT) prompting strategy. Specifically, we identify and utilize three key types of information within user history sequences: short-term interests, long-term interests and collaborative information from other users. Our approach enables LLMs to independently reason and generate recommendations based on these distinct types of information, subsequently aggregating the results within the GoT framework to derive the final recommended items. This method allows LLMs, with enhanced reasoning capabilities, to more effectively consider the diverse information within user sequences, resulting in more accurate recommendations and more comprehensive explanations. Extensive experiments on real-world datasets demonstrate the effectiveness of GOT4Rec, indicating that it outperforms existing state-of-the-art baselines. Our code is available at https://anonymous.4open.science/r/GOT4Rec-ED99.

We present the application of the image coaddition algorithm, Up-sampling and PSF Deconvolution Coaddition (UPDC), for stacking multiple exposure images captured by the James Webb Space Telescope (JWST) Near-Infrared Camera (NIRCam). By addressing the point spread function (PSF) effect, UPDC provides visually enhanced and sharper images. Furthermore, the anti-aliasing and super-resolution capabilities of UPDC make it easier to deblend sources overlapped on images, yielding a higher accuracy of aperture photometry. We apply this algorithm to the SMACS J0723 imaging data. Comparative analysis with the Drizzle algorithm demonstrates significant improvements in detecting faint sources, achieving accurate photometry, and effectively deblending (super-resolution) closely packed sources. {As a result, we have newly detected a pair of close binary stars that were previously unresolvable in the original exposures or the Drizzled image.} These improvements significantly benefit various scientific projects conducted by JWST. The resulting dataset, named "UPdec-Webb", can be accessible through the official website of the Chinese Virtual Observatory (ChinaVO)., Comment: 21 pages, 18 figures, accepted for publication in ApJS

Multimodal Large Language Models (MLLMs) have made significant advancements, demonstrating powerful capabilities in processing and understanding multimodal data. Fine-tuning MLLMs with Federated Learning (FL) allows for expanding the training data scope by including private data sources, thereby enhancing their practical applicability in privacy-sensitive domains. However, current research remains in the early stage, particularly in addressing the \textbf{multimodal heterogeneities} in real-world applications. In this paper, we introduce a benchmark for evaluating various downstream tasks in the federated fine-tuning of MLLMs within multimodal heterogeneous scenarios, laying the groundwork for the research in the field. Our benchmark encompasses two datasets, five comparison baselines, and four multimodal scenarios, incorporating over ten types of modal heterogeneities. To address the challenges posed by modal heterogeneity, we develop a general FedMLLM framework that integrates four representative FL methods alongside two modality-agnostic strategies. Extensive experimental results show that our proposed FL paradigm improves the performance of MLLMs by broadening the range of training data and mitigating multimodal heterogeneity. Code is available at https://github.com/1xbq1/FedMLLM

Detailed studies of two-neutrino double electron capture (2$\nu$DEC) is a crucial step towards searching for the neutrino-less mode to explore the Majorana nature of neutrinos. We have measured precisely the half-life of the 2$\nu$DEC process in $^{124}$Xe, utilizing a total exposure of 1.73 tonne$\cdot$year from the commissioning run and the first science run of the PandaX-4T experiment. A time-dependent background model in the $\mathcal{O}$(10 keV) energy is constructed for the first time in PandaX-4T data. With an unbinned maximum likelihood fit, we determine the half-life of the 2$\nu$DEC process to be $(1.03\pm0.15_{\rm stat}\pm0.06_{\rm sys})\times 10^{22}$$\,$yr. Furthermore, we have evaluated the branching ratio for both electrons captured from the $K$ shell ($KK$) to be $(65\pm5)\%$, which aligns with the $^{124}$Xe nuclear model calculations within 1.5$\,$$\sigma$., Comment: 18 pages, 5 figures, 3 tables

Metal-Ge contacts possess much stronger Fermi level pinning (FLP) than metal-Si contacts, which is commonly believed to be due to Ge having a narrower bandgap and higher permittivity in the context of FLP caused by metal-induced gap states. Here, we show that both Ge and Si have a similar FLP strength if they adopt an identical interface chemical bonding configuration at the contact interface by performing first-principles calculations: Si and Ge have FLP factors of 0.16 and 0.11, respectively, if they adopt the same reconstructed bonding configuration and have FLP factors of 0.05 and 0, respectively, if they adopt the same non-reconstructed bonding configuration. We illustrate that Ge prefers the latter configuration at the contact interface, which has denser dangling-bond-induced surface states, and Si prefers the latter one, which has a self-passivation effect for reducing the dangling bond-induced interface states, to reproduce the experimental data. By revealing the significance of dangling bond-induced interface gap states on FLP, these findings shed new light on lowering the contact resistance for developing future Si CMOS technology., Comment: 20 pages, 10 figures

In order to solve the problem of insufficient generation quality caused by traditional patent text abstract generation models only originating from patent specifications, the problem of new terminology OOV caused by rapid patent updates, and the problem of information redundancy caused by insufficient consideration of the high professionalism, accuracy, and uniqueness of patent texts, we proposes a patent text abstract generation model (MSEA) based on a master-slave encoder architecture; Firstly, the MSEA model designs a master-slave encoder, which combines the instructions in the patent text with the claims as input, and fully explores the characteristics and details between the two through the master-slave encoder; Then, the model enhances the consideration of new technical terms in the input sequence based on the pointer network, and further enhances the correlation with the input text by re weighing the "remembered" and "for-gotten" parts of the input sequence from the encoder; Finally, an enhanced repetition suppression mechanism for patent text was introduced to ensure accurate and non redundant abstracts generated. On a publicly available patent text dataset, compared to the state-of-the-art model, Improved Multi-Head Attention Mechanism (IMHAM), the MSEA model achieves an improvement of 0.006, 0.005, and 0.005 in Rouge-1, Rouge-2, and Rouge-L scores, respectively. MSEA leverages the characteristics of patent texts to effectively enhance the quality of patent text generation, demonstrating its advancement and effectiveness in the experiments., Comment: 25pages, 1 figure

RIS, as an efficient tool to improve receive signal-to-noise ratio, extend coverage and create more spatial diversity, is viewed as a most promising technique for the future wireless networks like 6G. As you know, IRS is very suitable for a special wireless scenario with wireless link between BS and users being completely blocked. In this paper, we extend its applications to a general scenario, i.e., rank-deficient-channel, particularly some extremely low-rank ones such as no link, and line-of-sight (LoS). Actually, there are several potential important low-rank applications of like satellite, UAV communications, marine, and deep-space communications. In such a situation, it is found that RIS may make a dramatic DoF enhancement over no RIS. By using a distributed RIS placement, the DoF of channels from BS to users may be even boosted from a low-rank like 0/1 to full-rank. This will achieve an extremely rate improvement via multiple spatial streams transmission per user. In this paper, we present a complete review of make a in-depth discussion on DoF effect of RIS.

This study investigates air pollution in central Taiwan, focusing on key pollutants, including SO$_2$, NO$_2$, PM$_{10}$, and PM$_{2.5}$. We use non-negative matrix factorization (NMF) to reduce data dimensionality, followed by wind direction analysis and speed to trace pollution sources. Our findings indicate that PM$_{2.5}$ and NO$_2$ levels are primarily influenced by local sources, while SO$_2$ levels are more affected by transboundary factors. For PM$_{10}$, contributions from domestic and transboundary sources are nearly equal., Comment: 25 pages, 29 figures

The CMS and ATLAS Collaborations have recently reported their findings based on the comprehensive run 2 dataset, detailing their searches for a light Higgs boson with a mass of approximately 95 GeV. We investigate the excesses observed in the $\gamma\gamma$, $\tau{\bar\tau}$ and $b{\bar b}$ data at approximately 95 GeV in the $U(1)_X$ model. Additionally, it also mixes with the SM-like Higgs boson. Research indicates that, in this model, identifying this singlet Higgs state as the lightest Higgs boson holds tremendous potential for explaining the excess observed at approximately 95 GeV. In our calculations, we maintain the masses of the lightest and next-to-lightest Higgs bosons at approximately 95 GeV and 125 GeV, respectively. The study finds that the theoretical predictions for the signal strengths $\mu(h_{95})_{\gamma\gamma}$ $\mu(h_{95})_{\tau{\bar\tau}}$ and $\mu(h_{95})_{b{\bar b}}$ in the $U(1)_X$ model align well with the excesses observed by CMS., Comment: 23 pages, 5 figures

In this short note, we introduce cospectral graphons, paralleling the notion of cospectral graphs. As in the graph case, we give three equivalent definitions: by equality of spectra, by equality of cycle densities, and by a unitary transformation. We also give an example of two cospectral graphons that cannot be approximated by two sequences of cospectral graphs in the cut distance., Comment: 7 pages

We report results of magnetic susceptibility, specific heat, and muon spin relaxation ($\mu$SR) measurements on the polycrystalline Ba$_6$Nd$_2$Ti$_4$O$_{17}$, a disorder-free triangular-lattice antiferromagnet. The absence of long-range magnetic order or spin freezing is confirmed down to 30~mK, much less than the Curie-Weiss temperature -1.8~K. The magnetic and specific heat measurements reveal the effective-1/2 spins are Ising-like. The persistent spin dynamics is determined down to 37~mK. Our study present a remarkable example of Ising spins on the triangular lattice, which remains magnetically disordered at low temperatures and potentially hosts a quantum spin liquid ground state.

Planning with partial observation is a central challenge in embodied AI. A majority of prior works have tackled this challenge by developing agents that physically explore their environment to update their beliefs about the world state. In contrast, humans can $\textit{imagine}$ unseen parts of the world through a mental exploration and $\textit{revise}$ their beliefs with imagined observations. Such updated beliefs can allow them to make more informed decisions, without necessitating the physical exploration of the world at all times. To achieve this human-like ability, we introduce the $\textit{Generative World Explorer (Genex)}$, an egocentric world exploration framework that allows an agent to mentally explore a large-scale 3D world (e.g., urban scenes) and acquire imagined observations to update its belief. This updated belief will then help the agent to make a more informed decision at the current step. To train $\textit{Genex}$, we create a synthetic urban scene dataset, Genex-DB. Our experimental results demonstrate that (1) $\textit{Genex}$ can generate high-quality and consistent observations during long-horizon exploration of a large virtual physical world and (2) the beliefs updated with the generated observations can inform an existing decision-making model (e.g., an LLM agent) to make better plans., Comment: Website: generative-world-explorer.github.io

Multi-modal Large Language models (MLLMs) are always trained on data from diverse and unreliable sources, which may contain misaligned or mislabeled text-image pairs. This frequently causes robustness issues and hallucinations, leading to performance degradation. Data valuation is an efficient way to detect and trace these misalignments. Nevertheless, existing methods are computationally expensive for MLLMs. While computationally efficient, the classical influence functions are inadequate for contrastive learning models because they were originally designed for pointwise loss. Additionally, contrastive learning involves minimizing the distance between the modalities of positive samples and maximizing the distance between the modalities of negative samples. This requires us to evaluate the influence of samples from both perspectives. To tackle these challenges, we introduce the Extended Influence Function for Contrastive Loss (ECIF), an influence function crafted for contrastive loss. ECIF considers both positive and negative samples and provides a closed-form approximation of contrastive learning models, eliminating the need for retraining. Building upon ECIF, we develop a series of algorithms for data evaluation in MLLM, misalignment detection, and misprediction trace-back tasks. Experimental results demonstrate our ECIF advances the transparency and interpretability of MLLMs by offering a more accurate assessment of data impact and model alignment compared to traditional baseline methods., Comment: 34 pages

Large Language Models (LLMs) have demonstrated remarkable success across a wide range of tasks and domains. However, their performance in low-resource language translation, particularly when translating into these languages, remains underexplored. This gap poses significant challenges, as linguistic barriers hinder the cultural preservation and development of minority communities. To address this issue, this paper introduces a novel retrieval-based method that enhances translation quality for low-resource languages by focusing on key terms, which involves translating keywords and retrieving corresponding examples from existing data. To evaluate the effectiveness of this method, we conducted experiments translating from English into three low-resource languages: Cherokee, a critically endangered indigenous language of North America; Tibetan, a historically and culturally significant language in Asia; and Manchu, a language with few remaining speakers. Our comparison with the zero-shot performance of GPT-4o and LLaMA 3.1 405B, highlights the significant challenges these models face when translating into low-resource languages. In contrast, our retrieval-based method shows promise in improving both word-level accuracy and overall semantic understanding by leveraging existing resources more effectively.

Numerous challenges persist in High Energy Physics (HEP), the addressing of which requires advancements in detection technology, computational methods, data analysis frameworks, and phenomenological designs. We provide a concise yet comprehensive overview of recent progress across these areas, in line with advances in quantum technology. We will discuss the potential of quantum devices in detecting subtle effects indicative of new physics beyond the Standard Model, the transformative role of quantum algorithms and large-scale quantum computers in studying real-time non-perturbative dynamics in the early universe and at colliders, as well as in analyzing complex HEP data. Additionally, we emphasize the importance of integrating quantum properties into HEP experiments to test quantum mechanics at unprecedented high-energy scales and search for hints of new physics. Looking ahead, the continued integration of resources to fully harness these evolving technologies will enhance our efforts to deepen our understanding of the fundamental laws of nature., Comment: 27 pages, 7 figures

Efficient deployment of large language models, particularly Mixture of Experts (MoE), on resource-constrained platforms presents significant challenges, especially in terms of computational efficiency and memory utilization. The MoE architecture, renowned for its ability to increase model capacity without a proportional increase in inference cost, greatly reduces the token generation latency compared with dense models. However, the large model size makes MoE models inaccessible to individuals without high-end GPUs. In this paper, we propose a high-throughput MoE batch inference system, that significantly outperforms past work. MoE-Lightning introduces a novel CPU-GPU-I/O pipelining schedule, CGOPipe, with paged weights to achieve high resource utilization, and a performance model, HRM, based on a Hierarchical Roofline Model we introduce to help find policies with higher throughput than existing systems. MoE-Lightning can achieve up to 10.3x higher throughput than state-of-the-art offloading-enabled LLM inference systems for Mixtral 8x7B on a single T4 GPU (16GB). When the theoretical system throughput is bounded by the GPU memory, MoE-Lightning can reach the throughput upper bound with 2-3x less CPU memory, significantly increasing resource utilization. MoE-Lightning also supports efficient batch inference for much larger MoEs (e.g., Mixtral 8x22B and DBRX) on multiple low-cost GPUs (e.g., 2-4 T4).

This study aims to fill the gap by constructing a topic-aware comparable corpus of Mainland Chinese Mandarin and Taiwanese Mandarin from the social media in Mainland China and Taiwan, respectively. Using Dcard for Taiwanese Mandarin and Sina Weibo for Mainland Chinese, we create a comparable corpus that updates regularly and reflects modern language use on social media., Comment: 4 pages, 4 figures, presented at APCLC2018: ASIA-PACIFIC CORPUS LINGUISTICS CONFERENCE 2018

We present a finite element semi-discrete error analysis for the Doyle-Fuller-Newman model, which is the most popular model for lithium-ion batteries. Central to our approach is a novel projection operator designed for the pseudo-($N$+1)-dimensional equation, offering a powerful tool for multiscale equation analysis. Our results bridge a gap in the analysis for dimensions $2 \le N \le 3$ and achieve optimal convergence rates of $h+(\Delta r)^2$. Additionally, we perform a detailed numerical verification, marking the first such validation in this context. By avoiding the change of variables, our error analysis can also be extended beyond isothermal conditions.

The nanosized boron vacancy ($V_\mathrm{B}^-$) defect spot in hexagonal boron nitride ($h$-BN) is promising for a local magnetic field quantum sensor. One of its advantages is that a helium-ion microscope can make a spot at any location in an $h$-BN flake with nanometer accuracy. In this study, we investigate the properties of the created nanosized $V_\mathrm{B}^-$ defect spots by systematically varying three conditions: the helium-ion dose, the thickness of the $h$-BN flakes, and the substrate on which the $h$-BN flakes are attached. The physical background of the results obtained is successfully interpreted using Monte Carlo calculations. From the findings obtained here, a guideline for their optimal creation conditions is obtained to maximize its performance as a quantum sensor concerning sensitivity and localization., Comment: 12 pages, 7 figures

The advent of large language models (LLMs) has spurred the development of numerous jailbreak techniques aimed at circumventing their security defenses against malicious attacks. An effective jailbreak approach is to identify a domain where safety generalization fails, a phenomenon known as mismatched generalization. In this paper, we introduce two novel jailbreak methods based on mismatched generalization: natural language games and custom language games, both of which effectively bypass the safety mechanisms of LLMs, with various kinds and different variants, making them hard to defend and leading to high attack rates. Natural language games involve the use of synthetic linguistic constructs and the actions intertwined with these constructs, such as the Ubbi Dubbi language. Building on this phenomenon, we propose the custom language games method: by engaging with LLMs using a variety of custom rules, we successfully execute jailbreak attacks across multiple LLM platforms. Extensive experiments demonstrate the effectiveness of our methods, achieving success rates of 93% on GPT-4o, 89% on GPT-4o-mini and 83% on Claude-3.5-Sonnet. Furthermore, to investigate the generalizability of safety alignments, we fine-tuned Llama-3.1-70B with the custom language games to achieve safety alignment within our datasets and found that when interacting through other language games, the fine-tuned models still failed to identify harmful content. This finding indicates that the safety alignment knowledge embedded in LLMs fails to generalize across different linguistic formats, thus opening new avenues for future research in this area.

Multimodal large language models (MLLMs) have advanced the integration of visual and linguistic modalities, establishing themselves as the dominant paradigm for visual-language tasks. Current approaches like chain of thought (CoT) reasoning have augmented the cognitive capabilities of large language models (LLMs), yet their adaptation to MLLMs is hindered by heightened risks of hallucination in cross-modality comprehension. In this paper, we find that the thinking while looking paradigm in current multimodal CoT approaches--where reasoning chains are generated alongside visual input--fails to mitigate hallucinations caused by misleading images. To address these limitations, we propose the Visual Inference Chain (VIC) framework, a novel approach that constructs reasoning chains using textual context alone before introducing visual input, effectively reducing cross-modal biases and enhancing multimodal reasoning accuracy. Comprehensive evaluations demonstrate that VIC significantly improves zero-shot performance across various vision-related tasks, mitigating hallucinations while refining the reasoning capabilities of MLLMs. Our code repository can be found at https://github.com/Terry-Xu-666/visual_inference_chain.

Recently, the altermagnets, a new kind of colinear antiferromagnet with zero net magnetization and momentum-dependent spin-splitting of bands, have sparked great interest. Despite simple magnetic structures, these altermagnets exhibit intriguing and intricate dependence of AHE on the N\'eel vector, in contrast to the conventional perpendicular configuration of Hall current with magnetization in ferromagnets. However, the relationship between the AHE and the N\'eel vector remains largely elusive. Here, we propose an "extrinsic parameter" method and further reveal diverse unconventional anomalous Hall textures in the N\'eel vector space, dubbed anomalous-Hall N\'eel textures (AHNTs), for altermagnets. Notably, we find that AHNTs resemble the spin textures in momentum space, and identify 10 types across four categories of AHNTs in altermagnets. Meanwhile, we examine our key discoveries in prototypical altermagnets. Our work can offer a methodology for detecting N\'eel vectors via anomalous Hall transport, and provide useful guidelines for designing electronic and optoelectronic devices based on altermagnets.

Multimodal image fusion (MMIF) aims to integrate information from different modalities to obtain a comprehensive image, aiding downstream tasks. However, existing methods tend to prioritize natural image fusion and focus on information complementary and network training strategies. They ignore the essential distinction between natural and medical image fusion and the influence of underlying components. This paper dissects the significant differences between the two tasks regarding fusion goals, statistical properties, and data distribution. Based on this, we rethink the suitability of the normalization strategy and convolutional kernels for end-to-end MMIF.Specifically, this paper proposes a mixture of instance normalization and group normalization to preserve sample independence and reinforce intrinsic feature correlation.This strategy promotes the potential of enriching feature maps, thus boosting fusion performance. To this end, we further introduce the large kernel convolution, effectively expanding receptive fields and enhancing the preservation of image detail. Moreover, the proposed multipath adaptive fusion module recalibrates the decoder input with features of various scales and receptive fields, ensuring the transmission of crucial information. Extensive experiments demonstrate that our method exhibits state-of-the-art performance in multiple fusion tasks and significantly improves downstream applications. The code is available at https://github.com/HeDan-11/LKC-FUNet.

Existing claim verification datasets often do not require systems to perform complex reasoning or effectively interpret multimodal evidence. To address this, we introduce a new task: multi-hop multimodal claim verification. This task challenges models to reason over multiple pieces of evidence from diverse sources, including text, images, and tables, and determine whether the combined multimodal evidence supports or refutes a given claim. To study this task, we construct MMCV, a large-scale dataset comprising 16k multi-hop claims paired with multimodal evidence, generated and refined using large language models, with additional input from human feedback. We show that MMCV is challenging even for the latest state-of-the-art multimodal large language models, especially as the number of reasoning hops increases. Additionally, we establish a human performance benchmark on a subset of MMCV. We hope this dataset and its evaluation task will encourage future research in multimodal multi-hop claim verification.

DarkSHINE is a newly proposed fixed-target experiment initiative to search for the invisible decay of Dark Photon via missing energy/momentum signatures, based on the high repetition rate electron beam to be deployed/delivered by the Shanghai High repetition rate XFEL and Extreme light facility (SHINE). This report elaborates the baseline design of DarkSHINE experiment by introducing the physics goals, experimental setups, details of each sub-detector system technical designs, signal and backgground modelings, expected search sensitivities and future prospects, which mark an important step towards the further prototyping and technical demonstrations.