Search

We introduce SimBench, a benchmark designed to evaluate the proficiency of student large language models (S-LLMs) in generating digital twins (DTs) that can be used in simulators for virtual testing. Given a collection of S-LLMs, this benchmark enables the ranking of the S-LLMs based on their ability to produce high-quality DTs. We demonstrate this by comparing over 20 open- and closed-source S-LLMs. Using multi-turn interactions, SimBench employs a rule-based judge LLM (J-LLM) that leverages both predefined rules and human-in-the-loop guidance to assign scores for the DTs generated by the S-LLM, thus providing a consistent and expert-inspired evaluation protocol. The J-LLM is specific to a simulator, and herein the proposed benchmarking approach is demonstrated in conjunction with the Chrono multi-physics simulator. Chrono provided the backdrop used to assess an S-LLM in relation to the latter's ability to create digital twins for multibody dynamics, finite element analysis, vehicle dynamics, robotic dynamics, and sensor simulations. The proposed benchmarking principle is broadly applicable and enables the assessment of an S-LLM's ability to generate digital twins for other simulation packages. All code and data are available at https://github.com/uwsbel/SimBench.

Closure models are widely used in simulating complex multiscale dynamical systems such as turbulence and the earth system, for which direct numerical simulation that resolves all scales is often too expensive. For those systems without a clear scale separation, deterministic and local closure models often lack enough generalization capability, which limits their performance in many real-world applications. In this work, we propose a data-driven modeling framework for constructing stochastic and non-local closure models via conditional diffusion model and neural operator. Specifically, the Fourier neural operator is incorporated into a score-based diffusion model, which serves as a data-driven stochastic closure model for complex dynamical systems governed by partial differential equations (PDEs). We also demonstrate how accelerated sampling methods can improve the efficiency of the data-driven stochastic closure model. The results show that the proposed methodology provides a systematic approach via generative machine learning techniques to construct data-driven stochastic closure models for multiscale dynamical systems with continuous spatiotemporal fields.

We report on high-sensitivity neutral hydrogen observations toward the gas-rich interacting galaxies NGC 3395/3396 with the Five-hundred-meter Aperture Spherical radio Telescope (FAST). Compared to previous observations carried out by the Very Large Array (VLA) and the Westerbork Synthesis Radio Telescope (WSRT), a more extended HI envelope around this system has been detected. The total HI gas mass of the NGC 3395/3396 system is estimated to be 7.8 x 109 M. This value is 2.7 times more than that reported based on the VLA interferometric maps. Previous observations found a large HI tail extending to the south-west and a minor tail emerging from the north of this peculiar galaxy pair. Based on the high-sensitivity observations of FAST, an extended HI plume to the north-west and a gas plume to the north-east have been detected for the first time. Neutral hydrogen of the two smaller galaxies IC 2604 and IC 2608 on the south of the system have also been detected. We discuss the origins of these extra gas and possible tidal interactions between these galaxies. NGC 3395/3396's most prominent tidal feature, the south-west tail combined with the new detected north-west plume behaves like a large ring. We suggest the ring might be formed by the previous fly-by interaction between NGC 3395 and NGC 3396 which happened 500 Myr ago. Our study shows that high-sensitivity HI observations are important in revealing low column density gas, which is crucial to a deeper understanding of this interacting system.

Recent advancements have showcased the potential of Large Language Models (LLMs) in executing reasoning tasks, particularly facilitated by Chain-of-Thought (CoT) prompting. While tasks like arithmetic reasoning involve clear, definitive answers and logical chains of thought, the application of LLM reasoning in recommendation systems (RecSys) presents a distinct challenge. RecSys tasks revolve around subjectivity and personalized preferences, an under-explored domain in utilizing LLMs' reasoning capabilities. Our study explores several aspects to better understand reasoning for RecSys and demonstrate how task quality improves by utilizing LLM reasoning in both zero-shot and finetuning settings. Additionally, we propose RecSAVER (Recommender Systems Automatic Verification and Evaluation of Reasoning) to automatically assess the quality of LLM reasoning responses without the requirement of curated gold references or human raters. We show that our framework aligns with real human judgment on the coherence and faithfulness of reasoning responses. Overall, our work shows that incorporating reasoning into RecSys can improve personalized tasks, paving the way for further advancements in recommender system methodologies., Comment: To be published at ACL 2024

The FAST All Sky HI survey (FASHI) is broader in frequency band and deeper in detection sensitivity than most of previous HI surveys. FASHI is designed to cover the entire sky observable by the Five-hundred-meter Aperture Spherical radio Telescope (FAST). Based on the FASHI data, we perform a blind survey of 21cm HI absorption galaxies at redshift $z<0.09$ over an area of about 10000 square degrees. We detected 51 HI absorbers, including 21 previously known and 30 new ones, with 8 sources having no optical spectroscopic redshift. The probability of occurrence for HI absorbers in all HI galaxies is 1/1078. The radio flux densities of the FASHI absorbers are mainly concentrated in the range of $S_{\rm 1.4GHz}=10\sim100$ mJy, but even as low as $2.6\pm0.4$mJy. The number of redshifted absorbers is slightly higher than the number of blueshifted absorbers. Such results would provide some important clues for future flux-selected HI absorber surveys. Therefore, FAST has significantly improved the capabilities and performance for HI absorption observations and provided a true blind survey of 21cm HI absorption galaxies for such studies., Comment: 32 pages, 7 figures, 2 tables, submitted to ApJS in 05/24/2024, Comments are welcome

We perform the first lattice calculation on the semileptonic decay of $J/\psi$ using the (2+1)-flavor Wilson-clover gauge ensembles generated by CLQCD collaboration. Three gauge ensembles with different lattice spacings, from 0.0519 fm to 0.1053 fm, and pion masses, $m_{\pi}\sim$ 300 MeV, are utilized. After a naive continuum extrapolation using three lattice spacings, we obtain $\operatorname{Br}(J/\psi\rightarrow D_s e\nu_e)=1.90(6)(5)_{V_{cs}}\times 10^{-10}$ and $\operatorname{Br}(J/\psi\rightarrow D e\nu_e)=1.21(6)(9)_{V_{cd}}\times 10^{-11}$, where the first errors are statistical, and the second come from the uncertainties of CKM matrix element $V_{cs(d)}$. The ratios of the branching fractions between lepton $\mu$ and $e$ are also calculated as $R_{J/\psi}(D_s)=0.97002(8)$ and $R_{J/\psi}(D)=0.97423(15)$ after performing a continuum limit including only $a^2$ term. The ratios provide necessary theoretical support for the future experimental test of lepton flavor universality., Comment: 13 pages, 7 figures

Natural language question answering (QA) over structured data sources such as tables and knowledge graphs (KGs) have been widely investigated, for example with Large Language Models (LLMs). The main solutions include question to formal query parsing and retrieval-based answer generation. However, current methods of the former often suffer from weak generalization, failing to dealing with multiple sources simultaneously, while the later is limited in trustfulness. In this paper, we propose UnifiedTQA, a trustful QA framework that can simultaneously support multiple types of structured data in a unified way. To this end, it adopts an LLM-friendly and unified knowledge representation method called Condition Graph (CG), and uses an LLM and demonstration-based two-level method for CG querying. For enhancement, it is also equipped with dynamic demonstration retrieval. We have evaluated UnifiedTQA with 5 benchmarks covering 3 types of structured data. It outperforms 2 existing unified structured data QA methods and in comparison with the baselines that are specific to a data type, it achieves state-of-the-art on 2 of them. Further more, we demonstrates potential of our method for more general QA tasks, QA over mixed structured data and QA across structured data.

The hybrid model of particle-ion-fluid-electron is widely utilized in astrophysical and laser-produced plasmas due to its kinetic characteristics and remarkable computational efficiency. However, the current numerical methods for the hybrid model have limitations when it comes to simulating non-quasi-neutral plasmas. To address this issue, I proposed a novel method called Convolutional Hybrid PIC (conv-HPIC). The conv-HPIC is based on a convolution equation derived from the Poisson's equation and the generalized Ohm's law. I performed numerical simulations on the collisionless electrostatic shock to validate the effectiveness of this method. The results demonstrate that the proposed method can accurately describe and predict the behavior of non-quasi-neutral plasmas. This method can be applied to both stationary and non-stationary electrostatic issues. It avoids the need for iterative calculations, effectively suppresses numerical noise, exhibits good computational efficiency, and can be easily parallelized.

A new knowledge-based and machine learning hybrid modeling approach, called conditional Gaussian neural stochastic differential equation (CGNSDE), is developed to facilitate modeling complex dynamical systems and implementing analytic formulae of the associated data assimilation (DA). In contrast to the standard neural network predictive models, the CGNSDE is designed to effectively tackle both forward prediction tasks and inverse state estimation problems. The CGNSDE starts by exploiting a systematic causal inference via information theory to build a simple knowledge-based nonlinear model that nevertheless captures as much explainable physics as possible. Then, neural networks are supplemented to the knowledge-based model in a specific way, which not only characterizes the remaining features that are challenging to model with simple forms but also advances the use of analytic formulae to efficiently compute the nonlinear DA solution. These analytic formulae are used as an additional computationally affordable loss to train the neural networks that directly improve the DA accuracy. This DA loss function promotes the CGNSDE to capture the interactions between state variables and thus advances its modeling skills. With the DA loss, the CGNSDE is more capable of estimating extreme events and quantifying the associated uncertainty. Furthermore, crucial physical properties in many complex systems, such as the translate-invariant local dependence of state variables, can significantly simplify the neural network structures and facilitate the CGNSDE to be applied to high-dimensional systems. Numerical experiments based on chaotic systems with intermittency and strong non-Gaussian features indicate that the CGNSDE outperforms knowledge-based regression models, and the DA loss further enhances the modeling skills of the CGNSDE.

The FAST All Sky HI survey (FASHI) is broader in frequency band and sky volume, and deeper in detection sensitivity than the Arecibo Legacy Fast ALFA survey (ALFALFA). To efficiently expand the sample of OH megamasers (OHMs), whose strongest line has a rest frequency of 1667.35903 MHz, we directly matched the IRAS Point Source Catalog Redshift (PSCz) catalog with the corresponding FASHI data cube. From 145 PSCz sources already covered by FASHI, we obtained 27 OHMs with a detection rate of 18.6%, including 9 previously known and 18 new ones, within a redshift range of $0.14314\lesssim z_{\rm OH} \lesssim0.27656$. We also measured the hyperfine ratio of nine OHMs between the 1667 and 1665 MHz lines. The ratio ranges from 1.32 to 15.22, with an average of $R_{1667:1665}=4.74$. In a fit to the $L_{\rm OH}$ vs. $L_{\rm FIR}$ relation, we have ${\rm log}L_{\rm OH}= (1.57\pm0.10){\rm log}L_{\rm FIR}-(15.80\pm1.19)$, which is almost the same as derived from previous observations. As expected, since the OHM sample was selected by cross-correlation with the IRAS-selected PSCz, our detected OHMs are [ultra]luminous infrared galaxies ([U]LIRGs). However, not all [U]LIRGs have detectable OH emission, suggesting that the OH emission may be triggered within a specific stage of the merger or can only be seen in specific orientations. In general, FAST, with its 19-beam array and UWB receiver, will be a powerful tool for observing more OHMs and unraveling their mystery in the future., Comment: 21 pages, 6 figures. Comments are welcome

We perform a lattice calculation on the radiative decay of $D_s^*$ using the (2+1)-flavor Wilson-clover gauge ensembles generated by CLQCD collaboration. A method allowing us to calculate the form factor with zero transfer momentum is proposed and applied to the radiative transition $D_s^*\rightarrow D_s\gamma$ and the Dalitz decay $D_s^*\rightarrow D_s e^+e^-$. After a continuum extrapolation using three lattice spacings, we obtain $\Gamma(D_s^*\rightarrow D_s \gamma)=0.0549(54)$ keV, where the error is purely statistical. The result is consistent with previous lattice calculations but with a error reduced to only a fifth of the before. The Dalitz decay rate is also calculated for the first time and the ratio with the radiative transition is found to be $R_{ee}=0.624(3)\%$. A total decay width of $D_s^*$ can then be determined as 0.0587(54) keV taking into account the experimental branching fraction. Combining with the most recent experimental measurement on the branching fraction of the purely leptonic decay $D_s^{+,*}\rightarrow e^+\nu_e$, we obtain the quantity $f_{D_s^*}|V_{cs}|=(190.5^{+55.1}_{-41.7_{\textrm{stat.}}}\pm 12.6_{\textrm{syst.}})$ MeV, where the stat. is only the statistical error from the experiment, and syst. results from the experimental systematic uncertainty and the lattice statistical error. Our result leads to an improved systematic uncertainty compared to $42.7_{\textrm{syst.}}$ obtained using previous lattice prediction of total decay width $0.070(28)$ keV as the input., Comment: 8 pages, 6 figures, published version

Complex dynamical systems are notoriously difficult to model because some degrees of freedom (e.g., small scales) may be computationally unresolvable or are incompletely understood, yet they are dynamically important. For example, the small scales of cloud dynamics and droplet formation are crucial for controlling climate, yet are unresolvable in global climate models. Semi-empirical closure models for the effects of unresolved degrees of freedom often exist and encode important domain-specific knowledge. Building on such closure models and correcting them through learning the structural errors can be an effective way of fusing data with domain knowledge. Here we describe a general approach, principles, and algorithms for learning about structural errors. Key to our approach is to include structural error models inside the models of complex systems, for example, in closure models for unresolved scales. The structural errors then map, usually nonlinearly, to observable data. As a result, however, mismatches between model output and data are only indirectly informative about structural errors, due to a lack of labeled pairs of inputs and outputs of structural error models. Additionally, derivatives of the model may not exist or be readily available. We discuss how structural error models can be learned from indirect data with derivative-free Kalman inversion algorithms and variants, how sparsity constraints enforce a "do no harm" principle, and various ways of modeling structural errors. We also discuss the merits of using non-local and/or stochastic error models. In addition, we demonstrate how data assimilation techniques can assist the learning about structural errors in non-ergodic systems. The concepts and algorithms are illustrated in two numerical examples based on the Lorenz-96 system and a human glucose-insulin model., Comment: 40 pages, 13 figures

Graph Neural Networks (GNNs) have become mainstream methods for solving the semi-supervised node classification problem. However, due to the uneven location distribution of labeled nodes in the graph, labeled nodes are only accessible to a small portion of unlabeled nodes, leading to the \emph{under-reaching} issue. In this study, we firstly reveal under-reaching by conducting an empirical investigation on various well-known graphs. Then, we demonstrate that under-reaching results in unsatisfactory distribution alignment between labeled and unlabeled nodes through systematic experimental analysis, significantly degrading GNNs' performance. To tackle under-reaching for GNNs, we propose an architecture-agnostic method dubbed NodeMixup. The fundamental idea is to (1) increase the reachability of labeled nodes by labeled-unlabeled pairs mixup, (2) leverage graph structures via fusing the neighbor connections of intra-class node pairs to improve performance gains of mixup, and (3) use neighbor label distribution similarity incorporating node degrees to determine sampling weights for node mixup. Extensive experiments demonstrate the efficacy of NodeMixup in assisting GNNs in handling under-reaching. The source code is available at \url{https://github.com/WeigangLu/NodeMixup}., Comment: Accepted by AAAI-24

Data-driven modeling techniques have been explored in the spatial-temporal modeling of complex dynamical systems for many engineering applications. However, a systematic approach is still lacking to leverage the information from different types of data, e.g., with different spatial and temporal resolutions, and the combined use of short-term trajectories and long-term statistics. In this work, we build on the recent progress of neural operator and present a data-driven modeling framework called neural dynamical operator that is continuous in both space and time. A key feature of the neural dynamical operator is the resolution-invariance with respect to both spatial and temporal discretizations, without demanding abundant training data in different temporal resolutions. To improve the long-term performance of the calibrated model, we further propose a hybrid optimization scheme that leverages both gradient-based and derivative-free optimization methods and efficiently trains on both short-term time series and long-term statistics. We investigate the performance of the neural dynamical operator with three numerical examples, including the viscous Burgers' equation, the Navier-Stokes equations, and the Kuramoto-Sivashinsky equation. The results confirm the resolution-invariance of the proposed modeling framework and also demonstrate stable long-term simulations with only short-term time series data. In addition, we show that the proposed model can better predict long-term statistics via the hybrid optimization scheme with a combined use of short-term and long-term data.

Based on the atomic-hydrogen (HI) observations using the Five-hundred-meter Aperture Spherical radio Telescope (FAST), we present a detailed study of the gas-rich massive S0 galaxy NGC 1023 in a nearby galaxy group. The presence of an HI extended warped disk in NGC 1023 indicates that this S0 galaxy originated from a spiral galaxy. The data also suggest that NGC 1023 is interacting with four dwarf galaxies. In particular, one of the largest dwarf galaxies has fallen into the gas disk of NGC 1023, forming a rare bright-dark galaxy pair with a large gas clump. This clump shows the signature of a galaxy but has no optical counterpart, implying that it is a newly formed starless galaxy. Our results firstly suggest that a massive S0 galaxy in a galaxy group can form via the morphological transformation from a spiral under the joint action of multiple tidal interactions., Comment: 13 pages, 8 figures, Accepted for publication in the ApJ Letters

Learning feature interaction is the critical backbone to building recommender systems. In web-scale applications, learning feature interaction is extremely challenging due to the sparse and large input feature space; meanwhile, manually crafting effective feature interactions is infeasible because of the exponential solution space. We propose to leverage a Transformer-based architecture with attention layers to automatically capture feature interactions. Transformer architectures have witnessed great success in many domains, such as natural language processing and computer vision. However, there has not been much adoption of Transformer architecture for feature interaction modeling in industry. We aim at closing the gap. We identify two key challenges for applying the vanilla Transformer architecture to web-scale recommender systems: (1) Transformer architecture fails to capture the heterogeneous feature interactions in the self-attention layer; (2) The serving latency of Transformer architecture might be too high to be deployed in web-scale recommender systems. We first propose a heterogeneous self-attention layer, which is a simple yet effective modification to the self-attention layer in Transformer, to take into account the heterogeneity of feature interactions. We then introduce \textsc{Hiformer} (\textbf{H}eterogeneous \textbf{I}nteraction Trans\textbf{former}) to further improve the model expressiveness. With low-rank approximation and model pruning, \hiformer enjoys fast inference for online deployment. Extensive offline experiment results corroborates the effectiveness and efficiency of the \textsc{Hiformer} model. We have successfully deployed the \textsc{Hiformer} model to a real world large scale App ranking model at Google Play, with significant improvement in key engagement metrics (up to +2.66\%).

As the development of academic conferences fosters global scholarly communication, researchers consistently need to obtain accurate and up-to-date information about academic conferences. Since the information is scattered, using an intelligent question-answering system to efficiently handle researchers' queries and ensure awareness of the latest advancements is necessary. Recently, Large Language Models (LLMs) have demonstrated impressive capabilities in question answering, and have been enhanced by retrieving external knowledge to deal with outdated knowledge. However, these methods fail to work due to the lack of the latest conference knowledge. To address this challenge, we develop the ConferenceQA dataset, consisting of seven diverse academic conferences. Specifically, for each conference, we first organize academic conference data in a tree-structured format through a semi-automated method. Then we annotate question-answer pairs and classify the pairs into four different types to better distinguish their difficulty. With the constructed dataset, we further propose a novel method STAR (STructure-Aware Retrieval) to improve the question-answering abilities of LLMs, leveraging inherent structural information during the retrieval process. Experimental results on the ConferenceQA dataset show the effectiveness of our retrieval method. The dataset and code are available at https://github.com/zjukg/ConferenceQA., Comment: 12 pages, 3 figures

Rydberg electromagnetically-induced transparency has been widely studied as a medium supporting light propagation under the action of nonlocal nonlinearities. Recently, optical potentials based on moir\'e lattices (MLs) were introduced for exploring unconventional physical states. Here, we predict a possibility of creating fully three-dimensional (3D) light bullets (LBs) in cold Rydberg gases under the action of ML potentials. The nonlinearity includes local self-defocusing and long-range focusing terms, the latter one induced by the Rydberg-Rydberg interaction. We produce zero-vorticity LB families of the fundamental, dipole, and quadrupole types, as well as vortex LBs. They all are gap solitons populating finite bandgaps of the underlying ML spectrum. Stable subfamilies are identified utilizing the combination of the anti-Vakhitov-Kolokolov criterion, computation of eigenvalues for small perturbations, and direct simulations.

Magnetic hot stars refer to the stars, which effective temperatures approximately in the range from 7,000 to 50,000 K, and with large-scale globally organized magnetic fields. These magnetic fields exhibit strengths ranging from tens of Gauss to tens of kilo-Gauss. They are key in understanding the effects caused by magnetic fields in the stellar evolution. However, there are only three magnetic hot stars studied via a combination of spectropolarimetric and asteroseismic modeling. Combined with $Transiting\;Exoplanet\;Survey\;Satellite\;(TESS)$ 1-56 sectors data sets, we provided a photometric variability and stochastic low frequency (SLF) variability study of 118 magnetic hot stars. 9 new rotating variable stars are identified. Using the Bayesian Markov Chain Monte Carlo (MCMC) framework, we fitted the morphologies of SLF variability for magnetic hot stars. Our analysis reveals that the magnetic hot stars in our sample have $\gamma < 5.5$ with the vast majority having $1 \leq \gamma \leq 3$. The $\nu_{\rm char}$ is primarily in the ranges of $0\;\text{d}^{-1} < \nu_{\rm char} < 6.3\;\text{d}^{-1}$. The amplitude of SLF variability, log$\alpha_{\rm 0}$, shows a dominant distribution ranging from 0.8 to 3. No significant correlations are observed between the luminosity and fitting parameters, suggesting no clear dependence of SLF variability on stellar mass for our sample of magnetic hot stars with masses between approximately $1.5 M_{\odot}< M < 20 M_{\odot}$. We found a significant negative correlation between the $B_{\rm p}$ and $\nu_{char}$. This suppression effect of magnetic fields on $\nu_{\rm char}$ may be a result of their inhibition of macroturbulence., Comment: 46 pages, 25 figures, Accepted by ApJ

Convolutional neural networks excel in histopathological image classification, yet their pixel-level focus hampers explainability. Conversely, emerging graph convolutional networks spotlight cell-level features and medical implications. However, limited by their shallowness and suboptimal use of high-dimensional pixel data, GCNs underperform in multi-class histopathological image classification. To make full use of pixel-level and cell-level features dynamically, we propose an asymmetric co-training framework combining a deep graph convolutional network and a convolutional neural network for multi-class histopathological image classification. To improve the explainability of the entire framework by embedding morphological and topological distribution of cells, we build a 14-layer deep graph convolutional network to handle cell graph data. For the further utilization and dynamic interactions between pixel-level and cell-level information, we also design a co-training strategy to integrate the two asymmetric branches. Notably, we collect a private clinically acquired dataset termed LUAD7C, including seven subtypes of lung adenocarcinoma, which is rare and more challenging. We evaluated our approach on the private LUAD7C and public colorectal cancer datasets, showcasing its superior performance, explainability, and generalizability in multi-class histopathological image classification.

Knowledge Graph Embedding (KGE) has proven to be an effective approach to solving the Knowledge Graph Completion (KGC) task. Relational patterns which refer to relations with specific semantics exhibiting graph patterns are an important factor in the performance of KGE models. Though KGE models' capabilities are analyzed over different relational patterns in theory and a rough connection between better relational patterns modeling and better performance of KGC has been built, a comprehensive quantitative analysis on KGE models over relational patterns remains absent so it is uncertain how the theoretical support of KGE to a relational pattern contributes to the performance of triples associated to such a relational pattern. To address this challenge, we evaluate the performance of 7 KGE models over 4 common relational patterns on 2 benchmarks, then conduct an analysis in theory, entity frequency, and part-to-whole three aspects and get some counterintuitive conclusions. Finally, we introduce a training-free method Score-based Patterns Adaptation (SPA) to enhance KGE models' performance over various relational patterns. This approach is simple yet effective and can be applied to KGE models without additional training. Our experimental results demonstrate that our method generally enhances performance over specific relational patterns. Our source code is available from GitHub at https://github.com/zjukg/Comprehensive-Study-over-Relational-Patterns., Comment: This paper is accepted by ISWC 2023

In this paper, we count the number of Pollicott--Ruelle resonances for open hyperbolic systems and Axiom A flows. In particular, we prove polynomial upper bounds and sublinear lower bounds on the number of resonances with modulus less than $r$ in strips for open hyperbolic systems and Axiom A flows with a transversality condition., Comment: 47 pages. Improve the lower bound from the previous version

Regime switching is ubiquitous in many complex dynamical systems with multiscale features, chaotic behavior, and extreme events. In this paper, a causation entropy boosting (CEBoosting) strategy is developed to facilitate the detection of regime switching and the discovery of the dynamics associated with the new regime via online model identification. The causation entropy, which can be efficiently calculated, provides a logic value of each candidate function in a pre-determined library. The reversal of one or a few such causation entropy indicators associated with the model calibrated for the current regime implies the detection of regime switching. Despite the short length of each batch formed by the sequential data, the accumulated value of causation entropy corresponding to a sequence of data batches leads to a robust indicator. With the detected rectification of the model structure, the subsequent parameter estimation becomes a quadratic optimization problem, which is solved using closed analytic formulae. Using the Lorenz 96 model, it is shown that the causation entropy indicator can be efficiently calculated, and the method applies to moderately large dimensional systems. The CEBoosting algorithm is also adaptive to the situation with partial observations. It is shown via a stochastic parameterized model that the CEBoosting strategy can be combined with data assimilation to identify regime switching triggered by the unobserved latent processes. In addition, the CEBoosting method is applied to a nonlinear paradigm model for topographic mean flow interaction, demonstrating the online detection of regime switching in the presence of strong intermittency and extreme events., Comment: 34 pages, 9 figures