Search

The performance differential of large language models (LLM) between languages hinders their effective deployment in many regions, inhibiting the potential economic and societal value of generative AI tools in many communities. However, the development of functional LLMs in many languages (\ie, multilingual LLMs) is bottlenecked by the lack of high-quality evaluation resources in languages other than English. Moreover, current practices in multilingual benchmark construction often translate English resources, ignoring the regional and cultural knowledge of the environments in which multilingual systems would be used. In this work, we construct an evaluation suite of 197,243 QA pairs from local exam sources to measure the capabilities of multilingual LLMs in a variety of regional contexts. Our novel resource, INCLUDE, is a comprehensive knowledge- and reasoning-centric benchmark across 44 written languages that evaluates multilingual LLMs for performance in the actual language environments where they would be deployed.

Shock-generated transients, such as hot flow anomalies (HFAs), upstream of planetary bow shocks, play a critical role in electron acceleration. Using multi-mission data from NASA's Magnetospheric Multiscale (MMS) and ESA's Cluster missions, we demonstrate the transmission of HFAs through Earth's quasi-parallel bow shock, associated with acceleration of electrons up to relativistic energies. Energetic electrons, initially accelerated upstream, are shown to remain broadly confined within the transmitted transient structures downstream, where betatron acceleration further boosts their energy due to elevated compression levels. Additionally, high-speed jets form at the compressive edges of HFAs, exhibiting a significant increase in dynamic pressure and potentially contributing to driving further localized compression. Our findings emphasize the efficiency of quasi-parallel shocks in driving particle acceleration far beyond the immediate shock transition region, expanding the acceleration region to a larger spatial domain. Finally, this study underscores the importance of multi-scale observational approach in understanding the convoluted processes behind collisionless shock physics and their broader implications.

In this work, the seasonal predictive capabilities of Neural Radiance Fields (NeRF) applied to satellite images are investigated. Focusing on the utilization of satellite data, the study explores how Sat-NeRF, a novel approach in computer vision, performs in predicting seasonal variations across different months. Through comprehensive analysis and visualization, the study examines the model's ability to capture and predict seasonal changes, highlighting specific challenges and strengths. Results showcase the impact of the sun direction on predictions, revealing nuanced details in seasonal transitions, such as snow cover, color accuracy, and texture representation in different landscapes. Given these results, we propose Planet-NeRF, an extension to Sat-NeRF capable of incorporating seasonal variability through a set of month embedding vectors. Comparative evaluations reveal that Planet-NeRF outperforms prior models in the case where seasonal changes are present. The extensive evaluation combined with the proposed method offers promising avenues for future research in this domain.

This study showcases the digitalization of L\"ofstad Castle in Sweden to contribute to preserving its heritage values. The castle and its collections are deteriorating due to an inappropriate indoor climate. To address this, thirteen cloud-connected sensor boxes, equipped with 84 sensors, were installed throughout the main building, from the basement to the attic, to continuously monitor various indoor environmental parameters. The collected extensive multi-parametric data form the basis for creating a parametric digital twin of the building. The digital twin and detailed data analytics offer a deeper understanding of indoor climate and guide the adoption of appropriate heating and ventilation strategies. The results revealed the need to address high humidity problems in the basement and on the ground floor, such as installing vapor barriers. Opportunities for adopting energy-efficient heating and ventilation strategies on the upper floors were also highlighted. The digitalization solution and findings are not only applicable to L\"ofstad Castle but also provide valuable guidance for the conservation of other historic buildings facing similar challenges., Comment: This work has been submitted to the IEEE for possible publication

This paper develops an approach to categorical deformation quantization via factorization homology. We show that a quantization of the local coefficients for factorization homology is equivalent to consistent quantizations of its value on manifolds. To formulate our results we introduce the concepts of shifted almost Poisson and BD categories. Our main example is the character stack of flat principal bundles for a reductive algebraic group $G$, where we show that applying the general framework to the Drinfeld category reproduces deformations previously introduced by Li-Bland and \v{S}evera. As a direct consequence, we can conclude a precise relation between their quantization and those introduced by Alekseev, Grosse, and Schomerus. To arrive at our results we compute factorization homology with values in a ribbon category enriched over complete $\mathbb{C}[[\hbar]]$-modules. More generally, we define enriched skein categories which compute factorization homology for ribbon categories enriched over a general closed symmetric monoidal category $\mathcal{V}$., Comment: 84 pages. First version, comments and suggestions welcome

This paper explores the evolving role of health economics within economic research and publishing over the past 30 years. Historically largely a niche field, health economics has become increasingly prominent, with the share of health economics papers in top journals growing significantly. We aim to identify the factors behind this rise, examining how health economics contributes to the broader economic knowledge base and the roles distinct subfields play. Using a combination of bibliometric methods and natural language processing, we classify abstracts to define health economics. Our findings suggest that the mainstreaming of health economics is driven by innovative, high-quality research, with notable cyclicality in quality ratings that highlights the emergence and impact of distinct subfields within the discipline.

MLLM agents demonstrate potential for complex embodied tasks by retrieving multimodal task-relevant trajectory data. However, current retrieval methods primarily focus on surface-level similarities of textual or visual cues in trajectories, neglecting their effectiveness for the specific task at hand. To address this issue, we propose a novel method, MLLM as ReTriever (MART), which enhances the performance of embodied agents by utilizing interaction data to fine-tune an MLLM retriever based on preference learning, such that the retriever fully considers the effectiveness of trajectories and prioritize them for unseen tasks. We also introduce Trajectory Abstraction, a mechanism that leverages MLLMs' summarization capabilities to represent trajectories with fewer tokens while preserving key information, enabling agents to better comprehend milestones in the trajectory. Experimental results across various environments demonstrate our method significantly improves task success rates in unseen scenes compared to baseline methods. This work presents a new paradigm for multimodal retrieval in embodied agents, by fine-tuning a general-purpose MLLM as the retriever to assess trajectory effectiveness. All benchmark task sets and simulator code modifications for action and observation spaces will be released.

This paper illustrates the utility of the heat kernel on $\mathbb{Z}$ as the discrete analogue of the Gaussian density function. It is the two-variable function $K_{\mathbb{Z}}(t,x)=e^{-2t}I_{x}(2t)$ involving a Bessel function and variables $x\in\mathbb{Z}$ and real $t\geq 0$. Like its classic counterpart it appears in many mathematical and physical contexts and has a wealth of applications. Some of these will be reviewed here, concerning Bessel integrals, trigonometric sums, hypergeometric functions and asymptotics of discrete models appearing in statistical and quantum physics. Moreover, we prove a new local limit theorem for sums of integer-valued random variables, obtain novel special values of the spectral zeta function of Bethe lattices, and provide a discussion on how $e^{-2t}I_{x}(2t)$ could be useful in differential privacy., Comment: 21 pages, 2 figures

Pedestrian action prediction is of great significance for many applications such as autonomous driving. However, state-of-the-art methods lack explainability to make trustworthy predictions. In this paper, a novel framework called MulCPred is proposed that explains its predictions based on multi-modal concepts represented by training samples. Previous concept-based methods have limitations including: 1) they cannot directly apply to multi-modal cases; 2) they lack locality to attend to details in the inputs; 3) they suffer from mode collapse. These limitations are tackled accordingly through the following approaches: 1) a linear aggregator to integrate the activation results of the concepts into predictions, which associates concepts of different modalities and provides ante-hoc explanations of the relevance between the concepts and the predictions; 2) a channel-wise recalibration module that attends to local spatiotemporal regions, which enables the concepts with locality; 3) a feature regularization loss that encourages the concepts to learn diverse patterns. MulCPred is evaluated on multiple datasets and tasks. Both qualitative and quantitative results demonstrate that MulCPred is promising in improving the explainability of pedestrian action prediction without obvious performance degradation. Furthermore, by removing unrecognizable concepts from MulCPred, the cross-dataset prediction performance is improved, indicating the feasibility of further generalizability of MulCPred.

Standardization processes build upon consensus between partners, which depends on their ability to identify points of disagreement and resolving them. Large standardization organizations, like the 3GPP or ISO, rely on leaders of work packages who can correctly, and efficiently, identify disagreements, discuss them and reach a consensus. This task, however, is effort-, labor-intensive and costly. In this paper, we address the problem of identifying similarities, dissimilarities and discussion points using large language models. In a design science research study, we work with one of the organizations which leads several workgroups in the 3GPP standard. Our goal is to understand how well the language models can support the standardization process in becoming more cost-efficient, faster and more reliable. Our results show that generic models for text summarization correlate well with domain expert's and delegate's assessments (Pearson correlation between 0.66 and 0.98), but that there is a need for domain-specific models to provide better discussion materials for the standardization groups.

We show that the Kontsevich-Segal-Witten (KSW) criterion applied to the no-boundary state constrains anisotropic deformations of de Sitter space. We consider squashed $S^3$ and $S^1 \times S^2$ boundaries and find that in both models, the KSW criterion excludes a significant range of homogeneous but anisotropic configurations. For squashed $S^3$ boundaries, the excluded range includes all surface geometries with negative scalar curvature, in line with dS/CFT reasoning. For $S^1 \times S^2$ boundaries, we find that KSW selects the low-temperature regime of configuration space where the $S^1$ is sufficiently large compared to the $S^2$. In both models, the KSW criterion renders the semiclassical wave function normalizable, up to one-loop effects., Comment: 33 pages

The Mid-infrared ELT Imager and Spectrograph (METIS) is one of the first-generation scientific instruments for the ELT, built under the supervision of ESO by a consortium of research institutes across and beyond Europe. Designed to cover the 3 to 13 $\mu$m wavelength range, METIS had its final design reviewed in Fall 2022, and has then entered in earnest its manufacture, assembly, integration, and test (MAIT) phase. Here, we present the final design of the METIS high-contrast imaging (HCI) modes. We detail the implementation of the two main coronagraphic solutions selected for METIS, namely the vortex coronagraph and the apodizing phase plate, including their combination with the high-resolution integral field spectrograph of METIS, and briefly describe their respective backup plans (Lyot coronagraph and shaped pupil plate). We then describe the status of the MAIT phase for HCI modes, including a review of the final design of individual components such as the vortex phase masks, the grayscale ring apodizer, and the apodizing phase plates, as well as a description of their on-going performance tests and of our plans for system-level integration and tests. Using end-to-end simulations, we predict the performance that will be reached on sky by the METIS HCI modes in presence of various environmental and instrumental disturbances, including non-common path aberrations and water vapor seeing, and discuss our strategy to mitigate these various effects. We finally illustrate with mock observations and data processing that METIS should be capable of directly imaging temperate rocky planets around the nearest stars., Comment: 16 pages, paper presented at SPIE Astronomical Telescopes + Instrumentation 2024

One approach for increasing the efficiency of randomized trials is the use of "external controls" -- individuals who received the control treatment in the trial during routine practice or in prior experimental studies. Existing external control methods, however, can have substantial bias if the populations underlying the trial and the external control data are not exchangeable. Here, we characterize a randomization-aware class of treatment effect estimators in the population underlying the trial that remain consistent and asymptotically normal when using external control data, even when exchangeability does not hold. We consider two members of this class of estimators: the well-known augmented inverse probability weighting trial-only estimator, which is the efficient estimator when only trial data are used; and a more efficient member of the class when exchangeability holds and external control data are available, which we refer to as the optimized randomization-aware estimator. To achieve robust integration of external control data in trial analyses, we then propose a combined estimator based on the efficient trial-only estimator and the optimized randomization-aware estimator. We show that the combined estimator is consistent and no less efficient than the most efficient of the two component estimators, whether the exchangeability assumption holds or not. We examine the estimators' performance in simulations and we illustrate their use with data from two trials of paliperidone extended-release for schizophrenia.

We study multi-marginal optimal transport (MOT) problems where the underlying cost has a graphical structure. These graphical multi-marginal optimal transport problems have found applications in several domains including traffic flow control and regression problems in the Wasserstein space. MOT problem can be approached through two aspects: a single big MOT problem, or coupled minor OT problems. In this paper, we focus on the latter approach and demonstrate it has efficiency gain from the parallelization. For tree-structured MOT problems, we introduce a novel parallelizable algorithm that significantly reduces computational complexity. Additionally, we adapt this algorithm for general graphs, employing the modified junction trees to enable parallel updates. Our contributions, validated through numerical experiments, offer new avenues for MOT applications and establish benchmarks in computational efficiency.

Southeast Asia (SEA) is a region rich in linguistic diversity and cultural variety, with over 1,300 indigenous languages and a population of 671 million people. However, prevailing AI models suffer from a significant lack of representation of texts, images, and audio datasets from SEA, compromising the quality of AI models for SEA languages. Evaluating models for SEA languages is challenging due to the scarcity of high-quality datasets, compounded by the dominance of English training data, raising concerns about potential cultural misrepresentation. To address these challenges, we introduce SEACrowd, a collaborative initiative that consolidates a comprehensive resource hub that fills the resource gap by providing standardized corpora in nearly 1,000 SEA languages across three modalities. Through our SEACrowd benchmarks, we assess the quality of AI models on 36 indigenous languages across 13 tasks, offering valuable insights into the current AI landscape in SEA. Furthermore, we propose strategies to facilitate greater AI advancements, maximizing potential utility and resource equity for the future of AI in SEA., Comment: https://seacrowd.github.io/ Accepted in EMNLP 2024

We introduce an efficient computational framework for solving a class of multi-marginal martingale optimal transport problems, which includes many robust pricing problems of large financial interest. Such problems are typically computationally challenging due to the martingale constraint, however, by extending the state space we can identify them with problems that exhibit a certain sequential martingale structure. Our method exploits such structures in combination with entropic regularisation, enabling fast computation of optimal solutions and allowing us to solve problems with a large number of marginals. We demonstrate the method by using it for computing robust price bounds for different options, such as lookback options and Asian options.

Prior research demonstrates that Open AI's GPT models can predict variations in moral opinions between countries but that the accuracy tends to be substantially higher among high-income countries compared to low-income ones. This study aims to replicate previous findings and advance the research by examining how accuracy varies with different types of moral questions. Using responses from the World Value Survey and the European Value Study, covering 18 moral issues across 63 countries, we calculated country-level mean scores for each moral issue and compared them with GPT-4's predictions. Confirming previous findings, our results show that GPT-4 has greater predictive success in high-income than in low-income countries. However, our factor analysis reveals that GPT-4 bases its predictions primarily on a single dimension, presumably reflecting countries' degree of conservatism/liberalism. Conversely, the real-world moral landscape appears to be two-dimensional, differentiating between personal-sexual and violent-dishonest issues. When moral issues are categorized based on their moral domain, GPT-4's predictions are found to be remarkably accurate in the personal-sexual domain, across both high-income (r = .77) and low-income (r = .58) countries. Yet the predictive accuracy significantly drops in the violent-dishonest domain for both high-income (r = .30) and low-income (r = -.16) countries, indicating that GPT-4's one-dimensional world-view does not fully capture the complexity of the moral landscape. In sum, this study underscores the importance of not only considering country-specific characteristics to understand GPT-4's moral understanding, but also the characteristics of the moral issues at hand.

This paper presents the Nordic-Estonian Quantum Computing e-Infrastructure Quest - NordIQuEst - an international collaboration of scientific and academic organizations from Denmark, Estonia, Finland, Norway, and Sweden, working together to develop a hybrid High-Performance and Quantum Computing (HPC+QC) infrastructure. The project leverages existing and upcoming classical high-performance computing and quantum computing systems, facilitating the development of interconnected systems. Our effort pioneers a forward-looking architecture for both hardware and software capabilities, representing an early-stage development in hybrid computing infrastructure. Here, we detail the outline of the initiative, summarizing the progress since the project outset, and describing the framework established. Moreover, we identify the crucial challenges encountered, and potential strategies employed to address them., Comment: 15 pages, 2 figures

We consider the problem of ranking a set of objects based on their performance when the measurement of said performance is subject to noise. In this scenario, the performance is measured repeatedly, resulting in a range of measurements for each object. If the ranges of two objects do not overlap, then we consider one object as 'better' than the other, and we expect it to receive a higher rank; if, however, the ranges overlap, then the objects are incomparable, and we wish them to be assigned the same rank. Unfortunately, the incomparability relation of ranges is in general not transitive; as a consequence, in general the two requirements cannot be satisfied simultaneously, i.e., it is not possible to guarantee both distinct ranks for objects with separated ranges, and same rank for objects with overlapping ranges. This conflict leads to more than one reasonable way to rank a set of objects. In this paper, we explore the ambiguities that arise when ranking with ties, and define a set of reasonable rankings, which we call partial rankings. We develop and analyse three different methodologies to compute a partial ranking. Finally, we show how performance differences among objects can be investigated with the help of partial ranking., Comment: 22 pages, 21 figures

Magnetic holes (MHs) are coherent magnetic field dips whose size ranges from fluid to kinetic scale, ubiquitously observed in the heliosphere and in planetary environments. Despite the longstanding effort in interpreting the abundance of observations, the origin and properties of MHs are still debated. In this letter, we investigate the interplay between plasma turbulence and MHs, using a 2D hybrid simulation initialized with solar wind parameters. We show that fully developed turbulence exhibits localized elongated magnetic depressions, whose properties are consistent with linear MHs frequently encountered in space. The observed MHs develop self-consistently from the initial magnetic field perturbations, by trapping hot ions with large pitch angles. Ion trapping produces an enhanced perpendicular temperature anysotropy that makes MHs stable for hundreds of ion gyroperiods, despite the surrounding turbulence. We introduce a new quantity, based on local magnetic field and ion temperature values, to measure the efficiency of ion trapping, with potential applications to the detection of MHs in satellite measurements. We complement this method by analyzing the ion velocity distribution functions inside MHs. Our diagnostics reveal the presence of trapped gyrotropic ion populations, whose velocity distribution is consistent with a loss cone, as expected for the motion of particles inside a magnetic mirror. Our results have potential implications for the theoretical and numerical modelling of MHs.

The capacity of a discrete-time multiple-input-multiple-output channel with correlated phase noises is investigated. In particular, the electro-optic frequency comb system is considered, where the phase noise of each channel is a combination of two independent Wiener phase-noise sources. Capacity upper and lower bounds are derived for this channel and are compared with lower bounds obtained by numerically evaluating the achievable information rates using quadrature amplitude modulation constellations. Capacity upper and lower bounds are provided for the high signal-to-noise ratio (SNR) regime. The multiplexing gain (pre-log) is shown to be $M-1$, where $M$ represents the number of channels. A constant gap between the asymptotic upper and lower bounds is observed, which depends on the number of channels $M$. For the specific case of $M=2$, capacity is characterized up to a term that vanishes as the SNR grows large., Comment: 45 pages, 3 figures, submitted to TIT, single-column

We show that finitely generated groups which are Liouville and without infinite finite-dimensional linear representations must have a global fixed point whenever they act by isometry on a finite-dimensional complete CAT(0)-space. This provides a partial answer to an old question in geometric group theory and proves partly a conjecture formulated by Norin, Osajda, and Przytycki. It applies in particular to Grigorchuk's groups of intermediate growth and other branch groups as well as to simple groups with the Liouville property such as those found by Matte Bon and by Nekrashevych. The method of proof uses ultralimits, equivariant harmonic maps, subharmonic functions, horofunctions and random walks., Comment: 14 pages

In reaction-diffusion models of annihilation reactions in low dimensions, single-particle dynamics provides a bottleneck for reactions, leading to an anomalously slow approach to the empty state. Here, we construct a reaction model with a reciprocal bottleneck on particle dynamics where single-particle motion conserves the center of mass. We show that such a constrained reaction-diffusion dynamics does not approach an empty state but freezes at late times in a state with fragmented particle clusters, and that the late-time dynamics and asymptotic density are universal. Our setup thus constitutes a minimal model for the fragmentation of a one-dimensional lattice into independent particle clusters, and we provide exact results for the final density in the large-reaction rate limit. We suggest that the universal reaction dynamics could be observable in experiments with cold atoms or in the Auger recombination of exciton gases., Comment: 4 pages, 4 figures. Updated to agree with journal version, minor changes

Energy correlations characterize the energy flux through detectors at infinity produced in a collision event. Remarkably, in holographic conformal field theories, they probe high-energy gravitational scattering in the dual anti-de Sitter geometry. We use known properties of high-energy gravitational scattering and its unitarization to explore the leading quantum-gravity correction to the energy-energy correlator at strong coupling. We find that it includes a part originating from large impact parameter scattering that is non-analytic in the angle between detectors and is $\log N_c$ enhanced compared to the standard $1/N_c$ perturbative expansion. It is sensitive to the full bulk geometry, including the internal manifold, providing a refined probe of the emergent holographic spacetime. Similarly, scattering at small impact parameters leads to contributions that are further enhanced by extra powers of the 't Hooft coupling assuming it is corrected by stringy effects. We conclude that energy correlations are sensitive to the UV properties of the dual gravitational theory and thus provide a promising target for the conformal bootstrap., Comment: 75 pages, 6 figures

Let $G$ be an infinite, edge- and vertex-weighted graph with certain reasonable restrictions. We construct the heat kernel of the associated Laplacian using an adaptation of the parametrix approach due to Minakshisundaram-Pleijel in the setting of Riemannian geometry. This is partly motivated by the wish to relate the heat kernels of a graph and a subgraph, or of a domain and a discretization of it. As an application, assuming that the graph is locally finite, we express the heat kernel $H_G(x,y;t)$ as a Taylor series with the lead term being $a(x,y)t^r$, where $r$ is the combinatorial distance between $x$ and $y$ and $a(x,y)$ depends (explicitly) upon edge and vertex weights. In the case $G$ is the regular $(q+1)$-tree with $q\geq 1$, our construction reproves different explicit formulas due to Chung-Yau and to Chinta-Jorgenson-Karlsson. Assuming uniform boundedness of the combinatorial vertex degree, we show that a dilated Gaussian depending on any distance metric on $G$, which is uniformly bounded from below can be taken as a parametrix in our construction. Our work extends in part the recent articles [LNY21, CJKS23] in that the graphs are infinite and weighted., Comment: 23 pages