Search

Time series data has become increasingly prevalent across numerous domains, driving a growing demand for time series machine learning techniques. Among these, time series clustering (TSCL) stands out as one of the most popular machine learning tasks. TSCL serves as a powerful exploratory analysis tool and is also employed as a preprocessing step or subroutine for various tasks, including anomaly detection, segmentation, and classification. The most popular TSCL algorithms are either fast (in terms of run time) but perform poorly on benchmark problems, or perform well on benchmarks but scale poorly. We present a new TSCL algorithm, the $k$-means (K) accelerated (A) Stochastic subgradient (S) Barycentre (B) Average (A) (KASBA) clustering algorithm. KASBA is a $k$-means clustering algorithm that uses the Move-Split-Merge (MSM) elastic distance at all stages of clustering, applies a randomised stochastic subgradient gradient descent to find barycentre centroids, links each stage of clustering to accelerate convergence and exploits the metric property of MSM distance to avoid a large proportion of distance calculations. It is a versatile and scalable clusterer designed for real-world TSCL applications. It allows practitioners to balance run time and clustering performance. We demonstrate through extensive experimentation that KASBA produces significantly better clustering than the faster state of the art clusterers and is offers orders of magnitude improvement in run time over the most performant $k$-means alternatives.

Large Language Models (LLMs) and Vision Language Models (VLMs) possess extensive knowledge and exhibit promising reasoning abilities; however, they still struggle to perform well in complex, dynamic environments. Real-world tasks require handling intricate interactions, advanced spatial reasoning, long-term planning, and continuous exploration of new strategies-areas in which we lack effective methodologies for comprehensively evaluating these capabilities. To address this gap, we introduce BALROG, a novel benchmark designed to assess the agentic capabilities of LLMs and VLMs through a diverse set of challenging games. Our benchmark incorporates a range of existing reinforcement learning environments with varying levels of difficulty, including tasks that are solvable by non-expert humans in seconds to extremely challenging ones that may take years to master (e.g., the NetHack Learning Environment). We devise fine-grained metrics to measure performance and conduct an extensive evaluation of several popular open-source and closed-source LLMs and VLMs. Our findings indicate that while current models achieve partial success in the easier games, they struggle significantly with more challenging tasks. Notably, we observe severe deficiencies in vision-based decision-making, as models perform worse when visual representations of the environments are provided. We release BALROG as an open and user-friendly benchmark to facilitate future research and development in the agentic community., Comment: Preprint, under review

From CMB polarization data alone we reconstruct the CMB lensing power spectrum, comparable in overall constraining power to previous temperature-based reconstructions, and an unlensed E-mode power spectrum. The observations, taken in 2019 and 2020 with the South Pole Telescope (SPT) and the SPT-3G camera, cover 1500 deg$^2$ at 95, 150, and 220 GHz with arcminute resolution and roughly 4.9$\mu$K-arcmin coadded noise in polarization. The power spectrum estimates, together with systematic parameter estimates and a joint covariance matrix, follow from a Bayesian analysis using the Marginal Unbiased Score Expansion (MUSE) method. The E-mode spectrum at $\ell>2000$ and lensing spectrum at $L>350$ are the most precise to date. Assuming the $\Lambda$CDM model, and using only these SPT data and priors on $\tau$ and absolute calibration from Planck, we find $H_0=66.81\pm0.81$ km/s/Mpc, comparable in precision to the Planck determination and in 5.4$\sigma$ tension with the most precise $H_0$ inference derived via the distance ladder. We also find $S_8=0.850\pm0.017$, providing further independent evidence of a slight tension with low-redshift structure probes. The $\Lambda$CDM model provides a good simultaneous fit to the combined Planck, ACT, and SPT data, and thus passes a powerful test. Combining these CMB datasets with BAO observations, we find that the effective number of neutrino species, spatial curvature, and primordial helium fraction are consistent with standard model values, and that the 95% confidence upper limit on the neutrino mass sum is 0.075 eV. The SPT data are consistent with the somewhat weak preference for excess lensing power seen in Planck and ACT data relative to predictions of the $\Lambda$CDM model. We also detect at greater than 3$\sigma$ the influence of non-linear evolution in the CMB lensing power spectrum and discuss it in the context of the $S_8$ tension.(abridged), Comment: 28 pages, 21 figures + appendices

The detection of satellite thermal emission at millimeter wavelengths is presented using data from the 3rd-Generation receiver on the South Pole Telescope (SPT-3G). This represents the first reported detection of thermal emission from artificial satellites at millimeter wavelengths. Satellite thermal emission is shown to be detectable at high signal-to-noise on timescales as short as a few tens of milliseconds. An algorithm for downloading orbital information and tracking known satellites given observer constraints and time-ordered observatory pointing is described. Consequences for cosmological surveys and short-duration transient searches are discussed, revealing that the integrated thermal emission from all large satellites does not contribute significantly to the SPT-3G survey intensity map. Measured satellite positions are found to be discrepant from their two-line element (TLE) derived ephemerides up to several arcminutes which may present a difficulty in cross-checking or masking satellites from short-duration transient searches.

There is a long history of research into time series clustering using distance-based partitional clustering. Many of the most popular algorithms adapt k-means (also known as Lloyd's algorithm) to exploit time dependencies in the data by specifying a time series distance function. However, these algorithms are often presented with k-means configured in various ways, altering key parameters such as the initialisation strategy. This variability makes it difficult to compare studies because k-means is known to be highly sensitive to its configuration. To address this, we propose a standard Lloyd's-based model for TSCL that adopts an end-to-end approach, incorporating a specialised distance function not only in the assignment step but also in the initialisation and stopping criteria. By doing so, we create a unified structure for comparing seven popular Lloyd's-based TSCL algorithms. This common framework enables us to more easily attribute differences in clustering performance to the distance function itself, rather than variations in the k-means configuration.

Weak momentum dissipation in ultra-clean metals gives rise to novel non-Ohmic current flow, including ballistic and hydrodynamic regimes. Recently, hydrodynamic flow has attracted intense interest because it presents a valuable window into the electronic correlations and the longest lived collective modes of quantum materials. However, diagnosing viscous flow is difficult as the macroscopic observables of ballistic and hydrodynamic transport such as the average current distribution can be deceptively similar, even if their respective microscopics deviate notably. Based on kinetic Boltzmann theory, here we propose to address this issue via the transverse channel voltage at zero magnetic field, which can efficiently detect hydrodynamic flow in a number of materials. To this end, we show that the transverse voltage is sensitive to the interplay between anisotropic fermiology and boundary scattering, resulting in a non-trivial behavior in narrow channels along crystalline low-symmetry directions. We discuss several materials where the channel-size dependent stress of the quantum fluid leads to a characteristic sign change of the transverse voltage as a new hallmark of the cross-over from the ballistic to the hydrodynamic regime.

Recent experiments in ABC trilayer graphene detected superconductivity on the border of a phase transition to a symmetry-broken phase. In this work, we use unrestricted Hartree-Fock to study the nature of this phase. We find a close competition between two incommensurate inter-valley coherent (IVC) phases: an IVC crystal where the ordering occurs at multiple wavevectors, and an IVC spiral with a single ordering wavevector. Focusing on one of the regimes where superconductivity is observed experimentally, we find a continuous (or very weakly first order) transition between a half metallic phase to an IVC crystal, followed by a first-order transition into an IVC spiral. Using time-dependent Hartree-Fock, we study the collective mode spectrum in the half-metalic phase. We find a soft inter-valley mode that can mediate superconductivity in a narrow sliver of density near the continuous transition, with a Tc that can reach a few hundreds of mK and a sign-changing s-wave order parameter. The spin stiffness in the half metal phase is found to be surprisingly low, of the order of a few degrees Kelvin.

Despite a long history, certain aspects of excitons - the bound inter-band states which form when a valence band hole and a conduction band electron pair - have remained relatively unexplored. This holds particularly true for the wavefunction of an exciton, for which few properties have been explored theoretically in various limiting cases. An intuitive language robustly characterizing the topology of bound electron-hole states is lacking, but needed in order to address the global features of the charge distribution of the excitonic state, to properly understand their transport theory, and to supplement the numerical investigation of excitons in ab-initio approaches. Here, we address these gaps by developing a comprehensive framework for the quantum geometry and topology of two-dimensional exciton states in terms of the exact connections which describe the interaction-renormalized exciton bundle in a periodic lattice. Based on this description, we derive two gauge-invariant quantities, which we identify as the exciton shift vector and the exciton dipole vector. Using the shift vector, we elucidate the topology of exciton bands compared to the topology of the parent electronic band structure, pinpointing precisely how interactions can introduce nontrivial topology to the exciton bands beyond the topology which is contained in the single-particle bands. We further elucidate how shift and polarizations enter into the semiclassical equations of motion for the exciton center of mass coordinates., Comment: 13 pages, 1 figure

We investigate perovskite oxides from different aspects, namely their pseudoharmonic dynamical properties, their dynamical properties when strong anharmonicity exists and the intriguing functionalities arising from domain walls. Taking these viewpoints together yields a rather complex picture of this material class which was not anticipated in previous approaches. It opens pathways to novel applications and reveals the rich ground states beyond the fictitious belief in simplicity of perovskites and such structures., Comment: 28 pages, 9 figures

SuperBIT was a 0.5-meter near-ultraviolet to near-infrared wide-field telescope that launched on a NASA superpressure balloon into the stratosphere from New Zealand for a 45-night flight. SuperBIT acquired multi-band images of galaxy clusters to study the properties of dark matter using weak gravitational lensing. We provide an overview of the instrument and its various subsystems. We then present the instrument performance from the flight, including the telescope and image stabilization system, the optical system, the power system, and the thermal system. SuperBIT successfully met the instrument's technical requirements, achieving a telescope pointing stability of 0.34 +/- 0.10 arcseconds, a focal plane image stability of 0.055 +/- 0.027 arcseconds, and a PSF FWHM of ~ 0.35 arcseconds over 5-minute exposures throughout the 45-night flight. The telescope achieved a near-diffraction limited point-spread function in all three science bands (u, b, and g). SuperBIT served as a pathfinder to the GigaBIT observatory, which will be a 1.34-meter near-ultraviolet to near-infrared balloon-borne telescope., Comment: 17 pages, 25 pages, published in the Astronomical Journal

We present the detection and characterization of fluctuations in linearly polarized emission from the atmosphere above the South Pole. These measurements make use of Austral winter survey data from the SPT-3G receiver on the South Pole Telescope in three frequency bands centered at 95, 150, and 220 GHz. We use the cross-correlation between detectors to produce an unbiased estimate of the power in Stokes I, Q, and U parameters on large angular scales. Our results are consistent with the polarized signal being produced by the combination of Rayleigh scattering of thermal radiation from the ground and thermal emission from a population of horizontally aligned ice crystals with an anisotropic distribution described by Kolmogorov turbulence. The signal is most significant at large angular scales, high observing frequency, and low elevation angle. Polarized atmospheric emission has the potential to significantly impact observations on the large angular scales being targeted by searches for inflationary B-mode CMB polarization. We present the distribution of measured angular power spectrum amplitudes in Stokes Q and I for 4 years of winter observations, which can be used to simulate the impact of atmospheric polarization and intensity fluctuations at the South Pole on a specified experiment and observation strategy. For the SPT-3G data, downweighting the small fraction of significantly contaminated observations is an effective mitigation strategy. In addition, we present a strategy for further improving sensitivity on large angular scales where maps made in the 220 GHz band are used to measure and subtract the polarized atmosphere signal from the 150 GHz band maps. In observations with the SPT-3G instrument at the South Pole, the polarized atmospheric signal is a well-understood and sub-dominant contribution to the measured noise after implementing the mitigation strategies described here., Comment: 32 pages, 28 figures

The perovskite oxide EuTiO3 (ETO) has attracted increased scientific interest due to its potential multiferroic properties and magnetic activity above and below its structural phase transition at TS=282K. Various experiments have indirectly evidenced that this transition is neither a cubic tetragonal nor the only one occurring in ETO. Here, we show new results demonstrating two further instabilities below TS based on lattice dynamics and spin-phonon interactions combined with a Landau free energy model with coupled order parameters. The new transition temperatures perfectly agree with available experimental data where further instabilities have been anticipated., Comment: 14 pages, 5 figures

Understanding the nature and identity of dark matter is a key goal in the physics community. In the case that TeV-scale dark matter particles decay or annihilate into standard model particles, very-high-energy (VHE) gamma rays (greater than 100 GeV) will be present in the final state. The Very Energetic Radiation Imaging Telescope Array System (VERITAS) is an imaging atmospheric Cherenkov telescope array that can indirectly detect VHE gamma rays in an energy range of 100 GeV to > 30 TeV. Dwarf spheroidal galaxies (dSphs) are ideal candidates in the search for dark matter due to their high dark matter content, high mass-to-light ratios, and their low gamma-ray fluxes from astrophysical processes. This study uses a legacy data set of 638 hours collected on 17 dSphs, built over 11 years with an observing strategy optimized according to the dark matter content of the targets. The study addresses a broad dark matter particle mass range, extending from 200 GeV to 30 PeV. In the absence of a detection, we set the upper limits on the dark matter velocity-weighted annihilation cross section., Comment: 18 pages, 7 figures, 3 tables, accepted in PRD

In February 2017, the blazar OJ~287 underwent a period of intense multiwavelength activity. It reached a new historic peak in the soft X-ray (0.3-10 keV) band, as measured by Swift-XRT. This event coincides with a very-high-energy (VHE) $\gamma$-ray outburst that led VERITAS to detect emission above 100 GeV, with a detection significance of $10\sigma$ (from 2016 December 9 to 2017 March 31). The time-averaged VHE $\gamma$-ray spectrum was consistent with a soft power law ($\Gamma = -3.81 \pm 0.26$) and an integral flux corresponding to $\sim2.4\%$ that of the Crab Nebula above the same energy. Contemporaneous data from multiple instruments across the electromagnetic spectrum reveal complex flaring behavior, primarily in the soft X-ray and VHE bands. To investigate the possible origin of such an event, our study focuses on three distinct activity states: before, during, and after the February 2017 peak. The spectral energy distributions during these periods suggest the presence of at least two non-thermal emission zones, with the more compact one responsible for the observed flare. Broadband modeling results and observations of a new radio knot in the jet of OJ~287 in 2017 are consistent with a flare originating from a strong recollimation shock outside the radio core., Comment: 21 pages, 7 figures, accepted for publication in The Astrophysical Journal

The Super-pressure Balloon-borne Imaging Telescope (SuperBIT) is a near-diffraction-limited 0.5m telescope that launched via NASA's super-pressure balloon technology on April 16, 2023. SuperBIT achieved precise pointing control through the use of three nested frames in conjunction with an optical Fine Guidance System (FGS), resulting in an average image stability of 0.055" over 300-second exposures. The SuperBIT FGS includes a tip-tilt fast-steering mirror that corrects for jitter on a pair of focal plane star cameras. In this paper, we leverage the empirical data from SuperBIT's successful 45-night stratospheric mission to inform the FGS design for the next-generation balloon-borne telescope. The Gigapixel Balloon-borne Imaging Telescope (GigaBIT) is designed to be a 1.35m wide-field, high resolution imaging telescope, with specifications to extend the scale and capabilities beyond those of its predecessor SuperBIT. A description and analysis of the SuperBIT FGS will be presented along with methodologies for extrapolating this data to enhance GigaBIT's FGS design and fine pointing control algorithm. We employ a systems engineering approach to outline and formalize the design constraints and specifications for GigaBIT's FGS. GigaBIT, building on the SuperBIT legacy, is set to enhance high-resolution astronomical imaging, marking a significant advancement in the field of balloon-borne telescopes., Comment: 13 pages, 7 figures, SPIE Astronomical Telescopes + Instrumentation 2024

Flatband systems form a new class of materials that challenge the conventional wisdom of transport. The intrinsically strong electronic correlations combined with the vanishing kinetic energy scale suggest a sensitive dependence of transport properties on the flat band states and make interacting flat bands promising candidates for exotic quantum transport. Utilizing the Drude weight, we investigate the low-frequency spectral properties of the electrical conductivity within a controlled analytic treatment of the many-body response at temperatures above the bandwidth and the interaction strength and below the bandgap. Focusing on this new transport regime, we demonstrate the potential of a quantum geometric approach for interacting systems and intermediate temperatures. The derived spectral weight yields unexplored 4-point geometric contributions unrelated to the quantum metric, which questions the previously proposed projection methods. For long-ranged interactions, we show that the low-frequency spectral weight reduces to the variance of the Berry curvature., Comment: 7+22 pages, 3+2 figures. Clarified the connection to the spectral weight, minor corrections which do not affect the conclusions

The rapid decline in groundwater around the world poses a significant challenge to sustainable agriculture. To address this issue, agricultural managed aquifer recharge (Ag-MAR) is proposed to recharge the aquifer by artificially flooding agricultural lands using surface water. Ag-MAR requires a carefully selected flooding schedule to avoid affecting the oxygen absorption of crop roots. However, current Ag-MAR scheduling does not take into account complex environmental factors such as weather and soil oxygen, resulting in crop damage and insufficient recharging amounts. This paper proposes MARLP, the first end-to-end data-driven control system for Ag-MAR. We first formulate Ag-MAR as an optimization problem. To that end, we analyze four-year in-field datasets, which reveal the multi-periodicity feature of the soil oxygen level trends and the opportunity to use external weather forecasts and flooding proposals as exogenous clues for soil oxygen prediction. Then, we design a two-stage forecasting framework. In the first stage, it extracts both the cross-variate dependency and the periodic patterns from historical data to conduct preliminary forecasting. In the second stage, it uses weather-soil and flooding-soil causality to facilitate an accurate prediction of soil oxygen levels. Finally, we conduct model predictive control (MPC) for Ag-MAR flooding. To address the challenge of large action spaces, we devise a heuristic planning module to reduce the number of flooding proposals to enable the search for optimal solutions. Real-world experiments show that MARLP reduces the oxygen deficit ratio by 86.8% while improving the recharging amount in unit time by 35.8%, compared with the previous four years., Comment: Accepted by KDD 2024

aeon is a unified Python 3 library for all machine learning tasks involving time series. The package contains modules for time series forecasting, classification, extrinsic regression and clustering, as well as a variety of utilities, transformations and distance measures designed for time series data. aeon also has a number of experimental modules for tasks such as anomaly detection, similarity search and segmentation. aeon follows the scikit-learn API as much as possible to help new users and enable easy integration of aeon estimators with useful tools such as model selection and pipelines. It provides a broad library of time series algorithms, including efficient implementations of the very latest advances in research. Using a system of optional dependencies, aeon integrates a wide variety of packages into a single interface while keeping the core framework with minimal dependencies. The package is distributed under the 3-Clause BSD license and is available at https://github.com/ aeon-toolkit/aeon. This version was submitted to the JMLR journal on 02 Nov 2023 for v0.5.0 of aeon. At the time of this preprint aeon has released v0.9.0, and has had substantial changes., Comment: 10 pages

In recent years there has been a tremendous surge in the general capabilities of AI systems, mainly fuelled by training foundation models on internetscale data. Nevertheless, the creation of openended, ever self-improving AI remains elusive. In this position paper, we argue that the ingredients are now in place to achieve openendedness in AI systems with respect to a human observer. Furthermore, we claim that such open-endedness is an essential property of any artificial superhuman intelligence (ASI). We begin by providing a concrete formal definition of open-endedness through the lens of novelty and learnability. We then illustrate a path towards ASI via open-ended systems built on top of foundation models, capable of making novel, humanrelevant discoveries. We conclude by examining the safety implications of generally-capable openended AI. We expect that open-ended foundation models will prove to be an increasingly fertile and safety-critical area of research in the near future.

Post-Training Quantization (PTQ) enhances the efficiency of Large Language Models (LLMs) by enabling faster operation and compatibility with more accessible hardware through reduced memory usage, at the cost of small performance drops. We explore the role of calibration sets in PTQ, specifically their effect on hidden activations in various notable open-source LLMs. Calibration sets are crucial for evaluating activation magnitudes and identifying outliers, which can distort the quantization range and negatively impact performance. Our analysis reveals a marked contrast in quantization effectiveness across models. The older OPT model, upon which much of the quantization literature is based, shows significant performance deterioration and high susceptibility to outliers with varying calibration sets. In contrast, newer models like Llama-2 7B, Llama-3 8B, Command-R 35B, and Mistral 7B demonstrate strong robustness, with Mistral 7B showing near-immunity to outliers and stable activations. These findings suggest a shift in PTQ strategies might be needed. As advancements in pre-training methods reduce the relevance of outliers, there is an emerging need to reassess the fundamentals of current quantization literature. The emphasis should pivot towards optimizing inference speed, rather than primarily focusing on outlier preservation, to align with the evolving characteristics of state-of-the-art LLMs.

Contemporary bioinformatics has seen in profound new visibility into the composition, structure, and history of the natural world around us. Arguably, the central pillar of bioinformatics is phylogenetics -- the study of hereditary relatedness among organisms. Insight from phylogenetic analysis has touched nearly every corner of biology. Examples range across natural history, population genetics and phylogeography, conservation biology, public health, medicine, in vivo and in silico experimental evolution, application-oriented evolutionary algorithms, and beyond. High-throughput genetic and phenotypic data has realized groundbreaking results, in large part, through conjunction with open-source software used to process and analyze it. Indeed, the preceding decades have ushered in a flourishing ecosystem of bioinformatics software applications and libraries. Over the course of its nearly fifteen-year history, the DendroPy library for phylogenetic computation in Python has established a generalist niche in serving the bioinformatics community. Here, we report on the recent major release of the library, DendroPy version 5. The software release represents a major milestone in transitioning the library to a sustainable long-term development and maintenance trajectory. As such, this work positions DendroPy to continue fulfilling a key supporting role in phyloinformatics infrastructure.

The IceCube neutrino telescope has detected a diffuse flux of high-energy astrophysical neutrinos, but the sources of this flux have largely remained elusive. Using the 10-year IceCube public dataset, we search for correlations between neutrino events and tracers of large-scale structure (LSS). We conduct a combined cross-correlation analysis using several wide-area galaxy catalogs spanning a redshift range of z = 0.1 to z ~ 2.5 as well as maps of the cosmic infrared background. We do not detect a definitive signal, but find tantalizing hints of a potential positive correlation between neutrinos and the tracers of LSS. We additionally construct a simple model to interpret galaxy-neutrino cross-correlations in terms of the redshift distribution of neutrino sources. We put upper limits on the clustering amplitude of neutrinos based on the measured cross-correlations with galaxies and forecast the improvements on these constraints that can be obtained using future detectors. We show that, in the future, neutrino-galaxy cross-correlations should be a powerful probe to constrain properties of neutrino source populations., Comment: 17 pages, 10 figures. Matches version accepted by PRD, significantly expanded section IIIB to clarify modeling of beam

We study the prospects for measuring the cosmological distribution and abundance of ionized electrons in the intergalactic medium using galaxy surveys. Optical light from distant galaxies is subject to Thomson screening by intervening electrons which distorts the observed galaxy number density, similar to the effect of weak gravitational lensing magnification. We construct an estimator for the optical-depth fluctuations from the statistical anisotropies of galaxy number counts induced by the spatially-varying optical-depth field. We find near-future galaxy surveys can detect this signal at signal-to-noise above $\sim10$ depending on galaxy survey specifications. We highlight various science cases for the measurement of optical-depth fluctuations., Comment: 8+9 pages, 11 figures, comments welcome

We measure the stacked lensing signal in the direction of galaxy clusters in the Dark Energy Survey Year 3 (DES Y3) redMaPPer sample, using cosmic microwave background (CMB) temperature data from SPT-3G, the third-generation CMB camera on the South Pole Telescope (SPT). We estimate the lensing signal using temperature maps constructed from the initial 2 years of data from the SPT-3G 'Main' survey, covering 1500 deg$^2$ of the Southern sky. We then use this signal as a proxy for the mean cluster mass of the DES sample. In this work, we employ three versions of the redMaPPer catalogue: a Flux-Limited sample containing 8865 clusters, a Volume-Limited sample with 5391 clusters, and a Volume&Redshift-Limited sample with 4450 clusters. For the three samples, we find the mean cluster masses to be ${M}_{200{\rm{m}}}=1.66\pm0.13$ [stat.]$\pm0.03$ [sys.], $1.97\pm0.18$ [stat.]$\pm0.05$ [sys.], and $2.11\pm0.20$ [stat.]$\pm0.05$ [sys.]$\times{10}^{14}\ {\rm{M}}_{\odot }$, respectively. This is a factor of $\sim2$ improvement relative to the precision of measurements with previous generations of SPT surveys and the most constraining cluster mass measurements using CMB cluster lensing to date. Overall, we find no significant tensions between our results and masses given by redMaPPer mass-richness scaling relations of previous works, which were calibrated using CMB cluster lensing, optical weak lensing, and velocity dispersion measurements from various combinations of DES, SDSS and Planck data. We then divide our sample into 3 redshift and 3 richness bins, finding no significant tensions with optical weak-lensing calibrated masses in these bins. We forecast a $5.7\%$ constraint on the mean cluster mass of the DES Y3 sample with the complete SPT-3G surveys when using both temperature and polarization data and including an additional $\sim1400$ deg$^2$ of observations from the 'Extended' SPT-3G survey., Comment: 23 pages, 9 figures, accepted for publication in JCAP. Minor changes and corrections have been made relative to v1

We forecast constraints on cosmological parameters enabled by three surveys conducted with SPT-3G, the third-generation camera on the South Pole Telescope. The surveys cover separate regions of 1500, 2650, and 6000 ${\rm deg}^{2}$ to different depths, in total observing 25% of the sky. These regions will be measured to white noise levels of roughly 2.5, 9, and 12 $\mu{\rm K-arcmin}$, respectively, in CMB temperature units at 150 GHz by the end of 2024. The survey also includes measurements at 95 and 220 GHz, which have noise levels a factor of ~1.2 and 3.5 times higher than 150 GHz, respectively, with each band having a polarization noise level ~$\sqrt{\text{2}}$ times higher than the temperature noise. We use a novel approach to obtain the covariance matrices for jointly and optimally estimated gravitational lensing potential bandpowers and unlensed CMB temperature and polarization bandpowers. We demonstrate the ability to test the $\Lambda{\rm CDM}$ model via the consistency of cosmological parameters constrained independently from SPT-3G and Planck data, and consider the improvement in constraints on $\Lambda{\rm CDM}$ extension parameters from a joint analysis of SPT-3G and Planck data. The $\Lambda{\rm CDM}$ cosmological parameters are typically constrained with uncertainties up to ~2 times smaller with SPT-3G data, compared to Planck, with the two data sets measuring significantly different angular scales and polarization levels, providing additional tests of the standard cosmological model., Comment: 26 pages; 13 figures; Accepted for publication in ApJ; Minor edits have been made

Monochromatic gamma-ray signals constitute a potential smoking gun signature for annihilating or decaying dark matter particles that could relatively easily be distinguished from astrophysical or instrumental backgrounds. We provide an updated assessment of the sensitivity of the Cherenkov Telescope Array (CTA) to such signals, based on observations of the Galactic centre region as well as of selected dwarf spheroidal galaxies. We find that current limits and detection prospects for dark matter masses above 300 GeV will be significantly improved, by up to an order of magnitude in the multi-TeV range. This demonstrates that CTA will set a new standard for gamma-ray astronomy also in this respect, as the world's largest and most sensitive high-energy gamma-ray observatory, in particular due to its exquisite energy resolution at TeV energies and the adopted observational strategy focussing on regions with large dark matter densities. Throughout our analysis, we use up-to-date instrument response functions, and we thoroughly model the effect of instrumental systematic uncertainties in our statistical treatment. We further present results for other potential signatures with sharp spectral features, e.g.~box-shaped spectra, that would likewise very clearly point to a particle dark matter origin., Comment: 44 pages JCAP style (excluding author list and references), 19 figures; minor changes to match published version

We report results from an analysis aimed at detecting the trispectrum of the kinematic Sunyaev-Zel{'}dovich (kSZ) effect by combining data from the South Pole Telescope (SPT) and {\it Herschel}-SPIRE experiments over a 100 ${\rm deg}^{2}$ field. The SPT observations combine data from the previous and current surveys, namely SPTpol and SPT-3G, to achieve depths of 4.5, 3, and 16 $\mu {\rm K-arcmin}$ in bands centered at 95, 150, and 220 GHz. For SPIRE, we include data from the 600 and 857 GHz bands. We reconstruct the velocity-induced large-scale correlation of the small-scale kSZ signal with a quadratic estimator that uses two cosmic microwave background (CMB) temperature maps, constructed by optimally combining data from all the frequency bands. We reject the null hypothesis of a zero trispectrum at $10.3\sigma$ level. However, the measured trispectrum contains contributions from both the kSZ and other undesired components, such as CMB lensing and astrophysical foregrounds, with kSZ being sub-dominant. We use the \textsc{Agora} simulations to estimate the expected signal from CMB lensing and astrophysical foregrounds. After accounting for the contributions from CMB lensing and foreground signals, we do not detect an excess kSZ-only trispectrum and use this non-detection to set constraints on reionization. By applying a prior based on observations of the Gunn-Peterson trough, we obtain an upper limit on the duration of reionization of $\Delta z_{\rm re, 50} < 4.5$ (95\% C.L). We find these constraints are fairly robust to foregrounds assumptions. This trispectrum measurement is independent of, but consistent with, {\it Planck}'s optical depth measurement. This result is the first constraint on the epoch of reionization using the non-Gaussian nature of the kSZ signal., Comment: 15 pages, 5 figures (3 in main text and 2 in Appendix); Accepted for publication in PRL; Some texts have been moved to Appendix; Minor change in Fig. 2 to include nomalization; Data products and plotting scripts can be downloaded from https://github.com/sriniraghunathan/kSZ_4pt_SPT_SPIRE

Both text and video data are abundant on the internet and support large-scale self-supervised learning through next token or frame prediction. However, they have not been equally leveraged: language models have had significant real-world impact, whereas video generation has remained largely limited to media entertainment. Yet video data captures important information about the physical world that is difficult to express in language. To address this gap, we discuss an under-appreciated opportunity to extend video generation to solve tasks in the real world. We observe how, akin to language, video can serve as a unified interface that can absorb internet knowledge and represent diverse tasks. Moreover, we demonstrate how, like language models, video generation can serve as planners, agents, compute engines, and environment simulators through techniques such as in-context learning, planning and reinforcement learning. We identify major impact opportunities in domains such as robotics, self-driving, and science, supported by recent work that demonstrates how such advanced capabilities in video generation are plausibly within reach. Lastly, we identify key challenges in video generation that mitigate progress. Addressing these challenges will enable video generation models to demonstrate unique value alongside language models in a wider array of AI applications.

As large language models (LLMs) become increasingly prevalent across many real-world applications, understanding and enhancing their robustness to adversarial attacks is of paramount importance. Existing methods for identifying adversarial prompts tend to focus on specific domains, lack diversity, or require extensive human annotations. To address these limitations, we present Rainbow Teaming, a novel black-box approach for producing a diverse collection of adversarial prompts. Rainbow Teaming casts adversarial prompt generation as a quality-diversity problem, and uses open-ended search to generate prompts that are both effective and diverse. Focusing on the safety domain, we use Rainbow Teaming to target various state-of-the-art LLMs, including the Llama 2 and Llama 3 models. Our approach reveals hundreds of effective adversarial prompts, with an attack success rate exceeding 90% across all tested models. Furthermore, we demonstrate that fine-tuning models with synthetic data generated by the Rainbow Teaming method significantly enhances their safety without sacrificing general performance or helpfulness. We additionally explore the versatility of Rainbow Teaming by applying it to question answering and cybersecurity, showcasing its potential to drive robust open-ended self-improvement in a wide range of applications.

We introduce Genie, the first generative interactive environment trained in an unsupervised manner from unlabelled Internet videos. The model can be prompted to generate an endless variety of action-controllable virtual worlds described through text, synthetic images, photographs, and even sketches. At 11B parameters, Genie can be considered a foundation world model. It is comprised of a spatiotemporal video tokenizer, an autoregressive dynamics model, and a simple and scalable latent action model. Genie enables users to act in the generated environments on a frame-by-frame basis despite training without any ground-truth action labels or other domain-specific requirements typically found in the world model literature. Further the resulting learned latent action space facilitates training agents to imitate behaviors from unseen videos, opening the path for training generalist agents of the future., Comment: https://sites.google.com/corp/view/genie-2024/

We investigate lensing reconstruction using the clustered galaxy distribution as a source field, using both the traditional cosmic microwave background quadratic estimator and a shear-only estimator. We calculate the expected signal-to-noise ratio of the cross power spectrum of such reconstructions with cosmic shear measurements for an LSST-like galaxy survey. Modeling the galaxy field as a Gaussian random field, we find that there is substantial clustering signal in the source field at angular scales substantially smaller than those typically used by CMB reconstructions. The expected signal-to-noise for cross-correlations in LSST from cosmic shear is $\sim$60 in the presence of shape noise, while cross correlating with a sample-variance limited mass map would have signal-to-noise in the hundreds. This type of cross-correlation could be used as a way to identify systematic errors in lensing studies and is just one example of many possible higher order correlations in galaxy surveys that may contain substantial cosmological information., Comment: 11 pages, 4 figures

We present a flare star catalog from four years of non-targeted millimeter-wave survey data from the South Pole Telescope (SPT). The data were taken with the SPT-3G camera and cover a 1500-square-degree region of the sky from $20^{h}40^{m}0^{s}$ to $3^{h}20^{m}0^{s}$ in right ascension and $-42^{\circ}$ to $-70^{\circ}$ in declination. This region was observed on a nearly daily cadence from 2019-2022 and chosen to avoid the plane of the galaxy. A short-duration transient search of this survey yields 111 flaring events from 66 stars, increasing the number of both flaring events and detected flare stars by an order of magnitude from the previous SPT-3G data release. We provide cross-matching to Gaia DR3, as well as matches to X-ray point sources found in the second ROSAT all-sky survey. We have detected flaring stars across the main sequence, from early-type A stars to M dwarfs, as well as a large population of evolved stars. These stars are mostly nearby, spanning 10 to 1000 parsecs in distance. Most of the flare spectral indices are constant or gently rising as a function of frequency at 95/150/220 GHz. The timescale of these events can range from minutes to hours, and the peak $\nu L_{\nu}$ luminosities range from $10^{27}$ to $10^{31}$ erg s$^{-1}$ in the SPT-3G frequency bands.

Objective: To investigate GPT-3.5 in generating and coding medical documents with ICD-10 codes for data augmentation on low-resources labels. Materials and Methods: Employing GPT-3.5 we generated and coded 9,606 discharge summaries based on lists of ICD-10 code descriptions of patients with infrequent (generation) codes within the MIMIC-IV dataset. Combined with the baseline training set, this formed an augmented training set. Neural coding models were trained on baseline and augmented data and evaluated on a MIMIC-IV test set. We report micro- and macro-F1 scores on the full codeset, generation codes, and their families. Weak Hierarchical Confusion Matrices were employed to determine within-family and outside-of-family coding errors in the latter codesets. The coding performance of GPT-3.5 was evaluated both on prompt-guided self-generated data and real MIMIC-IV data. Clinical professionals evaluated the clinical acceptability of the generated documents. Results: Augmentation slightly hinders the overall performance of the models but improves performance for the generation candidate codes and their families, including one unseen in the baseline training data. Augmented models display lower out-of-family error rates. GPT-3.5 can identify ICD-10 codes by the prompted descriptions, but performs poorly on real data. Evaluators note the correctness of generated concepts while suffering in variety, supporting information, and narrative. Discussion and Conclusion: GPT-3.5 alone is unsuitable for ICD-10 coding. Augmentation positively affects generation code families but mainly benefits codes with existing examples. Augmentation reduces out-of-family errors. Discharge summaries generated by GPT-3.5 state prompted concepts correctly but lack variety, and authenticity in narratives. They are unsuitable for clinical practice., Comment: 15 pages; 250 words in abstract; 4,152 words in main body; 4 figures (1 black and white, 3 colour); 4 tables; 34 references; Accepted and published by the Journal of the American Medical Informatics Association

In the rapidly advancing field of multi-agent systems, ensuring robustness in unfamiliar and adversarial settings is crucial. Notwithstanding their outstanding performance in familiar environments, these systems often falter in new situations due to overfitting during the training phase. This is especially pronounced in settings where both cooperative and competitive behaviours are present, encapsulating a dual nature of overfitting and generalisation challenges. To address this issue, we present Multi-Agent Diagnostics for Robustness via Illuminated Diversity (MADRID), a novel approach for generating diverse adversarial scenarios that expose strategic vulnerabilities in pre-trained multi-agent policies. Leveraging the concepts from open-ended learning, MADRID navigates the vast space of adversarial settings, employing a target policy's regret to gauge the vulnerabilities of these settings. We evaluate the effectiveness of MADRID on the 11vs11 version of Google Research Football, one of the most complex environments for multi-agent reinforcement learning. Specifically, we employ MADRID for generating a diverse array of adversarial settings for TiZero, the state-of-the-art approach which "masters" the game through 45 days of training on a large-scale distributed infrastructure. We expose key shortcomings in TiZero's tactical decision-making, underlining the crucial importance of rigorous evaluation in multi-agent systems.

The integrated Berry curvature is a geometric property that has dramatic implications for material properties. This study investigates the integrated Berry curvature and other contributions to the anomalous Hall effect in CrGeTe$_3$ as a function of pressure. The anomalous Hall effect is absent in the insulating phase of CrGeTe$_3$ and evolves with pressure in a dome-like fashion as pressure is applied. The dome's edges are characterized by Fermi surface deformations, manifested as mixed electron and hole transport. We corroborate the presence of bipolar transport by ab-initio calculations which also predict a nonmonotonic behavior of the Berry curvature as a function of pressure. Quantitative discrepancies between our calculations and experimental results indicate that additional scattering mechanisms, which are also strongly tuned by pressure, contribute to the anomalous Hall effect in CrGeTe$_3$.

We present cosmological constraints from the abundance of galaxy clusters selected via the thermal Sunyaev-Zel'dovich (SZ) effect in South Pole Telescope (SPT) data with a simultaneous mass calibration using weak gravitational lensing data from the Dark Energy Survey (DES) and the Hubble Space Telescope (HST). The cluster sample is constructed from the combined SPT-SZ, SPTpol ECS, and SPTpol 500d surveys, and comprises 1,005 confirmed clusters in the redshift range $0.25-1.78$ over a total sky area of 5,200 deg$^2$. We use DES Year 3 weak-lensing data for 688 clusters with redshifts $z<0.95$ and HST weak-lensing data for 39 clusters with $0.6

We use the VERITAS imaging air Cherenkov Telescope (IACT) array to obtain the first measured angular diameter of $\beta$ UMa at visual wavelengths using stellar intensity interferometry (SII) and independently constrain the limb-darkened angular diameter. The age of the Ursa Major moving group has been assessed from the ages of its members, including nuclear member Merak ($\beta$ UMa), an A1-type subgiant, by comparing effective temperature and luminosity constraints to model stellar evolution tracks. Previous interferometric limb-darkened angular-diameter measurements of $\beta$ UMa in the near-infrared (CHARA Array, $1.149 \pm 0.014$ mas) and mid-infrared (Keck Nuller, $1.08 \pm 0.07$ mas), together with the measured parallax and bolometric flux, have constrained the effective temperature. This paper presents current VERITAS-SII observation and analysis procedures to derive squared visibilities from correlation functions. We fit the resulting squared visibilities to find a limb-darkened angular diameter of $1.07 \pm 0.04 {\rm (stat)} \pm 0.05$ (sys) mas, using synthetic visibilities from a stellar atmosphere model that provides a good match to the spectrum of $\beta$ UMa in the optical wave band. The VERITAS-SII limb-darkened angular diameter yields an effective temperature of $9700\pm200\pm 200$ K, consistent with ultraviolet spectrophotometry, and an age of $390\pm 29 \pm 32 $ Myr, using MESA Isochrones and Stellar Tracks (MIST). This age is consistent with $408 \pm 6$ Myr from the CHARA Array angular diameter.